sparrow8i8's picture
Anchor eval: TAC (fixed, 52) + Betley + HarvestBench + retention
e23e213 verified
Raw History Blame Contribute Delete
307 Bytes
{
"arm": "olmo-compassion",
"n_docs": 200,
"max_tokens": 2048,
"results": {
"pretrained": {
"loss": 2.9418,
"retained": 0.0
},
"midtrained": {
"loss": 1.6292,
"retained": 1.0
},
"CompassioninMachineLearning/olmo-compassion-part1": {
"loss": 1.8694,
"retained": 0.817
}
}
}