sparrow8i8's picture
Anchor eval: TAC (fixed, 52) + Betley + HarvestBench + retention
ccc2ad1 verified
Raw History Blame Contribute Delete
310 Bytes
{
"arm": "olmo-compassion-s1",
"n_docs": 200,
"max_tokens": 2048,
"results": {
"pretrained": {
"loss": 2.9418,
"retained": 0.0
},
"midtrained": {
"loss": 1.629,
"retained": 1.0
},
"CompassioninMachineLearning/olmo-compassion-s1-part1": {
"loss": 1.865,
"retained": 0.82
}
}
}