olmo-compassion-s1-part1 / eval /retention.json
sparrow8i8's picture
Anchor eval: TAC (fixed, 52) + Betley + HarvestBench + retention
c723fd3 verified
Raw History Blame Contribute Delete
312 Bytes
{
"arm": "olmo-compassion-s1",
"n_docs": 200,
"max_tokens": 2048,
"results": {
"pretrained": {
"loss": 2.9418,
"retained": 0.0
},
"midtrained": {
"loss": 1.629,
"retained": 1.0
},
"CompassioninMachineLearning/olmo-compassion-s1-part1": {
"loss": 1.8078,
"retained": 0.864
}
}
}