s5-lite / space.json
maxgfr's picture
Publish the s5-lite demo
3db69c7 verified
Raw History Blame Contribute Delete
667 Bytes
{
"model": "s5-lite",
"title": "s5-lite",
"tagline": "A 17M-parameter decision model whose options cannot see each other: reordering the options or renaming their keys cannot change an answer.",
"kind": "decision",
"proofs": true,
"model_repo": "https://huggingface.co/maxgfr/s5-lite",
"notes": [
"This checkpoint is a longer run (8,000 steps) added for the demo outside the pre-registered bets; see the results page for what failed and why.",
"It answers 21 of the 30 English demo cases: expect mistakes, especially on incidents and severity."
],
"game": null,
"gate": null,
"gate_kind": null,
"gate_note": null,
"gate_url": null
}