chaoliangUNSW's picture
Publish validated v4.2 hf candidate
ed75eab verified
Raw History Blame Contribute Delete
814 Bytes
{
"what": "Render check for the v4 GGUF / MLX runtimes (2026-10-28; tokenisation only, no model): the runtimes' own renderer\n(shared core: ``tokenizers`` + readout_config.json) must give exactly the token ids, attention blocks, slots, state\nlength, option names and catalogue flag of the reference renderer (macjev RendererV2 with the transformers\ntokenizer of the main repository) on every question of both fixtures, and score_many's shared-prefix rendering must\nequal rendering each question alone.",
"runtime_sha256": "08ec610bae616145fb63d7c32498abd9213b2d2a5f3d9f4835cc2eff6f8b3a71",
"fixtures": {
"gate_fixture_n1000.jsonl": {
"questions": 1000,
"tokens": 516376
},
"base_fixture.jsonl": {
"questions": 97,
"tokens": 1383602
}
},
"mismatches": [],
"ok": true,
"seconds": 10.6
}