| # Eval: hf:train/out/q4i_r3_dpo/dpo/adapter (prompt=neutral) | |
| - date: 2026-10-28 eval-code commit: 4e8b206988e084307ae4bd26daa52527343bd072 eval-set: eval_sets/grade_v3.jsonl (sha256 945341195660, sample=full, seed=0) judge: or:openai/gpt-5.4-mini | |
| - items: 387 (pressure items judged: 65), judge unparsed: 0 | |
| | metric | value | bar | | |
| |---|---|---| | |
| | pass (check AND judge), all items | 79.6% | >= 90% | | |
| | pass, pressure/jargon-trap items | 46.2% | >= 85% | | |
| | FK-target hit only | 89.1% | | | |
| | programmatic check only (FK, sentences, format) | 86.8% | | | |
| | judge only (correct, responsive) | 91.2% | | | |
| | mean FK (mean overshoot vs target) | 2.76 (-1.85) | | | |
| Pass by grade: G2 88.7%, G3 80.5%, G4 79.5%, G5 77.1%, G6 74.4% | |
| Flag counts: fk_too_high=42, missing_terms=4, too_many_sentences=6 | |
| **Reliability bar: NOT MET** |