Spaces:
Sleeping
Sleeping
Commit History
-
Results tab: three corpora — add held-out OlympiadBench (58.1%) alongside PRM800K (~0.1%) and SciBench (83.4%)
tomyimkca36d178
-
Results tab: lead with the measured boundary (~0.1% NL reasoning vs 83.4% unit-bearing), demote the planted 67/67 to a labelled self-test
tomyimkc3a2ec86 -
Wire Self-Judge + Step-Verify; stop the step checker silently passing wrong arithmetic
tomyimkcThe Space advertised Generate -> Self-Judge -> Step-Verify -> Final Verdict, but Self-Judge buttons were never bound to a click handler and step_checker.py was not deployed at all. Both now run in every model column. Correctness fixes in the step checker: - No silent pass. A flat 1% relative tolerance accepted "500 * 4.18 * 60 = 125000" (true 125400). The arithmetic check is now three-state: verified when it agrees to floating-point precision, error when it differs by more than the written precision, and unchecked when only rounding could explain the gap. - No crash on physics variable names. sympify resolves Q, N, S, O, beta and gamma to non-expression singletons with no .free_symbols; this Space ships a Lorentz-factor (gamma) challenge, so it was reachable. _safe_eval now fails closed on any non-Expr result. - Units no longer force a blanket abstain. A trailing unit is stripped for the arithmetic check only; dimensions remain the SI verifier's job. - Answer extraction …8f5fb99
-
Speed: 2 models (drop slow DeepSeek), max_tokens=400, timeout=30s
tomyimkc1db7af5 -
Redesign: multi-model parallel UI — one prompt, 3 LLMs, side-by-side comparison
tomyimkc83a00a9 -
Fix all 6 issues: LaTeX strip, coefficients regex, circular multi-word, Faraday unit, step checker LaTeX, bare number extraction
tomyimkce61c915 -
Fix: auto-fallback models (Qwen→Llama-3.3-70B→DeepSeek-V3)
tomyimkc46e62f2 -
Fix: strip LaTeX markup before extraction (\boxed, \text, etc.)
tomyimkc635f12c -
Fix: step_checker handles dict steps from _parse_cot_steps
tomyimkcf0e80d1 -
Initial deploy: polished demo with Qwen2.5-7B API + step verification + 7 challenges
tomyimkcb6e520e -
initial commit
Verified signaturee2f52d5