14 days ago
-
Eval cells now record turns/tool_calls/completion+prompt tokens; summary gets efficiency-vs-base ratios
-
Resilient worker (transient CaptureContractError -> unscorable, systematic still fatal), resume-from-repo, eval worker base-cells download fix
15 days ago
-
Eval robustness: fresh HarborEnv client per rollout (openenv reconnect bug); failed checkpoint evals retried next poll
-
Add per-checkpoint eval worker (eval_watch.py + run_eval_watch.sh); ONLY_MODEL mode in eval_adapter.py