Spaces:
Runtime error
Runtime error
Commit History
-
KW-WM proof: reward prediction beats baselines by 38.8-71.7%
World model training results (727 transitions, 50 episodes): Reward prediction g(s,a) → r: - Beats mean-pred baseline by 38.8% (MSE 0.064 vs 0.104) - Beats random baseline by 71.7% (MSE 0.064 vs 0.225) - 75.3% directional accuracy (above/below 0.5) → Enables model-based planning without environment interaction State prediction f(s,a) → s': - Beats random by 6.0% (MSE 0.037 vs 0.039) - Copy baseline (s'=s) at 0.024 remains strong target This proves CodeReviewEnv transitions are LEARNABLE — the first empirical evidence for Knowledge-Work World Models.cf9e328 -
Fix all 4 remaining issues for hackathon
1. comments=3 frozen: Server now rebuilds obs after add_comment (task_hard track comments, server updates state on each comment) 2. Heuristic > LLM: Fixed eval_live.py hard scoring to use decision-only rewards (not intermediate ack rewards) 3. 20 → 50 PR templates: Added 30 new PRs across 7 languages (python, java, go, js, typescript, rust, ruby), all 8 bug categories. Expanded PRFile language validator. 4. World model trained: Added train_world_model.py with - Pure Python MLP (no PyTorch/TF dependency) - 340 transitions, 100 epochs - Copy baseline 0.025, model 0.047 - Documents the research challenge for KW-WM7e55f05