Spaces:
Sleeping
Sleeping
Commit History
-
feat: continuous PPO training + live web dashboard
Aksh Parekh +1: Claude Sonnet 4.6- Replace server/app.py with FastAPI continuous training loop - PPO training runs in background thread (no manual stepping) - Live dashboard: 2D road canvas on left, reward chart + episode log on right - SSE + polling for real-time updates (0.5s heartbeat) - Capped reward mode: min(reward, 2.0) per step - Uncapped reward mode: base + token_count * 0.001 (frontier LLM scaling) - Toggle capped/uncapped via UI button or POST /api/mode - Curriculum stage display with pip indicators - PPO losses (pg/vf/entropy) shown live - Dockerfile cleaned: removed openenv-core dep to avoid websockets conflict Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>71efc66