Commit History

  1. Delete generate_plots.py

    Verified signature
    1d191e4
  2. docs(readme): point blog links to the HF Space copy of blog.md⁠

    7b306cb
  3. docs: clarify scenario count, OPENGRID_MODE flag; drop runtime/epoch info⁠

    2f2ff77
  4. Polish for hackathon submission: training evidence, two pipelines, UI, docs⁠

    e81353d
  5. Fix health check timeout: start UI server in background before training

    89992e4
  6. Print every reward call so terminal shows continuous progress⁠

    81257d9
  7. Reduce prompt/completion length to fix silent OOM on backward pass

    a76abcc
  8. Replace env-simulation reward with fast pure-heuristic to fix hang⁠

    efbeb4b
  9. Fix batch/num_generations: 4/4 on 1 GPU, grad_accum=4

    114859b

  1. Trigger HF Space rebuild for batch_size=4 fix⁠

    d50432b
  2. Fix GRPO training: reward variance, batch/gen alignment, generation config⁠

    e1ab78c
  3. Update run_training.py and train_grpo.py, remove Dockerfile.training

    7be88b4
  4. Add pre-train gen sanity check, explicit GenerationConfig, dynamic GRPOConfig params, torch_compile/vllm off

    a6ecb81
  5. QLoRA best practices: prepare_model_for_kbit_training, paged_adamw_8bit, cosine LR, faster iteration

    8dab919
  6. Fix: enable_input_require_grads for gradient checkpointing + 4-bit

    c505237
  7. Fix OOM: reduce batch/gen/tokens, add grad checkpointing + adafactor

    c09f4cb
  8. Fix batch size: 8 to match num_generations=8

    8d94e97
  9. Drop unsloth: use standard bitsandbytes 4-bit + peft LoRA + TRL GRPOTrainer

    6072ace
  10. Pin transformers <4.52 and unsloth_zoo==2025.11.1 for API compat

    b724812
  11. Pin TRL <0.16 for unsloth 2025.11.1 GRPO API compatibility

    08c4515
  12. Dynamic NVIDIA lib path discovery in entrypoint for bitsandbytes

    c7e8b79
  13. Add LD_LIBRARY_PATH for pip-installed NVIDIA libs (bitsandbytes fix)

    f9c90fc
  14. Add torchvision and hf_transfer

    00b8117
  15. Remove torchao entirely - transformers handles absence gracefully

    d4e5470
  16. Fix: install torchao 0.8.0 separately, unsloth --no-deps to avoid torchao>=0.13 conflict

    f4d773c
  17. Pin compatible versions: torch 2.6.0 + torchao <0.9 + transformers <5.0

    9b70933
  18. Update CUDA to 12.4.1 and unpin PyTorch version to fix torchao/int1 compatibility

    371b620
  19. Remove --no-deps to allow installing sub-dependencies like regex

    3c0ad6e
  20. Add explicit compiler location debugging in run_training.py

    1991472
  21. Explicitly install gcc, g++, python3-dev and set CC/CXX

    8bac226
  22. Add build-essential for Triton compilation

    2b3d2c3
  23. GRPO training with CUDA + results in UI

    bcce6af
  24. fix: notebook uses compute_grpo_reward_env, updated hyperparams, no emojis

    69bab30
  25. fix: remove ENV OPENGRID_MODE to avoid HF secrets collision

    be15396
  26. fix: transformers>=4.51.3 to resolve unsloth dep conflict

    3313fd3
  27. fix: add unsloth back with pinned versions to avoid dep backtracking

    689cb35
  28. fix: lean Dockerfile + remove unsloth from training deps

    b2a04c7
  29. fix: unified Dockerfile with entrypoint for server/training mode⁠

    1dfed79
  30. fix: update .dockerignore for new repo structure

    db3026a
  31. feat: curriculum training + Karnataka scenarios + repo cleanup⁠

    8a02303
  32. restore env Dockerfile

    5ba53f6
  33. training dockerfile

    05e16e8
  34. fix: total_memory attribute name

    8cdf625
  35. Restore env Dockerfile

    7299ddc
  36. Use training Dockerfile for GPU Space

    af0b804
  37. Add GRPO training runner for HF Spaces GPU

    7bcd08c

  1. OpenGrid: Multi-agent POMDP power grid environment with GRPO training⁠

    78131a0