Openenv / cloud_arena

Commit History

  1. Fix torch bfloat16 errors on T4 GPUs by enabling Unsloth dtype auto-detection and explicitly wrapping forward passes in autocast

    4b22b06
  2. Add mandatory Unsloth inference state toggles around generation for RL pipeline

    81ed883
  3. Capture and display exact Unsloth import exception

    fbf8187
  4. Update with existing environment

    d81b76a
  5. Fix GRPO group-loss training and align UI defaults.⁠

    5a0c6af
  6. Migrate LLM pipeline to custom GRPO with robust rewards⁠

    dfc5996

  1. Multi-model benchmark pipeline: VRAM cleanup + EMA graph + detailed output

    af6bbef
  2. Fix truncation: 80 tokens, regex safety net, strict prompt

    deef82c
  3. Hackathon speedrun: max_new_tokens=32, seq_len=512 for 4-8x faster iterations

    ee5ddee
  4. Replace flash-attn with PyTorch built-in SDPA (no CUDA compile needed)

    e9dea07
  5. Max GPU utilization: flash-attn2 + grad accumulation + 15 steps/ep + 1024 seq len

    93d0171
  6. Switch to Llama 3.1 8B + fix low-timestep crash (min 5000)

    8d95050
  7. Add LLM RL training with Gemma 7B + LoRA

    ee3dfa7
  8. Add Cloud Arena Mathematical Model RL environment

    12263fa