Commit History

  1. Upload folder using huggingface_hub

    Verified signature
    98dce4a
  2. Upload folder using huggingface_hub

    Verified signature
    23d9813
  3. Clean up: remove build artifacts, debug logs, old notebook, internal docs

    Verified signature
    c4e8937
  4. Upload folder using huggingface_hub

    Verified signature
    6c62fb1
  5. Fix plot crash: filter None values from metrics before np.convolve

    Verified signature
    4728f59
  6. Upload artifacts/baseline_vs_trained.png with huggingface_hub

    Verified signature
    df3e8b5
  7. Upload artifacts/training_health.png with huggingface_hub

    Verified signature
    e695c2f
  8. Upload artifacts/loss_curve.png with huggingface_hub

    Verified signature
    b6d4d4d
  9. Upload artifacts/reward_curve.png with huggingface_hub

    Verified signature
    075873a
  10. Fix plot NoneType bug in rewards/entropy lists"

    Verified signature
    b0e5cb2
  11. Redesigned train_job.py: fix reward signal (100x), DAPO-style GRPO, curriculum learning

    Verified signature
    daceb77
  12. Upload redesigned train_job.py header (full upload via job)

    Verified signature
    5e7e929
  13. Upload folder using huggingface_hub

    Verified signature
    280be27

  1. Upload folder using huggingface_hub

    Verified signature
    9a03233
  2. Upload folder using huggingface_hub

    Verified signature
    22c2a42
  3. Upload folder using huggingface_hub

    Verified signature
    6ff212f
  4. Upload folder using huggingface_hub

    Verified signature
    589f1cb
  5. Delete round2-hackathon-spec.txt

    Verified signature
    ccc27e0
  6. Delete OpenEnv Hackathon - Provided Resources and Guidelines.pdf

    Verified signature
    8abfce0
  7. Add anti-reward-hacking test suite: scan_logs spam, false positive exploitation, conclude gaming, repeat action exploit"

    Verified signature
    8a72c51
  8. Fix train_grpo.py: rename SFT path, add actual GRPO CLI entrypoint with wired-in procedural gen + trajectory filter + adversarial attacker"

    Verified signature
    5214eea
  9. Upload folder using huggingface_hub

    Verified signature
    f876b60
  10. Rewrite README as clear project blog with all features documented"

    Verified signature
    95852d4
  11. Fix: set response_schema for Qwen2.5 tool-calling + add jmespath dep

    Verified signature
    598c4c8
  12. Remove temp file

    Verified signature
    dd45c68
  13. Fix: remove max_prompt_length (removed in TRL 1.x, Unsloth rejects it)

    Verified signature
    93ce912
  14. Remove max_prompt_length from GRPOConfig (removed in TRL 1.x, Unsloth rejects it)"

    Verified signature
    f6cacba
  15. Fix dtype='auto' -> None for Unsloth compatibility (T4 requires float16, Unsloth auto-detects with None)"

    Verified signature
    62e0566
  16. Fix total_mem bug + integrate procedural gen, security APIs, StarPO-S, adversarial attacker into notebook"

    Verified signature
    2b7135f
  17. Add adversarial attacker for self-play curriculum\n\nReference: SPIRAL (arXiv 2506.24119)\nAdaptive attacker that adds decoys, obscures IOCs, tightens deadlines,\nand exploits defender blind spots. Creates automatic difficulty scaling."

    Verified signature
    93a36f8
  18. Add StarPO-S trajectory filtering for GRPO stability\n\nReference: RAGEN (arXiv 2504.20073)\nFilters to keep only informative rollouts, preventing echo trap collapse."

    Verified signature
    60fa6a8
  19. Add real-world security API integrations (OSV.dev, deps.dev, GHSA, npm)\n\nFree, no-auth-required live lookups against security databases.\nAdds genuine information-gathering vs time-pressure tradeoff."

    Verified signature
    581cdcc
  20. Add procedural scenario generation (infinite training variation)\n\nGenerates unique supply-chain incidents from parameterized distributions.\nReference: Self-Evolving Curriculum (arXiv 2505.14970)"

    Verified signature
    1053202
  21. Replace notebook with complete GRPO training pipeline (TRL environment_factory + Unsloth QLoRA)

    Verified signature
    5d6d233
  22. Upload folder using huggingface_hub

    Verified signature
    4f73b89

  1. Upload folder using huggingface_hub

    Verified signature
    bccfde3
  2. Upload folder using huggingface_hub

    Verified signature
    cd43a41
  3. Upload folder using huggingface_hub

    Verified signature
    60f4610
  4. Upload folder using huggingface_hub

    Verified signature
    b25217e
  5. Upload folder using huggingface_hub

    Verified signature
    26bb614
  6. Upload folder using huggingface_hub

    Verified signature
    193594b
  7. Upload folder using huggingface_hub

    Verified signature
    580d6c5
  8. Upload folder using huggingface_hub

    Verified signature
    5080156

  1. Upload folder using huggingface_hub

    Verified signature
    6ce2d71
  2. Upload folder using huggingface_hub

    Verified signature
    be61f2e

  1. Upload folder using huggingface_hub

    Verified signature
    6580817
  2. Upload folder using huggingface_hub

    Verified signature
    a9fc425
  3. Upload folder using huggingface_hub

    Verified signature
    1a65381
  4. Upload folder using huggingface_hub

    Verified signature
    830f11e
  5. initial commit

    Verified signature
    a75efad