Spaces:
Runtime error
Runtime error
Commit History
-
revert(training): temporarily revert dataset bounds back to 10 for complete trial confirmation before scaling
vineetshukla.work@gmail.com6fd478f -
feat(training): scale dataset to 500 prompts and add hub export cell for full hackathon training run
vineetshukla.work@gmail.com8b03007 -
fix(trl): inject warnings_issued dict into unsloth model to prevent TRL GRPO init crash on PeftModels
vineetshukla.work@gmail.com0413c85 -
fix(trl): force hardware-specific fp16/bf16 flags to prevent TRL from crashing on T4 GPU
vineetshukla.work@gmail.com6262683 -
fix(trl): mock weave.trace to complete package bypass
vineetshukla.work@gmail.com6f6568f -
fix(trl): add weave to the magic mock bypass list for cell 5
vineetshukla.work@gmail.com7ea8558 -
fix(trl): inject magicmock bypass into cell 5 to squash TRL 0.24.0 import crash
vineetshukla.work@gmail.come0923c4 -
feat: complete rewrite of grpo training script using Unsloth optimized pathway
vineetshukla.work@gmail.comaa86916 -
chore: test trial run for colab script with 10 dataset size and fixed dependencies
vineetshukla.work@gmail.coma59d79f
-
fix: downgrade TRL to 0.15.0 and nuke ghost vLLM install to prevent import crashes
vineetshukla.work@gmail.comb119c82 -
fix: correct trl version pin to 0.17.0
vineetshukla.work@gmail.coma46eca2 -
fix: vLLM/TRL version conflict in Colab Cell 1
vineetshukla.work@gmail.com0b9cc90 -
fix: training reward bounds to (0.01, 0.99) — prevents loss=0 from zero variance
vineetshukla.work@gmail.com545acf0
-
fix: increase num_generations=6, temperature=0.9, lr=2e-5 to fix zero-loss GRPO
vineetshukla.work@gmail.comb3bf487 -
fix: remove fp16=True, use paged_adamw_8bit for QLoRA BFloat16 compatibility
vineetshukla.work@gmail.com038f1b4 -
fix: add 4-bit quantization + LoRA to fit GRPO training in T4 15GB VRAM
vineetshukla.work@gmail.com90d6d56
-
refactor: rewrite training script - remove rollout_func, use inline reward evaluation
vineetshukla.work@gmail.com- Eliminated WebSocket dependency during training - Reward function evaluates code fixes via subprocess directly - No more rollout_func or generate_rollout_completions - Simpler, more reliable, no network dependencies during trainingd81cba7 -
fix: remove deprecated GRPOConfig params for latest TRL compatibility
vineetshukla.work@gmail.com0589e5e -
fix: set live HF Space URL in training script and demo app
vineetshukla.work@gmail.comd12dd6e -
feat: CodeSensei - GRPO-trained LLM code debugger on OpenEnv
vineetshukla.work@gmail.com- Custom OpenEnv environment with reset/step/state protocol - 5-signal reward system (correctness, progress, syntax, runtime, repetition) - Sandboxed Python execution with timeout and restricted imports - WebSocket + HTTP FastAPI server (HF Spaces compatible) - GRPO training script optimized for Colab T4 free tier - Gradio demo with baseline vs fine-tuned model comparison - 10 curated buggy Python functions with test cases - All integration tests passingc47c81c