shank commited on
Commit
de4232f
ยท
1 Parent(s): 0b1d886

Updated readme

Browse files
Files changed (1) hide show
  1. README.md +3 -5
README.md CHANGED
@@ -12,8 +12,6 @@ pinned: false
12
 
13
  **Hackathon Links:**
14
  - ๐ŸŒŒ **[Live Hugging Face Space](https://huggingface.co/spaces/agentDebugger/AgentDebugger-training-v3)**
15
- - ๐Ÿ“Š **[Model Leaderboard Space](https://huggingface.co/spaces/shashaank0707/AgentDebugger-leaderboard)** *(coming soon)*
16
- - ๐Ÿ“น **[Watch the 2-Minute Demo](#)** *(Replace with YouTube Link)*
17
  - ๐Ÿ“ **[Read the Technical Writeup](./Blog.md)**
18
 
19
  ### ๐Ÿš€ One-Line Pitch
@@ -37,14 +35,14 @@ LLMs often hallucinate bug fixes via blind trial-and-error. Real debugging in pr
37
  * **Live Monitor:** A Gradio dashboard streaming `stdout` and Weights & Biases metrics directly from the active training container.
38
 
39
  ### โšก What Makes This Impressive
40
- * **Zero-to-One in 250 Steps:** Achieved a ~2.5x increase in total reward within just 250 steps, demonstrating extreme sample efficiency via GRPO.
41
  * **Dynamic Hardware Scaling:** The training pipeline natively detects hardware capability (A100/H100 vs. T4) and automatically scales `batch_size`, `grad_accum`, and compute `dtype` (`bfloat16`/`float16`)โ€”eliminating OOM errors across deployment environments.
42
  * **Frictionless Deployment:** Bypassed heavy dependency constraints (PyTorch/TRL vs. Gradio PIP conflicts) by engineering a lazy-loading runtime environment that ensures deterministic Docker builds.
43
 
44
  ### ๐Ÿ› ๏ธ Tech Stack
45
  * **Frameworks:** OpenEnv, FastAPI, Docker
46
  * **RL Pipeline:** HuggingFace TRL (GRPO), Peft (LoRA)
47
- * **Models:** Qwen2.5-Coder-7B-Instruct (Base), Llama-3.1-70B (Evaluator)
48
  * **Telemetry:** Weights & Biases
49
 
50
  ### ๐Ÿ“Š Results & Benchmarks
@@ -67,7 +65,7 @@ Our training run clearly demonstrates rapid policy adaptation. The model success
67
  ![Gradio UI Training Monitor](https://raw.githubusercontent.com/shasshaank/AgentDebuggerEnv/main/images/gradio%20UI.png)
68
 
69
  * **Format Compliance:** Scaled to 1.0 (max) within 50 steps.
70
- * **Total Reward:** Scaled from baseline ~0.4 to peaks of ~1.0 by step 250.
71
  * **Baseline Solve Rate:** 100.0% validation on tiered data structure.
72
 
73
  ### ๐Ÿ”ฅ Challenges & How They Were Solved
 
12
 
13
  **Hackathon Links:**
14
  - ๐ŸŒŒ **[Live Hugging Face Space](https://huggingface.co/spaces/agentDebugger/AgentDebugger-training-v3)**
 
 
15
  - ๐Ÿ“ **[Read the Technical Writeup](./Blog.md)**
16
 
17
  ### ๐Ÿš€ One-Line Pitch
 
35
  * **Live Monitor:** A Gradio dashboard streaming `stdout` and Weights & Biases metrics directly from the active training container.
36
 
37
  ### โšก What Makes This Impressive
38
+ * **Zero-to-One in 500 Steps:** Achieved a ~2.5x increase in total reward within 500 steps, demonstrating extreme sample efficiency via GRPO.
39
  * **Dynamic Hardware Scaling:** The training pipeline natively detects hardware capability (A100/H100 vs. T4) and automatically scales `batch_size`, `grad_accum`, and compute `dtype` (`bfloat16`/`float16`)โ€”eliminating OOM errors across deployment environments.
40
  * **Frictionless Deployment:** Bypassed heavy dependency constraints (PyTorch/TRL vs. Gradio PIP conflicts) by engineering a lazy-loading runtime environment that ensures deterministic Docker builds.
41
 
42
  ### ๐Ÿ› ๏ธ Tech Stack
43
  * **Frameworks:** OpenEnv, FastAPI, Docker
44
  * **RL Pipeline:** HuggingFace TRL (GRPO), Peft (LoRA)
45
+ * **Models:** Qwen2.5-Coder-3B-Instruct (Base), Llama-3.1-70B (Evaluator)
46
  * **Telemetry:** Weights & Biases
47
 
48
  ### ๐Ÿ“Š Results & Benchmarks
 
65
  ![Gradio UI Training Monitor](https://raw.githubusercontent.com/shasshaank/AgentDebuggerEnv/main/images/gradio%20UI.png)
66
 
67
  * **Format Compliance:** Scaled to 1.0 (max) within 50 steps.
68
+ * **Total Reward:** Scaled from baseline ~0.4 to peaks of ~1.0 by step 500.
69
  * **Baseline Solve Rate:** 100.0% validation on tiered data structure.
70
 
71
  ### ๐Ÿ”ฅ Challenges & How They Were Solved