shank commited on
Commit ยท
de4232f
1
Parent(s): 0b1d886
Updated readme
Browse files
README.md
CHANGED
|
@@ -12,8 +12,6 @@ pinned: false
|
|
| 12 |
|
| 13 |
**Hackathon Links:**
|
| 14 |
- ๐ **[Live Hugging Face Space](https://huggingface.co/spaces/agentDebugger/AgentDebugger-training-v3)**
|
| 15 |
-
- ๐ **[Model Leaderboard Space](https://huggingface.co/spaces/shashaank0707/AgentDebugger-leaderboard)** *(coming soon)*
|
| 16 |
-
- ๐น **[Watch the 2-Minute Demo](#)** *(Replace with YouTube Link)*
|
| 17 |
- ๐ **[Read the Technical Writeup](./Blog.md)**
|
| 18 |
|
| 19 |
### ๐ One-Line Pitch
|
|
@@ -37,14 +35,14 @@ LLMs often hallucinate bug fixes via blind trial-and-error. Real debugging in pr
|
|
| 37 |
* **Live Monitor:** A Gradio dashboard streaming `stdout` and Weights & Biases metrics directly from the active training container.
|
| 38 |
|
| 39 |
### โก What Makes This Impressive
|
| 40 |
-
* **Zero-to-One in
|
| 41 |
* **Dynamic Hardware Scaling:** The training pipeline natively detects hardware capability (A100/H100 vs. T4) and automatically scales `batch_size`, `grad_accum`, and compute `dtype` (`bfloat16`/`float16`)โeliminating OOM errors across deployment environments.
|
| 42 |
* **Frictionless Deployment:** Bypassed heavy dependency constraints (PyTorch/TRL vs. Gradio PIP conflicts) by engineering a lazy-loading runtime environment that ensures deterministic Docker builds.
|
| 43 |
|
| 44 |
### ๐ ๏ธ Tech Stack
|
| 45 |
* **Frameworks:** OpenEnv, FastAPI, Docker
|
| 46 |
* **RL Pipeline:** HuggingFace TRL (GRPO), Peft (LoRA)
|
| 47 |
-
* **Models:** Qwen2.5-Coder-
|
| 48 |
* **Telemetry:** Weights & Biases
|
| 49 |
|
| 50 |
### ๐ Results & Benchmarks
|
|
@@ -67,7 +65,7 @@ Our training run clearly demonstrates rapid policy adaptation. The model success
|
|
| 67 |

|
| 68 |
|
| 69 |
* **Format Compliance:** Scaled to 1.0 (max) within 50 steps.
|
| 70 |
-
* **Total Reward:** Scaled from baseline ~0.4 to peaks of ~1.0 by step
|
| 71 |
* **Baseline Solve Rate:** 100.0% validation on tiered data structure.
|
| 72 |
|
| 73 |
### ๐ฅ Challenges & How They Were Solved
|
|
|
|
| 12 |
|
| 13 |
**Hackathon Links:**
|
| 14 |
- ๐ **[Live Hugging Face Space](https://huggingface.co/spaces/agentDebugger/AgentDebugger-training-v3)**
|
|
|
|
|
|
|
| 15 |
- ๐ **[Read the Technical Writeup](./Blog.md)**
|
| 16 |
|
| 17 |
### ๐ One-Line Pitch
|
|
|
|
| 35 |
* **Live Monitor:** A Gradio dashboard streaming `stdout` and Weights & Biases metrics directly from the active training container.
|
| 36 |
|
| 37 |
### โก What Makes This Impressive
|
| 38 |
+
* **Zero-to-One in 500 Steps:** Achieved a ~2.5x increase in total reward within 500 steps, demonstrating extreme sample efficiency via GRPO.
|
| 39 |
* **Dynamic Hardware Scaling:** The training pipeline natively detects hardware capability (A100/H100 vs. T4) and automatically scales `batch_size`, `grad_accum`, and compute `dtype` (`bfloat16`/`float16`)โeliminating OOM errors across deployment environments.
|
| 40 |
* **Frictionless Deployment:** Bypassed heavy dependency constraints (PyTorch/TRL vs. Gradio PIP conflicts) by engineering a lazy-loading runtime environment that ensures deterministic Docker builds.
|
| 41 |
|
| 42 |
### ๐ ๏ธ Tech Stack
|
| 43 |
* **Frameworks:** OpenEnv, FastAPI, Docker
|
| 44 |
* **RL Pipeline:** HuggingFace TRL (GRPO), Peft (LoRA)
|
| 45 |
+
* **Models:** Qwen2.5-Coder-3B-Instruct (Base), Llama-3.1-70B (Evaluator)
|
| 46 |
* **Telemetry:** Weights & Biases
|
| 47 |
|
| 48 |
### ๐ Results & Benchmarks
|
|
|
|
| 65 |

|
| 66 |
|
| 67 |
* **Format Compliance:** Scaled to 1.0 (max) within 50 steps.
|
| 68 |
+
* **Total Reward:** Scaled from baseline ~0.4 to peaks of ~1.0 by step 500.
|
| 69 |
* **Baseline Solve Rate:** 100.0% validation on tiered data structure.
|
| 70 |
|
| 71 |
### ๐ฅ Challenges & How They Were Solved
|