Add kaggle/KAGGLE_SETUP.md
Browse files- kaggle/KAGGLE_SETUP.md +43 -0
kaggle/KAGGLE_SETUP.md
ADDED
|
@@ -0,0 +1,43 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Kaggle GRPO dispatch
|
| 2 |
+
|
| 3 |
+
## 1. Notebook settings
|
| 4 |
+
- **Accelerator:** GPU T4 x2
|
| 5 |
+
- **Internet:** On
|
| 6 |
+
- **Language:** Python
|
| 7 |
+
|
| 8 |
+
## 2. Secrets (Add-ons → Secrets → Attach to notebook)
|
| 9 |
+
| Secret name | Value |
|
| 10 |
+
|-------------|--------|
|
| 11 |
+
| `HF_TOKEN` | same as local `.env` |
|
| 12 |
+
| `WANDB_API_KEY` | same as local `.env` |
|
| 13 |
+
| `LANGFUSE_PUBLIC_KEY` | same as local `.env` |
|
| 14 |
+
| `LANGFUSE_SECRET_KEY` | same as local `.env` |
|
| 15 |
+
| `LANGFUSE_HOST` | `https://cloud.langfuse.com` (optional) |
|
| 16 |
+
|
| 17 |
+
Kaggle does **not** allow uploading secrets via API from this machine — paste once in the UI.
|
| 18 |
+
|
| 19 |
+
## 3. Checkpoint / observability contract
|
| 20 |
+
Every `save_steps` (default 5):
|
| 21 |
+
1. Held-out MBPP eval (`n_eval=16`)
|
| 22 |
+
2. Langfuse trace `kaggle-ckpt-eval` + scores (`mean_pass_frac`, …)
|
| 23 |
+
3. W&B `eval/*` metrics
|
| 24 |
+
4. **Then** push LoRA to `vanishingradient/deepagents-rl-coding` revision `grpo-step-{n}`
|
| 25 |
+
|
| 26 |
+
Baseline eval at step 0 runs before training starts.
|
| 27 |
+
|
| 28 |
+
## 4. Upload notebook
|
| 29 |
+
1. Open [Kaggle Notebooks](https://www.kaggle.com/code) → New Notebook
|
| 30 |
+
2. Apply settings + secrets above
|
| 31 |
+
3. Upload / paste cells from `notebooks/kaggle_grpo.ipynb`
|
| 32 |
+
4. Run All
|
| 33 |
+
|
| 34 |
+
Or use CLI after `pip install kaggle` (with `~/.kaggle/kaggle.json`):
|
| 35 |
+
|
| 36 |
+
```bash
|
| 37 |
+
kaggle kernels push -p notebooks/
|
| 38 |
+
```
|
| 39 |
+
|
| 40 |
+
## 5. Watch
|
| 41 |
+
- Langfuse: filter `kaggle-ckpt-eval`
|
| 42 |
+
- W&B: project `deepagents-rl-coding`, run `kaggle-grpo-mbpp`
|
| 43 |
+
- HF: https://huggingface.co/vanishingradient/deepagents-rl-coding/tree/main
|