vanishingradient commited on
Commit
bec7374
·
verified ·
1 Parent(s): a54bfe0

Add kaggle/KAGGLE_SETUP.md

Browse files
Files changed (1) hide show
  1. kaggle/KAGGLE_SETUP.md +43 -0
kaggle/KAGGLE_SETUP.md ADDED
@@ -0,0 +1,43 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Kaggle GRPO dispatch
2
+
3
+ ## 1. Notebook settings
4
+ - **Accelerator:** GPU T4 x2
5
+ - **Internet:** On
6
+ - **Language:** Python
7
+
8
+ ## 2. Secrets (Add-ons → Secrets → Attach to notebook)
9
+ | Secret name | Value |
10
+ |-------------|--------|
11
+ | `HF_TOKEN` | same as local `.env` |
12
+ | `WANDB_API_KEY` | same as local `.env` |
13
+ | `LANGFUSE_PUBLIC_KEY` | same as local `.env` |
14
+ | `LANGFUSE_SECRET_KEY` | same as local `.env` |
15
+ | `LANGFUSE_HOST` | `https://cloud.langfuse.com` (optional) |
16
+
17
+ Kaggle does **not** allow uploading secrets via API from this machine — paste once in the UI.
18
+
19
+ ## 3. Checkpoint / observability contract
20
+ Every `save_steps` (default 5):
21
+ 1. Held-out MBPP eval (`n_eval=16`)
22
+ 2. Langfuse trace `kaggle-ckpt-eval` + scores (`mean_pass_frac`, …)
23
+ 3. W&B `eval/*` metrics
24
+ 4. **Then** push LoRA to `vanishingradient/deepagents-rl-coding` revision `grpo-step-{n}`
25
+
26
+ Baseline eval at step 0 runs before training starts.
27
+
28
+ ## 4. Upload notebook
29
+ 1. Open [Kaggle Notebooks](https://www.kaggle.com/code) → New Notebook
30
+ 2. Apply settings + secrets above
31
+ 3. Upload / paste cells from `notebooks/kaggle_grpo.ipynb`
32
+ 4. Run All
33
+
34
+ Or use CLI after `pip install kaggle` (with `~/.kaggle/kaggle.json`):
35
+
36
+ ```bash
37
+ kaggle kernels push -p notebooks/
38
+ ```
39
+
40
+ ## 5. Watch
41
+ - Langfuse: filter `kaggle-ckpt-eval`
42
+ - W&B: project `deepagents-rl-coding`, run `kaggle-grpo-mbpp`
43
+ - HF: https://huggingface.co/vanishingradient/deepagents-rl-coding/tree/main