Add teacher model card
Browse files
README.md
ADDED
|
@@ -0,0 +1,17 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
base_model: deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B
|
| 3 |
+
tags:
|
| 4 |
+
- rlve
|
| 5 |
+
- grpo
|
| 6 |
+
- opd-teacher
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
# RLVE OPD teacher: CatalanNumberMod
|
| 10 |
+
|
| 11 |
+
DeepSeek-R1-Distill-Qwen-1.5B trained for 150 steps on difficulty-0
|
| 12 |
+
`CatalanNumberMod` prompts, with four prompts and 16 rollouts per step. Training
|
| 13 |
+
did not use DAPO prompt filtering. These are the final model weights at step
|
| 14 |
+
149 for environment-specific on-policy distillation.
|
| 15 |
+
|
| 16 |
+
Training project: `david-heineman/rl-data-opd-teachers-r1-distil`.
|
| 17 |
+
Training group: `opd-teachers-r1-nofilter16-20260929-231458`.
|