model card
Browse files
README.md
CHANGED
|
@@ -29,12 +29,13 @@ point in any eval CSV maps to a folder here without a lookup table:
|
|
| 29 |
|
| 30 |
| folder | base model | arm | lr | checkpoints |
|
| 31 |
| --- | --- | --- | --- | --- |
|
| 32 |
-
| `qwen3_1p7b_base_mbpp_hardcd_lam0p1_lr6e6` | `Qwen/Qwen3-1.7B-Base` | replay buffer (lambda=0.1) | 6e-6 | 30-
|
|
|
|
| 33 |
|
| 34 |
```python
|
| 35 |
from transformers import AutoModelForCausalLM
|
| 36 |
m = AutoModelForCausalLM.from_pretrained(
|
| 37 |
-
"RL-Forgetting-Experiments-3/code-rl-lr-ablation", subfolder="qwen3_1p7b_base_mbpp_hardcd_lam0p1_lr6e6/
|
| 38 |
```
|
| 39 |
|
| 40 |
## Training
|
|
|
|
| 29 |
|
| 30 |
| folder | base model | arm | lr | checkpoints |
|
| 31 |
| --- | --- | --- | --- | --- |
|
| 32 |
+
| `qwen3_1p7b_base_mbpp_hardcd_lam0p1_lr6e6` | `Qwen/Qwen3-1.7B-Base` | replay buffer (lambda=0.1) | 6e-6 | 30-500 step 30 |
|
| 33 |
+
| `qwen3_1p7b_base_mbpp_nobuf_lr6e7` | `Qwen/Qwen3-1.7B-Base` | no buffer | 6e-7 | 30-450 step 30 |
|
| 34 |
|
| 35 |
```python
|
| 36 |
from transformers import AutoModelForCausalLM
|
| 37 |
m = AutoModelForCausalLM.from_pretrained(
|
| 38 |
+
"RL-Forgetting-Experiments-3/code-rl-lr-ablation", subfolder="qwen3_1p7b_base_mbpp_hardcd_lam0p1_lr6e6/global_step_500")
|
| 39 |
```
|
| 40 |
|
| 41 |
## Training
|