Evangelinejy commited on
Commit
936125a
·
verified ·
1 Parent(s): fb1efdb

model card

Browse files
Files changed (1) hide show
  1. README.md +3 -2
README.md CHANGED
@@ -29,12 +29,13 @@ point in any eval CSV maps to a folder here without a lookup table:
29
 
30
  | folder | base model | arm | lr | checkpoints |
31
  | --- | --- | --- | --- | --- |
32
- | `qwen3_1p7b_base_mbpp_hardcd_lam0p1_lr6e6` | `Qwen/Qwen3-1.7B-Base` | replay buffer (lambda=0.1) | 6e-6 | 30-390 step 30 |
 
33
 
34
  ```python
35
  from transformers import AutoModelForCausalLM
36
  m = AutoModelForCausalLM.from_pretrained(
37
- "RL-Forgetting-Experiments-3/code-rl-lr-ablation", subfolder="qwen3_1p7b_base_mbpp_hardcd_lam0p1_lr6e6/global_step_390")
38
  ```
39
 
40
  ## Training
 
29
 
30
  | folder | base model | arm | lr | checkpoints |
31
  | --- | --- | --- | --- | --- |
32
+ | `qwen3_1p7b_base_mbpp_hardcd_lam0p1_lr6e6` | `Qwen/Qwen3-1.7B-Base` | replay buffer (lambda=0.1) | 6e-6 | 30-500 step 30 |
33
+ | `qwen3_1p7b_base_mbpp_nobuf_lr6e7` | `Qwen/Qwen3-1.7B-Base` | no buffer | 6e-7 | 30-450 step 30 |
34
 
35
  ```python
36
  from transformers import AutoModelForCausalLM
37
  m = AutoModelForCausalLM.from_pretrained(
38
+ "RL-Forgetting-Experiments-3/code-rl-lr-ablation", subfolder="qwen3_1p7b_base_mbpp_hardcd_lam0p1_lr6e6/global_step_500")
39
  ```
40
 
41
  ## Training