Physicsru commited on
Commit
4b3638d
Β·
verified Β·
1 Parent(s): 3218a18

add README

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -78,20 +78,20 @@ Qwen3-4B-Base
78
  | folder | init | atomic side (10k single-op tasks) | composition side | RL pool | steps | held-out numbers | status |
79
  |---|---|---|---|---|---|---|---|
80
  | `stage15b-init` | stage 1 | 20k closed-book depth-1 rows, prose + one code block | 12k depth-2..4 train-op comps (same format) | β€” | 500 | d4 / d8 = 0.03 / 0.00 (no RA format yet) | pending |
81
- | `sft-d1-s1` | stage15b-init | **single-task**: one op per answer | **none** | β€” | 152 | 0.00 / 0.00 | pending |
82
- | `sft-v1-s1` | stage15b-init | single-task | 15,979 mixed-structure train-op comps, depth 2-4 | β€” | 400 | 0.53Β±0.15 / 0.09Β±0.05 (3 seeds; this seed 0.75 / 0.15) | pending |
83
- | `sft-c1-s1` | stage15b-init | **co-occurrence groups**: 1-4 independent single-op tasks in one answer (all ops) | **none** | β€” | 58 | 0.66Β±0.14 / 0.08Β±0.04 | pending |
84
  | `sft-eco-s1` ("E-co") | stage15b-init | co-occurrence groups | the same 15,979 comps | β€” | 308 | 0.97Β±0.02 / 0.73Β±0.15 (this seed 0.98 / 0.83); serial d20 0.50 | uploaded |
85
  | `sft-c4-s1` | stage15b-init | co-occurrence groups | 12,452 mixed comps, **depth 2 only** | β€” | 252 | 0.70Β±0.03 / 0.12Β±0.05 | pending |
86
  | `sft-c4b-s1` | stage15b-init | co-occurrence groups | 12,436 mixed comps, **depth 2-4** (same count as c4) | β€” | 252 | 0.90Β±0.04 / 0.62Β±0.13 | pending |
87
  | `sft-matched-isolated-s1` | stage15b-init | per step: 48 atomic tasks as 48 single-task rows | per step: 76 comps (same stream as grouped) | β€” | 400 | 0.65Β±0.08 / 0.16Β±0.02 (3 paired seeds) | pending |
88
  | `sft-matched-grouped-s1` | stage15b-init | per step: the SAME 48 atomic tasks packed into 20 grouped rows | the same 76 comps | β€” | 400 | 0.93Β±0.03 / 0.47Β±0.04 | pending |
89
- | `rl-r1a-step100` | sft-eco-s1 | β€” | β€” | 1:1 mix of train-op serial chains d10-20 and all-op multi-task atomic prompts (widths 1-12) | 100 | serial d8/d12/d20 0.85 / 0.63 / 0.61; func_24 one-parameter 226/903 = 25% | pending |
90
  | `rl-r1b-step100` | sft-eco-s1 | β€” | β€” | same pool, different seed | 100 | 0.94 / 0.97 / 0.89; one-parameter 9/903 = 1% | pending |
91
  | `rl-mda-step5` | sft-eco-s1 | β€” | β€” | **mixed-depth pool**: chains + prompts holding one deep train-op chain task followed by 1-2 long-literal atomic tasks over all ops | 5 | 0.95 / 0.92 / 0.82; one-parameter 57/903 = 6% | pending |
92
  | `rl-mda-step50` | sft-eco-s1 | β€” | β€” | same run | 50 | 0.91 / 0.63 / 0.57; one-parameter 396/903 = **44%** | pending |
93
  | `rl-mda-step100` | sft-eco-s1 | β€” | β€” | same run | 100 | 0.97 / 0.97 / 0.93; one-parameter 3/903 = 0.3% | pending |
94
- | `rl-mdb-step100` | sft-eco-s1 | β€” | β€” | mixed-depth pool, second replicate | 100 | 0.99 / 0.98 / 0.95; one-parameter 33/903 = 3.7% | pending |
95
 
96
  "mixed-structure comps" = train-op compositions whose expression trees mix unary nesting, binary
97
  operators and literals (the benchmark's native generator); "co-occurrence groups" put several
 
78
  | folder | init | atomic side (10k single-op tasks) | composition side | RL pool | steps | held-out numbers | status |
79
  |---|---|---|---|---|---|---|---|
80
  | `stage15b-init` | stage 1 | 20k closed-book depth-1 rows, prose + one code block | 12k depth-2..4 train-op comps (same format) | β€” | 500 | d4 / d8 = 0.03 / 0.00 (no RA format yet) | pending |
81
+ | `sft-d1-s1` | stage15b-init | **single-task**: one op per answer | **none** | β€” | 152 | 0.00 / 0.00 | uploaded |
82
+ | `sft-v1-s1` | stage15b-init | single-task | 15,979 mixed-structure train-op comps, depth 2-4 | β€” | 400 | 0.53Β±0.15 / 0.09Β±0.05 (3 seeds; this seed 0.75 / 0.15) | uploaded |
83
+ | `sft-c1-s1` | stage15b-init | **co-occurrence groups**: 1-4 independent single-op tasks in one answer (all ops) | **none** | β€” | 58 | 0.66Β±0.14 / 0.08Β±0.04 | uploaded |
84
  | `sft-eco-s1` ("E-co") | stage15b-init | co-occurrence groups | the same 15,979 comps | β€” | 308 | 0.97Β±0.02 / 0.73Β±0.15 (this seed 0.98 / 0.83); serial d20 0.50 | uploaded |
85
  | `sft-c4-s1` | stage15b-init | co-occurrence groups | 12,452 mixed comps, **depth 2 only** | β€” | 252 | 0.70Β±0.03 / 0.12Β±0.05 | pending |
86
  | `sft-c4b-s1` | stage15b-init | co-occurrence groups | 12,436 mixed comps, **depth 2-4** (same count as c4) | β€” | 252 | 0.90Β±0.04 / 0.62Β±0.13 | pending |
87
  | `sft-matched-isolated-s1` | stage15b-init | per step: 48 atomic tasks as 48 single-task rows | per step: 76 comps (same stream as grouped) | β€” | 400 | 0.65Β±0.08 / 0.16Β±0.02 (3 paired seeds) | pending |
88
  | `sft-matched-grouped-s1` | stage15b-init | per step: the SAME 48 atomic tasks packed into 20 grouped rows | the same 76 comps | β€” | 400 | 0.93Β±0.03 / 0.47Β±0.04 | pending |
89
+ | `rl-r1a-step100` | sft-eco-s1 | β€” | β€” | 1:1 mix of train-op serial chains d10-20 and all-op multi-task atomic prompts (widths 1-12) | 100 | serial d8/d12/d20 0.85 / 0.63 / 0.61; func_24 one-parameter 226/903 = 25% | uploaded |
90
  | `rl-r1b-step100` | sft-eco-s1 | β€” | β€” | same pool, different seed | 100 | 0.94 / 0.97 / 0.89; one-parameter 9/903 = 1% | pending |
91
  | `rl-mda-step5` | sft-eco-s1 | β€” | β€” | **mixed-depth pool**: chains + prompts holding one deep train-op chain task followed by 1-2 long-literal atomic tasks over all ops | 5 | 0.95 / 0.92 / 0.82; one-parameter 57/903 = 6% | pending |
92
  | `rl-mda-step50` | sft-eco-s1 | β€” | β€” | same run | 50 | 0.91 / 0.63 / 0.57; one-parameter 396/903 = **44%** | pending |
93
  | `rl-mda-step100` | sft-eco-s1 | β€” | β€” | same run | 100 | 0.97 / 0.97 / 0.93; one-parameter 3/903 = 0.3% | pending |
94
+ | `rl-mdb-step100` | sft-eco-s1 | β€” | β€” | mixed-depth pool, second replicate | 100 | 0.99 / 0.98 / 0.95; one-parameter 33/903 = 3.7% | uploaded |
95
 
96
  "mixed-structure comps" = train-op compositions whose expression trees mix unary nesting, binary
97
  operators and literals (the benchmark's native generator); "co-occurrence groups" put several