add README
Browse files
README.md
CHANGED
|
@@ -78,20 +78,20 @@ Qwen3-4B-Base
|
|
| 78 |
| folder | init | atomic side (10k single-op tasks) | composition side | RL pool | steps | held-out numbers | status |
|
| 79 |
|---|---|---|---|---|---|---|---|
|
| 80 |
| `stage15b-init` | stage 1 | 20k closed-book depth-1 rows, prose + one code block | 12k depth-2..4 train-op comps (same format) | β | 500 | d4 / d8 = 0.03 / 0.00 (no RA format yet) | pending |
|
| 81 |
-
| `sft-d1-s1` | stage15b-init | **single-task**: one op per answer | **none** | β | 152 | 0.00 / 0.00 |
|
| 82 |
-
| `sft-v1-s1` | stage15b-init | single-task | 15,979 mixed-structure train-op comps, depth 2-4 | β | 400 | 0.53Β±0.15 / 0.09Β±0.05 (3 seeds; this seed 0.75 / 0.15) |
|
| 83 |
-
| `sft-c1-s1` | stage15b-init | **co-occurrence groups**: 1-4 independent single-op tasks in one answer (all ops) | **none** | β | 58 | 0.66Β±0.14 / 0.08Β±0.04 |
|
| 84 |
| `sft-eco-s1` ("E-co") | stage15b-init | co-occurrence groups | the same 15,979 comps | β | 308 | 0.97Β±0.02 / 0.73Β±0.15 (this seed 0.98 / 0.83); serial d20 0.50 | uploaded |
|
| 85 |
| `sft-c4-s1` | stage15b-init | co-occurrence groups | 12,452 mixed comps, **depth 2 only** | β | 252 | 0.70Β±0.03 / 0.12Β±0.05 | pending |
|
| 86 |
| `sft-c4b-s1` | stage15b-init | co-occurrence groups | 12,436 mixed comps, **depth 2-4** (same count as c4) | β | 252 | 0.90Β±0.04 / 0.62Β±0.13 | pending |
|
| 87 |
| `sft-matched-isolated-s1` | stage15b-init | per step: 48 atomic tasks as 48 single-task rows | per step: 76 comps (same stream as grouped) | β | 400 | 0.65Β±0.08 / 0.16Β±0.02 (3 paired seeds) | pending |
|
| 88 |
| `sft-matched-grouped-s1` | stage15b-init | per step: the SAME 48 atomic tasks packed into 20 grouped rows | the same 76 comps | β | 400 | 0.93Β±0.03 / 0.47Β±0.04 | pending |
|
| 89 |
-
| `rl-r1a-step100` | sft-eco-s1 | β | β | 1:1 mix of train-op serial chains d10-20 and all-op multi-task atomic prompts (widths 1-12) | 100 | serial d8/d12/d20 0.85 / 0.63 / 0.61; func_24 one-parameter 226/903 = 25% |
|
| 90 |
| `rl-r1b-step100` | sft-eco-s1 | β | β | same pool, different seed | 100 | 0.94 / 0.97 / 0.89; one-parameter 9/903 = 1% | pending |
|
| 91 |
| `rl-mda-step5` | sft-eco-s1 | β | β | **mixed-depth pool**: chains + prompts holding one deep train-op chain task followed by 1-2 long-literal atomic tasks over all ops | 5 | 0.95 / 0.92 / 0.82; one-parameter 57/903 = 6% | pending |
|
| 92 |
| `rl-mda-step50` | sft-eco-s1 | β | β | same run | 50 | 0.91 / 0.63 / 0.57; one-parameter 396/903 = **44%** | pending |
|
| 93 |
| `rl-mda-step100` | sft-eco-s1 | β | β | same run | 100 | 0.97 / 0.97 / 0.93; one-parameter 3/903 = 0.3% | pending |
|
| 94 |
-
| `rl-mdb-step100` | sft-eco-s1 | β | β | mixed-depth pool, second replicate | 100 | 0.99 / 0.98 / 0.95; one-parameter 33/903 = 3.7% |
|
| 95 |
|
| 96 |
"mixed-structure comps" = train-op compositions whose expression trees mix unary nesting, binary
|
| 97 |
operators and literals (the benchmark's native generator); "co-occurrence groups" put several
|
|
|
|
| 78 |
| folder | init | atomic side (10k single-op tasks) | composition side | RL pool | steps | held-out numbers | status |
|
| 79 |
|---|---|---|---|---|---|---|---|
|
| 80 |
| `stage15b-init` | stage 1 | 20k closed-book depth-1 rows, prose + one code block | 12k depth-2..4 train-op comps (same format) | β | 500 | d4 / d8 = 0.03 / 0.00 (no RA format yet) | pending |
|
| 81 |
+
| `sft-d1-s1` | stage15b-init | **single-task**: one op per answer | **none** | β | 152 | 0.00 / 0.00 | uploaded |
|
| 82 |
+
| `sft-v1-s1` | stage15b-init | single-task | 15,979 mixed-structure train-op comps, depth 2-4 | β | 400 | 0.53Β±0.15 / 0.09Β±0.05 (3 seeds; this seed 0.75 / 0.15) | uploaded |
|
| 83 |
+
| `sft-c1-s1` | stage15b-init | **co-occurrence groups**: 1-4 independent single-op tasks in one answer (all ops) | **none** | β | 58 | 0.66Β±0.14 / 0.08Β±0.04 | uploaded |
|
| 84 |
| `sft-eco-s1` ("E-co") | stage15b-init | co-occurrence groups | the same 15,979 comps | β | 308 | 0.97Β±0.02 / 0.73Β±0.15 (this seed 0.98 / 0.83); serial d20 0.50 | uploaded |
|
| 85 |
| `sft-c4-s1` | stage15b-init | co-occurrence groups | 12,452 mixed comps, **depth 2 only** | β | 252 | 0.70Β±0.03 / 0.12Β±0.05 | pending |
|
| 86 |
| `sft-c4b-s1` | stage15b-init | co-occurrence groups | 12,436 mixed comps, **depth 2-4** (same count as c4) | β | 252 | 0.90Β±0.04 / 0.62Β±0.13 | pending |
|
| 87 |
| `sft-matched-isolated-s1` | stage15b-init | per step: 48 atomic tasks as 48 single-task rows | per step: 76 comps (same stream as grouped) | β | 400 | 0.65Β±0.08 / 0.16Β±0.02 (3 paired seeds) | pending |
|
| 88 |
| `sft-matched-grouped-s1` | stage15b-init | per step: the SAME 48 atomic tasks packed into 20 grouped rows | the same 76 comps | β | 400 | 0.93Β±0.03 / 0.47Β±0.04 | pending |
|
| 89 |
+
| `rl-r1a-step100` | sft-eco-s1 | β | β | 1:1 mix of train-op serial chains d10-20 and all-op multi-task atomic prompts (widths 1-12) | 100 | serial d8/d12/d20 0.85 / 0.63 / 0.61; func_24 one-parameter 226/903 = 25% | uploaded |
|
| 90 |
| `rl-r1b-step100` | sft-eco-s1 | β | β | same pool, different seed | 100 | 0.94 / 0.97 / 0.89; one-parameter 9/903 = 1% | pending |
|
| 91 |
| `rl-mda-step5` | sft-eco-s1 | β | β | **mixed-depth pool**: chains + prompts holding one deep train-op chain task followed by 1-2 long-literal atomic tasks over all ops | 5 | 0.95 / 0.92 / 0.82; one-parameter 57/903 = 6% | pending |
|
| 92 |
| `rl-mda-step50` | sft-eco-s1 | β | β | same run | 50 | 0.91 / 0.63 / 0.57; one-parameter 396/903 = **44%** | pending |
|
| 93 |
| `rl-mda-step100` | sft-eco-s1 | β | β | same run | 100 | 0.97 / 0.97 / 0.93; one-parameter 3/903 = 0.3% | pending |
|
| 94 |
+
| `rl-mdb-step100` | sft-eco-s1 | β | β | mixed-depth pool, second replicate | 100 | 0.99 / 0.98 / 0.95; one-parameter 33/903 = 3.7% | uploaded |
|
| 95 |
|
| 96 |
"mixed-structure comps" = train-op compositions whose expression trees mix unary nesting, binary
|
| 97 |
operators and literals (the benchmark's native generator); "co-occurrence groups" put several
|