Model card: positive, concise wording
Browse files
README.md
CHANGED
|
@@ -39,7 +39,7 @@ Commit-order drafters for **SPOT** (Speculating Positions Order Trajectory). Eac
|
|
| 39 |
0.62M-parameter order model (3 layers, `d_model` 128, 8 heads, stale top-32 inputs). It reads only the target's
|
| 40 |
own output distributions from the previous pass and predicts which masked position a block-diffusion target
|
| 41 |
commits next. SPOT grows those predictions into a tree of candidate block states, and the target verifies the
|
| 42 |
-
whole tree in one forward, exactly:
|
| 43 |
coupled-noise match keeps this exact at any temperature. On SDAR-8B this cuts target passes by up to 6.8× and
|
| 44 |
reaches up to 3.2× the throughput of standard decoding, with the target's output unchanged.
|
| 45 |
|
|
@@ -54,8 +54,8 @@ reaches up to 3.2× the throughput of standard decoding, with the target's outpu
|
|
| 54 |
| `llada2mini_b32.pt` | LLaDA2.0-mini | 32 | 0.636 |
|
| 55 |
| `llada2mini_b16.pt` | LLaDA2.0-mini | 16 | 0.665 |
|
| 56 |
|
| 57 |
-
`tuned/` holds the per-setting comparison drafters of the paper's appendix;
|
| 58 |
-
A drafter can also drive
|
| 59 |
|
| 60 |
## Use
|
| 61 |
|
|
|
|
| 39 |
0.62M-parameter order model (3 layers, `d_model` 128, 8 heads, stale top-32 inputs). It reads only the target's
|
| 40 |
own output distributions from the previous pass and predicts which masked position a block-diffusion target
|
| 41 |
commits next. SPOT grows those predictions into a tree of candidate block states, and the target verifies the
|
| 42 |
+
whole tree in one forward, exactly: an accepted state equals the target's own next state, and
|
| 43 |
coupled-noise match keeps this exact at any temperature. On SDAR-8B this cuts target passes by up to 6.8× and
|
| 44 |
reaches up to 3.2× the throughput of standard decoding, with the target's output unchanged.
|
| 45 |
|
|
|
|
| 54 |
| `llada2mini_b32.pt` | LLaDA2.0-mini | 32 | 0.636 |
|
| 55 |
| `llada2mini_b16.pt` | LLaDA2.0-mini | 16 | 0.665 |
|
| 56 |
|
| 57 |
+
`tuned/` holds the per-setting comparison drafters of the paper's appendix; the six checkpoints above are all you need to use SPOT.
|
| 58 |
+
A drafter can also drive other targets directly; LLaDA-8B and Dream-7B run with transferred drafters.
|
| 59 |
|
| 60 |
## Use
|
| 61 |
|