EliezerS commited on
Commit
96b8c62
·
verified ·
1 Parent(s): b7b128c

Model card: positive, concise wording

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -39,7 +39,7 @@ Commit-order drafters for **SPOT** (Speculating Positions Order Trajectory). Eac
39
  0.62M-parameter order model (3 layers, `d_model` 128, 8 heads, stale top-32 inputs). It reads only the target's
40
  own output distributions from the previous pass and predicts which masked position a block-diffusion target
41
  commits next. SPOT grows those predictions into a tree of candidate block states, and the target verifies the
42
- whole tree in one forward, exactly: a state is accepted only if it equals the target's own next state, and
43
  coupled-noise match keeps this exact at any temperature. On SDAR-8B this cuts target passes by up to 6.8× and
44
  reaches up to 3.2× the throughput of standard decoding, with the target's output unchanged.
45
 
@@ -54,8 +54,8 @@ reaches up to 3.2× the throughput of standard decoding, with the target's outpu
54
  | `llada2mini_b32.pt` | LLaDA2.0-mini | 32 | 0.636 |
55
  | `llada2mini_b16.pt` | LLaDA2.0-mini | 16 | 0.665 |
56
 
57
- `tuned/` holds the per-setting comparison drafters of the paper's appendix; they are not needed to use SPOT.
58
- A drafter can also drive a target it was not trained on (LLaDA-8B and Dream-7B have no native drafter).
59
 
60
  ## Use
61
 
 
39
  0.62M-parameter order model (3 layers, `d_model` 128, 8 heads, stale top-32 inputs). It reads only the target's
40
  own output distributions from the previous pass and predicts which masked position a block-diffusion target
41
  commits next. SPOT grows those predictions into a tree of candidate block states, and the target verifies the
42
+ whole tree in one forward, exactly: an accepted state equals the target's own next state, and
43
  coupled-noise match keeps this exact at any temperature. On SDAR-8B this cuts target passes by up to 6.8× and
44
  reaches up to 3.2× the throughput of standard decoding, with the target's output unchanged.
45
 
 
54
  | `llada2mini_b32.pt` | LLaDA2.0-mini | 32 | 0.636 |
55
  | `llada2mini_b16.pt` | LLaDA2.0-mini | 16 | 0.665 |
56
 
57
+ `tuned/` holds the per-setting comparison drafters of the paper's appendix; the six checkpoints above are all you need to use SPOT.
58
+ A drafter can also drive other targets directly; LLaDA-8B and Dream-7B run with transferred drafters.
59
 
60
  ## Use
61