SargeDev commited on
Commit
14b30a9
·
verified ·
1 Parent(s): baf8dad

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +3 -7
README.md CHANGED
@@ -20,13 +20,12 @@ A DFlash2 drafter: a small (1.92B) draft model that proposes tokens for a
20
  larger verifier (target) model. The verifier scores the drafts in one forward
21
  pass and accepts a prefix — lossless speedups, identical output.
22
 
23
- Two drafters ship, both in z-lab export format (`DFlash2DraftModel` +
24
- `dflash_config`), drop-in for vLLM `--speculative-config`:
25
 
26
  | repo | base | training |
27
  |---|---|---|
28
- | `SargeDev/arete-dflash2-scratch` | random init | 5 epochs on Arete-27B-Uncensored regen data |
29
- | `SargeDev/arete-dflash2-incoai` | [incoai/Qwen3.8-27B-DFlash2](https://huggingface.co/incoai/Qwen3.8-27B-DFlash2) (Z-Lab DFlash2, 1.92B) | 7 epochs finetune on the same data |
30
 
31
  ## Targets
32
 
@@ -46,9 +45,6 @@ Greedy losslessness: 5/5 prompts identical to the un-drafted target output.
46
 
47
  | drafter | target | accept_len | draft rate |
48
  |---|---|---|---|
49
- | scratch | Arete-27B-Uncensored | 2.03 | 14.7% |
50
- | scratch | Arete-27B (censored) | 1.91 | 13.1% |
51
- | scratch | Qwen3.8-27B | 1.78 | 11.2% |
52
  | **incoai** | **Arete-27B-Uncensored** | **3.00** | **28.6%** |
53
  | **incoai** | **Arete-27B (censored)** | **2.97** | **28.2%** |
54
  | **incoai** | **Qwen3.8-27B** | **3.80** | **40.0%** |
 
20
  larger verifier (target) model. The verifier scores the drafts in one forward
21
  pass and accepts a prefix — lossless speedups, identical output.
22
 
23
+ In z-lab export format (`DFlash2DraftModel` + `dflash_config`), drop-in for
24
+ vLLM `--speculative-config`.
25
 
26
  | repo | base | training |
27
  |---|---|---|
28
+ | `SargeDev/arete-dflash2-incoai` | [incoai/Qwen3.8-27B-DFlash2](https://huggingface.co/incoai/Qwen3.8-27B-DFlash2) (Z-Lab DFlash2, 1.92B) | 7 epochs finetune on Arete-27B-Uncensored regen data |
 
29
 
30
  ## Targets
31
 
 
45
 
46
  | drafter | target | accept_len | draft rate |
47
  |---|---|---|---|
 
 
 
48
  | **incoai** | **Arete-27B-Uncensored** | **3.00** | **28.6%** |
49
  | **incoai** | **Arete-27B (censored)** | **2.97** | **28.2%** |
50
  | **incoai** | **Qwen3.8-27B** | **3.80** | **40.0%** |