Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -20,13 +20,12 @@ A DFlash2 drafter: a small (1.92B) draft model that proposes tokens for a
|
|
| 20 |
larger verifier (target) model. The verifier scores the drafts in one forward
|
| 21 |
pass and accepts a prefix — lossless speedups, identical output.
|
| 22 |
|
| 23 |
-
|
| 24 |
-
|
| 25 |
|
| 26 |
| repo | base | training |
|
| 27 |
|---|---|---|
|
| 28 |
-
| `SargeDev/arete-dflash2-
|
| 29 |
-
| `SargeDev/arete-dflash2-incoai` | [incoai/Qwen3.8-27B-DFlash2](https://huggingface.co/incoai/Qwen3.8-27B-DFlash2) (Z-Lab DFlash2, 1.92B) | 7 epochs finetune on the same data |
|
| 30 |
|
| 31 |
## Targets
|
| 32 |
|
|
@@ -46,9 +45,6 @@ Greedy losslessness: 5/5 prompts identical to the un-drafted target output.
|
|
| 46 |
|
| 47 |
| drafter | target | accept_len | draft rate |
|
| 48 |
|---|---|---|---|
|
| 49 |
-
| scratch | Arete-27B-Uncensored | 2.03 | 14.7% |
|
| 50 |
-
| scratch | Arete-27B (censored) | 1.91 | 13.1% |
|
| 51 |
-
| scratch | Qwen3.8-27B | 1.78 | 11.2% |
|
| 52 |
| **incoai** | **Arete-27B-Uncensored** | **3.00** | **28.6%** |
|
| 53 |
| **incoai** | **Arete-27B (censored)** | **2.97** | **28.2%** |
|
| 54 |
| **incoai** | **Qwen3.8-27B** | **3.80** | **40.0%** |
|
|
|
|
| 20 |
larger verifier (target) model. The verifier scores the drafts in one forward
|
| 21 |
pass and accepts a prefix — lossless speedups, identical output.
|
| 22 |
|
| 23 |
+
In z-lab export format (`DFlash2DraftModel` + `dflash_config`), drop-in for
|
| 24 |
+
vLLM `--speculative-config`.
|
| 25 |
|
| 26 |
| repo | base | training |
|
| 27 |
|---|---|---|
|
| 28 |
+
| `SargeDev/arete-dflash2-incoai` | [incoai/Qwen3.8-27B-DFlash2](https://huggingface.co/incoai/Qwen3.8-27B-DFlash2) (Z-Lab DFlash2, 1.92B) | 7 epochs finetune on Arete-27B-Uncensored regen data |
|
|
|
|
| 29 |
|
| 30 |
## Targets
|
| 31 |
|
|
|
|
| 45 |
|
| 46 |
| drafter | target | accept_len | draft rate |
|
| 47 |
|---|---|---|---|
|
|
|
|
|
|
|
|
|
|
| 48 |
| **incoai** | **Arete-27B-Uncensored** | **3.00** | **28.6%** |
|
| 49 |
| **incoai** | **Arete-27B (censored)** | **2.97** | **28.2%** |
|
| 50 |
| **incoai** | **Qwen3.8-27B** | **3.80** | **40.0%** |
|