darkmaniac7/TokForge-AccelerationPack-Draft
Text Generation • Updated • 279
Small draft models TokForge pairs with a bigger chat model for speculative decoding. Research drafts have their own list.
Note Draft model for speculative decoding (KL-distilled). 4 GB RAM or more (TokForge helper module).
Note Draft model for speculative decoding (paired with Qwen3 14B). 4 GB RAM or more (TokForge helper module).
Note Deprecated Qwen3.5 0.8B draft; the card says what to use instead.