Qwen3.6-27B DFlash drafter โ safetensors (vLLM)
Mirror of z-lab/Qwen3.6-27B-DFlash (MIT), the block-diffusion DFlash drafter for Qwen3.6-27B targets. Kept under this account so the full vLLM speculative-decoding stack pairs with the uncensored finetune repos below.
Serve with vLLM (FP8 target + DFlash, ~2x decode)
vllm serve zeeksa/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-FP8-Dynamic \
--speculative-config '{"method": "dflash", "model": "zeeksa/Qwen3.6-27B-DFlash", "num_speculative_tokens": 15}' \
--max-num-batched-tokens 32768 --max-num-seqs 64
DFlash is lossless โ output is identical to serving the target alone; only speed changes.
Related
- FP8 target (vLLM): zeeksa/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-FP8-Dynamic
- BF16 target: zeeksa/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-BF16
- llama.cpp GGUF bundle (targets + GGUF drafter): zeeksa/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-DFlash-GGUF
- Downloads last month
- 85
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐ Ask for provider support
Model tree for zeeksa/Qwen3.6-27B-DFlash
Base model
z-lab/Qwen3.6-27B-DFlash