florianvoss/Qwen3-4B-DFlash-N16-LLiMa-3.0.0
Text Generation • Updated
Note Qwen3-4B target + INT8 DFlash draft; n16, 4K context, n128 prefill.
Note Llama-3.1-8B-Instruct target + INT8 DFlash draft; n8, 4K context, n128 prefill.
Note Qwen3-8B target + INT8 DFlash draft; N16, 4K context, N128 prefill.
Note Qwen3.5-4B target + INT8 DFlash draft; N16, 4K context, N128 prefill. 448×448 vision.
Note Qwen3.5-9B target + INT8 DFlash draft; N16, 4K context, N128 prefill. 448×448 vision.