Diffusion Single File
comfyui

Jan-v1-4B β€” ComfyUI Quantizations

Quantized versions of janhq/Jan-v1-4B, optimized for ComfyUI inference.

Produced with convert_to_quant (learned rounding optimization included).

Available Formats

Format File VRAM* Hardware Notes
BF16 jan-v1-4b-ComfyUI_bf16.safetensors ~8 GB Any modern GPU Unmodified baseline weights
INT8 ConvRot jan-v1-4b-ComfyUI_int8-convrot.safetensors ~4.6 GB Any GPU Row-wise + ConvRot (group 256/64), learned rounding
W4A8 ConvRot Jan-v1-4B-ComfyUI_w4a8_convrot.safetensors ~2.8 GB compatible kernels 4-bit weights + 8-bit activations, ConvRot quantization

*Approximate β€” actual usage depends on resolution and context.

W4A8 Convrot offers the best quality/size trade-off on consumer GPUs. For quickness or if you notice artifacts, use BF16.

License

These quantizations inherit the license of the base model janhq/Jan-v1-4B. Check the base model card for terms of use.

Credits

Downloads last month
31
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for MisterNatural/Jan-v1-4B-ComfyUI

Finetuned
janhq/Jan-v1-4B
Quantized
(19)
this model