README.md

---
license: other
license_name: flux-2-dev-non-commercial-license
license_link: https://huggingface.co/black-forest-labs/FLUX.2-dev/blob/main/LICENSE.md
base_model: black-forest-labs/FLUX.2-dev
tags:
- flux
- comfyui
- int8
- quantized
- text-to-image
---

# FLUX.2-dev — INT8 tensorwise (+ConvRot), stock-ComfyUI native

Offline INT8 quantization of the `black-forest-labs/FLUX.2-dev` transformer, produced
with [Comfy-Org/comfy-quants](https://github.com/Comfy-Org/comfy-quants)
(`export-model-int8-tensorwise`). Loads **natively in stock ComfyUI >= v0.27.0**
(`QUANT_ALGOS["int8_tensorwise"]`, SM >= 7.5 / Turing+) — no custom node required.

Transformer-only (for `models/diffusion_models/`, load via `UNETLoader`); pair with
the usual FLUX.2 text encoder (Mistral) and VAE.

## Quantization contract

- 160 quantized Linears (8 double blocks × img/txt attn qkv/proj + gated MLP, 48
  single blocks × fused linear1/linear2); global modulation, io projections and
  final layer kept bf16; all 160 ConvRot-rotated (regular Hadamard, group 256).
- Per layer: `int8` weight + `float32 [out,1]` scale + `comfy_quant` marker
  `{"format": "int8_tensorwise", "convrot": true, "convrot_groupsize": 256}`
  (byte-exact to stock ComfyUI's save path).
- Quant math bit-faithful to comfy-kitchen >= 0.2.15.

## Measured (RTX PRO 6000 Blackwell, 1024², 20 steps, torch 2.10.0+cu130)

Image PSNR vs bf16: **32.6 dB** — markedly better than FP8 E4M3 (20.1 dB) or NVFP4
(17.6 dB) on this trajectory-sensitive 32B distilled model; INT8+ConvRot's higher
weight fidelity (SQNR ≈ 41 dB vs 31.5 dB for fp8) translates directly into image
quality here. Disk 33.1 GB (vs 64 GB bf16).

## License

Inherits the FLUX.2-dev Non-Commercial License from the base model.