Text-to-Video
Diffusers
LTX2VideoPipeline
custom_ltx2
video-generation
image-to-video
audio-to-video
quantized
4-bit precision
int4
svdquant
ltx-2
ltx-2.5
quantfunc
Instructions to use QuantFunc/LTX-2.5-QuantFunc-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use QuantFunc/LTX-2.5-QuantFunc-4bit with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("QuantFunc/LTX-2.5-QuantFunc-4bit", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
README: switch to English (user request)
Browse files
README.md
CHANGED
|
@@ -23,18 +23,16 @@ tags:
|
|
| 23 |
|
| 24 |
# LTX-2.5-QuantFunc-4bit
|
| 25 |
|
| 26 |
-
**4-bit
|
| 27 |
|
| 28 |
-
##
|
| 29 |
|
| 30 |
-
|
| 31 |
|
| 32 |
-
1. **
|
| 33 |
-
2. **
|
| 34 |
|
| 35 |
-
|
| 36 |
-
|
| 37 |
-
*In one line (EN): our enhanced low-rank branch absorbs substantially more activation-outlier energy than standard SVDQuant, and a combination of novel in-house techniques further smooths the outliers in the residual — so the 4-bit grid covers the remaining distribution with far less error. Net effect: clarity, detail retention and motion coherence on par with the BF16 baseline at roughly 1/3 the memory.*
|
| 38 |
|
| 39 |
## Files
|
| 40 |
|
|
@@ -50,7 +48,7 @@ This is **not** a standard diffusers/safetensors checkpoint. The file is produce
|
|
| 50 |
|
| 51 |
## Inference settings (required for correct output)
|
| 52 |
|
| 53 |
-
This is the **distilled** checkpoint, joint video+audio. It must be run with the distilled model's own schedule —
|
| 54 |
|
| 55 |
- **Sigma schedule (8 steps, fixed):** `1.0, 0.99375, 0.9875, 0.98125, 0.975, 0.909375, 0.725, 0.421875, 0.0`
|
| 56 |
- **CFG:** `1` (no classifier-free guidance — this is a guidance-distilled model)
|
|
@@ -66,11 +64,11 @@ This repository redistributes **derived (quantized) weights only**, produced fro
|
|
| 66 |
|
| 67 |
## License
|
| 68 |
|
| 69 |
-
Follows the original model's **LTX-2 Community License Agreement** ([license text](https://github.com/Lightricks/LTX-2/blob/main/LICENSE))
|
| 70 |
|
| 71 |
-
##
|
| 72 |
|
| 73 |
-
- 🌐 [QuantFunc
|
| 74 |
-
- 🐙 [ComfyUI-QuantFunc GitHub](https://github.com/QuantFunc/ComfyUI-QuantFunc)
|
| 75 |
- 🤗 [Hugging Face](https://huggingface.co/QuantFunc) | 🤖 [ModelScope](https://www.modelscope.cn/profile/QuantFunc)
|
| 76 |
-
- 🎮 [Discord
|
|
|
|
| 23 |
|
| 24 |
# LTX-2.5-QuantFunc-4bit
|
| 25 |
|
| 26 |
+
**4-bit quantized [Lightricks LTX-2.5](https://huggingface.co/Lightricks/LTX-2.5) 22B distilled — pure 4-bit inference holds up to BF16 quality while cutting weight/VRAM footprint to roughly 1/3.** Quantized and loaded by the [QuantFunc](https://github.com/quantfunc) inference engine.
|
| 27 |
|
| 28 |
+
## Why pure 4-bit holds up
|
| 29 |
|
| 30 |
+
Compressing a 22B joint video/audio DiT down to **4-bit activations × 4-bit weights (pure a4w4)** runs into one main enemy: activation outliers, which blow past 4-bit's dynamic range and show up as blur and lost detail. QuantFunc adds two layers on top of the SVDQuant approach:
|
| 31 |
|
| 32 |
+
1. **A much stronger low-rank branch.** Algorithmic improvements let the low-rank branch absorb significantly more activation-outlier energy than standard SVDQuant — outliers get siphoned off before the main path is quantized to 4-bit, so the main path sees a much cleaner distribution.
|
| 33 |
+
2. **A smoother residual.** A combination of in-house techniques further smooths the outlier distribution in what's left after low-rank absorption, so the 4-bit grid covers the remaining distribution with far less error.
|
| 34 |
|
| 35 |
+
Net effect: **at pure a4w4 inference, output video (including audio) clarity, detail retention and motion coherence are on par with the BF16 baseline** — at roughly 1/3 the memory.
|
|
|
|
|
|
|
| 36 |
|
| 37 |
## Files
|
| 38 |
|
|
|
|
| 48 |
|
| 49 |
## Inference settings (required for correct output)
|
| 50 |
|
| 51 |
+
This is the **distilled** checkpoint, joint video+audio. It must be run with the distilled model's own schedule — a generic/default scheduler will produce degraded output:
|
| 52 |
|
| 53 |
- **Sigma schedule (8 steps, fixed):** `1.0, 0.99375, 0.9875, 0.98125, 0.975, 0.909375, 0.725, 0.421875, 0.0`
|
| 54 |
- **CFG:** `1` (no classifier-free guidance — this is a guidance-distilled model)
|
|
|
|
| 64 |
|
| 65 |
## License
|
| 66 |
|
| 67 |
+
Follows the original model's **LTX-2 Community License Agreement** ([license text](https://github.com/Lightricks/LTX-2/blob/main/LICENSE)). This repository distributes quantized weights only; copyright and licensing of the original model belong to Lightricks.
|
| 68 |
|
| 69 |
+
## Community
|
| 70 |
|
| 71 |
+
- 🌐 [QuantFunc website](https://www.quantfunc.com/)
|
| 72 |
+
- 🐙 [ComfyUI-QuantFunc on GitHub](https://github.com/QuantFunc/ComfyUI-QuantFunc)
|
| 73 |
- 🤗 [Hugging Face](https://huggingface.co/QuantFunc) | 🤖 [ModelScope](https://www.modelscope.cn/profile/QuantFunc)
|
| 74 |
+
- 🎮 [Discord](https://discord.gg/jCp9TpFWcn)
|