Instructions to use intel-ai/Wan2.2-T2V-A14B-Diffusers-NVFP4-AutoRound with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use intel-ai/Wan2.2-T2V-A14B-Diffusers-NVFP4-AutoRound with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("intel-ai/Wan2.2-T2V-A14B-Diffusers-NVFP4-AutoRound", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Download transformer/quantization_config.json from intel-ai/Wan2.2-T2V-A14B-Diffusers-NVFP4-AutoRound: direct link, hf CLI and curl.
- Browser
- Download file 415 Bytes
-
https://huggingface.co/intel-ai/Wan2.2-T2V-A14B-Diffusers-NVFP4-AutoRound/resolve/main/transformer/quantization_config.json
- Command line
-
hf download hf://intel-ai/Wan2.2-T2V-A14B-Diffusers-NVFP4-AutoRound/transformer/quantization_config.json
-
curl -L -o quantization_config.json https://huggingface.co/intel-ai/Wan2.2-T2V-A14B-Diffusers-NVFP4-AutoRound/resolve/main/transformer/quantization_config.json
415 Bytes
| { | |
| "bits": 4, | |
| "act_bits": 4, | |
| "data_type": "nv_fp", | |
| "act_data_type": "nv_fp4_with_static_gs", | |
| "group_size": 16, | |
| "act_group_size": 16, | |
| "sym": true, | |
| "act_sym": true, | |
| "act_dynamic": true, | |
| "enable_quanted_input": false, | |
| "low_gpu_mem_usage": true, | |
| "autoround_version": "0.17.0", | |
| "block_name_to_quantize": "blocks", | |
| "quant_method": "auto-round", | |
| "packing_format": "auto_round:llm_compressor" | |
| } |