Image-to-Image
MLX
Safetensors
English
Chinese
qwen2_5_vl
apple-silicon
lance
bytedance
multimodal
text-to-image
image-editing
vqa
qwen2.5-vl
quantized
8-bit precision
Instructions to use mlx-community/Lance-3B-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/Lance-3B-8bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download mlx-community/Lance-3B-8bit --local-dir Lance-3B-8bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Download quantization_report.json from mlx-community/Lance-3B-8bit: direct link, hf CLI and curl.
- Browser
- Download file 394 Bytes
-
https://huggingface.co/mlx-community/Lance-3B-8bit/resolve/main/quantization_report.json
- Command line
-
hf download hf://mlx-community/Lance-3B-8bit/quantization_report.json
-
curl -L -o quantization_report.json https://huggingface.co/mlx-community/Lance-3B-8bit/resolve/main/quantization_report.json
394 Bytes
| { | |
| "source_dir": "/Volumes/DEV_VOL1/VideoResearch/lance-mlx-models/Lance-3B-bf16", | |
| "bits": 8, | |
| "group_size": 64, | |
| "mode": "affine", | |
| "bf16_bytes": 12371046496, | |
| "quantized_bytes": 6585364576, | |
| "compression_ratio": 0.5323207360128573, | |
| "n_tensors_bf16": 1021, | |
| "n_tensors_quant": 2033, | |
| "skip_patterns": [ | |
| "time_embedder.proj_in", | |
| "time_embedder.proj_out", | |
| "llm2vae" | |
| ] | |
| } |