Instructions to use SceneWorks/ideogram-4-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use SceneWorks/ideogram-4-mlx with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download SceneWorks/ideogram-4-mlx --local-dir ideogram-4-mlx
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -26,21 +26,21 @@ This is a **weights-only** repackaging for inference on Apple silicon. The model
|
|
| 26 |
|
| 27 |
## Versions
|
| 28 |
|
| 29 |
-
|
| 30 |
|
| 31 |
| Folder | Precision | On-disk | Peak @1024² ¹ | Suggested min RAM ² |
|
| 32 |
|--------|-----------|--------:|--------------:|--------------------:|
|
| 33 |
| `q4/` | **Q4 (packed) — recommended** | ~14 GB | ~28 GB | 48 GB |
|
| 34 |
| `q8/` | Q8 (packed) | ~27 GB | ~40 GB | 64 GB |
|
| 35 |
-
| `bf16/`| bf16 (dense) | ~50 GB | ~63 GB (est) | 96 GB |
|
| 36 |
|
| 37 |
¹ Runtime peak (weights + activations) at 1024², measured on a 128 GB Mac via `mlx_rs::memory`. Activations grow with resolution²: Q4 peaks ~16 GB @256², ~28 GB @1024², ~64 GB @2048². The 2048²/6:1 ceiling needs ~96 GB even at Q4.
|
| 38 |
² Recommended minimum unified memory for the 1024² default bucket.
|
| 39 |
|
| 40 |
**Q4 is the recommended default** — it renders with no visible quality loss versus bf16, at roughly a third of the memory and a quarter of the download.
|
| 41 |
|
| 42 |
-
-
|
| 43 |
-
|
|
|
|
| 44 |
|
| 45 |
## Architecture
|
| 46 |
|
|
|
|
| 26 |
|
| 27 |
## Versions
|
| 28 |
|
| 29 |
+
Two pre-quantized precisions ship as subfolders. They share the same architecture and produce the same images (within quantization tolerance); choose by your Mac's unified memory.
|
| 30 |
|
| 31 |
| Folder | Precision | On-disk | Peak @1024² ¹ | Suggested min RAM ² |
|
| 32 |
|--------|-----------|--------:|--------------:|--------------------:|
|
| 33 |
| `q4/` | **Q4 (packed) — recommended** | ~14 GB | ~28 GB | 48 GB |
|
| 34 |
| `q8/` | Q8 (packed) | ~27 GB | ~40 GB | 64 GB |
|
|
|
|
| 35 |
|
| 36 |
¹ Runtime peak (weights + activations) at 1024², measured on a 128 GB Mac via `mlx_rs::memory`. Activations grow with resolution²: Q4 peaks ~16 GB @256², ~28 GB @1024², ~64 GB @2048². The 2048²/6:1 ceiling needs ~96 GB even at Q4.
|
| 37 |
² Recommended minimum unified memory for the 1024² default bucket.
|
| 38 |
|
| 39 |
**Q4 is the recommended default** — it renders with no visible quality loss versus bf16, at roughly a third of the memory and a quarter of the download.
|
| 40 |
|
| 41 |
+
Both folders are pre-quantized (packed): the two DiTs and the text encoder are stored as group-wise affine quantized weights (group size 64), so they download smaller and load straight into quantized linears with no dense-memory transient. The VAE and tokenizer stay dense.
|
| 42 |
+
|
| 43 |
+
> The full-precision **bf16** snapshot (~50 GB) is the dense source these are derived from. It is not hosted here for size reasons; SceneWorks produces the packed versions from it offline (and can quantize it to Q4/Q8 at load time with no transient). Contact the SceneWorks team if you need it.
|
| 44 |
|
| 45 |
## Architecture
|
| 46 |
|