SceneWorks commited on
Commit
4227924
·
verified ·
1 Parent(s): 795e01e

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -26,21 +26,21 @@ This is a **weights-only** repackaging for inference on Apple silicon. The model
26
 
27
  ## Versions
28
 
29
- Three precisions ship as subfolders. They share the same architecture and produce the same images (within quantization tolerance); choose by your Mac's unified memory.
30
 
31
  | Folder | Precision | On-disk | Peak @1024² ¹ | Suggested min RAM ² |
32
  |--------|-----------|--------:|--------------:|--------------------:|
33
  | `q4/` | **Q4 (packed) — recommended** | ~14 GB | ~28 GB | 48 GB |
34
  | `q8/` | Q8 (packed) | ~27 GB | ~40 GB | 64 GB |
35
- | `bf16/`| bf16 (dense) | ~50 GB | ~63 GB (est) | 96 GB |
36
 
37
  ¹ Runtime peak (weights + activations) at 1024², measured on a 128 GB Mac via `mlx_rs::memory`. Activations grow with resolution²: Q4 peaks ~16 GB @256², ~28 GB @1024², ~64 GB @2048². The 2048²/6:1 ceiling needs ~96 GB even at Q4.
38
  ² Recommended minimum unified memory for the 1024² default bucket.
39
 
40
  **Q4 is the recommended default** — it renders with no visible quality loss versus bf16, at roughly a third of the memory and a quarter of the download.
41
 
42
- - **`bf16/`** is the flexible source: SceneWorks can also quantize it to Q4/Q8 at *load time* with no dense-memory transient (MLX lazy-mmaps the weights and quantizes per weight on the first forward).
43
- - **`q4/` and `q8/`** are pre-quantized (packed): the two DiTs and the text encoder are stored as group-wise affine quantized weights (group size 64), so they download smaller and load straight into quantized linears. The VAE and tokenizer stay dense.
 
44
 
45
  ## Architecture
46
 
 
26
 
27
  ## Versions
28
 
29
+ Two pre-quantized precisions ship as subfolders. They share the same architecture and produce the same images (within quantization tolerance); choose by your Mac's unified memory.
30
 
31
  | Folder | Precision | On-disk | Peak @1024² ¹ | Suggested min RAM ² |
32
  |--------|-----------|--------:|--------------:|--------------------:|
33
  | `q4/` | **Q4 (packed) — recommended** | ~14 GB | ~28 GB | 48 GB |
34
  | `q8/` | Q8 (packed) | ~27 GB | ~40 GB | 64 GB |
 
35
 
36
  ¹ Runtime peak (weights + activations) at 1024², measured on a 128 GB Mac via `mlx_rs::memory`. Activations grow with resolution²: Q4 peaks ~16 GB @256², ~28 GB @1024², ~64 GB @2048². The 2048²/6:1 ceiling needs ~96 GB even at Q4.
37
  ² Recommended minimum unified memory for the 1024² default bucket.
38
 
39
  **Q4 is the recommended default** — it renders with no visible quality loss versus bf16, at roughly a third of the memory and a quarter of the download.
40
 
41
+ Both folders are pre-quantized (packed): the two DiTs and the text encoder are stored as group-wise affine quantized weights (group size 64), so they download smaller and load straight into quantized linears with no dense-memory transient. The VAE and tokenizer stay dense.
42
+
43
+ > The full-precision **bf16** snapshot (~50 GB) is the dense source these are derived from. It is not hosted here for size reasons; SceneWorks produces the packed versions from it offline (and can quantize it to Q4/Q8 at load time with no transient). Contact the SceneWorks team if you need it.
44
 
45
  ## Architecture
46