31.6 GB

Ctrl+K

Card: runs at BF16 speed (runtime-bound, 17 s prefill + 2 s per branch), 36 GB memory, MLX cache cap in Quickstart, 4-bit build marked in preparation

c94e0e8 verified 12 days ago

backbone
Solomon ac4f9ccf, quality-q8: 8-bit affine group 64 on the language-model Linear layers (31.6 GB, 25 bound files) 12 days ago
.gitattributes

1.58 kB
Solomon ac4f9ccf, quality-q8: 8-bit affine group 64 on the language-model Linear layers (31.6 GB, 25 bound files) 12 days ago
LICENSE

11.3 kB
Solomon ac4f9ccf, quality-q8: 8-bit affine group 64 on the language-model Linear layers (31.6 GB, 25 bound files) 12 days ago
MODIFICATIONS.md

4.2 kB
Solomon ac4f9ccf, quality-q8: 8-bit affine group 64 on the language-model Linear layers (31.6 GB, 25 bound files) 12 days ago
NOTICE

3.9 kB
Solomon ac4f9ccf, quality-q8: 8-bit affine group 64 on the language-model Linear layers (31.6 GB, 25 bound files) 12 days ago
README.md

12.6 kB
Card: runs at BF16 speed (runtime-bound, 17 s prefill + 2 s per branch), 36 GB memory, MLX cache cap in Quickstart, 4-bit build marked in preparation 12 days ago
adapter.safetensors

870 MB
xet

Solomon ac4f9ccf, quality-q8: 8-bit affine group 64 on the language-model Linear layers (31.6 GB, 25 bound files) 12 days ago
binding.json

7.64 kB
Solomon ac4f9ccf, quality-q8: 8-bit affine group 64 on the language-model Linear layers (31.6 GB, 25 bound files) 12 days ago
heads.npz

2.05 MB
xet

Solomon ac4f9ccf, quality-q8: 8-bit affine group 64 on the language-model Linear layers (31.6 GB, 25 bound files) 12 days ago
runtime-patch-ac4f9cc.diff

6.72 kB
model card and runtime patch 12 days ago