Nanbeige4.3-33B-MLX-4bit / conversion.json
fcmeyer's picture
Publish validated MLX 4bit conversion and measurements
f972b73 verified
Raw History Blame Contribute Delete
320 Bytes
{
"source": "Nanbeige/Nanbeige4.3-33B",
"revision": "c1093c501cc6460427c0ac634db7223d0450c0ee",
"variant": "4bit",
"options": {
"hf_path": "artifacts/bf16",
"mlx_path": "artifacts/4bit",
"dtype": "bfloat16",
"quantize": true,
"q_bits": 4,
"q_group_size": 64,
"q_mode": "affine"
}
}