clairic-4bit / clair_head_config.json
lucataco's picture
Clairic, MLX 4-bit, with runtime, server and conversion script
1a48d6b verified
Raw History Blame Contribute Delete
327 Bytes
{
"hidden_size": 5120,
"bins": 256,
"pointer_width": 256,
"readout": "lexical",
"route_width": 1024,
"route_layers": 2,
"route_heads": 8,
"slot_rank": 32,
"estimate_lexical": true,
"span_trim": true,
"answer_slots": true,
"answer_slot_routing": true,
"number_groups": true,
"number_pointer": true
}