parakeet-redux-coreml / config.json
alexwengg's picture
Parakeet Redux Core ML (2-bit ternary encoder, iOS 18+)
1011cdf verified
Raw History Blame Contribute Delete
458 Bytes
{
"base_model": "moondream/parakeet-redux",
"contract": "parakeet-tdt-0.6b-v3-coreml",
"encoders": {
"Encoder.mlmodelc": {
"weight_format": "ternary_lut2_int8_blockwise_fp16_scale_g128",
"minimum_os": "iOS18/macOS15",
"recommended_compute_units": "cpuAndNeuralEngine",
"note": "exact re-encoding of the checkpoint's ternary weights; first ANE load compiles for several minutes (cached after), GPU loads in ~1 s"
}
}
}