Basalt v0.11.0 — Inference, Speech & Quantization Stack
Collection
42+ verified MLX/ANE models (QTIP, PV-Tuning, GSQ-RCO, TTS, OCR) with 1-click launch in Basalt v0.11.0 (Swift 6.4, 84 Compose profiles). • 43 items • Updated
How to use goodmai/laya with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download goodmai/laya --local-dir laya
⚡ Запустить в Basalt v0.11.0 · bas-alt.vercel.app (macOS 27+ · Swift 6.4 · Apple Silicon, без Python) · Upstream source:
convaiinnovations/laya:basalt serve --model goodmai/gemma-4-12B-it-qat-4bit --decision-model goodmai/laya --rest
Quantized
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download goodmai/laya --local-dir laya