How to use from the
Use from the
MLX library
# Download the model from the Hub
pip install huggingface_hub[hf_xet]

hf download goodmai/laya --local-dir laya

Запустить через Basalt Run with Basalt bas-alt.vercel.app Basalt v0.11.0

⚡ Запустить в Basalt v0.11.0 · bas-alt.vercel.app (macOS 27+ · Swift 6.4 · Apple Silicon, без Python) · Upstream source: convaiinnovations/laya:

basalt serve --model goodmai/gemma-4-12B-it-qat-4bit --decision-model goodmai/laya --rest

laya

Downloads last month
28
Safetensors
Model size
0.4B params
Tensor type
F32
·
F16
·
MLX
Hardware compatibility
Log In to add your hardware

Quantized

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including goodmai/laya