Models Optimized for Rapid-MLX
Tested & benchmarked MLX models for Rapid-MLX — fastest local AI on Apple Silicon. Tool calling, reasoning, streaming verified.
5B • Updated • 102k • 48Note ⚡ 174 tok/s · Fastest small model · `rapid-mlx serve qwen3.5-4b`
mlx-community/Qwen3.5-9B-4bit
Image-Text-to-Text • 9B • Updated • 25.1k • 21Note ⚡ 107 tok/s · 100% tools · Best bang-for-buck · `rapid-mlx serve qwen3.5-9b`
mlx-community/Qwen3.5-27B-4bit
Image-Text-to-Text • 27B • Updated • 3.2k • 50Note ⚡ 46 tok/s · 100% tools · Strong reasoning · `rapid-mlx serve qwen3.5-27b`
mlx-community/Qwen3.5-35B-A3B-8bit
Image-Text-to-Text • 35B • Updated • 1.67k • 23Note ⚡ MoE · 100% tools · `rapid-mlx serve qwen3.5-35b`
nightmedia/Qwen3.5-122B-A10B-Text-mxfp4-mlx
Text Generation • 122B • Updated • 362 • 11Note ⚡ MoE 122B · 100% tools · `rapid-mlx serve qwen3.5-122b`
mlx-community/Qwen3.5-122B-A10B-8bit
Image-Text-to-Text • 123B • Updated • 678 • 2Note ⚡ MoE 122B 8bit · `rapid-mlx serve qwen3.5-122b-8bit`
lmstudio-community/Qwen3-Coder-Next-MLX-4bit
80B • Updated • 113k • 32Note 🧑💻 Best coding model · `rapid-mlx serve qwen3-coder`
mlx-community/gemma-4-26b-a4b-it-4bit
Image-Text-to-Text • 26B • Updated • 17.5k • 89Note ⚡ 85 tok/s · MoE · Vision · 100% tools · `rapid-mlx serve gemma-4-26b`
mlx-community/gemma-4-31b-it-4bit
Image-Text-to-Text • 31B • Updated • 8.24k • 51Note ⚡ 31 tok/s · Vision · 100% tools · `rapid-mlx serve gemma-4-31b`
mlx-community/gemma-3-12b-it-qat-4bit
Image-Text-to-Text • Updated • 19.1k • 21Note ⚡ Gemma 3 · `rapid-mlx serve gemma3-12b`
mlx-community/Mistral-Small-3.1-24B-Instruct-2503-4bit
Updated • 1.54k • 9Note ⚡ Mistral · `rapid-mlx serve mistral-24b`
mlx-community/GLM-4.7-4bit
Text Generation • 353B • Updated • 636 • 5Note ⚡ GLM · `rapid-mlx serve glm4.7-9b`
lmstudio-community/MiniMax-M2.5-MLX-4bit
Text Generation • 229B • Updated • 16.1k • 1Note ⚡ MiniMax · Reasoning · `rapid-mlx serve minimax-m2.5`
mlx-community/DeepSeek-R1-0528-Qwen3-8B-4bit
Text Generation • 8B • Updated • 3.21k • 8Note 🧠 DeepSeek R1 · Reasoning · `rapid-mlx serve deepseek-r1-8b`
mlx-community/Hermes-3-Llama-3.1-8B-4bit
8B • Updated • 1.35k • 7Note ⚡ Hermes · `rapid-mlx serve hermes3-8b`
mlx-community/Llama-3.2-3B-Instruct-4bit
Text Generation • 3B • Updated • 21.7k • 48Note ⚡ Llama · `rapid-mlx serve llama3-3b`
mlx-community/Phi-4-mini-instruct-4bit
Text Generation • 4B • Updated • 2.62k • 5Note ⚡ 174 tok/s · Fastest overall · `rapid-mlx serve phi4-14b`
mlx-community/Devstral-Small-2-24B-Instruct-2512-4bit
Image-Text-to-Text • 24B • Updated • 71.8k • 13Note 🧑💻 Coding · `rapid-mlx serve devstral-24b`
mlx-community/gpt-oss-20b-MXFP4-Q8
Text Generation • 21B • Updated • 171k • 101Note ⚡ 123 tok/s · `rapid-mlx serve gpt-oss-20b`
mlx-community/Kimi-K2-Instruct-4bit
Text Generation • 1T • Updated • 1.21k • 13Note ⚡ MoE 1T · `rapid-mlx serve kimi-48b`