Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

18

Base only

Active filters: q5

LibraxisAI/c4ai-command-a-03-2025-q5-mlx

Text Generation • Updated May 12

adriabama06/whisper-large-v3-ggml

Updated Jun 11, 2025 • 1

LibraxisAI/Qwen3-235B-A22B-MLX-Q5

Text Generation • 235B • Updated May 11 • 32

LibraxisAI/QwQ-32B-MLX-Q5

Text Generation • 33B • Updated May 11 • 22

LibraxisAI/Qwen3-14b-MLX-Q5

Text Generation • 15B • Updated May 11 • 65

LibraxisAI/Llama-3_1-Nemotron-Ultra-253B-v1-MLX-Q5

Text Generation • 253B • Updated May 11 • 54

LibraxisAI/Bielik-11B-v3.0-mlx-q5

Text Generation • 11B • Updated May 11 • 38

tech-tweakers/XCT-Qwen3-4B

4B • Updated Mar 12 • 65 • 2

mavis-ai/Multilingual-e5-large-Q5

Feature Extraction • Updated Jun 18 • 27

mavis-ai/Gemma4-E2B-MLX-Q5

Image-Text-to-Text • 5B • Updated Jul 1 • 10

mavis-ai/Gemma4-E4B-MLX-Q5

Image-Text-to-Text • 8B • Updated Jul 1 • 15

mavis-ai/Gemma4-E2B-QAT-Q5

Image-Text-to-Text • 5B • Updated Jul 2 • 14

mavis-ai/Gemma4-12B-QAT-Q5

Image-Text-to-Text • 12B • Updated Jul 2 • 41

mavis-ai/Gemma4-E4B-QAT-Q5

Image-Text-to-Text • 8B • Updated Jul 2 • 9

mavis-ai/Gemma4-26B-QAT-Q5

Image-Text-to-Text • 26B • Updated Jul 2 • 16

mavis-ai/Gemma4-31B-QAT-Q5

Image-Text-to-Text • 31B • Updated Jul 2 • 25

mavis-ai/Qwen3.6-35B-MoE-Q5

Image-Text-to-Text • 35B • Updated Jul 14 • 139

RolanDorisTech/Qwen3.8-9B-Distill-MLX-5bit

Text Generation • 9B • Updated 9 days ago • 346