Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,850

Base only

Active filters: bfloat16

alexgusevski/Llama3.3-8B-Instruct-Thinking-Claude-4.5-Opus-High-Reasoning-mlx-6Bit

Text Generation • 8B • Updated Jan 12 • 28

alexgusevski/Llama3.3-8B-Instruct-Thinking-Claude-4.5-Opus-High-Reasoning-mlx-8Bit

Text Generation • 8B • Updated Jan 12 • 26

alexgusevski/Llama3.3-8B-Instruct-Thinking-Claude-4.5-Opus-High-Reasoning-mlx-fp16

Text Generation • 8B • Updated Jan 12 • 52 • • 1

mradermacher/Qwen3-4B-Element8-GGUF

4B • Updated Jan 13 • 223 • 1

mradermacher/Qwen3-4B-Element8-i1-GGUF

4B • Updated Jan 13 • 887 • 1

nightmedia/Qwen3-4B-Element8-Eva-qx86-hi-mlx

Text Generation • 4B • Updated Jan 15 • 35 • 1

nightmedia/Qwen3-4B-Agent-Eva-qx86-hi-mlx

Text Generation • 4B • Updated Jan 15 • 15

nightmedia/Qwen3-4B-Element4-Eva-qx86-hi-mlx

Text Generation • 4B • Updated Jan 15 • 20

nightmedia/Qwen3-4B-Element8-Eva

Text Generation • 4B • Updated Jan 13 • 16 • 1

nightmedia/Qwen3-4B-Element4-Eva

Text Generation • 4B • Updated Jan 23 • 29 • 1

nightmedia/Qwen3-4B-Agent-Eva

Text Generation • 4B • Updated Jan 14 • 31 • 1

mradermacher/Qwen2.5-7B-Instruct-1M-Thinking-Claude-Gemini-GPT5.2-DISTILL-GGUF

8B • Updated Jan 14 • 740 • 6

mradermacher/Qwen2.5-7B-Instruct-1M-Thinking-Claude-Gemini-GPT5.2-DISTILL-i1-GGUF

8B • Updated Jan 14 • 2.26k • 1

mradermacher/Mistral-Nemo-2407-Instruct-12B-Deep-Thinking-Claude-Gemini-GPT5.2-GGUF

12B • Updated Jan 14 • 779 • 5

mradermacher/Mistral-Nemo-2407-Instruct-12B-Deep-Thinking-Claude-Gemini-GPT5.2-i1-GGUF

12B • Updated Jan 14 • 1.72k • 3

mradermacher/Qwen3-4B-Element8-Eva-GGUF

4B • Updated Jan 14 • 386 • 1

mradermacher/Qwen3-4B-Agent-Eva-GGUF

4B • Updated Jan 14 • 232 • 1

mradermacher/Qwen3-4B-Element4-Eva-GGUF

4B • Updated Jan 14 • 349 • 1

mradermacher/Qwen3-4B-Element4-Eva-i1-GGUF

4B • Updated Jan 14 • 998 • 1

mradermacher/Qwen3-4B-Element8-Eva-i1-GGUF

4B • Updated Jan 14 • 885 • 1

nightmedia/Qwen3-30B-A3B-Element7-1M-qx64-hi-mlx

Text Generation • 31B • Updated Jan 15 • 14

nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx

Text Generation • 31B • Updated Jan 15 • 15

DavidAU/Gemma-3-27b-it-Gemini-Deep-Reasoning

Image-Text-to-Text • 27B • Updated Feb 21 • 69 • 9

alexgusevski/Qwen2.5-7B-Instruct-1M-Thinking-Claude-Gemini-GPT5.2-DISTILL-mlx-2Bit

Text Generation • 8B • Updated Jan 15 • 48

alexgusevski/Qwen2.5-7B-Instruct-1M-Thinking-Claude-Gemini-GPT5.2-DISTILL-mlx-3Bit

Text Generation • 8B • Updated Jan 15 • 52

alexgusevski/Qwen2.5-7B-Instruct-1M-Thinking-Claude-Gemini-GPT5.2-DISTILL-mlx-4Bit

Text Generation • 8B • Updated Jan 15 • 48

alexgusevski/Qwen2.5-7B-Instruct-1M-Thinking-Claude-Gemini-GPT5.2-DISTILL-mlx-5Bit

Text Generation • 8B • Updated Jan 15 • 54

alexgusevski/Qwen2.5-7B-Instruct-1M-Thinking-Claude-Gemini-GPT5.2-DISTILL-mlx-6Bit

Text Generation • 8B • Updated Jan 15 • 35

alexgusevski/Qwen2.5-7B-Instruct-1M-Thinking-Claude-Gemini-GPT5.2-DISTILL-mlx-8Bit

Text Generation • 8B • Updated Jan 15 • 36

alexgusevski/Qwen2.5-7B-Instruct-1M-Thinking-Claude-Gemini-GPT5.2-DISTILL-mlx-fp16

Text Generation • 8B • Updated Jan 15 • 164 • • 2