Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,606

Base only

Active filters: bfloat16

alexgusevski/Mistral-Nemo-Inst-2407-12B-Thinking-Uncensored-HERETIC-HI-Claude-Opus-mlx-8Bit

Text Generation • 12B • Updated Jan 12 • 67

alexgusevski/Mistral-Nemo-Inst-2407-12B-Thinking-Uncensored-HERETIC-HI-Claude-Opus-mlx-fp16

Text Generation • 12B • Updated Jan 12 • 226 • • 1

alexgusevski/Llama3.3-8B-Instruct-Thinking-Heretic-Uncensored-Claude-4.5-Opus-High-Reasoning-mlx-3Bit

Text Generation • 1B • Updated Jan 12 • 49

alexgusevski/Llama3.3-8B-Instruct-Thinking-Heretic-Uncensored-Claude-4.5-Opus-High-Reasoning-mlx-4Bit

Text Generation • 1B • Updated Jan 12 • 48

alexgusevski/Llama3.3-8B-Instruct-Thinking-Heretic-Uncensored-Claude-4.5-Opus-High-Reasoning-mlx-5Bit

Text Generation • 8B • Updated Jan 12 • 32

alexgusevski/Llama3.3-8B-Instruct-Thinking-Heretic-Uncensored-Claude-4.5-Opus-High-Reasoning-mlx-6Bit

Text Generation • 8B • Updated Jan 12 • 38

alexgusevski/Llama3.3-8B-Instruct-Thinking-Heretic-Uncensored-Claude-4.5-Opus-High-Reasoning-mlx-8Bit

Text Generation • 8B • Updated Jan 12 • 26

alexgusevski/Llama3.3-8B-Instruct-Thinking-Heretic-Uncensored-Claude-4.5-Opus-High-Reasoning-mlx-fp16

Text Generation • 8B • Updated Jan 12 • 30

alexgusevski/Llama3.3-8B-Instruct-Thinking-Claude-4.5-Opus-High-Reasoning-mlx-2Bit

Text Generation • 0.8B • Updated Jan 12 • 9

alexgusevski/Llama3.3-8B-Instruct-Thinking-Claude-4.5-Opus-High-Reasoning-mlx-3Bit

Text Generation • 1B • Updated Jan 12 • 11

alexgusevski/Llama3.3-8B-Instruct-Thinking-Claude-4.5-Opus-High-Reasoning-mlx-4Bit

Text Generation • 1B • Updated Jan 12 • 15

alexgusevski/Llama3.3-8B-Instruct-Thinking-Claude-4.5-Opus-High-Reasoning-mlx-5Bit

Text Generation • 8B • Updated Jan 12 • 21

alexgusevski/Llama3.3-8B-Instruct-Thinking-Claude-4.5-Opus-High-Reasoning-mlx-6Bit

Text Generation • 8B • Updated Jan 12 • 15

alexgusevski/Llama3.3-8B-Instruct-Thinking-Claude-4.5-Opus-High-Reasoning-mlx-8Bit

Text Generation • 8B • Updated Jan 12 • 25

alexgusevski/Llama3.3-8B-Instruct-Thinking-Claude-4.5-Opus-High-Reasoning-mlx-fp16

Text Generation • 8B • Updated Jan 12 • 75 • • 1

mradermacher/Qwen3-4B-Element8-GGUF

4B • Updated Jan 13 • 69 • 1

mradermacher/Qwen3-4B-Element8-i1-GGUF

4B • Updated Jan 13 • 117 • 1

nightmedia/Qwen3-4B-Element8-Eva-qx86-hi-mlx

Text Generation • 1B • Updated Jan 15 • 24 • 1

nightmedia/Qwen3-4B-Agent-Eva-qx86-hi-mlx

Text Generation • 1B • Updated Jan 15 • 11

nightmedia/Qwen3-4B-Element4-Eva-qx86-hi-mlx

Text Generation • 1B • Updated Jan 15 • 5

nightmedia/Qwen3-4B-Element8-Eva

Text Generation • 4B • Updated Jan 13 • 7 • 1

nightmedia/Qwen3-4B-Element4-Eva

Text Generation • 4B • Updated Jan 23 • 8 • 1

nightmedia/Qwen3-4B-Agent-Eva

Text Generation • 4B • Updated Jan 14 • 72 • 1

mradermacher/Qwen2.5-7B-Instruct-1M-Thinking-Claude-Gemini-GPT5.2-DISTILL-i1-GGUF

8B • Updated Jan 14 • 756 • 1

mradermacher/Mistral-Nemo-2407-Instruct-12B-Deep-Thinking-Claude-Gemini-GPT5.2-GGUF

12B • Updated Jan 14 • 459 • 5

mradermacher/Mistral-Nemo-2407-Instruct-12B-Deep-Thinking-Claude-Gemini-GPT5.2-i1-GGUF

12B • Updated Jan 14 • 682 • 3

mradermacher/Qwen3-4B-Element8-Eva-GGUF

4B • Updated Jan 14 • 63 • 1

mradermacher/Qwen3-4B-Agent-Eva-GGUF

4B • Updated Jan 14 • 52 • 1

mradermacher/Qwen3-4B-Element4-Eva-GGUF

4B • Updated Jan 14 • 75 • 1

mradermacher/Qwen3-4B-Element4-Eva-i1-GGUF

4B • Updated Jan 14 • 141 • 1