Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

18,270

Base only

Active filters: quantized

NVFP4/Polaris-7B-Preview-FP4

5B • Updated Jul 23, 2025 • 19 • 1

hdtrnk/Wan2.1_Phantom_FusioniX

Image-to-Video • Updated Jun 25, 2025 • 3

muranAI/DeepSeek-R1-0528-Qwen3-8B-GGUF

8B • Updated Jun 28, 2025 • 891 • 1

hrsvrn/Flux.1-kontext-dev-gguf

12B • Updated Jun 26, 2025 • 17

onnx-community/distiluse-base-multilingual-v2-merged-onnx

Feature Extraction • Updated Jun 26, 2025 • 1

muranAI/gemma-3n-E4B-it-GGUF

Text Generation • 7B • Updated Jun 28, 2025 • 761 • 2

agentlans/gemma-3-4b-it-GGUF

4B • Updated Jun 27, 2025 • 40

lym00/Wan2.1_T2V_1.3B_SelfForcing_VACE-GGUF

Image-to-Video • 2B • Updated Jun 28, 2025 • 1.42k • 4

muranAI/Mistral-Small-3.1-24B-Instruct-2503-GGUF

Text Generation • 24B • Updated Jun 28, 2025 • 626 • 1

vnyaryan/playwright4model_q4_k_m

Text Generation • 3B • Updated Jun 28, 2025 • 45

vnyaryan/playwright5model_q4_k_m

Text Generation • 3B • Updated Jun 28, 2025 • 31

LibraxisAI/Llama-3_1-Nemotron-Ultra-253B-v1-MLX-Q5

Text Generation • 253B • Updated May 11 • 56

agentlans/Qwen3-4B-multilingual-sft

4B • Updated Jun 29, 2025 • 7

agentlans/Qwen3-4B-multilingual-sft-GGUF

Text Generation • 4B • Updated Jun 29, 2025 • 60

RedHatAI/Qwen3-30B-A3B-FP8-block

Text Generation • 31B • Updated Oct 27, 2025 • 2.73k

TheMelonGod/Irixxed-Magcap-12B-Slerp-exl2

Text Generation • Updated Jul 1, 2025 • 16

mlx-community/Qwen3-32B-3bit

33B • Updated Jul 1, 2025 • 30 • 2

steampunque/ultravox-v0_5-llama-3_1-8b-MP-GGUF

8B • Updated Feb 18 • 32

ReallyFloppyPenguin/OCRFlux-3B-GGUF

3B • Updated Jul 2, 2025 • 88 • 1

QuantStack/MAGREF_Wan2.1_I2V_14B-GGUF

Image-to-Video • 16B • Updated Jul 2, 2025 • 323 • 12

WaveCut/gemma-3-1b-it-qat-int4-bnb-nf4

Text Generation • 1B • Updated Jul 2, 2025 • 19

mzbac/flux1.schnell.4bit.mlx

Text-to-Image • Updated Jul 6, 2025

mzbac/flux1.dev.4bit.mlx

Text-to-Image • Updated Jul 6, 2025 • 1

mzbac/flux1.kontext.4bit.mlx

Image-to-Image • Updated Jul 6, 2025 • 9

mzbac/flux1.schnell.8bit.mlx

Text-to-Image • Updated Jul 6, 2025

willt-dc/Rosa-V1

Text Classification • 0.1B • Updated Jul 31, 2025 • 96 • 1

mzbac/flux1.dev.8bit.mlx

Text-to-Image • Updated Jul 6, 2025

steampunque/gemma-3-4b-it-MP-GGUF

4B • Updated Feb 18 • 30

mzbac/flux1.kontext.8bit.mlx

Image-to-Image • Updated Jul 6, 2025 • 1

steampunque/Qwen2.5-VL-3B-Instruct-MP-GGUF

3B • Updated Feb 18 • 197