Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

18,141

Base only

Active filters: quantized

MaziyarPanahi/Mistral-Large-Instruct-2407-GGUF

Text Generation • 123B • Updated Jul 26, 2024 • 4.71k • 22

ggml-org/SmolVLM2-256M-Video-Instruct-GGUF

Image-Text-to-Text • 0.2B • Updated Aug 23 • 5.45k • 13

nvidia/Qwen3-235B-A22B-NVFP4

Text Generation • 133B • Updated Jul 8, 2025 • 21.1k • 23

JahnaviBhansali/person-classification-tflite

Image Classification • Updated Aug 1, 2025 • 33 • 2

FabioSarracino/VibeVoice-Large-Q8

Text-to-Audio • 9B • Updated Oct 1, 2025 • 812 • 101

steampunque/LFM2-VL-1.6B-MP-GGUF

1B • Updated Feb 18 • 85 • 2

elhayefrat/offensive_ollma

Text Generation • 8B • Updated Nov 18, 2025 • 4

MaziyarPanahi/gpt-oss-20b-Derestricted-GGUF

Text Generation • 21B • Updated Nov 28, 2025 • 81.7k • 4

filipstrand/Z-Image-Turbo-mflux-4bit

Text-to-Image • Updated Dec 2, 2025 • 19

unsloth/Qwen-Image-2512-GGUF

Text-to-Image • 20B • Updated Jan 6 • 323k • 425

solarkyle/GLM-4.7-Flash-GGUF

Text Generation • 30B • Updated Jan 20 • 218 • 6

QuantFunc/Nunchaku-Qwen-Image-EDIT-2511

Image-to-Image • Updated Jun 19 • 7.19k • 115

brianmatzelle/personaplex-7b-v1-bnb-4bit

Updated Feb 23 • 13

ShayanCyan/phi4-multimodal-quantisized-gguf

Image-to-Text • 4B • Updated Feb 16 • 2.23k • 9

alexliap/Qwen3-Embedding-8B-FP8-DYNAMIC

Feature Extraction • 8B • Updated Feb 17 • 3.35k • 3

saricles/Qwen3-Coder-Next-NVFP4-GB10

Text Generation • Updated Mar 1 • 71.4k • 51

embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead

Image-Text-to-Text • 2B • Updated Aug 12 • 268 • 10

mlx-community/Qwen3.5-9B-MLX-8bit

9B • Updated Mar 2 • 1.18k • 15

Alexzander85/Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-NVFP4-MLP-FP8KV

Text Generation • 8B • Updated Mar 4 • 783 • 13

Granddyser/flux-klein-9b-Biglove-Collection

Text-to-Image • 9B • Updated Jul 30 • 21.2k • 59

jc-builds/Qwen3.5-9B-VLM-Q4_K_M-GGUF

Image-Text-to-Text • 9B • Updated Mar 18 • 7.76k • 16

mtrpires/Qwen3.5-35B-A3B-IQK-RPi5-16GB

Text Generation • 35B • Updated Mar 28 • 138 • 1

caiovicentino1/Qwen3.5-9B-Claude-Opus-HLWQ-Q5

Text Generation • 9B • Updated Apr 13 • 61 • 5

h34v7/Jackrong-Qwopus3.5-27B-v3-GGUF

27B • Updated Apr 8 • 339 • 8

mudler/gemma-4-26B-A4B-it-APEX-GGUF

25B • Updated Aug 17 • 110k • 83

CCSSNE/gemma-4-26B-A4B-it-heretic-ara-gguf

25B • Updated Apr 3 • 621 • 35

bg-digitalservices/Gemma-4-26B-A4B-it-NVFP4

Text Generation • 15B • Updated Apr 5 • 14.9k • 34

caiovicentino1/Gemma-4-31B-Claude-Opus-HLWQ-Q5-Vision

Image-Text-to-Text • Updated Apr 13 • 80 • 18

majentik/gemma-4-E4B-turboquant

Image-Text-to-Text • 8B • Updated 20 days ago • 53 • 9

douyamv/Gemma-4-31B-JANG_4M-CRACK-GGUF

Text Generation • 31B • Updated Apr 9 • 6.2k • 246