Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

13,528

Base only

Active filters: quantized

oxide-lab/whisper-medium-GGUF

Automatic Speech Recognition • 0.8B • Updated Jan 30 • 577 • 1

embedl/Cosmos-Reason2-2B-W4A16

Image-Text-to-Text • 2B • Updated May 19 • 204 • 12

brianmatzelle/personaplex-7b-v1-bnb-4bit

Updated Feb 23 • 11

alexliap/Qwen3-Embedding-8B-FP8-DYNAMIC

Feature Extraction • 8B • Updated Feb 17 • 10.1k • 2

saricles/Qwen3-Coder-Next-NVFP4-GB10

Text Generation • Updated Mar 1 • 5.88k • 40

Sehyo/Qwen3.5-122B-A10B-NVFP4

Image-Text-to-Text • 71B • Updated Mar 2 • 16.9k • 69

mlx-community/Qwen3.5-9B-MLX-4bit

Image-Text-to-Text • 2B • Updated Mar 23 • 22.4k • 151

mlx-community/Qwen3.5-4B-MLX-4bit

1.0B • Updated Mar 2 • 27.3k • 33

mlx-community/Qwen3.5-0.8B-OptiQ-4bit

Text Generation • 0.2B • Updated 24 days ago • 1.45k • 22

mlx-community/Qwen3.5-4B-OptiQ-4bit

Text Generation • 0.9B • Updated 24 days ago • 3.62k • 27

mlx-community/Qwen3.5-9B-OptiQ-4bit

Text Generation • 9B • Updated 24 days ago • 8.84k • 88

ericleigh007/MiniCPM-o-4_5-BNB-Int8

Any-to-Any • 9B • Updated Mar 11 • 19 • 3

kanocz/Qwen3.5-9B-Claude-4.6-HighIQ-THINKING-HERETIC-UNCENSORED-FP8-vLLM

Text Generation • 9B • Updated Mar 13 • 864 • 4

cstr/Octen-Embedding-0.6B-ONNX-INT8

Sentence Similarity • Updated 5 days ago • 29 • 2

nuofang/Qwen3.5-9B-Claude-4.6-Opus-Deckard-V4.2-Uncensored-Heretic-Thinking-GGUF

9B • Updated Mar 21 • 184 • 2

dealignai/Nemotron-Cascade-2-30B-A3B-UNCENSORED-JANG_2L

Text Generation • 5B • Updated Apr 17 • 268 • 4

RepublicOfKorokke/GLM-4.7-Flash-REAP-23B-A3B-oQ4

Text Generation • 4B • Updated Mar 30 • 141 • 3

RepublicOfKorokke/Qwen3.5-2B-oQ4

Text Generation • 0.6B • Updated Mar 27 • 57 • 1

michaelw9999/Nemotron-Cascade-2-30B-A3B-NVFP4-GGUF

Text Generation • 32B • Updated Apr 2 • 1.18k • 6

QuantFunc/Qwen-Image-Edit-Series

Image-to-Image • Updated Jun 26 • 15 • 5

cudabenchmarktest/personaplex-7b-turbo2bit

Updated Mar 29 • 17 • 6

Andy-ML-And-AI/SocratesAI-GGUF

7B • Updated Mar 28 • 223 • 2

aufklarer/Qwen3.5-0.8B-Chat-CoreML

Text Generation • Updated 8 days ago • 1.62k • 1

ggml-org/gemma-4-26B-A4B-it-GGUF

Image-Text-to-Text • 25B • Updated 13 days ago • 55.2k • 79

fuchuenchow/NVIDIA-Nemotron-3-Nano-30B-A3B-oQ8e

32B • Updated Apr 2 • 17 • 1

mudler/Qwen3.5-122B-A10B-APEX-GGUF

122B • Updated Apr 27 • 10k • 30

Abiray/gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-GGUF

Text Generation • 8B • Updated Apr 4 • 459 • 8

mudler/gemma-4-26B-A4B-it-heretic-APEX-GGUF

25B • Updated Apr 27 • 15k • 50

mudler/gemma-4-26B-A4B-it-Claude-Opus-Distill-APEX-GGUF

25B • Updated Apr 27 • 12.8k • 20

mudler/Qwen3-Coder-Next-APEX-GGUF

80B • Updated Apr 27 • 10.4k • 17