Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

18,374

Base only

Active filters: quantized

nvidia/DeepSeek-R1-0528-NVFP4

Text Generation • 397B • Updated Aug 22, 2025 • 2.92k • 45

and-emili/aera-4b-GGUF

Text Generation • 4B • Updated Sep 24, 2025 • 120

steampunque/gemma-3-27b-it-MP-GGUF

27B • Updated Feb 18 • 95

XythicK/Qwen.Qwen2.5-Math-1.5B-GGUF

2B • Updated Jun 5, 2025 • 143

CarlOwOs/Qwen3-0.6B-Base-int2

Text Generation • 0.3B • Updated Jun 5, 2025 • 17

CarlOwOs/Qwen3-0.6B-Base-int4

Text Generation • 0.5B • Updated Jun 5, 2025 • 18

CarlOwOs/Qwen3-0.6B-Base-int8

Text Generation • 0.8B • Updated Jun 5, 2025 • 11

QuantStack/Wan2.1_T2V_14B_FusionX-GGUF

Text-to-Video • 14B • Updated Jun 12, 2025 • 5.5k • 29

QuantStack/Wan2.1_T2V_14B_FusionX_VACE-GGUF

Image-to-Video • 17B • Updated Jun 12, 2025 • 7.6k • 59

boltuix/bert-mini

Text Classification • 4.81M • Updated Jun 30, 2025 • 540 • 26

humbleakh/ram-swin-large-4bit-chain-of-zoom

Image-to-Image • Updated Jun 8, 2025 • 12

humbleakh/qwen2.5-vl-3b-8bit-chain-of-zoom

Image-to-Text • Updated Jun 8, 2025 • 25 • 1

humbleakh/stable-diffusion-8bit-chain-of-zoom

Image-to-Image • Updated Jun 8, 2025 • 10

humbleakh/lora-adapters-4bit-chain-of-zoom

Image-to-Image • Updated Jun 8, 2025

humbleakh/chain-of-zoom-8bit-complete-pipeline

Image-to-Image • Updated Jun 8, 2025 • 2

LeonSaia/minerva

7B • Updated Jun 9, 2025 • 11

duydq12/Qwen2.5-Coder-7B-Instruct-FP8-dynamic

Text Generation • 8B • Updated Jun 9, 2025 • 12

duydq12/Qwen2.5-7B-Instruct-1M-FP8-dynamic

Text Generation • 8B • Updated Jun 9, 2025 • 18 • 1

duydq12/Qwen2.5-14B-Instruct-1M-FP8-dynamic

Text Generation • 15B • Updated Jun 9, 2025 • 15

duydq12/Qwen2.5-Coder-14B-Instruct-FP8-dynamic

Text Generation • 15B • Updated Jun 9, 2025 • 14

duydq12/QwQ-32B-FP8-dynamic

Text Generation • 33B • Updated Jun 9, 2025 • 14

duydq12/Qwen2.5-Coder-32B-Instruct-FP8-dynamic

Text Generation • 33B • Updated Jun 9, 2025 • 1.84k

duydq12/GLM-4-32B-0414-FP8-dynamic

Text Generation • 33B • Updated Jun 9, 2025 • 26

duydq12/GLM-Z1-32B-0414-FP8-dynamic

Text Generation • 33B • Updated Jun 9, 2025 • 14

duydq12/nomic-embed-code-FP8-dynamic

Text Generation • 8B • Updated Jun 9, 2025 • 16 • 1

duydq12/Qwen2.5-Coder-1.5B-Instruct-FP8-dynamic

Text Generation • 2B • Updated Jun 9, 2025 • 17

duydq12/Qwen2.5-Coder-3B-Instruct-FP8-dynamic

Text Generation • 3B • Updated Jun 9, 2025 • 10

nikodoz/qwen2.5-7b-instruct-int4

Text Generation • 8B • Updated Jun 10, 2025 • 18 • 1

LibraxisAI/c4ai-command-a-03-2025-q5-mlx

Text Generation • Updated May 12

ReallyFloppyPenguin/Holo1-3B-GGUF

3B • Updated Jun 10, 2025 • 62 • 2