Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

18,286

Base only

Active filters: quantized

duydq12/QwQ-32B-FP8-dynamic

Text Generation • 33B • Updated Jun 9, 2025 • 14

duydq12/Qwen2.5-Coder-32B-Instruct-FP8-dynamic

Text Generation • 33B • Updated Jun 9, 2025 • 1.84k

duydq12/GLM-4-32B-0414-FP8-dynamic

Text Generation • 33B • Updated Jun 9, 2025 • 23

duydq12/GLM-Z1-32B-0414-FP8-dynamic

Text Generation • 33B • Updated Jun 9, 2025 • 13

duydq12/nomic-embed-code-FP8-dynamic

Text Generation • 8B • Updated Jun 9, 2025 • 16 • 1

duydq12/Qwen2.5-Coder-1.5B-Instruct-FP8-dynamic

Text Generation • 2B • Updated Jun 9, 2025 • 17

duydq12/Qwen2.5-Coder-3B-Instruct-FP8-dynamic

Text Generation • 3B • Updated Jun 9, 2025 • 10

nikodoz/qwen2.5-7b-instruct-int4

Text Generation • 8B • Updated Jun 10, 2025 • 17 • 1

LibraxisAI/c4ai-command-a-03-2025-q5-mlx

Text Generation • Updated May 12

ReallyFloppyPenguin/Holo1-3B-GGUF

3B • Updated Jun 10, 2025 • 84 • 2

Hariprasath28/orpheus-3b-8bit-gptq

Text Generation • Updated Jun 10, 2025 • 22 • 1

QuantStack/Wan2.1_I2V_14B_FusionX-GGUF

Image-to-Video • 16B • Updated Jun 11, 2025 • 3.89k • 87

QuantStack/Phantom_Wan_14B_FusionX-GGUF

Image-to-Video • 14B • Updated Jun 12, 2025 • 1.41k • 36

RedHatAI/Llama-4-Maverick-17B-128E-Instruct-quantized.w4a16

Image-Text-to-Text • 405B • Updated Jun 12, 2025 • 1.36k • 1

LibraxisAI/Qwen3-235B-A22B-MLX-Q5

Text Generation • 235B • Updated May 11 • 28

sausheong/lexsg

Text Generation • 8B • Updated Jun 12, 2025 • 22

botirk/tiny-prompt-task-complexity-classifier

Text Classification • Updated Jun 12, 2025 • 25 • 3

Argonaut790/PA-stage2-Qwen7B-147-GGUF

8B • Updated Jun 12, 2025 • 15

komixenon/Llama-Sahabat-AI-v2-70B-IT-GGUF

Text Generation • 71B • Updated Jun 14, 2025 • 39

ReallyFloppyPenguin/sarvam-m-GGUF

24B • Updated Jun 14, 2025 • 188 • 1

cello78/sambanova-llama2-100-gguf-q8

Text Generation • 7B • Updated Jun 14, 2025 • 24

althayr/Gemma-3-Gaia-PT-BR-4b-it-GGUF

Text Generation • 4B • Updated Jun 14, 2025 • 28 • 1

althayr/Gemma-3-Gaia-PT-BR-4b-it-Q8_0-GGUF

Text Generation • 4B • Updated Jun 14, 2025 • 16

ReallyFloppyPenguin/DeepSeek-R1-0528-Qwen3-8B-GGUF

8B • Updated Jul 5, 2025 • 157

ReallyFloppyPenguin/MiniCPM4-8B-GGUF

8B • Updated Jun 14, 2025 • 66

ReallyFloppyPenguin/Nemotron-Research-Reasoning-Qwen-1.5B-GGUF

2B • Updated Jun 14, 2025 • 192 • 1

Renugadevi82/cisco-nx-ai-4bit

1B • Updated Jun 16, 2025 • 7

LibraxisAI/QwQ-32B-MLX-Q5

Text Generation • 33B • Updated May 11 • 19

ReallyFloppyPenguin/OpenCodeReasoning-Nemotron-14B-GGUF

15B • Updated Jun 16, 2025 • 92 • 1

QuantStack/Wan2.1_T2V_14B_LightX2V_StepCfgDistill_VACE-GGUF

Image-to-Video • 17B • Updated Jun 17, 2025 • 4.12k • 24