Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,300

Base only

Active filters: quantization

Crusadersk/quantsafe-refusal-modernbert

Text Classification • 0.1B • Updated Jun 13 • 31

xv0y5ncu/gemma-4-26B-A4B-it-GLQ-3bpw

Image-Text-to-Text • 7B • Updated Jun 14 • 231

xv0y5ncu/gemma-4-26B-A4B-it-GLQ-5bpw

Image-Text-to-Text • 11B • Updated Jun 16 • 35

xv0y5ncu/gemma-4-26B-A4B-it-GLQ-6bpw

Image-Text-to-Text • 11B • Updated Jun 17 • 21

Defnotirf/gemma-4-E4B-hybrid-GGUF

Image-to-Text • 8B • Updated Jun 14

aquaman164/Nex-N2-Pro-AutoBit-3.2bpw

Text Generation • Updated Jun 17 • 134

FilledVaccum/gemma-4-31B-awq-manual

hansaka01/qwen2.5-7b-naive-1bit-ptq

Text Generation • Updated Jun 14

DJLougen/Qwen3.6-35B-A3B-REAP-90pct-GGUF

Text Generation • 6B • Updated Jun 14 • 919 • 17

tg-techie-agents/Q1D-4B-Blk0-V1

Text Generation • 4B • Updated Jun 14 • 7

anhnlq/Qwen3-30B-A3B-Q4_K_M-GGUF

Text Generation • 31B • Updated Jun 15 • 23

Abiray/SCAIL-2-GGUF

Image-to-Video • 16B • Updated Jun 14 • 6.93k • 11

tg-techie-agents/Q1D-8B-Blk0-V1

Text Generation • 8B • Updated Jun 19 • 29

MehulChourasia/sarvam-30b-compressed

32B • Updated Jun 16

Yingyaeliae/Ministral-3-14B-Nymphaea-RP-heretic

14B • Updated Jun 15 • 408

Pranay2412/sarvam-30b-W4A16-Autoround

Text Generation • 7B • Updated Jun 15

tg-techie-agents/Q1D-4B-Blk0-V2

Text Generation • 4B • Updated Jun 19 • 5

ltl1605/voxtral-fp8-round2

Automatic Speech Recognition • Updated Jun 15

KikoCis/vq-llm-compression

Shankara-A-S/sarvam-30b-godspeed

Text Generation • 6B • Updated Jun 15 • 32

leonsarmiento/MechaEpstein-8000-6bit-mlx

8B • Updated 11 days ago • 56

ForeverBlue/Qwen3-VL-2B-GRACE-W4G128-AWQ

Image-Text-to-Text • 0.9B • Updated Jun 16 • 17 • 1

Shankara-A-S/sarvam-30b-distillation-method

sahilchachra/fastcontext-1.0-4b-sft-mxfp4-mlx

0.8B • Updated Jun 16 • 7

sahilchachra/fastcontext-1.0-4b-sft-mxfp8-mlx

1B • Updated Jun 16 • 22

mradermacher/Ministral-3-14B-Nymphaea-RP-heretic-GGUF

14B • Updated Jun 16 • 380

sahilchachra/fastcontext-1.0-4b-sft-optiq-5bpw-mlx

0.8B • Updated Jun 16 • 21

SC117/Nex-N2-mini-APEX-GGUF

Image-Text-to-Text • 35B • Updated Jun 26 • 429

mradermacher/Ministral-3-14B-Nymphaea-RP-heretic-i1-GGUF

14B • Updated Jun 16 • 465

inductiveML/Qwen3.6-35B-A3B-evolved-mxbit

Text Generation • 35B • Updated Jun 17 • 92 • 1