Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

18,164

Base only

Active filters: quantized

appautomaton/fishaudio-s2-pro-8bit-mlx

Text-to-Speech • 5B • Updated 25 days ago • 640 • 6

mlx-community/YOLO26x-OptiQ-6bit

Object Detection • Updated 7 days ago • 236 • 4

appautomaton/step-audio-editx-8bit-mlx

Text-to-Speech • 4B • Updated 9 days ago • 182 • 3

sxiaa/Gemma-4-31B-JANG_4M-CRACK-GGUF

Text Generation • 31B • Updated Apr 11 • 176 • 1

w475241512/Gemma-4-31B-JANG_4M-CRACK-GGUF

Text Generation • 31B • Updated Apr 12 • 242 • 1

tutuchen2000/Gemma-4-31B-JANG_4M-CRACK-GGUF

Text Generation • 31B • Updated Apr 13 • 183 • 1

mlx-community/gemma-4-26B-A4B-it-heretic-msq-2.6bit

Image-Text-to-Text • 26B • Updated May 19 • 424 • 10

mattbucci/gemma-4-31B-it-AutoRound-AWQ

31B • Updated May 11 • 1.89k • 1

CISCai/gemma-4-31B-it-NVFP4-turbo-GGUF

Text Generation • 31B • Updated Apr 16 • 1.41k • 31

mudler/Qwen3.6-35B-A3B-APEX-GGUF

35B • Updated Aug 17 • 103k • 203

majentik/Kokoro-82M-MLX-8bit

Text-to-Speech • 81.8M • Updated Apr 17 • 52 • 2

batiai/Qwen3-Reranker-0.6B-GGUF

Text Ranking • 0.6B • Updated Apr 17 • 225 • 1

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 6.04k • 82

baa-ai/Qwen3.6-35B-A3B-RAM-26GB-GGUF

Text Generation • 35B • Updated Apr 20 • 160 • 1

kenpath/svara-tts-v1-openvino-int4

Text-to-Speech • Updated Apr 21 • 472 • 3

Jundot/Qwen3.6-27B-oQ4

27B • Updated Apr 23 • 64 • 7

wangzhang/Qwen3.6-27B-abliterated-GGUF

Text Generation • 27B • Updated Aug 29 • 1.31k • 10

antirez/deepseek-v4-gguf

Text Generation • 284B • Updated Aug 31 • 1.27M • 478

Pavan44444/ultravox-v0_6-gemma4-31b-nvfp4-surgical

21B • Updated Apr 27 • 36 • 1

groxaxo/Qwen3.6-27B-abliterated-v2-UD-GGUF

27B • Updated Aug 22 • 302 • 3

nvidia/Gemma-4-26B-A4B-NVFP4

Text Generation • 14B • Updated May 11 • 1.07M • 154

fesalfayed/gpt-oss-20b-hermes_agent-tool-finetune_gguf

Text Generation • 21B • Updated May 2 • 2.28k • 6

evilfreelancer/whisper-podlodka-turbo-MLX

Automatic Speech Recognition • Updated May 2 • 2

drawais/Qwen3-Embedding-0.6B-AWQ-INT4

Text Generation • 0.6B • Updated May 3 • 978 • 4

majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-TurboQuant-GGUF-MXFP4_MOE

Image-Text-to-Text • 32B • Updated 20 days ago • 400 • 1

allura-forge/G4-E4B-Musica-v1-LiteRT-TFLite

Updated May 7 • 67 • 3

barozp/Qwopus3.6-35B-A3B-v1-GGUF

Text Generation • 35B • Updated May 7 • 662 • 3

FGFGFGGDFGDFGSD/qwen3-0.6-Claude4.6-4.7-Gpt5.5-Gemini3.1pro-gguf

0.6B • Updated May 10 • 1.02k • 2

Jundot/Qwen3.6-35B-A3B-oQ4-mtp

36B • Updated May 12 • 442 • 10

sinimiini/HRM-Text-1B-GGUF

Text Generation • 1B • Updated May 21 • 312 • 22