Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,299

Base only

Active filters: quantization

SC117/Huihui-Nex-N2-mini-abliterated-APEX-GGUF

Image-Text-to-Text • 35B • Updated Jun 26 • 918 • 6

ArnavKewalram/gemma-4-E2B-coder-v1

Text Generation • 5B • Updated Jun 22 • 929 • 2

wepiqx/gemma-4-12B-it-SHQ6-GGUF

Text Generation • 12B • Updated Jun 23 • 269 • 2

Dayoung-space/SSUPER-AIGID

Image-Text-to-Text • Updated Jun 17 • 1

tonera/Qwen-Image-Edit-2511-Lightning-Nunchaku

Image-to-Image • Updated Jun 23 • 292 • 3

divyeshkamalanaban/nucleotide-transformer-2.5b-multi-species-NF4-Q4

Fill-Mask • 3B • Updated Jun 18 • 9 • 1

sakamakismile/Qwen3.6-27B-MTP-pi-tune-NVFP4

Image-Text-to-Text • 17B • Updated Jun 17 • 65.1k • 11

realrebelai/Boogu-Image-Base_GGUFs

Text-to-Image • 10B • Updated Jun 20 • 543 • 9

ycchen/proof-pilot-deploy-bundle

Updated 23 days ago

AnthonyL1996/Qwopus3.6-27B-Coder-ik-MTP-GGUF

Text Generation • 27B • Updated Jun 18 • 106

saital/Qwen3.5-4B-W4A16-g128-lmheadW8

Image-Text-to-Text • 5B • Updated Jun 29 • 39

Helllbos/Qwen_Quantised3.50.5b

Text Generation • Updated Jun 18 • 1

vinpix/Bonsai-8B-llama.cpp

Text Generation • 8B • Updated 20 days ago • 1.94k • 7

clark-labs/clark-air-sana-1.6b-1.58bit

Text-to-Image • 2B • Updated Jun 28 • 46 • 12

wepiqx/gemma-4-12B-OBLITERATED-SHQ7-GGUF

Text Generation • 12B • Updated Jun 23 • 550 • 4

tonera/FLUX.2-klein-4B-Nunchaku

Image-to-Image • 4B • Updated Jun 23 • 960 • 5

NU-World-Model-Embodied-AI/ActQuant-Pi05-LIBERO-3bpw

Robotics • 3B • Updated Jun 19 • 178

NU-World-Model-Embodied-AI/ActQuant-Pi05-LIBERO-4bpw

Robotics • 3B • Updated Jun 19 • 20

NU-World-Model-Embodied-AI/ActQuant-Pi05-LIBERO-3.5bpw

Robotics • 3B • Updated Jun 19 • 21

tg-techie-agents/Q1D-4B-Blk0thru1-V1

Text Generation • 4B • Updated Jun 19 • 17

tg-techie-agents/Q1D-4B-Blk0thru3-V1

Text Generation • 4B • Updated Jun 19 • 12

tg-techie-agents/Q1D-4B-Blk0thru3-V2

Text Generation • 4B • Updated Jun 19 • 17

tg-techie-agents/Q1D-4B-Blk0thru3-V3

Text Generation • 4B • Updated Jun 19 • 16

wepiqx/Qwable-9B-Claude-Fable-5-SHQ8-GGUF

Text Generation • 9B • Updated Jun 23 • 519 • 5

tonera/Qwen-Image-2512-Lightning-Nunchaku

Text-to-Image • 20B • Updated Jun 23 • 67 • 2

kongbai-84/animagguf-quantizer

Updated Jun 20 • 9

phptop/cohere-transcribe-03-2026-int8

Automatic Speech Recognition • Updated Jun 21

RESMP-DEV/MiMo-V2.5-ASR-FP8

Automatic Speech Recognition • 8B • Updated Jun 21 • 14

barryke/granite-4.1-8b-FP8-DYNAMIC

Text Generation • 9B • Updated Jun 21 • 8

sheikhmufrad/omniASR-LLM-7B-v2-quantized

Automatic Speech Recognition • Updated Jun 22