Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,256

Base only

Active filters: quantization

litfury/25M0831-Week01-Track1-Submission01

KikoCis/KAT-Coder-V2.5-Dev-IQ2_M-GGUF

Text Generation • 35B • Updated Aug 14 • 62

KikoCis/MiniMax-M2-REAP-139B-A10B-IQ2_XXS-GGUF

Text Generation • 139B • Updated Aug 14 • 61

marlalabsAI/Qwen3.5-4B-SX8

Text Generation • 4B • Updated Aug 29 • 76

quimmedes/Qwen3.8-27B-XYZ

27B • Updated Aug 26 • 7.67k • 53

uzairkhn/Qwen3.8-27B-FP4

Text Generation • 27B • Updated Aug 14 • 599 • 1

Lufel6848/Qwen3.5-9B-GGUF

9B • Updated Aug 14 • 180

Arki05/Qwen3.8-27B-GGUF-shards

2.67M • Updated Aug 27 • 5.08k

Lufel6848/Qwen3.5-4B-GGUF

4B • Updated Aug 14 • 211

Lufel6848/Qwen3.5-2B-GGUF

2B • Updated Aug 14 • 182

ucsbcit/InternVL3_5-38B-Flash-FP8

Image-Text-to-Text • 40B • Updated Aug 15 • 56

JackBinary/ROCmFPX-Quantize-Playbook

Updated Aug 14 • 1

Lufel6848/DeepSeek-R1-Distill-Qwen-7B-to-GGUF

8B • Updated Aug 14 • 126

Vishva007/Qwen3.8-27B-W4A16-AutoRound

Image-Text-to-Text • 3B • Updated 20 days ago • 1.81k • 2

Vishva007/Qwen3.8-27B-W4A16-AutoRound-GPTQ

Image-Text-to-Text • 3B • Updated 20 days ago • 30.2k • 10

kaminoke0731/wan22-qx-encoders-gguf

Text-to-Video • 6B • Updated Aug 14 • 83

CodeFlame/gemma-4-e4b-gguf

8B • Updated Aug 14 • 73 • 1

Lufel6848/Ministral-3-8B-Reasoning-2512-GGUF

8B • Updated Aug 14 • 169

Lufel6848/LFM2.5-2.6B-GGUF

3B • Updated Aug 14 • 207

KanakMalpani/bnn-lab-wrap-demo

Other • Updated Aug 14

Lufel6848/Qwen3.5-0.8B-GGUF

0.8B • Updated Aug 14 • 144

zherebetskyy/Qwen3.8-27B-mxfp8-mlx

Image-Text-to-Text • 27B • Updated Aug 15 • 102 • 1

yongyizang/TinyMOSS-Diarize

Automatic Speech Recognition • Updated Aug 14

petergilani/Qwen3.8-27B-MTP-8bit

Text Generation • 8B • Updated Aug 15 • 115

kristianpaul/Qwen3.8-27B-NVFP4

Text Generation • 15B • Updated Aug 15 • 172 • 1

brandonmusic/GLM-5.2-SQG-Coupled-H512-H128-K96Tail

Text Generation • Updated 4 days ago • 5

petergilani/Qwen3.8-27B-MTP-4bit

Text Generation • 4B • Updated Aug 15 • 147 • 1

amd/Qwen3.8-27B-Quark-Qronos-INT4-W4A16

Image-Text-to-Text • 6B • Updated Aug 28 • 1.03k • 2

amd/Qwen3.8-27B-Quark-AWQ-INT4-W4A16

Image-Text-to-Text • 6B • Updated Aug 28 • 55.5k • 21

haihengh/Qwen3.6-35B-A3B-finchmoe-3bit