Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,288

Base only

Active filters: quantization

Danny-Dasilva/Qwen3-8B-antidoom-W4A16-GPTQ-g32-DSpark

Text Generation • 8B • Updated Jul 8 • 67 • 1

SC117/Qwen-AgentWorld-35B-A3B-MTP-Uncensored-APEX-GGUF

Text Generation • 0.4B • Updated Jul 8 • 1.34k • 13

SC117/Qwen-AgentWorld-35B-A3B-MTP-APEX-GGUF

Text Generation • 0.4B • Updated Jul 8 • 918 • 8

ApacheOne/orbitquant_unets

Text-to-Image • Updated Jul 10

Litwein/Qwen3.6-35B-A3B-Claude-4.7-Opus-DWQ4-MTP-Vision-MLX

Image-Text-to-Text • 36B • Updated Jul 15 • 100 • 1

Litwein/Qwen3.6-35B-A3B-Claude-4.7-Opus-DWQ4-MTP-MLX

Text Generation • 36B • Updated Jul 15 • 131 • 2

Litwein/Qwen3.6-35B-A3B-Claude-4.7-Opus-oQ4-MTP-Vision-MLX

Image-Text-to-Text • 36B • Updated Jul 15 • 80

Litwein/Qwen3.6-35B-A3B-Claude-4.7-Opus-oQ4-MTP-MLX

Text Generation • 36B • Updated Jul 15 • 158

avtc/Hy3-GPTQ-RTN-4bit-tp8

Text Generation • 295B • Updated Jul 28 • 28 • 3

happynood/DeepSeek-R1-Distill-Qwen-1.5B-GGUF

2B • Updated Jul 8 • 20

happynood/DeepSeek-R1-Distill-Qwen-1.5B-GPTQ

2B • Updated Jul 8 • 12

Danny-Dasilva/Qwen3-14B-antidoom-W4A16-GPTQ-g32-DSpark

Text Generation • 15B • Updated Jul 11 • 31

urs-rs/gemma-4-26B-A4B-it-FP8-DYNAMIC

Image-Text-to-Text • 27B • Updated Jul 13 • 1.58k

shilohjt/GLM-4.5-Air-EXL3-RW-2.25bpw

16B • Updated Jul 9 • 7

yihao-liang/DVD-AWQ

Depth Estimation • Updated Jul 9

Azimml/Qwen3-1.7B-trellis-3bit-webgpu

Updated Jul 9 • 3

Azimml/Qwen3-8B-trellis-3bit-webgpu

Updated Jul 9 • 8

haven-ai-companion/gemma4-e4b-merged-iq4xs-turbo

Text Generation • 8B • Updated Jul 13 • 59

Azimml/SmolLM2-135M-trellis-3bit-webgpu

Updated Jul 9 • 3

Yingyaeliae/grok-oss-Apollyon-24B-heretic

24B • Updated Jul 9 • 450 • 1

Dhi-Technologies/prompt2model-reference-onnx

Image Classification • Updated Jul 28

yosoyalguien/Meta-Llama-3.1-8B-Instruct-GGUF-TQ4_1S

8B • Updated Jul 9 • 14

yosoyalguien/Qwen3.5-9B-GGUF-TQ4_1S

9B • Updated Jul 9 • 80 • 1

yosoyalguien/gemma-4-E2B-it-GGUF-TQ4_1S

5B • Updated Jul 9 • 42

avtc/Hy3-autoround-RTN-4bit-tp8-ep

Text Generation • 44B • Updated Jul 9 • 20 • 1

yosoyalguien/gemma-4-E4B-it-GGUF-TQ4_1S

8B • Updated Jul 9 • 36

realrebelai/LingBot_ComfyUI

Image-to-Video • Updated Jul 11 • 3.62k • 11

Yingyaeliae/grok-oss-Apollyon-8B-heretic-GGUF

8B • Updated Jul 10 • 267

mradermacher/grok-oss-Apollyon-24B-heretic-GGUF

24B • Updated Jul 10 • 752

mradermacher/grok-oss-Apollyon-24B-heretic-i1-GGUF

24B • Updated Jul 10 • 1.87k • 1