Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,255

Base only

Active filters: quantization

arashakb/FASTWAM-Unitree-G1

Robotics • Updated Aug 28

BoldingBuilds/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-ShimQuant-GGUF

Text Generation • 35B • Updated Aug 30 • 378 • 3

arashakb/IMAGEWAM-Unitree-G1

Robotics • Updated about 1 month ago

q3146dq4/supertonic-3-w8a8-qnn-qdq

Text-to-Speech • Updated Aug 29

CMSManhattan/JiRackDeltaNet_27b

Text Generation • 27B • Updated 4 days ago • 552k • 1

Strg-Alt-Entf-0x00/FireRedVAD-GGUF

Voice Activity Detection • 589k • Updated Aug 30 • 94 • 1

RoyYao233/scenario-quant-v2-ckpts

Updated 28 days ago

iromu/Gemma3-1B-tools-NVFP4

0.7B • Updated Aug 29 • 8

vikasclawd/GLM-5.3-Int4-Int8Mix

Text Generation • Updated 21 days ago • 694 • 2

HamboneLabs-AI/Qwen3.8-Flash-Next-uint3-g64

Text Generation • 16B • Updated Aug 29 • 217 • 2

lackonendes/PAW-27B-GGUF

6B • Updated 3 days ago • 271 • 1

SC117/Qwen3.8-27B-Uncensored-FIT-GGUF

Text Generation • 27B • Updated Aug 30 • 16.8k • 17

prehj/quantgate-student-robocasa-phase5-binary

Robotics • Updated Aug 30

prehj/quantgate-student-robocasa-phase5-softA

Robotics • Updated Aug 30

prehj/quantgate-student-robocasa-phase5-softB

Robotics • Updated Aug 30

prehj/quantgate-student-robocasa-phase5-dinov3s

Robotics • Updated Aug 30

mradermacher/JiRackDeltaNet_27b-GGUF

Text Generation • 27B • Updated Aug 30 • 216

doldolggi/EvoCUA-8B-20260105-GGUF

Image-Text-to-Text • 8B • Updated about 1 month ago • 1.64k

Hana-ame/additive-rand-transformer

Reinforcement Learning • Updated about 9 hours ago

textclf/Qwen3-Coder-Next-TQ-4bit

Text Generation • 0.8B • Updated 19 days ago • 186

doldolggi/EvoCUA-32B-20260105-GGUF

Image-Text-to-Text • 33B • Updated about 1 month ago • 1.33k

q3146dq4/Supertonic-3-LiteRT-WI8-AFP32

Text-to-Speech • Updated 30 days ago • 131

xv0y5ncu/Qwen3.8-27B-GLQ-trellis-3inst-3bpw

Image-Text-to-Text • 8B • Updated about 1 month ago • 31

Soulfate24/Ornith-1.5-9B-MTP-ASHQ1-Remix-GGUF

Text Generation • 9B • Updated 20 days ago • 3.32k • 3

RemySkye/Qwen3.8-Flash-Next-REAM-60Pct-GGUF

Text Generation • 129B • Updated 23 days ago • 15.5k • 5

rfi-irfos/dingir-ternary-gnn-poc

Updated about 1 month ago

Soulfate24/TwIL-LM3-ASHQ1-Remix-GGUF

Text Generation • 3B • Updated 20 days ago • 1.64k

Soulfate24/LFM2.5-2.6B-DSpark-ASHQ1-Remix-GGUF

Text Generation • 3B • Updated 20 days ago • 2.01k

Soulfate24/ReaderLM-v2-ASHQ1-Remix-GGUF

Text Generation • 2B • Updated 20 days ago • 1.22k

Soulfate24/MiniCPM5-1B-ASHQ1-Remix-GGUF

Text Generation • 1B • Updated 20 days ago • 1.22k