Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,309

Base only

Active filters: quantization

Winnougan/LTX-2.3-INT8

Updated Jun 27 • 23

Motif-Technologies/Motif-Video-2B-GGUF

Text-to-Video • 2B • Updated May 15 • 893 • 25

Abiray/Anima-base-v1.0-GGUF

Text-to-Image • 2B • Updated May 14 • 3.53k • 11

KeinNiemand/Qwopus3.5-122B-A10B-Kimi-K2.6-destill-healed-abliterated-IK_GGUF

Text Generation • 125B • Updated May 27 • 354 • 4

Reza2kn/Cosmos3-Nano-NVFP4-AWQ

Text-to-Image • Updated Jun 2 • 21 • 5

InsecureErasure/Wan2.2-I2V-A14B-Moe-Distill-Lightx2v-NVFP4

Image-to-Video • Updated Jun 7 • 1.04k • 3

pearsonkyle/Qwopus3.6-27B-Coder-imatrix-MTP-GGUF

Text Generation • 27B • Updated Jun 25 • 816 • 6

wenshutang/ternlight

Sentence Similarity • Updated 26 days ago • 7

molbal/krea2-gguf

Text-to-Image • 13B • Updated 8 days ago • 17.3k • 16

madeby561/GLM-5.2-MXFP8-NVFP4-NF3-Hybrid

318B • Updated 7 days ago • 5.25k • 68

mradermacher/Ornith-1.0-35B-Heretic-MTP-i1-GGUF

36B • Updated 21 days ago • 2.75k • 2

rdtand/Hy3-295B-A21B-prismaquant-gridbook-2.9bit-vllm

Text Generation • 104B • Updated 6 days ago • 68 • 3

0xSero/GLM-5.2-MXFP8-NVFP4-NF3-Hybrid-Vision

Image-Text-to-Text • 348B • Updated 9 days ago • 166 • 7

Myric/Laguna-S-2.1-imatrix-calibration-study

Updated 10 days ago • 3

brandonmusic/GLM-5.2-EXL3-DENSE6-MTP78

Text Generation • 150B • Updated 4 days ago • 83 • 2

infosave/Qwen3.6-35B-A3B-Escha-W2cmf

Text Generation • Updated 4 days ago • 2

ai-in-projectmanagement/ProjectManagementLLM

Text Generation • Updated Jun 19, 2025 • 15

lianghsun/Llama-3.2-Taiwan-3B-Instruct-GGUF

Text Generation • 4B • Updated May 4 • 1.21k • 11

btaskel/Illustrious-XL-v2.0-GGUF

Text-to-Image • 3B • Updated Apr 21, 2025 • 128 • 9

gpahal/bge-m3-onnx-int8

Feature Extraction • Updated Jun 25, 2025 • 4.02k • 3

MoringLabs/Qwen3.5-122B-A10B-MLX-3.7bit-VL-v2

Image-Text-to-Text • 17B • Updated Apr 6 • 645 • 2

zhangsq-nju/Qwen3-0.6B-EdgeRazor-4bit

Text Generation • 0.6B • Updated Jun 11 • 9 • 7

zhangsq-nju/Qwen3-0.6B-EdgeRazor-2.79bit

Text Generation • 0.6B • Updated Jun 11 • 11 • 1

zhangsq-nju/Qwen3-0.6B-EdgeRazor-1.88bit

Text Generation • 0.6B • Updated Jun 11 • 8 • 1

zhangsq-nju/Qwen3-0.6B-EdgeRazor-1.58bit

Text Generation • 0.6B • Updated Jun 11 • 45 • 1

zhangsq-nju/Qwen3-1.7B-EdgeRazor-4bit

Text Generation • 2B • Updated Jun 11 • 10 • 1

zhangsq-nju/Qwen3-1.7B-EdgeRazor-2.79bit

Text Generation • 2B • Updated Jun 11 • 16 • 1

zhangsq-nju/Qwen3-1.7B-EdgeRazor-1.88bit

Text Generation • 2B • Updated Jun 11 • 16 • 2

zhangsq-nju/Qwen3-1.7B-EdgeRazor-1.58bit

Text Generation • 2B • Updated Jun 11 • 86 • 2

zhangsq-nju/MobileLLM-350M-EdgeRazor-4bit

Text Generation • 0.4B • Updated Jun 11 • 11 • 1