Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,256

Base only

Active filters: quantization

nuvaidev/all-MiniLM-L6-v2-onnx-quantized

Feature Extraction • Updated Aug 12 • 14 • 1

Geometric-AI/Muse-Glimmer-30B-geoquant-GGUF

Text Generation • 28B • Updated Aug 14 • 114 • 1

dstair/gated-deltanet-nki-trainium

dstair/qwen3.5-moe-fp8-trainium2

Schackay3/Qwen3-Next-80B-A3B-Instruct-ternary-GGUF

Text Generation • 80B • Updated Aug 12 • 572 • 6

ftc8565/replitedet-s0

Object Detection • Updated Aug 14 • 22

lshar/ARM-TUNE-CPU-INFERENCE-OPT

Text Generation • Updated Aug 14

ApacheOne/facelift_convrot_int8_int4_runtimes

Updated Aug 13 • 1

surogate/Qwen3.5-2B-SWQ

Image-Text-to-Text • 2B • Updated Aug 13 • 10

surogate/Qwen3.5-4B-SWQ

Image-Text-to-Text • 3B • Updated Aug 14 • 13 • 1

LokkenJP/10EROS_1.5_int8_convrot_exp_learned

Image-to-Video • Updated Aug 13 • 3

guruswami-ai/qwen3.8-2.4t-mlx-tp4-recipe

Ishowbackup/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-NVFP4

Any-to-Any • 18B • Updated Aug 13 • 34

konic-labs/LFM2.5-VL-3B-ffn8192-int4

3B • Updated Aug 13 • 7

lite-infer/flux.2-klein-4b-nunchaku-lite-int4_r32-bnb4-text-encoder

Text-to-Image • 2B • Updated Aug 17 • 31

lite-infer/flux.2-klein-4b-nunchaku-lite-nvfp4_r32-bnb4-text-encoder

Text-to-Image • 2B • Updated Aug 17 • 87

lite-infer/flux.2-klein-9b-nunchaku-lite-int4_r32-bnb4-text-encoder

Text-to-Image • 5B • Updated Aug 17 • 12

lite-infer/flux.2-klein-9b-nunchaku-lite-nvfp4_r32-bnb4-text-encoder

Text-to-Image • 5B • Updated Aug 17 • 100

Myric/Mellum2-12B-A2.5B-Thinking-APEX-GGUF

12B • Updated Aug 14 • 206

konic-labs/LFM2.5-VL-3B-ffn7168-int4

3B • Updated Aug 13 • 7

konic-labs/LFM2.5-VL-3B-ffn6144-int4

3B • Updated Aug 13 • 5

NidAll/MiniMax-Music3-W4A8

Updated Aug 13 • 3

AnnotateIt/edgecrafter-ecseg-optimization-experiments

Image Segmentation • Updated 12 days ago • 2

goldhub/Qwen3.6-40B-Fable-Fusion-6-Core-Deckard-Eleanor-Heretic-Uncensored-W4A16-AutoRound

Text Generation • 15B • Updated Aug 19 • 234 • 4

shubhambaid/LFM2.5-VL-3B-MLX-mixed-v6p6b4e4

Image-Text-to-Text • 3B • Updated Aug 14 • 50 • 2

safffrron/25M2111-Week01-Track1-20-Submission01

Text Generation • Updated Aug 14

safffrron/25M2111-Week01-Track2-20-Submission01

Text Generation • Updated Aug 14

safffrron/25M2111-Week01-Track1-40-Submission01

Text Generation • Updated Aug 14

safffrron/25M2111-Week01-Track2-40-Submission01

Text Generation • Updated Aug 14

KikoCis/Qwen3.6-27B-GGUF

Text Generation • 27B • Updated Aug 14 • 328