Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,256

Base only

Active filters: quantization

rshoemake/taq-qwen32b-mixed-allocator-4bit

33B • Updated Aug 14 • 7

CNWPlayer/gemmeh-it-GGUF

1B • Updated Aug 11 • 333

rshoemake/taq-qwen32b-coder-outlier-2bit

33B • Updated Aug 15 • 10

praveenkumarpranjal/LFM2.5-2.6B-4bit-PathPack-Q

Text Generation • 3B • Updated Aug 11 • 63

rshoemake/taq-qwen32b-coder-rotation-outlier-2bit

33B • Updated Aug 15 • 13

rshoemake/taq-qwen32b-coder-outlier-3bit

33B • Updated Aug 15 • 11

rshoemake/taq-qwen32b-outlier-3bit

33B • Updated Aug 14 • 6

rshoemake/taq-qwen32b-coder-rotation-outlier-3bit

33B • Updated Aug 15 • 6

rshoemake/taq-qwen32b-rotation-outlier-3bit

33B • Updated Aug 14 • 9

Vishva007/Muse-Glimmer-30B-W4A16-AutoRound

Image-Text-to-Text • 5B • Updated 20 days ago • 114

Vishva007/Muse-Glimmer-30B-W4A16-AutoRound-GPTQ

Image-Text-to-Text • 5B • Updated 20 days ago • 196 • 1

TrojAI/ostquant_qwen3_4b_w4a4kv16_int4_v2

1.0B • Updated Aug 11 • 16

JuliaML/Cosmos3-Super-Image2Video-4Step-INT4-G64-BF16

Image-to-Video • 34B • Updated Aug 11

JuliaML/Cosmos3-Super-Image2Video-4Step-INT8-G64-BF16

Image-to-Video • 65B • Updated Aug 11 • 1

TrojAI/ostquant_qwen3_4b_w4a4kv4_int4_v2

1.0B • Updated Aug 11 • 6

Vishva007/Muse-Glimmer-30B-W2A16-AutoRound

Image-Text-to-Text • 5B • Updated 20 days ago • 86

Vishva007/Muse-Glimmer-30B-W2A16-AutoRound-GPTQ

Image-Text-to-Text • 5B • Updated 20 days ago • 33

rshoemake/taq-qwen32b-coder-outlier-4bit

33B • Updated Aug 15 • 7

rshoemake/taq-qwen32b-coder-rotation-outlier-4bit

33B • Updated Aug 15 • 7

rshoemake/taq-qwen32b-outlier-2bit

33B • Updated Aug 14 • 5

rshoemake/taq-qwen32b-rotation-outlier-2bit

33B • Updated Aug 14 • 5

rshoemake/taq-qwen32b-coder-mixed-allocator-2bit

33B • Updated Aug 15 • 15

rshoemake/taq-qwen32b-outlier-4bit

33B • Updated Aug 14 • 6

rshoemake/taq-qwen32b-coder-mixed-allocator-3bit

33B • Updated Aug 15 • 11

Uzbekswe/Muse-Glimmer-30B-Q4_K_M-GGUF

Text Generation • 28B • Updated Aug 12 • 259 • 2

rshoemake/taq-qwen32b-rotation-outlier-4bit

33B • Updated Aug 14 • 7

kaushikmondal2289/needle2

Text Generation • Updated Aug 12 • 59

rshoemake/taq-qwen32b-coder-mixed-allocator-4bit

33B • Updated Aug 15 • 12

rshoemake/taq-qwen32b-mixed-allocator-2bit

33B • Updated Aug 14 • 5

DmitryDB/LTX-2.5-ComfyUI-Quants

Text-to-Video • Updated Aug 13 • 2