Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

dynamic-quantization

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

92

Base only

Active filters: dynamic-quantization

ModelCloud/Phi-tiny-MoE-instruct-GPTQ-W4-MixedGroup-G32-G128

Text Generation • 4B • Updated 3 days ago • 19

amd/Qwen3.6-35B-A3B-w8a8-llmcompressor-v0.12.0

Text Generation • 35B • Updated about 10 hours ago • 4