88plug/Qwen3.6-35B-A3B-W8A16
Image-Text-to-Text • 35B • Updated • 796 • 3
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
462
Active filters: llmcompressor
canada-quant/hy3-w4a16-mtp
Text Generation • 47B • Updated • 1.62k • 4
RedHatAI/Qwen2.5-3B-quantized.w4a16
Text Generation • 3B • Updated • 558 • 1
Glazkov/qwen2.5-vl-table-extraction-FP8-Dynamic
Image-to-Text • 4B • Updated • 3 • 1
AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-NVFP4
Text Generation • 19B • Updated • 118k • 83
88plug/Qwen3.6-27B-W8A16
Image-Text-to-Text • 27B • Updated • 6.51k • 3
Alennnndy/Qwen3.6-27B-AWQ-4bit
Text Generation • 28B • Updated • 59.2k • 3
Ar4ikov/OvisOCR2-AWQ
Image-Text-to-Text • 1B • Updated • 42 • 2
Ar4ikov/OmniCoder-9B-AWQ-W4A16-ASYM
Image-Text-to-Text • 10B • Updated • 38 • 2
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic
Text Generation • 8B • Updated • 79.2k • 9
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8
Text Generation • 8B • Updated • 24.3k • 20
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16
Text Generation • 8B • Updated • 77.4k • 30
RedHatAI/Llama-3.2-1B-Instruct-quantized.w8a8
Text Generation • 1B • Updated • 42.8k • 8
RedHatAI/Llama-3.2-3B-Instruct-quantized.w8a8
Text Generation • 4B • Updated • 2.04k • 1
RedHatAI/Llama-3.2-1B-Instruct-FP8
Text Generation • 1B • Updated • 789k • 4
RedHatAI/Llama-3.2-3B-Instruct-FP8
Text Generation • 4B • Updated • 2.65k • 6
RedHatAI/Qwen2.5-0.5B-quantized.w8a8
Text Generation • 0.6B • Updated • 426
RedHatAI/Qwen2.5-0.5B-Instruct-quantized.w8a8
Text Generation • 0.6B • Updated • 434
RedHatAI/Qwen2.5-1.5B-quantized.w8a8
Text Generation • 2B • Updated • 902k • 4
RedHatAI/Qwen2.5-7B-quantized.w8a8
Text Generation • 8B • Updated • 20 • 1
RedHatAI/Qwen2.5-72B-quantized.w8a8
Text Generation • 73B • Updated • 24
RedHatAI/Qwen2.5-7B-quantized.w4a16
Text Generation • 8B • Updated • 31
RedHatAI/Qwen2.5-0.5B-FP8-dynamic
Text Generation • 0.6B • Updated • 114
RedHatAI/Qwen2.5-1.5B-FP8-dynamic
Text Generation • 2B • Updated • 49
RedHatAI/Qwen2.5-3B-FP8-dynamic
Text Generation • 3B • Updated • 570
RedHatAI/Qwen2.5-7B-FP8-dynamic
Text Generation • 8B • Updated • 22
RedHatAI/Qwen2.5-72B-FP8-dynamic
Text Generation • 73B • Updated • 32 • 1
RedHatAI/Qwen2.5-14B-FP8-dynamic
Text Generation • 15B • Updated • 120 • 2
GusPuffy/Llama-3.1-70B-ArliAI-RPMax-v1.3-GPTQ
71B • Updated • 3
RedHatAI/Qwen2.5-14B-quantized.w8a8
Text Generation • 15B • Updated • 22 • 2