Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

18,618

Base only

Active filters: quantized

crazymaker1122/Llama-3.3-8B-Instruct-awq-direct

Text Generation • 8B • Updated Jul 9, 2025 • 17

steampunque/Llama-3.1-8B-Instruct-MP-GGUF

8B • Updated Feb 18 • 45

steampunque/Llama-3.3-70B-Instruct-MP-GGUF

71B • Updated Feb 18 • 114

steampunque/ultravox-v0_5-llama-3_3-70b-MP-GGUF

0.7B • Updated Feb 18 • 21

steampunque/ultravox-v0_6-llama-3_3-70b-MP-GGUF

0.7B • Updated Feb 18 • 14

rs-test/llama-scout-fp8

Image-Text-to-Text • 109B • Updated Jul 11, 2025 • 12

Makatia/mistral-7b-instruct-v0.2.Q8_0-Q8_0.gguf

Text Generation • 7B • Updated Mar 25 • 23

Makatia/microsoft_Phi-3-mini-4k-instruct_onnx_rpi

Text Generation • Updated Mar 25

Makatia/TinyLlama_TinyLlama-1.1B-Chat-v1.0_onnx

Text Generation • Updated Mar 25 • 2

ramblingpolymath/Qwen3-32B-W8A8

Text Generation • 33B • Updated Aug 2, 2025 • 77

steampunque/Deepseek-R1-Distill-Llama-8B-MP-GGUF

8B • Updated Feb 18 • 32

ramblingpolymath/Qwen3-14B-W8A8

Text Generation • 15B • Updated Aug 3, 2025 • 15

ramblingpolymath/Qwen3-8B-W8A8

Text Generation • 8B • Updated Aug 3, 2025 • 33

ramblingpolymath/Qwen3-4B-W8A8

Text Generation • 4B • Updated Aug 2, 2025 • 50

wavespeed/Wan2.1-T2V-14B-Diffusers-fp16-nf4

Text-to-Video • Updated Aug 20 • 4

RedHatAI/Kimi-K2-Instruct-quantized.w4a16

Text Generation • 1T • Updated Apr 28 • 404 • 12

adamrb/mpt-30b-chat-w4a16-gptq

30B • Updated Jul 15, 2025 • 11

adamrb/mpt-30b-chat-w8a8-gptq

30B • Updated Jul 15, 2025 • 10

ramblingpolymath/qwen3-30B-A3B-w8a8

Text Generation • 31B • Updated Aug 2, 2025 • 30

ramblingpolymath/Qwen3-0.6B-W8A8

Text Generation • 0.8B • Updated Aug 3, 2025 • 80

tachyphylaxis/DeepSeek-R1-0528-FP4

Text Generation • 397B • Updated Jul 18, 2025 • 33

SandLogicTechnologies/MedGemma-4B-IT-GGUF

4B • Updated Jul 29, 2025 • 194 • 5

PJEDeveloper/Mistral_Nemo_Instruct_2407-F16.gguf-Q4_K_M

12B • Updated Jul 23, 2025 • 27

sdurgi/bert_emotion_response_classifier_quantized

Text Classification • Updated Jul 19, 2025 • 16

Hariprasath28/orpheus-3b-4bit-AWQ

Text Generation • 3B • Updated Jul 19, 2025 • 74

mirekphd/whisper-large-v3-onnx-fp16

Automatic Speech Recognition • Updated Jul 19, 2025 • 9

mirekphd/whisper-large-v3-onnx-w8a16-dynamic

Automatic Speech Recognition • Updated Jul 19, 2025 • 9

mirekphd/whisper-large-v3-onnx-w4a16-dynamic

Automatic Speech Recognition • Updated Jul 19, 2025 • 8

steampunque/Qwen2.5-VL-32B-Instruct-MP-GGUF

33B • Updated Feb 18 • 60

theprint/Zeth-Gemma3-4B-GGUF

Text Generation • 5B • Updated Aug 16, 2025 • 145