Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

4-bit precision

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

78

Base only

Active filters: 4-bit precision

QUASAR-QAT/Qwen3.8-27B-QUASAR-NVFP4

Image-Text-to-Text • 28B • Updated 15 days ago • 154k • 145

nvidia/Qwen3.8-2.4T-A95B-NVFP4

Text Generation • 1.3T • Updated 27 days ago • 2.47k • 17

cmod/firefunction-v1-GGUF

Updated Feb 25, 2024

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • 8B • Updated Jul 10 • 48.5k • 30

Esperanto/gemma-2b-it-kvc-AWQ-int4-onnx

Updated Dec 12, 2024 • 13

Esperanto/gemma-7b-it-kvc-AWQ-int4-onnx

Updated Dec 12, 2024 • 8

Esperanto/mistral-7b-Instruct-v0.2-kvc-AWQ-int4-onnx

Updated Dec 12, 2024 • 12 • 1

Esperanto/phi3-mini-4k-instruct-kvc-AWQ-int4-onnx

Updated Dec 12, 2024 • 10

amornpan/openthaigpt-MedChatModelv11

Text Generation • 8B • Updated Mar 10, 2025 • 43 • 2

Esperanto/llama-3.2-3B-Instruct-kvc-AWQ-int4-onnx

Text Generation • Updated Dec 12, 2024 • 18

Esperanto/llama-3.2-1B-Instruct-kvc-AWQ-int4-onnx

Text Generation • Updated Dec 12, 2024

Esperanto/llama3.1-8b-Instruct-kvc-AWQ-int4-onnx

Text Generation • Updated Dec 12, 2024 • 19

Esperanto/mistral-7b-kvc-AWQ-int4-onnx

Updated Dec 18, 2024 • 11

amornpan/openthaigpt1.5-14b-MedChatModelV1

Text Generation • 15B • Updated Nov 4, 2024 • 19 • 1

RedHatAI/Llama-3.3-70B-Instruct-quantized.w4a16

Text Generation • 71B • Updated Aug 5 • 4.8k • 4

akkikiki/j-moshi-ext-mlx-q4

Updated Feb 12, 2025 • 9

ruslanmv/granite-3.1-2b-Reasoning-4bit

Text Generation • 3B • Updated Feb 11, 2025 • 21

amornpan/V3_qwen2.5-32b-med-thai-optimized

Text Generation • Updated Mar 14, 2025 • 1

korarishi/rishi-2-2b-it

Text Generation • 3B • Updated May 10, 2025 • 14 • 1

Aeshp/llama2-7bChatbot

Text Generation • Updated Jun 27, 2025 • 8

ZennyKenny/novoyaz-20b

Text Generation • Updated Mar 27 • 23 • 1

adityakum667388/lumichats_v1.3_11b_vision

Image-to-Text • 11B • Updated Jan 25 • 21 • 1

raydelossantos/Qwen3-Coder-Next-int4-mixed-AutoRound

Text Generation • 12B • Updated Feb 6 • 29 • 2

atbender/Qwen3.5-REAP-212B-A17B-W4A16

Text Generation • 30B • Updated Mar 1 • 108 • 24

tocchitocchi/NVIDIA-Nemotron-Nano-9B-v2-Japanese-4bit-mlx

9B • Updated Apr 17 • 85

thesilverheadengineer/llm-surgery-dark-arts-gpt-oss-40b-64a8-init

Text Generation • 40B • Updated Mar 20 • 76 • 2

thesilverheadengineer/llm-surgery-dark-arts-gpt-oss-60b-96a12-init

Text Generation • 59B • Updated Mar 20 • 11 • 1

Vishalshendge3198/orpheus-3b-tts-german-emotional-merged

Text-to-Speech • 3B • Updated Mar 21 • 1

TxemAI/Qwen3.5-27B-4bit-MLX

Text Generation • 27B • Updated Apr 4 • 92

TxemAI/Qwen3.5-122B-A10B-Q4_K_M-GGUF

Text Generation • 122B • Updated Apr 4 • 188 • 1