Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

13,624

Base only

Active filters: quantized

TheMelonGod/Qwen3-4B-exl2

Text Generation • Updated May 23, 2025 • 121

HagalazAI/CyberDolphin-2.9.3-mistral-nemo-12b-GGUF

Text Generation • 12B • Updated May 23, 2025 • 320 • 2

TheMelonGod/Qwen3-1.7B-exl2

Text Generation • Updated May 23, 2025 • 170 • 1

TheMelonGod/Qwen3-0.6B-exl2

Text Generation • Updated May 23, 2025 • 165

c516a/quantized-codegemma-7b-it

Text Generation • Updated May 25, 2025 • 103

TheMelonGod/Qwen3-14B-exl2

Text Generation • Updated May 25, 2025 • 160

tifin-india/sarvam-m-24b-q6-k-gguf

Text Generation • 24B • Updated May 24, 2025 • 39 • 1

tifin-india/sarvam-m-24b-q5-1-gguf

Text Generation • 24B • Updated May 24, 2025 • 15

tifin-india/sarvam-m-24b-q2-k-gguf

Text Generation • 24B • Updated May 24, 2025 • 20

tifin-india/sarvam-m-24b-f16-gguf

Text Generation • 24B • Updated May 24, 2025 • 16

tifin-india/sarvam-m-24b-q3-k-l-gguf

Text Generation • 24B • Updated May 24, 2025 • 20

tifin-india/sarvam-m-24b-q3-k-s-gguf

Text Generation • 24B • Updated May 24, 2025 • 37

tifin-india/sarvam-m-24b-q3-k-gguf

Text Generation • 24B • Updated May 24, 2025 • 29

tifin-india/sarvam-m-24b-q4-k-m-gguf

Text Generation • 24B • Updated May 24, 2025 • 31 • 1

tifin-india/sarvam-m-24b-q3-k-m-gguf

Text Generation • 24B • Updated May 24, 2025 • 14

tifin-india/sarvam-m-24b-q4-k-s-gguf

Text Generation • 24B • Updated May 24, 2025 • 34

tifin-india/sarvam-m-24b-q5-k-m-gguf

Text Generation • 24B • Updated May 24, 2025 • 57 • 2

phazei/phazei-SkyReels-V2-fp8-e5m2

Text-to-Video • Updated May 25, 2025 • 4

Kikinoking/MNLP_M2_quantized_model

0.6B • Updated May 27, 2025 • 7

dinhnhat241103/Phi-4-mini-instruct-Vi

4B • Updated May 25, 2025 • 7

argmaxinc/parakeetkit-pro

Automatic Speech Recognition • Updated Sep 23, 2025 • 191k • 4

Raymond-dev-546730/MaterialsAnalyst-AI-7B

Text Generation • 8B • Updated 8 days ago • 1.45k • 8

Jimmi42/sarvam-m-4bit-mlx

Text Generation • 4B • Updated May 26, 2025 • 96 • 2

tommytracx/CodeLlama-Edge-1.5B

Text Generation • Updated May 26, 2025 • 2

martinctl/MNLP_M2_quantized_model

Text Generation • 0.6B • Updated May 27, 2025 • 10

MWeste/MNLP_M2_quantized_model

0.6B • Updated Jun 6, 2025 • 7

steampunque/Qwen3-30B-A3B-MP-GGUF

31B • Updated Apr 22 • 25

steampunque/Qwen3-14B-MP-GGUF

15B • Updated Apr 21 • 24

steampunque/Mistral-Small-3.1-24B-Instruct-2503-MP-GGUF

24B • Updated Feb 18 • 251 • 1

ikerion/mistral-7b-magyar-q4-gguf

7B • Updated May 29, 2025 • 21