Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

18,309

Base only

Active filters: quantized

tifin-india/sarvam-m-24b-q5-1-gguf

Text Generation • 24B • Updated May 24, 2025 • 33

tifin-india/sarvam-m-24b-q2-k-gguf

Text Generation • 24B • Updated May 24, 2025 • 28

tifin-india/sarvam-m-24b-f16-gguf

Text Generation • 24B • Updated May 24, 2025 • 34

tifin-india/sarvam-m-24b-q3-k-l-gguf

Text Generation • 24B • Updated May 24, 2025 • 33

tifin-india/sarvam-m-24b-q3-k-s-gguf

Text Generation • 24B • Updated May 24, 2025 • 42

tifin-india/sarvam-m-24b-q3-k-gguf

Text Generation • 24B • Updated May 24, 2025 • 25

tifin-india/sarvam-m-24b-q4-k-m-gguf

Text Generation • 24B • Updated May 24, 2025 • 43 • 1

tifin-india/sarvam-m-24b-q3-k-m-gguf

Text Generation • 24B • Updated May 24, 2025 • 28

tifin-india/sarvam-m-24b-q4-k-s-gguf

Text Generation • 24B • Updated May 24, 2025 • 34

tifin-india/sarvam-m-24b-q5-k-m-gguf

Text Generation • 24B • Updated May 24, 2025 • 65 • 2

phazei/phazei-SkyReels-V2-fp8-e5m2

Text-to-Video • Updated May 25, 2025 • 4

Kikinoking/MNLP_M2_quantized_model

0.6B • Updated May 27, 2025 • 12

dinhnhat241103/Phi-4-mini-instruct-Vi

4B • Updated May 25, 2025 • 22

argmaxinc/parakeetkit-pro

Automatic Speech Recognition • Updated Sep 23, 2025 • 180k • 4

Raymond-dev-546730/MaterialsAnalyst-AI-7B

Text Generation • 8B • Updated Aug 1 • 447 • 8

Jimmi42/sarvam-m-4bit-mlx

Text Generation • 24B • Updated May 26, 2025 • 68 • 2

tommytracx/CodeLlama-Edge-1.5B

Text Generation • Updated May 26, 2025 • 2

martinctl/MNLP_M2_quantized_model

Text Generation • 0.6B • Updated May 27, 2025 • 5

MWeste/MNLP_M2_quantized_model

0.6B • Updated Jun 6, 2025 • 5

steampunque/Qwen3-30B-A3B-MP-GGUF

31B • Updated Apr 22 • 33

steampunque/Qwen3-14B-MP-GGUF

15B • Updated Apr 21 • 26

steampunque/Mistral-Small-3.1-24B-Instruct-2503-MP-GGUF

24B • Updated Feb 18 • 71 • 1

ikerion/mistral-7b-magyar-q4-gguf

7B • Updated May 29, 2025 • 24

MaziyarPanahi/DeepSeek-R1-0528-Qwen3-8B-GGUF

Text Generation • 8B • Updated May 29, 2025 • 143k • 11

mahdi-b/viral-esm2-3b-hqq

2B • Updated May 30, 2025 • 9

geninhu/RakutenAI-7B-instruct-GPTQ

Updated May 30, 2025 • 10

RedHatAI/DeepSeek-R1-0528-quantized.w4a16

Text Generation • 676B • Updated Apr 28 • 159 • 13

sallani/ELISARCyberAIEdge7B-LoRA-GGUF

Zero-Shot Classification • 41.9M • Updated Jul 18, 2025 • 3.98k • 1

Narutoouz/QwenLong-L1-32B-4bit-DWQ

Text Generation • 33B • Updated Jun 1, 2025 • 15

Narutoouz/GLM-4-9B-0414-4bit-DWQ

Text Generation • 9B • Updated Jun 1, 2025 • 19 • 2