Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

18,323

Base only

Active filters: quantized

RedHatAI/Qwen3-32B-quantized.w4a16

Text Generation • 33B • Updated May 13, 2025 • 6.74k • 12

RedHatAI/Qwen3-14B-quantized.w4a16

Text Generation • 15B • Updated May 13, 2025 • 262 • 1

RedHatAI/Qwen3-8B-quantized.w4a16

Text Generation • 8B • Updated May 5 • 14.1k • 5

RedHatAI/Qwen3-30B-A3B-quantized.w4a16

Text Generation • 31B • Updated May 13, 2025 • 1.61k • 7

Baskar2005/deepseek_Sunfall_Merged_Model

8B • Updated May 8, 2025 • 149

Baskar2005/deepseek_sunfall_merged_model_GGUF

8B • Updated May 8, 2025 • 14

BCCard/Qwen3-32B-FP8-Dynamic

Text Generation • 33B • Updated Jun 20, 2025 • 18 • 1

BCCard/Qwen3-30B-A3B-FP8-Dynamic

Text Generation • 31B • Updated Jun 20, 2025 • 6.99k

ronniealfaro/mythos-prime

7B • Updated May 8, 2025 • 31 • 1

XformAI-india/Qwen3-0.6B-medicaldataset-gguf

0.6B • Updated May 16, 2025 • 321 • 1

ABDALLALSWAITI/ACE-Step-v1-3.5B-FP8

Updated May 9, 2025 • 2

c516a/gemma-3-12b-it

Text Generation • 12B • Updated May 11, 2025 • 106

MaziyarPanahi/INTELLECT-2-GGUF

Text Generation • 33B • Updated May 12, 2025 • 133k • 3

RedHatAI/Llama-4-Maverick-17B-128E-Instruct-FP8

Image-Text-to-Text • 402B • Updated Jun 9 • 107 • 2

Goraint/Qwen3-32B-4bit-AWQ-MLX

Text Generation • 33B • Updated May 13, 2025 • 22

sychonix/OlympicCoder-7B-Sychonix

8B • Updated May 14, 2025 • 10 • 1

patf82/Absolute_Zero_Reasoner-Coder-14b-5.0bpw-exl3

5B • Updated May 14, 2025 • 18 • 4

boltuix/NeuroBERT-Mini

Text Classification • 9.62M • Updated Jun 30, 2025 • 140 • 26

mradermacher/NeuroBERT-Mini-GGUF

11.1M • Updated Jul 11, 2025 • 388 • 2

TheMelonGod/Qwen3-8B-exl2

Text Generation • Updated May 22, 2025 • 35

boltuix/NeuroBERT-Small

Text Classification • 12.8M • Updated Jun 30, 2025 • 104 • 26

boltuix/NeuroBERT

Text Classification • 14.4M • Updated Jun 30, 2025 • 50 • 27

boltuix/NeuroBERT-Pro

Text Classification • 41.4M • Updated May 22, 2025 • 49 • 25

Gapeleon/bytedance_BAGEL-7B-MoT-INT8

Any-to-Any • Updated Aug 2, 2025 • 30 • 24

meimeilook/BAGEL-7B-MoT-FP8

Any-to-Any • Updated May 30, 2025 • 15

ZRX1Raziel/gemma-3b-it

Updated May 22, 2025 • 8

TheMelonGod/Qwen3-4B-exl2

Text Generation • Updated May 23, 2025 • 20

HagalazAI/CyberDolphin-2.9.3-mistral-nemo-12b-GGUF

Text Generation • 12B • Updated May 23, 2025 • 494 • 2

TheMelonGod/Qwen3-1.7B-exl2

Text Generation • Updated May 23, 2025 • 27 • 1

TheMelonGod/Qwen3-0.6B-exl2

Text Generation • Updated May 23, 2025 • 26