Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,260

Base only

Active filters: quantization

pottokao/MiniMax-H3-NVFP4-rotated

Text-to-Video • Updated 10 days ago • 1

wepiqx/Ornith-1.5-9B-MTP-ASHQ1-GGUF

Text Generation • 9B • Updated 19 days ago • 2.44k • 1

sayedM/cohere-transcribe-arabic-cpu-friendly

Automatic Speech Recognition • 2B • Updated 24 days ago • 78 • 5

lackonendes/PAW-27B-X3-GGUF

5B • Updated 3 days ago • 4.87k • 1

Lightje/Qwen3.8-27B-DavidAU-Turbo-GSQ-RCO

Text Generation • Updated 23 days ago • 5

czxichen/timesfm3.0-f16

0.3B • Updated 22 days ago • 40 • 1

ForeverBlue/PrismQuant-Qwen3-Base

Text Generation • Updated 1 day ago • 358 • 1

ForeverBlue/PrismQuant-Llama-3.1-70B

Text Generation • Updated 1 day ago • 355 • 1

ForeverBlue/PrismQuant-Llama-3.2-3B

Text Generation • Updated 1 day ago • 359 • 1

ForeverBlue/PrismQuant-Llama-3.1-8B

Text Generation • Updated 1 day ago • 353 • 1

pfeifferj/Spark-X2.5-4B-GSQ-RCO-GGUF

Text Generation • 4B • Updated 17 days ago • 1.78k • 6

wepiqx/OxCoder-9B-MERNIK-GGUF

Text Generation • 9B • Updated 6 days ago • 3.45k • 5

amd/DeepSeek-V4.1-Flash-Quark-MXFP4

Text Generation • 484B • Updated 6 days ago • 660 • 1

ewin-reg/MiniCPM5-2B-RotSVDMix-Quantized

Text Generation • 3B • Updated 7 days ago • 1.63k • 2

IsValorum/KAT-Coder-V2.5-Dev-APEX-I-MiniPlus-V2-GGUF

Text Generation • 35B • Updated 4 days ago • 2.8k • 1

adidsh/indic-transcribe-flex-int8-onnx

Automatic Speech Recognition • 1B • Updated 4 days ago • 67 • 1

adidsh/indic-transcribe-core-int8-onnx

Automatic Speech Recognition • 1B • Updated 4 days ago • 61 • 1

IsValorum/Qwen3.8-35B-A3B-Distill-MTP-APEX-I-MiniPlus-V2.1-GGUF

Text Generation • 35B • Updated about 9 hours ago • 10.8k • 13

Litwein/Qwen3.8-Flash-Next-REAP320-oQ3e-fp16-DWQ-MTP-Vision-MLX

Image-Text-to-Text • 134B • Updated 13 days ago • 761 • 5

IsValorum/Nex-N2.5-mini-APEX-I-MiniPlus-V2.1-GGUF

Text Generation • 35B • Updated about 9 hours ago • 7.74k • 3

IsValorum/KAT-Coder-V2.5-Dev-APEX-I-MiniPlus-V2.1-GGUF

Text Generation • 35B • Updated about 8 hours ago • 3.58k • 3

benjzzz/Qwen3-1.7B-GALE-v2

Text Generation • Updated 13 days ago • 1

TokenAI-zer/Xing4.0-29B-A4B-8bit-MLX

Text Generation • 30B • Updated 11 days ago • 291 • 2

hermitdave/Qwen3.8-27B-Bonsai-MLX-2bit

Text Generation • 27B • Updated 12 days ago • 1.65k • 3

tooltd/Qwen3.8-27B-GSQ-RCO-BuffedMod-GGUF

Image-Text-to-Text • 27B • Updated 11 days ago • 1.67k • 2

webmp3/Sakura-Micro-Bonsai-2-GSQ-RCO

Text Generation • 27B • Updated 10 days ago • 512 • 1

Zrald/zralddeepseekv4.1

Text Generation • 5.9M • Updated 10 days ago • 316 • 2

kataguru/Qwen3.8-9B-Distill-uncensored-heretic-Finnish-GGUF

Image-Text-to-Text • 9B • Updated 5 days ago • 1.18k • 1

voves/AliceAI-Foundation-80B-A3B-Base-NVFP4

Text Generation • 41B • Updated 8 days ago • 485 • 1

wepiqx/MiMo-V2.6-Distill-Qwen-9B-GGUF-MERNIK

9B • Updated 1 day ago • 4.04k • 2