Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,299

Base only

Active filters: quantization

Farikhan/Llama-3.1-8B-Instruct-GPTQ-4bit

Text Generation • 2B • Updated Apr 29 • 9

feanors/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-FP8-Dynamic

Text Generation • 35B • Updated Apr 28 • 74 • 2

feanors/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-AWQ-INT4

Image-Text-to-Text • 36B • Updated Apr 28 • 888 • 7

lyf/Qwen3.6-27B-heretic-v2-mtp-int4-AutoRound

Image-Text-to-Text • 3B • Updated Apr 28 • 1.54k • 10

Rofati/right-parameters-not-more-parameters

AEON-7/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-NVFP4

Any-to-Any • 20B • Updated 19 days ago • 6.19k • 9

Abiray/Mistral-Medium-3.5-128B-Q4_K_M-GGUF

Text Generation • 125B • Updated May 3 • 220 • 4

inferRouter/Qwen3.6-27B-FP8-lmhead-embed-fp8

Image-Text-to-Text • 28B • Updated Apr 30 • 21

d-alistarh/Qwen3-4B-GSQ-Q3_K_M-GGUF

4B • Updated Apr 30 • 13

d-alistarh/Qwen3-8B-GSQ-Q3_K_M-GGUF

8B • Updated Apr 30 • 12

SuperJerem/voxtral-coalition

XiaofanQue/llama2-7b-scheme3c-ptq

7B • Updated Apr 30 • 5

nrl-ai/vn-spell-correction-small-onnx-int8

Text Generation • Updated May 1 • 24

nrl-ai/vn-spell-correction-base-onnx-int8

Text Generation • Updated May 1 • 17

nrl-ai/vn-diacritic-vit5-base-onnx-int8

Text Generation • Updated May 1 • 34

Tribewarez/pot-o-slim-greenhouse-666

Text Generation • 667k • Updated May 1 • 15

d-alistarh/Qwen3.5-9B-GSQ-Q3_K_M-GGUF

9B • Updated May 1 • 14

feanors/nemotron-3-nano-omni-30b-a3b-awq

Image-Text-to-Text • 33B • Updated May 1 • 661 • 3

scasella91/talkie-1930-13b-it-MLX-q4

Text Generation • 13B • Updated May 1 • 21

evilfreelancer/whisper-podlodka-turbo-GGUF

Updated May 1 • 2

LGxNDs/Geeked-Out-Quantization-Software

35B • Updated May 9 • 11

sombra-x/Kimi-K2.6-REAP-Solidity

Text Generation • 688B • Updated May 2 • 297

dinhhungitsoft/Qwen3-Embedding-4B-bnb4

Sentence Similarity • 4B • Updated May 2 • 76

berkerdooo/Qwen3.6-27B-NVFP4

Image-Text-to-Text • 15B • Updated May 2 • 183

KennethTang/MiniMax-M2.7-TQ3

88B • Updated May 2 • 9

CoreWorxLab/Qwen3.6-27B-Claude-Opus-Reasoning-Distill-v2-int4-AutoRound

Text Generation • 6B • Updated May 3 • 142 • 14

montevive/ALIA-40b-instruct-2601-NVFP4-GGUF

Text Generation • 40B • Updated May 2 • 12

Pranay2412/sarvam-30b-W8A8-FP8-Dynamic

Text Generation • 32B • Updated May 2

xv0y5ncu/Gemma-4-E4B-it-GLQ-4bpw

Text Generation • 3B • Updated Jun 6 • 25

xv0y5ncu/Gemma-4-E4B-it-GLQ-6bpw

Text Generation • 4B • Updated Jun 6 • 7