Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,836

Base only

Active filters: llama.cpp

jedisct1/MiMo-V2.5-coder-Q2-v2-MTP

Text Generation • 310B • Updated May 26 • 50 • 6

Jackrong/Qwopus3.5-4B-Coder-MTP-GGUF

Image-Text-to-Text • 0.3B • Updated May 30 • 8.09k • 59

LiquidAI/LFM2.5-Audio-1.5B-JP-GGUF

Audio-to-Audio • 1B • Updated Jun 7 • 2.09k • 24

RootMonsteR/Qwen3.6-27B-Nemesis-GGUF

Text Generation • 27B • Updated May 31 • 166 • 2

poolside-laguna-hackathon/Piscina-XS.2-GGUF

Text Generation • 33B • Updated May 30 • 754 • 10

michaelw9999/Qwen3.6-27B-NVFP4-MXFP6-MTP-GGUF

27B • Updated 5 days ago • 975 • 8

zaakirio/LFM2.5-1.2B-Instruct-Uncensored-GGUF

Text Generation • 1B • Updated Jun 4 • 3.87k • 5

michaelw9999/Qwopus3.6-27B-v2-MTP-NVFP4-GGUF

27B • Updated Jun 10 • 28.6k • 11

jcbtc/qwen3.6-35b-a3b-crown-halo-mtp-dynamic

Image-Text-to-Text • 36B • Updated Jun 19 • 590 • 17

jcbtc/qwopus3.6-27b-v2-chadrock-rocmfp4-mtp

Image-Text-to-Text • 27B • Updated Jun 23 • 450 • 22

yuxinlu1/gemma-4-12B-it-Claude-4.6-4.8-Opus-GGUF

Text Generation • 12B • Updated Jun 18 • 13k • 118

JetBrains/Mellum2-12B-A2.5B-Instruct-GGUF-Q4_K_M

Text Generation • 12B • Updated Jun 4 • 8.92k • 10

Mungert/Qwopus3.5-9B-Coder-MTP-GGUF

Image-Text-to-Text • 9B • Updated Jun 4 • 488 • 1

Janvitos/gemma-4-12B-it-qat-assistant-MTP-Q8_0-GGUF

0.4B • Updated Jun 6 • 3.73k • 37

Jianqiao1/Qwen3.6-27B-MTP-MoQ-GGUF

27B • Updated about 7 hours ago • 16.1k • 10

s-batman/Nex-N2-mini-GGUF

Image-Text-to-Text • 35B • Updated Jun 9 • 344 • 5

Pulsate1680/gemma-4-mtp-q8_0-gguf

Text Generation • 0.4B • Updated Jun 9 • 41 • 1

dahara1/gemma-4-12B-it-qat-UD-japanese-imatrix

Any-to-Any • 12B • Updated 25 days ago • 3.7k • 11

SyzygyResearch/Qwen3.6-35B-A3B-2bit

Text Generation • 36B • Updated Jun 10 • 340 • 4

michaelw9999/Qwopus3.6-27B-Coder-MTP-NVFP4-GGUF

27B • Updated Jun 14 • 24.8k • 6

Kami574/Nova-FinLex-Phi3

4B • Updated Jun 20 • 351 • 3

Buck2222/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF

Text Generation • 12B • Updated Jun 15 • 1.6k • 13

jcbtc/chadrock3.6-40b-opus-deckard-uncensored-thinking-neo-code-di-imatrix-rocmfp4

Text Generation • 39B • Updated Jun 23 • 195 • 8

dasvad/open3dvqa-qwen3vl-4b-distill-q4-k-m-gguf

Image-Text-to-Text • 4B • Updated 6 days ago • 295 • 1

lordx64/Qwable-v1-GGUF

Text Generation • 35B • Updated Jun 15 • 1.62k • 39

TeichAI/Qwen3.6-27B-Fable-5-Experimental-GGUF

27B • Updated Jun 23 • 9.38k • 41

vinpix/Bonsai-8B-llama.cpp

Text Generation • 8B • Updated 20 days ago • 1.9k • 7

DennisHuang648/VoxCPM2-GGUF

Text-to-Speech • 0.9B • Updated Jun 30 • 4.91k • 12

FunAudioLLM/Paraformer-GGUF

Automatic Speech Recognition • 0.2B • Updated 6 days ago • 679 • 2

FunAudioLLM/Fun-ASR-Nano-GGUF

Automatic Speech Recognition • 0.2B • Updated 6 days ago • 3.67k • 3