Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,176

Base only

Active filters: on-device

prism-ml/Ternary-Bonsai-2-27B-gguf

Text Generation • 27B • Updated 6 days ago • 3.77M • 2.34k

FermionResearch/Phonon-2

Automatic Speech Recognition • Updated about 16 hours ago • 1.33k • 143

huihui-ai/Huihui-Qwen3.8-27B-abliterated-GGUF

Image-Text-to-Text • 27B • Updated about 19 hours ago • 2.04M • 1.06k

prism-ml/Ternary-Bonsai-2-27B-mlx-2bit

Text Generation • 27B • Updated 9 days ago • 67.6k • 414

Cactus-Compute/needle3

Text Generation • Updated about 3 hours ago • 99.6k • 268

openbmb/MiniCPM5-2B

Text Generation • 3B • Updated 3 days ago • 943k • 1.71k

openbmb/MiniCPM5-2B-GGUF

Text Generation • 3B • Updated 20 days ago • 254k • 346

dealignai/Bonsai-2-27B-Ternary-CRACK-GGUF

Text Generation • 27B • Updated 14 days ago • 82.7k • 157

FINAL-Bench/POCKET-Zimage-CPU

Text-to-Image • 6B • Updated 7 days ago • 251 • 49

prism-ml/Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 17 • 429k • 883

Supertone/supertonic-3

Text-to-Speech • Updated May 18 • 29k • 977

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated Aug 31 • 634k • • 1.4k

chaoliangUNSW/Jev-Style-0.8B-Decision-v3-GGUF

Text Classification • 0.8B • Updated 6 days ago • 2.36k • 12

FINAL-Bench/POCKET-Qwen3.8-Flash-Next-GGUF

Text Generation • 177B • Updated 7 days ago • 305 • 56

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 118k • 790

desert-ant-labs/clear

Audio-to-Audio • Updated 8 days ago • 1.81k • 31

desert-ant-labs/tongue

Text Classification • Updated 8 days ago • 40 • 12

wenzhouwu/YoungAi-DeepSeek-V4.1-Flash

Text Generation • Updated 2 days ago • 6

jsbaicenter/Aztec-Coder-4B

Text Generation • 4B • Updated 2 days ago • 2.47k • 8

prism-ml/Bonsai-27B-mlx-1bit

Text Generation • 2B • Updated Jul 14 • 1.08M • 260

ewin-reg/MiniCPM5-2B-EXL3-Quantized

Text Generation • 0.9B • Updated 16 days ago • 38 • 6

dealignai/Bonsai-2-27B-1bit-CRACK-GGUF

Text Generation • 27B • Updated 14 days ago • 38.9k • 84

chaoliangUNSW/Jev-Style-2B-Decision-v3-GGUF

Text Classification • 2B • Updated 5 days ago • 967 • 5

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 370k • 163

openbmb/MiniCPM5-1B

Text Generation • 1B • Updated Aug 17 • 483k • 1.15k

desert-ant-labs/align

Automatic Speech Recognition • Updated 8 days ago • 774 • 11

openbmb/MiniCPM5-2B-MLX

Text Generation • 3B • Updated 20 days ago • 268k • 53

litert-community/Fun-ASR-Nano-2512

Automatic Speech Recognition • Updated 5 days ago • 40 • 4

FINAL-Bench/POCKET-Darwin-180B-GGUF

Text Generation • 177B • Updated about 4 hours ago • 37

prism-ml/Ternary-Bonsai-27B-mlx-2bit

Text Generation • 27B • Updated Jul 14 • 1.09M • 201