Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

efficient-inference

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

153

Base only

Active filters: efficient-inference

open-machine/Llama-3.1-8B-FlashNorm-test

Text Generation • 8B • Updated Apr 18 • 10 • 1

mradermacher/Llama-3.2-1B-FlashNorm-GGUF

1B • Updated Apr 22 • 86 • 1

mradermacher/Llama-3.2-1B-FlashNorm-i1-GGUF

1B • Updated Apr 22 • 162 • 1

mradermacher/Llama-3.1-8B-FlashNorm-GGUF

8B • Updated Apr 22 • 61 • 1

mradermacher/Llama-3.1-8B-FlashNorm-i1-GGUF

8B • Updated Apr 22 • 164 • 1

stephenjun8192/esm2-8m-sparse50

Feature Extraction • 7.51M • Updated Apr 20 • 4

stephenjun8192/esm2-35m-sparse50

Feature Extraction • 33.5M • Updated Apr 20 • 7

stephenjun8192/chemberta-zinc-sparse50

Feature Extraction • 44.1M • Updated Apr 20 • 10

open-machine/SmolLM2-135M-FlashNorm

Text Generation • 0.1B • Updated Apr 21 • 24 • 3

open-machine/Qwen3-1.7B-FlashNorm

Text Generation • 2B • Updated Apr 23 • 18 • 1

open-machine/Llama-3.2-1B-FlashNorm

Text Generation • 1B • Updated Apr 23 • 16 • 1

open-machine/Qwen3-8B-FlashNorm

Text Generation • 8B • Updated Apr 23 • 16 • 2

open-machine/Llama-3.1-8B-FlashNorm

Text Generation • 8B • Updated Apr 23 • 14 • 2

thebnbrkr/qwen3-0.6b-awq-hyperband

Text Generation • 0.6B • Updated Apr 22 • 8 • 2

asdf98/BokehFlow

Depth Estimation • Updated Apr 26

Jackrong/Qwen3.5-9B-DeepSeek-V4-Flash

Image-Text-to-Text • 10B • Updated May 2 • 787 • • 43

mradermacher/Qwen3.5-9B-DeepSeek-V4-Flash-GGUF

9B • Updated May 7 • 2.73k • 11

firedancer/Qwen3.5-9B-DeepSeek-V4-Flash-GGUF

Image-Text-to-Text • 9B • Updated May 2 • 564

madhurithika22/mistral-compressed

Text Generation • 7B • Updated May 7

jorge-erdb/Qwen3.5-9B-DeepSeek-V4-Flash-4bit-GGUF

Image-Text-to-Text • 9B • Updated May 6 • 326

mradermacher/Qwen3.5-9B-DeepSeek-V4-Flash-i1-GGUF

9B • Updated May 7 • 2.19k • 5

meghanamakkapati/sarvam30b_INT4_quantisation

6B • Updated Jun 15

AlekseyCalvin/LYRICAL_POET_qwen_3.5_DS4

Image-Text-to-Text • 10B • Updated May 16 • 10

AlekseyCalvin/LYRICAL_POET_qwen_3.5_DS4-mlx-4Bit

Image-Text-to-Text • 1B • Updated May 16 • 109

AlekseyCalvin/LYRICAL_POET_qwen_3.5_DS4-mlx-3Bit

Image-Text-to-Text • 1B • Updated May 16 • 39

tamerbaydag/Qwen3.5-9B-DeepSeek-V4-Flash-Q4_K_M-GGUF

Image-Text-to-Text • 9B • Updated May 18 • 1.13k • 2

enCoder/qwen3-5-4b-mlp7808-distilled

Text Generation • Updated May 26 • 13

Vineetha00/synapnet-edge

xxxn3m3s1sxxx/Falcon3-1B-Instruct-1.58bit-ATLAS

Text Generation • Updated Jun 9 • 8

xxxn3m3s1sxxx/Falcon3-3B-Instruct-1.58bit-ATLAS

Text Generation • Updated Jun 9 • 7