Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,170

Base only

Active filters: vllm

mashriram/sarvam-1.5-vllm

5B • Updated May 3 • 4

awilliamson/talkie-1930-13b-it-vllm

Text Generation • 13B • Updated May 3 • 154

CnakeCharmer/CnakeAgent-sft-v0.3

Text Generation • 22B • Updated May 3 • 8

YuYu1015/Huihui-Qwen3.6-35B-A3B-Claude-4.7-Opus-abliterated-int4-AutoRound

Text Generation • 7B • Updated Jun 8 • 212 • 1

mohammedqarnuon/Qarnon-AI

7B • Updated May 3

notSnix/Qwen3.5-122B-A10B-REAP-20-AWQ-W4A16

Text Generation • 14B • Updated May 3 • 19

jinaai/jina-embeddings-v5-omni-nano-classification-GGUF

Feature Extraction • 0.2B • Updated May 12 • 174

jinaai/jina-embeddings-v5-omni-small-classification-GGUF

Feature Extraction • 0.6B • Updated May 12 • 301 • 1

jinaai/jina-embeddings-v5-omni-small-clustering-GGUF

Feature Extraction • 0.6B • Updated May 12 • 304 • 2

jinaai/jina-embeddings-v5-omni-small-text-matching-GGUF

Feature Extraction • 0.6B • Updated May 12 • 463 • 4

jinaai/jina-embeddings-v5-omni-nano-clustering-GGUF

Feature Extraction • 0.2B • Updated May 12 • 305

jinaai/jina-embeddings-v5-omni-nano-text-matching-GGUF

Feature Extraction • 0.2B • Updated May 12 • 310 • 1

nwirandx/Biomni-R0-32B-Preview-AWQ

Text Generation • 6B • Updated May 4 • 11

LLM-OS-Models/Ouro-1.4B-terminal-sft

Text Generation • 1B • Updated May 9 • 11

LLM-OS-Models/Ouro-2.6B-terminal-sft

Text Generation • 3B • Updated May 9 • 16

xy-98/gemma-4-31B-it-FP8-block

Image-Text-to-Text • 31B • Updated May 4 • 10

pranavbapat/granite-4.1-8b-awq

Text Generation • 9B • Updated May 4 • 465

Nerdzmasterz/Mixtral-8x7B-Instruct-v0.1

47B • Updated May 4 • 2

Nerdzmasterz/Mixtral-8x7B-v0.1

47B • Updated May 4 • 3

Franck-J/rcia-voxtral-round1

Automatic Speech Recognition • 4B • Updated May 7

DarkRanger7e/Mistral-Nemo-Base-2407

12B • Updated May 4

amir22010/voxtral-mini-4b-gptq

Automatic Speech Recognition • 5B • Updated May 13

madhurithika22/mistral-compressed

Text Generation • 7B • Updated May 7

soumil1/simamba-midpoint-10m-slimpajama-500m

Text Generation • Updated May 4 • 14

soumil1/mamba2-10m-slimpajama-500m

Text Generation • Updated May 4 • 193

XProger/Qwen3-TTS-12Hz-1.7B-Base-TalkerMLP-L2-L23-W4A16-RestBF16-G64-C512

Text-to-Speech • 2B • Updated May 4 • 5

pavanperi/voxtral-optimized-atos

Automatic Speech Recognition • 4B • Updated May 4 • 15 • 1

LLM-OS-Models/Ouro-1.4B-Thinking-Terminal-SFT

Text Generation • 1B • Updated May 9 • 10

LLM-OS-Models/Ouro-2.6B-Thinking-Terminal-SFT

Text Generation • 3B • Updated May 9 • 11

vrfai/Cosmos-Reason2-8B-NVFP4

Image-Text-to-Text • 6B • Updated Jun 6 • 140 • 2