Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

arxiv: 2311.12022

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

574

Base only

Active filters: 2311.12022

google/gemma-3-4b-it

Image-Text-to-Text • 4B • Updated Mar 21, 2025 • 2.13M • • 1.43k

google/gemma-3-1b-it

Text Generation • 1.0B • Updated Apr 4, 2025 • 3.05M • • 1.07k

google/gemma-3-27b-it

Image-Text-to-Text • 27B • Updated Mar 21, 2025 • 842k • • 2k

google/gemma-3-12b-it

Image-Text-to-Text • 12B • Updated Mar 21, 2025 • 1.22M • • 793

google/gemma-3n-E2B-it-litert-lm

Text Generation • Updated Dec 8, 2025 • 7.05k • 498

unsloth/gemma-3-4b-it-GGUF

Image-Text-to-Text • 4B • Updated Aug 14, 2025 • 47.8k • 197

google/gemma-3-12b-it-qat-q4_0-unquantized

Image-Text-to-Text • 12B • Updated Apr 15, 2025 • 100k • • 151

google/gemma-3-270m-it

Text Generation • 0.3B • Updated Aug 14, 2025 • 849k • 607

google/gemma-3-270m

Text Generation • 0.3B • Updated Aug 14, 2025 • 1.92M • 1.05k

unsloth/gemma-3-12b-it-GGUF

Image-Text-to-Text • 12B • Updated Aug 14, 2025 • 75.8k • 193

google/gemma-3-4b-pt

Image-Text-to-Text • 4B • Updated Mar 21, 2025 • 65.7k • 158

google/gemma-3-1b-pt

Text Generation • 1.0B • Updated Mar 21, 2025 • 59.1k • • 196

unsloth/gemma-3-12b-it-bnb-4bit

Image-Text-to-Text • 13B • Updated May 12, 2025 • 8.7k • 45

google/gemma-3-1b-it-qat-int4-unquantized

Text Generation • 1.0B • Updated Apr 15, 2025 • 143 • • 14

google/gemma-3n-E2B-it-litert-preview

Image-Text-to-Text • Updated May 20, 2025 • 591

google/gemma-3n-E4B

Image-Text-to-Text • 8B • Updated Jul 14, 2025 • 4.11k • 143

google/gemma-3n-E4B-it-litert-lm

Text Generation • Updated Nov 25, 2025 • 17.2k • 473

google/gemma-3n-E2B-it

Image-Text-to-Text • 5B • Updated Jul 14, 2025 • 464k • 315

unsloth/gemma-3-270m-it-GGUF

Text Generation • 0.3B • Updated Aug 15, 2025 • 81.7k • 169

litert-community/gemma-3-270m-it

Text Generation • Updated Apr 8 • 2.03k • 57

p-e-w/gemma-3-12b-it-heretic

Image-Text-to-Text • 12B • Updated Nov 15, 2025 • 323 • • 91

ghost-x/ghost-8b-beta

Text Generation • 8B • Updated Aug 19, 2024 • 6 • • 14

FlorianJc/ghost-8b-beta-vllm-fp8

Text Generation • 8B • Updated Jul 25, 2024 • 6

QuantFactory/ghost-8b-beta-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 80 • 1

akjindal53244/Llama-3.1-Storm-8B

Text Generation • 8B • Updated Dec 5, 2024 • 1.78k • • 178

akjindal53244/Llama-3.1-Storm-8B-FP8-Dynamic

Text Generation • 8B • Updated Aug 21, 2024 • 54 • 14

RichardErkhov/ghost-x_-_ghost-8b-beta-gguf

8B • Updated Aug 13, 2024 • 102

akjindal53244/Llama-3.1-Storm-8B-GGUF

Text Generation • 8B • Updated Aug 21, 2024 • 598 • 40

ghost-x/ghost-8b-beta-1608

Text Generation • 8B • Updated Aug 23, 2024 • 9.4k • • 34

ghost-x/ghost-8b-beta-1608-awq

Text Generation • 8B • Updated Aug 23, 2024 • 2 • 1