Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

gemma4_assistant

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

106

Base only

Active filters: gemma4_assistant

bahadirakdemir/gemma-4-31B-it-assistant-fp8

Text Generation • 0.5B • Updated May 13 • 272 • 2

jsm40/gemma-4-31B-it-assistant

Any-to-Any • 0.5B • Updated May 13 • 10

thy025/gemma-4-31B-it-assistant

Any-to-Any • 0.5B • Updated May 15 • 9

inferencerlabs/gemma-4-31B-MTP-MLX

Image-Text-to-Text • 0.5B • Updated 29 days ago • 754 • 2

inferencerlabs/gemma-4-31B-MTP-MLX-Q9

Image-Text-to-Text • 0.1B • Updated 29 days ago • 353 • 1

inferencerlabs/gemma-4-31B-MTP-MLX-Q4

Image-Text-to-Text • 73.4M • Updated 29 days ago • 451

inferencerlabs/gemma-4-26B-A4B-MTP-MLX

Image-Text-to-Text • 0.4B • Updated 29 days ago • 807 • 1

inferencerlabs/gemma-4-26B-A4B-MTP-MLX-Q9

Image-Text-to-Text • 0.1B • Updated 29 days ago • 471 • 1

inferencerlabs/gemma-4-26B-A4B-MTP-MLX-Q4

Image-Text-to-Text • 65.6M • Updated 29 days ago • 807 • 1

jahwag/gemma-4-26B-A4B-it-assistant-8bit

Updated May 25 • 12

yujiepan/gemma-4-assistant-tiny-random

Text Generation • 2.12M • Updated May 26 • 12

tiny-random/gemma-4-assistant

Text Generation • 2.12M • Updated May 26 • 7

google/gemma-4-E2B-it-qat-q4_0-unquantized-assistant

Any-to-Any • 78M • Updated 6 days ago • 5.77k • 19

google/gemma-4-26B-A4B-it-qat-q4_0-unquantized-assistant

Image-Text-to-Text • 0.4B • Updated 6 days ago • 12.1k • 16

google/gemma-4-31B-it-qat-q4_0-unquantized-assistant

Image-Text-to-Text • 0.5B • Updated 6 days ago • 13.9k • 21

Reza2kn/gemma-4-26B-A4B-it-assistant-NVFP4

Text Generation • Updated Jun 4 • 54 • 1

melcheikh/gemma-4-31B-it-qat-assistant-NVFP4-Blackwell

Text Generation • 0.4B • Updated Jun 8 • 660 • 4

mlx-community/gemma-4-E2B-it-qat-assistant-4bit

Text Generation • 12.4M • Updated Jun 5 • 235

mlx-community/gemma-4-E2B-it-qat-assistant-5bit

Text Generation • 14.8M • Updated Jun 5 • 25

mlx-community/gemma-4-E2B-it-qat-assistant-6bit

Text Generation • 17.3M • Updated Jun 5 • 42

mlx-community/gemma-4-E2B-it-qat-assistant-8bit

Text Generation • 22.1M • Updated Jun 5 • 55

mlx-community/gemma-4-E2B-it-qat-assistant-bf16

Text Generation • 78M • Updated Jun 5 • 42

mlx-community/gemma-4-E2B-it-qat-assistant-mxfp4

Text Generation • 14.8M • Updated Jun 5 • 144 • 1

mlx-community/gemma-4-E2B-it-qat-assistant-nvfp4

Text Generation • 19.7M • Updated Jun 5 • 54

mlx-community/gemma-4-E2B-it-qat-assistant-mxfp8

Text Generation • 22.1M • Updated Jun 5 • 54

mlx-community/gemma-4-E4B-it-qat-assistant-4bit

Text Generation • 12.5M • Updated Jun 5 • 439 • 1

mlx-community/gemma-4-E4B-it-qat-assistant-6bit

Text Generation • 17.4M • Updated Jun 5 • 54

mlx-community/gemma-4-E4B-it-qat-assistant-5bit

Text Generation • 15M • Updated Jun 5 • 27

mlx-community/gemma-4-E4B-it-qat-assistant-8bit

Text Generation • 22.3M • Updated Jun 5 • 99

mlx-community/gemma-4-E4B-it-qat-assistant-bf16

Text Generation • 78.8M • Updated Jun 5 • 346 • 2