Gemma4

axteam 's Collections

Image Models Quantized

OCR Quantized

Qwen

updated 3 days ago

axteam's Gemma 4 quantizations — FP8 dynamic, AWQ INT4/INT8, NVFP4 (W4A4 & W4A16), and GGUF — for 12B-it, E4B-it, 26B-A4B(+it), 31B(+it).

Upvote

axteam/gemma-4-12B-it-FP8-dynamic

Image-Text-to-Text • 12B • Updated 19 days ago • 60 • 3

Note gemma-4-12B-it · FP8 dynamic (W8A8) — near-lossless; Hopper/Ada/Blackwell
axteam/gemma-4-12B-it-AWQ-8bit

Image-Text-to-Text • 12B • Updated 19 days ago • 50 • 3

Note gemma-4-12B-it · AWQ W8A16 INT8 — near-lossless
axteam/gemma-4-12B-it-AWQ-4bit

Image-Text-to-Text • 12B • Updated 19 days ago • 221 • 2

Note gemma-4-12B-it · AWQ W4A16 INT4 — ~1/4 size
axteam/gemma-4-12B-it-NVFP4A16

Image-Text-to-Text • 12B • Updated 19 days ago • 55 • 1

Note gemma-4-12B-it · NVFP4 W4A16 (FP4 weights, BF16 activations) — best 4-bit quality
axteam/gemma-4-12B-it-NVFP4

Image-Text-to-Text • 12B • Updated 19 days ago • 155 • 1

Note gemma-4-12B-it · NVFP4 W4A4 (FP4 weights + activations) — fastest on Blackwell
axteam/gemma-4-12B-it-GGUF

Image-Text-to-Text • 12B • Updated 19 days ago • 344 • 1

Note gemma-4-12B-it · GGUF (Q4_K_M / Q8_0 / BF16) for llama.cpp / Ollama
axteam/gemma-4-E4B-it-FP8-dynamic

Image-Text-to-Text • 8B • Updated 19 days ago • 68 • 1

Note gemma-4-E4B-it · FP8 dynamic (W8A8) — near-lossless; Hopper/Ada/Blackwell
axteam/gemma-4-E4B-it-AWQ-8bit

Image-Text-to-Text • 8B • Updated 19 days ago • 43 • 1

Note gemma-4-E4B-it · AWQ W8A16 INT8 — near-lossless
axteam/gemma-4-E4B-it-AWQ-4bit

Image-Text-to-Text • 8B • Updated 19 days ago • 48 • 1

Note gemma-4-E4B-it · AWQ W4A16 INT4 — ~1/4 size
axteam/gemma-4-E4B-it-NVFP4A16

Image-Text-to-Text • 8B • Updated 19 days ago • 40 • 1

Note gemma-4-E4B-it · NVFP4 W4A16 (FP4 weights, BF16 activations) — best 4-bit quality
axteam/gemma-4-E4B-it-NVFP4

Image-Text-to-Text • 8B • Updated 19 days ago • 43 • 1

Note gemma-4-E4B-it · NVFP4 W4A4 (FP4 weights + activations) — fastest on Blackwell
axteam/gemma-4-E4B-it-GGUF

Image-Text-to-Text • 8B • Updated 19 days ago • 615 • 2

Note gemma-4-E4B-it · GGUF (Q4_K_M / Q8_0 / BF16) for llama.cpp / Ollama
axteam/gemma-4-26B-A4B-FP8-dynamic

Image-Text-to-Text • 26B • Updated 19 days ago • 64 • 1

Note gemma-4-26B-A4B · FP8 dynamic (W8A8) — near-lossless; Hopper/Ada/Blackwell
axteam/gemma-4-26B-A4B-AWQ-8bit

Image-Text-to-Text • 9B • Updated 19 days ago • 60 • 1

Note gemma-4-26B-A4B · AWQ W8A16 INT8 — near-lossless
axteam/gemma-4-26B-A4B-AWQ-4bit

Image-Text-to-Text • 26B • Updated 19 days ago • 120 • 1

Note gemma-4-26B-A4B · AWQ W4A16 INT4 — ~1/4 size
axteam/gemma-4-26B-A4B-NVFP4A16

Image-Text-to-Text • 26B • Updated 19 days ago • 55 • 1

Note gemma-4-26B-A4B · NVFP4 W4A16 (FP4 weights, BF16 activations) — best 4-bit quality
axteam/gemma-4-26B-A4B-NVFP4

Image-Text-to-Text • 26B • Updated 19 days ago • 69 • 1

Note gemma-4-26B-A4B · NVFP4 W4A4 (FP4 weights + activations) — fastest on Blackwell
axteam/gemma-4-26B-A4B-GGUF

Image-Text-to-Text • 25B • Updated 19 days ago • 396 • 1

Note gemma-4-26B-A4B · GGUF (Q4_K_M / Q8_0 / BF16) for llama.cpp / Ollama
axteam/gemma-4-26B-A4B-it-FP8-dynamic

Image-Text-to-Text • 26B • Updated 19 days ago • 76 • 1

Note gemma-4-26B-A4B-it · FP8 dynamic (W8A8) — near-lossless; Hopper/Ada/Blackwell
axteam/gemma-4-26B-A4B-it-AWQ-8bit

Image-Text-to-Text • 9B • Updated 19 days ago • 43 • 1

Note gemma-4-26B-A4B-it · AWQ W8A16 INT8 — near-lossless
axteam/gemma-4-26B-A4B-it-AWQ-4bit

Image-Text-to-Text • 26B • Updated 19 days ago • 241 • 1

Note gemma-4-26B-A4B-it · AWQ W4A16 INT4 — ~1/4 size
axteam/gemma-4-26B-A4B-it-NVFP4A16

Image-Text-to-Text • 26B • Updated 19 days ago • 70 • 1

Note gemma-4-26B-A4B-it · NVFP4 W4A16 (FP4 weights, BF16 activations) — best 4-bit quality
axteam/gemma-4-26B-A4B-it-NVFP4

Image-Text-to-Text • 26B • Updated 19 days ago • 85 • 1

Note gemma-4-26B-A4B-it · NVFP4 W4A4 (FP4 weights + activations) — fastest on Blackwell
axteam/gemma-4-26B-A4B-it-GGUF

Image-Text-to-Text • 25B • Updated 19 days ago • 783 • 3

Note gemma-4-26B-A4B-it · GGUF (Q4_K_M / Q8_0 / BF16) for llama.cpp / Ollama
axteam/gemma-4-31B-FP8-dynamic

Image-Text-to-Text • 31B • Updated 19 days ago • 182 • 1

Note gemma-4-31B · FP8 dynamic (W8A8) — near-lossless; Hopper/Ada/Blackwell
axteam/gemma-4-31B-AWQ-8bit

Image-Text-to-Text • 10B • Updated 19 days ago • 63 • 1

Note gemma-4-31B · AWQ W8A16 INT8 — near-lossless
axteam/gemma-4-31B-AWQ-4bit

Image-Text-to-Text • 7B • Updated 19 days ago • 65 • 1

Note gemma-4-31B · AWQ W4A16 INT4 — ~1/4 size
axteam/gemma-4-31B-NVFP4A16

Image-Text-to-Text • 18B • Updated 19 days ago • 59 • 1

Note gemma-4-31B · NVFP4 W4A16 (FP4 weights, BF16 activations) — best 4-bit quality
axteam/gemma-4-31B-NVFP4

Image-Text-to-Text • 18B • Updated 19 days ago • 119 • 1

Note gemma-4-31B · NVFP4 W4A4 (FP4 weights + activations) — fastest on Blackwell
axteam/gemma-4-31B-GGUF

Image-Text-to-Text • 31B • Updated 19 days ago • 343 • 1

Note gemma-4-31B · GGUF (Q4_K_M / Q8_0 / BF16) for llama.cpp / Ollama
axteam/gemma-4-31B-it-FP8-dynamic

Image-Text-to-Text • 31B • Updated 19 days ago • 54 • 1

Note gemma-4-31B-it · FP8 dynamic (W8A8) — near-lossless; Hopper/Ada/Blackwell
axteam/gemma-4-31B-it-AWQ-8bit

Image-Text-to-Text • 10B • Updated 19 days ago • 58 • 1

Note gemma-4-31B-it · AWQ W8A16 INT8 — near-lossless
axteam/gemma-4-31B-it-AWQ-4bit

Image-Text-to-Text • 7B • Updated 19 days ago • 230 • 1

Note gemma-4-31B-it · AWQ W4A16 INT4 — ~1/4 size
axteam/gemma-4-31B-it-NVFP4A16

Image-Text-to-Text • 18B • Updated 19 days ago • 76 • 2

Note gemma-4-31B-it · NVFP4 W4A16 (FP4 weights, BF16 activations) — best 4-bit quality
axteam/gemma-4-31B-it-NVFP4

Image-Text-to-Text • 18B • Updated 19 days ago • 135 • 4

Note gemma-4-31B-it · NVFP4 W4A4 (FP4 weights + activations) — fastest on Blackwell
axteam/gemma-4-31B-it-GGUF

Image-Text-to-Text • 31B • Updated 19 days ago • 334 • 1

Note gemma-4-31B-it · GGUF (Q4_K_M / Q8_0 / BF16) for llama.cpp / Ollama
axteam/gemma-4-E2B-it-GGUF

Image-Text-to-Text • 5B • Updated 19 days ago • 383 • 1

Note gemma-4-E2B-it · GGUF (Q4_K_M / Q8_0 / BF16) for llama.cpp / Ollama
axteam/gemma-4-E2B-it-FP8-dynamic

Image-Text-to-Text • 5B • Updated 19 days ago • 69 • 1

Note gemma-4-E2B-it · FP8 dynamic (W8A8) — near-lossless; Hopper/Ada/Blackwell
axteam/gemma-4-E2B-it-AWQ-8bit

Image-Text-to-Text • 5B • Updated 19 days ago • 46 • 1

Note gemma-4-E2B-it · AWQ W8A16 INT8 — near-lossless
axteam/gemma-4-E2B-it-AWQ-4bit

Image-Text-to-Text • 5B • Updated 19 days ago • 48 • 1

Note gemma-4-E2B-it · AWQ W4A16 INT4 — ~1/4 size
axteam/gemma-4-E2B-it-NVFP4A16

Image-Text-to-Text • 5B • Updated 19 days ago • 51 • 1

Note gemma-4-E2B-it · NVFP4 W4A16 (FP4 weights, BF16 activations) — best 4-bit quality
axteam/gemma-4-E2B-it-NVFP4

Image-Text-to-Text • 5B • Updated 19 days ago • 49 • 1

Note gemma-4-E2B-it · NVFP4 W4A4 (FP4 weights + activations) — fastest on Blackwell

Upvote