LetheanNetwork/lemmy-mlx-8bit

Gemma 4 26B A4B MoE in MLX format, 8-bit quantized, converted from LetheanNetwork/lemmy's bf16 safetensors via mlx_lm.convert. Higher-precision sibling of LetheanNetwork/lemmy-mlx (4-bit). For the LEK-merged variant see lthn/lemmy.

License

Apache 2.0, subject to the Gemma Terms of Use.

Downloads last month
14
Safetensors
Model size
25B params
Tensor type
U32
ยท
BF16
ยท
MLX
Hardware compatibility
Log In to add your hardware

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for LetheanNetwork/lemmy-mlx-8bit

Quantized
(2)
this model