MLX conversions of Nanbeige4.2-3B (Looped Transformer): bf16 + 2-8 bit quants. Needs mlx-lm PR #1597.
-
MercuriusDream/Nanbeige4.2-3B-mlx-bf16
Text Generation • 4B • Updated • 247 • 1 -
MercuriusDream/Nanbeige4.2-3B-mlx-8bit
Text Generation • 1B • Updated • 1.25k • 4 -
MercuriusDream/Nanbeige4.2-3B-mlx-6bit
Text Generation • 0.9B • Updated • 156 • 1 -
MercuriusDream/Nanbeige4.2-3B-mlx-5bit
Text Generation • 0.8B • Updated • 56