MLX conversions of Nanbeige4.2-3B (Looped Transformer): bf16 + 2-8 bit quants. Needs mlx-lm PR #1597.
-
MercuriusDream/Nanbeige4.2-3B-mlx-bf16
Text Generation • 4B • Updated • 362 • 1 -
MercuriusDream/Nanbeige4.2-3B-mlx-8bit
Text Generation • 1B • Updated • 1.83k • 4 -
MercuriusDream/Nanbeige4.2-3B-mlx-6bit
Text Generation • 0.9B • Updated • 245 • 1 -
MercuriusDream/Nanbeige4.2-3B-mlx-5bit
Text Generation • 0.8B • Updated • 69