MiniMax-M3.1-Flash-oQ3e-mtp

This model was quantized using oQ (oMLX v0.7.3.dev1) mixed-precision quantization.

A mixed-precision MLX checkpoint of MiniMaxAI/MiniMax-M3.1-Flash, a native multimodal mixture-of-experts model for coding, agentic workflows, computer use and cybersecurity with about 428B total and 23B activated parameters. It takes text, image and video inputs with a context window of up to 1M tokens, and uses MiniMax Sparse Attention throughout the model. It includes the language model, the vision encoder and the bundled DSpark draft in dspark/, which oMLX Lightning MTP uses for speculative decoding.

The effective average is 3.631 bits/weight for the language model and vision encoder, or 3.657 bits/weight including the DSpark draft.

Quantization and Bit Distribution

oQ3e requantizes the routed experts from NVFP4 to affine 3-bit. It keeps MXFP8 for the shared experts, the sparse attention indexer and about a third of the attention projections, and stores the remaining projections, the embeddings and the vocabulary head as affine 3- to 8-bit. The router and the DSpark draft keep their source precision.

Storage format Logical weights Share of total Tensor storage Effective bits/weight
Affine 3-bit, group 64 413.311B 96.782% 168.405 GiB 3.50
Affine 4-bit, group 64 2.378B 0.557% 1.246 GiB 4.50
Affine 5-bit, group 64 2.460B 0.576% 1.575 GiB 5.50
Affine 6-bit, group 64 0.226B 0.053% 0.171 GiB 6.50
Affine 8-bit, group 64 2.458B 0.576% 2.433 GiB 8.50
MXFP8, group 32 5.496B 1.287% 5.278 GiB 8.25
BF16 0.678B 0.159% 1.262 GiB 16.00
FP32 0.045B 0.010% 0.167 GiB 32.00
Total 427.052B 100% 180.537 GiB 3.631

Storage Breakdown

Component Logical weights Storage
Language model 426.375B 192.497 GB / 179.277 GiB
Vision 0.677B 1.354 GB / 1.261 GiB
DSpark draft (MTP) 2.011B 2.302 GB / 2.144 GiB
Total 429.063B 196.152 GB / 182.681 GiB

License

MiniMax Community License, following the source model. See LICENSE. Commercial use has additional conditions in the license, including displaying "Built with MiniMax M3.1-Flash" and obtaining prior written authorization from MiniMax.

Downloads last month
480
Safetensors
Model size
427B params
Tensor type
U32
·
BF16
·
F32
·
MLX
Hardware compatibility
Log In to add your hardware

3-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for mlx-community/MiniMax-M3.1-Flash-oQ3e-mtp

Quantized
(32)
this model