M2.5 community integration proposal: local MLX chat and tool-result replay

#71
by Raullen - opened

Proposing a community deployment example for MiniMax M2.5 users connecting a coding/search client to an Apple Silicon HTTP endpoint.

Rapid-MLX catalogs the M2.5 4-bit conversion and selects model-specific minimax tool and reasoning parsers. The useful example would make those observable via a plain response, a structured tool request and a second turn with the tool result. It should preserve your documented inference parameters and separate reasoning from the final answer in both streaming and nonstreaming requests.

This scope is M2.5 text serving only. MiniMax H3 video and M2.7 are different artifacts and endpoints; their presence in the catalog is not evidence for this model. An eventual recipe needs measured memory and exact runtime versions before recommending hardware.

Concrete catalog entry: minimax-m2.5-4bit → lmstudio-community/MiniMax-M2.5-MLX-4bit@9af822e97aaa5d3d8f9a635ec2b967b0c0a9a09f. This is a conversion/distribution artifact; it is not presented as an official upstream release.

Source references (fixed Rapid commit): catalog, parser selection, tool API guide.

Verification status: this proposal is based on reading the catalog, implementation and the linked documentation/tests. No fresh model inference or test-suite run was performed for this submission; source tests are not an end-to-end qualification. It requests a community documentation scope, not an official endorsement or a performance listing.

Disclosure: I maintain Rapid-MLX. Prepared with AI assistance under my direction. Anonymous usage-metadata telemetry is enabled by default; DO_NOT_TRACK=1 disables it. The original model and conversion terms continue to apply.

Sign up or log in to comment