| --- |
| library_name: audio.cpp |
| pipeline_tag: text-to-audio |
| license: other |
| license_name: minimax-music3-community-license |
| base_model: |
| - MiniMaxAI/MiniMax-Music3 |
| tags: |
| - audio.cpp |
| - gguf |
| - minimax-music3 |
| --- |
| |
| # MiniMax Music 3 GGUF |
|
|
| GGUF package for MiniMax Music 3 for audio.cpp. |
|
|
| Star our repo so you don't miss important updates! https://github.com/0xShug0/audio.cpp |
|
|
| Upstream model: https://huggingface.co/MiniMaxAI/MiniMax-Music3 |
| Upstream license: https://huggingface.co/MiniMaxAI/MiniMax-Music3/blob/main/LICENSE |
|
|
| Compatible Q8 GGUF package: https://huggingface.co/joemattie/MiniMax-Music3-GGUF |
|
|
| ## Notes |
|
|
| - The implementation is available on the `main` branch and release 0.6.1. |
| - The current runtime uses model-local resource loading instead of treating the v1 spec as the runtime contract. This keeps component selection flexible while the package layout and option surface settle. |
| - The default component mix favors Q4_0 for the large language model and flow transformer, with Q8_0 for the RVQ depth decoder. |
| - BF16, Q8_0, and Q4_0 component variants are included for quality/performance comparison. |
| - Longer generations such as five-minute songs are supported as long-form runs, but they are currently tuned for completion and quality checks rather than realtime throughput. |
| - Memory usage remains an active optimization target for larger durations and alternate component mixes. |
|
|
| ## Performance Snapshot |
|
|
| Measured on an RTX 5090 with CUDA using a 30-second lyric generation request, 30 flow steps, flow guidance scale 1.7, AR guidance scale 1.5, and top-k 50. Peak VRAM is the observed `nvidia-smi` process peak during a warmup-plus-measured-request run. |
|
|
| | Component mix | Language model | RVQ depth decoder | Flow transformer | RTF | Speed | Peak VRAM | |
| |---|---|---|---|---:|---:|---:| |
| | Default Q4/Q8/Q4 | `q4_0` | `q8_0` | `q4_0` | 0.738 | 1.35x realtime | 9.8 GiB | |
| | Q8 | `q8_0` | `q8_0` | `q8_0` | 0.832 | 1.20x realtime | 13.4 GiB | |
| | BF16 | `bf16` | `bf16` | `bf16` | 1.389 | 0.72x realtime | 19.4 GiB | |
|
|
| ## Quick Start |
|
|
| The prompt is for smoke end-to-end test only. |
|
|
| ```bash |
| audiocpp_cli \ |
| --task gen \ |
| --family minimax_music3 \ |
| --model MiniMax-Music3-GGUF \ |
| --backend cuda \ |
| --text "A bright pop rock song with clean drums and a clear male vocal." \ |
| --request-option 'lyrics=City lights are shining low. I keep moving with the glow. Turn it up and let it fly. Sing the melody tonight.' \ |
| --request-option duration_sec=10 \ |
| --request-option num_inference_steps=30 \ |
| --out output.wav |
| ``` |
|
|
| ## Components |
|
|
| Default audio.cpp component mix: |
|
|
| - `language_model_q4_0.gguf` |
| - `rvq_depth_decoder_q8_0.gguf` |
| - `transformer_q4_0.gguf` |
| - `condition_encoder.gguf` |
| - `vocoder.gguf` |
|
|
| The BF16, Q8_0, and Q4_0 component variants are included for measurement and quality/performance comparison. |
|
|
| Component GGUFs can be selected explicitly for experiments: |
|
|
| ```bash |
| --session-option minimax_music3.language_model_gguf=language_model_bf16.gguf |
| --session-option minimax_music3.language_model_gguf=language_model_q8_0.gguf |
| --session-option minimax_music3.rvq_depth_decoder_gguf=rvq_depth_decoder_bf16.gguf |
| --session-option minimax_music3.rvq_depth_decoder_gguf=rvq_depth_decoder_q8_0.gguf |
| --session-option minimax_music3.flow_transformer_gguf=transformer_bf16.gguf |
| --session-option minimax_music3.flow_transformer_gguf=transformer_q8_0.gguf |
| ``` |
|
|
| ## License |
|
|
| This GGUF package follows the upstream MiniMax-Music3 COMMUNITY LICENSE. The |
| license text is included in `LICENSE`; review it before use, especially for |
| commercial deployment. |
|
|
