Commit ·
dfe574a
0
Parent(s):
Duplicate from nvidia/MiniMax-M3-NVFP4
Browse filesCo-authored-by: Chad Voegele <cvoegele-nv@users.noreply.huggingface.co>
This view is limited to 50 files because it contains too many changes. See raw diff
- .gitattributes +36 -0
- LICENSE +17 -0
- README.md +134 -0
- added_tokens.json +63 -0
- chat_template.jinja +247 -0
- config.json +0 -0
- configuration_minimax_m3_vl.py +111 -0
- generation_config.json +8 -0
- hf_quant_config.json +0 -0
- image_processor.py +223 -0
- merges.txt +0 -0
- model-00001-of-00088.safetensors +3 -0
- model-00002-of-00088.safetensors +3 -0
- model-00003-of-00088.safetensors +3 -0
- model-00004-of-00088.safetensors +3 -0
- model-00005-of-00088.safetensors +3 -0
- model-00006-of-00088.safetensors +3 -0
- model-00007-of-00088.safetensors +3 -0
- model-00008-of-00088.safetensors +3 -0
- model-00009-of-00088.safetensors +3 -0
- model-00010-of-00088.safetensors +3 -0
- model-00011-of-00088.safetensors +3 -0
- model-00012-of-00088.safetensors +3 -0
- model-00013-of-00088.safetensors +3 -0
- model-00014-of-00088.safetensors +3 -0
- model-00015-of-00088.safetensors +3 -0
- model-00016-of-00088.safetensors +3 -0
- model-00017-of-00088.safetensors +3 -0
- model-00018-of-00088.safetensors +3 -0
- model-00019-of-00088.safetensors +3 -0
- model-00020-of-00088.safetensors +3 -0
- model-00021-of-00088.safetensors +3 -0
- model-00022-of-00088.safetensors +3 -0
- model-00023-of-00088.safetensors +3 -0
- model-00024-of-00088.safetensors +3 -0
- model-00025-of-00088.safetensors +3 -0
- model-00026-of-00088.safetensors +3 -0
- model-00027-of-00088.safetensors +3 -0
- model-00028-of-00088.safetensors +3 -0
- model-00029-of-00088.safetensors +3 -0
- model-00030-of-00088.safetensors +3 -0
- model-00031-of-00088.safetensors +3 -0
- model-00032-of-00088.safetensors +3 -0
- model-00033-of-00088.safetensors +3 -0
- model-00034-of-00088.safetensors +3 -0
- model-00035-of-00088.safetensors +3 -0
- model-00036-of-00088.safetensors +3 -0
- model-00037-of-00088.safetensors +3 -0
- model-00038-of-00088.safetensors +3 -0
- model-00039-of-00088.safetensors +3 -0
.gitattributes
ADDED
|
@@ -0,0 +1,36 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
*.7z filter=lfs diff=lfs merge=lfs -text
|
| 2 |
+
*.arrow filter=lfs diff=lfs merge=lfs -text
|
| 3 |
+
*.bin filter=lfs diff=lfs merge=lfs -text
|
| 4 |
+
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
| 5 |
+
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
| 6 |
+
*.ftz filter=lfs diff=lfs merge=lfs -text
|
| 7 |
+
*.gz filter=lfs diff=lfs merge=lfs -text
|
| 8 |
+
*.h5 filter=lfs diff=lfs merge=lfs -text
|
| 9 |
+
*.joblib filter=lfs diff=lfs merge=lfs -text
|
| 10 |
+
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
| 11 |
+
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
| 12 |
+
*.model filter=lfs diff=lfs merge=lfs -text
|
| 13 |
+
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
| 14 |
+
*.npy filter=lfs diff=lfs merge=lfs -text
|
| 15 |
+
*.npz filter=lfs diff=lfs merge=lfs -text
|
| 16 |
+
*.onnx filter=lfs diff=lfs merge=lfs -text
|
| 17 |
+
*.ot filter=lfs diff=lfs merge=lfs -text
|
| 18 |
+
*.parquet filter=lfs diff=lfs merge=lfs -text
|
| 19 |
+
*.pb filter=lfs diff=lfs merge=lfs -text
|
| 20 |
+
*.pickle filter=lfs diff=lfs merge=lfs -text
|
| 21 |
+
*.pkl filter=lfs diff=lfs merge=lfs -text
|
| 22 |
+
*.pt filter=lfs diff=lfs merge=lfs -text
|
| 23 |
+
*.pth filter=lfs diff=lfs merge=lfs -text
|
| 24 |
+
*.rar filter=lfs diff=lfs merge=lfs -text
|
| 25 |
+
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
| 26 |
+
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
| 27 |
+
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
| 28 |
+
*.tar filter=lfs diff=lfs merge=lfs -text
|
| 29 |
+
*.tflite filter=lfs diff=lfs merge=lfs -text
|
| 30 |
+
*.tgz filter=lfs diff=lfs merge=lfs -text
|
| 31 |
+
*.wasm filter=lfs diff=lfs merge=lfs -text
|
| 32 |
+
*.xz filter=lfs diff=lfs merge=lfs -text
|
| 33 |
+
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
+
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
+
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
figures/benchmark.jpeg filter=lfs diff=lfs merge=lfs -text
|
LICENSE
ADDED
|
@@ -0,0 +1,17 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
MINIMAX COMMUNITY LICENSE
|
| 2 |
+
Copyright (c) 2026 MiniMax
|
| 3 |
+
Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the “Software”), to deal in the Software for non-commercial purposes, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or provide copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
|
| 4 |
+
1. The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
|
| 5 |
+
2. If the Software (or any derivative works thereof) is used for any Commercial Use for your products or services:
|
| 6 |
+
1. you shall prominently display “Built with MiniMax M3” on a related website, user interface, blogpost, about page or product documentation.
|
| 7 |
+
2. you shall obtain a separate, prior written authorization from MiniMax by contacting api@minimax.io with the subject line “M3 licensing - authorization request”, if such products and services generate more than 20 million US dollars (or equivalent in other currencies) in yearly revenue; otherwise, you only need to send a one-time notice to api@minimax.io with the subject “M3 licensing — notice”.
|
| 8 |
+
3. “Commercial Use” means any use of the Software or any derivative work thereof that is primarily intended for commercial advantage or monetary compensation, which includes, without limitation: (i) offering products or services to third parties for a fee, which utilize, incorporate, or rely on the Software or its derivatives, (ii) the commercial use of APIs provided by or for the Software or its derivatives, including to support or enable commercial products, services, or operations, whether in a cloud-based, hosted, or other similar environment, and (iii) the deployment or provision of the Software or its derivatives that have been subjected to post-training, fine-tuning, instruction-tuning, or any other form of modification, for any commercial purpose.
|
| 9 |
+
THE SOFTWARE IS PROVIDED “AS IS”, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
|
| 10 |
+
|
| 11 |
+
Appendix: Prohibited Uses
|
| 12 |
+
You agree you will not use, or allow others to use, the Software or any derivatives of the Software to:
|
| 13 |
+
1. Generate or disseminate content prohibited by applicable laws or regulations.
|
| 14 |
+
2. Assist with, engage in or otherwise support any military purpose.
|
| 15 |
+
3. Exploit, harm, or attempt to exploit or harm minors.
|
| 16 |
+
4. Generate or disseminate false or misleading information with the intent to cause harm.
|
| 17 |
+
5. Promote discrimination, hate speech, or harmful behavior against individuals or groups based on race or ethnic origin, religion, disability, age, nationality and national origin, veteran status, sexual orientation, gender or gender identity, caste, immigration status, or any other characteristic that is associated with systemic discrimination or marginalization.
|
README.md
ADDED
|
@@ -0,0 +1,134 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
pipeline_tag: text-generation
|
| 3 |
+
base_model:
|
| 4 |
+
- MiniMaxAI/MiniMax-M3
|
| 5 |
+
license: other
|
| 6 |
+
license_name: minimax-community-license
|
| 7 |
+
license_link: https://huggingface.co/MiniMaxAI/MiniMax-M3/blob/main/LICENSE
|
| 8 |
+
tags:
|
| 9 |
+
- nvidia
|
| 10 |
+
- ModelOpt
|
| 11 |
+
- MiniMax-M3
|
| 12 |
+
- quantized
|
| 13 |
+
- NVFP4
|
| 14 |
+
- nvfp4
|
| 15 |
+
---
|
| 16 |
+
|
| 17 |
+
# Model Overview
|
| 18 |
+
|
| 19 |
+
## Description
|
| 20 |
+
MiniMax-M3 is a multimodal model with frontier-level coding and agentic capabilities, built on a Mixture-of-Experts architecture with a 1M-token context window. The model processes text, image, video, and computer use inputs and produces text outputs, with emphasis on long-horizon coding tasks, agentic and tool-use workflows, and long-form video understanding.
|
| 21 |
+
The NVIDIA MiniMax-M3 NVFP4 model is quantized with [Model Optimizer](https://github.com/NVIDIA/Model-Optimizer).
|
| 22 |
+
|
| 23 |
+
*This model is ready for non-commercial use.*
|
| 24 |
+
|
| 25 |
+
## Third-Party Community Consideration:
|
| 26 |
+
This model is not owned or developed by NVIDIA. This model has been developed and built to a third-party's requirements for this application and use case; see link to Non-NVIDIA [MiniMax-M3 Model Card](https://huggingface.co/MiniMaxAI).
|
| 27 |
+
|
| 28 |
+
### License/Terms of Use:
|
| 29 |
+
**GOVERNING TERMS:** Use of the checkpoints is governed by the [MiniMax Community License](https://huggingface.co/MiniMaxAI/MiniMax-M3/blob/main/LICENSE).<br>
|
| 30 |
+
**Additional Information:** Built with [MiniMax M3](https://huggingface.co/MiniMaxAI/MiniMax-M3).
|
| 31 |
+
|
| 32 |
+
### Deployment Geography:
|
| 33 |
+
Global
|
| 34 |
+
|
| 35 |
+
## Use Case:
|
| 36 |
+
**Use Case:** MiniMax-M3 is intended for multimodal understanding across text, image, and video; long-form video understanding (up to 30 minutes); long-horizon coding tasks (8+ hours); agentic and tool-use workflows; and design and creative tasks. The model supports two reasoning modes switchable per request: thinking mode for complex reasoning and agentic tasks, and non-thinking mode for latency-sensitive scenarios.
|
| 37 |
+
|
| 38 |
+
### Release Date:
|
| 39 |
+
Hugging Face 06/23/2026 via https://huggingface.co/nvidia/MiniMax-M3-NVFP4
|
| 40 |
+
|
| 41 |
+
## Model Architecture:
|
| 42 |
+
**Architecture Type:** Transformer<br>
|
| 43 |
+
**Network Architecture:** Mixture-of-Experts (multimodal)<br>
|
| 44 |
+
**Total Parameters:** 428B<br>
|
| 45 |
+
**Active Parameters:** Approximately 23B per token (A23B)<br>
|
| 46 |
+
**Vision Encoder:** ViT for image and video input
|
| 47 |
+
|
| 48 |
+
### Input:
|
| 49 |
+
**Input Types:** Text, Image, Video<br>
|
| 50 |
+
**Input Formats:** Text: String; Image: RGB images; Video: encoded video file<br>
|
| 51 |
+
**Input Parameters:** One-Dimensional (1D), Two-Dimensional (2D), Three-Dimensional (3D)<br>
|
| 52 |
+
**Other Input Properties:** Supports long-form video input up to 30 minutes.<br>
|
| 53 |
+
**Input Context Length (ISL):** 1 million tokens
|
| 54 |
+
|
| 55 |
+
### Output:
|
| 56 |
+
**Output Types:** Text<br>
|
| 57 |
+
**Output Format:** String<br>
|
| 58 |
+
**Output Parameters:** One-Dimensional (1D)<br>
|
| 59 |
+
**Other Output Properties:** None
|
| 60 |
+
|
| 61 |
+
Our AI models are designed and/or optimized to run on NVIDIA GPU-accelerated systems. By leveraging NVIDIA's hardware (e.g. GPU cores) and software frameworks (e.g., CUDA libraries), the model achieves faster training and inference times compared to CPU-only solutions.
|
| 62 |
+
|
| 63 |
+
## Software Integration:
|
| 64 |
+
**Runtime Engine(s):**<br>
|
| 65 |
+
**vLLM**
|
| 66 |
+
|
| 67 |
+
**Supported Hardware Microarchitecture Compatibility:**
|
| 68 |
+
* NVIDIA Blackwell
|
| 69 |
+
|
| 70 |
+
**Preferred Operating System(s):**
|
| 71 |
+
* Linux
|
| 72 |
+
|
| 73 |
+
The integration of foundation and fine-tuned models into AI systems requires additional testing using use-case-specific data to ensure safe and effective deployment. Following the V-model methodology, iterative testing and validation at both unit and system levels are essential to mitigate risks, meet technical and functional requirements, and ensure compliance with safety and ethical standards before deployment.
|
| 74 |
+
|
| 75 |
+
## Model Version(s):
|
| 76 |
+
This model is NVFP4 quantized with nvidia-modelopt **v0.44.0**
|
| 77 |
+
|
| 78 |
+
## Training and Evaluation Datasets:
|
| 79 |
+
|
| 80 |
+
### Training Dataset
|
| 81 |
+
**Data Modality:** Text, Image, Video<br>
|
| 82 |
+
**Image Training Data Size:** Undisclosed<br>
|
| 83 |
+
**Text Training Data Size:** Undisclosed<br>
|
| 84 |
+
**Training Data Collection:** Undisclosed<br>
|
| 85 |
+
**Training Labeling:** Undisclosed<br>
|
| 86 |
+
**Training Properties:** Undisclosed
|
| 87 |
+
|
| 88 |
+
## Evaluation Dataset:
|
| 89 |
+
**Datasets:** GPQA Diamond, AA-LCR, τ²-Telecom, MMMU-Pro, and SciCode<br>
|
| 90 |
+
**Data Collection Method by dataset:** Hybrid, Automated, Human<br>
|
| 91 |
+
**Labeling Method by dataset:** Hybrid, Automated, Human<br>
|
| 92 |
+
**Properties:** We evaluated the model on reasoning, instruction-following, agentic, multimodal, and coding benchmarks: GPQA Diamond contains 448 graduate-level multiple-choice questions written by domain experts in biology, physics, and chemistry; AA-LCR (Artificial Analysis Long Context Reasoning) tests reasoning and synthesis over long-context inputs spanning multiple documents; τ²-Telecom (tau2-bench) is an agentic tool-use benchmark measuring multi-turn task completion in a telecom customer-service domain; MMMU-Pro is a massive multi-discipline multimodal understanding benchmark with challenging multiple-choice questions requiring image comprehension across diverse academic domains; SciCode evaluates scientific coding capabilities.
|
| 93 |
+
|
| 94 |
+
## Inference:
|
| 95 |
+
**Engine:** vLLM
|
| 96 |
+
|
| 97 |
+
**Test Hardware:** NVIDIA Blackwell B200
|
| 98 |
+
|
| 99 |
+
## Post Training Quantization
|
| 100 |
+
This model was obtained by quantizing the weights and activations of Minimax-M3 to NVFP4 data type. This optimization reduces the number of bits per parameter from 8 to 4, reducing disk size and GPU memory requirements by approximately 2x.
|
| 101 |
+
|
| 102 |
+
## Usage
|
| 103 |
+
To serve this checkpoint with [vLLM](https://github.com/vllm-project/vllm), you currently need the nightly docker image that includes MiniMax-M3 NVFP4 support from [vllm-project/vllm#46380](https://github.com/vllm-project/vllm/pull/46380) (not yet in a stable release). Launch the nightly image and run the sample command below:
|
| 104 |
+
|
| 105 |
+
```
|
| 106 |
+
vllm serve nvidia/MiniMax-M3-NVFP4 \
|
| 107 |
+
--tensor-parallel-size 8 \
|
| 108 |
+
--block-size 128 \
|
| 109 |
+
--tool-call-parser minimax_m3 \
|
| 110 |
+
--reasoning-parser minimax_m3 \
|
| 111 |
+
--enable-auto-tool-choice
|
| 112 |
+
```
|
| 113 |
+
|
| 114 |
+
### Evaluation
|
| 115 |
+
|
| 116 |
+
**NVFP4 Quantization Accuracy (vs. FP8 baseline):**
|
| 117 |
+
|
| 118 |
+
| **Precision** | **GPQA Diamond** | **AA-LCR** | **τ²-Telecom** | **MMMU-Pro** | **SciCode** |
|
| 119 |
+
|---|---|---|---|---|---|
|
| 120 |
+
| FP8 | **92.53** | **76.62** | **92.22** | **71.97** | **49.90** |
|
| 121 |
+
| NVFP4 | **91.92** | **75.60** | **91.89** | **71.01** | **49.70** |
|
| 122 |
+
|
| 123 |
+
Baseline: MiniMax-M3 in its native MXFP8 format. Benchmarked with temperature=1.0, top_p=0.95, max num tokens 65536.
|
| 124 |
+
|
| 125 |
+
## Model Limitations:
|
| 126 |
+
The base model was trained on data that contains toxic language and societal biases originally crawled from the internet. Therefore, the model may amplify those biases and return toxic responses especially when prompted with toxic prompts. The model may generate answers that may be inaccurate, omit key information, or include irrelevant or redundant text producing socially unacceptable or undesirable text, even if the prompt itself does not include anything explicitly offensive.
|
| 127 |
+
|
| 128 |
+
## Ethical Considerations
|
| 129 |
+
|
| 130 |
+
NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. Developers should work with their internal model team to ensure this model meets requirements for the relevant industry and use case and addresses unforeseen product misuse.
|
| 131 |
+
|
| 132 |
+
Please make sure you have proper rights and permissions for all input image and video content; if image or video includes people, personal health information, or intellectual property, the image or video generated will not blur or maintain proportions of image subjects included.
|
| 133 |
+
|
| 134 |
+
Please report model quality, risk, security vulnerabilities or NVIDIA AI Concerns [here](https://app.intigriti.com/programs/nvidia/nvidiavdp/detail).
|
added_tokens.json
ADDED
|
@@ -0,0 +1,63 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"]!p~[": 200000,
|
| 3 |
+
"<fim_prefix>": 200001,
|
| 4 |
+
"<fim_middle>": 200002,
|
| 5 |
+
"<fim_suffix>": 200003,
|
| 6 |
+
"<fim_pad>": 200004,
|
| 7 |
+
"<reponame>": 200005,
|
| 8 |
+
"<filename>": 200006,
|
| 9 |
+
"<gh_stars>": 200007,
|
| 10 |
+
"<issue_start>": 200008,
|
| 11 |
+
"<issue_comment>": 200009,
|
| 12 |
+
"<issue_closed>": 200010,
|
| 13 |
+
"<jupyter_start>": 200011,
|
| 14 |
+
"<jupyter_text>": 200012,
|
| 15 |
+
"<jupyter_code>": 200013,
|
| 16 |
+
"<jupyter_output>": 200014,
|
| 17 |
+
"<empty_output>": 200015,
|
| 18 |
+
"<commit_before>": 200016,
|
| 19 |
+
"<commit_msg>": 200017,
|
| 20 |
+
"<commit_after>": 200018,
|
| 21 |
+
"]~b]": 200019,
|
| 22 |
+
"[e~[": 200020,
|
| 23 |
+
"]!d~[": 200021,
|
| 24 |
+
"<function_call>": 200022,
|
| 25 |
+
"<code_interpreter>": 200023,
|
| 26 |
+
"]<]speech[>[": 200024,
|
| 27 |
+
"]<]image[>[": 200025,
|
| 28 |
+
"]<]video[>[": 200026,
|
| 29 |
+
"]<]start of speech[>[": 200027,
|
| 30 |
+
"]<]end of speech[>[": 200028,
|
| 31 |
+
"]<]start of image[>[": 200029,
|
| 32 |
+
"]<]end of image[>[": 200030,
|
| 33 |
+
"]<]start of video[>[": 200031,
|
| 34 |
+
"]<]end of video[>[": 200032,
|
| 35 |
+
"]<]vision pad[>[": 200033,
|
| 36 |
+
"]~!b[": 200034,
|
| 37 |
+
"<jupyter_error>": 200035,
|
| 38 |
+
"<add_file>": 200036,
|
| 39 |
+
"<delete_file>": 200037,
|
| 40 |
+
"<rename_file>": 200038,
|
| 41 |
+
"<edit_file>": 200039,
|
| 42 |
+
"<commit_message>": 200040,
|
| 43 |
+
"<empty_source_file>": 200041,
|
| 44 |
+
"<repo_struct>": 200042,
|
| 45 |
+
"<code_context>": 200043,
|
| 46 |
+
"<file_content>": 200044,
|
| 47 |
+
"<source_files>": 200045,
|
| 48 |
+
"<pr_start>": 200046,
|
| 49 |
+
"<review_comment>": 200047,
|
| 50 |
+
"<filepath>": 200048,
|
| 51 |
+
"<file_sep>": 200049,
|
| 52 |
+
"<think>": 200050,
|
| 53 |
+
"</think>": 200051,
|
| 54 |
+
"<tool_call>": 200052,
|
| 55 |
+
"</tool_call>": 200053,
|
| 56 |
+
"]<]frame[>[": 200054,
|
| 57 |
+
"]<]start of frame[>[": 200055,
|
| 58 |
+
"]<]end of frame[>[": 200056,
|
| 59 |
+
"<|content_altered_placeholder|>": 200057,
|
| 60 |
+
"]<]minimax[>[": 200058,
|
| 61 |
+
"<mm:think>": 200059,
|
| 62 |
+
"</mm:think>": 200060
|
| 63 |
+
}
|
chat_template.jinja
ADDED
|
@@ -0,0 +1,247 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{# ---------- special token variables ---------- #}
|
| 2 |
+
{%- set ns_token = ']<]minimax[>[' -%}
|
| 3 |
+
{%- set bod_token = ']~!b[' -%}
|
| 4 |
+
{%- set bos_token = ']~b]' -%}
|
| 5 |
+
{%- set eos_token = '[e~[' -%}
|
| 6 |
+
{%- set toolcall_begin_token = ns_token ~ '<tool_call>' -%}
|
| 7 |
+
{%- set toolcall_end_token = ns_token ~ '</tool_call>' -%}
|
| 8 |
+
{%- set think_begin_token = '<mm:think>' -%}
|
| 9 |
+
{%- set think_end_token = '</mm:think>' -%}
|
| 10 |
+
{%- set image_token = ']<]image[>[' -%}
|
| 11 |
+
{%- set video_token = ']<]video[>[' -%}
|
| 12 |
+
{#- Thinking mode: "enabled" / "disabled" / "adaptive" / not defined -#}
|
| 13 |
+
{#- Recursive XML renderer for tool_call arguments ======================== -#}
|
| 14 |
+
{#- None values are intentionally skipped in mapping iteration so that
|
| 15 |
+
`<key>null</key>` (which would round-trip to the literal string "null")
|
| 16 |
+
never appears in the rendered tool_call. The convention is: omit the
|
| 17 |
+
field entirely. The top-level `_args` loop applies the same rule.
|
| 18 |
+
The `val is none` branch below is a safety net only — upstream cleaning
|
| 19 |
+
(drop_none_in_tool_arguments) should ensure no None ever reaches here. -#}
|
| 20 |
+
{%- macro to_xml(val, ns) -%}
|
| 21 |
+
{%- if val is mapping -%}
|
| 22 |
+
{%- for k, v in val.items() if v is not none -%}
|
| 23 |
+
{{ ns }}<{{ k }}>{{ to_xml(v, ns) }}{{ ns }}</{{ k }}>
|
| 24 |
+
{%- endfor -%}
|
| 25 |
+
{%- elif val is iterable and val is not string -%}
|
| 26 |
+
{%- for item in val -%}
|
| 27 |
+
{{ ns }}<item>{{ to_xml(item, ns) }}{{ ns }}</item>
|
| 28 |
+
{%- endfor -%}
|
| 29 |
+
{%- elif val is none -%}
|
| 30 |
+
{#- Should be unreachable when upstream cleaning is applied. -#}
|
| 31 |
+
{%- elif val is boolean -%}
|
| 32 |
+
{{ val | tojson }}
|
| 33 |
+
{%- else -%}
|
| 34 |
+
{{ val }}
|
| 35 |
+
{%- endif -%}
|
| 36 |
+
{%- endmacro -%}
|
| 37 |
+
{#- Tool Rendering Functions ============================================== -#}
|
| 38 |
+
{%- macro render_tool_namespace(namespace_name, tool_list) -%}
|
| 39 |
+
{%- for tool in tool_list -%}
|
| 40 |
+
<tool>{{ tool.function | tojson(ensure_ascii=False) }}</tool>
|
| 41 |
+
{% endfor -%}
|
| 42 |
+
{%- endmacro -%}
|
| 43 |
+
{%- macro visible_text(content) -%}
|
| 44 |
+
{%- if content is string -%}
|
| 45 |
+
{{ content }}
|
| 46 |
+
{%- elif content is iterable and content is not mapping -%}
|
| 47 |
+
{%- for item in content -%}
|
| 48 |
+
{%- if item is mapping and item.type == 'text' -%}
|
| 49 |
+
{{- item.text }}
|
| 50 |
+
{%- elif item is mapping and item.type == 'image' -%}
|
| 51 |
+
{{- image_token }}
|
| 52 |
+
{%- elif item is mapping and item.type == 'video' -%}
|
| 53 |
+
{{- video_token}}
|
| 54 |
+
{%- elif item is string -%}
|
| 55 |
+
{{- item }}
|
| 56 |
+
{%- endif -%}
|
| 57 |
+
{%- endfor -%}
|
| 58 |
+
{%- elif content is none -%}
|
| 59 |
+
{{- '' }}
|
| 60 |
+
{%- else -%}
|
| 61 |
+
{{- content }}
|
| 62 |
+
{%- endif -%}
|
| 63 |
+
{%- endmacro -%}
|
| 64 |
+
{#- System Message Construction ============================================ -#}
|
| 65 |
+
{%- macro build_system_message(system_message) -%}
|
| 66 |
+
{%- if system_message and system_message.content -%}
|
| 67 |
+
{{- visible_text(system_message.content) }}
|
| 68 |
+
{%- else -%}
|
| 69 |
+
{{- 'Your model version is MiniMax-M3, developed by MiniMax. Knowledge cutoff: January 2026. Founded in early 2022, MiniMax is a global AI foundation model company committed to advancing the frontiers of AI towards AGI.' }}
|
| 70 |
+
{%- endif -%}
|
| 71 |
+
|
| 72 |
+
{#- Thinking mode instructions -#}
|
| 73 |
+
{{- '\n\n<thinking_instructions>\n' }}
|
| 74 |
+
{{- 'You have a thinking capability that allows you to reason step by step before responding. When thinking is enabled, wrap your reasoning in ' ~ think_begin_token ~ think_end_token ~ ' tags before your response. When thinking is disabled, begin your response directly after the ' ~ think_end_token ~ ' prefix. When thinking is adaptive, decide on your own whether to think for the current turn.\n' }}
|
| 75 |
+
{%- if thinking_mode is defined -%}
|
| 76 |
+
{%- if thinking_mode == "enabled" -%}
|
| 77 |
+
{{- 'Current thinking mode: enabled. You MUST think step by step before every response, including after receiving function/tool results.\n' }}
|
| 78 |
+
{%- elif thinking_mode == "disabled" -%}
|
| 79 |
+
{{- 'Current thinking mode: disabled. Do not output any thinking process.\n' }}
|
| 80 |
+
{%- elif thinking_mode == "adaptive" -%}
|
| 81 |
+
{{- 'Current thinking mode: adaptive. You are encouraged to think for complex decision-making, multi-step reasoning, or when analyzing function/tool results.\n' }}
|
| 82 |
+
{%- endif -%}
|
| 83 |
+
{%- else -%}
|
| 84 |
+
{{- 'Current thinking mode: adaptive. You are encouraged to think for complex decision-making, multi-step reasoning, or when analyzing function/tool results.\n' }}
|
| 85 |
+
{%- endif -%}
|
| 86 |
+
{{- '</thinking_instructions>' }}
|
| 87 |
+
{%- endmacro -%}
|
| 88 |
+
{%- macro build_developer_message(developer_message) -%}
|
| 89 |
+
{%- if developer_message and developer_message.content -%}
|
| 90 |
+
{{- visible_text(developer_message.content) }}
|
| 91 |
+
{%- else -%}
|
| 92 |
+
{%- if model_identity is not defined -%}
|
| 93 |
+
{%- set model_identity = "You are a helpful assistant." -%}
|
| 94 |
+
{%- endif -%}
|
| 95 |
+
{{- model_identity }}
|
| 96 |
+
{%- endif -%}
|
| 97 |
+
{%- endmacro -%}
|
| 98 |
+
{#- Main Template Logic ================================================= -#}
|
| 99 |
+
{#- Role mapping: root -> system sp (high priority), system/developer -> developer sp (low priority) -#}
|
| 100 |
+
{%- set system_message = none -%}
|
| 101 |
+
{%- set developer_message = none -%}
|
| 102 |
+
{%- set conversation_messages = messages -%}
|
| 103 |
+
{%- if messages and messages[0].role == "root" -%}
|
| 104 |
+
{%- set system_message = messages[0] -%}
|
| 105 |
+
{%- set conversation_messages = messages[1:] -%}
|
| 106 |
+
{%- if conversation_messages and conversation_messages[0].role in ["system", "developer"] -%}
|
| 107 |
+
{%- set developer_message = conversation_messages[0] -%}
|
| 108 |
+
{%- set conversation_messages = conversation_messages[1:] -%}
|
| 109 |
+
{%- endif -%}
|
| 110 |
+
{%- elif messages and messages[0].role in ["system", "developer"] -%}
|
| 111 |
+
{%- set developer_message = messages[0] -%}
|
| 112 |
+
{%- set conversation_messages = messages[1:] -%}
|
| 113 |
+
{%- endif -%}
|
| 114 |
+
{#- Render system sp (higher priority, root role only) -#}
|
| 115 |
+
{{- bod_token ~ bos_token ~ 'system' ~ '\n' }}
|
| 116 |
+
{{- build_system_message(system_message) }}
|
| 117 |
+
{{- eos_token ~ '\n' }}
|
| 118 |
+
|
| 119 |
+
{#- Render developer sp (lower priority: system/developer role + tools) -#}
|
| 120 |
+
{{- bos_token ~ 'developer' ~ '\n' }}
|
| 121 |
+
{{- build_developer_message(developer_message) }}
|
| 122 |
+
{%- if tools -%}
|
| 123 |
+
{{- '\n\n' ~ '# Tools' ~ '\n' ~ 'You may call one or more tools to assist with the user query.\nHere are the tools available in JSONSchema format:' ~ '\n' }}
|
| 124 |
+
{{- '\n' ~ '<tools>' ~ '\n' }}
|
| 125 |
+
{{- render_tool_namespace("functions", tools) }}
|
| 126 |
+
{{- '</tools>' ~ '\n\n' }}
|
| 127 |
+
{{- 'To call tools, wrap all invocations in a single ' ~ toolcall_begin_token ~ toolcall_end_token ~ ' block. Parameter values containing nested objects or arrays are recursively expanded into XML elements. Example:\n' }}
|
| 128 |
+
{{- '\n' ~ toolcall_begin_token ~ '\n' }}
|
| 129 |
+
{{- ns_token + '<invoke name="tool-name-1">' }}
|
| 130 |
+
{{- ns_token + '<param-1>value-1' + ns_token + '</param-1>' }}
|
| 131 |
+
{{- ns_token + '<param-2>' }}
|
| 132 |
+
{{- ns_token + '<item>' }}
|
| 133 |
+
{{- ns_token + '<key-a>val-a' + ns_token + '</key-a>' }}
|
| 134 |
+
{{- ns_token + '<key-b>val-b' + ns_token + '</key-b>' }}
|
| 135 |
+
{{- ns_token + '</item>' }}
|
| 136 |
+
{{- ns_token + '</param-2>' }}
|
| 137 |
+
{{- ns_token + '</invoke>\n' }}
|
| 138 |
+
{{- ns_token + '<invoke name="tool-name-2">' }}
|
| 139 |
+
{{- ns_token + '<param-1>value-1' + ns_token + '</param-1>' }}
|
| 140 |
+
{{- ns_token + '</invoke>\n' }}
|
| 141 |
+
{{- toolcall_end_token }}
|
| 142 |
+
{%- endif -%}
|
| 143 |
+
{{- eos_token ~ '\n' }}
|
| 144 |
+
|
| 145 |
+
{#- Render messages -#}
|
| 146 |
+
{%- set last_tool_call = namespace(name=none) -%}
|
| 147 |
+
{%- for message in conversation_messages -%}
|
| 148 |
+
{%- if message.role == 'assistant' -%}
|
| 149 |
+
{{- bos_token ~ 'ai' ~ '\n' }}
|
| 150 |
+
|
| 151 |
+
{%- set reasoning_content = '' %}
|
| 152 |
+
{%- set content = visible_text(message.content) %}
|
| 153 |
+
{%- if message.reasoning_content is string %}
|
| 154 |
+
{%- set reasoning_content = message.reasoning_content %}
|
| 155 |
+
{%- else %}
|
| 156 |
+
{%- if think_end_token in content %}
|
| 157 |
+
{%- set reasoning_content = content.split(think_end_token)[0].strip('\n').split(think_begin_token)[-1].strip('\n') %}
|
| 158 |
+
{%- set content = content.split(think_end_token)[-1].strip('\n') %}
|
| 159 |
+
{%- endif %}
|
| 160 |
+
{%- endif %}
|
| 161 |
+
|
| 162 |
+
{%- if reasoning_content -%}
|
| 163 |
+
{#- Render thinking for every assistant turn (all-turn visible) -#}
|
| 164 |
+
{{- think_begin_token ~ reasoning_content ~ think_end_token }}
|
| 165 |
+
{%- else -%}
|
| 166 |
+
{#- No thinking rendered → prefix with think_end_token -#}
|
| 167 |
+
{{- think_end_token }}
|
| 168 |
+
{%- endif -%}
|
| 169 |
+
|
| 170 |
+
{%- if content -%}
|
| 171 |
+
{{- content }}
|
| 172 |
+
{%- endif -%}
|
| 173 |
+
{%- if message.tool_calls -%}
|
| 174 |
+
{{- toolcall_begin_token ~ '\n' }}
|
| 175 |
+
|
| 176 |
+
{%- for tool_call in message.tool_calls -%}
|
| 177 |
+
{%- if tool_call.function -%}
|
| 178 |
+
{%- set tool_call = tool_call.function -%}
|
| 179 |
+
{%- endif -%}
|
| 180 |
+
{{- ns_token + '<invoke name="' + tool_call.name + '">' }}
|
| 181 |
+
{%- set _args = tool_call.arguments -%}
|
| 182 |
+
{%- for k, v in _args.items() if v is not none %}
|
| 183 |
+
{{- ns_token + '<' + k + '>' -}}
|
| 184 |
+
{{- to_xml(v, ns_token) -}}
|
| 185 |
+
{{- ns_token + '</' + k + '>' }}
|
| 186 |
+
{%- endfor -%}
|
| 187 |
+
{{- ns_token + '</invoke>' ~ '\n' }}
|
| 188 |
+
{%- endfor -%}
|
| 189 |
+
|
| 190 |
+
{{- toolcall_end_token }}
|
| 191 |
+
{%- if message.tool_calls[-1].function -%}
|
| 192 |
+
{%- set last_tool_call.name = message.tool_calls[-1].function.name -%}
|
| 193 |
+
{%- else -%}
|
| 194 |
+
{%- set last_tool_call.name = message.tool_calls[-1].name -%}
|
| 195 |
+
{%- endif -%}
|
| 196 |
+
{%- else -%}
|
| 197 |
+
{%- set last_tool_call.name = none -%}
|
| 198 |
+
{%- endif -%}
|
| 199 |
+
{{- eos_token ~ '\n' }}
|
| 200 |
+
|
| 201 |
+
{%- elif message.role == 'tool' -%}
|
| 202 |
+
{%- if last_tool_call.name is none -%}
|
| 203 |
+
{{- raise_exception("Message has tool role, but there was no previous assistant message with a tool call!") }}
|
| 204 |
+
{%- endif -%}
|
| 205 |
+
{%- if loop.first or (conversation_messages[loop.index0 - 1].role != 'tool') -%}
|
| 206 |
+
{{- bos_token ~ 'tool' }}
|
| 207 |
+
{%- endif -%}
|
| 208 |
+
{{- '\n<response>' }}
|
| 209 |
+
{%- if message.content is string -%}
|
| 210 |
+
{{- message.content }}
|
| 211 |
+
{%- else -%}
|
| 212 |
+
{%- for tr in message.content -%}
|
| 213 |
+
{%- if tr is mapping and tr.type is defined and tr.type == 'image' -%}
|
| 214 |
+
{{- image_token }}
|
| 215 |
+
{%- elif tr is mapping and tr.type is defined and tr.type == 'video' -%}
|
| 216 |
+
{{- video_token }}
|
| 217 |
+
{%- else -%}
|
| 218 |
+
{{- tr.output if tr.output is defined else (tr.text if tr.type == 'text' and tr.text is defined else tr) }}
|
| 219 |
+
{%- endif -%}
|
| 220 |
+
{%- endfor -%}
|
| 221 |
+
{%- endif -%}
|
| 222 |
+
{{- '</response>' }}
|
| 223 |
+
{%- if loop.last or (conversation_messages[loop.index0 + 1].role != 'tool') -%}
|
| 224 |
+
{{- eos_token ~ '\n' -}}
|
| 225 |
+
{%- endif -%}
|
| 226 |
+
|
| 227 |
+
{%- elif message.role == 'user' -%}
|
| 228 |
+
{{- bos_token ~ 'user' ~ '\n' }}
|
| 229 |
+
{{- visible_text(message.content) }}
|
| 230 |
+
{{- eos_token ~ '\n' }}
|
| 231 |
+
{%- endif -%}
|
| 232 |
+
{%- endfor -%}
|
| 233 |
+
|
| 234 |
+
{#- Generation prompt -#}
|
| 235 |
+
{%- if add_generation_prompt -%}
|
| 236 |
+
{{- bos_token ~ 'ai' ~ '\n' }}
|
| 237 |
+
{%- if thinking_mode is defined and thinking_mode == "disabled" -%}
|
| 238 |
+
{{- think_end_token }}
|
| 239 |
+
{%- elif thinking_mode is defined and thinking_mode == "adaptive" -%}
|
| 240 |
+
{#- adaptive: no prefix, let model decide -#}
|
| 241 |
+
{%- elif thinking_mode is defined and thinking_mode == "enabled" -%}
|
| 242 |
+
{#- enabled or not defined: default to think -#}
|
| 243 |
+
{{- think_begin_token }}
|
| 244 |
+
{%- else -%}
|
| 245 |
+
{#- adaptive: no prefix, let model decide -#}
|
| 246 |
+
{%- endif -%}
|
| 247 |
+
{%- endif -%}
|
config.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
configuration_minimax_m3_vl.py
ADDED
|
@@ -0,0 +1,111 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
"""HuggingFace configs for the MiniMax VL family (M2 VL / M3 VL).
|
| 2 |
+
|
| 3 |
+
This file is bundled into every converted HF checkpoint so that loading via
|
| 4 |
+
``AutoConfig.from_pretrained(..., trust_remote_code=True)`` works without any
|
| 5 |
+
runtime dependency on sglang or other internal packages — only stock
|
| 6 |
+
``transformers`` is required.
|
| 7 |
+
|
| 8 |
+
The class definitions intentionally mirror
|
| 9 |
+
``sglang.srt.configs.minimax_vl``; if either side changes, keep them in sync.
|
| 10 |
+
|
| 11 |
+
The file is named ``configuration_minimax_m3_vl.py`` (matching the legacy
|
| 12 |
+
``model_type="minimax_m3_vl"`` and the converter's ``auto_map`` entry) so
|
| 13 |
+
that ckpts produced by this converter remain loadable by older sglang versions
|
| 14 |
+
that only know the ``MiniMaxM3VL*`` names. The canonical class is
|
| 15 |
+
``MiniMaxM3VLConfig``; ``MiniMaxM3VLConfig`` is a thin BC alias whose only
|
| 16 |
+
purpose is to be referenced from ``auto_map``.
|
| 17 |
+
"""
|
| 18 |
+
|
| 19 |
+
from typing import Optional
|
| 20 |
+
|
| 21 |
+
from transformers.configuration_utils import PretrainedConfig
|
| 22 |
+
from transformers.models.auto import CONFIG_MAPPING
|
| 23 |
+
|
| 24 |
+
|
| 25 |
+
def _coerce_sub_config(
|
| 26 |
+
sub_config: Optional[dict], default_model_type: str
|
| 27 |
+
) -> Optional[PretrainedConfig]:
|
| 28 |
+
"""Convert a config dict to a ``PretrainedConfig`` instance.
|
| 29 |
+
|
| 30 |
+
If ``model_type`` is registered in HF ``CONFIG_MAPPING`` the corresponding
|
| 31 |
+
config class is used; otherwise we fall back to a generic
|
| 32 |
+
``PretrainedConfig`` so all dict keys still become real attributes (M3's
|
| 33 |
+
text backbone uses ``model_type="minimax_m2"`` which is not in
|
| 34 |
+
``CONFIG_MAPPING``).
|
| 35 |
+
"""
|
| 36 |
+
if not isinstance(sub_config, dict):
|
| 37 |
+
return sub_config
|
| 38 |
+
model_type = sub_config.get("model_type", default_model_type)
|
| 39 |
+
cls = CONFIG_MAPPING.get(model_type, PretrainedConfig)
|
| 40 |
+
return cls(**sub_config)
|
| 41 |
+
|
| 42 |
+
|
| 43 |
+
class MiniMaxVLBaseConfig(PretrainedConfig):
|
| 44 |
+
"""Base config shared by every MiniMax VL variant.
|
| 45 |
+
|
| 46 |
+
Handles vision/text sub-config coercion. Concrete subclasses only need to
|
| 47 |
+
declare a unique ``model_type`` string.
|
| 48 |
+
"""
|
| 49 |
+
|
| 50 |
+
def __init__(
|
| 51 |
+
self,
|
| 52 |
+
vision_config: Optional[dict] = None,
|
| 53 |
+
text_config: Optional[dict] = None,
|
| 54 |
+
image_token_index: int = 200025,
|
| 55 |
+
video_token_index: int = 200026,
|
| 56 |
+
image_seq_length: int = 576,
|
| 57 |
+
process_image_mode: str = "dynamic_res",
|
| 58 |
+
projector_hidden_act: str = "gelu",
|
| 59 |
+
multimodal_projector_bias: bool = True,
|
| 60 |
+
vision_feature_layer: int = -1,
|
| 61 |
+
vision_feature_select_strategy: str = "full",
|
| 62 |
+
img_token_compression_config: Optional[dict] = None,
|
| 63 |
+
image_grid_pinpoints: Optional[str] = None,
|
| 64 |
+
**kwargs,
|
| 65 |
+
):
|
| 66 |
+
self.vision_config = _coerce_sub_config(vision_config, "clip_vision_model")
|
| 67 |
+
self.text_config = _coerce_sub_config(text_config, "mixtral")
|
| 68 |
+
|
| 69 |
+
self.image_token_index = image_token_index
|
| 70 |
+
self.video_token_index = video_token_index
|
| 71 |
+
self.image_seq_length = image_seq_length
|
| 72 |
+
self.process_image_mode = process_image_mode
|
| 73 |
+
self.projector_hidden_act = projector_hidden_act
|
| 74 |
+
self.multimodal_projector_bias = multimodal_projector_bias
|
| 75 |
+
self.vision_feature_layer = vision_feature_layer
|
| 76 |
+
self.vision_feature_select_strategy = vision_feature_select_strategy
|
| 77 |
+
self.img_token_compression_config = img_token_compression_config or {}
|
| 78 |
+
self.image_grid_pinpoints = image_grid_pinpoints
|
| 79 |
+
|
| 80 |
+
super().__init__(**kwargs)
|
| 81 |
+
|
| 82 |
+
def __post_init__(self, **kwargs):
|
| 83 |
+
super().__post_init__(**kwargs)
|
| 84 |
+
if hasattr(self, "vision_config"):
|
| 85 |
+
self.vision_config = _coerce_sub_config(self.vision_config, "clip_vision_model")
|
| 86 |
+
if hasattr(self, "text_config"):
|
| 87 |
+
self.text_config = _coerce_sub_config(self.text_config, "mixtral")
|
| 88 |
+
|
| 89 |
+
|
| 90 |
+
class MiniMaxM2VLConfig(MiniMaxVLBaseConfig):
|
| 91 |
+
"""MiniMax M2 VL: vision tower + M2 (Mixtral-style MoE) text backbone."""
|
| 92 |
+
|
| 93 |
+
model_type = "minimax_m2_vl"
|
| 94 |
+
|
| 95 |
+
|
| 96 |
+
class MiniMaxM3VLConfig(MiniMaxVLBaseConfig):
|
| 97 |
+
"""MiniMax M3 VL: vision tower + M3 (mixed sparse/dense MoE) text backbone."""
|
| 98 |
+
|
| 99 |
+
model_type = "minimax_m3_vl"
|
| 100 |
+
|
| 101 |
+
|
| 102 |
+
class MiniMaxM2MiniVLConfig(MiniMaxM2VLConfig):
|
| 103 |
+
"""Legacy alias kept so old ``model_type="minimax_m2_mini_vl"`` ckpts load."""
|
| 104 |
+
|
| 105 |
+
model_type = "minimax_m2_mini_vl"
|
| 106 |
+
|
| 107 |
+
|
| 108 |
+
class MiniMaxM3VLConfig(MiniMaxM3VLConfig):
|
| 109 |
+
"""Legacy alias kept so old ``model_type="minimax_m3_vl"`` ckpts load."""
|
| 110 |
+
|
| 111 |
+
model_type = "minimax_m3_vl"
|
generation_config.json
ADDED
|
@@ -0,0 +1,8 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"bos_token_id": 200019,
|
| 3 |
+
"do_sample": true,
|
| 4 |
+
"eos_token_id": 200020,
|
| 5 |
+
"temperature": 1.0,
|
| 6 |
+
"top_p": 0.95,
|
| 7 |
+
"transformers_version": "4.46.1"
|
| 8 |
+
}
|
hf_quant_config.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
image_processor.py
ADDED
|
@@ -0,0 +1,223 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Copyright 2023-2024 SGLang Team
|
| 2 |
+
# Licensed under the Apache License, Version 2.0 (the "License");
|
| 3 |
+
"""
|
| 4 |
+
MiniMax VL family HuggingFace-compatible Processor, ImageProcessor, VideoProcessor.
|
| 5 |
+
"""
|
| 6 |
+
import math
|
| 7 |
+
from typing import List, Tuple
|
| 8 |
+
|
| 9 |
+
import torch
|
| 10 |
+
from torchvision.transforms import InterpolationMode
|
| 11 |
+
from transformers import BatchFeature
|
| 12 |
+
from transformers.image_processing_utils_fast import (
|
| 13 |
+
BaseImageProcessorFast,
|
| 14 |
+
group_images_by_shape,
|
| 15 |
+
reorder_images,
|
| 16 |
+
)
|
| 17 |
+
from transformers.image_utils import PILImageResampling, SizeDict
|
| 18 |
+
from transformers.processing_utils import (
|
| 19 |
+
ImagesKwargs,
|
| 20 |
+
Unpack,
|
| 21 |
+
)
|
| 22 |
+
from transformers.utils import TensorType
|
| 23 |
+
|
| 24 |
+
MAX_RATIO = 200
|
| 25 |
+
|
| 26 |
+
|
| 27 |
+
def round_by_factor(number: int, factor: int) -> int:
|
| 28 |
+
return round(number / factor) * factor
|
| 29 |
+
|
| 30 |
+
|
| 31 |
+
def ceil_by_factor(number: int, factor: int) -> int:
|
| 32 |
+
return math.ceil(number / factor) * factor
|
| 33 |
+
|
| 34 |
+
|
| 35 |
+
def floor_by_factor(number: int, factor: int) -> int:
|
| 36 |
+
return math.floor(number / factor) * factor
|
| 37 |
+
|
| 38 |
+
|
| 39 |
+
def smart_resize(
|
| 40 |
+
height: int,
|
| 41 |
+
width: int,
|
| 42 |
+
factor: int = 28,
|
| 43 |
+
min_pixels: int = 4 * 28 * 28,
|
| 44 |
+
max_pixels: int = 451584,
|
| 45 |
+
) -> tuple[int, int]:
|
| 46 |
+
if max(height, width) / min(height, width) > MAX_RATIO:
|
| 47 |
+
raise ValueError(
|
| 48 |
+
f"absolute aspect ratio must be smaller than {MAX_RATIO}, "
|
| 49 |
+
f"got {max(height, width) / min(height, width)}"
|
| 50 |
+
)
|
| 51 |
+
h_bar = max(factor, round_by_factor(height, factor))
|
| 52 |
+
w_bar = max(factor, round_by_factor(width, factor))
|
| 53 |
+
if h_bar * w_bar > max_pixels:
|
| 54 |
+
beta = math.sqrt((height * width) / max_pixels)
|
| 55 |
+
h_bar = floor_by_factor(height / beta, factor)
|
| 56 |
+
w_bar = floor_by_factor(width / beta, factor)
|
| 57 |
+
elif h_bar * w_bar < min_pixels:
|
| 58 |
+
beta = math.sqrt(min_pixels / (height * width))
|
| 59 |
+
h_bar = ceil_by_factor(height * beta, factor)
|
| 60 |
+
w_bar = ceil_by_factor(width * beta, factor)
|
| 61 |
+
return h_bar, w_bar
|
| 62 |
+
|
| 63 |
+
|
| 64 |
+
# ==============================================================================
|
| 65 |
+
# MiniMax M3 VL Image Processor Fast (Fast Mode - Torch based)
|
| 66 |
+
# ==============================================================================
|
| 67 |
+
|
| 68 |
+
|
| 69 |
+
class MiniMaxM3VLImageProcessorKwargs(ImagesKwargs, total=False):
|
| 70 |
+
patch_size: int
|
| 71 |
+
temporal_patch_size: int
|
| 72 |
+
merge_size: int
|
| 73 |
+
max_pixels: int
|
| 74 |
+
|
| 75 |
+
|
| 76 |
+
class MiniMaxM3VLImageProcessor(BaseImageProcessorFast):
|
| 77 |
+
do_resize = True
|
| 78 |
+
resample = PILImageResampling.BICUBIC
|
| 79 |
+
size = {"height": 672, "width": 672} # required by base class validation, not used as resize bound
|
| 80 |
+
default_to_square = False
|
| 81 |
+
do_rescale = True
|
| 82 |
+
rescale_factor = 1 / 255
|
| 83 |
+
do_normalize = True
|
| 84 |
+
image_mean = [0.48145466, 0.4578275, 0.40821073]
|
| 85 |
+
image_std = [0.26862954, 0.26130258, 0.27577711]
|
| 86 |
+
do_convert_rgb = True
|
| 87 |
+
patch_size = 14
|
| 88 |
+
temporal_patch_size = 2
|
| 89 |
+
merge_size = 2
|
| 90 |
+
max_pixels = 451584 # 672*672
|
| 91 |
+
valid_kwargs = MiniMaxM3VLImageProcessorKwargs
|
| 92 |
+
model_input_names = ["pixel_values", "image_grid_thw"]
|
| 93 |
+
|
| 94 |
+
def __init__(self, **kwargs: Unpack[MiniMaxM3VLImageProcessorKwargs]):
|
| 95 |
+
super().__init__(**kwargs)
|
| 96 |
+
|
| 97 |
+
def preprocess(
|
| 98 |
+
self, images, **kwargs: Unpack[MiniMaxM3VLImageProcessorKwargs]
|
| 99 |
+
) -> BatchFeature:
|
| 100 |
+
return super().preprocess(images, **kwargs)
|
| 101 |
+
|
| 102 |
+
def _preprocess(
|
| 103 |
+
self,
|
| 104 |
+
images: List[torch.Tensor],
|
| 105 |
+
do_resize: bool,
|
| 106 |
+
size: SizeDict,
|
| 107 |
+
resample: PILImageResampling | InterpolationMode | int | None,
|
| 108 |
+
do_rescale: bool,
|
| 109 |
+
rescale_factor: float,
|
| 110 |
+
do_normalize: bool,
|
| 111 |
+
image_mean: float | List[float] | None,
|
| 112 |
+
image_std: float | List[float] | None,
|
| 113 |
+
patch_size: int,
|
| 114 |
+
temporal_patch_size: int,
|
| 115 |
+
merge_size: int,
|
| 116 |
+
max_pixels: int,
|
| 117 |
+
disable_grouping: bool | None,
|
| 118 |
+
return_tensors: str | TensorType | None,
|
| 119 |
+
**kwargs,
|
| 120 |
+
) -> BatchFeature:
|
| 121 |
+
grouped_images, grouped_images_index = group_images_by_shape(
|
| 122 |
+
images, disable_grouping=disable_grouping
|
| 123 |
+
)
|
| 124 |
+
resized_images_grouped = {}
|
| 125 |
+
factor = patch_size * merge_size
|
| 126 |
+
for shape, stacked_images in grouped_images.items():
|
| 127 |
+
height, width = stacked_images.shape[-2:]
|
| 128 |
+
if do_resize:
|
| 129 |
+
resized_height, resized_width = smart_resize(
|
| 130 |
+
height, width, factor=factor,
|
| 131 |
+
max_pixels=max_pixels,
|
| 132 |
+
)
|
| 133 |
+
stacked_images = self.resize(
|
| 134 |
+
stacked_images,
|
| 135 |
+
size=SizeDict(height=resized_height, width=resized_width),
|
| 136 |
+
resample=resample,
|
| 137 |
+
)
|
| 138 |
+
resized_images_grouped[shape] = stacked_images
|
| 139 |
+
|
| 140 |
+
resized_images = reorder_images(resized_images_grouped, grouped_images_index)
|
| 141 |
+
|
| 142 |
+
grouped_images, grouped_images_index = group_images_by_shape(
|
| 143 |
+
resized_images, disable_grouping=disable_grouping
|
| 144 |
+
)
|
| 145 |
+
processed_images_grouped = {}
|
| 146 |
+
processed_grids = {}
|
| 147 |
+
|
| 148 |
+
for shape, stacked_images in grouped_images.items():
|
| 149 |
+
resized_height, resized_width = stacked_images.shape[-2:]
|
| 150 |
+
|
| 151 |
+
patches = self.rescale_and_normalize(
|
| 152 |
+
stacked_images,
|
| 153 |
+
do_rescale,
|
| 154 |
+
rescale_factor,
|
| 155 |
+
do_normalize,
|
| 156 |
+
image_mean,
|
| 157 |
+
image_std,
|
| 158 |
+
)
|
| 159 |
+
if patches.ndim == 4:
|
| 160 |
+
patches = patches.unsqueeze(1)
|
| 161 |
+
|
| 162 |
+
if patches.shape[1] % temporal_patch_size != 0:
|
| 163 |
+
repeats = patches[:, -1:].repeat(
|
| 164 |
+
1,
|
| 165 |
+
temporal_patch_size - (patches.shape[1] % temporal_patch_size),
|
| 166 |
+
1,
|
| 167 |
+
1,
|
| 168 |
+
1,
|
| 169 |
+
)
|
| 170 |
+
patches = torch.cat([patches, repeats], dim=1)
|
| 171 |
+
|
| 172 |
+
batch_size, grid_t, channel = patches.shape[:3]
|
| 173 |
+
grid_t = grid_t // temporal_patch_size
|
| 174 |
+
grid_h, grid_w = resized_height // patch_size, resized_width // patch_size
|
| 175 |
+
|
| 176 |
+
patches = patches.view(
|
| 177 |
+
batch_size,
|
| 178 |
+
grid_t,
|
| 179 |
+
temporal_patch_size,
|
| 180 |
+
channel,
|
| 181 |
+
grid_h // merge_size,
|
| 182 |
+
merge_size,
|
| 183 |
+
patch_size,
|
| 184 |
+
grid_w // merge_size,
|
| 185 |
+
merge_size,
|
| 186 |
+
patch_size,
|
| 187 |
+
)
|
| 188 |
+
patches = patches.permute(0, 1, 4, 7, 5, 8, 3, 2, 6, 9)
|
| 189 |
+
|
| 190 |
+
flatten_patches = patches.reshape(
|
| 191 |
+
batch_size,
|
| 192 |
+
grid_t * grid_h * grid_w,
|
| 193 |
+
channel * temporal_patch_size * patch_size * patch_size,
|
| 194 |
+
)
|
| 195 |
+
|
| 196 |
+
processed_images_grouped[shape] = flatten_patches
|
| 197 |
+
processed_grids[shape] = [[grid_t, grid_h, grid_w]] * batch_size
|
| 198 |
+
|
| 199 |
+
processed_images = reorder_images(
|
| 200 |
+
processed_images_grouped, grouped_images_index
|
| 201 |
+
)
|
| 202 |
+
processed_grids = reorder_images(processed_grids, grouped_images_index)
|
| 203 |
+
|
| 204 |
+
pixel_values = torch.cat(processed_images, dim=0)
|
| 205 |
+
image_grid_thw = torch.tensor(processed_grids, dtype=torch.long)
|
| 206 |
+
|
| 207 |
+
return BatchFeature(
|
| 208 |
+
data={"pixel_values": pixel_values, "image_grid_thw": image_grid_thw},
|
| 209 |
+
tensor_type=return_tensors,
|
| 210 |
+
)
|
| 211 |
+
|
| 212 |
+
def get_number_of_image_patches(self, height: int, width: int, images_kwargs=None):
|
| 213 |
+
images_kwargs = images_kwargs or {}
|
| 214 |
+
patch_size = images_kwargs.get("patch_size", self.patch_size)
|
| 215 |
+
merge_size = images_kwargs.get("merge_size", self.merge_size)
|
| 216 |
+
max_pixels = images_kwargs.get("max_pixels", self.max_pixels)
|
| 217 |
+
|
| 218 |
+
resized_height, resized_width = smart_resize(
|
| 219 |
+
height, width, factor=patch_size * merge_size,
|
| 220 |
+
max_pixels=max_pixels,
|
| 221 |
+
)
|
| 222 |
+
grid_h, grid_w = resized_height // patch_size, resized_width // patch_size
|
| 223 |
+
return grid_h * grid_w
|
merges.txt
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
model-00001-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:292ffab60e057ba7404af6fe47518871f8bb893c1c8f2ab46e4c4fe15a5c6332
|
| 3 |
+
size 5948470800
|
model-00002-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ad8509faf17ed7cec8b6f6d76677b1ac10b34b35fca4f11927d138281f6db97f
|
| 3 |
+
size 351840912
|
model-00003-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7f9d2fb02eb91b722ad44acb7f67210614b2be23d4587db4ad61cf56a8bcbf09
|
| 3 |
+
size 351840912
|
model-00004-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d15884ebb8d064dd6c8acd8bbdb9191340aebd20216412ee0b1afd704c78fcd6
|
| 3 |
+
size 351840296
|
model-00005-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ca5ed52e6f7688d62c2f28eb12e1d0657fac15ca01cb4f1e23df9e34ce50fe5e
|
| 3 |
+
size 351840944
|
model-00006-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cd0055cb216195c29bd924316bb8dbd0c9bcf13783de1aa77de35b4828080d8d
|
| 3 |
+
size 351840296
|
model-00007-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:310adf81b8912a453bef500e88fc1447ec5a569edb78e75ab5f542e1d66203fc
|
| 3 |
+
size 351840328
|
model-00008-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a3be739b0b84c80e310612c343dac040330319430cbe53ba1b4fb0480201b622
|
| 3 |
+
size 351840328
|
model-00009-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:436c24fe37fc3645e514e7ccadb0d3b5bb3e18c83425bccc0bd629f07528707d
|
| 3 |
+
size 351840328
|
model-00010-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:465f5b2f83f0b5bfae7fc95968b0fcd315b5eee5a2c046079cbeba815b608574
|
| 3 |
+
size 351840328
|
model-00011-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fce23fa3013cc08cf3402689710c0129bbf3ccfdeda378e973c20ca5511e6427
|
| 3 |
+
size 351840328
|
model-00012-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1600d58eccaa8f7e4545b98e8b3d749bed6b41e83b8cbe8f835e9a1531f071a4
|
| 3 |
+
size 351840328
|
model-00013-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:767c84494f649ef19062ed3c76579be95229c69aa2b9ab084f0e09941b183a56
|
| 3 |
+
size 351840328
|
model-00014-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e452875426ec6df9fa31bcbf45e4d4fd54ecce21a3cde50ef1fc673b083aaf42
|
| 3 |
+
size 351840328
|
model-00015-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:88dcb66b1518d32dd4737693c35c116f9c5ed53ca09180988e33a2f2b5ee04dd
|
| 3 |
+
size 351840328
|
model-00016-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b6f2b74a3ff1b16941bd7c085b391b8b2cad87c7f42dda4d1437e03aa944609a
|
| 3 |
+
size 351840328
|
model-00017-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3f550ee2185ffd8e4a97d7188b71718cf0cb8cf5d02b5f015158cff706ec5407
|
| 3 |
+
size 351840328
|
model-00018-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:da3b068a0a1c34d4c77dbdc9b2af09b71c4e777ff94b03998422181100fdeb51
|
| 3 |
+
size 351840328
|
model-00019-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9e6a078f96d5ee01d6027d67216ad05bae32977aaba35307ef94d52dc3f07efa
|
| 3 |
+
size 351840328
|
model-00020-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4cfeea333a12b446176de8a3c53096f46b09e81c95e231d1b6f4612b64f8df95
|
| 3 |
+
size 351840328
|
model-00021-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:45f62b14a7d9bf2971fea19dc418681f9b72874101aeaf2982fce66e99401410
|
| 3 |
+
size 351840328
|
model-00022-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4d2edf9511362648c335278d9c1fa79e9437e0c9bb73910ee2f47455b9b20a10
|
| 3 |
+
size 351840328
|
model-00023-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ab5987204e3535c8c6500543ec52b505df440845af585cccb5325f5d3e755442
|
| 3 |
+
size 351840328
|
model-00024-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b4d467ae709a5ec7e6f43ffbd063d5dee75138465eae00d166e223c9bcde5293
|
| 3 |
+
size 351840328
|
model-00025-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b35ed4f04baa3a09fbdacb1f2ac09bfe5b8de876cb2bce1df352485ba73b5f87
|
| 3 |
+
size 351840328
|
model-00026-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0473995187d8d404873f790999140e272462daeed18af5bc01eab588b11ab195
|
| 3 |
+
size 351840328
|
model-00027-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c13a5b601335bfef10903e7b5dcd90496dbcf29aebd051293d5c3e63d4444449
|
| 3 |
+
size 351840328
|
model-00028-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ea60a857aa6ad6b06344716ecd8db30abcad4bd861a9e6ebd9568c6f91bf2932
|
| 3 |
+
size 175919512
|
model-00029-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8a7cd317adbc9978a96e73c6fff4d7af6ab0d0a3c70e710a75b0727067da4a17
|
| 3 |
+
size 2086056424
|
model-00030-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b5d1ceeaa6d620a172cdc2dd9dff7719a6bfd920aa96a955465c6ef7c4b2b2f9
|
| 3 |
+
size 175919512
|
model-00031-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:442118e2b7062a51a693e33a9fc2e05b3122dc31048915025437178f5df7006c
|
| 3 |
+
size 175919512
|
model-00032-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b1c84470fdd206bd55dca32233c087d3509673659b8012eb100eba2254750b4d
|
| 3 |
+
size 4077079816
|
model-00033-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8abd151706d3df6c78b8314e249717e069ecc45ed455e7957dd4f484a6569511
|
| 3 |
+
size 4077079816
|
model-00034-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5bd08e3597999cac083542994925eef27c18f79f2bd612d0ee04f05697949c8b
|
| 3 |
+
size 4077079816
|
model-00035-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c4b62767ceeaafd5a25744695868a75d36475a1c66f0768c8e50bd6ce572bfb1
|
| 3 |
+
size 4077079816
|
model-00036-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4d6ea5920eb315846aece05fa02332975f8d99843824b2955b649dd3d6d3f7a5
|
| 3 |
+
size 4077079816
|
model-00037-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:db4ad874b205ac1b78d3022f094a5f747b19e4dab3750ecbc68c4ccffdf98759
|
| 3 |
+
size 4077079816
|
model-00038-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:33ba4f86763fa974f4f0862495ef13aa83d87a4c7a5b42a3ebba0986662a9dbe
|
| 3 |
+
size 4077079816
|
model-00039-of-00088.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:23f72b6ab48bca0c70acf4e2625b6e86ddf1cf858dca9234731821eda3eee747
|
| 3 |
+
size 4077081352
|