Instructions to use scriptedvn/scriptedvn-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use scriptedvn/scriptedvn-models with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf scriptedvn/scriptedvn-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf scriptedvn/scriptedvn-models:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf scriptedvn/scriptedvn-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf scriptedvn/scriptedvn-models:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf scriptedvn/scriptedvn-models:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf scriptedvn/scriptedvn-models:Q4_K_M
Use Docker
docker model run hf.co/scriptedvn/scriptedvn-models:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use scriptedvn/scriptedvn-models with Ollama:
ollama run hf.co/scriptedvn/scriptedvn-models:Q4_K_M
- Unsloth Desktop
- Pi
How to use scriptedvn/scriptedvn-models with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf scriptedvn/scriptedvn-models:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "scriptedvn/scriptedvn-models:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use scriptedvn/scriptedvn-models with Docker Model Runner:
docker model run hf.co/scriptedvn/scriptedvn-models:Q4_K_M
- Lemonade
How to use scriptedvn/scriptedvn-models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull scriptedvn/scriptedvn-models:Q4_K_M
Run and chat with the model
lemonade run user.scriptedvn-models-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use scriptedvn/scriptedvn-models with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf scriptedvn/scriptedvn-models:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default scriptedvn/scriptedvn-models:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use scriptedvn/scriptedvn-models with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf scriptedvn/scriptedvn-models:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "scriptedvn/scriptedvn-models:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
ScriptedVN models v1 (MADLAD CT2, Hy-MT2 GGUF, Qwen3.5-4B GGUF)
Browse files- .gitattributes +4 -0
- README.md +4 -0
- hymt_1_8b/gguf/Hy-MT2-1.8B-Q4_K_M.gguf +3 -0
- hymt_1_8b/gguf/LICENSE.txt +208 -0
- hymt_1_8b/gguf/README.md +298 -0
- madlad400_3b/LICENSE +202 -0
- madlad400_3b/ct2_int8/config.json +10 -0
- madlad400_3b/ct2_int8/model.bin +3 -0
- madlad400_3b/ct2_int8/runtime_manifest.json +14 -0
- madlad400_3b/ct2_int8/shared_vocabulary.json +0 -0
- madlad400_3b/model/README.md +633 -0
- madlad400_3b/model/added_tokens.json +2 -0
- madlad400_3b/model/config.json +29 -0
- madlad400_3b/model/generation_config.json +7 -0
- madlad400_3b/model/special_tokens_map.json +23 -0
- madlad400_3b/model/spiece.model +3 -0
- madlad400_3b/model/tokenizer.json +3 -0
- madlad400_3b/model/tokenizer_config.json +38 -0
- qwen_3_5_4b_gguf/LICENSE +202 -0
- qwen_3_5_4b_gguf/Qwen3.5-4B-Q4_K_M.gguf +3 -0
- qwen_3_5_4b_gguf/mmproj-F16.gguf +3 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
madlad400_3b/model/tokenizer.json filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
hymt_1_8b/gguf/Hy-MT2-1.8B-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 38 |
+
qwen_3_5_4b_gguf/Qwen3.5-4B-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 39 |
+
qwen_3_5_4b_gguf/mmproj-F16.gguf filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
|
@@ -0,0 +1,4 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# ScriptedVN model files
|
| 2 |
+
|
| 3 |
+
Redistributed, unmodified (or format-converted) open models used by the ScriptedVN desktop app.
|
| 4 |
+
Each folder keeps the original license file. MADLAD-400 3B (Google, Apache-2.0; converted to CTranslate2 int8), Hy-MT2 1.8B (Tencent, Apache-2.0; GGUF Q4_K_M), Qwen3.5-4B (Qwen, Apache-2.0; GGUF Q4_K_M + mmproj).
|
hymt_1_8b/gguf/Hy-MT2-1.8B-Q4_K_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dc5f44fcf1fa496ee7ad725982c0c8c553a4de00259b53af84c4b89fb0c06699
|
| 3 |
+
size 1133080448
|
hymt_1_8b/gguf/LICENSE.txt
ADDED
|
@@ -0,0 +1,208 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Tencent is pleased to support the open-source community by making Hy-MT2-1.8B available.
|
| 2 |
+
|
| 3 |
+
Copyright (C) 2026 Tencent. All rights reserved.
|
| 4 |
+
|
| 5 |
+
Hy-MT2-1.8B is licensed under the Apache License, Version 2.0.
|
| 6 |
+
|
| 7 |
+
--------------------------------------------------------------------
|
| 8 |
+
Apache License
|
| 9 |
+
Version 2.0, January 2004
|
| 10 |
+
http://www.apache.org/licenses/
|
| 11 |
+
|
| 12 |
+
TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
|
| 13 |
+
|
| 14 |
+
1. Definitions.
|
| 15 |
+
|
| 16 |
+
"License" shall mean the terms and conditions for use, reproduction,
|
| 17 |
+
and distribution as defined by Sections 1 through 9 of this document.
|
| 18 |
+
|
| 19 |
+
"Licensor" shall mean the copyright owner or entity authorized by
|
| 20 |
+
the copyright owner that is granting the License.
|
| 21 |
+
|
| 22 |
+
"Legal Entity" shall mean the union of the acting entity and all
|
| 23 |
+
other entities that control, are controlled by, or are under common
|
| 24 |
+
control with that entity. For the purposes of this definition,
|
| 25 |
+
"control" means (i) the power, direct or indirect, to cause the
|
| 26 |
+
direction or management of such entity, whether by contract or
|
| 27 |
+
otherwise, or (ii) ownership of fifty percent (50%) or more of the
|
| 28 |
+
outstanding shares, or (iii) beneficial ownership of such entity.
|
| 29 |
+
|
| 30 |
+
"You" (or "Your") shall mean an individual or Legal Entity
|
| 31 |
+
exercising permissions granted by this License.
|
| 32 |
+
|
| 33 |
+
"Source" form shall mean the preferred form for making modifications,
|
| 34 |
+
including but not limited to software source code, documentation
|
| 35 |
+
source, and configuration files.
|
| 36 |
+
|
| 37 |
+
"Object" form shall mean any form resulting from mechanical
|
| 38 |
+
transformation or translation of a Source form, including but
|
| 39 |
+
not limited to compiled object code, generated documentation,
|
| 40 |
+
and conversions to other media types.
|
| 41 |
+
|
| 42 |
+
"Work" shall mean the work of authorship, whether in Source or
|
| 43 |
+
Object form, made available under the License, as indicated by a
|
| 44 |
+
copyright notice that is included in or attached to the work
|
| 45 |
+
(an example is provided in the Appendix below).
|
| 46 |
+
|
| 47 |
+
"Derivative Works" shall mean any work, whether in Source or Object
|
| 48 |
+
form, that is based on (or derived from) the Work and for which the
|
| 49 |
+
editorial revisions, annotations, elaborations, or other modifications
|
| 50 |
+
represent, as a whole, an original work of authorship. For the purposes
|
| 51 |
+
of this License, Derivative Works shall not include works that remain
|
| 52 |
+
separable from, or merely link (or bind by name) to the interfaces of,
|
| 53 |
+
the Work and Derivative Works thereof.
|
| 54 |
+
|
| 55 |
+
"Contribution" shall mean any work of authorship, including
|
| 56 |
+
the original version of the Work and any modifications or additions
|
| 57 |
+
to that Work or Derivative Works thereof, that is intentionally
|
| 58 |
+
submitted to Licensor for inclusion in the Work by the copyright owner
|
| 59 |
+
or by an individual or Legal Entity authorized to submit on behalf of
|
| 60 |
+
the copyright owner. For the purposes of this definition, "submitted"
|
| 61 |
+
means any form of electronic, verbal, or written communication sent
|
| 62 |
+
to the Licensor or its representatives, including but not limited to
|
| 63 |
+
communication on electronic mailing lists, source code control systems,
|
| 64 |
+
and issue tracking systems that are managed by, or on behalf of, the
|
| 65 |
+
Licensor for the purpose of discussing and improving the Work, but
|
| 66 |
+
excluding communication that is conspicuously marked or otherwise
|
| 67 |
+
designated in writing by the copyright owner as "Not a Contribution."
|
| 68 |
+
|
| 69 |
+
"Contributor" shall mean Licensor and any individual or Legal Entity
|
| 70 |
+
on behalf of whom a Contribution has been received by Licensor and
|
| 71 |
+
subsequently incorporated within the Work.
|
| 72 |
+
|
| 73 |
+
2. Grant of Copyright License. Subject to the terms and conditions of
|
| 74 |
+
this License, each Contributor hereby grants to You a perpetual,
|
| 75 |
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
| 76 |
+
copyright license to reproduce, prepare Derivative Works of,
|
| 77 |
+
publicly display, publicly perform, sublicense, and distribute the
|
| 78 |
+
Work and such Derivative Works in Source or Object form.
|
| 79 |
+
|
| 80 |
+
3. Grant of Patent License. Subject to the terms and conditions of
|
| 81 |
+
this License, each Contributor hereby grants to You a perpetual,
|
| 82 |
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
| 83 |
+
(except as stated in this section) patent license to make, have made,
|
| 84 |
+
use, offer to sell, sell, import, and otherwise transfer the Work,
|
| 85 |
+
where such license applies only to those patent claims licensable
|
| 86 |
+
by such Contributor that are necessarily infringed by their
|
| 87 |
+
Contribution(s) alone or by combination of their Contribution(s)
|
| 88 |
+
with the Work to which such Contribution(s) was submitted. If You
|
| 89 |
+
institute patent litigation against any entity (including a
|
| 90 |
+
cross-claim or counterclaim in a lawsuit) alleging that the Work
|
| 91 |
+
or a Contribution incorporated within the Work constitutes direct
|
| 92 |
+
or contributory patent infringement, then any patent licenses
|
| 93 |
+
granted to You under this License for that Work shall terminate
|
| 94 |
+
as of the date such litigation is filed.
|
| 95 |
+
|
| 96 |
+
4. Redistribution. You may reproduce and distribute copies of the
|
| 97 |
+
Work or Derivative Works thereof in any medium, with or without
|
| 98 |
+
modifications, and in Source or Object form, provided that You
|
| 99 |
+
meet the following conditions:
|
| 100 |
+
|
| 101 |
+
(a) You must give any other recipients of the Work or
|
| 102 |
+
Derivative Works a copy of this License; and
|
| 103 |
+
|
| 104 |
+
(b) You must cause any modified files to carry prominent notices
|
| 105 |
+
stating that You changed the files; and
|
| 106 |
+
|
| 107 |
+
(c) You must retain, in the Source form of any Derivative Works
|
| 108 |
+
that You distribute, all copyright, patent, trademark, and
|
| 109 |
+
attribution notices from the Source form of the Work,
|
| 110 |
+
excluding those notices that do not pertain to any part of
|
| 111 |
+
the Derivative Works; and
|
| 112 |
+
|
| 113 |
+
(d) If the Work includes a "NOTICE" text file as part of its
|
| 114 |
+
distribution, then any Derivative Works that You distribute must
|
| 115 |
+
include a readable copy of the attribution notices contained
|
| 116 |
+
within such NOTICE file, excluding those notices that do not
|
| 117 |
+
pertain to any part of the Derivative Works, in at least one
|
| 118 |
+
of the following places: within a NOTICE text file distributed
|
| 119 |
+
as part of the Derivative Works; within the Source form or
|
| 120 |
+
documentation, if provided along with the Derivative Works; or,
|
| 121 |
+
within a display generated by the Derivative Works, if and
|
| 122 |
+
wherever such third-party notices normally appear. The contents
|
| 123 |
+
of the NOTICE file are for informational purposes only and
|
| 124 |
+
do not modify the License. You may add Your own attribution
|
| 125 |
+
notices within Derivative Works that You distribute, alongside
|
| 126 |
+
or as an addendum to the NOTICE text from the Work, provided
|
| 127 |
+
that such additional attribution notices cannot be construed
|
| 128 |
+
as modifying the License.
|
| 129 |
+
|
| 130 |
+
You may add Your own copyright statement to Your modifications and
|
| 131 |
+
may provide additional or different license terms and conditions
|
| 132 |
+
for use, reproduction, or distribution of Your modifications, or
|
| 133 |
+
for any such Derivative Works as a whole, provided Your use,
|
| 134 |
+
reproduction, and distribution of the Work otherwise complies with
|
| 135 |
+
the conditions stated in this License.
|
| 136 |
+
|
| 137 |
+
5. Submission of Contributions. Unless You explicitly state otherwise,
|
| 138 |
+
any Contribution intentionally submitted for inclusion in the Work
|
| 139 |
+
by You to the Licensor shall be under the terms and conditions of
|
| 140 |
+
this License, without any additional terms or conditions.
|
| 141 |
+
Notwithstanding the above, nothing herein shall supersede or modify
|
| 142 |
+
the terms of any separate license agreement you may have executed
|
| 143 |
+
with Licensor regarding such Contributions.
|
| 144 |
+
|
| 145 |
+
6. Trademarks. This License does not grant permission to use the trade
|
| 146 |
+
names, trademarks, service marks, or product names of the Licensor,
|
| 147 |
+
except as required for reasonable and customary use in describing the
|
| 148 |
+
origin of the Work and reproducing the content of the NOTICE file.
|
| 149 |
+
|
| 150 |
+
7. Disclaimer of Warranty. Unless required by applicable law or
|
| 151 |
+
agreed to in writing, Licensor provides the Work (and each
|
| 152 |
+
Contributor provides its Contributions) on an "AS IS" BASIS,
|
| 153 |
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
|
| 154 |
+
implied, including, without limitation, any warranties or conditions
|
| 155 |
+
of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
|
| 156 |
+
PARTICULAR PURPOSE. You are solely responsible for determining the
|
| 157 |
+
appropriateness of using or redistributing the Work and assume any
|
| 158 |
+
risks associated with Your exercise of permissions under this License.
|
| 159 |
+
|
| 160 |
+
8. Limitation of Liability. In no event and under no legal theory,
|
| 161 |
+
whether in tort (including negligence), contract, or otherwise,
|
| 162 |
+
unless required by applicable law (such as deliberate and grossly
|
| 163 |
+
negligent acts) or agreed to in writing, shall any Contributor be
|
| 164 |
+
liable to You for damages, including any direct, indirect, special,
|
| 165 |
+
incidental, or consequential damages of any character arising as a
|
| 166 |
+
result of this License or out of the use or inability to use the
|
| 167 |
+
Work (including but not limited to damages for loss of goodwill,
|
| 168 |
+
work stoppage, computer failure or malfunction, or any and all
|
| 169 |
+
other commercial damages or losses), even if such Contributor
|
| 170 |
+
has been advised of the possibility of such damages.
|
| 171 |
+
|
| 172 |
+
9. Accepting Warranty or Additional Liability. While redistributing
|
| 173 |
+
the Work or Derivative Works thereof, You may choose to offer,
|
| 174 |
+
and charge a fee for, acceptance of support, warranty, indemnity,
|
| 175 |
+
or other liability obligations and/or rights consistent with this
|
| 176 |
+
License. However, in accepting such obligations, You may act only
|
| 177 |
+
on Your own behalf and on Your sole responsibility, not on behalf
|
| 178 |
+
of any other Contributor, and only if You agree to indemnify,
|
| 179 |
+
defend, and hold each Contributor harmless for any liability
|
| 180 |
+
incurred by, or claims asserted against, such Contributor by reason
|
| 181 |
+
of your accepting any such warranty or additional liability.
|
| 182 |
+
|
| 183 |
+
END OF TERMS AND CONDITIONS
|
| 184 |
+
|
| 185 |
+
APPENDIX: How to apply the Apache License to your work.
|
| 186 |
+
|
| 187 |
+
To apply the Apache License to your work, attach the following
|
| 188 |
+
boilerplate notice, with the fields enclosed by brackets "[]"
|
| 189 |
+
replaced with your own identifying information. (Don't include
|
| 190 |
+
the brackets!) The text should be enclosed in the appropriate
|
| 191 |
+
comment syntax for the file format. We also recommend that a
|
| 192 |
+
file or class name and description of purpose be included on the
|
| 193 |
+
same "printed page" as the copyright notice for easier
|
| 194 |
+
identification within third-party archives.
|
| 195 |
+
|
| 196 |
+
Copyright [yyyy] [name of copyright owner]
|
| 197 |
+
|
| 198 |
+
Licensed under the Apache License, Version 2.0 (the "License");
|
| 199 |
+
you may not use this file except in compliance with the License.
|
| 200 |
+
You may obtain a copy of the License at
|
| 201 |
+
|
| 202 |
+
http://www.apache.org/licenses/LICENSE-2.0
|
| 203 |
+
|
| 204 |
+
Unless required by applicable law or agreed to in writing, software
|
| 205 |
+
distributed under the License is distributed on an "AS IS" BASIS,
|
| 206 |
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
| 207 |
+
See the License for the specific language governing permissions and
|
| 208 |
+
limitations under the License.
|
hymt_1_8b/gguf/README.md
ADDED
|
@@ -0,0 +1,298 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
base_model:
|
| 3 |
+
- tencent/Hy-MT2-1.8B
|
| 4 |
+
license: apache-2.0
|
| 5 |
+
---
|
| 6 |
+
<p align="left">
|
| 7 |
+
English | <a href="Hy-MT2-1.8B-GGUF/blob/main/README_CN.md">中文</a>
|
| 8 |
+
</p>
|
| 9 |
+
<br>
|
| 10 |
+
|
| 11 |
+
<p align="center">
|
| 12 |
+
<img src="imgs/logo-en.png" width="400"/> <br>
|
| 13 |
+
</p>
|
| 14 |
+
|
| 15 |
+
<div align="center" style="line-height: 1;">
|
| 16 |
+
|
| 17 |
+
|
| 18 |
+
[](https://huggingface.co/collections/tencent/hy-mt2)
|
| 19 |
+
|
| 20 |
+
[](https://modelscope.cn/collections/Tencent-Hunyuan/Hy-MT2)
|
| 21 |
+
|
| 22 |
+
</div>
|
| 23 |
+
|
| 24 |
+
<p align="center">
|
| 25 |
+
🖥️ <a href="https://aistudio.tencent.com/llm/en?tabIndex=0"><b>Official Website</b></a> |
|
| 26 |
+
💬 <a href="https://github.com/Tencent-Hunyuan/Hy-MT2"><b>GitHub</b></a> |
|
| 27 |
+
🪡 <a href="https://github.com/Tencent/AngelSlim/tree/main"><b>AngelSlim</b></a> |
|
| 28 |
+
📚 <a href="https://arxiv.org/pdf/2605.22064"><b>Hy-MT2 Report</b></a></p>
|
| 29 |
+
|
| 30 |
+
## Model Introduction
|
| 31 |
+
|
| 32 |
+
|
| 33 |
+
Hy-MT2 is a family of “fast-thinking” multilingual translation models designed for complex real-world scenarios. It includes three model sizes: 1.8B, 7B, and 30B-A3B (MoE), all of which support translation among 33 languages and effectively follow translation instructions in multiple languages.
|
| 34 |
+
For on-device deployment, AngelSlim 1.25-bit extreme quantization reduces the storage requirement of the 1.8B model to only 440 MB and improves inference speed by 1.5x.
|
| 35 |
+
Multi-dimensional evaluations show that Hy-MT2 delivers outstanding performance across general, real-world business, domain-specific, and instruction-following translation tasks. The 7B and 30B-A3B models outperform open-source models such as DeepSeek-V4-Pro and Kimi K2.6 in fast-thinking mode, while the lightweight 1.8B model also surpasses mainstream commercial APIs from providers such as Microsoft and Doubao overall.
|
| 36 |
+
|
| 37 |
+
In this release, we also open-source [IFMTBench](./IFMTBench/README.md), a benchmark for evaluating translation instruction-following capabilities.
|
| 38 |
+
|
| 39 |
+
We also welcome everyone to use our released Hy-MT2-Translator Skill, which makes it easy to integrate Hy-MT2 series models for translation tasks. Download links: [ClawHub](https://clawhub.ai/tencent-adm/hy-mt2-translator-skill) and [SkillHub](https://skillhub.cn/skills/hy-mt2-translator).
|
| 40 |
+
|
| 41 |
+
Now, Tencent Hy is officially partnering with WMT26 for the "Video Subtitle Translation Task" (https://www2.statmt.org/wmt26/video-subtitle-translation.html). Participants who use the Hy-MT model series to compete in the "General Machine Translation Task" (https://www2.statmt.org/wmt26/translation-task.html) and the "Video Subtitle Translation Task" will have the chance to win special awards sponsored by Hunyuan. We sincerely invite everyone to participate and jointly push the boundaries of machine translation technology!
|
| 42 |
+
|
| 43 |
+
## News
|
| 44 |
+
|
| 45 |
+
* 2026.5.21 We open-sourced **Hy-MT2-1.8B**/**Hy-MT2-7B**/**Hy-MT2-30B-A3B**/**IFMTBench** on HuggingFace and ModelScope.
|
| 46 |
+
* 2025.12.30 We open-sourced **HY-MT1.5-1.8B** and **HY-MT1.5-7B** on HuggingFace and ModelScope.
|
| 47 |
+
* 2025.9.1 We open-sourced **Hunyuan-MT-7B** and **Hunyuan-MT-Chimera-7B** on HuggingFace and ModelScope.
|
| 48 |
+
|
| 49 |
+
|
| 50 |
+
## Results
|
| 51 |
+
<div align='center'>
|
| 52 |
+
<img src="imgs/main_result.png" width = "100%" />
|
| 53 |
+
</div>
|
| 54 |
+
|
| 55 |
+
For more experimental results and analysis, please refer to our [report](https://arxiv.org/pdf/2605.22064).
|
| 56 |
+
|
| 57 |
+
|
| 58 |
+
|
| 59 |
+
## Model Links
|
| 60 |
+
| Model Name | Description | Download Link |
|
| 61 |
+
| ----------- | ----------- |-----------
|
| 62 |
+
| Hy-MT2-1.8B | Hy 1.8B translation model |🤗 [Model](https://huggingface.co/tencent/Hy-MT2-1.8B)|
|
| 63 |
+
| Hy-MT2-1.8B-FP8 | Hy 1.8B translation model, FP8 quantization | 🤗 [Model](https://huggingface.co/tencent/Hy-MT2-1.8B-FP8)|
|
| 64 |
+
| Hy-MT2-1.8B-GGUF | Hy 1.8B translation model, llama.cpp | 🤗 [Model](https://huggingface.co/tencent/Hy-MT2-1.8B-GGUF)|
|
| 65 |
+
| Hy-MT2-1.8B-2bit-GGUF | Hy 1.8B translation model, llama.cpp, 2bit | 🤗 [Model](https://huggingface.co/tencent/Hy-MT2-1.8B-2bit-GGUF)|
|
| 66 |
+
| Hy-MT2-1.8B-1.25bit-GGUF | Hy 1.8B translation model, llama.cpp, 1.25bit | 🤗 [Model](https://huggingface.co/tencent/Hy-MT2-1.8B-1.25bit-GGUF)|
|
| 67 |
+
| Hy-MT2-7B | Hy 7B translation model | 🤗 [Model](https://huggingface.co/tencent/Hy-MT2-7B)|
|
| 68 |
+
| Hy-MT2-7B-FP8 | Hy 7B translation model, FP8 quantization | 🤗 [Model](https://huggingface.co/tencent/Hy-MT2-7B-FP8)|
|
| 69 |
+
| Hy-MT2-7B-GGUF | Hy 7B translation model, llama.cpp | 🤗 [Model](https://huggingface.co/tencent/Hy-MT2-7B-GGUF)|
|
| 70 |
+
| Hy-MT2-30B-A3B | Hy 30B-A3B translation model | 🤗 [Model](https://huggingface.co/tencent/Hy-MT2-30B-A3B)|
|
| 71 |
+
| Hy-MT2-30B-A3B-FP8 | Hy 30B-A3B translation model, FP8 quantization | 🤗 [Model](https://huggingface.co/tencent/Hy-MT2-30B-A3B-FP8)|
|
| 72 |
+
|
| 73 |
+
|
| 74 |
+
|
| 75 |
+
## Hy-MT2 Translation Task Instruction Examples (Chinese-English Comparison)
|
| 76 |
+
|
| 77 |
+
*Note: In the following examples, both source_lang and target_lang should use the full language names. Chinese names should be used in Chinese prompts, and English names should be used in English prompts.*
|
| 78 |
+
|
| 79 |
+
| Type | Chinese prompt | English prompt |
|
| 80 |
+
|---|---|---|
|
| 81 |
+
| **Default Translation** | 将以下文本翻译为 `{target_lang}`,注意**只需要输出翻译后的结果,不要额外解释**:<br><br>`{source_text}` | Translate the following text into `{target_lang}`. Note that you should **only output the translated result without any additional explanation**:<br><br>`{source_text}` |
|
| 82 |
+
| **Terminology** | *参考下面的翻译:*<br>`{text}` 翻译成 `{text}`<br>`{text}` 翻译成 `{text}`<br>`{text}` 翻译成 `{text}`<br>将以下文本翻译为 `{target_lang}`,注意**只需要输出翻译后的结果,不要额外解释**:<br><br>`{source_text}` | *Reference the following translations:*<br>`{text}` translates to `{text}`<br>`{text}` translates to `{text}`<br>`{text}` translates to `{text}`<br><br>Translate the following text into `{target_lang}`. Note that you must **ONLY output the translated result without any additional explanation**:<br><br>`{source_text}` |
|
| 83 |
+
| **Style** | 请将以下文本翻译为 `{target_lang}`。<br>注意翻译的风格要严格符合【**`{target_style}`**】<br><br>`{source_text}` | Please translate the following text into `{target_lang}`. Note that the translation style must strictly conform to [**`{target_style}`**]:<br><br>`{source_text}` |
|
| 84 |
+
| **Personalization** | *【待翻译文本】*<br>`{source_text}`<br><br>*【翻译任务】*<br>1、**`{user_preferences}`**<br>2、**`{user_preferences}`**<br>3、……<br>4、将【待翻译文本】翻译为 `{target_lang}`。 | *[Source Text]*<br>`{source_text}`<br><br>*[Translation Tasks]*<br>1. **`{user_preferences}`**<br>2. **`{user_preferences}`**<br>3. ...<br>4. Translate the [Source Text] into `{target_lang}`. |
|
| 85 |
+
| **Delimiters** | 请将以下文本准确翻译为 `{target_lang}`。<br>你必须在译文中**保留等量的分隔符,绝对不可遗漏、转义或翻译该符号,并注意分隔符的位置**。<br><br>`{source_text}` | Please accurately translate the following text into `{target_lang}`.<br>You must **retain the exact same number of delimiters in the translation. Strictly do not omit, escape, or translate these symbols, and pay close attention to their placement**.<br><br>`{source_text}` |
|
| 86 |
+
| **Structured Data 1** | *# 任务目标*<br>将下方 `{source_text}` 中的 `{format_type}` 格式数据翻译为 `{target_lang}`。<br><br>*# 严格约束*<br>1. **结构锁定**:绝对保持原有的 `{format_type}` 数据结构、缩进和层级完全不变。<br>2. **选择性翻译**:仅翻译面向用户展示的可见文本内容。<br>3. **禁止修改**:**严禁**翻译或更改任何代码标签、键名 (Key)、变量占位符(如 `{{var}}`、`${var}`、`%s`、`%d` 等)或代码属性。<br><br>*# 数据输入*<br>`{source_text}` | *### Task*<br>Translate the user-facing text within the following `{format_type}` data into `{target_lang}`.<br><br>*### Strict Rules*<br>1. **Structure Preservation:** You MUST preserve the original `{format_type}` data structure, nesting, hierarchy, and indentation exactly as they are.<br>2. **Selective Translation:** Translate ONLY the visible, user-facing text content/values.<br>3. **Strict Non-Translation:** NEVER translate or alter code tags, keys, properties, object names, or variable placeholders. Leave them exactly in their original English/code form.<br><br>*### Source Data*<br>`{source_text}` |
|
| 87 |
+
| **Structured Data 2** | *【背景信息】*<br>`{background_text}`<br><br>请结合背景信息将以下文本翻译为 `{target_lang}`。<br><br>*【待翻译文本】*<br>`{source_text}` | *[Background Information]*<br>`{background_text}`<br><br>Please translate the following text into `{target_lang}`, taking the provided background information into consideration.<br><br>*[Source Text]*<br>`{source_text}` |
|
| 88 |
+
|
| 89 |
+
---
|
| 90 |
+
|
| 91 |
+
## Inference and Deployment
|
| 92 |
+
### transformers
|
| 93 |
+
|
| 94 |
+
transformers>=5.6.0
|
| 95 |
+
|
| 96 |
+
```python
|
| 97 |
+
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 98 |
+
import torch
|
| 99 |
+
|
| 100 |
+
model_path = "tencent/Hy-MT2-30B-A3B"
|
| 101 |
+
|
| 102 |
+
# Load tokenizer
|
| 103 |
+
tokenizer = AutoTokenizer.from_pretrained(model_path, trust_remote_code=True)
|
| 104 |
+
|
| 105 |
+
# Load model
|
| 106 |
+
model = AutoModelForCausalLM.from_pretrained(
|
| 107 |
+
model_path,
|
| 108 |
+
dtype=torch.bfloat16,
|
| 109 |
+
device_map="auto",
|
| 110 |
+
trust_remote_code=True,
|
| 111 |
+
)
|
| 112 |
+
|
| 113 |
+
model.eval()
|
| 114 |
+
|
| 115 |
+
# Example inference
|
| 116 |
+
prompt = "将以下文本翻译成英语,注意只需要输出翻译后的结果,不要额外解释:\n\n今天天气真好。"
|
| 117 |
+
messages = [{"role": "user", "content": prompt}]
|
| 118 |
+
inputs = tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt").to(model.device)
|
| 119 |
+
|
| 120 |
+
with torch.no_grad():
|
| 121 |
+
outputs = model.generate(
|
| 122 |
+
**inputs,
|
| 123 |
+
max_new_tokens=4096,
|
| 124 |
+
)
|
| 125 |
+
response = tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:], skip_special_tokens=True)
|
| 126 |
+
print(response)
|
| 127 |
+
```
|
| 128 |
+
|
| 129 |
+
### vllm
|
| 130 |
+
|
| 131 |
+
Build vLLM from source:
|
| 132 |
+
```bash
|
| 133 |
+
uv venv --python 3.12 --seed --managed-python
|
| 134 |
+
source .venv/bin/activate
|
| 135 |
+
git clone https://github.com/vllm-project/vllm.git
|
| 136 |
+
cd vllm
|
| 137 |
+
uv pip install --editable . --torch-backend=auto
|
| 138 |
+
```
|
| 139 |
+
|
| 140 |
+
Start the vLLM server:
|
| 141 |
+
|
| 142 |
+
```bash
|
| 143 |
+
vllm serve tencent/Hy-MT2-30B-A3B --tensor-parallel-size 1
|
| 144 |
+
```
|
| 145 |
+
|
| 146 |
+
### sglang
|
| 147 |
+
|
| 148 |
+
Build SGLang from source:
|
| 149 |
+
```bash
|
| 150 |
+
git clone https://github.com/sgl-project/sglang
|
| 151 |
+
cd sglang
|
| 152 |
+
pip3 install pip --upgrade
|
| 153 |
+
pip3 install "transformers>=5.6.0"
|
| 154 |
+
pip3 install -e "python"
|
| 155 |
+
```
|
| 156 |
+
|
| 157 |
+
Launch SGLang server:
|
| 158 |
+
|
| 159 |
+
```bash
|
| 160 |
+
python3 -m sglang.launch_server --model tencent/Hy-MT2-30B-A3B --tp 1
|
| 161 |
+
```
|
| 162 |
+
|
| 163 |
+
### llama_cpp
|
| 164 |
+
**❕❕ This gguf depends on our STQ kernel, which is released at [PR #22836](https://github.com/ggml-org/llama.cpp/pull/22836).**
|
| 165 |
+
|
| 166 |
+
#### Clone llama.cpp
|
| 167 |
+
|
| 168 |
+
```bash
|
| 169 |
+
git clone https://github.com/ggml-org/llama.cpp.git
|
| 170 |
+
```
|
| 171 |
+
|
| 172 |
+
#### Enter the llama.cpp folder
|
| 173 |
+
|
| 174 |
+
```bash
|
| 175 |
+
cd llama.cpp
|
| 176 |
+
```
|
| 177 |
+
|
| 178 |
+
#### Build llama.cpp
|
| 179 |
+
|
| 180 |
+
```bash
|
| 181 |
+
cmake -B build
|
| 182 |
+
cmake --build build --config Release
|
| 183 |
+
```
|
| 184 |
+
|
| 185 |
+
#### Run a completion example
|
| 186 |
+
|
| 187 |
+
```bash
|
| 188 |
+
./build/bin/llama-completion \
|
| 189 |
+
--model model.gguf \
|
| 190 |
+
-p "Translate the following segment into Chinese, without additional explanation:Hello" \
|
| 191 |
+
--jinja \
|
| 192 |
+
-ngl 0 \
|
| 193 |
+
-n 64 -st
|
| 194 |
+
```
|
| 195 |
+
|
| 196 |
+
#### Run the llama.cpp benchmark
|
| 197 |
+
|
| 198 |
+
```bash
|
| 199 |
+
./build/bin/llama-bench -m model_zoo/model.gguf -ngl 0
|
| 200 |
+
```
|
| 201 |
+
|
| 202 |
+
|
| 203 |
+
For 1.8B and 7B, we recommend using the following parameters for inference. Note that our models do not have a default system_prompt.
|
| 204 |
+
|
| 205 |
+
```json
|
| 206 |
+
|
| 207 |
+
{
|
| 208 |
+
"temperature": 0.7,
|
| 209 |
+
"top_p": 0.6,
|
| 210 |
+
"top_k": 20,
|
| 211 |
+
"repetition_penalty": 1.05,
|
| 212 |
+
"max_tokens": 4096
|
| 213 |
+
}
|
| 214 |
+
```
|
| 215 |
+
|
| 216 |
+
For 30B-A3B, we recommend using the following parameters for inference. Note that our models do not have a default system_prompt.
|
| 217 |
+
|
| 218 |
+
```json
|
| 219 |
+
|
| 220 |
+
{
|
| 221 |
+
"temperature": 0.7,
|
| 222 |
+
"top_p": 1.0,
|
| 223 |
+
"top_k": -1,
|
| 224 |
+
"repetition_penalty": 1.0,
|
| 225 |
+
"max_tokens": 4096
|
| 226 |
+
}
|
| 227 |
+
```
|
| 228 |
+
|
| 229 |
+
## Model Training
|
| 230 |
+
Hy-MT2 provides a complete model training pipeline, supporting both full-parameter fine-tuning and LoRA fine-tuning, as well as multiple DeepSpeed ZeRO configurations and LLaMA-Factory integration.
|
| 231 |
+
|
| 232 |
+
For detailed training documentation, please refer to: [Model Training Guide](./train/README.md)
|
| 233 |
+
|
| 234 |
+
## Quantization Tool
|
| 235 |
+
|
| 236 |
+
We provide [AngelSlim](https://github.com/tencent/AngelSlim), an easy-to-use, comprehensive, and efficient large model compression toolkit covering common quantization algorithms, low-bit quantization, speculative sampling, and more.
|
| 237 |
+
|
| 238 |
+
|
| 239 |
+
## Supported Languages
|
| 240 |
+
| Languages | Abbr. | Chinese Names |
|
| 241 |
+
|-------------------|---------|-----------------|
|
| 242 |
+
| Chinese | zh | 中文 |
|
| 243 |
+
| English | en | 英语 |
|
| 244 |
+
| French | fr | 法语 |
|
| 245 |
+
| Portuguese | pt | 葡萄牙语 |
|
| 246 |
+
| Spanish | es | 西班牙语 |
|
| 247 |
+
| Japanese | ja | 日语 |
|
| 248 |
+
| Turkish | tr | 土耳其语 |
|
| 249 |
+
| Russian | ru | 俄语 |
|
| 250 |
+
| Arabic | ar | 阿拉伯语 |
|
| 251 |
+
| Korean | ko | 韩语 |
|
| 252 |
+
| Thai | th | 泰语 |
|
| 253 |
+
| Italian | it | 意大利语 |
|
| 254 |
+
| German | de | 德语 |
|
| 255 |
+
| Vietnamese | vi | 越南语 |
|
| 256 |
+
| Malay | ms | 马来语 |
|
| 257 |
+
| Indonesian | id | 印尼语 |
|
| 258 |
+
| Filipino | tl | 菲律宾语 |
|
| 259 |
+
| Hindi | hi | 印地语 |
|
| 260 |
+
| Traditional Chinese | zh-Hant| 繁体中文 |
|
| 261 |
+
| Polish | pl | 波兰语 |
|
| 262 |
+
| Czech | cs | 捷克语 |
|
| 263 |
+
| Dutch | nl | 荷兰语 |
|
| 264 |
+
| Khmer | km | 高棉语 |
|
| 265 |
+
| Burmese | my | 缅甸语 |
|
| 266 |
+
| Persian | fa | 波斯语 |
|
| 267 |
+
| Gujarati | gu | 古吉拉特语 |
|
| 268 |
+
| Urdu | ur | 乌尔都语 |
|
| 269 |
+
| Telugu | te | 泰卢固语 |
|
| 270 |
+
| Marathi | mr | 马拉地语 |
|
| 271 |
+
| Hebrew | he | 希伯来语 |
|
| 272 |
+
| Bengali | bn | 孟加拉语 |
|
| 273 |
+
| Tamil | ta | 泰米尔语 |
|
| 274 |
+
| Ukrainian | uk | 乌克兰语 |
|
| 275 |
+
| Tibetan | bo | 藏语 |
|
| 276 |
+
| Kazakh | kk | 哈萨克语 |
|
| 277 |
+
| Mongolian | mn | 蒙古语 |
|
| 278 |
+
| Uyghur | ug | 维吾尔语 |
|
| 279 |
+
| Cantonese | yue | 粤语 |
|
| 280 |
+
|
| 281 |
+
|
| 282 |
+
|
| 283 |
+
## Citing Hy-MT2
|
| 284 |
+
|
| 285 |
+
```bibtex
|
| 286 |
+
@misc{zheng2026hymt2familyfastefficient,
|
| 287 |
+
title={Hy-MT2: A Family of Fast, Efficient and Powerful Multilingual Translation Models in the Wild},
|
| 288 |
+
author={Mao Zheng and Zheng Li and Tao Chen and Bo Lv and Mingrui Sun and Mingyang Song and Jinlong Song and Hong Huang and Decheng Wu and Hai Wang and Yifan Song and Yanfeng Chen and Guanwei Zhang},
|
| 289 |
+
year={2026},
|
| 290 |
+
eprint={2605.22064},
|
| 291 |
+
archivePrefix={arXiv},
|
| 292 |
+
primaryClass={cs.CL},
|
| 293 |
+
url={https://arxiv.org/abs/2605.22064},
|
| 294 |
+
}
|
| 295 |
+
```
|
| 296 |
+
|
| 297 |
+
## Contact Us
|
| 298 |
+
If you would like to leave feedback for our R&D and product teams, you are welcome to contact the Tencent Hunyuan LLM team. You can reach us by email at hunyuan_opensource@tencent.com.
|
madlad400_3b/LICENSE
ADDED
|
@@ -0,0 +1,202 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
|
| 2 |
+
Apache License
|
| 3 |
+
Version 2.0, January 2004
|
| 4 |
+
http://www.apache.org/licenses/
|
| 5 |
+
|
| 6 |
+
TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
|
| 7 |
+
|
| 8 |
+
1. Definitions.
|
| 9 |
+
|
| 10 |
+
"License" shall mean the terms and conditions for use, reproduction,
|
| 11 |
+
and distribution as defined by Sections 1 through 9 of this document.
|
| 12 |
+
|
| 13 |
+
"Licensor" shall mean the copyright owner or entity authorized by
|
| 14 |
+
the copyright owner that is granting the License.
|
| 15 |
+
|
| 16 |
+
"Legal Entity" shall mean the union of the acting entity and all
|
| 17 |
+
other entities that control, are controlled by, or are under common
|
| 18 |
+
control with that entity. For the purposes of this definition,
|
| 19 |
+
"control" means (i) the power, direct or indirect, to cause the
|
| 20 |
+
direction or management of such entity, whether by contract or
|
| 21 |
+
otherwise, or (ii) ownership of fifty percent (50%) or more of the
|
| 22 |
+
outstanding shares, or (iii) beneficial ownership of such entity.
|
| 23 |
+
|
| 24 |
+
"You" (or "Your") shall mean an individual or Legal Entity
|
| 25 |
+
exercising permissions granted by this License.
|
| 26 |
+
|
| 27 |
+
"Source" form shall mean the preferred form for making modifications,
|
| 28 |
+
including but not limited to software source code, documentation
|
| 29 |
+
source, and configuration files.
|
| 30 |
+
|
| 31 |
+
"Object" form shall mean any form resulting from mechanical
|
| 32 |
+
transformation or translation of a Source form, including but
|
| 33 |
+
not limited to compiled object code, generated documentation,
|
| 34 |
+
and conversions to other media types.
|
| 35 |
+
|
| 36 |
+
"Work" shall mean the work of authorship, whether in Source or
|
| 37 |
+
Object form, made available under the License, as indicated by a
|
| 38 |
+
copyright notice that is included in or attached to the work
|
| 39 |
+
(an example is provided in the Appendix below).
|
| 40 |
+
|
| 41 |
+
"Derivative Works" shall mean any work, whether in Source or Object
|
| 42 |
+
form, that is based on (or derived from) the Work and for which the
|
| 43 |
+
editorial revisions, annotations, elaborations, or other modifications
|
| 44 |
+
represent, as a whole, an original work of authorship. For the purposes
|
| 45 |
+
of this License, Derivative Works shall not include works that remain
|
| 46 |
+
separable from, or merely link (or bind by name) to the interfaces of,
|
| 47 |
+
the Work and Derivative Works thereof.
|
| 48 |
+
|
| 49 |
+
"Contribution" shall mean any work of authorship, including
|
| 50 |
+
the original version of the Work and any modifications or additions
|
| 51 |
+
to that Work or Derivative Works thereof, that is intentionally
|
| 52 |
+
submitted to Licensor for inclusion in the Work by the copyright owner
|
| 53 |
+
or by an individual or Legal Entity authorized to submit on behalf of
|
| 54 |
+
the copyright owner. For the purposes of this definition, "submitted"
|
| 55 |
+
means any form of electronic, verbal, or written communication sent
|
| 56 |
+
to the Licensor or its representatives, including but not limited to
|
| 57 |
+
communication on electronic mailing lists, source code control systems,
|
| 58 |
+
and issue tracking systems that are managed by, or on behalf of, the
|
| 59 |
+
Licensor for the purpose of discussing and improving the Work, but
|
| 60 |
+
excluding communication that is conspicuously marked or otherwise
|
| 61 |
+
designated in writing by the copyright owner as "Not a Contribution."
|
| 62 |
+
|
| 63 |
+
"Contributor" shall mean Licensor and any individual or Legal Entity
|
| 64 |
+
on behalf of whom a Contribution has been received by Licensor and
|
| 65 |
+
subsequently incorporated within the Work.
|
| 66 |
+
|
| 67 |
+
2. Grant of Copyright License. Subject to the terms and conditions of
|
| 68 |
+
this License, each Contributor hereby grants to You a perpetual,
|
| 69 |
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
| 70 |
+
copyright license to reproduce, prepare Derivative Works of,
|
| 71 |
+
publicly display, publicly perform, sublicense, and distribute the
|
| 72 |
+
Work and such Derivative Works in Source or Object form.
|
| 73 |
+
|
| 74 |
+
3. Grant of Patent License. Subject to the terms and conditions of
|
| 75 |
+
this License, each Contributor hereby grants to You a perpetual,
|
| 76 |
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
| 77 |
+
(except as stated in this section) patent license to make, have made,
|
| 78 |
+
use, offer to sell, sell, import, and otherwise transfer the Work,
|
| 79 |
+
where such license applies only to those patent claims licensable
|
| 80 |
+
by such Contributor that are necessarily infringed by their
|
| 81 |
+
Contribution(s) alone or by combination of their Contribution(s)
|
| 82 |
+
with the Work to which such Contribution(s) was submitted. If You
|
| 83 |
+
institute patent litigation against any entity (including a
|
| 84 |
+
cross-claim or counterclaim in a lawsuit) alleging that the Work
|
| 85 |
+
or a Contribution incorporated within the Work constitutes direct
|
| 86 |
+
or contributory patent infringement, then any patent licenses
|
| 87 |
+
granted to You under this License for that Work shall terminate
|
| 88 |
+
as of the date such litigation is filed.
|
| 89 |
+
|
| 90 |
+
4. Redistribution. You may reproduce and distribute copies of the
|
| 91 |
+
Work or Derivative Works thereof in any medium, with or without
|
| 92 |
+
modifications, and in Source or Object form, provided that You
|
| 93 |
+
meet the following conditions:
|
| 94 |
+
|
| 95 |
+
(a) You must give any other recipients of the Work or
|
| 96 |
+
Derivative Works a copy of this License; and
|
| 97 |
+
|
| 98 |
+
(b) You must cause any modified files to carry prominent notices
|
| 99 |
+
stating that You changed the files; and
|
| 100 |
+
|
| 101 |
+
(c) You must retain, in the Source form of any Derivative Works
|
| 102 |
+
that You distribute, all copyright, patent, trademark, and
|
| 103 |
+
attribution notices from the Source form of the Work,
|
| 104 |
+
excluding those notices that do not pertain to any part of
|
| 105 |
+
the Derivative Works; and
|
| 106 |
+
|
| 107 |
+
(d) If the Work includes a "NOTICE" text file as part of its
|
| 108 |
+
distribution, then any Derivative Works that You distribute must
|
| 109 |
+
include a readable copy of the attribution notices contained
|
| 110 |
+
within such NOTICE file, excluding those notices that do not
|
| 111 |
+
pertain to any part of the Derivative Works, in at least one
|
| 112 |
+
of the following places: within a NOTICE text file distributed
|
| 113 |
+
as part of the Derivative Works; within the Source form or
|
| 114 |
+
documentation, if provided along with the Derivative Works; or,
|
| 115 |
+
within a display generated by the Derivative Works, if and
|
| 116 |
+
wherever such third-party notices normally appear. The contents
|
| 117 |
+
of the NOTICE file are for informational purposes only and
|
| 118 |
+
do not modify the License. You may add Your own attribution
|
| 119 |
+
notices within Derivative Works that You distribute, alongside
|
| 120 |
+
or as an addendum to the NOTICE text from the Work, provided
|
| 121 |
+
that such additional attribution notices cannot be construed
|
| 122 |
+
as modifying the License.
|
| 123 |
+
|
| 124 |
+
You may add Your own copyright statement to Your modifications and
|
| 125 |
+
may provide additional or different license terms and conditions
|
| 126 |
+
for use, reproduction, or distribution of Your modifications, or
|
| 127 |
+
for any such Derivative Works as a whole, provided Your use,
|
| 128 |
+
reproduction, and distribution of the Work otherwise complies with
|
| 129 |
+
the conditions stated in this License.
|
| 130 |
+
|
| 131 |
+
5. Submission of Contributions. Unless You explicitly state otherwise,
|
| 132 |
+
any Contribution intentionally submitted for inclusion in the Work
|
| 133 |
+
by You to the Licensor shall be under the terms and conditions of
|
| 134 |
+
this License, without any additional terms or conditions.
|
| 135 |
+
Notwithstanding the above, nothing herein shall supersede or modify
|
| 136 |
+
the terms of any separate license agreement you may have executed
|
| 137 |
+
with Licensor regarding such Contributions.
|
| 138 |
+
|
| 139 |
+
6. Trademarks. This License does not grant permission to use the trade
|
| 140 |
+
names, trademarks, service marks, or product names of the Licensor,
|
| 141 |
+
except as required for reasonable and customary use in describing the
|
| 142 |
+
origin of the Work and reproducing the content of the NOTICE file.
|
| 143 |
+
|
| 144 |
+
7. Disclaimer of Warranty. Unless required by applicable law or
|
| 145 |
+
agreed to in writing, Licensor provides the Work (and each
|
| 146 |
+
Contributor provides its Contributions) on an "AS IS" BASIS,
|
| 147 |
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
|
| 148 |
+
implied, including, without limitation, any warranties or conditions
|
| 149 |
+
of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
|
| 150 |
+
PARTICULAR PURPOSE. You are solely responsible for determining the
|
| 151 |
+
appropriateness of using or redistributing the Work and assume any
|
| 152 |
+
risks associated with Your exercise of permissions under this License.
|
| 153 |
+
|
| 154 |
+
8. Limitation of Liability. In no event and under no legal theory,
|
| 155 |
+
whether in tort (including negligence), contract, or otherwise,
|
| 156 |
+
unless required by applicable law (such as deliberate and grossly
|
| 157 |
+
negligent acts) or agreed to in writing, shall any Contributor be
|
| 158 |
+
liable to You for damages, including any direct, indirect, special,
|
| 159 |
+
incidental, or consequential damages of any character arising as a
|
| 160 |
+
result of this License or out of the use or inability to use the
|
| 161 |
+
Work (including but not limited to damages for loss of goodwill,
|
| 162 |
+
work stoppage, computer failure or malfunction, or any and all
|
| 163 |
+
other commercial damages or losses), even if such Contributor
|
| 164 |
+
has been advised of the possibility of such damages.
|
| 165 |
+
|
| 166 |
+
9. Accepting Warranty or Additional Liability. While redistributing
|
| 167 |
+
the Work or Derivative Works thereof, You may choose to offer,
|
| 168 |
+
and charge a fee for, acceptance of support, warranty, indemnity,
|
| 169 |
+
or other liability obligations and/or rights consistent with this
|
| 170 |
+
License. However, in accepting such obligations, You may act only
|
| 171 |
+
on Your own behalf and on Your sole responsibility, not on behalf
|
| 172 |
+
of any other Contributor, and only if You agree to indemnify,
|
| 173 |
+
defend, and hold each Contributor harmless for any liability
|
| 174 |
+
incurred by, or claims asserted against, such Contributor by reason
|
| 175 |
+
of your accepting any such warranty or additional liability.
|
| 176 |
+
|
| 177 |
+
END OF TERMS AND CONDITIONS
|
| 178 |
+
|
| 179 |
+
APPENDIX: How to apply the Apache License to your work.
|
| 180 |
+
|
| 181 |
+
To apply the Apache License to your work, attach the following
|
| 182 |
+
boilerplate notice, with the fields enclosed by brackets "[]"
|
| 183 |
+
replaced with your own identifying information. (Don't include
|
| 184 |
+
the brackets!) The text should be enclosed in the appropriate
|
| 185 |
+
comment syntax for the file format. We also recommend that a
|
| 186 |
+
file or class name and description of purpose be included on the
|
| 187 |
+
same "printed page" as the copyright notice for easier
|
| 188 |
+
identification within third-party archives.
|
| 189 |
+
|
| 190 |
+
Copyright 2026 Alibaba Cloud
|
| 191 |
+
|
| 192 |
+
Licensed under the Apache License, Version 2.0 (the "License");
|
| 193 |
+
you may not use this file except in compliance with the License.
|
| 194 |
+
You may obtain a copy of the License at
|
| 195 |
+
|
| 196 |
+
http://www.apache.org/licenses/LICENSE-2.0
|
| 197 |
+
|
| 198 |
+
Unless required by applicable law or agreed to in writing, software
|
| 199 |
+
distributed under the License is distributed on an "AS IS" BASIS,
|
| 200 |
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
| 201 |
+
See the License for the specific language governing permissions and
|
| 202 |
+
limitations under the License.
|
madlad400_3b/ct2_int8/config.json
ADDED
|
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"add_source_bos": false,
|
| 3 |
+
"add_source_eos": false,
|
| 4 |
+
"bos_token": "<s>",
|
| 5 |
+
"decoder_start_token": "<unk>",
|
| 6 |
+
"eos_token": "</s>",
|
| 7 |
+
"layer_norm_epsilon": null,
|
| 8 |
+
"multi_query_attention": false,
|
| 9 |
+
"unk_token": "<unk>"
|
| 10 |
+
}
|
madlad400_3b/ct2_int8/model.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:890ed3b7e4654dcf1b9e7f2ce6ce641447462e782881e81aac443568eb1ca702
|
| 3 |
+
size 2950208290
|
madlad400_3b/ct2_int8/runtime_manifest.json
ADDED
|
@@ -0,0 +1,14 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"version": 1,
|
| 3 |
+
"created": "2026-10-22T00:10:01.979912+00:00",
|
| 4 |
+
"model_bin_size": 2950208290,
|
| 5 |
+
"files": [
|
| 6 |
+
"config.json",
|
| 7 |
+
"model.bin",
|
| 8 |
+
"shared_vocabulary.json"
|
| 9 |
+
],
|
| 10 |
+
"source_dir": "google_madlad400_3b_mt",
|
| 11 |
+
"source_revision": "fa184c675da0b5c9e1c8694fccd4e12e2d422094",
|
| 12 |
+
"source_weights_size": 5880840296,
|
| 13 |
+
"model_bin_sha256": "890ed3b7e4654dcf1b9e7f2ce6ce641447462e782881e81aac443568eb1ca702"
|
| 14 |
+
}
|
madlad400_3b/ct2_int8/shared_vocabulary.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
madlad400_3b/model/README.md
ADDED
|
@@ -0,0 +1,633 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
language:
|
| 4 |
+
- multilingual
|
| 5 |
+
- en
|
| 6 |
+
- ru
|
| 7 |
+
- es
|
| 8 |
+
- fr
|
| 9 |
+
- de
|
| 10 |
+
- it
|
| 11 |
+
- pt
|
| 12 |
+
- pl
|
| 13 |
+
- nl
|
| 14 |
+
- vi
|
| 15 |
+
- tr
|
| 16 |
+
- sv
|
| 17 |
+
- id
|
| 18 |
+
- ro
|
| 19 |
+
- cs
|
| 20 |
+
- zh
|
| 21 |
+
- hu
|
| 22 |
+
- ja
|
| 23 |
+
- th
|
| 24 |
+
- fi
|
| 25 |
+
- fa
|
| 26 |
+
- uk
|
| 27 |
+
- da
|
| 28 |
+
- el
|
| 29 |
+
- "no"
|
| 30 |
+
- bg
|
| 31 |
+
- sk
|
| 32 |
+
- ko
|
| 33 |
+
- ar
|
| 34 |
+
- lt
|
| 35 |
+
- ca
|
| 36 |
+
- sl
|
| 37 |
+
- he
|
| 38 |
+
- et
|
| 39 |
+
- lv
|
| 40 |
+
- hi
|
| 41 |
+
- sq
|
| 42 |
+
- ms
|
| 43 |
+
- az
|
| 44 |
+
- sr
|
| 45 |
+
- ta
|
| 46 |
+
- hr
|
| 47 |
+
- kk
|
| 48 |
+
- is
|
| 49 |
+
- ml
|
| 50 |
+
- mr
|
| 51 |
+
- te
|
| 52 |
+
- af
|
| 53 |
+
- gl
|
| 54 |
+
- fil
|
| 55 |
+
- be
|
| 56 |
+
- mk
|
| 57 |
+
- eu
|
| 58 |
+
- bn
|
| 59 |
+
- ka
|
| 60 |
+
- mn
|
| 61 |
+
- bs
|
| 62 |
+
- uz
|
| 63 |
+
- ur
|
| 64 |
+
- sw
|
| 65 |
+
- yue
|
| 66 |
+
- ne
|
| 67 |
+
- kn
|
| 68 |
+
- kaa
|
| 69 |
+
- gu
|
| 70 |
+
- si
|
| 71 |
+
- cy
|
| 72 |
+
- eo
|
| 73 |
+
- la
|
| 74 |
+
- hy
|
| 75 |
+
- ky
|
| 76 |
+
- tg
|
| 77 |
+
- ga
|
| 78 |
+
- mt
|
| 79 |
+
- my
|
| 80 |
+
- km
|
| 81 |
+
- tt
|
| 82 |
+
- so
|
| 83 |
+
- ku
|
| 84 |
+
- ps
|
| 85 |
+
- pa
|
| 86 |
+
- rw
|
| 87 |
+
- lo
|
| 88 |
+
- ha
|
| 89 |
+
- dv
|
| 90 |
+
- fy
|
| 91 |
+
- lb
|
| 92 |
+
- ckb
|
| 93 |
+
- mg
|
| 94 |
+
- gd
|
| 95 |
+
- am
|
| 96 |
+
- ug
|
| 97 |
+
- ht
|
| 98 |
+
- grc
|
| 99 |
+
- hmn
|
| 100 |
+
- sd
|
| 101 |
+
- jv
|
| 102 |
+
- mi
|
| 103 |
+
- tk
|
| 104 |
+
- ceb
|
| 105 |
+
- yi
|
| 106 |
+
- ba
|
| 107 |
+
- fo
|
| 108 |
+
- or
|
| 109 |
+
- xh
|
| 110 |
+
- su
|
| 111 |
+
- kl
|
| 112 |
+
- ny
|
| 113 |
+
- sm
|
| 114 |
+
- sn
|
| 115 |
+
- co
|
| 116 |
+
- zu
|
| 117 |
+
- ig
|
| 118 |
+
- yo
|
| 119 |
+
- pap
|
| 120 |
+
- st
|
| 121 |
+
- haw
|
| 122 |
+
- as
|
| 123 |
+
- oc
|
| 124 |
+
- cv
|
| 125 |
+
- lus
|
| 126 |
+
- tet
|
| 127 |
+
- gsw
|
| 128 |
+
- sah
|
| 129 |
+
- br
|
| 130 |
+
- rm
|
| 131 |
+
- sa
|
| 132 |
+
- bo
|
| 133 |
+
- om
|
| 134 |
+
- se
|
| 135 |
+
- ce
|
| 136 |
+
- cnh
|
| 137 |
+
- ilo
|
| 138 |
+
- hil
|
| 139 |
+
- udm
|
| 140 |
+
- os
|
| 141 |
+
- lg
|
| 142 |
+
- ti
|
| 143 |
+
- vec
|
| 144 |
+
- ts
|
| 145 |
+
- tyv
|
| 146 |
+
- kbd
|
| 147 |
+
- ee
|
| 148 |
+
- iba
|
| 149 |
+
- av
|
| 150 |
+
- kha
|
| 151 |
+
- to
|
| 152 |
+
- tn
|
| 153 |
+
- nso
|
| 154 |
+
- fj
|
| 155 |
+
- zza
|
| 156 |
+
- ak
|
| 157 |
+
- ada
|
| 158 |
+
- otq
|
| 159 |
+
- dz
|
| 160 |
+
- bua
|
| 161 |
+
- cfm
|
| 162 |
+
- ln
|
| 163 |
+
- chm
|
| 164 |
+
- gn
|
| 165 |
+
- krc
|
| 166 |
+
- wa
|
| 167 |
+
- hif
|
| 168 |
+
- yua
|
| 169 |
+
- srn
|
| 170 |
+
- war
|
| 171 |
+
- rom
|
| 172 |
+
- bik
|
| 173 |
+
- pam
|
| 174 |
+
- sg
|
| 175 |
+
- lu
|
| 176 |
+
- ady
|
| 177 |
+
- kbp
|
| 178 |
+
- syr
|
| 179 |
+
- ltg
|
| 180 |
+
- myv
|
| 181 |
+
- iso
|
| 182 |
+
- kac
|
| 183 |
+
- bho
|
| 184 |
+
- ay
|
| 185 |
+
- kum
|
| 186 |
+
- qu
|
| 187 |
+
- za
|
| 188 |
+
- pag
|
| 189 |
+
- ngu
|
| 190 |
+
- ve
|
| 191 |
+
- pck
|
| 192 |
+
- zap
|
| 193 |
+
- tyz
|
| 194 |
+
- hui
|
| 195 |
+
- bbc
|
| 196 |
+
- tzo
|
| 197 |
+
- tiv
|
| 198 |
+
- ksd
|
| 199 |
+
- gom
|
| 200 |
+
- min
|
| 201 |
+
- ang
|
| 202 |
+
- nhe
|
| 203 |
+
- bgp
|
| 204 |
+
- nzi
|
| 205 |
+
- nnb
|
| 206 |
+
- nv
|
| 207 |
+
- zxx
|
| 208 |
+
- bci
|
| 209 |
+
- kv
|
| 210 |
+
- new
|
| 211 |
+
- mps
|
| 212 |
+
- alt
|
| 213 |
+
- meu
|
| 214 |
+
- bew
|
| 215 |
+
- fon
|
| 216 |
+
- iu
|
| 217 |
+
- abt
|
| 218 |
+
- mgh
|
| 219 |
+
- mnw
|
| 220 |
+
- tvl
|
| 221 |
+
- dov
|
| 222 |
+
- tlh
|
| 223 |
+
- ho
|
| 224 |
+
- kw
|
| 225 |
+
- mrj
|
| 226 |
+
- meo
|
| 227 |
+
- crh
|
| 228 |
+
- mbt
|
| 229 |
+
- emp
|
| 230 |
+
- ace
|
| 231 |
+
- ium
|
| 232 |
+
- mam
|
| 233 |
+
- gym
|
| 234 |
+
- mai
|
| 235 |
+
- crs
|
| 236 |
+
- pon
|
| 237 |
+
- ubu
|
| 238 |
+
- fip
|
| 239 |
+
- quc
|
| 240 |
+
- gv
|
| 241 |
+
- kj
|
| 242 |
+
- btx
|
| 243 |
+
- ape
|
| 244 |
+
- chk
|
| 245 |
+
- rcf
|
| 246 |
+
- shn
|
| 247 |
+
- tzh
|
| 248 |
+
- mdf
|
| 249 |
+
- ppk
|
| 250 |
+
- ss
|
| 251 |
+
- gag
|
| 252 |
+
- cab
|
| 253 |
+
- kri
|
| 254 |
+
- seh
|
| 255 |
+
- ibb
|
| 256 |
+
- tbz
|
| 257 |
+
- bru
|
| 258 |
+
- enq
|
| 259 |
+
- ach
|
| 260 |
+
- cuk
|
| 261 |
+
- kmb
|
| 262 |
+
- wo
|
| 263 |
+
- kek
|
| 264 |
+
- qub
|
| 265 |
+
- tab
|
| 266 |
+
- bts
|
| 267 |
+
- kos
|
| 268 |
+
- rwo
|
| 269 |
+
- cak
|
| 270 |
+
- tuc
|
| 271 |
+
- bum
|
| 272 |
+
- cjk
|
| 273 |
+
- gil
|
| 274 |
+
- stq
|
| 275 |
+
- tsg
|
| 276 |
+
- quh
|
| 277 |
+
- mak
|
| 278 |
+
- arn
|
| 279 |
+
- ban
|
| 280 |
+
- jiv
|
| 281 |
+
- sja
|
| 282 |
+
- yap
|
| 283 |
+
- tcy
|
| 284 |
+
- toj
|
| 285 |
+
- twu
|
| 286 |
+
- xal
|
| 287 |
+
- amu
|
| 288 |
+
- rmc
|
| 289 |
+
- hus
|
| 290 |
+
- nia
|
| 291 |
+
- kjh
|
| 292 |
+
- bm
|
| 293 |
+
- guh
|
| 294 |
+
- mas
|
| 295 |
+
- acf
|
| 296 |
+
- dtp
|
| 297 |
+
- ksw
|
| 298 |
+
- bzj
|
| 299 |
+
- din
|
| 300 |
+
- zne
|
| 301 |
+
- mad
|
| 302 |
+
- msi
|
| 303 |
+
- mag
|
| 304 |
+
- mkn
|
| 305 |
+
- kg
|
| 306 |
+
- lhu
|
| 307 |
+
- ch
|
| 308 |
+
- qvi
|
| 309 |
+
- mh
|
| 310 |
+
- djk
|
| 311 |
+
- sus
|
| 312 |
+
- mfe
|
| 313 |
+
- srm
|
| 314 |
+
- dyu
|
| 315 |
+
- ctu
|
| 316 |
+
- gui
|
| 317 |
+
- pau
|
| 318 |
+
- inb
|
| 319 |
+
- bi
|
| 320 |
+
- mni
|
| 321 |
+
- guc
|
| 322 |
+
- jam
|
| 323 |
+
- wal
|
| 324 |
+
- jac
|
| 325 |
+
- bas
|
| 326 |
+
- gor
|
| 327 |
+
- skr
|
| 328 |
+
- nyu
|
| 329 |
+
- noa
|
| 330 |
+
- sda
|
| 331 |
+
- gub
|
| 332 |
+
- nog
|
| 333 |
+
- cni
|
| 334 |
+
- teo
|
| 335 |
+
- tdx
|
| 336 |
+
- sxn
|
| 337 |
+
- rki
|
| 338 |
+
- nr
|
| 339 |
+
- frp
|
| 340 |
+
- alz
|
| 341 |
+
- taj
|
| 342 |
+
- lrc
|
| 343 |
+
- cce
|
| 344 |
+
- rn
|
| 345 |
+
- jvn
|
| 346 |
+
- hvn
|
| 347 |
+
- nij
|
| 348 |
+
- dwr
|
| 349 |
+
- izz
|
| 350 |
+
- msm
|
| 351 |
+
- bus
|
| 352 |
+
- ktu
|
| 353 |
+
- chr
|
| 354 |
+
- maz
|
| 355 |
+
- tzj
|
| 356 |
+
- suz
|
| 357 |
+
- knj
|
| 358 |
+
- bim
|
| 359 |
+
- gvl
|
| 360 |
+
- bqc
|
| 361 |
+
- tca
|
| 362 |
+
- pis
|
| 363 |
+
- prk
|
| 364 |
+
- laj
|
| 365 |
+
- mel
|
| 366 |
+
- qxr
|
| 367 |
+
- niq
|
| 368 |
+
- ahk
|
| 369 |
+
- shp
|
| 370 |
+
- hne
|
| 371 |
+
- spp
|
| 372 |
+
- koi
|
| 373 |
+
- krj
|
| 374 |
+
- quf
|
| 375 |
+
- luz
|
| 376 |
+
- agr
|
| 377 |
+
- tsc
|
| 378 |
+
- mqy
|
| 379 |
+
- gof
|
| 380 |
+
- gbm
|
| 381 |
+
- miq
|
| 382 |
+
- dje
|
| 383 |
+
- awa
|
| 384 |
+
- bjj
|
| 385 |
+
- qvz
|
| 386 |
+
- sjp
|
| 387 |
+
- tll
|
| 388 |
+
- raj
|
| 389 |
+
- kjg
|
| 390 |
+
- bgz
|
| 391 |
+
- quy
|
| 392 |
+
- cbk
|
| 393 |
+
- akb
|
| 394 |
+
- oj
|
| 395 |
+
- ify
|
| 396 |
+
- mey
|
| 397 |
+
- ks
|
| 398 |
+
- cac
|
| 399 |
+
- brx
|
| 400 |
+
- qup
|
| 401 |
+
- syl
|
| 402 |
+
- jax
|
| 403 |
+
- ff
|
| 404 |
+
- ber
|
| 405 |
+
- tks
|
| 406 |
+
- trp
|
| 407 |
+
- mrw
|
| 408 |
+
- adh
|
| 409 |
+
- smt
|
| 410 |
+
- srr
|
| 411 |
+
- ffm
|
| 412 |
+
- qvc
|
| 413 |
+
- mtr
|
| 414 |
+
- ann
|
| 415 |
+
- kaa
|
| 416 |
+
- aa
|
| 417 |
+
- noe
|
| 418 |
+
- nut
|
| 419 |
+
- gyn
|
| 420 |
+
- kwi
|
| 421 |
+
- xmm
|
| 422 |
+
- msb
|
| 423 |
+
library_name: transformers
|
| 424 |
+
tags:
|
| 425 |
+
- text2text-generation
|
| 426 |
+
- text-generation-inference
|
| 427 |
+
datasets:
|
| 428 |
+
- allenai/MADLAD-400
|
| 429 |
+
pipeline_tag: translation
|
| 430 |
+
|
| 431 |
+
widget:
|
| 432 |
+
- text: "<2en> Como vai, amigo?"
|
| 433 |
+
example_title: "Translation to English"
|
| 434 |
+
- text: "<2de> Do you speak German?"
|
| 435 |
+
example_title: "Translation to German"
|
| 436 |
+
|
| 437 |
+
---
|
| 438 |
+
|
| 439 |
+
# Model Card for MADLAD-400-3B-MT
|
| 440 |
+
|
| 441 |
+
# Table of Contents
|
| 442 |
+
|
| 443 |
+
0. [TL;DR](#TL;DR)
|
| 444 |
+
1. [Model Details](#model-details)
|
| 445 |
+
2. [Usage](#usage)
|
| 446 |
+
3. [Uses](#uses)
|
| 447 |
+
4. [Bias, Risks, and Limitations](#bias-risks-and-limitations)
|
| 448 |
+
5. [Training Details](#training-details)
|
| 449 |
+
6. [Evaluation](#evaluation)
|
| 450 |
+
7. [Environmental Impact](#environmental-impact)
|
| 451 |
+
8. [Citation](#citation)
|
| 452 |
+
|
| 453 |
+
# TL;DR
|
| 454 |
+
|
| 455 |
+
MADLAD-400-3B-MT is a multilingual machine translation model based on the T5 architecture that was
|
| 456 |
+
trained on 1 trillion tokens covering over 450 languages using publicly available data.
|
| 457 |
+
It is competitive with models that are significantly larger.
|
| 458 |
+
|
| 459 |
+
**Disclaimer**: [Juarez Bochi](https://huggingface.co/jbochi), who was not involved in this research, converted
|
| 460 |
+
the original weights and wrote the contents of this model card based on the original paper and Flan-T5.
|
| 461 |
+
|
| 462 |
+
# Model Details
|
| 463 |
+
|
| 464 |
+
## Model Description
|
| 465 |
+
|
| 466 |
+
- **Model type:** Language model
|
| 467 |
+
- **Language(s) (NLP):** Multilingual (400+ languages)
|
| 468 |
+
- **License:** Apache 2.0
|
| 469 |
+
- **Related Models:** [All MADLAD-400 Checkpoints](https://huggingface.co/models?search=madlad)
|
| 470 |
+
- **Original Checkpoints:** [All Original MADLAD-400 Checkpoints](https://github.com/google-research/google-research/tree/master/madlad_400)
|
| 471 |
+
- **Resources for more information:**
|
| 472 |
+
- [Research paper](https://arxiv.org/abs/2309.04662)
|
| 473 |
+
- [GitHub Repo](https://github.com/google-research/t5x)
|
| 474 |
+
- [Hugging Face MADLAD-400 Docs (Similar to T5) ](https://huggingface.co/docs/transformers/model_doc/MADLAD-400) - [Pending PR](https://github.com/huggingface/transformers/pull/27471)
|
| 475 |
+
|
| 476 |
+
# Usage
|
| 477 |
+
|
| 478 |
+
Find below some example scripts on how to use the model:
|
| 479 |
+
|
| 480 |
+
## Using the Pytorch model with `transformers`
|
| 481 |
+
|
| 482 |
+
### Running the model on a CPU or GPU
|
| 483 |
+
|
| 484 |
+
<details>
|
| 485 |
+
<summary> Click to expand </summary>
|
| 486 |
+
|
| 487 |
+
First, install the Python packages that are required:
|
| 488 |
+
|
| 489 |
+
`pip install transformers accelerate sentencepiece`
|
| 490 |
+
|
| 491 |
+
```python
|
| 492 |
+
from transformers import T5ForConditionalGeneration, T5Tokenizer
|
| 493 |
+
|
| 494 |
+
model_name = 'jbochi/madlad400-3b-mt'
|
| 495 |
+
model = T5ForConditionalGeneration.from_pretrained(model_name, device_map="auto")
|
| 496 |
+
tokenizer = T5Tokenizer.from_pretrained(model_name)
|
| 497 |
+
|
| 498 |
+
text = "<2pt> I love pizza!"
|
| 499 |
+
input_ids = tokenizer(text, return_tensors="pt").input_ids.to(model.device)
|
| 500 |
+
outputs = model.generate(input_ids=input_ids)
|
| 501 |
+
|
| 502 |
+
tokenizer.decode(outputs[0], skip_special_tokens=True)
|
| 503 |
+
# Eu adoro pizza!
|
| 504 |
+
```
|
| 505 |
+
|
| 506 |
+
</details>
|
| 507 |
+
|
| 508 |
+
## Running the model with Candle
|
| 509 |
+
|
| 510 |
+
<details>
|
| 511 |
+
<summary> Click to expand </summary>
|
| 512 |
+
|
| 513 |
+
Usage with [candle](https://github.com/huggingface/candle):
|
| 514 |
+
|
| 515 |
+
```bash
|
| 516 |
+
$ cargo run --example t5 --release -- \
|
| 517 |
+
--model-id "jbochi/madlad400-3b-mt" \
|
| 518 |
+
--prompt "<2de> How are you, my friend?" \
|
| 519 |
+
--decode --temperature 0
|
| 520 |
+
```
|
| 521 |
+
|
| 522 |
+
We also provide a quantized model (1.65 GB vs the original 11.8 GB file):
|
| 523 |
+
|
| 524 |
+
```
|
| 525 |
+
cargo run --example quantized-t5 --release -- \
|
| 526 |
+
--model-id "jbochi/madlad400-3b-mt" --weight-file "model-q4k.gguf" \
|
| 527 |
+
--prompt "<2de> How are you, my friend?" \
|
| 528 |
+
--temperature 0
|
| 529 |
+
...
|
| 530 |
+
Wie geht es dir, mein Freund?
|
| 531 |
+
```
|
| 532 |
+
|
| 533 |
+
</details>
|
| 534 |
+
|
| 535 |
+
|
| 536 |
+
# Uses
|
| 537 |
+
|
| 538 |
+
## Direct Use and Downstream Use
|
| 539 |
+
|
| 540 |
+
> Primary intended uses: Machine Translation and multilingual NLP tasks on over 400 languages.
|
| 541 |
+
> Primary intended users: Research community.
|
| 542 |
+
|
| 543 |
+
## Out-of-Scope Use
|
| 544 |
+
|
| 545 |
+
> These models are trained on general domain data and are therefore not meant to
|
| 546 |
+
> work on domain-specific models out-of-the box. Moreover, these research models have not been assessed
|
| 547 |
+
> for production usecases.
|
| 548 |
+
|
| 549 |
+
# Bias, Risks, and Limitations
|
| 550 |
+
|
| 551 |
+
> We note that we evaluate on only 204 of the languages supported by these models and on machine translation
|
| 552 |
+
> and few-shot machine translation tasks. Users must consider use of this model carefully for their own
|
| 553 |
+
> usecase.
|
| 554 |
+
|
| 555 |
+
## Ethical considerations and risks
|
| 556 |
+
|
| 557 |
+
> We trained these models with MADLAD-400 and publicly available data to create baseline models that
|
| 558 |
+
> support NLP for over 400 languages, with a focus on languages underrepresented in large-scale corpora.
|
| 559 |
+
> Given that these models were trained with web-crawled datasets that may contain sensitive, offensive or
|
| 560 |
+
> otherwise low-quality content despite extensive preprocessing, it is still possible that these issues to the
|
| 561 |
+
> underlying training data may cause differences in model performance and toxic (or otherwise problematic)
|
| 562 |
+
> output for certain domains. Moreover, large models are dual use technologies that have specific risks
|
| 563 |
+
> associated with their use and development. We point the reader to surveys such as those written by
|
| 564 |
+
> Weidinger et al. or Bommasani et al. for a more detailed discussion of these risks, and to Liebling
|
| 565 |
+
> et al. for a thorough discussion of the risks of machine translation systems.
|
| 566 |
+
|
| 567 |
+
## Known Limitations
|
| 568 |
+
|
| 569 |
+
More information needed
|
| 570 |
+
|
| 571 |
+
## Sensitive Use:
|
| 572 |
+
|
| 573 |
+
More information needed
|
| 574 |
+
|
| 575 |
+
# Training Details
|
| 576 |
+
|
| 577 |
+
> We train models of various sizes: a 3B, 32-layer parameter model,
|
| 578 |
+
> a 7.2B 48-layer parameter model and a 10.7B 32-layer parameter model.
|
| 579 |
+
> We share all parameters of the model across language pairs,
|
| 580 |
+
> and use a Sentence Piece Model with 256k tokens shared on both the encoder and decoder
|
| 581 |
+
> side. Each input sentence has a <2xx> token prepended to the source sentence to indicate the target
|
| 582 |
+
> language.
|
| 583 |
+
|
| 584 |
+
See the [research paper](https://arxiv.org/pdf/2309.04662.pdf) for further details.
|
| 585 |
+
|
| 586 |
+
## Training Data
|
| 587 |
+
|
| 588 |
+
> For both the machine translation and language model, MADLAD-400 is used. For the machine translation
|
| 589 |
+
> model, a combination of parallel datasources covering 157 languages is also used. Further details are
|
| 590 |
+
> described in the [paper](https://arxiv.org/pdf/2309.04662.pdf).
|
| 591 |
+
|
| 592 |
+
## Training Procedure
|
| 593 |
+
|
| 594 |
+
See the [research paper](https://arxiv.org/pdf/2309.04662.pdf) for further details.
|
| 595 |
+
|
| 596 |
+
# Evaluation
|
| 597 |
+
|
| 598 |
+
## Testing Data, Factors & Metrics
|
| 599 |
+
|
| 600 |
+
> For evaluation, we used WMT, NTREX, Flores-200 and Gatones datasets as described in Section 4.3 in the [paper](https://arxiv.org/pdf/2309.04662.pdf).
|
| 601 |
+
|
| 602 |
+
> The translation quality of this model varies based on language, as seen in the paper, and likely varies on
|
| 603 |
+
> domain, though we have not assessed this.
|
| 604 |
+
|
| 605 |
+
## Results
|
| 606 |
+
|
| 607 |
+

|
| 608 |
+
|
| 609 |
+

|
| 610 |
+
|
| 611 |
+

|
| 612 |
+
|
| 613 |
+
See the [research paper](https://arxiv.org/pdf/2309.04662.pdf) for further details.
|
| 614 |
+
|
| 615 |
+
# Environmental Impact
|
| 616 |
+
|
| 617 |
+
More information needed
|
| 618 |
+
|
| 619 |
+
# Citation
|
| 620 |
+
|
| 621 |
+
**BibTeX:**
|
| 622 |
+
|
| 623 |
+
```bibtex
|
| 624 |
+
@misc{kudugunta2023madlad400,
|
| 625 |
+
title={MADLAD-400: A Multilingual And Document-Level Large Audited Dataset},
|
| 626 |
+
author={Sneha Kudugunta and Isaac Caswell and Biao Zhang and Xavier Garcia and Christopher A. Choquette-Choo and Katherine Lee and Derrick Xin and Aditya Kusupati and Romi Stella and Ankur Bapna and Orhan Firat},
|
| 627 |
+
year={2023},
|
| 628 |
+
eprint={2309.04662},
|
| 629 |
+
archivePrefix={arXiv},
|
| 630 |
+
primaryClass={cs.CL}
|
| 631 |
+
}
|
| 632 |
+
```
|
| 633 |
+
|
madlad400_3b/model/added_tokens.json
ADDED
|
@@ -0,0 +1,2 @@
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
}
|
madlad400_3b/model/config.json
ADDED
|
@@ -0,0 +1,29 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"architectures": [
|
| 3 |
+
"T5ForConditionalGeneration"
|
| 4 |
+
],
|
| 5 |
+
"d_ff": 8192,
|
| 6 |
+
"d_kv": 128,
|
| 7 |
+
"d_model": 1024,
|
| 8 |
+
"dropout_rate": 0.1,
|
| 9 |
+
"decoder_start_token_id": 0,
|
| 10 |
+
"pad_token_id": 1,
|
| 11 |
+
"eos_token_id": 2,
|
| 12 |
+
"feed_forward_proj": "gated-gelu",
|
| 13 |
+
"initializer_factor": 1.0,
|
| 14 |
+
"is_encoder_decoder": true,
|
| 15 |
+
"layer_norm_epsilon": 1e-06,
|
| 16 |
+
"model_type": "t5",
|
| 17 |
+
"n_positions": 512,
|
| 18 |
+
"num_decoder_layers": 32,
|
| 19 |
+
"num_heads": 16,
|
| 20 |
+
"num_layers": 32,
|
| 21 |
+
"output_past": true,
|
| 22 |
+
"relative_attention_max_distance": 128,
|
| 23 |
+
"relative_attention_num_buckets": 32,
|
| 24 |
+
"task_specific_params": {},
|
| 25 |
+
"tie_word_embeddings": false,
|
| 26 |
+
"transformers_version": "4.23.1",
|
| 27 |
+
"use_cache": true,
|
| 28 |
+
"vocab_size": 256000
|
| 29 |
+
}
|
madlad400_3b/model/generation_config.json
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"_from_model_config": true,
|
| 3 |
+
"decoder_start_token_id": 0,
|
| 4 |
+
"eos_token_id": 2,
|
| 5 |
+
"pad_token_id": 1,
|
| 6 |
+
"transformers_version": "4.35.0"
|
| 7 |
+
}
|
madlad400_3b/model/special_tokens_map.json
ADDED
|
@@ -0,0 +1,23 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"eos_token": {
|
| 3 |
+
"content": "</s>",
|
| 4 |
+
"lstrip": false,
|
| 5 |
+
"normalized": false,
|
| 6 |
+
"rstrip": false,
|
| 7 |
+
"single_word": false
|
| 8 |
+
},
|
| 9 |
+
"pad_token": {
|
| 10 |
+
"content": "<s>",
|
| 11 |
+
"lstrip": false,
|
| 12 |
+
"normalized": false,
|
| 13 |
+
"rstrip": false,
|
| 14 |
+
"single_word": false
|
| 15 |
+
},
|
| 16 |
+
"unk_token": {
|
| 17 |
+
"content": "<unk>",
|
| 18 |
+
"lstrip": false,
|
| 19 |
+
"normalized": false,
|
| 20 |
+
"rstrip": false,
|
| 21 |
+
"single_word": false
|
| 22 |
+
}
|
| 23 |
+
}
|
madlad400_3b/model/spiece.model
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ef11ac9a22c7503492f56d48dce53be20e339b63605983e9f27d2cd0e0f3922c
|
| 3 |
+
size 4427844
|
madlad400_3b/model/tokenizer.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a2799ccc696b752ba00c34f58726bfe253a04921ceb6cfc620400f560474790b
|
| 3 |
+
size 16629031
|
madlad400_3b/model/tokenizer_config.json
ADDED
|
@@ -0,0 +1,38 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"added_tokens_decoder": {
|
| 3 |
+
"0": {
|
| 4 |
+
"content": "<unk>",
|
| 5 |
+
"lstrip": false,
|
| 6 |
+
"normalized": false,
|
| 7 |
+
"rstrip": false,
|
| 8 |
+
"single_word": false,
|
| 9 |
+
"special": true
|
| 10 |
+
},
|
| 11 |
+
"1": {
|
| 12 |
+
"content": "<s>",
|
| 13 |
+
"lstrip": false,
|
| 14 |
+
"normalized": false,
|
| 15 |
+
"rstrip": false,
|
| 16 |
+
"single_word": false,
|
| 17 |
+
"special": true
|
| 18 |
+
},
|
| 19 |
+
"2": {
|
| 20 |
+
"content": "</s>",
|
| 21 |
+
"lstrip": false,
|
| 22 |
+
"normalized": false,
|
| 23 |
+
"rstrip": false,
|
| 24 |
+
"single_word": false,
|
| 25 |
+
"special": true
|
| 26 |
+
}
|
| 27 |
+
},
|
| 28 |
+
"additional_special_tokens": [],
|
| 29 |
+
"clean_up_tokenization_spaces": true,
|
| 30 |
+
"eos_token": "</s>",
|
| 31 |
+
"extra_ids": 0,
|
| 32 |
+
"legacy": false,
|
| 33 |
+
"model_max_length": 1000000000000000019884624838656,
|
| 34 |
+
"pad_token": "<s>",
|
| 35 |
+
"sp_model_kwargs": {},
|
| 36 |
+
"tokenizer_class": "T5Tokenizer",
|
| 37 |
+
"unk_token": "<unk>"
|
| 38 |
+
}
|
qwen_3_5_4b_gguf/LICENSE
ADDED
|
@@ -0,0 +1,202 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
|
| 2 |
+
Apache License
|
| 3 |
+
Version 2.0, January 2004
|
| 4 |
+
http://www.apache.org/licenses/
|
| 5 |
+
|
| 6 |
+
TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
|
| 7 |
+
|
| 8 |
+
1. Definitions.
|
| 9 |
+
|
| 10 |
+
"License" shall mean the terms and conditions for use, reproduction,
|
| 11 |
+
and distribution as defined by Sections 1 through 9 of this document.
|
| 12 |
+
|
| 13 |
+
"Licensor" shall mean the copyright owner or entity authorized by
|
| 14 |
+
the copyright owner that is granting the License.
|
| 15 |
+
|
| 16 |
+
"Legal Entity" shall mean the union of the acting entity and all
|
| 17 |
+
other entities that control, are controlled by, or are under common
|
| 18 |
+
control with that entity. For the purposes of this definition,
|
| 19 |
+
"control" means (i) the power, direct or indirect, to cause the
|
| 20 |
+
direction or management of such entity, whether by contract or
|
| 21 |
+
otherwise, or (ii) ownership of fifty percent (50%) or more of the
|
| 22 |
+
outstanding shares, or (iii) beneficial ownership of such entity.
|
| 23 |
+
|
| 24 |
+
"You" (or "Your") shall mean an individual or Legal Entity
|
| 25 |
+
exercising permissions granted by this License.
|
| 26 |
+
|
| 27 |
+
"Source" form shall mean the preferred form for making modifications,
|
| 28 |
+
including but not limited to software source code, documentation
|
| 29 |
+
source, and configuration files.
|
| 30 |
+
|
| 31 |
+
"Object" form shall mean any form resulting from mechanical
|
| 32 |
+
transformation or translation of a Source form, including but
|
| 33 |
+
not limited to compiled object code, generated documentation,
|
| 34 |
+
and conversions to other media types.
|
| 35 |
+
|
| 36 |
+
"Work" shall mean the work of authorship, whether in Source or
|
| 37 |
+
Object form, made available under the License, as indicated by a
|
| 38 |
+
copyright notice that is included in or attached to the work
|
| 39 |
+
(an example is provided in the Appendix below).
|
| 40 |
+
|
| 41 |
+
"Derivative Works" shall mean any work, whether in Source or Object
|
| 42 |
+
form, that is based on (or derived from) the Work and for which the
|
| 43 |
+
editorial revisions, annotations, elaborations, or other modifications
|
| 44 |
+
represent, as a whole, an original work of authorship. For the purposes
|
| 45 |
+
of this License, Derivative Works shall not include works that remain
|
| 46 |
+
separable from, or merely link (or bind by name) to the interfaces of,
|
| 47 |
+
the Work and Derivative Works thereof.
|
| 48 |
+
|
| 49 |
+
"Contribution" shall mean any work of authorship, including
|
| 50 |
+
the original version of the Work and any modifications or additions
|
| 51 |
+
to that Work or Derivative Works thereof, that is intentionally
|
| 52 |
+
submitted to Licensor for inclusion in the Work by the copyright owner
|
| 53 |
+
or by an individual or Legal Entity authorized to submit on behalf of
|
| 54 |
+
the copyright owner. For the purposes of this definition, "submitted"
|
| 55 |
+
means any form of electronic, verbal, or written communication sent
|
| 56 |
+
to the Licensor or its representatives, including but not limited to
|
| 57 |
+
communication on electronic mailing lists, source code control systems,
|
| 58 |
+
and issue tracking systems that are managed by, or on behalf of, the
|
| 59 |
+
Licensor for the purpose of discussing and improving the Work, but
|
| 60 |
+
excluding communication that is conspicuously marked or otherwise
|
| 61 |
+
designated in writing by the copyright owner as "Not a Contribution."
|
| 62 |
+
|
| 63 |
+
"Contributor" shall mean Licensor and any individual or Legal Entity
|
| 64 |
+
on behalf of whom a Contribution has been received by Licensor and
|
| 65 |
+
subsequently incorporated within the Work.
|
| 66 |
+
|
| 67 |
+
2. Grant of Copyright License. Subject to the terms and conditions of
|
| 68 |
+
this License, each Contributor hereby grants to You a perpetual,
|
| 69 |
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
| 70 |
+
copyright license to reproduce, prepare Derivative Works of,
|
| 71 |
+
publicly display, publicly perform, sublicense, and distribute the
|
| 72 |
+
Work and such Derivative Works in Source or Object form.
|
| 73 |
+
|
| 74 |
+
3. Grant of Patent License. Subject to the terms and conditions of
|
| 75 |
+
this License, each Contributor hereby grants to You a perpetual,
|
| 76 |
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
| 77 |
+
(except as stated in this section) patent license to make, have made,
|
| 78 |
+
use, offer to sell, sell, import, and otherwise transfer the Work,
|
| 79 |
+
where such license applies only to those patent claims licensable
|
| 80 |
+
by such Contributor that are necessarily infringed by their
|
| 81 |
+
Contribution(s) alone or by combination of their Contribution(s)
|
| 82 |
+
with the Work to which such Contribution(s) was submitted. If You
|
| 83 |
+
institute patent litigation against any entity (including a
|
| 84 |
+
cross-claim or counterclaim in a lawsuit) alleging that the Work
|
| 85 |
+
or a Contribution incorporated within the Work constitutes direct
|
| 86 |
+
or contributory patent infringement, then any patent licenses
|
| 87 |
+
granted to You under this License for that Work shall terminate
|
| 88 |
+
as of the date such litigation is filed.
|
| 89 |
+
|
| 90 |
+
4. Redistribution. You may reproduce and distribute copies of the
|
| 91 |
+
Work or Derivative Works thereof in any medium, with or without
|
| 92 |
+
modifications, and in Source or Object form, provided that You
|
| 93 |
+
meet the following conditions:
|
| 94 |
+
|
| 95 |
+
(a) You must give any other recipients of the Work or
|
| 96 |
+
Derivative Works a copy of this License; and
|
| 97 |
+
|
| 98 |
+
(b) You must cause any modified files to carry prominent notices
|
| 99 |
+
stating that You changed the files; and
|
| 100 |
+
|
| 101 |
+
(c) You must retain, in the Source form of any Derivative Works
|
| 102 |
+
that You distribute, all copyright, patent, trademark, and
|
| 103 |
+
attribution notices from the Source form of the Work,
|
| 104 |
+
excluding those notices that do not pertain to any part of
|
| 105 |
+
the Derivative Works; and
|
| 106 |
+
|
| 107 |
+
(d) If the Work includes a "NOTICE" text file as part of its
|
| 108 |
+
distribution, then any Derivative Works that You distribute must
|
| 109 |
+
include a readable copy of the attribution notices contained
|
| 110 |
+
within such NOTICE file, excluding those notices that do not
|
| 111 |
+
pertain to any part of the Derivative Works, in at least one
|
| 112 |
+
of the following places: within a NOTICE text file distributed
|
| 113 |
+
as part of the Derivative Works; within the Source form or
|
| 114 |
+
documentation, if provided along with the Derivative Works; or,
|
| 115 |
+
within a display generated by the Derivative Works, if and
|
| 116 |
+
wherever such third-party notices normally appear. The contents
|
| 117 |
+
of the NOTICE file are for informational purposes only and
|
| 118 |
+
do not modify the License. You may add Your own attribution
|
| 119 |
+
notices within Derivative Works that You distribute, alongside
|
| 120 |
+
or as an addendum to the NOTICE text from the Work, provided
|
| 121 |
+
that such additional attribution notices cannot be construed
|
| 122 |
+
as modifying the License.
|
| 123 |
+
|
| 124 |
+
You may add Your own copyright statement to Your modifications and
|
| 125 |
+
may provide additional or different license terms and conditions
|
| 126 |
+
for use, reproduction, or distribution of Your modifications, or
|
| 127 |
+
for any such Derivative Works as a whole, provided Your use,
|
| 128 |
+
reproduction, and distribution of the Work otherwise complies with
|
| 129 |
+
the conditions stated in this License.
|
| 130 |
+
|
| 131 |
+
5. Submission of Contributions. Unless You explicitly state otherwise,
|
| 132 |
+
any Contribution intentionally submitted for inclusion in the Work
|
| 133 |
+
by You to the Licensor shall be under the terms and conditions of
|
| 134 |
+
this License, without any additional terms or conditions.
|
| 135 |
+
Notwithstanding the above, nothing herein shall supersede or modify
|
| 136 |
+
the terms of any separate license agreement you may have executed
|
| 137 |
+
with Licensor regarding such Contributions.
|
| 138 |
+
|
| 139 |
+
6. Trademarks. This License does not grant permission to use the trade
|
| 140 |
+
names, trademarks, service marks, or product names of the Licensor,
|
| 141 |
+
except as required for reasonable and customary use in describing the
|
| 142 |
+
origin of the Work and reproducing the content of the NOTICE file.
|
| 143 |
+
|
| 144 |
+
7. Disclaimer of Warranty. Unless required by applicable law or
|
| 145 |
+
agreed to in writing, Licensor provides the Work (and each
|
| 146 |
+
Contributor provides its Contributions) on an "AS IS" BASIS,
|
| 147 |
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
|
| 148 |
+
implied, including, without limitation, any warranties or conditions
|
| 149 |
+
of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
|
| 150 |
+
PARTICULAR PURPOSE. You are solely responsible for determining the
|
| 151 |
+
appropriateness of using or redistributing the Work and assume any
|
| 152 |
+
risks associated with Your exercise of permissions under this License.
|
| 153 |
+
|
| 154 |
+
8. Limitation of Liability. In no event and under no legal theory,
|
| 155 |
+
whether in tort (including negligence), contract, or otherwise,
|
| 156 |
+
unless required by applicable law (such as deliberate and grossly
|
| 157 |
+
negligent acts) or agreed to in writing, shall any Contributor be
|
| 158 |
+
liable to You for damages, including any direct, indirect, special,
|
| 159 |
+
incidental, or consequential damages of any character arising as a
|
| 160 |
+
result of this License or out of the use or inability to use the
|
| 161 |
+
Work (including but not limited to damages for loss of goodwill,
|
| 162 |
+
work stoppage, computer failure or malfunction, or any and all
|
| 163 |
+
other commercial damages or losses), even if such Contributor
|
| 164 |
+
has been advised of the possibility of such damages.
|
| 165 |
+
|
| 166 |
+
9. Accepting Warranty or Additional Liability. While redistributing
|
| 167 |
+
the Work or Derivative Works thereof, You may choose to offer,
|
| 168 |
+
and charge a fee for, acceptance of support, warranty, indemnity,
|
| 169 |
+
or other liability obligations and/or rights consistent with this
|
| 170 |
+
License. However, in accepting such obligations, You may act only
|
| 171 |
+
on Your own behalf and on Your sole responsibility, not on behalf
|
| 172 |
+
of any other Contributor, and only if You agree to indemnify,
|
| 173 |
+
defend, and hold each Contributor harmless for any liability
|
| 174 |
+
incurred by, or claims asserted against, such Contributor by reason
|
| 175 |
+
of your accepting any such warranty or additional liability.
|
| 176 |
+
|
| 177 |
+
END OF TERMS AND CONDITIONS
|
| 178 |
+
|
| 179 |
+
APPENDIX: How to apply the Apache License to your work.
|
| 180 |
+
|
| 181 |
+
To apply the Apache License to your work, attach the following
|
| 182 |
+
boilerplate notice, with the fields enclosed by brackets "[]"
|
| 183 |
+
replaced with your own identifying information. (Don't include
|
| 184 |
+
the brackets!) The text should be enclosed in the appropriate
|
| 185 |
+
comment syntax for the file format. We also recommend that a
|
| 186 |
+
file or class name and description of purpose be included on the
|
| 187 |
+
same "printed page" as the copyright notice for easier
|
| 188 |
+
identification within third-party archives.
|
| 189 |
+
|
| 190 |
+
Copyright 2026 Alibaba Cloud
|
| 191 |
+
|
| 192 |
+
Licensed under the Apache License, Version 2.0 (the "License");
|
| 193 |
+
you may not use this file except in compliance with the License.
|
| 194 |
+
You may obtain a copy of the License at
|
| 195 |
+
|
| 196 |
+
http://www.apache.org/licenses/LICENSE-2.0
|
| 197 |
+
|
| 198 |
+
Unless required by applicable law or agreed to in writing, software
|
| 199 |
+
distributed under the License is distributed on an "AS IS" BASIS,
|
| 200 |
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
| 201 |
+
See the License for the specific language governing permissions and
|
| 202 |
+
limitations under the License.
|
qwen_3_5_4b_gguf/Qwen3.5-4B-Q4_K_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:00fe7986ff5f6b463e62455821146049db6f9313603938a70800d1fb69ef11a4
|
| 3 |
+
size 2740937888
|
qwen_3_5_4b_gguf/mmproj-F16.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cd88edcf8d031894960bb0c9c5b9b7e1fea6ebee02b9f7ce925a00d12891f864
|
| 3 |
+
size 672423616
|