Text Generation
Transformers
Safetensors
hy_v3
hunyuan
hy3
Mixture of Experts
conversational
Eval Results
Instructions to use tencent/Hy3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use tencent/Hy3 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="tencent/Hy3") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("tencent/Hy3") model = AutoModelForCausalLM.from_pretrained("tencent/Hy3", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Inference
- HuggingChat
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use tencent/Hy3 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "tencent/Hy3" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "tencent/Hy3", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/tencent/Hy3
- SGLang
How to use tencent/Hy3 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "tencent/Hy3" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "tencent/Hy3", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "tencent/Hy3" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "tencent/Hy3", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use tencent/Hy3 with Docker Model Runner:
docker model run hf.co/tencent/Hy3
Add files using upload-large-folder tool
Browse files- chat_template.jinja +204 -0
- config.json +46 -0
- generation_config.json +10 -0
- model-00009-of-00099.safetensors +3 -0
- model-00011-of-00099.safetensors +3 -0
- model-00013-of-00099.safetensors +3 -0
- model-00014-of-00099.safetensors +3 -0
- model-00017-of-00099.safetensors +3 -0
- model-00023-of-00099.safetensors +3 -0
- model-00025-of-00099.safetensors +3 -0
- model-00026-of-00099.safetensors +3 -0
- model-00027-of-00099.safetensors +3 -0
- model-00029-of-00099.safetensors +3 -0
- model-00032-of-00099.safetensors +3 -0
- model-00033-of-00099.safetensors +3 -0
- model-00034-of-00099.safetensors +3 -0
- model-00035-of-00099.safetensors +3 -0
- model-00037-of-00099.safetensors +3 -0
- model-00041-of-00099.safetensors +3 -0
- model-00043-of-00099.safetensors +3 -0
- model-00050-of-00099.safetensors +3 -0
- model-00053-of-00099.safetensors +3 -0
- model-00055-of-00099.safetensors +3 -0
- model-00056-of-00099.safetensors +3 -0
- model-00057-of-00099.safetensors +3 -0
- model-00061-of-00099.safetensors +3 -0
- model-00064-of-00099.safetensors +3 -0
- model-00065-of-00099.safetensors +3 -0
- model-00067-of-00099.safetensors +3 -0
- model-00068-of-00099.safetensors +3 -0
- model-00069-of-00099.safetensors +3 -0
- model-00070-of-00099.safetensors +3 -0
- model-00074-of-00099.safetensors +3 -0
- model-00076-of-00099.safetensors +3 -0
- model-00078-of-00099.safetensors +3 -0
- model-00081-of-00099.safetensors +3 -0
- model-00083-of-00099.safetensors +3 -0
- model-00084-of-00099.safetensors +3 -0
- model-00087-of-00099.safetensors +3 -0
- model-00088-of-00099.safetensors +3 -0
- model-00089-of-00099.safetensors +3 -0
- model-00093-of-00099.safetensors +3 -0
- model-00094-of-00099.safetensors +3 -0
- model-00095-of-00099.safetensors +3 -0
- model-00096-of-00099.safetensors +3 -0
- model-00098-of-00099.safetensors +3 -0
- model-00099-of-00099.safetensors +3 -0
- model.safetensors.index.json +0 -0
- tokenizer.json +0 -0
- tokenizer_config.json +0 -0
chat_template.jinja
ADDED
|
@@ -0,0 +1,204 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{#- ----------‑‑‑ special token variables ‑‑‑---------- -#}
|
| 2 |
+
{%- set HYTK = ':opensource' %}
|
| 3 |
+
{%- set eos_token = '<|hy_eos{}|>'.format(HYTK) %}
|
| 4 |
+
{%- set bos_token = '<|hy_begin_of_sentence{}|>'.format(HYTK) %}
|
| 5 |
+
{%- set pad_token = '<|hy_pad{}|>'.format(HYTK) %}
|
| 6 |
+
{%- set user_token = '<|hy_User{}|>'.format(HYTK) %}
|
| 7 |
+
{%- set assistant_token = '<|hy_Assistant{}|>'.format(HYTK) %}
|
| 8 |
+
{%- set think_begin_token = '<think{}>'.format(HYTK) %}
|
| 9 |
+
{%- set think_end_token = '</think{}>'.format(HYTK) %}
|
| 10 |
+
{%- set toolcalls_begin_token = '<tool_calls{}>'.format(HYTK) %}
|
| 11 |
+
{%- set toolcalls_end_token = '</tool_calls{}>'.format(HYTK) %}
|
| 12 |
+
{%- set toolcall_begin_token = '<tool_call{}>'.format(HYTK) %}
|
| 13 |
+
{%- set toolcall_end_token = '</tool_call{}>'.format(HYTK) %}
|
| 14 |
+
{%- set toolsep_token = '<tool_sep{}>'.format(HYTK) %}
|
| 15 |
+
{%- set argkey_begin_token = '<arg_key{}>'.format(HYTK) %}
|
| 16 |
+
{%- set argkey_end_token = '</arg_key{}>'.format(HYTK) %}
|
| 17 |
+
{%- set argvalue_begin_token = '<arg_value{}>'.format(HYTK) %}
|
| 18 |
+
{%- set argvalue_end_token = '</arg_value{}>'.format(HYTK) %}
|
| 19 |
+
{%- set toolresponses_begin_token = '<tool_responses{}>'.format(HYTK) %}
|
| 20 |
+
{%- set toolresponses_end_token = '</tool_responses{}>'.format(HYTK) %}
|
| 21 |
+
{%- set toolresponse_begin_token = '<tool_response{}>'.format(HYTK) %}
|
| 22 |
+
{%- set toolresponse_end_token = '</tool_response{}>'.format(HYTK) %}
|
| 23 |
+
{%- set reasoning_mode_token = '<|reasoning_mode{}|>'.format(HYTK) %}
|
| 24 |
+
|
| 25 |
+
{#- ----------‑‑‑ hyperparameters variables ‑‑‑---------- -#}
|
| 26 |
+
{%- if not add_generation_prompt is defined %}
|
| 27 |
+
{%- set add_generation_prompt = false %}
|
| 28 |
+
{%- endif %}
|
| 29 |
+
{%- if not preserved_thinking is defined %}
|
| 30 |
+
{%- if not tools %}
|
| 31 |
+
{%- set preserved_thinking = false %}
|
| 32 |
+
{%- else %}
|
| 33 |
+
{%- set preserved_thinking = true %}
|
| 34 |
+
{%- endif %}
|
| 35 |
+
{%- endif %}
|
| 36 |
+
{%- if not is_training is defined %}
|
| 37 |
+
{%- set is_training = false %}
|
| 38 |
+
{%- endif %}
|
| 39 |
+
|
| 40 |
+
{%- if not reasoning_effort is defined %}
|
| 41 |
+
{%- set reasoning_effort = 'no_think' %}
|
| 42 |
+
{%- elif reasoning_effort not in ['high', 'low', 'no_think'] %}
|
| 43 |
+
{%- if reasoning_effort is none %}
|
| 44 |
+
{{- raise_exception('reasoning_effort error : None, should be no_think/low/high') }}
|
| 45 |
+
{%- else %}
|
| 46 |
+
{{- raise_exception('reasoning_effort error : ' + reasoning_effort + ', should be no_think/low/high') }}
|
| 47 |
+
{%- endif %}
|
| 48 |
+
{%- endif %}
|
| 49 |
+
|
| 50 |
+
{%- if fallback_strategy is defined and fallback_strategy == 'reasoning_toolcall_retry' %}
|
| 51 |
+
{%- set reasoning_effort = 'high' %}
|
| 52 |
+
{%- set add_generation_prompt = false %}
|
| 53 |
+
{%- endif %}
|
| 54 |
+
{%- if not raw_last_assistant is defined %}
|
| 55 |
+
{%- set raw_last_assistant = false %}
|
| 56 |
+
{%- endif %}
|
| 57 |
+
|
| 58 |
+
{%- macro visible_text(content) -%}
|
| 59 |
+
{%- if content is string -%}
|
| 60 |
+
{{- content }}
|
| 61 |
+
{%- elif content is iterable and content is not mapping -%}
|
| 62 |
+
{%- for item in content -%}
|
| 63 |
+
{%- if item is mapping and item.type == 'text' -%}
|
| 64 |
+
{{- item.text }}
|
| 65 |
+
{%- elif item is string -%}
|
| 66 |
+
{{- item }}
|
| 67 |
+
{%- endif -%}
|
| 68 |
+
{%- endfor -%}
|
| 69 |
+
{%- elif content is none -%}
|
| 70 |
+
{{- '' }}
|
| 71 |
+
{%- else -%}
|
| 72 |
+
{{- content }}
|
| 73 |
+
{%- endif -%}
|
| 74 |
+
{%- endmacro -%}
|
| 75 |
+
|
| 76 |
+
{%- set ns = namespace(last_user_index=-1) %}
|
| 77 |
+
{%- set sp_ns = namespace(system_prompt='', is_first_sp=true) %}
|
| 78 |
+
{%- for message in messages %}
|
| 79 |
+
{%- if message['role'] == 'system' %}
|
| 80 |
+
{%- set sp_ns.system_prompt = sp_ns.system_prompt + visible_text(message['content']) %}
|
| 81 |
+
{%- endif %}
|
| 82 |
+
{%- if message['role'] == 'user' %}
|
| 83 |
+
{%- set ns.last_user_index = loop.index0 %}
|
| 84 |
+
{%- endif %}
|
| 85 |
+
{%- endfor %}
|
| 86 |
+
{%- if reasoning_effort is defined and reasoning_effort is string and reasoning_effort != '' and not tools %}
|
| 87 |
+
{%- set sp_ns.system_prompt = sp_ns.system_prompt + reasoning_mode_token + 'reasoning_effort:' + reasoning_effort %}
|
| 88 |
+
{%- endif %}
|
| 89 |
+
{{- bos_token }}
|
| 90 |
+
{{- sp_ns.system_prompt }}
|
| 91 |
+
{%- if tools %}
|
| 92 |
+
{%- if sp_ns.system_prompt != '' %}
|
| 93 |
+
{{- '\n\n# Tools\n\nYou may call one or more functions to assist with the user query.' }}
|
| 94 |
+
{%- else %}
|
| 95 |
+
{{- '# Tools\n\nYou may call one or more functions to assist with the user query.' }}
|
| 96 |
+
{%- endif %}
|
| 97 |
+
{{- '\n\nYou are provided with function signatures within <tools></tools> XML tags:' }}
|
| 98 |
+
{{- '\n<tools>\n' }}
|
| 99 |
+
{%- for tool in tools %}
|
| 100 |
+
{%- if loop.index0 > 0 %}
|
| 101 |
+
{{- '\n' }}
|
| 102 |
+
{%- endif %}
|
| 103 |
+
{{- tool | tojson }}
|
| 104 |
+
{%- endfor %}
|
| 105 |
+
{{- '\n</tools>\n\n' }}
|
| 106 |
+
{{- 'For function call returns, you should first print ' + toolcalls_begin_token + '\n' }}
|
| 107 |
+
{{- 'For each function call, you should return object like:\n' }}
|
| 108 |
+
{{- toolcall_begin_token + '{function-name}' + toolsep_token + '\n' }}
|
| 109 |
+
{{- argkey_begin_token + '{arg-key-1}' + argkey_end_token + '\n' }}
|
| 110 |
+
{{- argvalue_begin_token + '{arg-value-1}' + argvalue_end_token + '\n' }}
|
| 111 |
+
{{- argkey_begin_token + '{arg-key-2}' + argkey_end_token + '\n' }}
|
| 112 |
+
{{- argvalue_begin_token + '{arg-value-2}' + argvalue_end_token + '\n' }}
|
| 113 |
+
{{- '...\n' }}
|
| 114 |
+
{{- toolcall_end_token + '\n' }}
|
| 115 |
+
{%- if reasoning_effort is defined and reasoning_effort is string and reasoning_effort != '' %}
|
| 116 |
+
{{- 'At the end of function call returns, you should print ' + toolcalls_end_token + reasoning_mode_token + 'reasoning_effort:' + reasoning_effort }}
|
| 117 |
+
{%- else %}
|
| 118 |
+
{{- 'At the end of function call returns, you should print ' + toolcalls_end_token }}
|
| 119 |
+
{%- endif %}
|
| 120 |
+
{%- endif %}
|
| 121 |
+
|
| 122 |
+
{%- set prev_ns = namespace(is_tool=false, is_tool_first=true) %}
|
| 123 |
+
{%- set last_ns = namespace(last_is_assistant=false) %}
|
| 124 |
+
{%- for message in messages %}
|
| 125 |
+
{%- if message['role'] == 'user' %}
|
| 126 |
+
{%- if prev_ns.is_tool %}
|
| 127 |
+
{{- toolresponses_end_token }}
|
| 128 |
+
{%- endif %}
|
| 129 |
+
{{- user_token + visible_text(message['content']) }}
|
| 130 |
+
{%- set prev_ns.is_tool = false %}
|
| 131 |
+
{%- endif %}
|
| 132 |
+
{%- if message['role'] == 'assistant' %}
|
| 133 |
+
{%- if is_training %}
|
| 134 |
+
{%- if 'reasoning_content' in message and message['reasoning_content'] is string %}
|
| 135 |
+
{%- set content = think_begin_token + message['reasoning_content'] + think_end_token + visible_text(message['content']) %}
|
| 136 |
+
{%- else %}
|
| 137 |
+
{%- set content = think_begin_token + think_end_token + visible_text(message['content']) %}
|
| 138 |
+
{%- endif %}
|
| 139 |
+
{%- else %}
|
| 140 |
+
{%- if ((preserved_thinking is defined and preserved_thinking) or loop.index0 > ns.last_user_index) and 'reasoning_content' in message and message['reasoning_content'] is string %}
|
| 141 |
+
{%- set content = think_begin_token + message['reasoning_content'] + think_end_token + visible_text(message['content']) %}
|
| 142 |
+
{%- else %}
|
| 143 |
+
{%- set content = think_begin_token + think_end_token + visible_text(message['content']) %}
|
| 144 |
+
{%- endif %}
|
| 145 |
+
{%- endif %}
|
| 146 |
+
{%- if prev_ns.is_tool %}
|
| 147 |
+
{{- toolresponses_end_token }}
|
| 148 |
+
{%- endif %}
|
| 149 |
+
{{- assistant_token }}
|
| 150 |
+
{%- if message['tool_calls'] is defined and message['tool_calls'] %}
|
| 151 |
+
{%- set prev_ns.is_tool_first = true %}
|
| 152 |
+
{{- content }}
|
| 153 |
+
{{- toolcalls_begin_token + '\n' }}
|
| 154 |
+
{%- for tool in message['tool_calls'] %}
|
| 155 |
+
{%- set arguments = tool['function']['arguments'] %}
|
| 156 |
+
{{- toolcall_begin_token + tool['function']['name'] + toolsep_token + '\n' }}
|
| 157 |
+
{%- for key, value in arguments.items() %}
|
| 158 |
+
{{- argkey_begin_token + key + argkey_end_token + '\n' }}
|
| 159 |
+
{%- if value is not string %}
|
| 160 |
+
{%- set value = value | tojson(ensure_ascii=False) %}
|
| 161 |
+
{%- endif %}
|
| 162 |
+
{{- argvalue_begin_token + value + argvalue_end_token + '\n' }}
|
| 163 |
+
{%- endfor %}
|
| 164 |
+
{{- toolcall_end_token + '\n' }}
|
| 165 |
+
{%- endfor %}
|
| 166 |
+
{{- toolcalls_end_token + eos_token }}
|
| 167 |
+
{%- else %}
|
| 168 |
+
{%- if loop.last and raw_last_assistant %}
|
| 169 |
+
{{- visible_text(message['content']) }}
|
| 170 |
+
{%- elif not loop.last or is_training %}
|
| 171 |
+
{{- content + eos_token }}
|
| 172 |
+
{%- else %}
|
| 173 |
+
{{- content }}
|
| 174 |
+
{%- endif %}
|
| 175 |
+
{%- endif %}
|
| 176 |
+
{%- set prev_ns.is_tool = false %}
|
| 177 |
+
{%- endif %}
|
| 178 |
+
{%- if message['role'] == 'tool' %}
|
| 179 |
+
{%- set prev_ns.is_tool = true %}
|
| 180 |
+
{%- if prev_ns.is_tool_first %}
|
| 181 |
+
{{- toolresponses_begin_token + '\n' }}
|
| 182 |
+
{%- set prev_ns.is_tool_first = false %}
|
| 183 |
+
{%- endif %}
|
| 184 |
+
{{- toolresponse_begin_token + '\n' + visible_text(message['content']) + '\n' + toolresponse_end_token + '\n' }}
|
| 185 |
+
{%- endif %}
|
| 186 |
+
{%- if loop.last and message['role'] == 'assistant' %}
|
| 187 |
+
{%- set last_ns.last_is_assistant = true %}
|
| 188 |
+
{%- endif %}
|
| 189 |
+
|
| 190 |
+
{%- endfor %}
|
| 191 |
+
{%- if prev_ns.is_tool %}
|
| 192 |
+
{{- toolresponses_end_token }}
|
| 193 |
+
{%- endif %}
|
| 194 |
+
{%- if add_generation_prompt %}
|
| 195 |
+
{%- if not last_ns.last_is_assistant %}
|
| 196 |
+
{%- if reasoning_effort is defined and reasoning_effort in ['low', 'high'] %}
|
| 197 |
+
{{- assistant_token + think_begin_token }}
|
| 198 |
+
{%- elif reasoning_effort is defined and reasoning_effort == 'no_think' %}
|
| 199 |
+
{{- assistant_token + think_begin_token + think_end_token }}
|
| 200 |
+
{%- else %}
|
| 201 |
+
{{- assistant_token }}
|
| 202 |
+
{%- endif %}
|
| 203 |
+
{%- endif %}
|
| 204 |
+
{%- endif %}
|
config.json
ADDED
|
@@ -0,0 +1,46 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"architectures": [
|
| 3 |
+
"HYV3ForCausalLM"
|
| 4 |
+
],
|
| 5 |
+
"bos_token_id": 120000,
|
| 6 |
+
"enable_attention_fp32_softmax": false,
|
| 7 |
+
"enable_lm_head_fp32": true,
|
| 8 |
+
"enable_moe_fp32_combine": false,
|
| 9 |
+
"eod_token_id": 120026,
|
| 10 |
+
"eos_token_id": 120025,
|
| 11 |
+
"expert_hidden_dim": 1536,
|
| 12 |
+
"moe_intermediate_size": 1536,
|
| 13 |
+
"first_k_dense_replace": 1,
|
| 14 |
+
"head_dim": 128,
|
| 15 |
+
"hidden_act": "silu",
|
| 16 |
+
"hidden_size": 4096,
|
| 17 |
+
"initializer_range": 0.006,
|
| 18 |
+
"intermediate_size": 13312,
|
| 19 |
+
"max_position_embeddings": 262144,
|
| 20 |
+
"model_type": "hy_v3",
|
| 21 |
+
"moe_router_enable_expert_bias": true,
|
| 22 |
+
"moe_router_use_sigmoid": true,
|
| 23 |
+
"num_attention_heads": 64,
|
| 24 |
+
"num_experts": 192,
|
| 25 |
+
"num_experts_per_tok": 8,
|
| 26 |
+
"num_hidden_layers": 80,
|
| 27 |
+
"num_key_value_heads": 8,
|
| 28 |
+
"num_shared_experts": 1,
|
| 29 |
+
"output_router_logits": true,
|
| 30 |
+
"pad_token_id": 120002,
|
| 31 |
+
"qk_norm": true,
|
| 32 |
+
"rms_norm_eps": 1e-05,
|
| 33 |
+
"rope_parameters": {
|
| 34 |
+
"rope_theta": 11158840.0,
|
| 35 |
+
"rope_type": "default"
|
| 36 |
+
},
|
| 37 |
+
"route_norm": true,
|
| 38 |
+
"router_scaling_factor": 2.826,
|
| 39 |
+
"sep_token_id": 120007,
|
| 40 |
+
"tie_word_embeddings": false,
|
| 41 |
+
"transformers_version": "5.6.0",
|
| 42 |
+
"use_cache": true,
|
| 43 |
+
"use_grouped_mm": false,
|
| 44 |
+
"vocab_size": 120832,
|
| 45 |
+
"num_nextn_predict_layers": 1
|
| 46 |
+
}
|
generation_config.json
ADDED
|
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"bos_token_id": 120000,
|
| 3 |
+
"do_sample": true,
|
| 4 |
+
"eos_token_id": 120025,
|
| 5 |
+
"pad_token_id": 120002,
|
| 6 |
+
"temperature": 0.9,
|
| 7 |
+
"top_k": -1,
|
| 8 |
+
"top_p": 1,
|
| 9 |
+
"transformers_version": "5.6.0"
|
| 10 |
+
}
|
model-00009-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:09dbd820bd4dcb306976105266dbb017b2d0f1a8019bd37b6dbd4bf859e35c59
|
| 3 |
+
size 7247829584
|
model-00011-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:29c8d8a926246569e553a1486b1d9f40774ed4bc46ff6a33e3e425ea76bb5e16
|
| 3 |
+
size 7247829584
|
model-00013-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1a8222ce5abf81d4cdf72fc8ff23d37d09cfc972552b7db1e2f63adcaf15d249
|
| 3 |
+
size 7247829008
|
model-00014-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fcc9f1aed84d47e68df595eff48272e6726c77e96c78d89ded6294ce958e6332
|
| 3 |
+
size 7247829584
|
model-00017-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6d6e18ece70a4813a408b894a0399bd830c18a6888788b263bfef17b880272c4
|
| 3 |
+
size 7247829584
|
model-00023-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:52d9924ead7e25ddf5019cc7e9504b3dc113f4777202f05cb9916d55f2a25ea2
|
| 3 |
+
size 7247829584
|
model-00025-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4e428cd287456c189baac90b1ca8aa2d0d9e1cb453faf0ca827a062913874c84
|
| 3 |
+
size 7247829008
|
model-00026-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a3f98207f6205818674908052efb4c3adeed6ce73154617323177df347a6da4d
|
| 3 |
+
size 7247829584
|
model-00027-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:59946d434bd2e6377c68728b5417285c77510ccc13a2c873b0ad96002f5a3914
|
| 3 |
+
size 7247829584
|
model-00029-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d9a7b69c60dbb9afdc447bb0dc06a643846ef83da32b9206c1ca9b37b6e91d6a
|
| 3 |
+
size 7247829584
|
model-00032-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:51216f9f9d6658aea0277e9e73a91083223193d9b166ab62961290be3050a9a1
|
| 3 |
+
size 7247829584
|
model-00033-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:986014e11dbc2ebbd20465f7a7a7558bc7e6640d76753cf6e308ef91a1c73833
|
| 3 |
+
size 7247829584
|
model-00034-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:70225673b81ed882c341329979749df9ebf3d76397bc062cd8d45985578b6aaa
|
| 3 |
+
size 7247829584
|
model-00035-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:496c6fa66c557193f11c3bc8c53da798293ba4dd549055d6d7228a74d8f3f47b
|
| 3 |
+
size 7247829584
|
model-00037-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:96d1b08006c13931f68c4974cf90b48eb027da6da70bd79e83d436e04bf1c5de
|
| 3 |
+
size 7247829008
|
model-00041-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3973686874599c9c0b886b43387a0b05f073752aed07de84db823f709ea8ae87
|
| 3 |
+
size 7247829584
|
model-00043-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5f3fe90acd2f05b6a5e3e7c5f386b9022f88a22f0014b407bb3338134360699c
|
| 3 |
+
size 7247829008
|
model-00050-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:eb19dd3b2c5af8b04644627d61f3f9d5b5bd29216bd445ad1535a57523b8de49
|
| 3 |
+
size 7247829584
|
model-00053-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3f9b8622863a45a26567fca442a2367046f0ead2e61f03a186abf3986c2171c2
|
| 3 |
+
size 7247829584
|
model-00055-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4fafb37815f208ac4906d5f5b72714824c6b7a2b1cf6cdd339722f1d67a19bbf
|
| 3 |
+
size 7247829584
|
model-00056-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5da89fbcd0a244e021b940ec44424ed0cd409981a3b45797e15a917c08be8422
|
| 3 |
+
size 7247829584
|
model-00057-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ce571a8b37fed26a860426530dd9a3f845b596c27370d0707efce65e484b8e47
|
| 3 |
+
size 7247829584
|
model-00061-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:512e72f955cfa0a82763d1b04261d94499726ecb4f91f1a2a052061f5484aac5
|
| 3 |
+
size 7247829584
|
model-00064-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2c3996ae8bd0cca00b6086321129510b9dcb6e08a23460acddf1e0ac10b60f52
|
| 3 |
+
size 7247829584
|
model-00065-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:83b8bafe62c73fcaafb0253a995ecef38fc29470837179fb601f98be419b7ef6
|
| 3 |
+
size 7247829584
|
model-00067-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:728ef063f8c5300e212790a866688409b9fd08e5544dd93769ba66313b7897cd
|
| 3 |
+
size 7247829584
|
model-00068-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:28ed8a375ef1828f2b72a0ce5f02f4931c91cf672b8b9c10262b50e016ce9777
|
| 3 |
+
size 7247829584
|
model-00069-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a259c199f91b5169116af02c95f5a0a310fc39f2a1c953b9cd52a593e5b76e5b
|
| 3 |
+
size 7247829584
|
model-00070-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fc1961320c73f97cb414578014506d30196d4b12ff55de1d16a0bd738bb6687d
|
| 3 |
+
size 7247829584
|
model-00074-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f5e6b760456aa53de13110ec546d2698130a0b10c66a3c86ce35102e875b4f34
|
| 3 |
+
size 7247829584
|
model-00076-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c85bfae1efcac7b311febcb05b35ebb035b7c6d2ca2cb53f6c5b1ad692b1be3f
|
| 3 |
+
size 7247829584
|
model-00078-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7d9e89fcd78d0e325ae4c841ad88f85604e42f3f8ffd2011b0e53edf7ea612f8
|
| 3 |
+
size 1006636320
|
model-00081-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d686a0fdc1daf31ee44bd9714b5fe393c6da2324de0e4aea0f922933ea63dce7
|
| 3 |
+
size 7247829584
|
model-00083-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ec422be669830657fd93e0ca9831a324f4925e823ec65f69d06de3c848e0f870
|
| 3 |
+
size 7247829584
|
model-00084-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:62bac69dd8112f917d78907d260433409503d2304343d38635fbc1f58351b1e0
|
| 3 |
+
size 1006637128
|
model-00087-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bf7e6705a57a771c2e9740120c9cc736899a22f56b588362560732ffe9d89bf3
|
| 3 |
+
size 7247829584
|
model-00088-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e02b1f3c9d7cdc207f71ea18d49c2d04a70108ed1d6ef7fd6d198e64cd617f0e
|
| 3 |
+
size 7247829584
|
model-00089-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ae081bc5cba906f206d28ff184fae4239bbca4ba191ace7d8a32b94827955fbf
|
| 3 |
+
size 7247829584
|
model-00093-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e95e4f54980ddee6c447c639363d4c4d16c471a5a0f59d1fef2deb63f409c830
|
| 3 |
+
size 7247829584
|
model-00094-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f7b1125b7dd8fb1540dcbf88c58f55daa23ec99409e3c5edbb81c57af977a925
|
| 3 |
+
size 7247829584
|
model-00095-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ee79a555173f409a2cb78a215a3160f0fc322efec1ffed32450755b06905fd09
|
| 3 |
+
size 7247829584
|
model-00096-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1b66c240042bbe649ffe3411b44a449e64eb86123e502504e767d2b67f7f9fae
|
| 3 |
+
size 4831886200
|
model-00098-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3981cec5493da0ef184aa0d8b58c1a95d194abe2588749a694ebd48b53eab0e4
|
| 3 |
+
size 989855856
|
model-00099-of-00099.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fe9bc39636ac0fb248b350b8be9804c96820e5816047402e7f6b65bb94da15a6
|
| 3 |
+
size 822086024
|
model.safetensors.index.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
tokenizer.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
tokenizer_config.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|