misono commited on
Commit
f94ad56
·
verified ·
1 Parent(s): 86828f7

docs: align model card with technical report and inference defaults

Browse files
Files changed (1) hide show
  1. README.md +31 -6
README.md CHANGED
@@ -36,6 +36,8 @@ The evaluated 2B and 9B models combine the general, instruction, and meme specia
36
 
37
  Results below reproduce the latest technical report. Comparisons apply to the report's evaluation data and settings, and metric scales differ. Higher is better except for off-target rates. These are individual benchmark scores, separate from the demo's normalized radar categories.
38
 
 
 
39
  ### Main translation benchmarks
40
 
41
  WMT26 Judge uses a **0–100** scale; the other columns use **0–1**. instTrans quality and IFscore measure translation quality and instruction adherence separately. IFMTBench reports reference-based XCOMET-XXL and instruction adherence. Vertical is the equal-weight mean of the five domain scores below. North-Small-Translate is the **218B-A25B** model; TranslateGemma is **translategemma-12b-it**.
@@ -111,14 +113,37 @@ The **1,024-token output budget in the inference client below is a usage default
111
 
112
  ### Default settings
113
 
114
- These settings match the released GitHub text client and apply across Index-Translate sizes:
115
 
116
- | Setting | Default |
117
  |---|---|
118
- | Decoding | Greedy, **`temperature=0`** |
119
- | Thinking | Disabled: `enable_thinking=False` |
120
- | Output budget | `max_tokens=1024` |
121
- | `top_p`, `top_k`, repetition penalties | Not explicitly set by the client; use inference-server defaults |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
122
 
123
  The shipped configuration sets `max_position_embeddings=262144`. The examples below use **`--max-model-len 32768`**, matching the GitHub 2B/9B Translate serving preset. Input plus output must fit within the served context, and available GPU memory constrains practical lengths. Increase the client output budget for longer translations.
124
 
 
36
 
37
  Results below reproduce the latest technical report. Comparisons apply to the report's evaluation data and settings, and metric scales differ. Higher is better except for off-target rates. These are individual benchmark scores, separate from the demo's normalized radar categories.
38
 
39
+ The tables compare this checkpoint with the other Index-Translate sizes, **Hy-MT2-7B**, **TranslateGemma-12B**, and the **Qwen3.5-9B** base at a similar scale, and larger translation models and API baselines.
40
+
41
  ### Main translation benchmarks
42
 
43
  WMT26 Judge uses a **0–100** scale; the other columns use **0–1**. instTrans quality and IFscore measure translation quality and instruction adherence separately. IFMTBench reports reference-based XCOMET-XXL and instruction adherence. Vertical is the equal-weight mean of the five domain scores below. North-Small-Translate is the **218B-A25B** model; TranslateGemma is **translategemma-12b-it**.
 
113
 
114
  ### Default settings
115
 
116
+ The following settings describe the released [`translate.py`](https://github.com/bilibili/Index-Translate/blob/main/inference/llm/translate.py) client. Its decoding defaults apply across Index-Translate sizes; the commands below explicitly select this card's model.
117
 
118
+ | Setting | Client default and override |
119
  |---|---|
120
+ | Decoding | Greedy, **`temperature=0`**; override with `--temperature` |
121
+ | Output budget | `max_tokens=1024`; override with `--max-tokens` |
122
+ | Thinking | Disabled through `chat_template_kwargs={"enable_thinking": False}`; no thinking toggle in this CLI |
123
+ | Top-p / top-k / min-p | Not explicitly set by this client; inference-server defaults apply |
124
+ | Presence / frequency / repetition penalties | Not explicitly set by this client; inference-server defaults apply |
125
+ | Random seed | Not explicitly set by this client; inference-server behavior applies |
126
+ | Stop strings / stop-token IDs / ignore-EOS | Not explicitly set by this client; inference-server and model defaults apply |
127
+ | Model ID | `IndexTeam/Index-Translate-9B`; `INDEX_MODEL` changes the default, and `--model` overrides it |
128
+ | Source language | `auto`; override with `--source` / `-s`; auto omits the source-language name from the prompt |
129
+ | Target language | `en`; override with `--target` / `-t` |
130
+ | Endpoint | `http://127.0.0.1:8000/v1`; `OPENAI_BASE_URL` changes the default, and `--base-url` overrides it |
131
+ | API key | `EMPTY` for local serving; `OPENAI_API_KEY` changes the default, and `--api-key` overrides it |
132
+ | Request format | One user message; no system message is added by the client |
133
+ | Response streaming | Not enabled by this client; it prints the complete response |
134
+ | Transport timeout and retries | No explicit values set by the script; installed OpenAI / HTTPX client behavior applies |
135
+ | Proxy handling | Environment proxies disabled for `127.0.0.1`, `localhost`, and `::1`; remote endpoints use the OpenAI client's usual behavior |
136
+ | Input / output | Positional text or stdin; input is stripped and empty input is rejected; output is stripped and any emitted thinking block is removed |
137
+
138
+ The client maps supported short language codes to Chinese language names in the prompt. Provide the full language name for a code outside its mapping. Its training-aligned prompt is:
139
+
140
+ ```text
141
+ 请将以下{source-language}文本翻译为{target-language},直接输出翻译结果,不要进行任何解释。
142
+
143
+ {source-text}
144
+ ```
145
+
146
+ With `--source auto`, `{source-language}` is omitted. Prompt length, source text, and generated output all count toward the served context. Parameters left unspecified above are not assigned new fixed values by this model card.
147
 
148
  The shipped configuration sets `max_position_embeddings=262144`. The examples below use **`--max-model-len 32768`**, matching the GitHub 2B/9B Translate serving preset. Input plus output must fit within the served context, and available GPU memory constrains practical lengths. Increase the client output budget for longer translations.
149