docs: align model card with technical report and inference defaults
Browse files
README.md
CHANGED
|
@@ -36,6 +36,8 @@ The evaluated 2B and 9B models combine the general, instruction, and meme specia
|
|
| 36 |
|
| 37 |
Results below reproduce the latest technical report. Comparisons apply to the report's evaluation data and settings, and metric scales differ. Higher is better except for off-target rates. These are individual benchmark scores, separate from the demo's normalized radar categories.
|
| 38 |
|
|
|
|
|
|
|
| 39 |
### Main translation benchmarks
|
| 40 |
|
| 41 |
WMT26 Judge uses a **0–100** scale; the other columns use **0–1**. instTrans quality and IFscore measure translation quality and instruction adherence separately. IFMTBench reports reference-based XCOMET-XXL and instruction adherence. Vertical is the equal-weight mean of the five domain scores below. North-Small-Translate is the **218B-A25B** model; TranslateGemma is **translategemma-12b-it**.
|
|
@@ -111,14 +113,37 @@ The **1,024-token output budget in the inference client below is a usage default
|
|
| 111 |
|
| 112 |
### Default settings
|
| 113 |
|
| 114 |
-
|
| 115 |
|
| 116 |
-
| Setting |
|
| 117 |
|---|---|
|
| 118 |
-
| Decoding | Greedy, **`temperature=0`** |
|
| 119 |
-
|
|
| 120 |
-
|
|
| 121 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 122 |
|
| 123 |
The shipped configuration sets `max_position_embeddings=262144`. The examples below use **`--max-model-len 32768`**, matching the GitHub 2B/9B Translate serving preset. Input plus output must fit within the served context, and available GPU memory constrains practical lengths. Increase the client output budget for longer translations.
|
| 124 |
|
|
|
|
| 36 |
|
| 37 |
Results below reproduce the latest technical report. Comparisons apply to the report's evaluation data and settings, and metric scales differ. Higher is better except for off-target rates. These are individual benchmark scores, separate from the demo's normalized radar categories.
|
| 38 |
|
| 39 |
+
The tables compare this checkpoint with the other Index-Translate sizes, **Hy-MT2-7B**, **TranslateGemma-12B**, and the **Qwen3.5-9B** base at a similar scale, and larger translation models and API baselines.
|
| 40 |
+
|
| 41 |
### Main translation benchmarks
|
| 42 |
|
| 43 |
WMT26 Judge uses a **0–100** scale; the other columns use **0–1**. instTrans quality and IFscore measure translation quality and instruction adherence separately. IFMTBench reports reference-based XCOMET-XXL and instruction adherence. Vertical is the equal-weight mean of the five domain scores below. North-Small-Translate is the **218B-A25B** model; TranslateGemma is **translategemma-12b-it**.
|
|
|
|
| 113 |
|
| 114 |
### Default settings
|
| 115 |
|
| 116 |
+
The following settings describe the released [`translate.py`](https://github.com/bilibili/Index-Translate/blob/main/inference/llm/translate.py) client. Its decoding defaults apply across Index-Translate sizes; the commands below explicitly select this card's model.
|
| 117 |
|
| 118 |
+
| Setting | Client default and override |
|
| 119 |
|---|---|
|
| 120 |
+
| Decoding | Greedy, **`temperature=0`**; override with `--temperature` |
|
| 121 |
+
| Output budget | `max_tokens=1024`; override with `--max-tokens` |
|
| 122 |
+
| Thinking | Disabled through `chat_template_kwargs={"enable_thinking": False}`; no thinking toggle in this CLI |
|
| 123 |
+
| Top-p / top-k / min-p | Not explicitly set by this client; inference-server defaults apply |
|
| 124 |
+
| Presence / frequency / repetition penalties | Not explicitly set by this client; inference-server defaults apply |
|
| 125 |
+
| Random seed | Not explicitly set by this client; inference-server behavior applies |
|
| 126 |
+
| Stop strings / stop-token IDs / ignore-EOS | Not explicitly set by this client; inference-server and model defaults apply |
|
| 127 |
+
| Model ID | `IndexTeam/Index-Translate-9B`; `INDEX_MODEL` changes the default, and `--model` overrides it |
|
| 128 |
+
| Source language | `auto`; override with `--source` / `-s`; auto omits the source-language name from the prompt |
|
| 129 |
+
| Target language | `en`; override with `--target` / `-t` |
|
| 130 |
+
| Endpoint | `http://127.0.0.1:8000/v1`; `OPENAI_BASE_URL` changes the default, and `--base-url` overrides it |
|
| 131 |
+
| API key | `EMPTY` for local serving; `OPENAI_API_KEY` changes the default, and `--api-key` overrides it |
|
| 132 |
+
| Request format | One user message; no system message is added by the client |
|
| 133 |
+
| Response streaming | Not enabled by this client; it prints the complete response |
|
| 134 |
+
| Transport timeout and retries | No explicit values set by the script; installed OpenAI / HTTPX client behavior applies |
|
| 135 |
+
| Proxy handling | Environment proxies disabled for `127.0.0.1`, `localhost`, and `::1`; remote endpoints use the OpenAI client's usual behavior |
|
| 136 |
+
| Input / output | Positional text or stdin; input is stripped and empty input is rejected; output is stripped and any emitted thinking block is removed |
|
| 137 |
+
|
| 138 |
+
The client maps supported short language codes to Chinese language names in the prompt. Provide the full language name for a code outside its mapping. Its training-aligned prompt is:
|
| 139 |
+
|
| 140 |
+
```text
|
| 141 |
+
请将以下{source-language}文本翻译为{target-language},直接输出翻译结果,不要进行任何解释。
|
| 142 |
+
|
| 143 |
+
{source-text}
|
| 144 |
+
```
|
| 145 |
+
|
| 146 |
+
With `--source auto`, `{source-language}` is omitted. Prompt length, source text, and generated output all count toward the served context. Parameters left unspecified above are not assigned new fixed values by this model card.
|
| 147 |
|
| 148 |
The shipped configuration sets `max_position_embeddings=262144`. The examples below use **`--max-model-len 32768`**, matching the GitHub 2B/9B Translate serving preset. Input plus output must fit within the served context, and available GPU memory constrains practical lengths. Increase the client output budget for longer translations.
|
| 149 |
|