File size: 2,786 Bytes
03b9596
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9d4b576
84c826c
9d4b576
 
 
03b9596
 
 
 
 
 
9d4b576
 
03b9596
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
---
license: cc-by-4.0
language:
- ar
- fr
pipeline_tag: translation
library_name: transformers.js
base_model: Helsinki-NLP/opus-mt-ar-fr
tags:
- translation
- marian
- opus-mt
- onnx
---

# OptimaMT ar โ†’ fr (Arabic to French)

Drop-in copy of an ONNX export of [Helsinki-NLP/opus-mt-ar-fr](https://huggingface.co/Helsinki-NLP/opus-mt-ar-fr) at revision `e507d7bc8508` (same layout as the Xenova exports) with a lighter merged decoder: ONNX Runtime's fast mode (`disable_quant_qdq = 1`, 2.3โ€“2.5ร— faster) at half the memory. Same weights, same tokens.
Part of [OptimaMT](https://github.com/AmerAlreyahi/OptimaMT): [all 51 pairs](https://huggingface.co/collections/OptimaMT/optimamt-lighter-opus-mt-onnx-models-6af228dc9cd91f015e56e869), named `OptimaMT/<src>-<tgt>`.

**Used in production:**
- [OpenCircle](https://github.com/AmerAlreyahi/OpenCircle), a desktop screen translator for Windows and Linux, ships these models since v0.1.4.

| Memory after load | Linux | Windows | Identical tokens |
|---|---:|---:|---|
| `disable_quant_qdq = 1` | 542 โ†’ 290 MiB (-47 %) | 514 โ†’ 265 MiB (-48 %) | yes |
| ONNX Runtime defaults | 288 โ†’ 226 MiB (-22 %) | 200 โ†’ 170 MiB (-15 %) | yes |

FLORES-200 devtest (1,012 sentences): the same translations as the original, BLEU 26.01, chrF 53.48 (greedy).

ONNX Runtime 1.31.1, CPU, 4 threads (Linux; Windows in a VM). Interactive results: [OptimaMT/results](https://huggingface.co/spaces/OptimaMT/results) ยท
method: [REPORT.md](https://github.com/AmerAlreyahi/OptimaMT/blob/main/REPORT.md).

## Use

```js
import { pipeline } from "@huggingface/transformers";

const translator = await pipeline("translation", "OptimaMT/ar-fr", {
  dtype: "q8",
  session_options: { extra: { session: { disable_quant_qdq: "1" } } },
});
const [out] = await translator("ุงู„ู…ู†ุงุฑุฉ ุชู‚ู ุนู„ู‰ ุงู„ุณุงุญู„.");
console.log(out.translation_text);
```

Python ([translate.py](https://github.com/AmerAlreyahi/OptimaMT/blob/main/scripts/translate.py): onnxruntime, sentencepiece, numpy):

```bash
python translate.py OptimaMT/ar-fr "ุงู„ู…ู†ุงุฑุฉ ุชู‚ู ุนู„ู‰ ุงู„ุณุงุญู„."
```

## Files

`onnx/decoder_model_merged_quantized.onnx` is rebuilt; `tokenizer.json`, `special_tokens_map.json` and `tokenizer_config.json` were written in the Xenova layout; every other file is the original, byte for byte.
Vocabulary: 64,505 tokens.

## Licence and credits

- Weights: [OPUS-MT](https://huggingface.co/Helsinki-NLP/opus-mt-ar-fr) by the University of Helsinki, CC BY 4.0.
- ONNX export: an ONNX export of [Helsinki-NLP/opus-mt-ar-fr](https://huggingface.co/Helsinki-NLP/opus-mt-ar-fr) at revision `e507d7bc8508` (same layout as the Xenova exports).
- Modified: the decoder's output projection was moved out of its two branches (graph change only). CC BY 4.0.