File size: 1,309 Bytes
21e8356
84e4bd5
97638e9
 
84e4bd5
 
21e8356
 
 
 
84e4bd5
 
518a909
84e4bd5
22cdea4
84e4bd5
 
22cdea4
84e4bd5
 
 
 
518a909
 
 
 
84e4bd5
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
---
title: OptimaMT
emoji: 🌐
short_description: Lighter OPUS-MT translation models for ONNX Runtime
colorFrom: blue
colorTo: indigo
sdk: static
pinned: false
---

# OptimaMT

**ONNX Runtime's fast mode at half the memory: 2.3–2.5× faster than the default, same translations.**

51 OPUS-MT translation models for ONNX Runtime and transformers.js: drop-in copies of the int8 exports
with a lighter merged decoder. Same weights, same tokens.

| Memory after load (median; Linux 51 pairs, Windows 49) | Linux | Windows |
|---|---:|---:|
| `disable_quant_qdq = 1` | 525 → 281 MiB (-46 %) | 500 → 257 MiB (-49 %) |
| ONNX Runtime defaults | 277 → 217 MiB (-22 %) | 196 → 166 MiB (-16 %) |

**Used in production:**
- [OpenCircle](https://github.com/AmerAlreyahi/OpenCircle), a desktop screen translator for Windows and Linux, ships these models since v0.1.4.

[All models](https://huggingface.co/collections/OptimaMT/optimamt-lighter-opus-mt-onnx-models-6af228dc9cd91f015e56e869) · repo ids `OptimaMT/<src>-<tgt>`, e.g. [`OptimaMT/en-ar`](https://huggingface.co/OptimaMT/en-ar) ·
[interactive results](https://huggingface.co/spaces/OptimaMT/results) · [method and code](https://github.com/AmerAlreyahi/OptimaMT)

Models CC BY 4.0 (OPUS-MT, University of Helsinki; ONNX exports by Xenova); code MIT.