This Seq2Seq transformer model is designed to translate text, compose headings, generate questions and summarizations. Its size is only 80 million parameters, which allows you to work with good speed on equipment with low computing power.
Supported languages: Russian and English.
Maximum sequence length: 256 tokens.
For work, files in the main directory are sufficient.
q8 is a quantized model of ctranslate2 in INT8. Use it if you want to save disk space and RAM.
OpenNMT is a averaged OpenNMT model. It can be used in cases where the capabilities of the ctranslate are not enough.
Example of use
You can check the features on the demo site:
https://tolmacher.wia.su/
The items "write an article" and "rewrite" an article are implemented in tandem with the Queen 05B model, the rest are performed entirely by the Requestor model.
To work on your computer
1. Install the Python packages
pip install ctranslate2 OpenNMT-py==2.* sentencepiece
2. Download model in some dirrectory
3. Use with …
