--- license: other language: [hi, mr, ne, mai, sa, brx, kok, doi, gu, pa, or, ta, te, kn, ml, mni, bn, as, ur, sd, ks, sat] tags: [transliteration, code-mixing, text-to-speech, indic] --- # indictrans: English words in Indian-language text, written in the request's script Runtime assets of the code-mix transliteration layer of the Finesse TTS (`utils/codemix_xlit`): English words inside Indic text are rewritten in the language's script, spelled the way an Indian-English speaker says them, so an Indic voice reads them correctly; text typed entirely in Latin is read word by word, the language's own words back into its script. 22 languages (Dogri and Santali through the Hindi model). Version 1.3.0+c0ad24b04aaa. Built by `tools/codemix_xlit/build_assets.py`; `manifest.json` lists every file with its size and SHA-256. ## Contents - `model/`: the IndicXlit en->indic v1.0 transformer converted to CTranslate2 - `lexicon/.reviewed.json`, `lexicon/.generated.json`: reviewed and generated spellings - `rescore/`: pruned IndicXlit word-frequency dictionaries - `cmudict.json`, `english_*`: English pronunciations, vocabulary and reviewed corrections - `indic_words.json`: Indian words read natively; `ranker.json`: candidate ranker - `roman/.json`: how people type each language's words in Latin, and how often ## Sources and licences - IndicXlit model and word-frequency dictionaries: AI4Bharat, MIT licence (https://github.com/AI4Bharat/IndicXlit) - CMU Pronouncing Dictionary: Carnegie Mellon University, BSD-style licence - English word lists derived from wordfreq (https://github.com/rspeer/wordfreq): CC BY-SA 4.0 - Dakshina dataset (Roark et al. 2020, https://github.com/google-research-datasets/dakshina): CC BY-SA 4.0; the romanized tables of bn, gu, hi, kn, ml, mr, pa, sd, ta, te, ur use counts derived from its romanized sentences, and those tables are shared under CC BY-SA 4.0 - Lexicons, corrections, ranker and the other romanized tables: derived from the above and reviewed