| # 💡Model Description | |
| Official model repository for our **ACL 2026 Main Conference** paper "*Language on Demand, Knowledge at Core*: Composing LLMs with Encoder-Decoder Translation Models for Extensible Multilinguality". | |
| ## ✨XBridge-base | |
| [`XBridge-base`](https://huggingface.co/ICTNLP/XBridge-base) is trained with stage 1 (cross-model alignment) using trilingual translation data, composing [`LLaMA3-8B`](https://huggingface.co/meta-llama/Meta-Llama-3-8B) with [`NLLB-200-1.3B`](https://huggingface.co/facebook/nllb-200-1.3B). Training is conducted on 10 languages: | |
| > Bn, De, En, Es, Fr, Ja, Ru, Sw, Th, Zh | |
| Despite being trained on a limited set of languages, we observe in our analysis that **stage 1 learns a language-agnostic cross-model alignment**, which generalizes well beyond the seen languages. | |
| ## ✨XBridge-SFT | |
| [`XBridge-SFT`](https://huggingface.co/ICTNLP/XBridge-SFT) further extends `XBridge-base` by training stage 2 (encoder-side adaptation) and stage 3 (decoder-side adaptation) for multilingual mathematical reasoning dataset. We evaluate `XBridge-SFT` on [MGSM](https://huggingface.co/datasets/juletxara/mgsm) benchmark in our paper. | |
| See our [paper](https://arxiv.org/abs/2603.17512) and [github repository](https://github.com/ictnlp/XBridge-for-multilingual-extension) for more details! | |
| # 🌍BayLing-MLingual | |
| XBridge serves as the research foundation of **BayLing-MLingual**. BayLing-MLingual extends XBridge from a research setting to practical multilingual question answering across 50 languages and 2500 cross-lingual pairs. **Try our BayLing-MLingual for general QA among 50 languages!** | |
| 👉Code: https://github.com/BayLing-Models/BayLing-MLingual | |
| 👉Model: https://huggingface.co/BayLing-Models/BayLing-MLingual | |
| # 📚Citation | |
| If you find this model or our work useful, please cite: | |
| ```tex | |
| @misc{bu2026languagedemandknowledgecore, | |
| title={Language on Demand, Knowledge at Core: Composing LLMs with Encoder-Decoder Translation Models for Extensible Multilinguality}, | |
| author={Mengyu Bu and Yang Feng}, | |
| year={2026}, | |
| eprint={2603.17512}, | |
| archivePrefix={arXiv}, | |
| primaryClass={cs.CL}, | |
| url={https://arxiv.org/abs/2603.17512}, | |
| } | |
| ``` | |
| # 📮Contact | |
| For questions, please contact: `bumengyu23z@ict.ac.cn` |