Instructions to use iamshnoo/en_bul_a with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use iamshnoo/en_bul_a with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="iamshnoo/en_bul_a")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("iamshnoo/en_bul_a") model = AutoModelForCausalLM.from_pretrained("iamshnoo/en_bul_a", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use iamshnoo/en_bul_a with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "iamshnoo/en_bul_a" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "iamshnoo/en_bul_a", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/iamshnoo/en_bul_a
- SGLang
How to use iamshnoo/en_bul_a with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "iamshnoo/en_bul_a" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "iamshnoo/en_bul_a", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "iamshnoo/en_bul_a" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "iamshnoo/en_bul_a", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use iamshnoo/en_bul_a with Docker Model Runner:
docker model run hf.co/iamshnoo/en_bul_a
en_bul_a
A bilingual model trained on English and Bulgarian. It is one of the 40 checkpoints released with the paper "Double Trouble: Bilingual Pretraining Leaves Language-Conditioned Effects in Shared-Language Representations" (EMNLP 2026).
Paper (EMNLP 2026) | arXiv | Project page | Code
Model
All 40 models in the study share one architecture, tokenizer, training recipe and data source (BabyBabelLM). Each is a decoder-only model with about 310M parameters (12 layers, hidden size 768, 12 attention heads, 512-token context), trained from scratch. The tokenizer and vocabulary come from meta-llama/Llama-3.2-1B; no pretrained Llama weights are loaded.
This checkpoint:
- Languages: English and Bulgarian
- English data: the shared English partition, the same English documents that
en_50msees - Bulgarian data:
BabyLM-community/babylm-bul - Schedule: 50-step English/L2 blocks, alternating for 3,000 steps (1,500 steps per language)
- Training tokens: about 98.3M (3,000 steps of 32,768 tokens)
- Seed: 42
In the paper this is the bilingual model for the matched English documents comparison (C1, against en_50m) and the matched compute comparison (C3, against en_100m).
The full list of runs, with data sources, token budgets, seeds and optimization settings, is in the training manifest of the code repository.
Use
from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained("iamshnoo/en_bul_a")
model = AutoModelForCausalLM.from_pretrained("iamshnoo/en_bul_a")
These are small models trained on about 50M to 100M tokens for a study of internal representations. They are meant for representation analysis and for reproducing the paper, and they are not meant for text generation in applications.
Citation
@inproceedings{mukherjee-etal-2026-double,
title = "Double Trouble: Bilingual Pretraining Leaves Language-Conditioned Effects in Shared-Language Representations",
author = "Mukherjee, Anjishnu and
Zhu, Ziwei and
Anastasopoulos, Antonios",
editor = "Lee, Hung-Yi and
Dev, Sunipa and
Li, Junyi Jessy and
Elliott, Desmond",
booktitle = "Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing",
month = oct,
year = "2026",
address = "Budapest, Hungary",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2026.emnlp-main.2062/",
doi = "10.18653/2026.emnlp-main.2062",
pages = "46953--46977",
ISBN = "979-8-89176-459-0"
}
- Downloads last month
- 17