Instructions to use iamshnoo/deu_50m with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use iamshnoo/deu_50m with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="iamshnoo/deu_50m")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("iamshnoo/deu_50m") model = AutoModelForCausalLM.from_pretrained("iamshnoo/deu_50m", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use iamshnoo/deu_50m with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "iamshnoo/deu_50m" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "iamshnoo/deu_50m", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/iamshnoo/deu_50m
- SGLang
How to use iamshnoo/deu_50m with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "iamshnoo/deu_50m" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "iamshnoo/deu_50m", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "iamshnoo/deu_50m" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "iamshnoo/deu_50m", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use iamshnoo/deu_50m with Docker Model Runner:
docker model run hf.co/iamshnoo/deu_50m
deu_50m
A German-only model. It is one of the 40 checkpoints released with the paper "Double Trouble: Bilingual Pretraining Leaves Language-Conditioned Effects in Shared-Language Representations" (EMNLP 2026).
Paper (EMNLP 2026) | arXiv | Project page | Code
Model
All 40 models in the study share one architecture, tokenizer, training recipe and data source (BabyBabelLM). Each is a decoder-only model with about 310M parameters (12 layers, hidden size 768, 12 attention heads, 512-token context), trained from scratch. The tokenizer and vocabulary come from meta-llama/Llama-3.2-1B; no pretrained Llama weights are loaded.
This checkpoint:
- Language: German
- Data:
BabyLM-community/babylm-deu - Training tokens: about 49.2M (1,500 steps of 32,768 tokens)
- Seed: 42
In the paper the second-language-only models are used for the second-language validation, which compares them with the bilingual English and German models.
The full list of runs, with data sources, token budgets, seeds and optimization settings, is in the training manifest of the code repository.
Use
from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained("iamshnoo/deu_50m")
model = AutoModelForCausalLM.from_pretrained("iamshnoo/deu_50m")
These are small models trained on about 50M to 100M tokens for a study of internal representations. They are meant for representation analysis and for reproducing the paper, and they are not meant for text generation in applications.
Citation
@inproceedings{mukherjee-etal-2026-double,
title = "Double Trouble: Bilingual Pretraining Leaves Language-Conditioned Effects in Shared-Language Representations",
author = "Mukherjee, Anjishnu and
Zhu, Ziwei and
Anastasopoulos, Antonios",
editor = "Lee, Hung-Yi and
Dev, Sunipa and
Li, Junyi Jessy and
Elliott, Desmond",
booktitle = "Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing",
month = oct,
year = "2026",
address = "Budapest, Hungary",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2026.emnlp-main.2062/",
doi = "10.18653/2026.emnlp-main.2062",
pages = "46953--46977",
ISBN = "979-8-89176-459-0"
}
- Downloads last month
- 16