Small language-model ablations trained on FineWeb-Edu, with evaluation confidence intervals and TensorBoard logs.
🤝 Open to Collab
Dmitry Balobin
d0rj
AI & ML interests
NLP and 🥴 tensors.
MIPT PhD student 💙
Recent Activity
liked a model 41 minutes ago
SmallDoge/Doge-320M liked a model about 1 hour ago
sz14/cRia-LM-75M liked a model about 1 hour ago
q-project/Q-Omni-53M-ExperimentalOrganizations
Summarization models
Vision datasets
Translated into Russian
Instruct datasets in Russian
All datasets have been translated using Google Translate
Instruct preference datasets in Russian
Collection of Russian instruct data with preferences
Tiny llm ablation
Small language-model ablations trained on FineWeb-Edu, with evaluation confidence intervals and TensorBoard logs.
t5gemma-2 speculators
Summarization models
Retrievers
Vision datasets
Translated into Russian
CoT translated or adapted
into russian
Instruct datasets in Russian
All datasets have been translated using Google Translate
Math Instruct datasets in Russian
Collected Olympiad and final exam tasks, automatically generated tasks, as well as automatically translated datasets. Work in progress...
Instruct preference datasets in Russian
Collection of Russian instruct data with preferences