VillanovaAI/Villanova-2B-checkpoints

Intermediate checkpoints of villanovaAI/Villanova-2B-base-2603 model and related experiments with different models and data distributions investigated in Practical Guidelines for Model Merging in LLMs Pre-Training paper.

Citation

@inproceedings{curci2026practical,
  title={Practical Guidelines for Model Merging in LLMs Pre-Training},
  author={Curci, Giuseppe and Simonazzi, Stefano and Zugarini, Andrea and others},
  booktitle={Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026)},
  pages={1519--1532},
  year={2026}
}