Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior
Paper • 2609.39827 • Published • 13
SSU
university
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
Mitigating Catastrophic Forgetting in Target Language Adaptation of LLMs via Source-Shielded Updates
atsuki-yamaguchiÂ
authored a
paper 10 days ago
atsuki-yamaguchiÂ
submitted a
paper to Daily Papers 10 days ago
atsuki-yamaguchiÂ
authored a
paper about 1 month ago
atsuki-yamaguchiÂ
authored 3
papers 3 months ago
How Can We Synthesize High-Quality Pretraining Data? A Systematic Study of Prompt Design, Generator Model, and Source Data
Paper • 2604.13977 • Published • 3
MultiHashFormer: Hash-based Generative Language Models
Paper • 2606.28057 • Published • 23
On the Utility and Factual Reliability of Pruned Mixture-of-Experts Models in the Biomedical Domain
Paper • 2607.01444 • Published • 2
atsuki-yamaguchiÂ
submitted a
paper to Daily Papers 3 months ago
atsuki-yamaguchiÂ
published 7
models 6 months ago
ssu-project/OLMo-2-1124-7B-Instruct-ig-fft-20MT
7B • Updated • 8
ssu-project/OLMo-2-1124-7B-Instruct-ig-gmt-20MT
7B • Updated • 12
ssu-project/OLMo-2-1124-7B-Instruct-ig-adalora-20MT
Updated
ssu-project/OLMo-2-1124-7B-Instruct-ig-hft-20MT
7B • Updated • 6
ssu-project/OLMo-2-1124-7B-Instruct-ig-ssu-20MT
7B • Updated • 12
ssu-project/OLMo-2-1124-7B-Instruct-ig-magnitude-20MT
7B • Updated • 11
ssu-project/OLMo-2-1124-7B-Instruct-ig-random-20MT
7B • Updated • 17
atsuki-yamaguchiÂ
updated 2
models 6 months ago
atsuki-yamaguchiÂ
updated a
Space 6 months ago
atsuki-yamaguchiÂ
updated 3
models 6 months ago