Built on LS2's foundation, LS2.5 introduces a 16k vocab tokenizer to improve efficiency.
Chenhao Guan
Dsg2
AI & ML interests
"Built in a cave with a box of scraps"
Training small language models on low end consumer hardware.
Recent Activity
updated a collection 3 days ago
LS2.5 updated a collection 3 days ago
LS2.5 updated a model 3 days ago
Dsg2/LS2.5-108M-A17M-Coder-GGUFOrganizations
None yet
Built on LS2's foundation, LS2.5 introduces a 16k vocab tokenizer to improve efficiency.
LaoShu2 🐭 family: new architecture with engrams and top-2 routing, QAT without fp32 master weights.
Experimental models: testing next gen algorithms
LaoShu 🐭: tiny little models, no practicality but worth keeping anyways