LUNA-1B by ASTERIZER: 1B-parameter multilingual model, 2.4TB training corpus, and 128K/64K tokenizer.
ASTERIZER
company
Verified
AI & ML interests
None defined yet.
Shared GPT-NeoX tokenizer (vocab 50304) for LUNA-100M and LUNA-300M — the single tokenizer behind both models.
LUNA-100M by ASTERIZER: 4.5B-token pretraining corpus + RAG/MCP SFT dataset + model. Compact, English-first, agent-era AI.
LUNA-1B by ASTERIZER: 1B-parameter multilingual model, 2.4TB training corpus, and 128K/64K tokenizer.
Multilingual BPE tokenizer family (128K/64K/8K) for LUNA-1B, with benchmark vs the original GPT-NeoX tokenizer.
Shared GPT-NeoX tokenizer (vocab 50304) for LUNA-100M and LUNA-300M — the single tokenizer behind both models.
LUNA-300M by ASTERIZER: 303M-parameter English causal LM, pretrained from scratch on the 4.5B-token LUNA_PreTrain corpus.
LUNA-100M by ASTERIZER: 4.5B-token pretraining corpus + RAG/MCP SFT dataset + model. Compact, English-first, agent-era AI.