docs/MODEL_SPECIFICATION.md

Neo Model Specification

Neo is an English-only System One decision model.

• Bidirectional Transformer encoder.
• 41,391,654 trainable parameters (approximately 41.4M).
• 8 layers, hidden size 512, 8 attention heads.
• Intermediate size 2048.
• Maximum context 1,024 tokens.
• Tokenizer: bert-base-uncased.
• Decision heads: choice, score, and noul.
• Choice head: up to 32 options.
• Score head: up to 5 ordered levels.
• Noul head: binary probability.

The model is trained from scratch; the tokenizer is standard pretrained English vocabulary, not a custom tokenizer.

Training data and configuration are documented in the source repository:

https://github.com/tokenaii/Neo/blob/main/docs/MODEL_SPECIFICATION.md