| license: mit | |
| pipeline_tag: text-generation | |
| language: | |
| - en | |
| tags: | |
| - code | |
| - coding | |
| - agentic-coding | |
| - causal-language-model | |
| # M31Genesis | |
| M31-Genesis-AgenticCode-v1: native M31 causal language model for agentic coding research. | |
| ## Checkpoints | |
| Immutable checkpoints are stored at `checkpoints/<stage>/step-XXXXXXXXXX/`. `latest.json` points to the newest checkpoint. `latest/<stage>/` mirrors the newest checkpoint. | |
| Each checkpoint contains `model.safetensors`, `checkpoint.json`, and tokenizer files. Selected milestones additionally contain `trainer_state.pt` for trainer continuation. | |
| ## Usage | |
| Use `modeling_m31.py` and `inference.py` from the repository to load and run a checkpoint. | |
| ## Architecture | |
| Native M31 decoder-only transformer, 425M-class parameters, 65,536 ByteLevel BPE vocabulary, 24 layers, hidden size 1024, 16 attention heads / 8 KV heads, RMSNorm, RoPE, tied embeddings. | |
| ## Intended use | |
| Software engineering, coding, debugging, code editing, repository-aware reasoning, and agent/tool-use research. | |
| ## Status | |
| Experimental research checkpoints. Evaluate before production use. | |