license: mit
pipeline_tag: text-generation
language:
- en
tags:
- code
- coding
- agentic-coding
- causal-language-model
M31Genesis
M31-Genesis-AgenticCode-v1: native M31 causal language model for agentic coding research.
Checkpoints
Immutable checkpoints are stored at checkpoints/<stage>/step-XXXXXXXXXX/. latest.json points to the newest checkpoint. latest/<stage>/ mirrors the newest checkpoint.
Each checkpoint contains model.safetensors, checkpoint.json, and tokenizer files. Selected milestones additionally contain trainer_state.pt for trainer continuation.
Usage
Use modeling_m31.py and inference.py from the repository to load and run a checkpoint.
Architecture
Native M31 decoder-only transformer, 425M-class parameters, 65,536 ByteLevel BPE vocabulary, 24 layers, hidden size 1024, 16 attention heads / 8 KV heads, RMSNorm, RoPE, tied embeddings.
Intended use
Software engineering, coding, debugging, code editing, repository-aware reasoning, and agent/tool-use research.
Status
Experimental research checkpoints. Evaluate before production use.