eshanized's picture
add v5 experiment runtime
af547ea verified
|
Raw History Blame Contribute Delete
576 Bytes

M31Tesla — M31-Python-Agent-220M-v5 Runtime

Standalone runtime for the custom M31-Python-Agent-220M-v5 model.

Architecture: 228,953,984 parameters; vocab 32,768; hidden 896; 20 layers; 14 query heads; 7 KV heads; intermediate 2,816; GQA; RMSNorm; RoPE theta 10,000; tied embeddings.

The v5 trainer used a 512-token training sequence. The runtime therefore defaults to a 512-token working context, although the architecture supports positions up to 2,048.

Use m31_runtime.load_stage("repair") to load a checkpoint and generation_m31.generate(...) to generate text.