license: cc-by-4.0
tags:
- mechanistic-interpretability
- circuits
- arithmetic
- matrix-vector-product
- scratchpad
integer-matvec
Atlas entry: entries/integer-matvec.md in https://github.com/jc1122/mechanistic-interpretability-circuit-atlas (mechanism, setup, limits). Task: y = Mv for a 3x3 integer matrix and vector with entries 0..7, each y_i as nine LSB-first bits. Format A emits the answers only; format T writes the row accumulator after every shifted partial product (scratchpad). Score: teacher-forced whole-output exact on each seed's disjoint 2,000-input test set.
Model: GPT-NeoX, 5 layers, 4 heads x 32, d_model 128, ReLU MLP 640, no LayerNorm, no positional encoding, vocab 15 (config.json -> hf_config).
Files: hand_{A,T} (hand-built HAND-a for A, HAND-b for T); train_<fmt>_<round>_{best,final}_s<seed> (rung TRAIN, full nets): T screening r1 s0-2, A retry r3 s0-2, T final run s0-9. PART research nets are not included. Per net: format, round, snapshot, seed, step, circuit type, recorded_test, acc_test_fp32 (fp32 re-score), sha256: manifest.json.
34 networks (2 HAND, 32 TRAIN). No pickles. License CC BY 4.0.