atom-ai / docs /LAST_ATOM_READOUT.md
thefinalboss's picture
ATOM (atom-ai): code snapshot (100fae0 + batched-train), README with measured numbers, curated checkpoints
9f1076a verified
|
Raw History Blame Contribute Delete
483 Bytes
# Last-atom readout — one hypothesis after byte-tick
English. Numbers. No fluency claim.
Last living atom payload (last byte) + α-gate → next-byte logits.
Not payload_produce copy-bias. Not byte_decoder. Not attention.
```
emb = byte_embed(last_byte)
h = GELU(emb + mix(sigmoid(α_gate)) + phase(cos φ, sin φ))
logits += last_atom_head(h)
```
Dentate (bridge #1) expands concat(last, prev) and keeps top-25% winners
before the down-projection.
See `docs/MEASURE_LOG.md`.