atom-ai / docs /DRIVE_PROBE.md
thefinalboss's picture
ATOM (atom-ai): code snapshot (100fae0 + batched-train), README with measured numbers, curated checkpoints
9f1076a verified
|
Raw History Blame Contribute Delete
1.49 kB
# DRIVE_PROBE — token drive collinearity
Date: 2026-09-17 PT
Probe: inject `"Bonjour"` vs `"xxxxxx"` from zero field; measure alpha RMS + cosine.
Model: AtomNativeModel d_model=32, n_modes=32, seed=0.
## Hypothesis (verified in `src/toroidal/dynamics.py` before patch)
| Claim | Verified |
|-------|----------|
| `mode_phase` regular polygon `arange * 2π/n_modes` | yes |
| token drive mean-broadcast identical on all modes | yes (pre-patch) |
| `rotated = sin(phase) * alpha` | yes |
| `_compute_phase_laplacian` exists but unused; linear Laplacian used | yes |
## Before (pre-patch numbers only)
```
RMS_Bonjour=0.00242920
RMS_xxxxxx=0.00243263
COSINE=0.97792614
```
## Patch choice: **A** (mode-modulated drive)
`drive_m,d = token_d * cos(mode_phase_m + 0.5 * token_d * d)` — not the same
vector on every mode. Same tensor shapes. No new module. Choice B (phase
Laplacian) not applied.
## After
```
RMS_Bonjour=0.00178140
RMS_xxxxxx=0.00177089
COSINE=0.95857894
```
Cosine dropped (0.9779 → 0.9586). RMS did not explode.
## energy_decay clamp
Train path calls `model.stabilize_dynamics_parameters()` after every
`optimizer.step()` (`tools/run_atom_native.py`); band default `[0.3, 0.95]`.
Already correct — no further clamp fix. See `DECAY_FIX.md`.
## Train path note
`tools/run_atom_native.py` supports `--stream`, `--resume`, `--atom-flush-every`
(soft atom list clear; field alpha not wiped), `--no-episode-reset` default.
No long train started for this probe.