atom-ai / docs /SPEECH_LOCK.md
thefinalboss's picture
ATOM (atom-ai): code snapshot (100fae0 + batched-train), README with measured numbers, curated checkpoints
9f1076a verified
|
Raw History Blame Contribute Delete
2.01 kB

Speech lock repair — 2026-09-18

English. Numbers. No fluency / GPT claim until a prompt emits a distinct phrase.

Grok Bot cascade STOP at 48cdb19. Do not stack another α-map / payload / +10k.

What was broken

fact number
payload + MERGE-train logits 0.838 → 0.999
α-local copy +10k logits 0.9987, chat auiseateu : aernun e
MERGE-off ingest atoms 4–6, surface still identical
last healthy surface field_next @ 3,458,000 logits 0.838 / spans @ 3,425,000 logits 0.866

Two mechanical locks, not "needs more CE":

  1. payload_produce broadcast the winner unigram hist onto every span slot → letter soup.
  2. generate_packets committed that soup back into the atomizer → the next tick copies soup.

Turning the frozen α map down on the 3.508M ckpt would have fed the collapsed payload path. Falsified.

One repair (this commit)

  • Position-aligned copy only (no broadcast hist).
  • Chat payload_copy=False (hard path = frozen α + capped α-MLP only).
  • Dialogue wrap Utilisateur: …\nAssistant: (train distribution).
  • speech_ok gate: do not re-ingest soup. Hint lexicon, not a Transformer.

Banned: attention, HF tokenizer, byte_decoder reopen, +10k on alpha_local, MERGE retune in the same change.

Run on the box (no Bot)

# STOP the Bot first.
git pull

# Prefer 3.458M field_next, then 3.425M spans. NEVER alpha_local 3.508M.
python3 scripts/speech_chat.py --prompt "Bonjour"
python3 scripts/speech_chat.py --prompt "Qui es-tu ?"
python3 scripts/speech_chat.py --prompt "Il était une fois"

If the response is empty, speech_ok refused soup. That is correct. Load the 3.458M file, not 3.508M.

Next train (only if chat on 3.458M is still scraps)

Single lever: resume 3,458,000, payload_enabled=False, chat merge-off already default, do not lower MERGE thr. Budget ≤25k. Stop if logits > 0.95. Gate = distinct phrases across the three prompts, not logits cos.