Post
70
14 sequential LoRA stages on the same Hermes-3-8B base, no merging — each stage continue-trained straight from a prior checkpoint. Not a clean line up: two stages failed outright before stage 3 even landed, and the math-curriculum branch (stages 8-14) is a real rollback story, not a monotonic climb.
The collapse that mattered:
* Stage 8 (risk_math): 100% on its own eval.
* Stage 9 (probability_math, trained straight from stage 8): risk_math fell to 65% (-35pp) — training one math topic quietly overwrote another.
* Stage 10 (a terse-execution style pass, no new math content): risk_math fully recovered to 100%, just from changing HOW the model answers.
* Stage 11 (probability_math retried, from the stage-10 checkpoint): only partial protection — risk_math dropped to 78.3%, roughly half the damage of stage 9's run on identical data.
* Stage 12 (chain_math): never recovered. Still an open item.
* Stages 13-14 (game_theory, decision_theory): clean, zero contamination, closing at 79% overall math / 93.2% safety.
Earlier: stage 3 failed twice before anything landed, and stage 7 — a retry of the first failed stage, six stages later — scored LOWER than the original attempt.
Judge correction ran in parallel: v5 through v10, six rounds, each triggered by the judge missing a real refusal, not the model regressing.
github.com/soulinpsyabstract/sipa-os-governance
huggingface.co/datasets/SoulInPsyAbstract/sipa-os-governance
Weights: huggingface.co/SoulInPsyAbstract/hermes3-8b-exp044-8stage-curriculum-loras
Stage 6 is live: ai.sipa-os.org
cli: curl -fsSL https://get.sipa-os.org/install | bash
The collapse that mattered:
* Stage 8 (risk_math): 100% on its own eval.
* Stage 9 (probability_math, trained straight from stage 8): risk_math fell to 65% (-35pp) — training one math topic quietly overwrote another.
* Stage 10 (a terse-execution style pass, no new math content): risk_math fully recovered to 100%, just from changing HOW the model answers.
* Stage 11 (probability_math retried, from the stage-10 checkpoint): only partial protection — risk_math dropped to 78.3%, roughly half the damage of stage 9's run on identical data.
* Stage 12 (chain_math): never recovered. Still an open item.
* Stages 13-14 (game_theory, decision_theory): clean, zero contamination, closing at 79% overall math / 93.2% safety.
Earlier: stage 3 failed twice before anything landed, and stage 7 — a retry of the first failed stage, six stages later — scored LOWER than the original attempt.
Judge correction ran in parallel: v5 through v10, six rounds, each triggered by the judge missing a real refusal, not the model regressing.
github.com/soulinpsyabstract/sipa-os-governance
huggingface.co/datasets/SoulInPsyAbstract/sipa-os-governance
Weights: huggingface.co/SoulInPsyAbstract/hermes3-8b-exp044-8stage-curriculum-loras
Stage 6 is live: ai.sipa-os.org
cli: curl -fsSL https://get.sipa-os.org/install | bash