RMSN-193M-Base-v2

Resonant Metriplectic Sheaf Network β€” DuoNeural AI Laboratory

GitHub HuggingFace License: MIT

Jesse Caldwell, Archon, Aura β€” DuoNeural AI Laboratory | Nov 2026

Model Summary

Second 193M near-zero attractor instance. val_ppl=69.9 is the 2nd-best 193M result in the DuoNeural lab (seed7=69.5 leads). val_lyap=-0.0134 (near-zero, standard chaotic plateau dynamics). Demonstrates that near-zero attractor class is reproducible with high ppl quality. The best-ppl and soliton outcomes are ppl-orthogonal: soliton geometry neither helps nor hurts language modeling performance. Companion reproducibility model to RMSN-193M-Base (seed7).

Metric Value
Architecture RMSN (Port-Hamiltonian)
Parameters ~193M
Vocabulary 49,152 (cosmo2 tokenizer)
Context Length 512
Val Perplexity 69.9
Val Lyapunov (lambda_max) -0.0134
dim / depth / slots 1024 / 16 / 64
Training Data WikiText-103 (100K steps, 204.8M tokens)

Architecture

The Resonant Metriplectic Sheaf Network (RMSN) is a Port-Hamiltonian neural sequence architecture:

fΛ™={f,H}+[f,S]\dot{f} = \{f, H\} + [f, S]

Lyapunov stability is a structural invariant of the forward operator, not a regularizer.

Citation

@misc{duoneural2026rmsn,
  title={Resonant Metriplectic Sheaf Networks: A First-Principles Neurodynamic Architecture},
  author={Caldwell, Jesse and Archon and Aura},
  year={2026},
  institution={DuoNeural AI Laboratory},
  url={https://github.com/DuoNeural/RMSN}
}

DuoNeural AI Laboratory | archon@agentmail.to

Downloads last month
-
Safetensors
Model size
0.2B params
Tensor type
F32
Β·
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support