MiniMax-H3 21.6B AV diffusion folded without retraining from 44.89 GB to 10.38 GB (4.33x), with a constant state across frames.

Paper · DOI · Runtime (PyPI) · Wirkung · Base weights · Contact · License

Origami-H3 is a 21.60B-parameter Holographic Causal Graph Machine (HCGM) Preview compiled in closed form from MiniMax-H3 with zero retraining, zero fine-tuning, and zero gradient steps. It folds the 44.89 GB source checkpoint into 10.38 GB (4.33x compression), executes directly from NVMe/SSD storage via OS mmap with 0 GB GPU VRAM and 0 GB dedicated weight-RAM, and keeps live state strictly constant (O(1)) across arbitrary horizons on CPU, NPU, sGPU, Metal, and standalone PTX.

Origami-H3 preserves the full MiniMax-H3 architecture (50 joint audio-video Diffusion Transformer (DiT) blocks, 2 token refiners, a fused rank-128 Walsh-6 Turbo-LoRA, a 24-block 3D SoL-H3-VAE, and an Audio-VAE) while turning a passive weight checkpoint into a self-contained binary file executed under one cross-silicon contract. It succeeds our first-generation constant-state releases published under huggingface.co/tfwnotops by removing vLLM, MLX, and Transformers runtime dependencies altogether. This repository is a Preview release: structural byte footprints, fold ratios, and constant-memory invariants below are fixed properties of the compiled artifact, while hardware-dependent throughput figures are omitted from the card and documented in the Origami Family Paper.

pip install -U wirkung && wkng pull wirkung/Origami-H3 -o ./Origami-H3
wkng verify ./Origami-H3 --full && wkng info ./Origami-H3

Source checkpoint against Origami-H3

Property Source (MiniMax-H3) Origami-H3 (HCGM Preview)
Parameters 21.60B 21.60B (identical graph topology)
Retraining / fine-tuning steps Pretrained baseline 0 (closed-form compilation)
Checkpoint footprint on disk 44.89 GB BF16 10.38 GB (4.33x smaller; 307 .o3f DiT + 3D/Audio VAE operator files + exact_core.safetensors)
Required GPU VRAM Multi-tens of GB HBM 0 GB (runs on plain CPU / NPU / sGPU or optional GPU)
Dedicated weight-RAM Pinned in host / device RAM 0 GB (read-only OS mmap directly from SSD/NVMe)
Live session / horizon state Unbounded multi-window 3D spatiotemporal latent buffers (exceeds 16 GB unified memory) Constant O(1) horizon carrier across continuous uncut audio-video windows
Operator & readout path Dense per-step matrix scan 4-step shifted Euler flow matching + M-Rail physical/geometric sideline verification
Runtime dependencies PyTorch / vLLM / MLX / CUDA wirkung + numpy (standalone C11, NPU, sGPU, Metal, PTX)

Physical byte anatomy and sequence-horizon state scaling of Origami-H3

Figure 1. (a) Physical byte scale contrasting the 44.89 GB BF16 MiniMax-H3 pipeline against the 10.38 GB Origami-H3 .o3f bundle mapped directly from SSD (0 GB dedicated GPU VRAM, 0 GB weight-RAM). (b) Live spatiotemporal state across consecutive latent audio-video windows: unbounded window caching against the constant O(1) Origami-H3 horizon state.

Zero-retraining compilation and constant-state architecture

Every Origami model is produced by the same four-part compilation pipeline without gradient descent:

  1. The file is the machine (disk-resident mmap execution). An HCGM model is an immutable binary artifact on disk. The operating system maps operator pages read-only on demand from SSD or NVMe storage, requiring neither GPU VRAM nor weight-deserialization buffers in host RAM. Under our v3-exakt dyadic integer reduction contract, CPU (AVX2 / NEON), general NPUs, embedded sGPU (cpu_cuda), Apple Metal, and driver-API PTX evaluate identical canonical reductions rather than drifting floating-point kernel approximations.
  2. Closed-form Parseval + projective-crystal folding (.o3f, 4.33x without retraining). Compiled directly from the frozen 44.89 GB BF16 MiniMax-H3 pipeline with zero gradient steps into 10.38 GB across 307 .o3f operator files, Origami-H3 pairs Parseval row-norm conservation with rank-48 boundary crystals (blocks 0..2 and 47..49), rank-32 interior crystals (blocks 3..46), gauge-balanced QR-SVD rank-128 Walsh-6 rANS Turbo-LoRA, and a folded 97-operator 3D SoL-H3-VAE, preserving nonlinear SwiGLU velocity fields on 16 GB consumer hardware.
  3. Constant O(1) uncut horizon state synthesized via Wirkung. Using Wirkung, our internal exact structural-law and closed-form operator synthesis engine, Origami-H3 replaces hard scene-cut window resets with a bounded O(1) spatiotemporal carrier across consecutive 4-step shifted Euler windows while parallel constant-state M-Rail observers check 3D geometric, physical, and audio-visual invariants in the same weight stream.
  4. Certified readout and online trajectory decomposition (X = Xknown + R). Rather than re-evaluating every parameter blindly for isolated single tokens, HCGM decomposes live hidden trajectories into known low-rank structure Xknown (cosine trajectory banks, multi-order suffix tables, and rank-1 Sherman-Morrison-Woodbury updates) plus novel residual R, verifying multiple candidate steps in one weight pass with zero greedy output drift.

Constant-memory read geometry and folded operator execution in Origami-H3

Figure 2. (a) Continuous multi-window trajectory coherence under uncut Origami-H3 M-Rail flow against open-loop window-boundary drift. (b) Single-pass .o3f DiT operator combining Parseval FWHT_128 4-class bitplanes and Walsh-6 LoRA with a rank-r projective crystal (UrVr⊤) feeding the folded 3D and Audio VAEs.

Shared trajectory assimilation (M-Rail), GPU-less server fleets and multi-model routing (HMoE)

Beyond single-node execution, Origami-H3 attaches natively to Shared M-Rail (.mrail v3), a content-addressed associative trajectory manifold shared across processes or across an enterprise network:

  • Warm up once on one GPU, run permanently on disk-only CPU/NPU servers. Because HCGM models require only SSD storage and megabytes of live state, an organization can run a single GPU (or a short temporary cloud GPU lease) until its recurring domain workflows are crystallized into a shared .mrail file, then shut the GPU down and serve frontier models across commodity CPU/NPU VMs and CPU-only servers. Known trajectories execute via Track copy morphisms or resume in O(1) space from Station (ANCHOR + DELTA) snapshots; whenever any server encounters an unseen task (R ≠ 0), computing and committing that residual once makes the solution immediately available to every other node on the rail.
  • Heavy Mixture of Experts (HMoE). Because idle disk-mapped models consume zero weight-RAM, M-Rail routes across complete compiled Origami models (Origami-9B, Origami-27B, Origami-31B, Origami-78B, Origami-H3), zero-recompile static-graph NPU specialist pools, and sub-2 KB exact algebraic group organs on a synchronous station bus (cstar) under deterministic check gates.

Shared M-Rail GPU-less server fleet topology and multi-session memory scaling for Origami-H3

Figure 3. (a) Shared M-Rail (.mrail v3) fleet architecture: optional temporary GPU warmup feeds a permanent zero-GPU CPU/NPU/sGPU server fleet where any novel residual +R solved once commits back to all nodes alongside HMoE routing on cstar. (b) Total resident RAM/VRAM across N = 1..32 concurrent 32k-token sessions: pinned weights plus N · KV against shared read-only mmap plus N · O(1) constant state.

How to run

Requires Python 3.10+ and the wirkung runtime package (pip install -U wirkung), which installs the wkng, wirkung, sgpu, and rail CLI entrypoints.

pip install -U wirkung
wkng pull wirkung/Origami-H3 -o ./Origami-H3
wkng info ./Origami-H3
wkng verify ./Origami-H3 --full
from wirkung import Engine

eng = Engine("./Origami-H3")
print(eng.info())

Files

  • layers/*.o3f, vae/*.o3f: 307 folded HCGM DiT, Walsh-6 LoRA, 3D SoL-H3-VAE, and Audio-VAE operator files (10.38 GB total bundle)
  • exact_core.safetensors: exact modulation, norm, and conditioning scalars
  • bundle.json: shard inventory and SHA-256 digests verified by wkng verify
  • config.json, generation_config.json: pipeline and 4-step Euler schedule configuration
  • paper/Wirkung_2026_Origami_HCGM.pdf: the Origami Model Family technical report
  • assets/: banner.png, architecture.png, mechanism.png, mrail.png
  • LICENSE, NOTICE: Wirkung Model and Runtime License 1.0 and upstream attribution

Inquiries and collaboration

We welcome inquiries regarding custom zero-retraining HCGM model compilation, closed-form formula and exact algorithm synthesis via Wirkung, Shared M-Rail / zero-GPU enterprise fleet deployments, and research collaboration:

Papers

Citation

@techreport{foss2026origami,
  title       = {The Origami Model Family: Compiling Pretrained Foundation Models into Holographic Causal Graph Machines},
  author      = {Foss, David Tom},
  institution = {Wirkung Inc.},
  year        = {2026},
  month       = nov,
  doi         = {10.13140/RG.2.2.31826.72647},
  url         = {https://doi.org/10.13140/RG.2.2.31826.72647}
}

License

Released under the Wirkung Model and Runtime License 1.0. Compiled in closed form without training steps from Upstream MiniMax-H3 terms and notices (NOTICE); full attribution and closed-form transformation notices are recorded in NOTICE.

Downloads last month
2
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support