Update unified Origami Preview model card, wirkung.cls figures, and Family Paper PDF
Browse files- .gitattributes +3 -0
- README.md +83 -91
- assets/{weights_vs_origami.png → architecture.png} +2 -2
- assets/architecture_organs.pdf +0 -0
- assets/banner.png +2 -2
- assets/mechanism.png +0 -0
- assets/{architecture_organs.png → mrail.png} +2 -2
- assets/mrail_network.pdf +0 -0
- assets/weights_vs_origami.pdf +0 -0
- assets/mrail_network.png → paper/Foss_2026_Origami_HCGM.pdf +2 -2
.gitattributes
CHANGED
|
@@ -639,3 +639,6 @@ vision/layer-026/self_attn__o_proj.o3f filter=lfs diff=lfs merge=lfs -text
|
|
| 639 |
vision/layer-026/self_attn__q_proj.o3f filter=lfs diff=lfs merge=lfs -text
|
| 640 |
vision/layer-026/self_attn__v_proj.o3f filter=lfs diff=lfs merge=lfs -text
|
| 641 |
vocab/embed_tokens.o3f filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
| 639 |
vision/layer-026/self_attn__q_proj.o3f filter=lfs diff=lfs merge=lfs -text
|
| 640 |
vision/layer-026/self_attn__v_proj.o3f filter=lfs diff=lfs merge=lfs -text
|
| 641 |
vocab/embed_tokens.o3f filter=lfs diff=lfs merge=lfs -text
|
| 642 |
+
paper/Foss_2026_Origami_HCGM.pdf filter=lfs diff=lfs merge=lfs -text
|
| 643 |
+
assets/architecture.png filter=lfs diff=lfs merge=lfs -text
|
| 644 |
+
assets/mrail.png filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
|
@@ -2,152 +2,144 @@
|
|
| 2 |
license: other
|
| 3 |
license_name: wirkung-model-and-runtime-1.0
|
| 4 |
license_link: LICENSE
|
| 5 |
-
library_name: wirkung
|
| 6 |
-
pipeline_tag: text-generation
|
| 7 |
base_model:
|
| 8 |
-
- google/gemma-4-
|
| 9 |
base_model_relation: quantized
|
|
|
|
|
|
|
|
|
|
| 10 |
language:
|
| 11 |
- en
|
| 12 |
- de
|
| 13 |
-
- zh
|
| 14 |
-
- fr
|
| 15 |
-
- es
|
| 16 |
-
- ja
|
| 17 |
-
- ko
|
| 18 |
tags:
|
| 19 |
- wirkung
|
| 20 |
- origami
|
| 21 |
- preview
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 22 |
- hcgm
|
| 23 |
- m-rail
|
| 24 |
-
-
|
| 25 |
-
- hmoe
|
| 26 |
-
- constant-state
|
| 27 |
-
- cpu-inference
|
| 28 |
-
- zero-gpu
|
| 29 |
- multimodal
|
| 30 |
-
-
|
|
|
|
| 31 |
---
|
| 32 |
|
| 33 |
-

|
| 130 |
|
| 131 |
## Papers
|
| 132 |
|
| 133 |
-
- **[The
|
| 134 |
-
- **[
|
| 135 |
-
- **[
|
| 136 |
-
- **[
|
| 137 |
|
| 138 |
## Citation
|
| 139 |
|
| 140 |
```bibtex
|
| 141 |
-
@
|
| 142 |
-
|
| 143 |
-
|
| 144 |
-
|
| 145 |
-
year
|
| 146 |
-
|
| 147 |
-
|
| 148 |
}
|
| 149 |
```
|
| 150 |
|
| 151 |
## License
|
| 152 |
|
| 153 |
-
|
|
|
|
| 2 |
license: other
|
| 3 |
license_name: wirkung-model-and-runtime-1.0
|
| 4 |
license_link: LICENSE
|
|
|
|
|
|
|
| 5 |
base_model:
|
| 6 |
+
- google/gemma-4-31b-it
|
| 7 |
base_model_relation: quantized
|
| 8 |
+
library_name: wirkung
|
| 9 |
+
pipeline_tag: text-generation
|
| 10 |
+
num_parameters: 32680000000
|
| 11 |
language:
|
| 12 |
- en
|
| 13 |
- de
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
tags:
|
| 15 |
- wirkung
|
| 16 |
- origami
|
| 17 |
- preview
|
| 18 |
+
- training-free
|
| 19 |
+
- lossless-folding
|
| 20 |
+
- constant-memory
|
| 21 |
+
- zero-vram
|
| 22 |
+
- cpu-inference
|
| 23 |
+
- npu
|
| 24 |
- hcgm
|
| 25 |
- m-rail
|
| 26 |
+
- 31b
|
|
|
|
|
|
|
|
|
|
|
|
|
| 27 |
- multimodal
|
| 28 |
+
- gemma-4
|
| 29 |
+
- vision-language
|
| 30 |
---
|
| 31 |
|
| 32 |
+

|
| 33 |
+
|
| 34 |
+
[Paper](paper/Foss_2026_Origami_HCGM.pdf) · [Runtime (PyPI)](https://pypi.org/project/wirkung/) · [Wirkung](https://wirku.ng) · [Base weights](https://huggingface.co/google/gemma-4-31b-it) · [Contact](mailto:contact@wirku.ng) · [License](LICENSE)
|
| 35 |
|
| 36 |
+
**`Origami-31B` is a 32.68B-parameter Holographic Causal Graph Machine (HCGM) Preview compiled in closed form from `google/gemma-4-31b-it` with zero retraining, zero fine-tuning, and zero gradient steps. It folds the 62.55 GB source checkpoint into 11.56 GB (5.41x compression), executes directly from NVMe/SSD storage via OS `mmap` with `0 GB` GPU VRAM and `0 GB` dedicated weight-RAM, and keeps live state strictly constant ($O(1)$) across arbitrary horizons on CPU, NPU, `sGPU`, Metal, and standalone PTX.**
|
| 37 |
|
| 38 |
+
`Origami-31B` preserves the full `google/gemma-4-31b-it` architecture (50 sliding-window attention layers, 10 symmetric $K = V$ global-attention layers, a 27-layer SigLIP vision tower, and a tied 262,144-entry softcapped vocabulary) while turning a passive weight checkpoint into a self-contained binary file executed under one cross-silicon contract. It succeeds our first-generation constant-state releases published under [`huggingface.co/tfwnotops`](https://huggingface.co/tfwnotops) by removing `vLLM`, `MLX`, and `Transformers` runtime dependencies altogether. This repository is a **Preview** release: structural byte footprints, fold ratios, and constant-memory invariants below are fixed properties of the compiled artifact, while hardware-dependent throughput figures are omitted from the card and documented in the [Origami Family Paper](paper/Foss_2026_Origami_HCGM.pdf).
|
| 39 |
|
| 40 |
```bash
|
| 41 |
pip install -U wirkung && wkng pull wirkung/Origami-31B -o ./Origami-31B
|
| 42 |
+
wkng run ./Origami-31B -p "Explain why monotone logit softcapping preserves exact Cauchy-Schwarz row pruning." -n 128
|
| 43 |
```
|
| 44 |
|
| 45 |
+
## Source checkpoint against Origami-31B
|
| 46 |
|
| 47 |
+
| Property | Source (`google/gemma-4-31b-it`) | `Origami-31B` (HCGM Preview) |
|
| 48 |
+
|:--|--:|--:|
|
| 49 |
+
| Parameters | 32.68B | **32.68B** (identical graph topology) |
|
| 50 |
+
| Retraining / fine-tuning steps | Pretrained baseline | **0** (closed-form compilation) |
|
| 51 |
+
| Checkpoint footprint on disk | 62.55 GB BF16 | **11.56 GB** (**5.41x** smaller; 601 `.o3f` text, vision, and vocabulary files + `exact_core.safetensors`) |
|
| 52 |
+
| Required GPU VRAM | Multi-tens of GB HBM | **0 GB** (runs on plain CPU / NPU / `sGPU` or optional GPU) |
|
| 53 |
+
| Dedicated weight-RAM | Pinned in host / device RAM | **0 GB** (read-only OS `mmap` directly from SSD/NVMe) |
|
| 54 |
+
| Live session / horizon state | Linearly growing $O(T)$ global KV cache across 10 full-attention layers | **Constant $O(1)$ bounded sliding-window + symmetric $K = V$ carrier at any length** |
|
| 55 |
+
| Operator & readout path | Dense per-step matrix scan | Certified Cauchy-Schwarz gate under $\kappa \tanh(z/\kappa)$ logit softcapping (median 2.0 of 262,144 rows, 0 drift) |
|
| 56 |
+
| Runtime dependencies | PyTorch / `vLLM` / `MLX` / CUDA | **`wirkung` + `numpy`** (standalone C11, NPU, `sGPU`, Metal, PTX) |
|
| 57 |
|
| 58 |
+

|
|
|
|
| 59 |
|
| 60 |
+
Figure 1. (a) Physical byte scale contrasting the 62.55 GB BF16 `google/gemma-4-31b-it` checkpoint against the 11.56 GB `Origami-31B` `.o3f` bundle mapped directly from SSD (`0 GB` GPU VRAM, `0 GB` dedicated weight-RAM). (b) Live conversation state across 4k to 1M tokens: linear $O(T)$ KV growth against the bounded $O(1)$ `Origami-31B` carrier.
|
| 61 |
|
| 62 |
+
## Zero-retraining compilation and constant-state architecture
|
|
|
|
|
|
|
|
|
|
| 63 |
|
| 64 |
+
Every Origami model is produced by the same four-part compilation pipeline without gradient descent:
|
|
|
|
| 65 |
|
| 66 |
+
1. **The file is the machine (disk-resident `mmap` execution).** An HCGM model is an immutable binary artifact on disk. The operating system maps operator pages read-only on demand from SSD or NVMe storage, requiring neither GPU VRAM nor weight-deserialization buffers in host RAM. Under our `v3-exakt` dyadic integer reduction contract, CPU (`AVX2` / `NEON`), general NPUs, embedded `sGPU` (`cpu_cuda`), Apple Metal, and driver-API PTX evaluate identical canonical reductions rather than drifting floating-point kernel approximations.
|
| 67 |
+
2. **Closed-form multimodal folding (`.o3f`, 5.41x without retraining).** Compiled directly from the pure BF16 62.55 GB `google/gemma-4-31b-it` repository (61.40 GB active text and vision weights) with zero gradient steps, `Origami-31B` packs all 60 decoder layers, the 27-layer SigLIP vision encoder, and the tied 262,144-row head into 11.56 GB across 601 `.o3f` operator files via Rademacher-scrambled `FWHT_128` bitplanes and rank-$r$ projective crystals ($U_r V_r^\top$).
|
| 68 |
+
3. **Constant $O(1)$ symmetric $K = V$ carrier synthesized via `Wirkung`.** Through `Wirkung`, our internal exact structural-law and closed-form operator synthesis engine, the 50 local sliding-window layers pair with a constant-capacity pinned-sink carrier on the 10 global symmetric $K = V$ attention layers, holding live memory strictly independent of sequence length $T$ while preserving exact argmax ordering across monotonically softcapped $\psi(z) = 30 \tanh(z/30)$ vocabulary logits.
|
| 69 |
+
4. **Certified readout and online trajectory decomposition ($X = X_{\mathrm{known}} + R$).** Rather than re-evaluating every parameter blindly for isolated single tokens, HCGM decomposes live hidden trajectories into known low-rank structure $X_{\mathrm{known}}$ (cosine trajectory banks, multi-order suffix tables, and rank-1 Sherman-Morrison-Woodbury updates) plus novel residual $R$, verifying multiple candidate steps in one weight pass with zero greedy output drift.
|
| 70 |
|
| 71 |
+

|
|
|
|
| 72 |
|
| 73 |
+
Figure 2. (a) Constant-memory attention read over token coordinate $j$: pinned sink $s_0$, bounded symmetric $K = V$ far-history carrier, and exact sliding-window frontier. (b) Single-pass `.o3f` contraction with 4-class Walsh-Hadamard bitplanes, rank-$r$ projective crystal ($U_r V_r^\top$), and softcap-invariant Cauchy-Schwarz pruning.
|
| 74 |
|
| 75 |
+
## Shared trajectory assimilation (M-Rail), GPU-less server fleets and multi-model routing (HMoE)
|
|
|
|
|
|
|
| 76 |
|
| 77 |
+
Beyond single-node execution, `Origami-31B` attaches natively to **Shared `M-Rail`** (`.mrail` v3), a content-addressed associative trajectory manifold shared across processes or across an enterprise network:
|
| 78 |
|
| 79 |
+
- **Warm up once on one GPU, run permanently on disk-only CPU/NPU servers.** Because HCGM models require only SSD storage and megabytes of live state, an organization can run a single GPU (or a short temporary cloud GPU lease) until its recurring domain workflows are crystallized into a shared `.mrail` file, then shut the GPU down and serve frontier models across commodity CPU/NPU VMs and CPU-only servers. Known trajectories execute via `Spur` copy morphisms or resume in $O(1)$ space from `Station` (`ANCHOR` + `DELTA`) snapshots; whenever any server encounters an unseen task ($R \neq 0$), computing and committing that residual once makes the solution immediately available to every other node on the rail.
|
| 80 |
+
- **Heavy Mixture of Experts (`HMoE`).** Because idle disk-mapped models consume zero weight-RAM, `M-Rail` routes across complete compiled Origami models (`Origami-9B`, `Origami-27B`, `Origami-31B`, `Origami-78B`, `Origami-H3`), zero-recompile static-graph NPU specialist pools, and sub-2 KB exact algebraic group organs on a synchronous station bus (`cstar`) under deterministic check gates.
|
| 81 |
|
| 82 |
+

|
| 83 |
+
|
| 84 |
+
Figure 3. (a) Shared `M-Rail` (`.mrail` v3) fleet architecture: optional temporary GPU warmup feeds a permanent zero-GPU CPU/NPU/`sGPU` server fleet where any novel residual $+R$ solved once commits back to all nodes alongside `HMoE` routing on `cstar`. (b) Total resident RAM/VRAM across $N = 1..32$ concurrent 32k-token sessions: pinned weights plus $N \cdot \mathrm{KV}$ against shared read-only `mmap` plus $N \cdot O(1)$ constant state.
|
| 85 |
+
|
| 86 |
+
## How to run
|
| 87 |
|
| 88 |
+
Requires Python 3.10+ and the `wirkung` runtime package (`pip install -U wirkung`), which installs the `wkng`, `wirkung`, `sgpu`, and `rail` CLI entrypoints.
|
| 89 |
+
|
| 90 |
+
```bash
|
| 91 |
+
pip install -U wirkung
|
| 92 |
+
wkng pull wirkung/Origami-31B -o ./Origami-31B
|
| 93 |
+
wkng verify ./Origami-31B --full
|
| 94 |
+
wkng run ./Origami-31B --chat
|
| 95 |
wkng serve ./Origami-31B --host 127.0.0.1 --port 8080
|
|
|
|
| 96 |
```
|
| 97 |
|
| 98 |
```python
|
| 99 |
from wirkung import Engine
|
| 100 |
|
| 101 |
+
eng = Engine("./Origami-31B")
|
| 102 |
+
print(eng.generate("Compare linear O(T) KV caches against fixed-capacity symmetric K=V carriers:", max_new_tokens=128))
|
|
|
|
|
|
|
|
|
|
|
|
|
| 103 |
```
|
| 104 |
|
| 105 |
+
## Files
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 106 |
|
| 107 |
+
- `layers/*.o3f`, `vision/*.o3f`, `vocab/*.o3f`: 601 folded HCGM text, vision, and vocabulary operator files (11.56 GB total bundle)
|
| 108 |
+
- `exact_core.safetensors`: exact norms and structural scalars
|
| 109 |
+
- `bundle.json`: shard inventory and SHA-256 digests verified by `wkng verify`
|
| 110 |
+
- `config.json`, `generation_config.json`, `processor_config.json`, `tokenizer.json`, `tokenizer_config.json`, `chat_template.jinja`: multimodal and tokenizer configuration
|
| 111 |
+
- `paper/Foss_2026_Origami_HCGM.pdf`: the Origami Model Family technical report
|
| 112 |
+
- `assets/`: `banner.png`, `architecture.png`, `mechanism.png`, `mrail.png`
|
| 113 |
+
- `LICENSE`, `NOTICE`: Wirkung Model and Runtime License 1.0 and upstream attribution
|
| 114 |
|
| 115 |
+
## Inquiries and collaboration
|
| 116 |
|
| 117 |
+
We welcome inquiries regarding custom zero-retraining HCGM model compilation, closed-form formula and exact algorithm synthesis via `Wirkung`, Shared `M-Rail` / zero-GPU enterprise fleet deployments, and research collaboration:
|
|
|
|
|
|
|
|
|
|
| 118 |
|
| 119 |
+
- **Email:** [contact@wirku.ng](mailto:contact@wirku.ng)
|
| 120 |
+
- **X (Twitter):** [https://x.com/FossDT](https://x.com/FossDT)
|
| 121 |
+
- **Web:** [https://wirku.ng](https://wirku.ng)
|
|
|
|
| 122 |
|
| 123 |
## Papers
|
| 124 |
|
| 125 |
+
- **[The Origami Model Family: Compiling Pretrained Foundation Models into Holographic Causal Graph Machines](paper/Foss_2026_Origami_HCGM.pdf)**. David Tom Foss, 2026. Included directly in this repository at `paper/Foss_2026_Origami_HCGM.pdf`.
|
| 126 |
+
- **[Holographic Causal Graph Machines: Source-Free Constant-State Execution of Pretrained Transformers](https://doi.org/10.5281/zenodo.19040842)**. David Tom Foss, 2026.
|
| 127 |
+
- **[Crystallized Attention: Constant-Memory Exact Store and Exponential-Mode Carriers](https://doi.org/10.5281/zenodo.19058017)**. David Tom Foss, 2026.
|
| 128 |
+
- **[Intelligence Is Not Made of Scarcity: Constant-Memory Causal Execution and Associative M-Rail](https://doi.org/10.13140/RG.2.2.28823.43689)**. David Tom Foss, 2026.
|
| 129 |
|
| 130 |
## Citation
|
| 131 |
|
| 132 |
```bibtex
|
| 133 |
+
@techreport{foss2026origami,
|
| 134 |
+
title = {The Origami Model Family: Compiling Pretrained Foundation Models into Holographic Causal Graph Machines},
|
| 135 |
+
author = {Foss, David Tom},
|
| 136 |
+
institution = {Wirkung Inc.},
|
| 137 |
+
year = {2026},
|
| 138 |
+
month = nov,
|
| 139 |
+
url = {https://wirku.ng}
|
| 140 |
}
|
| 141 |
```
|
| 142 |
|
| 143 |
## License
|
| 144 |
|
| 145 |
+
Released under the [Wirkung Model and Runtime License 1.0](LICENSE). Compiled in closed form without training steps from Gemma Terms of Use / upstream license (`google/gemma-4-31b-it`); full attribution and closed-form transformation notices are recorded in [`NOTICE`](NOTICE).
|
assets/{weights_vs_origami.png → architecture.png}
RENAMED
|
File without changes
|
assets/architecture_organs.pdf
DELETED
|
Binary file (33.5 kB)
|
|
|
assets/banner.png
CHANGED
|
Git LFS Details
|
|
Git LFS Details
|
assets/mechanism.png
ADDED
|
assets/{architecture_organs.png → mrail.png}
RENAMED
|
File without changes
|
assets/mrail_network.pdf
DELETED
|
Binary file (29.5 kB)
|
|
|
assets/weights_vs_origami.pdf
DELETED
|
Binary file (46.6 kB)
|
|
|
assets/mrail_network.png → paper/Foss_2026_Origami_HCGM.pdf
RENAMED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:72360f42140569826578d8c872b993a5be6ec1b43015d2536b82ec7e33ff9868
|
| 3 |
+
size 1716287
|