davidfoss commited on
Commit
fc86ca7
路
verified 路
1 Parent(s): 1ac2bff

Add Origami-9B Enterprise Preview model card and header figures

Browse files
.gitattributes CHANGED
@@ -346,3 +346,7 @@ layers/vision/merger__linear_fc2__weight.o3f filter=lfs diff=lfs merge=lfs -text
346
  tokenizer.json filter=lfs diff=lfs merge=lfs -text
347
  vocab/embed_tokens.o3f filter=lfs diff=lfs merge=lfs -text
348
  vocab/lm_head.o3f filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
346
  tokenizer.json filter=lfs diff=lfs merge=lfs -text
347
  vocab/embed_tokens.o3f filter=lfs diff=lfs merge=lfs -text
348
  vocab/lm_head.o3f filter=lfs diff=lfs merge=lfs -text
349
+ assets/architecture_organs.png filter=lfs diff=lfs merge=lfs -text
350
+ assets/banner.png filter=lfs diff=lfs merge=lfs -text
351
+ assets/mrail_network.png filter=lfs diff=lfs merge=lfs -text
352
+ assets/weights_vs_origami.png filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,152 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: wirkung-model-and-runtime-1.0
4
+ license_link: LICENSE
5
+ library_name: wirkung
6
+ pipeline_tag: text-generation
7
+ base_model:
8
+ - Qwen/Qwen3.5-9B
9
+ base_model_relation: quantized
10
+ language:
11
+ - en
12
+ - de
13
+ - zh
14
+ - fr
15
+ - es
16
+ - ja
17
+ - ko
18
+ tags:
19
+ - wirkung
20
+ - origami
21
+ - preview
22
+ - hcgm
23
+ - m-rail
24
+ - sgpu
25
+ - hmoe
26
+ - constant-state
27
+ - cpu-inference
28
+ - zero-gpu
29
+ - multimodal
30
+ - qwen3.5
31
+ ---
32
+
33
+ ![Multimodal hybrid Holographic Causal Graph Machine with disk-mapped execution, constant session state, and native M-Rail support.](assets/banner.png)
34
+
35
+ [Paper](https://doi.org/10.13140/RG.2.2.28206.68167) 路 [Runtime (PyPI)](https://pypi.org/project/wirkung/) 路 [Website](https://wirku.ng) 路 [Base weights](https://huggingface.co/Qwen/Qwen3.5-9B) 路 [License](https://huggingface.co/wirkung/Origami-9B/blob/main/LICENSE)
36
+
37
+ **Origami-9B (Preview)** is a multimodal hybrid Holographic Causal Graph Machine (HCGM) compiled in closed form from [`Qwen/Qwen3.5-9B`](https://huggingface.co/Qwen/Qwen3.5-9B) with zero gradient updates and zero fine-tuning steps. Executed directly from NVMe storage via OS `mmap` under the sovereign [`wirkung`](https://pypi.org/project/wirkung/) runtime, Origami-9B requires no GPU VRAM, eliminates PyTorch and CUDA framework overhead, maintains a strictly constant `O(1)` live session state across arbitrary sequence horizons, and produces bit-identical greedy token sequences across server, desktop, and edge CPU architectures.
38
+
39
+ ```bash
40
+ pip install -U wirkung && wkng pull wirkung/Origami-9B -o ./Origami-9B
41
+ wkng run ./Origami-9B -p "Explain constant-state Ward carriers." --chat
42
+ ```
43
+
44
+ ## Architectural Overview: Upstream vs. Origami
45
+
46
+ | Architectural Dimension | Conventional Checkpoint Serving | `Origami-9B` (Wirkung HCGM Preview) | Structural Invariant |
47
+ |---|---|---|---|
48
+ | Compilation & Adaptation | Pretrained dense & hybrid weights | **Closed-form algebraic fold** | Zero gradient or training steps |
49
+ | Execution Substrate | GPU HBM + PyTorch / CUDA / vLLM | **Self-describing `mmap` operator file** | Zero GPU VRAM required |
50
+ | Weight Residency | Deserialized into resident VRAM / RAM | **Demand-paged directly from SSD / NVMe** | Shared read-only OS pages across sessions |
51
+ | Live Conversation State | `O(N)` KV cache growing with context | **Strictly constant `O(1)` carrier state** | Flat memory across arbitrary horizons |
52
+ | Multimodal Backbone | Separate dense vision & text execution | **Unified `.o3f` vision + hybrid graph** | Single coherent operator runtime |
53
+ | Vocabulary Readout | Full dense vocabulary matrix pass | **Certified Cauchy-Schwarz norm gate** | Exact greedy argmax preservation |
54
+ | Cross-Hardware Execution | Backend-dependent floating-point drift | **Bit-identical greedy token trajectories** | Deterministic across ARM64, x86_64 & edge |
55
+ | Fleet Reuse | Stateless per-request recomputation | **Shared `M-Rail` (`X = X_known + R`)** | Associative fleet-wide residual closure |
56
+
57
+ ![Disk-mapped execution and constant session state](assets/weights_vs_origami.png)
58
+ <sub><b>Figure 1.</b> Execution substrate and live session memory trajectory. Conventional serving deserializes full checkpoints into GPU memory and expands KV state linearly with sequence length, whereas Origami-9B executes directly from NVMe via read-only `mmap` and holds live session state strictly constant (`O(1)`) across arbitrary context horizons.</sub>
59
+
60
+ ## Signature HCGM Architecture & Distinguishing Capabilities
61
+
62
+ - **The File Is the Machine (`mmap` Operator Graph)**: Dense projections across the hybrid language decoder, vision encoder, and vocabulary head fold into self-describing `.o3f` spectral operators stored on disk. At runtime, the OS maps operator pages directly into virtual address space on demand, allowing multiple concurrent sessions to share a single read-only mapping without loading weights into resident RAM or GPU HBM.
63
+ - **Constant `O(1)` Hybrid Carrier State**: Recurrent Gated DeltaNet carriers on linear layers paired with crystallized pinned-sink Ward carriers on full-attention layers bound live conversation memory to a fixed footprint regardless of prompt length, document size, or multi-turn agent duration.
64
+ - **Spectral Gate-Confidence Denoising**: Operating in the randomized Walsh-Hadamard spectral basis, gate-confidence filtering suppresses low-energy pretrained tail noise inside SwiGLU feed-forward blocks without fine-tuning.
65
+ - **Certified Cauchy-Schwarz Vocabulary Gate & Cross-ISA Determinism**: Exact row-norm certificates stored alongside the folded output head prune dominated vocabulary candidates prior to full inner-product evaluation while preserving exact greedy argmax tokens identically across Apple Silicon ARM64, x86_64 AVX2 servers, and mobile/edge ARM SoCs.
66
+
67
+ ![HCGM organ and operator architecture](assets/architecture_organs.png)
68
+ <sub><b>Figure 2.</b> Three-stage full-width HCGM operator pipeline of Origami-9B: multimodal vision-and-language operator intake over OS `mmap`, constant-state hybrid sequence processing with spectral gate denoising, and certified Cauchy-Schwarz vocabulary readout with cross-ISA bit-exactness.</sub>
69
+
70
+ ## Shared M-Rail (`X = X_known + R`), sGPU Fleet Economics & HMoE
71
+
72
+ ![Shared M-Rail, sGPU fleet, and HMoE topology](assets/mrail_network.png)
73
+ <sub><b>Figure 3.</b> Fleet topology over the Shared `M-Rail` associative trajectory bus. Recurring trajectories replay directly from verified stations (`R = 0`), while newly encountered residuals (`R != 0`) are solved once by any node and shared immediately across CPU and GPU peers.</sub>
74
+
75
+ Origami-9B integrates natively with the **Shared `M-Rail`** trajectory bus and bundled **`sGPU`** (`sgpu`, `cpuda`, `rail`) deterministic CPU execution layer:
76
+
77
+ 1. **Warm Up Once, Serve Indefinitely on Disk-Backed CPU Fleets**: Every forward trajectory decomposes into known crystallized structure plus residual (`X = X_known + R`). Organizations can optionally use a single GPU or a brief cloud GPU lease to crystallize recurring workflows, system prompts, and agentic pipelines into `.mrail` tracks, shut GPUs down, and serve production traffic continuously on commodity CPU VMs backed by NVMe storage.
78
+ 2. **Collective Associative Residual Closure**: Whenever any node in the fleet computes an unseen residual branch (`R != 0`), it commits verified `ANCHOR` / `DELTA` stations and `OP_COPY` morphisms to the shared `M-Rail` store (`wkng maps merge`), closing that trajectory for every peer node with zero greedy output drift.
79
+ 3. **Heavy Mixture of Experts (`HMoE`) Specialist**: Mounted on the synchronous `M-Rail` `cstar` bus alongside `Origami-27B`, `Origami-31B`, `Origami-78B`, and `Origami-H3`, Origami-9B operates as a fast multimodal specialist, tool-calling router, and `DraftRail` span verifier.
80
+
81
+ ## Runtime CLI & Python SDK
82
+
83
+ The standalone [`wirkung`](https://pypi.org/project/wirkung/) package (`pip install wirkung` or `pip install wkng`, `Python >= 3.10`, `numpy` as the sole Python dependency) provides both CLI tools and an embeddable Python engine:
84
+
85
+ ```bash
86
+ # Verify host SIMD capabilities and model integrity
87
+ wkng doctor
88
+ sgpu doctor
89
+ wkng verify ./Origami-9B
90
+
91
+ # Launch an OpenAI-compatible local HTTP server or merge fleet M-Rail maps
92
+ wkng serve ./Origami-9B --host 127.0.0.1 --port 8080
93
+ wkng maps merge ./peer_node_maps --into ~/.wkng/maps
94
+ ```
95
+
96
+ ```python
97
+ from wirkung import Engine
98
+
99
+ engine = Engine("./Origami-9B")
100
+ response = engine.generate(
101
+ "Summarize the architectural role of pinned-sink Ward carriers in constant-state attention.",
102
+ chat=True,
103
+ )
104
+ print(response)
105
+ ```
106
+
107
+ ## Repository Contents
108
+
109
+ - `bundle.json`, `origami9b_manifest.json`, `config.json`, `generation_config.json`: HCGM bundle schema, operator manifest, and hybrid multimodal architecture metadata.
110
+ - `layers/`: compiled `.o3f` spectral operators across all hybrid decoder blocks and the multimodal vision encoder.
111
+ - `vocab/`: folded vocabulary readout operators with certified Cauchy-Schwarz row-norm bounds.
112
+ - `exact_core.safetensors`: exact normalization parameters, recurrent routing gates, and vision conditioning norms.
113
+ - `tokenizer.json`, `tokenizer_config.json`, `chat_template.jinja`, `processor_config.json`, `preprocessor_config.json`, `video_preprocessor_config.json`: standalone tokenizer and multimodal preprocessors.
114
+ - `LICENSE`, `NOTICE`: Wirkung Model and Runtime License Agreement 1.0 and upstream Apache-2.0 attribution notice.
115
+
116
+ ## Enterprise, Custom Models & Research Inquiries
117
+
118
+ Wirkung partners with enterprises, AI labs, and infrastructure providers on:
119
+
120
+ - **Custom Model Compilations & Preview Access**: Closed-form HCGM folding of proprietary, domain-specific, or frontier checkpoints into zero-GPU, constant-state operator artifacts.
121
+ - **Exact Formula & Algorithm Synthesis (`Wirkung`)**: Symbolic and spectral operator discovery replacing dense compute bottlenecks with certified closed-form kernels.
122
+ - **Fleet & Inference-Provider Partnerships**: Production deployments of Shared `M-Rail`, disk-backed `sGPU` CPU cloud fabrics, and multi-specialist `HMoE` routing.
123
+ - **Research & Academic Collaboration**: Joint investigations into constant-state sequence modeling, deterministic cross-ISA inference, and reusable computation.
124
+
125
+ Reach us directly:
126
+ - **Email:** [`contact@wirku.ng`](mailto:contact@wirku.ng)
127
+ - **X:** [`https://x.com/FossDT`](https://x.com/FossDT)
128
+ - **Website:** [`https://wirku.ng`](https://wirku.ng)
129
+
130
+ ## Papers
131
+
132
+ - **[The Holographic Causal Graph Machine: Compiling a Pretrained Transformer into a Constant-State Model without Training](https://doi.org/10.13140/RG.2.2.28206.68167)**. David Tom Foss, 2026.
133
+ - **[Crystallized Attention: Fixed-State Carriers and Exact Index Correction for the Full-Attention Heads of a 27B Hybrid Language Model](https://doi.org/10.13140/RG.2.2.21299.18725)**. David Tom Foss, 2026.
134
+ - **[Compute Once: Constant-State Language Models Make Answers Reusable and Agents Cheap](https://doi.org/10.13140/RG.2.2.18140.35202)**. David Tom Foss, 2026.
135
+ - **[No GPU, No KV Cache: A Constant-State Language Model on the Neural Engine of a Mac mini](https://doi.org/10.13140/RG.2.2.31562.12484)**. David Tom Foss, 2026.
136
+ - **[Scarcity as Method. Attention, Replaced: Exact Forms, Constant State, and Reusable Inference](https://doi.org/10.13140/RG.2.2.34347.40489)**. David Tom Foss, 2026.
137
+
138
+ ## Citation
139
+
140
+ ```bibtex
141
+ @misc{foss2026origami9b,
142
+ author = {David Tom Foss},
143
+ title = {{Origami-9B: Closed-Form Constant-State HCGM Compilation of Qwen3.5-9B}},
144
+ year = {2026},
145
+ howpublished = {Wirkung Inc., \url{https://huggingface.co/wirkung/Origami-9B}},
146
+ note = {DOI 10.13140/RG.2.2.28206.68167}
147
+ }
148
+ ```
149
+
150
+ ## License
151
+
152
+ Licensed under the **Wirkung Model and Runtime License Agreement 1.0** ([`LICENSE`](LICENSE)). Free for non-commercial research, academic evaluation, and personal use in compiled Object form; commercial or production deployment of Origami models, `wkng`, or `sgpu` requires a commercial license from Wirkung Inc. ([`contact@wirku.ng`](mailto:contact@wirku.ng)). Compiled in closed form without training from [`Qwen/Qwen3.5-9B`](https://huggingface.co/Qwen/Qwen3.5-9B) (Apache License 2.0; see [`NOTICE`](NOTICE)).
assets/architecture_organs.pdf ADDED
Binary file (36 kB). View file
 
assets/architecture_organs.png ADDED

Git LFS Details

  • SHA256: f33906252e9c24e71743f61e4f936a032800088ca7b5125d4557e8aa37adfb0a
  • Pointer size: 131 Bytes
  • Size of remote file: 260 kB
assets/banner.png ADDED

Git LFS Details

  • SHA256: 49f58a63232a7052e6604f0ed2caf4abafeb953b714c251d8e4d9c8dad5ceaca
  • Pointer size: 131 Bytes
  • Size of remote file: 215 kB
assets/mrail_network.pdf ADDED
Binary file (29.6 kB). View file
 
assets/mrail_network.png ADDED

Git LFS Details

  • SHA256: 3945ec67a81d83129ab8236f4ad90bdc0d8a765b7a2e62f7f38cc51f98aeb4fe
  • Pointer size: 131 Bytes
  • Size of remote file: 225 kB
assets/weights_vs_origami.pdf ADDED
Binary file (46.4 kB). View file
 
assets/weights_vs_origami.png ADDED

Git LFS Details

  • SHA256: 0c68a840f05dbd81267edd6854b8d91f42b28c6ee1533ed1137ded5a173b9ee4
  • Pointer size: 131 Bytes
  • Size of remote file: 264 kB