Add Origami-9B Enterprise Preview model card and header figures
Browse files- .gitattributes +4 -0
- README.md +152 -0
- assets/architecture_organs.pdf +0 -0
- assets/architecture_organs.png +3 -0
- assets/banner.png +3 -0
- assets/mrail_network.pdf +0 -0
- assets/mrail_network.png +3 -0
- assets/weights_vs_origami.pdf +0 -0
- assets/weights_vs_origami.png +3 -0
.gitattributes
CHANGED
|
@@ -346,3 +346,7 @@ layers/vision/merger__linear_fc2__weight.o3f filter=lfs diff=lfs merge=lfs -text
|
|
| 346 |
tokenizer.json filter=lfs diff=lfs merge=lfs -text
|
| 347 |
vocab/embed_tokens.o3f filter=lfs diff=lfs merge=lfs -text
|
| 348 |
vocab/lm_head.o3f filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 346 |
tokenizer.json filter=lfs diff=lfs merge=lfs -text
|
| 347 |
vocab/embed_tokens.o3f filter=lfs diff=lfs merge=lfs -text
|
| 348 |
vocab/lm_head.o3f filter=lfs diff=lfs merge=lfs -text
|
| 349 |
+
assets/architecture_organs.png filter=lfs diff=lfs merge=lfs -text
|
| 350 |
+
assets/banner.png filter=lfs diff=lfs merge=lfs -text
|
| 351 |
+
assets/mrail_network.png filter=lfs diff=lfs merge=lfs -text
|
| 352 |
+
assets/weights_vs_origami.png filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
|
@@ -0,0 +1,152 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
license_name: wirkung-model-and-runtime-1.0
|
| 4 |
+
license_link: LICENSE
|
| 5 |
+
library_name: wirkung
|
| 6 |
+
pipeline_tag: text-generation
|
| 7 |
+
base_model:
|
| 8 |
+
- Qwen/Qwen3.5-9B
|
| 9 |
+
base_model_relation: quantized
|
| 10 |
+
language:
|
| 11 |
+
- en
|
| 12 |
+
- de
|
| 13 |
+
- zh
|
| 14 |
+
- fr
|
| 15 |
+
- es
|
| 16 |
+
- ja
|
| 17 |
+
- ko
|
| 18 |
+
tags:
|
| 19 |
+
- wirkung
|
| 20 |
+
- origami
|
| 21 |
+
- preview
|
| 22 |
+
- hcgm
|
| 23 |
+
- m-rail
|
| 24 |
+
- sgpu
|
| 25 |
+
- hmoe
|
| 26 |
+
- constant-state
|
| 27 |
+
- cpu-inference
|
| 28 |
+
- zero-gpu
|
| 29 |
+
- multimodal
|
| 30 |
+
- qwen3.5
|
| 31 |
+
---
|
| 32 |
+
|
| 33 |
+

|
| 34 |
+
|
| 35 |
+
[Paper](https://doi.org/10.13140/RG.2.2.28206.68167) 路 [Runtime (PyPI)](https://pypi.org/project/wirkung/) 路 [Website](https://wirku.ng) 路 [Base weights](https://huggingface.co/Qwen/Qwen3.5-9B) 路 [License](https://huggingface.co/wirkung/Origami-9B/blob/main/LICENSE)
|
| 36 |
+
|
| 37 |
+
**Origami-9B (Preview)** is a multimodal hybrid Holographic Causal Graph Machine (HCGM) compiled in closed form from [`Qwen/Qwen3.5-9B`](https://huggingface.co/Qwen/Qwen3.5-9B) with zero gradient updates and zero fine-tuning steps. Executed directly from NVMe storage via OS `mmap` under the sovereign [`wirkung`](https://pypi.org/project/wirkung/) runtime, Origami-9B requires no GPU VRAM, eliminates PyTorch and CUDA framework overhead, maintains a strictly constant `O(1)` live session state across arbitrary sequence horizons, and produces bit-identical greedy token sequences across server, desktop, and edge CPU architectures.
|
| 38 |
+
|
| 39 |
+
```bash
|
| 40 |
+
pip install -U wirkung && wkng pull wirkung/Origami-9B -o ./Origami-9B
|
| 41 |
+
wkng run ./Origami-9B -p "Explain constant-state Ward carriers." --chat
|
| 42 |
+
```
|
| 43 |
+
|
| 44 |
+
## Architectural Overview: Upstream vs. Origami
|
| 45 |
+
|
| 46 |
+
| Architectural Dimension | Conventional Checkpoint Serving | `Origami-9B` (Wirkung HCGM Preview) | Structural Invariant |
|
| 47 |
+
|---|---|---|---|
|
| 48 |
+
| Compilation & Adaptation | Pretrained dense & hybrid weights | **Closed-form algebraic fold** | Zero gradient or training steps |
|
| 49 |
+
| Execution Substrate | GPU HBM + PyTorch / CUDA / vLLM | **Self-describing `mmap` operator file** | Zero GPU VRAM required |
|
| 50 |
+
| Weight Residency | Deserialized into resident VRAM / RAM | **Demand-paged directly from SSD / NVMe** | Shared read-only OS pages across sessions |
|
| 51 |
+
| Live Conversation State | `O(N)` KV cache growing with context | **Strictly constant `O(1)` carrier state** | Flat memory across arbitrary horizons |
|
| 52 |
+
| Multimodal Backbone | Separate dense vision & text execution | **Unified `.o3f` vision + hybrid graph** | Single coherent operator runtime |
|
| 53 |
+
| Vocabulary Readout | Full dense vocabulary matrix pass | **Certified Cauchy-Schwarz norm gate** | Exact greedy argmax preservation |
|
| 54 |
+
| Cross-Hardware Execution | Backend-dependent floating-point drift | **Bit-identical greedy token trajectories** | Deterministic across ARM64, x86_64 & edge |
|
| 55 |
+
| Fleet Reuse | Stateless per-request recomputation | **Shared `M-Rail` (`X = X_known + R`)** | Associative fleet-wide residual closure |
|
| 56 |
+
|
| 57 |
+

|
| 58 |
+
<sub><b>Figure 1.</b> Execution substrate and live session memory trajectory. Conventional serving deserializes full checkpoints into GPU memory and expands KV state linearly with sequence length, whereas Origami-9B executes directly from NVMe via read-only `mmap` and holds live session state strictly constant (`O(1)`) across arbitrary context horizons.</sub>
|
| 59 |
+
|
| 60 |
+
## Signature HCGM Architecture & Distinguishing Capabilities
|
| 61 |
+
|
| 62 |
+
- **The File Is the Machine (`mmap` Operator Graph)**: Dense projections across the hybrid language decoder, vision encoder, and vocabulary head fold into self-describing `.o3f` spectral operators stored on disk. At runtime, the OS maps operator pages directly into virtual address space on demand, allowing multiple concurrent sessions to share a single read-only mapping without loading weights into resident RAM or GPU HBM.
|
| 63 |
+
- **Constant `O(1)` Hybrid Carrier State**: Recurrent Gated DeltaNet carriers on linear layers paired with crystallized pinned-sink Ward carriers on full-attention layers bound live conversation memory to a fixed footprint regardless of prompt length, document size, or multi-turn agent duration.
|
| 64 |
+
- **Spectral Gate-Confidence Denoising**: Operating in the randomized Walsh-Hadamard spectral basis, gate-confidence filtering suppresses low-energy pretrained tail noise inside SwiGLU feed-forward blocks without fine-tuning.
|
| 65 |
+
- **Certified Cauchy-Schwarz Vocabulary Gate & Cross-ISA Determinism**: Exact row-norm certificates stored alongside the folded output head prune dominated vocabulary candidates prior to full inner-product evaluation while preserving exact greedy argmax tokens identically across Apple Silicon ARM64, x86_64 AVX2 servers, and mobile/edge ARM SoCs.
|
| 66 |
+
|
| 67 |
+

|
| 68 |
+
<sub><b>Figure 2.</b> Three-stage full-width HCGM operator pipeline of Origami-9B: multimodal vision-and-language operator intake over OS `mmap`, constant-state hybrid sequence processing with spectral gate denoising, and certified Cauchy-Schwarz vocabulary readout with cross-ISA bit-exactness.</sub>
|
| 69 |
+
|
| 70 |
+
## Shared M-Rail (`X = X_known + R`), sGPU Fleet Economics & HMoE
|
| 71 |
+
|
| 72 |
+

|
| 73 |
+
<sub><b>Figure 3.</b> Fleet topology over the Shared `M-Rail` associative trajectory bus. Recurring trajectories replay directly from verified stations (`R = 0`), while newly encountered residuals (`R != 0`) are solved once by any node and shared immediately across CPU and GPU peers.</sub>
|
| 74 |
+
|
| 75 |
+
Origami-9B integrates natively with the **Shared `M-Rail`** trajectory bus and bundled **`sGPU`** (`sgpu`, `cpuda`, `rail`) deterministic CPU execution layer:
|
| 76 |
+
|
| 77 |
+
1. **Warm Up Once, Serve Indefinitely on Disk-Backed CPU Fleets**: Every forward trajectory decomposes into known crystallized structure plus residual (`X = X_known + R`). Organizations can optionally use a single GPU or a brief cloud GPU lease to crystallize recurring workflows, system prompts, and agentic pipelines into `.mrail` tracks, shut GPUs down, and serve production traffic continuously on commodity CPU VMs backed by NVMe storage.
|
| 78 |
+
2. **Collective Associative Residual Closure**: Whenever any node in the fleet computes an unseen residual branch (`R != 0`), it commits verified `ANCHOR` / `DELTA` stations and `OP_COPY` morphisms to the shared `M-Rail` store (`wkng maps merge`), closing that trajectory for every peer node with zero greedy output drift.
|
| 79 |
+
3. **Heavy Mixture of Experts (`HMoE`) Specialist**: Mounted on the synchronous `M-Rail` `cstar` bus alongside `Origami-27B`, `Origami-31B`, `Origami-78B`, and `Origami-H3`, Origami-9B operates as a fast multimodal specialist, tool-calling router, and `DraftRail` span verifier.
|
| 80 |
+
|
| 81 |
+
## Runtime CLI & Python SDK
|
| 82 |
+
|
| 83 |
+
The standalone [`wirkung`](https://pypi.org/project/wirkung/) package (`pip install wirkung` or `pip install wkng`, `Python >= 3.10`, `numpy` as the sole Python dependency) provides both CLI tools and an embeddable Python engine:
|
| 84 |
+
|
| 85 |
+
```bash
|
| 86 |
+
# Verify host SIMD capabilities and model integrity
|
| 87 |
+
wkng doctor
|
| 88 |
+
sgpu doctor
|
| 89 |
+
wkng verify ./Origami-9B
|
| 90 |
+
|
| 91 |
+
# Launch an OpenAI-compatible local HTTP server or merge fleet M-Rail maps
|
| 92 |
+
wkng serve ./Origami-9B --host 127.0.0.1 --port 8080
|
| 93 |
+
wkng maps merge ./peer_node_maps --into ~/.wkng/maps
|
| 94 |
+
```
|
| 95 |
+
|
| 96 |
+
```python
|
| 97 |
+
from wirkung import Engine
|
| 98 |
+
|
| 99 |
+
engine = Engine("./Origami-9B")
|
| 100 |
+
response = engine.generate(
|
| 101 |
+
"Summarize the architectural role of pinned-sink Ward carriers in constant-state attention.",
|
| 102 |
+
chat=True,
|
| 103 |
+
)
|
| 104 |
+
print(response)
|
| 105 |
+
```
|
| 106 |
+
|
| 107 |
+
## Repository Contents
|
| 108 |
+
|
| 109 |
+
- `bundle.json`, `origami9b_manifest.json`, `config.json`, `generation_config.json`: HCGM bundle schema, operator manifest, and hybrid multimodal architecture metadata.
|
| 110 |
+
- `layers/`: compiled `.o3f` spectral operators across all hybrid decoder blocks and the multimodal vision encoder.
|
| 111 |
+
- `vocab/`: folded vocabulary readout operators with certified Cauchy-Schwarz row-norm bounds.
|
| 112 |
+
- `exact_core.safetensors`: exact normalization parameters, recurrent routing gates, and vision conditioning norms.
|
| 113 |
+
- `tokenizer.json`, `tokenizer_config.json`, `chat_template.jinja`, `processor_config.json`, `preprocessor_config.json`, `video_preprocessor_config.json`: standalone tokenizer and multimodal preprocessors.
|
| 114 |
+
- `LICENSE`, `NOTICE`: Wirkung Model and Runtime License Agreement 1.0 and upstream Apache-2.0 attribution notice.
|
| 115 |
+
|
| 116 |
+
## Enterprise, Custom Models & Research Inquiries
|
| 117 |
+
|
| 118 |
+
Wirkung partners with enterprises, AI labs, and infrastructure providers on:
|
| 119 |
+
|
| 120 |
+
- **Custom Model Compilations & Preview Access**: Closed-form HCGM folding of proprietary, domain-specific, or frontier checkpoints into zero-GPU, constant-state operator artifacts.
|
| 121 |
+
- **Exact Formula & Algorithm Synthesis (`Wirkung`)**: Symbolic and spectral operator discovery replacing dense compute bottlenecks with certified closed-form kernels.
|
| 122 |
+
- **Fleet & Inference-Provider Partnerships**: Production deployments of Shared `M-Rail`, disk-backed `sGPU` CPU cloud fabrics, and multi-specialist `HMoE` routing.
|
| 123 |
+
- **Research & Academic Collaboration**: Joint investigations into constant-state sequence modeling, deterministic cross-ISA inference, and reusable computation.
|
| 124 |
+
|
| 125 |
+
Reach us directly:
|
| 126 |
+
- **Email:** [`contact@wirku.ng`](mailto:contact@wirku.ng)
|
| 127 |
+
- **X:** [`https://x.com/FossDT`](https://x.com/FossDT)
|
| 128 |
+
- **Website:** [`https://wirku.ng`](https://wirku.ng)
|
| 129 |
+
|
| 130 |
+
## Papers
|
| 131 |
+
|
| 132 |
+
- **[The Holographic Causal Graph Machine: Compiling a Pretrained Transformer into a Constant-State Model without Training](https://doi.org/10.13140/RG.2.2.28206.68167)**. David Tom Foss, 2026.
|
| 133 |
+
- **[Crystallized Attention: Fixed-State Carriers and Exact Index Correction for the Full-Attention Heads of a 27B Hybrid Language Model](https://doi.org/10.13140/RG.2.2.21299.18725)**. David Tom Foss, 2026.
|
| 134 |
+
- **[Compute Once: Constant-State Language Models Make Answers Reusable and Agents Cheap](https://doi.org/10.13140/RG.2.2.18140.35202)**. David Tom Foss, 2026.
|
| 135 |
+
- **[No GPU, No KV Cache: A Constant-State Language Model on the Neural Engine of a Mac mini](https://doi.org/10.13140/RG.2.2.31562.12484)**. David Tom Foss, 2026.
|
| 136 |
+
- **[Scarcity as Method. Attention, Replaced: Exact Forms, Constant State, and Reusable Inference](https://doi.org/10.13140/RG.2.2.34347.40489)**. David Tom Foss, 2026.
|
| 137 |
+
|
| 138 |
+
## Citation
|
| 139 |
+
|
| 140 |
+
```bibtex
|
| 141 |
+
@misc{foss2026origami9b,
|
| 142 |
+
author = {David Tom Foss},
|
| 143 |
+
title = {{Origami-9B: Closed-Form Constant-State HCGM Compilation of Qwen3.5-9B}},
|
| 144 |
+
year = {2026},
|
| 145 |
+
howpublished = {Wirkung Inc., \url{https://huggingface.co/wirkung/Origami-9B}},
|
| 146 |
+
note = {DOI 10.13140/RG.2.2.28206.68167}
|
| 147 |
+
}
|
| 148 |
+
```
|
| 149 |
+
|
| 150 |
+
## License
|
| 151 |
+
|
| 152 |
+
Licensed under the **Wirkung Model and Runtime License Agreement 1.0** ([`LICENSE`](LICENSE)). Free for non-commercial research, academic evaluation, and personal use in compiled Object form; commercial or production deployment of Origami models, `wkng`, or `sgpu` requires a commercial license from Wirkung Inc. ([`contact@wirku.ng`](mailto:contact@wirku.ng)). Compiled in closed form without training from [`Qwen/Qwen3.5-9B`](https://huggingface.co/Qwen/Qwen3.5-9B) (Apache License 2.0; see [`NOTICE`](NOTICE)).
|
assets/architecture_organs.pdf
ADDED
|
Binary file (36 kB). View file
|
|
|
assets/architecture_organs.png
ADDED
|
Git LFS Details
|
assets/banner.png
ADDED
|
Git LFS Details
|
assets/mrail_network.pdf
ADDED
|
Binary file (29.6 kB). View file
|
|
|
assets/mrail_network.png
ADDED
|
Git LFS Details
|
assets/weights_vs_origami.pdf
ADDED
|
Binary file (46.4 kB). View file
|
|
|
assets/weights_vs_origami.png
ADDED
|
Git LFS Details
|