Architectural Positioning: Lightweight Foundational Family vs Heavyweight Large Model Tier
ZAQERIS AI engineers two complementary model families: AXIOM serves as the agile, high-throughput foundation tailored for single-workstation edge execution, while ZAQION represents the absolute heavy-weight cognitive Large Model engineered for multi-step mathematical deduction and complex systems software synthesis.
| Architectural Dimension |
AXIOM Family
Lightweight High-Throughput Core
|
ZAQION Family
Heavyweight Large Model Tier
|
|---|---|---|
| Total Physical Parameters | 79.43 Billion (79,425,295,488) | 150.0 Billion (150,000,000,000) |
| Active Parameters per Forward Pass | 12.39 Billion (Static Top-2 Gating) | 12.5B to 50.0B (Adaptive-k: Top-2 to Top-8) |
| Transformer Layers & Topology | 36 Layers × 16 MoE Experts | 64 Layers × 32 Physical Experts (4 ERA Swarms) |
| Model Dimension ($d_{model}$ / $d_{ffn}$) | 4,224 / 10,496 | 5,376 / 15,360 |
| Attention Mechanism | GQA 32:8 (Head Dim 128) | GQA 48:8 (Head Dim 112) |
| Native Quantization Engine | ZAQERIS-M3 (8D Gosset $E_8$ Lattice) | ZAQERIS-M4 Gold (16D Barnes-Wall $\Lambda_{16}$) |
| On-Disk Compressed Footprint | 29.20 GiB (3.158 bpp) | 48.90 GiB (2.115 bpp) |
| Target Deployment Hardware | Single 32GB–48GB GPU (RTX 6000, A100-40G) | Single 48GB–80GB Workstation / A100-80G / H100 |
| Primary Operational Mission | High-throughput interactive serving, general NLP | Olympiad mathematics, SWE-bench engineering, systems logic |