ZAQERIS AI Logo
ZAQERIS AI RESEARCH LAB EGYPT

Independent AI Research Group • Foundation Model Directorate

Hugging Face Hub
Official Technical Architecture Explorer • Foundation Suite

ZAQION 1.0 (150B MoE) & Foundation Model Architecture Suite

Official engineering specifications, mathematical lattice quantization benchmarks, and comparative architectural analysis of the AXIOM (Lightweight) and ZAQION (Heavyweight Large Model) foundation model families.

ZAQION Physical Capacity
150,000,000,000
50.0B Peak Active (Adaptive-k)
AXIOM Physical Capacity
79,425,295,488
12.39B Active (Lightweight Edge)
ZAQERIS-M4 Footprint
48.9 GiB (2.115 bpp)
16D Barnes-Wall Lattice
From-Scratch Pre-Training
3.2 Trillion Tokens
512× H100 InfiniBand Cluster

Architectural Positioning: Lightweight Foundational Family vs Heavyweight Large Model Tier

ZAQERIS AI engineers two complementary model families: AXIOM serves as the agile, high-throughput foundation tailored for single-workstation edge execution, while ZAQION represents the absolute heavy-weight cognitive Large Model engineered for multi-step mathematical deduction and complex systems software synthesis.

Architectural Dimension
AXIOM Family
Lightweight High-Throughput Core
ZAQION Family
Heavyweight Large Model Tier
Total Physical Parameters 79.43 Billion (79,425,295,488) 150.0 Billion (150,000,000,000)
Active Parameters per Forward Pass 12.39 Billion (Static Top-2 Gating) 12.5B to 50.0B (Adaptive-k: Top-2 to Top-8)
Transformer Layers & Topology 36 Layers × 16 MoE Experts 64 Layers × 32 Physical Experts (4 ERA Swarms)
Model Dimension ($d_{model}$ / $d_{ffn}$) 4,224 / 10,496 5,376 / 15,360
Attention Mechanism GQA 32:8 (Head Dim 128) GQA 48:8 (Head Dim 112)
Native Quantization Engine ZAQERIS-M3 (8D Gosset $E_8$ Lattice) ZAQERIS-M4 Gold (16D Barnes-Wall $\Lambda_{16}$)
On-Disk Compressed Footprint 29.20 GiB (3.158 bpp) 48.90 GiB (2.115 bpp)
Target Deployment Hardware Single 32GB–48GB GPU (RTX 6000, A100-40G) Single 48GB–80GB Workstation / A100-80G / H100
Primary Operational Mission High-throughput interactive serving, general NLP Olympiad mathematics, SWE-bench engineering, systems logic