Update README tier table to match shard headers (134 / 269 / 493)
Browse files- README.md +7 -6
- kimi31_coder_benchmark_card.png +2 -2
README.md
CHANGED
|
@@ -19,12 +19,13 @@ pipeline_tag: image-text-to-text
|
|
| 19 |
|
| 20 |
All non-routed parameters (embeddings, `KDA` & `MLA` attention, `AttnRes` projections, shared experts, LatentMoE projections, `lm_head`, and vision tower) are preserved in native **`BF16` / `F32`**, while all `82,432` routed experts (`896` per layer across Layers `1..92`) are compressed using **Strata-Coder 3-Tier Mixed-Bit MoE Compression** calibrated on coding and mathematical reasoning router activation frequencies:
|
| 21 |
|
| 22 |
-
| Expert Tier | Routed Experts / Layer | Effective BPW | Storage Tier (`Strata`
|
| 23 |
-
| :--- | :---: | :---: | :--- | :---: |
|
| 24 |
-
| **
|
| 25 |
-
| **Tier
|
| 26 |
-
| **Tier
|
| 27 |
-
| **
|
|
|
|
| 28 |
|
| 29 |
---
|
| 30 |
|
|
|
|
| 19 |
|
| 20 |
All non-routed parameters (embeddings, `KDA` & `MLA` attention, `AttnRes` projections, shared experts, LatentMoE projections, `lm_head`, and vision tower) are preserved in native **`BF16` / `F32`**, while all `82,432` routed experts (`896` per layer across Layers `1..92`) are compressed using **Strata-Coder 3-Tier Mixed-Bit MoE Compression** calibrated on coding and mathematical reasoning router activation frequencies:
|
| 21 |
|
| 22 |
+
| Expert / Weight Tier | Routed Experts / Layer | Effective BPW | Total Size (`GB` / `GiB`) | Default Storage Tier (`Strata`) | Matrix Cosine vs Base MXFP4 |
|
| 23 |
+
| :--- | :---: | :---: | :---: | :--- | :---: |
|
| 24 |
+
| **Base Non-Routed (`BF16`/`F32`)** | Shared + `KDA`/`MLA` + `lm_head` | `16.0 bpw` | **`114.76 GB` (`106.88 GiB`)** | **GPU VRAM / Shared** | **`100.00%` (Exact Native)** |
|
| 25 |
+
| **Tier 1 (Hot Coding/Math)** | `134 / 896` (`15.0%`) | **`2.81 bpw`** | **`160.58 GB` (`149.55 GiB`)** | **Tier 1: Hot GPU VRAM** | **`96.95%`** |
|
| 26 |
+
| **Tier 2 (Warm General)** | `269 / 896` (`30.0%`) | **`2.56 bpw`** | **`254.53 GB` (`237.05 GiB`)** | **Tier 2: Warm Pinned System RAM** | **`94.53%`** |
|
| 27 |
+
| **Tier 3 (Cold Tail)** | `493 / 896` (`55.0%`) | **`1.44 bpw`** | **`244.95 GB` (`228.13 GiB`)** | **Tier 3: Cold NVMe SSD (`mmap`)** | **`82.51%`** |
|
| 28 |
+
| **Full Model Total** | **All 96 / 96 Shards** | **`~1.98 bpw` (MoE)** | **`774.97 GB` (`721.75 GiB`, `-56.2%`)** | **VRAM + RAM + NVMe** | **`93.09%` – `98.22%` MoE Output** |
|
| 29 |
|
| 30 |
---
|
| 31 |
|
kimi31_coder_benchmark_card.png
CHANGED
|
Git LFS Details
|
|
Git LFS Details
|