Grawnch commited on
Commit
2d95f64
·
verified ·
1 Parent(s): d72b5a3

Update README tier table to match shard headers (134 / 269 / 493)

Browse files
Files changed (2) hide show
  1. README.md +7 -6
  2. kimi31_coder_benchmark_card.png +2 -2
README.md CHANGED
@@ -19,12 +19,13 @@ pipeline_tag: image-text-to-text
19
 
20
  All non-routed parameters (embeddings, `KDA` & `MLA` attention, `AttnRes` projections, shared experts, LatentMoE projections, `lm_head`, and vision tower) are preserved in native **`BF16` / `F32`**, while all `82,432` routed experts (`896` per layer across Layers `1..92`) are compressed using **Strata-Coder 3-Tier Mixed-Bit MoE Compression** calibrated on coding and mathematical reasoning router activation frequencies:
21
 
22
- | Expert Tier | Routed Experts / Layer | Effective BPW | Storage Tier (`Strata` Engine) | Matrix Cosine vs Base MXFP4 |
23
- | :--- | :---: | :---: | :--- | :---: |
24
- | **Tier 1 (Hot Coding/Math)** | `90 / 896` (`10%`) | **`2.81 bpw`** | **Tier 1: Hot GPU VRAM** | **`96.95%`** |
25
- | **Tier 2 (Warm General)** | `224 / 896` (`25%`) | **`2.56 bpw`** | **Tier 2: Warm Pinned System RAM** | **`94.53%`** |
26
- | **Tier 3 (Cold Tail)** | `582 / 896` (`65%`) | **`1.44 bpw`** | **Tier 3: Cold NVMe SSD (`mmap`)** | **`82.51%`** |
27
- | **Full Model Total** | **All 96 / 96 Shards** | **`~1.92 bpw` (MoE)** | **774.97 GB Total (`-56.2%` vs 1.77 TB Base)** | **`93.09%` – `98.22%` MoE Output** |
 
28
 
29
  ---
30
 
 
19
 
20
  All non-routed parameters (embeddings, `KDA` & `MLA` attention, `AttnRes` projections, shared experts, LatentMoE projections, `lm_head`, and vision tower) are preserved in native **`BF16` / `F32`**, while all `82,432` routed experts (`896` per layer across Layers `1..92`) are compressed using **Strata-Coder 3-Tier Mixed-Bit MoE Compression** calibrated on coding and mathematical reasoning router activation frequencies:
21
 
22
+ | Expert / Weight Tier | Routed Experts / Layer | Effective BPW | Total Size (`GB` / `GiB`) | Default Storage Tier (`Strata`) | Matrix Cosine vs Base MXFP4 |
23
+ | :--- | :---: | :---: | :---: | :--- | :---: |
24
+ | **Base Non-Routed (`BF16`/`F32`)** | Shared + `KDA`/`MLA` + `lm_head` | `16.0 bpw` | **`114.76 GB` (`106.88 GiB`)** | **GPU VRAM / Shared** | **`100.00%` (Exact Native)** |
25
+ | **Tier 1 (Hot Coding/Math)** | `134 / 896` (`15.0%`) | **`2.81 bpw`** | **`160.58 GB` (`149.55 GiB`)** | **Tier 1: Hot GPU VRAM** | **`96.95%`** |
26
+ | **Tier 2 (Warm General)** | `269 / 896` (`30.0%`) | **`2.56 bpw`** | **`254.53 GB` (`237.05 GiB`)** | **Tier 2: Warm Pinned System RAM** | **`94.53%`** |
27
+ | **Tier 3 (Cold Tail)** | `493 / 896` (`55.0%`) | **`1.44 bpw`** | **`244.95 GB` (`228.13 GiB`)** | **Tier 3: Cold NVMe SSD (`mmap`)** | **`82.51%`** |
28
+ | **Full Model Total** | **All 96 / 96 Shards** | **`~1.98 bpw` (MoE)** | **`774.97 GB` (`721.75 GiB`, `-56.2%`)** | **VRAM + RAM + NVMe** | **`93.09%` – `98.22%` MoE Output** |
29
 
30
  ---
31
 
kimi31_coder_benchmark_card.png CHANGED

Git LFS Details

  • SHA256: d5741189e9f78ed687f1188395316d9e5ba9109f941187444366ef657d4e1451
  • Pointer size: 131 Bytes
  • Size of remote file: 553 kB

Git LFS Details

  • SHA256: 4b96869343f80287908958e76bcba78a71b006883f14e3f6105828168ebde96b
  • Pointer size: 131 Bytes
  • Size of remote file: 551 kB