Evidence for report v1.1 and ICE 2.0
Browse filesAdds appendix/ice-v1.1-ice2-evidence.tar.gz: the raw llama-perplexity KLD output behind every number in report v1.1 (U1-U3) and the ICE 2.0 report (3.1-3.3), with an INDEX and per-file SHA-256; links from both reports; SHA256SUMS updated. Corrects 19G code to -17.5% and states the U1 session precisely (abliterated CyberTiel checkpoint, 163 chunks).
- README.md +2 -1
- appendix/SHA256SUMS.txt +1 -0
- appendix/ice-v1.1-ice2-evidence.tar.gz +3 -0
- paper/ICE2_Technical_Report.md +10 -6
- paper/ICE_Technical_Report.md +11 -7
README.md
CHANGED
|
@@ -31,7 +31,7 @@ checkpoints.
|
|
| 31 |
|---|---|---|
|
| 32 |
| ICE v1, report 1.0 | August 2026 | error-propagation classes, five rules, four laws; Ornith-1.5-35B-A3B |
|
| 33 |
| ICE v1, report 1.1 | October 2026 | Law 3 depth profile measured per checkpoint (U-shaped); Law 4 fitted on the per-block error (χ² 14.67 → 0.29); measurements unchanged |
|
| 34 |
-
| ICE 2.0, report 1.0 | October 2026 | Sangreal domain-matched imatrix, ICE 1.6 recipes, 12G–25G ladder, format-preserving expert repair; paired against ICE 1.6, code KLD −4.5% to −17.
|
| 35 |
|
| 36 |
## What ICE is
|
| 37 |
|
|
@@ -93,6 +93,7 @@ paper/ICE_Technical_Report.md the report
|
|
| 93 |
appendix/original-ICE/ PRINCIPLE.md and RECIPE.md, the method as first written
|
| 94 |
appendix/recipes/ every tensor-type-file cited in the paper
|
| 95 |
appendix/measurements/ raw llama-perplexity output for every KLD quoted
|
|
|
|
| 96 |
appendix/SHA256SUMS.txt checksum for every file above
|
| 97 |
```
|
| 98 |
|
|
|
|
| 31 |
|---|---|---|
|
| 32 |
| ICE v1, report 1.0 | August 2026 | error-propagation classes, five rules, four laws; Ornith-1.5-35B-A3B |
|
| 33 |
| ICE v1, report 1.1 | October 2026 | Law 3 depth profile measured per checkpoint (U-shaped); Law 4 fitted on the per-block error (χ² 14.67 → 0.29); measurements unchanged |
|
| 34 |
+
| ICE 2.0, report 1.0 | October 2026 | Sangreal domain-matched imatrix, ICE 1.6 recipes, 12G–25G ladder, format-preserving expert repair; paired against ICE 1.6, code KLD −4.5% to −17.5% at every tier |
|
| 35 |
|
| 36 |
## What ICE is
|
| 37 |
|
|
|
|
| 93 |
appendix/original-ICE/ PRINCIPLE.md and RECIPE.md, the method as first written
|
| 94 |
appendix/recipes/ every tensor-type-file cited in the paper
|
| 95 |
appendix/measurements/ raw llama-perplexity output for every KLD quoted
|
| 96 |
+
appendix/ice-v1.1-ice2-evidence.tar.gz raw KLD logs for report v1.1 and the ICE 2.0 report (INDEX.md inside)
|
| 97 |
appendix/SHA256SUMS.txt checksum for every file above
|
| 98 |
```
|
| 99 |
|
appendix/SHA256SUMS.txt
CHANGED
|
@@ -56,3 +56,4 @@ efc76732cf05eb6fdf750336a0a9ac574c495b87b4bddc0bdb5c321a3b5295c1 *./recipes/cfg_
|
|
| 56 |
e88b620a8c80cab33661be765ed9f01ec9a56d1ee9ae239d429a1f19e0aa5f2d *./recipes/cfg_UD-IQ4_XS_comparison.txt
|
| 57 |
d4f78a46b67f7105edf66f8c6a0a8a99dafa4337b6dbe707128908d837618cb5 *./recipes/cfg_UD-Q5_K_S_comparison.txt
|
| 58 |
cf561e0bbb74d0fdf3ea49cb85006c0221a180cfbeb180c91fb3ca160b7dc7d1 *./recipes/cfg_UD-Q6_K_comparison.txt
|
|
|
|
|
|
| 56 |
e88b620a8c80cab33661be765ed9f01ec9a56d1ee9ae239d429a1f19e0aa5f2d *./recipes/cfg_UD-IQ4_XS_comparison.txt
|
| 57 |
d4f78a46b67f7105edf66f8c6a0a8a99dafa4337b6dbe707128908d837618cb5 *./recipes/cfg_UD-Q5_K_S_comparison.txt
|
| 58 |
cf561e0bbb74d0fdf3ea49cb85006c0221a180cfbeb180c91fb3ca160b7dc7d1 *./recipes/cfg_UD-Q6_K_comparison.txt
|
| 59 |
+
43cdb2c80ddffaa86897ac3bcec0fb4639ae075d8fd63047498a1492495a549b *./ice-v1.1-ice2-evidence.tar.gz
|
appendix/ice-v1.1-ice2-evidence.tar.gz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:43cdb2c80ddffaa86897ac3bcec0fb4639ae075d8fd63047498a1492495a549b
|
| 3 |
+
size 231689
|
paper/ICE2_Technical_Report.md
CHANGED
|
@@ -20,7 +20,7 @@ ICE 2.0 also differs from v1 in three further respects: a domain-matched calibra
|
|
| 20 |
ICE 1.6 recipes built on refined versions of Laws 3 and 4, and a five-tier ladder from 12G to 25G.
|
| 21 |
|
| 22 |
In a paired, single-session comparison against its own ICE 1.6 parent files on MiniCPM-V-4.7-35B-A3B, ICE 2.0
|
| 23 |
-
lowers code KLD by **4.5–17.
|
| 24 |
19G (−14% to −19% on all three columns, paired t below −7). On Ornith-1.5-35B-A3B, the checkpoint ICE v1 was
|
| 25 |
developed on, KLD at equal size falls at each step from ICE 1.5 to ICE 1.6 to ICE 2.0.
|
| 26 |
|
|
@@ -79,18 +79,20 @@ quantity this report measures.
|
|
| 79 |
|
| 80 |
Mean KL divergence against the model's own bf16 logits (lower is better). "wiki" and "code" are 64 chunks of
|
| 81 |
2,048 tokens; "code @16K" is 8 chunks of 16,384 tokens. Sizes in 3.1–3.2 exclude the one-layer MTP draft head
|
| 82 |
-
(0.29 GB), as the rival files carry none; sizes in 3.3 are file sizes as published.
|
|
|
|
|
|
|
| 83 |
|
| 84 |
### 3.1 ICE 2.0 against its ICE 1.6 parent (one session, paired)
|
| 85 |
|
| 86 |
MiniCPM-V-4.7-35B-A3B Uncensored (Qwen3.6-35B-A3B architecture), 14 October 2026. Imatrix: Sangreal 10k,
|
| 87 |
-
computed on a sibling Qwen3.6 fine-tune (Occamy-1.0).
|
| 88 |
|
| 89 |
| tier | wiki | code | code @16K |
|
| 90 |
|---|---|---|---|
|
| 91 |
| 12G | 0.1495 → 0.1574 (+5.3%) | 0.1064 → **0.1014 (−4.7%)** | 0.0847 → **0.0812 (−4.1%)** |
|
| 92 |
| 15G | 0.0716 → 0.0717 (+0.2%, n.s.) | 0.0509 → **0.0486 (−4.5%)** | 0.0418 → **0.0381 (−8.8%, t −6.9)** |
|
| 93 |
-
| 19G | 0.0295 → **0.0253 (−14.1%, t −10.5)** | 0.0189 → **0.0156 (−17.
|
| 94 |
| 23G | 0.0120 → 0.0121 (+0.3%, n.s.) | 0.0080 → **0.0076 (−5.0%)** | 0.0065 → **0.0061 (−6.7%)** |
|
| 95 |
| 25G | 0.0081 → 0.0082 (+1.0%, n.s.) | 0.0053 → **0.0049 (−6.7%)** | 0.0042 → **0.0040 (−6.7%)** |
|
| 96 |
|
|
@@ -121,7 +123,8 @@ checkpoint. UD's ladder has no file at the sizes of 12G and 15G: it ends at 12.2
|
|
| 121 |
ICE v1 was developed on Ornith-1.5-35B-A3B; its abliterated derivative (huihui-ai) was rebuilt with ICE 1.5,
|
| 122 |
ICE 1.6 and ICE 2.0.
|
| 123 |
|
| 124 |
-
**ICE 1.5 → ICE 1.6, with Unsloth Dynamic 2.0, one session (25 September 2026)
|
|
|
|
| 125 |
|
| 126 |
| file | size | wiki | code | code @16K |
|
| 127 |
|---|---:|---:|---:|---:|
|
|
@@ -139,7 +142,8 @@ ICE 1.6 lowers KLD over ICE 1.5 at every shipped tier (paired; at 15G by 4.4–4
|
|
| 139 |
−6.4). At matched size ICE 1.6 23G is below `UD-Q4_K_XL` on every column (−11.8% wiki, −6.4% code), and
|
| 140 |
ICE 1.6 19G is 21% below `UD-IQ4_XS` on code. `UD-Q5_K_XL` sits on the floor side of Law 4, 2.16 GB above 25G.
|
| 141 |
|
| 142 |
-
**ICE 1.6 → ICE 2.0** (separate sessions; the bf16 reference PPL agrees within 0.4%):
|
|
|
|
| 143 |
|
| 144 |
| tier | code | code @16K | wiki |
|
| 145 |
|---|---|---|---|
|
|
|
|
| 20 |
ICE 1.6 recipes built on refined versions of Laws 3 and 4, and a five-tier ladder from 12G to 25G.
|
| 21 |
|
| 22 |
In a paired, single-session comparison against its own ICE 1.6 parent files on MiniCPM-V-4.7-35B-A3B, ICE 2.0
|
| 23 |
+
lowers code KLD by **4.5–17.5%** and code @16K KLD by **4.1–18.6%** at every tier, with the strongest effect at
|
| 24 |
19G (−14% to −19% on all three columns, paired t below −7). On Ornith-1.5-35B-A3B, the checkpoint ICE v1 was
|
| 25 |
developed on, KLD at equal size falls at each step from ICE 1.5 to ICE 1.6 to ICE 2.0.
|
| 26 |
|
|
|
|
| 79 |
|
| 80 |
Mean KL divergence against the model's own bf16 logits (lower is better). "wiki" and "code" are 64 chunks of
|
| 81 |
2,048 tokens; "code @16K" is 8 chunks of 16,384 tokens. Sizes in 3.1–3.2 exclude the one-layer MTP draft head
|
| 82 |
+
(0.29 GB), as the rival files carry none; sizes in 3.3 are file sizes as published. The raw `llama-perplexity`
|
| 83 |
+
output behind every number in this section is in [`appendix/ice-v1.1-ice2-evidence.tar.gz`](../appendix/ice-v1.1-ice2-evidence.tar.gz)
|
| 84 |
+
(contents described in its `INDEX.md`).
|
| 85 |
|
| 86 |
### 3.1 ICE 2.0 against its ICE 1.6 parent (one session, paired)
|
| 87 |
|
| 88 |
MiniCPM-V-4.7-35B-A3B Uncensored (Qwen3.6-35B-A3B architecture), 14 October 2026. Imatrix: Sangreal 10k,
|
| 89 |
+
computed on a sibling Qwen3.6 fine-tune (Occamy-1.0). Raw logs: `ice2-3.1-3.2_minicpm-v47-35b-a3b_2026-10-14/`.
|
| 90 |
|
| 91 |
| tier | wiki | code | code @16K |
|
| 92 |
|---|---|---|---|
|
| 93 |
| 12G | 0.1495 → 0.1574 (+5.3%) | 0.1064 → **0.1014 (−4.7%)** | 0.0847 → **0.0812 (−4.1%)** |
|
| 94 |
| 15G | 0.0716 → 0.0717 (+0.2%, n.s.) | 0.0509 → **0.0486 (−4.5%)** | 0.0418 → **0.0381 (−8.8%, t −6.9)** |
|
| 95 |
+
| 19G | 0.0295 → **0.0253 (−14.1%, t −10.5)** | 0.0189 → **0.0156 (−17.5%, t −7.8)** | 0.0151 → **0.0123 (−18.6%, t −7.4)** |
|
| 96 |
| 23G | 0.0120 → 0.0121 (+0.3%, n.s.) | 0.0080 → **0.0076 (−5.0%)** | 0.0065 → **0.0061 (−6.7%)** |
|
| 97 |
| 25G | 0.0081 → 0.0082 (+1.0%, n.s.) | 0.0053 → **0.0049 (−6.7%)** | 0.0042 → **0.0040 (−6.7%)** |
|
| 98 |
|
|
|
|
| 123 |
ICE v1 was developed on Ornith-1.5-35B-A3B; its abliterated derivative (huihui-ai) was rebuilt with ICE 1.5,
|
| 124 |
ICE 1.6 and ICE 2.0.
|
| 125 |
|
| 126 |
+
**ICE 1.5 → ICE 1.6, with Unsloth Dynamic 2.0, one session (25 September 2026).** Raw logs:
|
| 127 |
+
`ice2-3.3_ornith15-huihui_ice15-ice16-ud_2026-09-25/`.
|
| 128 |
|
| 129 |
| file | size | wiki | code | code @16K |
|
| 130 |
|---|---:|---:|---:|---:|
|
|
|
|
| 142 |
−6.4). At matched size ICE 1.6 23G is below `UD-Q4_K_XL` on every column (−11.8% wiki, −6.4% code), and
|
| 143 |
ICE 1.6 19G is 21% below `UD-IQ4_XS` on code. `UD-Q5_K_XL` sits on the floor side of Law 4, 2.16 GB above 25G.
|
| 144 |
|
| 145 |
+
**ICE 1.6 → ICE 2.0** (separate sessions; the bf16 reference PPL agrees within 0.4%). ICE 2.0 raw logs:
|
| 146 |
+
`ice2-3.3_ornith15-huihui_ice20_2026-10-28/`.
|
| 147 |
|
| 148 |
| tier | code | code @16K | wiki |
|
| 149 |
|---|---|---|---|
|
paper/ICE_Technical_Report.md
CHANGED
|
@@ -80,16 +80,18 @@ had looked like the largest remaining direction.
|
|
| 80 |
|
| 81 |
Every number in this report stands as measured. Later measurements on the same checkpoint refined two of the
|
| 82 |
four laws; the recipes from ICE 1.6 on are built on the refined forms. The method that followed this report, ICE 2.0, is
|
| 83 |
-
described separately in [`ICE2_Technical_Report.md`](ICE2_Technical_Report.md).
|
|
|
|
|
|
|
| 84 |
|
| 85 |
### U1. Law 3 (placement): the depth profile is U-shaped
|
| 86 |
|
| 87 |
Section 4.3 fits the per-block value of a bit as `g(t) ≈ exp(−t/9.95)` and Rule 5 (Section 3.6) places the
|
| 88 |
-
high type shallow-first. A direct measurement on Ornith-1.5-35B-A3B
|
| 89 |
-
value is **U-shaped**: it reaches its minimum around blocks 25–30 and rises again toward the deep tail.
|
| 90 |
|
| 91 |
-
Six blocks demoted at the 25G budget, four
|
| 92 |
-
one session,
|
| 93 |
|
| 94 |
| blocks demoted | mean KLD |
|
| 95 |
|---|---:|
|
|
@@ -98,12 +100,14 @@ one session, 64 chunks:
|
|
| 98 |
| 34–39 (shallow-first, as Rule 5 prescribes) | 0.030007 |
|
| 99 |
| 20–25 | 0.030237 |
|
| 100 |
|
| 101 |
-
|
|
|
|
|
|
|
| 102 |
better on the 99%, 99.9% and same-top-1 columns. The comparison needs the **paired** standard error (per-chunk
|
| 103 |
differences): the unpaired `√(σ₀²+σ₁²)` overstates the uncertainty about 3× and hides a result at p ≈ 0.0006.
|
| 104 |
|
| 105 |
**Update.** `g(t) ≈ exp(−t/9.95)` and "shallow-first" are replaced by a measured profile. The depth profile is
|
| 106 |
-
a property of the checkpoint: measure it per model (a handful of
|
| 107 |
tier's budget, one session) and demote the trough. A wrong depth prior only costs bytes when a tier's high/low
|
| 108 |
boundary falls shallower than the trough, so the generous, high-bpw tiers are the ones to check first.
|
| 109 |
|
|
|
|
| 80 |
|
| 81 |
Every number in this report stands as measured. Later measurements on the same checkpoint refined two of the
|
| 82 |
four laws; the recipes from ICE 1.6 on are built on the refined forms. The method that followed this report, ICE 2.0, is
|
| 83 |
+
described separately in [`ICE2_Technical_Report.md`](ICE2_Technical_Report.md). Raw logs for every number in these
|
| 84 |
+
updates: [`appendix/ice-v1.1-ice2-evidence.tar.gz`](../appendix/ice-v1.1-ice2-evidence.tar.gz) (folders `v1.1-U1_…`,
|
| 85 |
+
`v1.1-U2_…`, and `ice2-3.3_…_2026-09-25` for U3).
|
| 86 |
|
| 87 |
### U1. Law 3 (placement): the depth profile is U-shaped
|
| 88 |
|
| 89 |
Section 4.3 fits the per-block value of a bit as `g(t) ≈ exp(−t/9.95)` and Rule 5 (Section 3.6) places the
|
| 90 |
+
high type shallow-first. A direct measurement on the abliterated, CyberTiel-calibrated Ornith-1.5-35B-A3B checkpoint
|
| 91 |
+
(13 September 2026) shows the per-block value is **U-shaped**: it reaches its minimum around blocks 25–30 and rises again toward the deep tail.
|
| 92 |
|
| 93 |
+
Six blocks demoted at the 25G budget, four files identical in size (within 32 bytes) and differing only in *which*
|
| 94 |
+
blocks hold the low type, one session, 163 chunks of WikiText-2:
|
| 95 |
|
| 96 |
| blocks demoted | mean KLD |
|
| 97 |
|---|---:|
|
|
|
|
| 100 |
| 34–39 (shallow-first, as Rule 5 prescribes) | 0.030007 |
|
| 101 |
| 20–25 | 0.030237 |
|
| 102 |
|
| 103 |
+
In this session the trough placement is 1.6% better than shallow-first (paired over the 145 common chunks:
|
| 104 |
+
t = −3.25, p = 0.00057, better on 93 of 145). The shipped 25G tier with the trough demoted measured 2.5% better
|
| 105 |
+
than its shallow-first predecessor on the 64-chunk harness, at identical size, active bpw and file bpw, and also
|
| 106 |
better on the 99%, 99.9% and same-top-1 columns. The comparison needs the **paired** standard error (per-chunk
|
| 107 |
differences): the unpaired `√(σ₀²+σ₁²)` overstates the uncertainty about 3× and hides a result at p ≈ 0.0006.
|
| 108 |
|
| 109 |
**Update.** `g(t) ≈ exp(−t/9.95)` and "shallow-first" are replaced by a measured profile. The depth profile is
|
| 110 |
+
a property of the checkpoint: measure it per model (a handful of size-identical files at the most generous
|
| 111 |
tier's budget, one session) and demote the trough. A wrong depth prior only costs bytes when a tier's high/low
|
| 112 |
boundary falls shallower than the trough, so the generous, high-bpw tiers are the ones to check first.
|
| 113 |
|