gbuzhf commited on
Commit
8a8a44c
·
verified ·
1 Parent(s): 3285d40

Evidence for report v1.1 and ICE 2.0

Browse files

Adds appendix/ice-v1.1-ice2-evidence.tar.gz: the raw llama-perplexity KLD output behind every number in report v1.1 (U1-U3) and the ICE 2.0 report (3.1-3.3), with an INDEX and per-file SHA-256; links from both reports; SHA256SUMS updated. Corrects 19G code to -17.5% and states the U1 session precisely (abliterated CyberTiel checkpoint, 163 chunks).

README.md CHANGED
@@ -31,7 +31,7 @@ checkpoints.
31
  |---|---|---|
32
  | ICE v1, report 1.0 | August 2026 | error-propagation classes, five rules, four laws; Ornith-1.5-35B-A3B |
33
  | ICE v1, report 1.1 | October 2026 | Law 3 depth profile measured per checkpoint (U-shaped); Law 4 fitted on the per-block error (χ² 14.67 → 0.29); measurements unchanged |
34
- | ICE 2.0, report 1.0 | October 2026 | Sangreal domain-matched imatrix, ICE 1.6 recipes, 12G–25G ladder, format-preserving expert repair; paired against ICE 1.6, code KLD −4.5% to −17.6% at every tier |
35
 
36
  ## What ICE is
37
 
@@ -93,6 +93,7 @@ paper/ICE_Technical_Report.md the report
93
  appendix/original-ICE/ PRINCIPLE.md and RECIPE.md, the method as first written
94
  appendix/recipes/ every tensor-type-file cited in the paper
95
  appendix/measurements/ raw llama-perplexity output for every KLD quoted
 
96
  appendix/SHA256SUMS.txt checksum for every file above
97
  ```
98
 
 
31
  |---|---|---|
32
  | ICE v1, report 1.0 | August 2026 | error-propagation classes, five rules, four laws; Ornith-1.5-35B-A3B |
33
  | ICE v1, report 1.1 | October 2026 | Law 3 depth profile measured per checkpoint (U-shaped); Law 4 fitted on the per-block error (χ² 14.67 → 0.29); measurements unchanged |
34
+ | ICE 2.0, report 1.0 | October 2026 | Sangreal domain-matched imatrix, ICE 1.6 recipes, 12G–25G ladder, format-preserving expert repair; paired against ICE 1.6, code KLD −4.5% to −17.5% at every tier |
35
 
36
  ## What ICE is
37
 
 
93
  appendix/original-ICE/ PRINCIPLE.md and RECIPE.md, the method as first written
94
  appendix/recipes/ every tensor-type-file cited in the paper
95
  appendix/measurements/ raw llama-perplexity output for every KLD quoted
96
+ appendix/ice-v1.1-ice2-evidence.tar.gz raw KLD logs for report v1.1 and the ICE 2.0 report (INDEX.md inside)
97
  appendix/SHA256SUMS.txt checksum for every file above
98
  ```
99
 
appendix/SHA256SUMS.txt CHANGED
@@ -56,3 +56,4 @@ efc76732cf05eb6fdf750336a0a9ac574c495b87b4bddc0bdb5c321a3b5295c1 *./recipes/cfg_
56
  e88b620a8c80cab33661be765ed9f01ec9a56d1ee9ae239d429a1f19e0aa5f2d *./recipes/cfg_UD-IQ4_XS_comparison.txt
57
  d4f78a46b67f7105edf66f8c6a0a8a99dafa4337b6dbe707128908d837618cb5 *./recipes/cfg_UD-Q5_K_S_comparison.txt
58
  cf561e0bbb74d0fdf3ea49cb85006c0221a180cfbeb180c91fb3ca160b7dc7d1 *./recipes/cfg_UD-Q6_K_comparison.txt
 
 
56
  e88b620a8c80cab33661be765ed9f01ec9a56d1ee9ae239d429a1f19e0aa5f2d *./recipes/cfg_UD-IQ4_XS_comparison.txt
57
  d4f78a46b67f7105edf66f8c6a0a8a99dafa4337b6dbe707128908d837618cb5 *./recipes/cfg_UD-Q5_K_S_comparison.txt
58
  cf561e0bbb74d0fdf3ea49cb85006c0221a180cfbeb180c91fb3ca160b7dc7d1 *./recipes/cfg_UD-Q6_K_comparison.txt
59
+ 43cdb2c80ddffaa86897ac3bcec0fb4639ae075d8fd63047498a1492495a549b *./ice-v1.1-ice2-evidence.tar.gz
appendix/ice-v1.1-ice2-evidence.tar.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:43cdb2c80ddffaa86897ac3bcec0fb4639ae075d8fd63047498a1492495a549b
3
+ size 231689
paper/ICE2_Technical_Report.md CHANGED
@@ -20,7 +20,7 @@ ICE 2.0 also differs from v1 in three further respects: a domain-matched calibra
20
  ICE 1.6 recipes built on refined versions of Laws 3 and 4, and a five-tier ladder from 12G to 25G.
21
 
22
  In a paired, single-session comparison against its own ICE 1.6 parent files on MiniCPM-V-4.7-35B-A3B, ICE 2.0
23
- lowers code KLD by **4.5–17.6%** and code @16K KLD by **4.1–18.6%** at every tier, with the strongest effect at
24
  19G (−14% to −19% on all three columns, paired t below −7). On Ornith-1.5-35B-A3B, the checkpoint ICE v1 was
25
  developed on, KLD at equal size falls at each step from ICE 1.5 to ICE 1.6 to ICE 2.0.
26
 
@@ -79,18 +79,20 @@ quantity this report measures.
79
 
80
  Mean KL divergence against the model's own bf16 logits (lower is better). "wiki" and "code" are 64 chunks of
81
  2,048 tokens; "code @16K" is 8 chunks of 16,384 tokens. Sizes in 3.1–3.2 exclude the one-layer MTP draft head
82
- (0.29 GB), as the rival files carry none; sizes in 3.3 are file sizes as published.
 
 
83
 
84
  ### 3.1 ICE 2.0 against its ICE 1.6 parent (one session, paired)
85
 
86
  MiniCPM-V-4.7-35B-A3B Uncensored (Qwen3.6-35B-A3B architecture), 14 October 2026. Imatrix: Sangreal 10k,
87
- computed on a sibling Qwen3.6 fine-tune (Occamy-1.0).
88
 
89
  | tier | wiki | code | code @16K |
90
  |---|---|---|---|
91
  | 12G | 0.1495 → 0.1574 (+5.3%) | 0.1064 → **0.1014 (−4.7%)** | 0.0847 → **0.0812 (−4.1%)** |
92
  | 15G | 0.0716 → 0.0717 (+0.2%, n.s.) | 0.0509 → **0.0486 (−4.5%)** | 0.0418 → **0.0381 (−8.8%, t −6.9)** |
93
- | 19G | 0.0295 → **0.0253 (−14.1%, t −10.5)** | 0.0189 → **0.0156 (−17.6%, t −7.8)** | 0.0151 → **0.0123 (−18.6%, t −7.4)** |
94
  | 23G | 0.0120 → 0.0121 (+0.3%, n.s.) | 0.0080 → **0.0076 (−5.0%)** | 0.0065 → **0.0061 (−6.7%)** |
95
  | 25G | 0.0081 → 0.0082 (+1.0%, n.s.) | 0.0053 → **0.0049 (−6.7%)** | 0.0042 → **0.0040 (−6.7%)** |
96
 
@@ -121,7 +123,8 @@ checkpoint. UD's ladder has no file at the sizes of 12G and 15G: it ends at 12.2
121
  ICE v1 was developed on Ornith-1.5-35B-A3B; its abliterated derivative (huihui-ai) was rebuilt with ICE 1.5,
122
  ICE 1.6 and ICE 2.0.
123
 
124
- **ICE 1.5 → ICE 1.6, with Unsloth Dynamic 2.0, one session (25 September 2026):**
 
125
 
126
  | file | size | wiki | code | code @16K |
127
  |---|---:|---:|---:|---:|
@@ -139,7 +142,8 @@ ICE 1.6 lowers KLD over ICE 1.5 at every shipped tier (paired; at 15G by 4.4–4
139
  −6.4). At matched size ICE 1.6 23G is below `UD-Q4_K_XL` on every column (−11.8% wiki, −6.4% code), and
140
  ICE 1.6 19G is 21% below `UD-IQ4_XS` on code. `UD-Q5_K_XL` sits on the floor side of Law 4, 2.16 GB above 25G.
141
 
142
- **ICE 1.6 → ICE 2.0** (separate sessions; the bf16 reference PPL agrees within 0.4%):
 
143
 
144
  | tier | code | code @16K | wiki |
145
  |---|---|---|---|
 
20
  ICE 1.6 recipes built on refined versions of Laws 3 and 4, and a five-tier ladder from 12G to 25G.
21
 
22
  In a paired, single-session comparison against its own ICE 1.6 parent files on MiniCPM-V-4.7-35B-A3B, ICE 2.0
23
+ lowers code KLD by **4.5–17.5%** and code @16K KLD by **4.1–18.6%** at every tier, with the strongest effect at
24
  19G (−14% to −19% on all three columns, paired t below −7). On Ornith-1.5-35B-A3B, the checkpoint ICE v1 was
25
  developed on, KLD at equal size falls at each step from ICE 1.5 to ICE 1.6 to ICE 2.0.
26
 
 
79
 
80
  Mean KL divergence against the model's own bf16 logits (lower is better). "wiki" and "code" are 64 chunks of
81
  2,048 tokens; "code @16K" is 8 chunks of 16,384 tokens. Sizes in 3.1–3.2 exclude the one-layer MTP draft head
82
+ (0.29 GB), as the rival files carry none; sizes in 3.3 are file sizes as published. The raw `llama-perplexity`
83
+ output behind every number in this section is in [`appendix/ice-v1.1-ice2-evidence.tar.gz`](../appendix/ice-v1.1-ice2-evidence.tar.gz)
84
+ (contents described in its `INDEX.md`).
85
 
86
  ### 3.1 ICE 2.0 against its ICE 1.6 parent (one session, paired)
87
 
88
  MiniCPM-V-4.7-35B-A3B Uncensored (Qwen3.6-35B-A3B architecture), 14 October 2026. Imatrix: Sangreal 10k,
89
+ computed on a sibling Qwen3.6 fine-tune (Occamy-1.0). Raw logs: `ice2-3.1-3.2_minicpm-v47-35b-a3b_2026-10-14/`.
90
 
91
  | tier | wiki | code | code @16K |
92
  |---|---|---|---|
93
  | 12G | 0.1495 → 0.1574 (+5.3%) | 0.1064 → **0.1014 (−4.7%)** | 0.0847 → **0.0812 (−4.1%)** |
94
  | 15G | 0.0716 → 0.0717 (+0.2%, n.s.) | 0.0509 → **0.0486 (−4.5%)** | 0.0418 → **0.0381 (−8.8%, t −6.9)** |
95
+ | 19G | 0.0295 → **0.0253 (−14.1%, t −10.5)** | 0.0189 → **0.0156 (−17.5%, t −7.8)** | 0.0151 → **0.0123 (−18.6%, t −7.4)** |
96
  | 23G | 0.0120 → 0.0121 (+0.3%, n.s.) | 0.0080 → **0.0076 (−5.0%)** | 0.0065 → **0.0061 (−6.7%)** |
97
  | 25G | 0.0081 → 0.0082 (+1.0%, n.s.) | 0.0053 → **0.0049 (−6.7%)** | 0.0042 → **0.0040 (−6.7%)** |
98
 
 
123
  ICE v1 was developed on Ornith-1.5-35B-A3B; its abliterated derivative (huihui-ai) was rebuilt with ICE 1.5,
124
  ICE 1.6 and ICE 2.0.
125
 
126
+ **ICE 1.5 → ICE 1.6, with Unsloth Dynamic 2.0, one session (25 September 2026).** Raw logs:
127
+ `ice2-3.3_ornith15-huihui_ice15-ice16-ud_2026-09-25/`.
128
 
129
  | file | size | wiki | code | code @16K |
130
  |---|---:|---:|---:|---:|
 
142
  −6.4). At matched size ICE 1.6 23G is below `UD-Q4_K_XL` on every column (−11.8% wiki, −6.4% code), and
143
  ICE 1.6 19G is 21% below `UD-IQ4_XS` on code. `UD-Q5_K_XL` sits on the floor side of Law 4, 2.16 GB above 25G.
144
 
145
+ **ICE 1.6 → ICE 2.0** (separate sessions; the bf16 reference PPL agrees within 0.4%). ICE 2.0 raw logs:
146
+ `ice2-3.3_ornith15-huihui_ice20_2026-10-28/`.
147
 
148
  | tier | code | code @16K | wiki |
149
  |---|---|---|---|
paper/ICE_Technical_Report.md CHANGED
@@ -80,16 +80,18 @@ had looked like the largest remaining direction.
80
 
81
  Every number in this report stands as measured. Later measurements on the same checkpoint refined two of the
82
  four laws; the recipes from ICE 1.6 on are built on the refined forms. The method that followed this report, ICE 2.0, is
83
- described separately in [`ICE2_Technical_Report.md`](ICE2_Technical_Report.md).
 
 
84
 
85
  ### U1. Law 3 (placement): the depth profile is U-shaped
86
 
87
  Section 4.3 fits the per-block value of a bit as `g(t) ≈ exp(−t/9.95)` and Rule 5 (Section 3.6) places the
88
- high type shallow-first. A direct measurement on Ornith-1.5-35B-A3B (13 September 2026) shows the per-block
89
- value is **U-shaped**: it reaches its minimum around blocks 25–30 and rises again toward the deep tail.
90
 
91
- Six blocks demoted at the 25G budget, four byte-identical files except for *which* blocks hold the low type,
92
- one session, 64 chunks:
93
 
94
  | blocks demoted | mean KLD |
95
  |---|---:|
@@ -98,12 +100,14 @@ one session, 64 chunks:
98
  | 34–39 (shallow-first, as Rule 5 prescribes) | 0.030007 |
99
  | 20–25 | 0.030237 |
100
 
101
- Demoting the trough is 2.5% better at identical size, active bpw and file bpw, and also
 
 
102
  better on the 99%, 99.9% and same-top-1 columns. The comparison needs the **paired** standard error (per-chunk
103
  differences): the unpaired `√(σ₀²+σ₁²)` overstates the uncertainty about 3× and hides a result at p ≈ 0.0006.
104
 
105
  **Update.** `g(t) ≈ exp(−t/9.95)` and "shallow-first" are replaced by a measured profile. The depth profile is
106
- a property of the checkpoint: measure it per model (a handful of byte-identical files at the most generous
107
  tier's budget, one session) and demote the trough. A wrong depth prior only costs bytes when a tier's high/low
108
  boundary falls shallower than the trough, so the generous, high-bpw tiers are the ones to check first.
109
 
 
80
 
81
  Every number in this report stands as measured. Later measurements on the same checkpoint refined two of the
82
  four laws; the recipes from ICE 1.6 on are built on the refined forms. The method that followed this report, ICE 2.0, is
83
+ described separately in [`ICE2_Technical_Report.md`](ICE2_Technical_Report.md). Raw logs for every number in these
84
+ updates: [`appendix/ice-v1.1-ice2-evidence.tar.gz`](../appendix/ice-v1.1-ice2-evidence.tar.gz) (folders `v1.1-U1_…`,
85
+ `v1.1-U2_…`, and `ice2-3.3_…_2026-09-25` for U3).
86
 
87
  ### U1. Law 3 (placement): the depth profile is U-shaped
88
 
89
  Section 4.3 fits the per-block value of a bit as `g(t) ≈ exp(−t/9.95)` and Rule 5 (Section 3.6) places the
90
+ high type shallow-first. A direct measurement on the abliterated, CyberTiel-calibrated Ornith-1.5-35B-A3B checkpoint
91
+ (13 September 2026) shows the per-block value is **U-shaped**: it reaches its minimum around blocks 25–30 and rises again toward the deep tail.
92
 
93
+ Six blocks demoted at the 25G budget, four files identical in size (within 32 bytes) and differing only in *which*
94
+ blocks hold the low type, one session, 163 chunks of WikiText-2:
95
 
96
  | blocks demoted | mean KLD |
97
  |---|---:|
 
100
  | 34–39 (shallow-first, as Rule 5 prescribes) | 0.030007 |
101
  | 20–25 | 0.030237 |
102
 
103
+ In this session the trough placement is 1.6% better than shallow-first (paired over the 145 common chunks:
104
+ t = −3.25, p = 0.00057, better on 93 of 145). The shipped 25G tier with the trough demoted measured 2.5% better
105
+ than its shallow-first predecessor on the 64-chunk harness, at identical size, active bpw and file bpw, and also
106
  better on the 99%, 99.9% and same-top-1 columns. The comparison needs the **paired** standard error (per-chunk
107
  differences): the unpaired `√(σ₀²+σ₁²)` overstates the uncertainty about 3× and hides a result at p ≈ 0.0006.
108
 
109
  **Update.** `g(t) ≈ exp(−t/9.95)` and "shallow-first" are replaced by a measured profile. The depth profile is
110
+ a property of the checkpoint: measure it per model (a handful of size-identical files at the most generous
111
  tier's budget, one session) and demote the trough. A wrong depth prior only costs bytes when a tier's high/low
112
  boundary falls shallower than the trough, so the generous, high-bpw tiers are the ones to check first.
113