byte-vortex commited on
Commit
de971f2
·
verified ·
1 Parent(s): 3f465fe

Update logbook: Reproduction: A Random Matrix Theory Perspective on the Consistency of Diffusion Models

Browse files
logbook.json CHANGED
@@ -10,7 +10,7 @@
10
  "icml2026-repro",
11
  "paper-iPjuUQbkfl"
12
  ],
13
- "updated_at": "2026-08-01T21:05:59+00:00",
14
  "root": {
15
  "slug": "index",
16
  "title": "Reproduction: A Random Matrix Theory Perspective on the Consistency of Diffusion Models",
@@ -76,5 +76,5 @@
76
  "agent_view_tokens": 3154,
77
  "trace_view_tokens": 10,
78
  "workspace_view_tokens": 8,
79
- "revision": "b29ffff956816aa73ea9"
80
  }
 
10
  "icml2026-repro",
11
  "paper-iPjuUQbkfl"
12
  ],
13
+ "updated_at": "2026-08-01T22:37:29+00:00",
14
  "root": {
15
  "slug": "index",
16
  "title": "Reproduction: A Random Matrix Theory Perspective on the Consistency of Diffusion Models",
 
76
  "agent_view_tokens": 3154,
77
  "trace_view_tokens": 10,
78
  "workspace_view_tokens": 8,
79
+ "revision": "54c5a6717fa0e2517d34"
80
  }
pages/claim-1-linear-model-predicts-cross-split-consistency/page.md CHANGED
@@ -3,13 +3,13 @@
3
 
4
  ---
5
  <!-- trackio-cell
6
- {"type": "code", "id": "cell_a0cec5778e2f", "created_at": "2026-08-01T20:54:40+00:00", "title": "Run: hf rmt_diffusion_claim1.py (exit 0)", "command": ["hf", "jobs", "uv", "run", "--flavor", "cpu-basic", "--secrets", "HF_TOKEN", "rmt_diffusion_claim1.py"], "exit_code": 0, "duration_s": 40.896}
7
  -->
8
  ````bash
9
  $ hf jobs uv run --flavor cpu-basic --secrets HF_TOKEN rmt_diffusion_claim1.py
10
  ````
11
 
12
- exit 0 · 40.9s
13
 
14
 
15
  ````python title=rmt_diffusion_claim1.py
@@ -188,30 +188,30 @@ if __name__ == "__main__":
188
  ````output
189
  /usr/local/lib/python3.12/dist-packages/huggingface_hub/utils/_experimental.py:59: UserWarning: 'HfApi.run_uv_job' is experimental and might be subject to breaking changes in the future without prior notice. You can disable this warning by setting `HF_HUB_DISABLE_EXPERIMENTAL_WARNING=1` as environment variable.
190
  warnings.warn(
191
- Job started with ID: 6a6e5ce86b79c09949c1eafb
192
- View at: https://huggingface.co/jobs/byte-vortex/6a6e5ce86b79c09949c1eafb
193
- Downloading numpy (15.9MiB)
194
- Downloading nvidia-cuda-cupti (10.2MiB)
195
- Downloading sympy (6.0MiB)
196
- Downloading nvidia-cufft (204.2MiB)
197
- Downloading nvidia-nvjitlink (38.9MiB)
198
- Downloading networkx (2.0MiB)
199
- Downloading nvidia-cudnn-cu13 (349.2MiB)
200
- Downloading cuda-bindings (6.3MiB)
201
  Downloading nvidia-cusolver (191.6MiB)
202
- Downloading nvidia-cusparselt-cu13 (162.3MiB)
203
- Downloading pillow (6.6MiB)
204
- Downloading triton (188.6MiB)
205
  Downloading nvidia-cuda-nvrtc (86.0MiB)
206
- Downloading torch (502.2MiB)
 
207
  Downloading nvidia-cuda-runtime (2.1MiB)
208
  Downloading nvidia-cufile (1.2MiB)
 
209
  Downloading nvidia-nvshmem-cu13 (57.6MiB)
 
210
  Downloading nvidia-nccl-cu13 (196.4MiB)
211
- Downloading nvidia-cublas (403.5MiB)
212
- Downloading nvidia-cusparse (139.2MiB)
213
  Downloading nvidia-curand (56.8MiB)
 
 
 
 
214
  Downloading torchvision (7.3MiB)
 
 
 
 
215
  Downloaded nvidia-cufile
216
  Downloaded nvidia-cuda-runtime
217
  Downloaded networkx
@@ -229,12 +229,12 @@ Downloading torchvision (7.3MiB)
229
  Downloaded nvidia-cusparselt-cu13
230
  Downloaded nvidia-cusolver
231
  Downloaded nvidia-nccl-cu13
232
- Downloaded triton
233
  Downloaded nvidia-cufft
 
234
  Downloaded nvidia-cudnn-cu13
235
  Downloaded nvidia-cublas
236
  Downloaded torch
237
- Installed 32 packages in 235ms
238
  ======================================================================
239
  RMT Diffusion Consistency reproduction -- Claim 1
240
  Testing: linear closed-form denoiser predicts cross-split
@@ -606,12 +606,12 @@ Using REAL MNIST data (16x16 downsampled, flattened, d=256).
606
  Dataset: 4000 samples, 256 dims, split into 2000 / 2000
607
 
608
  [Results over 100 shared-seed trials]
609
- Cross-split distance (same seed, different training data): 0.344 +/- 0.046
610
- Nearest-training-neighbor distance (memorization check): 2.650 +/- 0.333
611
 
612
  ======================================================================
613
  SUMMARY
614
- PASS: cross-split outputs are 7.69x MORE similar to each
615
  other than to their own nearest training example.
616
  This supports the paper's Claim 1: a purely linear, closed-form
617
  model already predicts strong cross-split consistency, without
 
3
 
4
  ---
5
  <!-- trackio-cell
6
+ {"type": "code", "id": "cell_ebe60bbba6d7", "created_at": "2026-08-01T22:25:26+00:00", "title": "Run: hf rmt_diffusion_claim1.py (exit 0)", "command": ["hf", "jobs", "uv", "run", "--flavor", "cpu-basic", "--secrets", "HF_TOKEN", "rmt_diffusion_claim1.py"], "exit_code": 0, "duration_s": 43.926}
7
  -->
8
  ````bash
9
  $ hf jobs uv run --flavor cpu-basic --secrets HF_TOKEN rmt_diffusion_claim1.py
10
  ````
11
 
12
+ exit 0 · 43.9s
13
 
14
 
15
  ````python title=rmt_diffusion_claim1.py
 
188
  ````output
189
  /usr/local/lib/python3.12/dist-packages/huggingface_hub/utils/_experimental.py:59: UserWarning: 'HfApi.run_uv_job' is experimental and might be subject to breaking changes in the future without prior notice. You can disable this warning by setting `HF_HUB_DISABLE_EXPERIMENTAL_WARNING=1` as environment variable.
190
  warnings.warn(
191
+ Job started with ID: 6a6e722b6b79c09949c1ec91
192
+ View at: https://huggingface.co/jobs/byte-vortex/6a6e722b6b79c09949c1ec91
 
 
 
 
 
 
 
 
193
  Downloading nvidia-cusolver (191.6MiB)
 
 
 
194
  Downloading nvidia-cuda-nvrtc (86.0MiB)
195
+ Downloading networkx (2.0MiB)
196
+ Downloading numpy (15.9MiB)
197
  Downloading nvidia-cuda-runtime (2.1MiB)
198
  Downloading nvidia-cufile (1.2MiB)
199
+ Downloading nvidia-nvjitlink (38.9MiB)
200
  Downloading nvidia-nvshmem-cu13 (57.6MiB)
201
+ Downloading cuda-bindings (6.3MiB)
202
  Downloading nvidia-nccl-cu13 (196.4MiB)
203
+ Downloading nvidia-cuda-cupti (10.2MiB)
204
+ Downloading sympy (6.0MiB)
205
  Downloading nvidia-curand (56.8MiB)
206
+ Downloading nvidia-cufft (204.2MiB)
207
+ Downloading nvidia-cusparse (139.2MiB)
208
+ Downloading nvidia-cusparselt-cu13 (162.3MiB)
209
+ Downloading pillow (6.6MiB)
210
  Downloading torchvision (7.3MiB)
211
+ Downloading triton (188.6MiB)
212
+ Downloading nvidia-cublas (403.5MiB)
213
+ Downloading torch (502.2MiB)
214
+ Downloading nvidia-cudnn-cu13 (349.2MiB)
215
  Downloaded nvidia-cufile
216
  Downloaded nvidia-cuda-runtime
217
  Downloaded networkx
 
229
  Downloaded nvidia-cusparselt-cu13
230
  Downloaded nvidia-cusolver
231
  Downloaded nvidia-nccl-cu13
 
232
  Downloaded nvidia-cufft
233
+ Downloaded triton
234
  Downloaded nvidia-cudnn-cu13
235
  Downloaded nvidia-cublas
236
  Downloaded torch
237
+ Installed 32 packages in 228ms
238
  ======================================================================
239
  RMT Diffusion Consistency reproduction -- Claim 1
240
  Testing: linear closed-form denoiser predicts cross-split
 
606
  Dataset: 4000 samples, 256 dims, split into 2000 / 2000
607
 
608
  [Results over 100 shared-seed trials]
609
+ Cross-split distance (same seed, different training data): 0.357 +/- 0.048
610
+ Nearest-training-neighbor distance (memorization check): 2.651 +/- 0.334
611
 
612
  ======================================================================
613
  SUMMARY
614
+ PASS: cross-split outputs are 7.42x MORE similar to each
615
  other than to their own nearest training example.
616
  This supports the paper's Claim 1: a purely linear, closed-form
617
  model already predicts strong cross-split consistency, without
pages/claim-2-self-consistency-equation-and-renormalized-noise/page.md CHANGED
@@ -3,13 +3,13 @@
3
 
4
  ---
5
  <!-- trackio-cell
6
- {"type": "code", "id": "cell_13add7472b7b", "created_at": "2026-08-01T20:56:33+00:00", "title": "Run: hf rmt_diffusion_claim2.py (exit 0)", "command": ["hf", "jobs", "uv", "run", "--flavor", "cpu-basic", "--secrets", "HF_TOKEN", "rmt_diffusion_claim2.py"], "exit_code": 0, "duration_s": 110.886}
7
  -->
8
  ````bash
9
  $ hf jobs uv run --flavor cpu-basic --secrets HF_TOKEN rmt_diffusion_claim2.py
10
  ````
11
 
12
- exit 0 · 110.9s
13
 
14
 
15
  ````python title=rmt_diffusion_claim2.py
@@ -142,11 +142,11 @@ if __name__ == "__main__":
142
  ````output
143
  /usr/local/lib/python3.12/dist-packages/huggingface_hub/utils/_experimental.py:59: UserWarning: 'HfApi.run_uv_job' is experimental and might be subject to breaking changes in the future without prior notice. You can disable this warning by setting `HF_HUB_DISABLE_EXPERIMENTAL_WARNING=1` as environment variable.
144
  warnings.warn(
145
- Job started with ID: 6a6e5d136b79c09949c1eb01
146
- View at: https://huggingface.co/jobs/byte-vortex/6a6e5d136b79c09949c1eb01
147
  Downloading numpy (15.9MiB)
148
  Downloaded numpy
149
- Installed 1 package in 16ms
150
  ======================================================================
151
  RMT Diffusion Consistency reproduction -- Claim 2
152
  Testing Proposition 4.1: sigma^2 -> kappa(sigma^2) renormalization
 
3
 
4
  ---
5
  <!-- trackio-cell
6
+ {"type": "code", "id": "cell_c04792568a82", "created_at": "2026-08-01T22:27:04+00:00", "title": "Run: hf rmt_diffusion_claim2.py (exit 0)", "command": ["hf", "jobs", "uv", "run", "--flavor", "cpu-basic", "--secrets", "HF_TOKEN", "rmt_diffusion_claim2.py"], "exit_code": 0, "duration_s": 96.287}
7
  -->
8
  ````bash
9
  $ hf jobs uv run --flavor cpu-basic --secrets HF_TOKEN rmt_diffusion_claim2.py
10
  ````
11
 
12
+ exit 0 · 96.3s
13
 
14
 
15
  ````python title=rmt_diffusion_claim2.py
 
142
  ````output
143
  /usr/local/lib/python3.12/dist-packages/huggingface_hub/utils/_experimental.py:59: UserWarning: 'HfApi.run_uv_job' is experimental and might be subject to breaking changes in the future without prior notice. You can disable this warning by setting `HF_HUB_DISABLE_EXPERIMENTAL_WARNING=1` as environment variable.
144
  warnings.warn(
145
+ Job started with ID: 6a6e7259a00abefd4b28c32e
146
+ View at: https://huggingface.co/jobs/byte-vortex/6a6e7259a00abefd4b28c32e
147
  Downloading numpy (15.9MiB)
148
  Downloaded numpy
149
+ Installed 1 package in 15ms
150
  ======================================================================
151
  RMT Diffusion Consistency reproduction -- Claim 2
152
  Testing Proposition 4.1: sigma^2 -> kappa(sigma^2) renormalization
pages/claim-3-variance-factorization-anisotropy-x-inhomogeneity/page.md CHANGED
@@ -3,13 +3,13 @@
3
 
4
  ---
5
  <!-- trackio-cell
6
- {"type": "code", "id": "cell_889018733e36", "created_at": "2026-08-01T20:57:23+00:00", "title": "Run: hf rmt_diffusion_claim3.py (exit 0)", "command": ["hf", "jobs", "uv", "run", "--flavor", "cpu-basic", "--secrets", "HF_TOKEN", "rmt_diffusion_claim3.py"], "exit_code": 0, "duration_s": 47.165}
7
  -->
8
  ````bash
9
  $ hf jobs uv run --flavor cpu-basic --secrets HF_TOKEN rmt_diffusion_claim3.py
10
  ````
11
 
12
- exit 0 · 47.2s
13
 
14
 
15
  ````python title=rmt_diffusion_claim3.py
@@ -126,8 +126,8 @@ if __name__ == "__main__":
126
  ````output
127
  /usr/local/lib/python3.12/dist-packages/huggingface_hub/utils/_experimental.py:59: UserWarning: 'HfApi.run_uv_job' is experimental and might be subject to breaking changes in the future without prior notice. You can disable this warning by setting `HF_HUB_DISABLE_EXPERIMENTAL_WARNING=1` as environment variable.
128
  warnings.warn(
129
- Job started with ID: 6a6e5d84a00abefd4b28c0e4
130
- View at: https://huggingface.co/jobs/byte-vortex/6a6e5d84a00abefd4b28c0e4
131
  Downloading numpy (15.9MiB)
132
  Downloaded numpy
133
  Installed 1 package in 16ms
 
3
 
4
  ---
5
  <!-- trackio-cell
6
+ {"type": "code", "id": "cell_b8f1a2d58c2a", "created_at": "2026-08-01T22:28:52+00:00", "title": "Run: hf rmt_diffusion_claim3.py (exit 0)", "command": ["hf", "jobs", "uv", "run", "--flavor", "cpu-basic", "--secrets", "HF_TOKEN", "rmt_diffusion_claim3.py"], "exit_code": 0, "duration_s": 105.623}
7
  -->
8
  ````bash
9
  $ hf jobs uv run --flavor cpu-basic --secrets HF_TOKEN rmt_diffusion_claim3.py
10
  ````
11
 
12
+ exit 0 · 105.6s
13
 
14
 
15
  ````python title=rmt_diffusion_claim3.py
 
126
  ````output
127
  /usr/local/lib/python3.12/dist-packages/huggingface_hub/utils/_experimental.py:59: UserWarning: 'HfApi.run_uv_job' is experimental and might be subject to breaking changes in the future without prior notice. You can disable this warning by setting `HF_HUB_DISABLE_EXPERIMENTAL_WARNING=1` as environment variable.
128
  warnings.warn(
129
+ Job started with ID: 6a6e72bb6b79c09949c1ec97
130
+ View at: https://huggingface.co/jobs/byte-vortex/6a6e72bb6b79c09949c1ec97
131
  Downloading numpy (15.9MiB)
132
  Downloaded numpy
133
  Installed 1 package in 16ms
pages/claim-4-fractional-matrix-power-extension-to-sampling-trajectories/page.md CHANGED
@@ -3,13 +3,13 @@
3
 
4
  ---
5
  <!-- trackio-cell
6
- {"type": "code", "id": "cell_897d87a9e87b", "created_at": "2026-08-01T20:57:41+00:00", "title": "Run: hf rmt_diffusion_claim4.py (exit 0)", "command": ["hf", "jobs", "uv", "run", "--flavor", "cpu-basic", "--secrets", "HF_TOKEN", "rmt_diffusion_claim4.py"], "exit_code": 0, "duration_s": 15.882}
7
  -->
8
  ````bash
9
  $ hf jobs uv run --flavor cpu-basic --secrets HF_TOKEN rmt_diffusion_claim4.py
10
  ````
11
 
12
- exit 0 · 15.9s
13
 
14
 
15
  ````python title=rmt_diffusion_claim4.py
@@ -233,8 +233,8 @@ if __name__ == "__main__":
233
  ````output
234
  /usr/local/lib/python3.12/dist-packages/huggingface_hub/utils/_experimental.py:59: UserWarning: 'HfApi.run_uv_job' is experimental and might be subject to breaking changes in the future without prior notice. You can disable this warning by setting `HF_HUB_DISABLE_EXPERIMENTAL_WARNING=1` as environment variable.
235
  warnings.warn(
236
- Job started with ID: 6a6e5db66b79c09949c1eb09
237
- View at: https://huggingface.co/jobs/byte-vortex/6a6e5db66b79c09949c1eb09
238
  Downloading numpy (15.9MiB)
239
  Downloaded numpy
240
  Installed 1 package in 16ms
 
3
 
4
  ---
5
  <!-- trackio-cell
6
+ {"type": "code", "id": "cell_a6e5732231f1", "created_at": "2026-08-01T22:29:10+00:00", "title": "Run: hf rmt_diffusion_claim4.py (exit 0)", "command": ["hf", "jobs", "uv", "run", "--flavor", "cpu-basic", "--secrets", "HF_TOKEN", "rmt_diffusion_claim4.py"], "exit_code": 0, "duration_s": 16.497}
7
  -->
8
  ````bash
9
  $ hf jobs uv run --flavor cpu-basic --secrets HF_TOKEN rmt_diffusion_claim4.py
10
  ````
11
 
12
+ exit 0 · 16.5s
13
 
14
 
15
  ````python title=rmt_diffusion_claim4.py
 
233
  ````output
234
  /usr/local/lib/python3.12/dist-packages/huggingface_hub/utils/_experimental.py:59: UserWarning: 'HfApi.run_uv_job' is experimental and might be subject to breaking changes in the future without prior notice. You can disable this warning by setting `HF_HUB_DISABLE_EXPERIMENTAL_WARNING=1` as environment variable.
235
  warnings.warn(
236
+ Job started with ID: 6a6e73276b79c09949c1ec9c
237
+ View at: https://huggingface.co/jobs/byte-vortex/6a6e73276b79c09949c1ec9c
238
  Downloading numpy (15.9MiB)
239
  Downloaded numpy
240
  Installed 1 package in 16ms
pages/claim-5-deep-network-validation-toy-scale/page.md CHANGED
@@ -3,13 +3,13 @@
3
 
4
  ---
5
  <!-- trackio-cell
6
- {"type": "code", "id": "cell_bfef2b3ac46a", "created_at": "2026-08-01T21:00:32+00:00", "title": "Run: hf rmt_diffusion_claim5.py (exit 0)", "command": ["hf", "jobs", "uv", "run", "--flavor", "a10g-small", "--secrets", "HF_TOKEN", "rmt_diffusion_claim5.py"], "exit_code": 0, "duration_s": 169.518}
7
  -->
8
  ````bash
9
  $ hf jobs uv run --flavor a10g-small --secrets HF_TOKEN rmt_diffusion_claim5.py
10
  ````
11
 
12
- exit 0 · 169.5s
13
 
14
 
15
  ````python title=rmt_diffusion_claim5.py
@@ -207,30 +207,30 @@ if __name__ == "__main__":
207
  ````output
208
  /usr/local/lib/python3.12/dist-packages/huggingface_hub/utils/_experimental.py:59: UserWarning: 'HfApi.run_uv_job' is experimental and might be subject to breaking changes in the future without prior notice. You can disable this warning by setting `HF_HUB_DISABLE_EXPERIMENTAL_WARNING=1` as environment variable.
209
  warnings.warn(
210
- Job started with ID: 6a6e5dc8a00abefd4b28c0e6
211
- View at: https://huggingface.co/jobs/byte-vortex/6a6e5dc8a00abefd4b28c0e6
212
- Downloading nvidia-cufile (1.2MiB)
213
- Downloading nvidia-cudnn-cu13 (349.2MiB)
214
- Downloading nvidia-curand (56.8MiB)
215
- Downloading nvidia-cuda-nvrtc (86.0MiB)
216
  Downloading numpy (15.9MiB)
217
  Downloading nvidia-cusparselt-cu13 (162.3MiB)
218
- Downloading nvidia-nvjitlink (38.9MiB)
219
- Downloading nvidia-cuda-cupti (10.2MiB)
220
  Downloading cuda-bindings (6.3MiB)
221
- Downloading nvidia-cufft (204.2MiB)
222
- Downloading nvidia-nvshmem-cu13 (57.6MiB)
 
223
  Downloading nvidia-cusparse (139.2MiB)
 
 
 
224
  Downloading torch (502.2MiB)
225
- Downloading nvidia-cublas (403.5MiB)
226
- Downloading nvidia-cusolver (191.6MiB)
227
- Downloading sympy (6.0MiB)
228
- Downloading nvidia-nccl-cu13 (196.4MiB)
229
- Downloading triton (188.6MiB)
230
  Downloading networkx (2.0MiB)
231
- Downloading pillow (6.6MiB)
232
- Downloading nvidia-cuda-runtime (2.1MiB)
 
 
233
  Downloading torchvision (7.3MiB)
 
 
 
 
234
  Downloaded nvidia-cufile
235
  Downloaded nvidia-cuda-runtime
236
  Downloaded networkx
@@ -239,8 +239,8 @@ Downloading torchvision (7.3MiB)
239
  Downloaded torchvision
240
  Downloaded nvidia-cuda-cupti
241
  Downloaded numpy
242
- Downloaded sympy
243
  Downloaded nvidia-nvjitlink
 
244
  Downloaded nvidia-curand
245
  Downloaded nvidia-nvshmem-cu13
246
  Downloaded nvidia-cuda-nvrtc
@@ -253,7 +253,7 @@ Downloading torchvision (7.3MiB)
253
  Downloaded nvidia-cudnn-cu13
254
  Downloaded nvidia-cublas
255
  Downloaded torch
256
- Installed 32 packages in 601ms
257
  ======================================================================
258
  RMT Diffusion Consistency reproduction -- Claim 5 (toy scale)
259
  Testing: do REAL TRAINED deep denoisers show the same
@@ -624,22 +624,22 @@ Using REAL MNIST data (14x14 downsampled, d=196).
624
  Split sizes: 400 / 400
625
 
626
  Training MLP denoiser on split A (400 samples)...
627
- step 500/1500 loss=0.5923
628
- step 1000/1500 loss=0.4806
629
  step 1500/1500 loss=0.3555
630
  Training MLP denoiser on split B (400 samples)...
631
- step 500/1500 loss=0.5559
632
- step 1000/1500 loss=0.4497
633
- step 1500/1500 loss=0.3706
634
 
635
  [Results over 30 shared-seed trials, TRAINED deep MLP denoisers]
636
- Cross-split distance: 7.284 +/- 1.358
637
- Nearest-training-neighbor dist: 15.879 +/- 2.446
638
 
639
  ======================================================================
640
  SUMMARY
641
  PASS (toy scale): trained deep MLP denoisers show cross-split outputs
642
- 2.18x MORE similar to each other than to their nearest training
643
  example -- the same qualitative pattern the linear theory (Claim 1)
644
  predicts, now confirmed with REAL TRAINED nonlinear networks, not
645
  just the closed-form linear denoiser. Supports Claim 5 at toy scale.
 
3
 
4
  ---
5
  <!-- trackio-cell
6
+ {"type": "code", "id": "cell_36b1149007c3", "created_at": "2026-08-01T22:32:02+00:00", "title": "Run: hf rmt_diffusion_claim5.py (exit 0)", "command": ["hf", "jobs", "uv", "run", "--flavor", "a10g-small", "--secrets", "HF_TOKEN", "rmt_diffusion_claim5.py"], "exit_code": 0, "duration_s": 169.787}
7
  -->
8
  ````bash
9
  $ hf jobs uv run --flavor a10g-small --secrets HF_TOKEN rmt_diffusion_claim5.py
10
  ````
11
 
12
+ exit 0 · 169.8s
13
 
14
 
15
  ````python title=rmt_diffusion_claim5.py
 
207
  ````output
208
  /usr/local/lib/python3.12/dist-packages/huggingface_hub/utils/_experimental.py:59: UserWarning: 'HfApi.run_uv_job' is experimental and might be subject to breaking changes in the future without prior notice. You can disable this warning by setting `HF_HUB_DISABLE_EXPERIMENTAL_WARNING=1` as environment variable.
209
  warnings.warn(
210
+ Job started with ID: 6a6e7339a00abefd4b28c339
211
+ View at: https://huggingface.co/jobs/byte-vortex/6a6e7339a00abefd4b28c339
212
+ Downloading sympy (6.0MiB)
 
 
 
213
  Downloading numpy (15.9MiB)
214
  Downloading nvidia-cusparselt-cu13 (162.3MiB)
 
 
215
  Downloading cuda-bindings (6.3MiB)
216
+ Downloading nvidia-nvjitlink (38.9MiB)
217
+ Downloading nvidia-nccl-cu13 (196.4MiB)
218
+ Downloading nvidia-cuda-nvrtc (86.0MiB)
219
  Downloading nvidia-cusparse (139.2MiB)
220
+ Downloading nvidia-cuda-runtime (2.1MiB)
221
+ Downloading nvidia-cuda-cupti (10.2MiB)
222
+ Downloading nvidia-cudnn-cu13 (349.2MiB)
223
  Downloading torch (502.2MiB)
 
 
 
 
 
224
  Downloading networkx (2.0MiB)
225
+ Downloading triton (188.6MiB)
226
+ Downloading nvidia-nvshmem-cu13 (57.6MiB)
227
+ Downloading nvidia-cusolver (191.6MiB)
228
+ Downloading nvidia-cufile (1.2MiB)
229
  Downloading torchvision (7.3MiB)
230
+ Downloading nvidia-curand (56.8MiB)
231
+ Downloading nvidia-cublas (403.5MiB)
232
+ Downloading pillow (6.6MiB)
233
+ Downloading nvidia-cufft (204.2MiB)
234
  Downloaded nvidia-cufile
235
  Downloaded nvidia-cuda-runtime
236
  Downloaded networkx
 
239
  Downloaded torchvision
240
  Downloaded nvidia-cuda-cupti
241
  Downloaded numpy
 
242
  Downloaded nvidia-nvjitlink
243
+ Downloaded sympy
244
  Downloaded nvidia-curand
245
  Downloaded nvidia-nvshmem-cu13
246
  Downloaded nvidia-cuda-nvrtc
 
253
  Downloaded nvidia-cudnn-cu13
254
  Downloaded nvidia-cublas
255
  Downloaded torch
256
+ Installed 32 packages in 668ms
257
  ======================================================================
258
  RMT Diffusion Consistency reproduction -- Claim 5 (toy scale)
259
  Testing: do REAL TRAINED deep denoisers show the same
 
624
  Split sizes: 400 / 400
625
 
626
  Training MLP denoiser on split A (400 samples)...
627
+ step 500/1500 loss=0.5875
628
+ step 1000/1500 loss=0.4851
629
  step 1500/1500 loss=0.3555
630
  Training MLP denoiser on split B (400 samples)...
631
+ step 500/1500 loss=0.5614
632
+ step 1000/1500 loss=0.4500
633
+ step 1500/1500 loss=0.3717
634
 
635
  [Results over 30 shared-seed trials, TRAINED deep MLP denoisers]
636
+ Cross-split distance: 7.158 +/- 0.911
637
+ Nearest-training-neighbor dist: 15.957 +/- 2.329
638
 
639
  ======================================================================
640
  SUMMARY
641
  PASS (toy scale): trained deep MLP denoisers show cross-split outputs
642
+ 2.23x MORE similar to each other than to their nearest training
643
  example -- the same qualitative pattern the linear theory (Claim 1)
644
  predicts, now confirmed with REAL TRAINED nonlinear networks, not
645
  just the closed-form linear denoiser. Supports Claim 5 at toy scale.
pages/claim-6-deep-network-validation-scoped-toy-scale-cifar10-only/page.md CHANGED
@@ -3,13 +3,13 @@
3
 
4
  ---
5
  <!-- trackio-cell
6
- {"type": "code", "id": "cell_ed109f32162a", "created_at": "2026-08-01T21:05:57+00:00", "title": "Run: hf rmt_diffusion_claim6.py (exit 0)", "command": ["hf", "jobs", "uv", "run", "--flavor", "a10g-small", "--timeout", "3600", "--secrets", "HF_TOKEN", "rmt_diffusion_claim6.py"], "exit_code": 0, "duration_s": 322.114}
7
  -->
8
  ````bash
9
  $ hf jobs uv run --flavor a10g-small --timeout 3600 --secrets HF_TOKEN rmt_diffusion_claim6.py
10
  ````
11
 
12
- exit 0 · 322.1s
13
 
14
 
15
  ````python title=rmt_diffusion_claim6.py
@@ -489,30 +489,30 @@ if __name__ == "__main__":
489
  ````output
490
  /usr/local/lib/python3.12/dist-packages/huggingface_hub/utils/_experimental.py:59: UserWarning: 'HfApi.run_uv_job' is experimental and might be subject to breaking changes in the future without prior notice. You can disable this warning by setting `HF_HUB_DISABLE_EXPERIMENTAL_WARNING=1` as environment variable.
491
  warnings.warn(
492
- Job started with ID: 6a6e5e746b79c09949c1eb1d
493
- View at: https://huggingface.co/jobs/byte-vortex/6a6e5e746b79c09949c1eb1d
494
- Downloading nvidia-cusparselt-cu13 (162.3MiB)
495
- Downloading nvidia-cusparse (139.2MiB)
496
  Downloading nvidia-cuda-runtime (2.1MiB)
497
- Downloading networkx (2.0MiB)
498
  Downloading nvidia-cufile (1.2MiB)
499
- Downloading triton (188.6MiB)
500
- Downloading numpy (15.9MiB)
501
- Downloading torchvision (7.3MiB)
502
  Downloading nvidia-cuda-nvrtc (86.0MiB)
503
- Downloading nvidia-nvjitlink (38.9MiB)
504
- Downloading nvidia-nvshmem-cu13 (57.6MiB)
505
- Downloading nvidia-cublas (403.5MiB)
506
  Downloading nvidia-cusolver (191.6MiB)
507
  Downloading nvidia-cudnn-cu13 (349.2MiB)
508
  Downloading pillow (6.6MiB)
509
- Downloading nvidia-curand (56.8MiB)
510
- Downloading cuda-bindings (6.3MiB)
511
- Downloading torch (502.2MiB)
512
  Downloading nvidia-cufft (204.2MiB)
513
  Downloading nvidia-nccl-cu13 (196.4MiB)
514
  Downloading nvidia-cuda-cupti (10.2MiB)
515
- Downloading sympy (6.0MiB)
 
 
 
 
 
 
 
 
516
  Downloaded nvidia-cufile
517
  Downloaded nvidia-cuda-runtime
518
  Downloaded networkx
@@ -535,7 +535,7 @@ Downloading sympy (6.0MiB)
535
  Downloaded nvidia-cudnn-cu13
536
  Downloaded nvidia-cublas
537
  Downloaded torch
538
- Installed 32 packages in 562ms
539
  ======================================================================
540
  RMT Diffusion Consistency reproduction -- Claim 6 (SCOPED TOY SCALE)
541
  Testing official Claim 5: consistency vs linear theory,
 
3
 
4
  ---
5
  <!-- trackio-cell
6
+ {"type": "code", "id": "cell_9db6a1472e76", "created_at": "2026-08-01T22:37:27+00:00", "title": "Run: hf rmt_diffusion_claim6.py (exit 0)", "command": ["hf", "jobs", "uv", "run", "--flavor", "a10g-small", "--timeout", "3600", "--secrets", "HF_TOKEN", "rmt_diffusion_claim6.py"], "exit_code": 0, "duration_s": 322.502}
7
  -->
8
  ````bash
9
  $ hf jobs uv run --flavor a10g-small --timeout 3600 --secrets HF_TOKEN rmt_diffusion_claim6.py
10
  ````
11
 
12
+ exit 0 · 322.5s
13
 
14
 
15
  ````python title=rmt_diffusion_claim6.py
 
489
  ````output
490
  /usr/local/lib/python3.12/dist-packages/huggingface_hub/utils/_experimental.py:59: UserWarning: 'HfApi.run_uv_job' is experimental and might be subject to breaking changes in the future without prior notice. You can disable this warning by setting `HF_HUB_DISABLE_EXPERIMENTAL_WARNING=1` as environment variable.
491
  warnings.warn(
492
+ Job started with ID: 6a6e73e56b79c09949c1eca6
493
+ View at: https://huggingface.co/jobs/byte-vortex/6a6e73e56b79c09949c1eca6
494
+ Downloading cuda-bindings (6.3MiB)
 
495
  Downloading nvidia-cuda-runtime (2.1MiB)
496
+ Downloading sympy (6.0MiB)
497
  Downloading nvidia-cufile (1.2MiB)
 
 
 
498
  Downloading nvidia-cuda-nvrtc (86.0MiB)
 
 
 
499
  Downloading nvidia-cusolver (191.6MiB)
500
  Downloading nvidia-cudnn-cu13 (349.2MiB)
501
  Downloading pillow (6.6MiB)
502
+ Downloading nvidia-cublas (403.5MiB)
503
+ Downloading nvidia-nvjitlink (38.9MiB)
 
504
  Downloading nvidia-cufft (204.2MiB)
505
  Downloading nvidia-nccl-cu13 (196.4MiB)
506
  Downloading nvidia-cuda-cupti (10.2MiB)
507
+ Downloading numpy (15.9MiB)
508
+ Downloading triton (188.6MiB)
509
+ Downloading nvidia-nvshmem-cu13 (57.6MiB)
510
+ Downloading nvidia-curand (56.8MiB)
511
+ Downloading nvidia-cusparselt-cu13 (162.3MiB)
512
+ Downloading nvidia-cusparse (139.2MiB)
513
+ Downloading networkx (2.0MiB)
514
+ Downloading torch (502.2MiB)
515
+ Downloading torchvision (7.3MiB)
516
  Downloaded nvidia-cufile
517
  Downloaded nvidia-cuda-runtime
518
  Downloaded networkx
 
535
  Downloaded nvidia-cudnn-cu13
536
  Downloaded nvidia-cublas
537
  Downloaded torch
538
+ Installed 32 packages in 608ms
539
  ======================================================================
540
  RMT Diffusion Consistency reproduction -- Claim 6 (SCOPED TOY SCALE)
541
  Testing official Claim 5: consistency vs linear theory,
pages/conclusion/page.md CHANGED
@@ -3,7 +3,7 @@
3
 
4
  ---
5
  <!-- trackio-cell
6
- {"type": "markdown", "id": "cell_1ff9eb6e69a3", "created_at": "2026-08-01T21:05:58+00:00", "title": "Conclusion"}
7
  -->
8
  This reproduction verified all 5 claims from the official challenge for "A Random Matrix Perspective on the Consistency of Diffusion Models" (arXiv 2602.02908, ICML 2026 Oral).
9
 
 
3
 
4
  ---
5
  <!-- trackio-cell
6
+ {"type": "markdown", "id": "cell_d1cf88dca664", "created_at": "2026-08-01T22:37:28+00:00", "title": "Conclusion"}
7
  -->
8
  This reproduction verified all 5 claims from the official challenge for "A Random Matrix Perspective on the Consistency of Diffusion Models" (arXiv 2602.02908, ICML 2026 Oral).
9
 
pages/executive-summary/page.md CHANGED
@@ -3,7 +3,7 @@
3
 
4
  ---
5
  <!-- trackio-cell
6
- {"type": "markdown", "id": "cell_f212dfa9c3cc", "created_at": "2026-08-01T20:53:54+00:00", "title": "Executive summary", "pinned": true, "pinned_at": "2026-08-01T20:53:55+00:00"}
7
  -->
8
  Reproduction of "A Random Matrix Theory Perspective on the Consistency of Diffusion Models" (arXiv 2602.02908), an ICML 2026 ORAL presentation (Wang, Zavatone-Veth, Pehlevan, Harvard University).
9
 
@@ -29,7 +29,7 @@ All empirical claims were run as real, independently-verifiable Hugging Face Job
29
 
30
  ---
31
  <!-- trackio-cell
32
- {"type": "figure", "id": "cell_51fdb1764519", "created_at": "2026-08-01T20:53:56+00:00", "title": "Reproduction poster", "pinned": true, "pinned_at": "2026-08-01T20:53:57+00:00"}
33
  -->
34
  ````html
35
  <div style="font-family: -apple-system, sans-serif; max-width: 900px; margin: 0 auto; padding: 24px; border: 1px solid #ddd; border-radius: 8px;">
 
3
 
4
  ---
5
  <!-- trackio-cell
6
+ {"type": "markdown", "id": "cell_369c8772e75d", "created_at": "2026-08-01T22:24:38+00:00", "title": "Executive summary", "pinned": true, "pinned_at": "2026-08-01T22:24:38+00:00"}
7
  -->
8
  Reproduction of "A Random Matrix Theory Perspective on the Consistency of Diffusion Models" (arXiv 2602.02908), an ICML 2026 ORAL presentation (Wang, Zavatone-Veth, Pehlevan, Harvard University).
9
 
 
29
 
30
  ---
31
  <!-- trackio-cell
32
+ {"type": "figure", "id": "cell_432d2a7dcb11", "created_at": "2026-08-01T22:24:39+00:00", "title": "Reproduction poster", "pinned": true, "pinned_at": "2026-08-01T22:24:40+00:00"}
33
  -->
34
  ````html
35
  <div style="font-family: -apple-system, sans-serif; max-width: 900px; margin: 0 auto; padding: 24px; border: 1px solid #ddd; border-radius: 8px;">
workspace.json CHANGED
@@ -5,34 +5,34 @@
5
  "files": [],
6
  "hub_refs": [
7
  {
8
- "url": "https://huggingface.co/jobs/byte-vortex/6a6e5ce86b79c09949c1eafb",
9
  "type": "Jobs",
10
- "label": "byte-vortex/6a6e5ce86b79c09949c1eafb"
11
  },
12
  {
13
- "url": "https://huggingface.co/jobs/byte-vortex/6a6e5d136b79c09949c1eb01",
14
  "type": "Jobs",
15
- "label": "byte-vortex/6a6e5d136b79c09949c1eb01"
16
  },
17
  {
18
- "url": "https://huggingface.co/jobs/byte-vortex/6a6e5d84a00abefd4b28c0e4",
19
  "type": "Jobs",
20
- "label": "byte-vortex/6a6e5d84a00abefd4b28c0e4"
21
  },
22
  {
23
- "url": "https://huggingface.co/jobs/byte-vortex/6a6e5db66b79c09949c1eb09",
24
  "type": "Jobs",
25
- "label": "byte-vortex/6a6e5db66b79c09949c1eb09"
26
  },
27
  {
28
- "url": "https://huggingface.co/jobs/byte-vortex/6a6e5dc8a00abefd4b28c0e6",
29
  "type": "Jobs",
30
- "label": "byte-vortex/6a6e5dc8a00abefd4b28c0e6"
31
  },
32
  {
33
- "url": "https://huggingface.co/jobs/byte-vortex/6a6e5e746b79c09949c1eb1d",
34
  "type": "Jobs",
35
- "label": "byte-vortex/6a6e5e746b79c09949c1eb1d"
36
  }
37
  ],
38
  "reference_only": true
 
5
  "files": [],
6
  "hub_refs": [
7
  {
8
+ "url": "https://huggingface.co/jobs/byte-vortex/6a6e722b6b79c09949c1ec91",
9
  "type": "Jobs",
10
+ "label": "byte-vortex/6a6e722b6b79c09949c1ec91"
11
  },
12
  {
13
+ "url": "https://huggingface.co/jobs/byte-vortex/6a6e7259a00abefd4b28c32e",
14
  "type": "Jobs",
15
+ "label": "byte-vortex/6a6e7259a00abefd4b28c32e"
16
  },
17
  {
18
+ "url": "https://huggingface.co/jobs/byte-vortex/6a6e72bb6b79c09949c1ec97",
19
  "type": "Jobs",
20
+ "label": "byte-vortex/6a6e72bb6b79c09949c1ec97"
21
  },
22
  {
23
+ "url": "https://huggingface.co/jobs/byte-vortex/6a6e73276b79c09949c1ec9c",
24
  "type": "Jobs",
25
+ "label": "byte-vortex/6a6e73276b79c09949c1ec9c"
26
  },
27
  {
28
+ "url": "https://huggingface.co/jobs/byte-vortex/6a6e7339a00abefd4b28c339",
29
  "type": "Jobs",
30
+ "label": "byte-vortex/6a6e7339a00abefd4b28c339"
31
  },
32
  {
33
+ "url": "https://huggingface.co/jobs/byte-vortex/6a6e73e56b79c09949c1eca6",
34
  "type": "Jobs",
35
+ "label": "byte-vortex/6a6e73e56b79c09949c1eca6"
36
  }
37
  ],
38
  "reference_only": true