jsaurabh commited on
Commit
f46498c
·
verified ·
1 Parent(s): 341a4f3

Archive raw experiment records outside the source repository

Browse files
README.md CHANGED
@@ -16,9 +16,9 @@ Checkpoints, weight edits and activation arrays for [Weight Space Lab](https://g
16
  - `results/qwen/blind-discovery/selected.safetensors`: the independently selected Qwen candidate. This contains **only two edited tensors**, not a full model. The blind search did **not** improve performance: base 5/64 versus candidate 3/64; both finished correctly 3/64 times and hit the token cap 61/64 times.
17
  - `results/qwen/blind-discovery/artifacts/*.npz`: recorded activation arrays from that independent search, without object pickles.
18
 
19
- - `results/comparison/qwen-astra-vs-gpt55-20261103-interrupted/gpt55/artifacts/*.npz`: two activation captures from an interrupted infrastructure trial, excluded from the editor comparison. See the [interruption report](https://github.com/jsaurabh/weight-space-lab/tree/main/results/comparison/qwen-astra-vs-gpt55-20261103-interrupted).
20
 
21
- - `results/comparison/qwen-astra-vs-gpt55-20261103/{gpt55,astra}/selected.safetensors`: independent frozen patches from the matched ten-feedback-call Qwen pilot. GPT-5.5 changes one matrix; Astra changes 24. On 32 unseen MATH-500 questions with two samples each, base scored **7/64**, Astra **11/64**, and GPT-5.5 **13/64**. This is one attempt per editor; Astra required declared infrastructure recoveries. See the [full report and limits](https://github.com/jsaurabh/weight-space-lab/tree/main/results/comparison/qwen-astra-vs-gpt55-20261103). Associated `artifacts/*.npz` files contain two activation captures per editor.
22
  - `results/comparison/qwen-astra-vs-gpt55-20261103/recovery_001/launcher_repair/current_checkpoint.safetensors`: an intermediate Astra checkpoint retained as recovery evidence. This is **not** either final selected repair.
23
 
24
  ## Reproduce
@@ -30,3 +30,12 @@ The Qwen patches require [Qwen/Qwen3.5-0.8B](https://huggingface.co/Qwen/Qwen3.5
30
  ## Attribution
31
 
32
  The published numerical diff is by Rikiya Takehi, Jayden Teoh, Alex Zhang and Omar Khattab, *Sparks of Weight-Space Programming* (2026), and retains its included CC BY 4.0 attribution. The modified Qwen tensors derive from the Qwen team's Apache 2.0 model; its license and the modification notice are included alongside them. The tiny checkpoints were constructed for this project without gradient descent. See each GitHub report for the distinction between guided construction, independent discovery and replay.
 
 
 
 
 
 
 
 
 
 
16
  - `results/qwen/blind-discovery/selected.safetensors`: the independently selected Qwen candidate. This contains **only two edited tensors**, not a full model. The blind search did **not** improve performance: base 5/64 versus candidate 3/64; both finished correctly 3/64 times and hit the token cap 61/64 times.
17
  - `results/qwen/blind-discovery/artifacts/*.npz`: recorded activation arrays from that independent search, without object pickles.
18
 
19
+ - `results/comparison/qwen-astra-vs-gpt55-20261103-interrupted/gpt55/artifacts/*.npz`: two activation captures from an interrupted infrastructure trial, excluded from the editor comparison. See the [interruption report](https://github.com/jsaurabh/weight-space-lab/blob/main/reports/qwen-editor-comparison.md).
20
 
21
+ - `results/comparison/qwen-astra-vs-gpt55-20261103/{gpt55,astra}/selected.safetensors`: independent frozen patches from the matched ten-feedback-call Qwen pilot. GPT-5.5 changes one matrix; Astra changes 24. On 32 unseen MATH-500 questions with two samples each, base scored **7/64**, Astra **11/64**, and GPT-5.5 **13/64**. This is one attempt per editor; Astra required declared infrastructure recoveries. See the [full report and limits](https://github.com/jsaurabh/weight-space-lab/blob/main/reports/qwen-editor-comparison.md). Associated `artifacts/*.npz` files contain two activation captures per editor.
22
  - `results/comparison/qwen-astra-vs-gpt55-20261103/recovery_001/launcher_repair/current_checkpoint.safetensors`: an intermediate Astra checkpoint retained as recovery evidence. This is **not** either final selected repair.
23
 
24
  ## Reproduce
 
30
  ## Attribution
31
 
32
  The published numerical diff is by Rikiya Takehi, Jayden Teoh, Alex Zhang and Omar Khattab, *Sparks of Weight-Space Programming* (2026), and retains its included CC BY 4.0 attribution. The modified Qwen tensors derive from the Qwen team's Apache 2.0 model; its license and the modification notice are included alongside them. The tiny checkpoints were constructed for this project without gradient descent. See each GitHub report for the distinction between guided construction, independent discovery and replay.
33
+
34
+ ## Archived experiment records
35
+
36
+ The `records/` archives hold raw API exchanges, generated answers, diagnostics,
37
+ source snapshots and recovery records. GitHub keeps code and concise reports.
38
+ `python3 experiments/fetch_artifacts.py` restores these records under the
39
+ ignored `results/` directory, together with the separately stored checkpoints
40
+ and activation arrays. Archive hashes and sizes are pinned in GitHub’s
41
+ `model_artifacts.json`. Group-specific downloads also restore the relevant records.
artifact_inventory.json CHANGED
@@ -1,5 +1,4 @@
1
  {
2
- "comparison_report": "https://github.com/jsaurabh/weight-space-lab/tree/main/results/comparison/qwen-astra-vs-gpt55-20261103",
3
  "files": {
4
  "results/comparison/qwen-astra-vs-gpt55-20261103-interrupted/gpt55/artifacts/probe-002.npz": {
5
  "bytes": 972891,
@@ -107,7 +106,36 @@
107
  "sha256": "e92a92aafd1f1068b4fd94aa0fbe081ba3ddea2047ee7bcac7161d861be299e7"
108
  }
109
  },
110
- "note": "GitHub model_artifacts.json pins the immutable Hugging Face revision. Inventory hashes cover all 21 binary assets.",
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
111
  "repo_id": "jsaurabh/weight-space-lab-artifacts",
112
  "repo_type": "model",
113
  "revision": null,
 
1
  {
 
2
  "files": {
3
  "results/comparison/qwen-astra-vs-gpt55-20261103-interrupted/gpt55/artifacts/probe-002.npz": {
4
  "bytes": 972891,
 
106
  "sha256": "e92a92aafd1f1068b4fd94aa0fbe081ba3ddea2047ee7bcac7161d861be299e7"
107
  }
108
  },
109
+ "record_archives": {
110
+ "records/qwen-editor-comparison.tar.gz": {
111
+ "bytes": 26294557,
112
+ "extract_to": ".",
113
+ "groups": [
114
+ "qwen-comparison"
115
+ ],
116
+ "member_count": 697,
117
+ "sha256": "96d15bbda2162f47bbec760b31ff0fab8d24d12d754c5bf7587be585956fd443"
118
+ },
119
+ "records/qwen-pilots.tar.gz": {
120
+ "bytes": 10843448,
121
+ "extract_to": ".",
122
+ "groups": [
123
+ "qwen-published",
124
+ "qwen-blind"
125
+ ],
126
+ "member_count": 313,
127
+ "sha256": "75c89488f482cd053f8f33f47678e60f843dc437ec6d3228e1335e3bdc1a8a85"
128
+ },
129
+ "records/tiny.tar.gz": {
130
+ "bytes": 60976,
131
+ "extract_to": ".",
132
+ "groups": [
133
+ "tiny"
134
+ ],
135
+ "member_count": 30,
136
+ "sha256": "b18d95a87da0027e8f88787e4f3ce0815a6651631b0a7e7fa6293297cbe70548"
137
+ }
138
+ },
139
  "repo_id": "jsaurabh/weight-space-lab-artifacts",
140
  "repo_type": "model",
141
  "revision": null,
records/qwen-editor-comparison.tar.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:96d15bbda2162f47bbec760b31ff0fab8d24d12d754c5bf7587be585956fd443
3
+ size 26294557
records/qwen-pilots.tar.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75c89488f482cd053f8f33f47678e60f843dc437ec6d3228e1335e3bdc1a8a85
3
+ size 10843448
records/tiny.tar.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b18d95a87da0027e8f88787e4f3ce0815a6651631b0a7e7fa6293297cbe70548
3
+ size 60976