Perfect7613 commited on
Commit
8967c53
·
verified ·
1 Parent(s): 1bbfb55

Tiny Aya Global over-refusal patch (WeightPatch, changed tensors only)

Browse files
Files changed (4) hide show
  1. README.md +8 -0
  2. edits_by_layer.json +1041 -0
  3. manifest.json +36 -0
  4. patch.safetensors +3 -0
README.md ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ base_model: CohereLabs/tiny-aya-global
4
+ tags: [weightpatch, weight-editing, lexsi]
5
+ ---
6
+ # Tiny Aya Global over-refusal patch (WeightPatch, changed tensors only)
7
+
8
+ The four changed tensors of [the edited model](https://huggingface.co/Perfect7613/tiny-aya-global-weightpatch-overrefusal), as a patch: load `CohereLabs/tiny-aya-global` and replace these tensors with the ones in `patch.safetensors`. 398,328 weights differ (0.012% of the model). `manifest.json` records each edit and the evidence the agent gave for it; `edits_by_layer.json` lists every changed column. Tiny Aya is CC BY-NC 4.0 and this derivative keeps that licence.
edits_by_layer.json ADDED
@@ -0,0 +1,1041 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [
2
+ {
3
+ "tensor": "model.layers.20.mlp.down_proj.weight",
4
+ "layer": 20,
5
+ "module": "mlp.down_proj.weight",
6
+ "shape": [
7
+ 2048,
8
+ 11008
9
+ ],
10
+ "entries_changed": 71680,
11
+ "relative_change": 0.042976610362529755,
12
+ "columns_changed": 35,
13
+ "rows_touched": 2048,
14
+ "columns": [
15
+ {
16
+ "col": 75,
17
+ "relative_change": 0.606,
18
+ "cosine_new_old": 0.8623
19
+ },
20
+ {
21
+ "col": 128,
22
+ "relative_change": 0.7347,
23
+ "cosine_new_old": 0.8186
24
+ },
25
+ {
26
+ "col": 591,
27
+ "relative_change": 0.7044,
28
+ "cosine_new_old": 0.8288
29
+ },
30
+ {
31
+ "col": 1175,
32
+ "relative_change": 0.9039,
33
+ "cosine_new_old": 0.7643
34
+ },
35
+ {
36
+ "col": 1671,
37
+ "relative_change": 0.9732,
38
+ "cosine_new_old": 0.7436
39
+ },
40
+ {
41
+ "col": 1721,
42
+ "relative_change": 0.6926,
43
+ "cosine_new_old": 0.8327
44
+ },
45
+ {
46
+ "col": 1815,
47
+ "relative_change": 1.879,
48
+ "cosine_new_old": 0.572
49
+ },
50
+ {
51
+ "col": 1846,
52
+ "relative_change": 0.4829,
53
+ "cosine_new_old": 0.9039
54
+ },
55
+ {
56
+ "col": 1962,
57
+ "relative_change": 0.973,
58
+ "cosine_new_old": 0.7437
59
+ },
60
+ {
61
+ "col": 1989,
62
+ "relative_change": 0.5723,
63
+ "cosine_new_old": 0.8738
64
+ },
65
+ {
66
+ "col": 2723,
67
+ "relative_change": 0.7963,
68
+ "cosine_new_old": 0.7982
69
+ },
70
+ {
71
+ "col": 2913,
72
+ "relative_change": 0.7004,
73
+ "cosine_new_old": 0.8301
74
+ },
75
+ {
76
+ "col": 3436,
77
+ "relative_change": 0.4876,
78
+ "cosine_new_old": 0.9023
79
+ },
80
+ {
81
+ "col": 3611,
82
+ "relative_change": 0.7615,
83
+ "cosine_new_old": 0.8096
84
+ },
85
+ {
86
+ "col": 3701,
87
+ "relative_change": 0.7641,
88
+ "cosine_new_old": 0.8088
89
+ },
90
+ {
91
+ "col": 3766,
92
+ "relative_change": 0.6723,
93
+ "cosine_new_old": 0.8396
94
+ },
95
+ {
96
+ "col": 4013,
97
+ "relative_change": 0.6602,
98
+ "cosine_new_old": 0.8438
99
+ },
100
+ {
101
+ "col": 4214,
102
+ "relative_change": 0.722,
103
+ "cosine_new_old": 0.8228
104
+ },
105
+ {
106
+ "col": 4454,
107
+ "relative_change": 0.6272,
108
+ "cosine_new_old": 0.8551
109
+ },
110
+ {
111
+ "col": 4568,
112
+ "relative_change": 0.6616,
113
+ "cosine_new_old": 0.8433
114
+ },
115
+ {
116
+ "col": 5220,
117
+ "relative_change": 1.2427,
118
+ "cosine_new_old": 0.6743
119
+ },
120
+ {
121
+ "col": 5297,
122
+ "relative_change": 0.5527,
123
+ "cosine_new_old": 0.8805
124
+ },
125
+ {
126
+ "col": 5409,
127
+ "relative_change": 0.5761,
128
+ "cosine_new_old": 0.8725
129
+ },
130
+ {
131
+ "col": 5480,
132
+ "relative_change": 0.8765,
133
+ "cosine_new_old": 0.7727
134
+ },
135
+ {
136
+ "col": 5817,
137
+ "relative_change": 0.9918,
138
+ "cosine_new_old": 0.7383
139
+ },
140
+ {
141
+ "col": 6196,
142
+ "relative_change": 0.8977,
143
+ "cosine_new_old": 0.7661
144
+ },
145
+ {
146
+ "col": 7197,
147
+ "relative_change": 0.4803,
148
+ "cosine_new_old": 0.9047
149
+ },
150
+ {
151
+ "col": 7626,
152
+ "relative_change": 1.0451,
153
+ "cosine_new_old": 0.7235
154
+ },
155
+ {
156
+ "col": 8439,
157
+ "relative_change": 0.6025,
158
+ "cosine_new_old": 0.8635
159
+ },
160
+ {
161
+ "col": 8449,
162
+ "relative_change": 0.5634,
163
+ "cosine_new_old": 0.8768
164
+ },
165
+ {
166
+ "col": 8588,
167
+ "relative_change": 0.4889,
168
+ "cosine_new_old": 0.9019
169
+ },
170
+ {
171
+ "col": 9275,
172
+ "relative_change": 0.6579,
173
+ "cosine_new_old": 0.8446
174
+ },
175
+ {
176
+ "col": 9403,
177
+ "relative_change": 0.7409,
178
+ "cosine_new_old": 0.8165
179
+ },
180
+ {
181
+ "col": 10147,
182
+ "relative_change": 0.4826,
183
+ "cosine_new_old": 0.904
184
+ },
185
+ {
186
+ "col": 10245,
187
+ "relative_change": 0.5875,
188
+ "cosine_new_old": 0.8686
189
+ }
190
+ ],
191
+ "rank1_share": 1.0
192
+ },
193
+ {
194
+ "tensor": "model.layers.22.mlp.down_proj.weight",
195
+ "layer": 22,
196
+ "module": "mlp.down_proj.weight",
197
+ "shape": [
198
+ 2048,
199
+ 11008
200
+ ],
201
+ "entries_changed": 96256,
202
+ "relative_change": 0.052520837634801865,
203
+ "columns_changed": 47,
204
+ "rows_touched": 2048,
205
+ "columns": [
206
+ {
207
+ "col": 52,
208
+ "relative_change": 0.6033,
209
+ "cosine_new_old": 0.8632
210
+ },
211
+ {
212
+ "col": 627,
213
+ "relative_change": 1.0553,
214
+ "cosine_new_old": 0.7207
215
+ },
216
+ {
217
+ "col": 680,
218
+ "relative_change": 0.6721,
219
+ "cosine_new_old": 0.8397
220
+ },
221
+ {
222
+ "col": 910,
223
+ "relative_change": 0.9789,
224
+ "cosine_new_old": 0.742
225
+ },
226
+ {
227
+ "col": 931,
228
+ "relative_change": 0.9049,
229
+ "cosine_new_old": 0.764
230
+ },
231
+ {
232
+ "col": 1018,
233
+ "relative_change": 0.7328,
234
+ "cosine_new_old": 0.8192
235
+ },
236
+ {
237
+ "col": 1331,
238
+ "relative_change": 0.7553,
239
+ "cosine_new_old": 0.8117
240
+ },
241
+ {
242
+ "col": 1533,
243
+ "relative_change": 1.3516,
244
+ "cosine_new_old": 0.6511
245
+ },
246
+ {
247
+ "col": 1700,
248
+ "relative_change": 1.0953,
249
+ "cosine_new_old": 0.7101
250
+ },
251
+ {
252
+ "col": 1801,
253
+ "relative_change": 1.0194,
254
+ "cosine_new_old": 0.7305
255
+ },
256
+ {
257
+ "col": 2453,
258
+ "relative_change": 0.5519,
259
+ "cosine_new_old": 0.8808
260
+ },
261
+ {
262
+ "col": 2557,
263
+ "relative_change": 0.6597,
264
+ "cosine_new_old": 0.844
265
+ },
266
+ {
267
+ "col": 2991,
268
+ "relative_change": 0.8285,
269
+ "cosine_new_old": 0.7878
270
+ },
271
+ {
272
+ "col": 3191,
273
+ "relative_change": 0.4808,
274
+ "cosine_new_old": 0.9046
275
+ },
276
+ {
277
+ "col": 3247,
278
+ "relative_change": 0.5747,
279
+ "cosine_new_old": 0.873
280
+ },
281
+ {
282
+ "col": 3734,
283
+ "relative_change": 0.8475,
284
+ "cosine_new_old": 0.7818
285
+ },
286
+ {
287
+ "col": 3873,
288
+ "relative_change": 0.7326,
289
+ "cosine_new_old": 0.8192
290
+ },
291
+ {
292
+ "col": 4170,
293
+ "relative_change": 0.8484,
294
+ "cosine_new_old": 0.7815
295
+ },
296
+ {
297
+ "col": 4360,
298
+ "relative_change": 0.7369,
299
+ "cosine_new_old": 0.8178
300
+ },
301
+ {
302
+ "col": 4611,
303
+ "relative_change": 0.7126,
304
+ "cosine_new_old": 0.826
305
+ },
306
+ {
307
+ "col": 4864,
308
+ "relative_change": 0.6859,
309
+ "cosine_new_old": 0.835
310
+ },
311
+ {
312
+ "col": 4869,
313
+ "relative_change": 0.7706,
314
+ "cosine_new_old": 0.8066
315
+ },
316
+ {
317
+ "col": 5523,
318
+ "relative_change": 0.6854,
319
+ "cosine_new_old": 0.8352
320
+ },
321
+ {
322
+ "col": 5548,
323
+ "relative_change": 1.6612,
324
+ "cosine_new_old": 0.5988
325
+ },
326
+ {
327
+ "col": 5684,
328
+ "relative_change": 0.8259,
329
+ "cosine_new_old": 0.7887
330
+ },
331
+ {
332
+ "col": 6112,
333
+ "relative_change": 0.5748,
334
+ "cosine_new_old": 0.873
335
+ },
336
+ {
337
+ "col": 6355,
338
+ "relative_change": 0.6107,
339
+ "cosine_new_old": 0.8607
340
+ },
341
+ {
342
+ "col": 6664,
343
+ "relative_change": 0.7861,
344
+ "cosine_new_old": 0.8015
345
+ },
346
+ {
347
+ "col": 6804,
348
+ "relative_change": 0.7433,
349
+ "cosine_new_old": 0.8157
350
+ },
351
+ {
352
+ "col": 6812,
353
+ "relative_change": 0.8618,
354
+ "cosine_new_old": 0.7773
355
+ },
356
+ {
357
+ "col": 6912,
358
+ "relative_change": 1.5145,
359
+ "cosine_new_old": 0.6213
360
+ },
361
+ {
362
+ "col": 6951,
363
+ "relative_change": 1.0438,
364
+ "cosine_new_old": 0.7238
365
+ },
366
+ {
367
+ "col": 7058,
368
+ "relative_change": 1.3964,
369
+ "cosine_new_old": 0.6424
370
+ },
371
+ {
372
+ "col": 7161,
373
+ "relative_change": 0.9772,
374
+ "cosine_new_old": 0.7425
375
+ },
376
+ {
377
+ "col": 7619,
378
+ "relative_change": 0.8314,
379
+ "cosine_new_old": 0.7869
380
+ },
381
+ {
382
+ "col": 7910,
383
+ "relative_change": 0.8386,
384
+ "cosine_new_old": 0.7846
385
+ },
386
+ {
387
+ "col": 8239,
388
+ "relative_change": 0.5439,
389
+ "cosine_new_old": 0.8835
390
+ },
391
+ {
392
+ "col": 8504,
393
+ "relative_change": 0.6496,
394
+ "cosine_new_old": 0.8474
395
+ },
396
+ {
397
+ "col": 8558,
398
+ "relative_change": 0.9682,
399
+ "cosine_new_old": 0.7451
400
+ },
401
+ {
402
+ "col": 8937,
403
+ "relative_change": 0.6189,
404
+ "cosine_new_old": 0.8579
405
+ },
406
+ {
407
+ "col": 9303,
408
+ "relative_change": 0.5648,
409
+ "cosine_new_old": 0.8764
410
+ },
411
+ {
412
+ "col": 9393,
413
+ "relative_change": 0.839,
414
+ "cosine_new_old": 0.7845
415
+ },
416
+ {
417
+ "col": 9488,
418
+ "relative_change": 1.2592,
419
+ "cosine_new_old": 0.6706
420
+ },
421
+ {
422
+ "col": 9686,
423
+ "relative_change": 1.0059,
424
+ "cosine_new_old": 0.7343
425
+ },
426
+ {
427
+ "col": 9944,
428
+ "relative_change": 0.6521,
429
+ "cosine_new_old": 0.8465
430
+ },
431
+ {
432
+ "col": 10414,
433
+ "relative_change": 0.7978,
434
+ "cosine_new_old": 0.7977
435
+ },
436
+ {
437
+ "col": 10793,
438
+ "relative_change": 0.6707,
439
+ "cosine_new_old": 0.8402
440
+ }
441
+ ],
442
+ "rank1_share": 1.0
443
+ },
444
+ {
445
+ "tensor": "model.layers.23.mlp.down_proj.weight",
446
+ "layer": 23,
447
+ "module": "mlp.down_proj.weight",
448
+ "shape": [
449
+ 2048,
450
+ 11008
451
+ ],
452
+ "entries_changed": 124928,
453
+ "relative_change": 0.053105976432561874,
454
+ "columns_changed": 61,
455
+ "rows_touched": 2048,
456
+ "columns": [
457
+ {
458
+ "col": 35,
459
+ "relative_change": 0.7699,
460
+ "cosine_new_old": 0.8069
461
+ },
462
+ {
463
+ "col": 125,
464
+ "relative_change": 0.5848,
465
+ "cosine_new_old": 0.8696
466
+ },
467
+ {
468
+ "col": 260,
469
+ "relative_change": 0.7805,
470
+ "cosine_new_old": 0.8034
471
+ },
472
+ {
473
+ "col": 494,
474
+ "relative_change": 0.6005,
475
+ "cosine_new_old": 0.8642
476
+ },
477
+ {
478
+ "col": 646,
479
+ "relative_change": 0.5024,
480
+ "cosine_new_old": 0.8974
481
+ },
482
+ {
483
+ "col": 806,
484
+ "relative_change": 0.4973,
485
+ "cosine_new_old": 0.8991
486
+ },
487
+ {
488
+ "col": 814,
489
+ "relative_change": 0.5592,
490
+ "cosine_new_old": 0.8783
491
+ },
492
+ {
493
+ "col": 900,
494
+ "relative_change": 0.6907,
495
+ "cosine_new_old": 0.8334
496
+ },
497
+ {
498
+ "col": 1176,
499
+ "relative_change": 0.5806,
500
+ "cosine_new_old": 0.871
501
+ },
502
+ {
503
+ "col": 1412,
504
+ "relative_change": 0.8423,
505
+ "cosine_new_old": 0.7834
506
+ },
507
+ {
508
+ "col": 1588,
509
+ "relative_change": 1.0101,
510
+ "cosine_new_old": 0.7331
511
+ },
512
+ {
513
+ "col": 1767,
514
+ "relative_change": 0.5383,
515
+ "cosine_new_old": 0.8854
516
+ },
517
+ {
518
+ "col": 1997,
519
+ "relative_change": 0.719,
520
+ "cosine_new_old": 0.8238
521
+ },
522
+ {
523
+ "col": 2027,
524
+ "relative_change": 0.6017,
525
+ "cosine_new_old": 0.8638
526
+ },
527
+ {
528
+ "col": 2297,
529
+ "relative_change": 0.623,
530
+ "cosine_new_old": 0.8565
531
+ },
532
+ {
533
+ "col": 2379,
534
+ "relative_change": 0.5218,
535
+ "cosine_new_old": 0.8909
536
+ },
537
+ {
538
+ "col": 2490,
539
+ "relative_change": 0.7189,
540
+ "cosine_new_old": 0.8239
541
+ },
542
+ {
543
+ "col": 2731,
544
+ "relative_change": 0.528,
545
+ "cosine_new_old": 0.8888
546
+ },
547
+ {
548
+ "col": 3016,
549
+ "relative_change": 0.6319,
550
+ "cosine_new_old": 0.8534
551
+ },
552
+ {
553
+ "col": 3060,
554
+ "relative_change": 0.9161,
555
+ "cosine_new_old": 0.7605
556
+ },
557
+ {
558
+ "col": 3072,
559
+ "relative_change": 0.4863,
560
+ "cosine_new_old": 0.9028
561
+ },
562
+ {
563
+ "col": 3155,
564
+ "relative_change": 0.6816,
565
+ "cosine_new_old": 0.8365
566
+ },
567
+ {
568
+ "col": 3209,
569
+ "relative_change": 0.8171,
570
+ "cosine_new_old": 0.7915
571
+ },
572
+ {
573
+ "col": 3302,
574
+ "relative_change": 0.7654,
575
+ "cosine_new_old": 0.8083
576
+ },
577
+ {
578
+ "col": 3316,
579
+ "relative_change": 0.7219,
580
+ "cosine_new_old": 0.8228
581
+ },
582
+ {
583
+ "col": 3575,
584
+ "relative_change": 2.0919,
585
+ "cosine_new_old": 0.5523
586
+ },
587
+ {
588
+ "col": 3667,
589
+ "relative_change": 0.9054,
590
+ "cosine_new_old": 0.7638
591
+ },
592
+ {
593
+ "col": 3714,
594
+ "relative_change": 0.7882,
595
+ "cosine_new_old": 0.8008
596
+ },
597
+ {
598
+ "col": 3719,
599
+ "relative_change": 0.841,
600
+ "cosine_new_old": 0.7838
601
+ },
602
+ {
603
+ "col": 3730,
604
+ "relative_change": 0.529,
605
+ "cosine_new_old": 0.8885
606
+ },
607
+ {
608
+ "col": 3898,
609
+ "relative_change": 0.5891,
610
+ "cosine_new_old": 0.8681
611
+ },
612
+ {
613
+ "col": 4006,
614
+ "relative_change": 0.8336,
615
+ "cosine_new_old": 0.7862
616
+ },
617
+ {
618
+ "col": 4133,
619
+ "relative_change": 0.8856,
620
+ "cosine_new_old": 0.7699
621
+ },
622
+ {
623
+ "col": 4188,
624
+ "relative_change": 0.7811,
625
+ "cosine_new_old": 0.8032
626
+ },
627
+ {
628
+ "col": 4329,
629
+ "relative_change": 0.7072,
630
+ "cosine_new_old": 0.8278
631
+ },
632
+ {
633
+ "col": 4441,
634
+ "relative_change": 0.5941,
635
+ "cosine_new_old": 0.8664
636
+ },
637
+ {
638
+ "col": 5154,
639
+ "relative_change": 0.4566,
640
+ "cosine_new_old": 0.9124
641
+ },
642
+ {
643
+ "col": 5158,
644
+ "relative_change": 0.5416,
645
+ "cosine_new_old": 0.8843
646
+ },
647
+ {
648
+ "col": 5328,
649
+ "relative_change": 0.7875,
650
+ "cosine_new_old": 0.8011
651
+ },
652
+ {
653
+ "col": 5721,
654
+ "relative_change": 0.5473,
655
+ "cosine_new_old": 0.8823
656
+ },
657
+ {
658
+ "col": 6113,
659
+ "relative_change": 0.6185,
660
+ "cosine_new_old": 0.858
661
+ },
662
+ {
663
+ "col": 6253,
664
+ "relative_change": 0.4438,
665
+ "cosine_new_old": 0.9166
666
+ },
667
+ {
668
+ "col": 6575,
669
+ "relative_change": 0.8288,
670
+ "cosine_new_old": 0.7877
671
+ },
672
+ {
673
+ "col": 6832,
674
+ "relative_change": 0.6117,
675
+ "cosine_new_old": 0.8604
676
+ },
677
+ {
678
+ "col": 6993,
679
+ "relative_change": 0.8585,
680
+ "cosine_new_old": 0.7783
681
+ },
682
+ {
683
+ "col": 7127,
684
+ "relative_change": 1.3468,
685
+ "cosine_new_old": 0.6521
686
+ },
687
+ {
688
+ "col": 7438,
689
+ "relative_change": 0.7418,
690
+ "cosine_new_old": 0.8162
691
+ },
692
+ {
693
+ "col": 7585,
694
+ "relative_change": 0.811,
695
+ "cosine_new_old": 0.7934
696
+ },
697
+ {
698
+ "col": 7833,
699
+ "relative_change": 0.8899,
700
+ "cosine_new_old": 0.7685
701
+ },
702
+ {
703
+ "col": 8550,
704
+ "relative_change": 0.5815,
705
+ "cosine_new_old": 0.8707
706
+ },
707
+ {
708
+ "col": 8660,
709
+ "relative_change": 0.5637,
710
+ "cosine_new_old": 0.8768
711
+ },
712
+ {
713
+ "col": 9047,
714
+ "relative_change": 0.7038,
715
+ "cosine_new_old": 0.829
716
+ },
717
+ {
718
+ "col": 9218,
719
+ "relative_change": 0.9381,
720
+ "cosine_new_old": 0.7539
721
+ },
722
+ {
723
+ "col": 9310,
724
+ "relative_change": 0.988,
725
+ "cosine_new_old": 0.7394
726
+ },
727
+ {
728
+ "col": 9344,
729
+ "relative_change": 0.6611,
730
+ "cosine_new_old": 0.8434
731
+ },
732
+ {
733
+ "col": 9589,
734
+ "relative_change": 0.8277,
735
+ "cosine_new_old": 0.7881
736
+ },
737
+ {
738
+ "col": 9673,
739
+ "relative_change": 0.5444,
740
+ "cosine_new_old": 0.8833
741
+ },
742
+ {
743
+ "col": 9917,
744
+ "relative_change": 0.638,
745
+ "cosine_new_old": 0.8514
746
+ },
747
+ {
748
+ "col": 10454,
749
+ "relative_change": 1.217,
750
+ "cosine_new_old": 0.6802
751
+ },
752
+ {
753
+ "col": 10571,
754
+ "relative_change": 0.6248,
755
+ "cosine_new_old": 0.8559
756
+ },
757
+ {
758
+ "col": 10887,
759
+ "relative_change": 0.6109,
760
+ "cosine_new_old": 0.8606
761
+ }
762
+ ],
763
+ "rank1_share": 1.0
764
+ },
765
+ {
766
+ "tensor": "model.layers.24.mlp.down_proj.weight",
767
+ "layer": 24,
768
+ "module": "mlp.down_proj.weight",
769
+ "shape": [
770
+ 2048,
771
+ 11008
772
+ ],
773
+ "entries_changed": 106496,
774
+ "relative_change": 0.05433182045817375,
775
+ "columns_changed": 52,
776
+ "rows_touched": 2048,
777
+ "columns": [
778
+ {
779
+ "col": 25,
780
+ "relative_change": 0.6489,
781
+ "cosine_new_old": 0.8476
782
+ },
783
+ {
784
+ "col": 173,
785
+ "relative_change": 0.5337,
786
+ "cosine_new_old": 0.8869
787
+ },
788
+ {
789
+ "col": 178,
790
+ "relative_change": 0.6209,
791
+ "cosine_new_old": 0.8572
792
+ },
793
+ {
794
+ "col": 272,
795
+ "relative_change": 0.7007,
796
+ "cosine_new_old": 0.83
797
+ },
798
+ {
799
+ "col": 493,
800
+ "relative_change": 0.7671,
801
+ "cosine_new_old": 0.8078
802
+ },
803
+ {
804
+ "col": 498,
805
+ "relative_change": 0.7492,
806
+ "cosine_new_old": 0.8137
807
+ },
808
+ {
809
+ "col": 695,
810
+ "relative_change": 1.3829,
811
+ "cosine_new_old": 0.645
812
+ },
813
+ {
814
+ "col": 840,
815
+ "relative_change": 0.5447,
816
+ "cosine_new_old": 0.8832
817
+ },
818
+ {
819
+ "col": 1137,
820
+ "relative_change": 0.8451,
821
+ "cosine_new_old": 0.7825
822
+ },
823
+ {
824
+ "col": 1219,
825
+ "relative_change": 0.6947,
826
+ "cosine_new_old": 0.832
827
+ },
828
+ {
829
+ "col": 1298,
830
+ "relative_change": 1.4262,
831
+ "cosine_new_old": 0.6368
832
+ },
833
+ {
834
+ "col": 1928,
835
+ "relative_change": 0.5797,
836
+ "cosine_new_old": 0.8713
837
+ },
838
+ {
839
+ "col": 2162,
840
+ "relative_change": 0.6711,
841
+ "cosine_new_old": 0.84
842
+ },
843
+ {
844
+ "col": 2337,
845
+ "relative_change": 0.584,
846
+ "cosine_new_old": 0.8698
847
+ },
848
+ {
849
+ "col": 2455,
850
+ "relative_change": 1.2415,
851
+ "cosine_new_old": 0.6746
852
+ },
853
+ {
854
+ "col": 3040,
855
+ "relative_change": 0.6658,
856
+ "cosine_new_old": 0.8419
857
+ },
858
+ {
859
+ "col": 3135,
860
+ "relative_change": 1.2207,
861
+ "cosine_new_old": 0.6793
862
+ },
863
+ {
864
+ "col": 3329,
865
+ "relative_change": 0.7948,
866
+ "cosine_new_old": 0.7987
867
+ },
868
+ {
869
+ "col": 3380,
870
+ "relative_change": 1.2277,
871
+ "cosine_new_old": 0.6777
872
+ },
873
+ {
874
+ "col": 3554,
875
+ "relative_change": 0.5595,
876
+ "cosine_new_old": 0.8782
877
+ },
878
+ {
879
+ "col": 3814,
880
+ "relative_change": 0.679,
881
+ "cosine_new_old": 0.8374
882
+ },
883
+ {
884
+ "col": 3867,
885
+ "relative_change": 0.7136,
886
+ "cosine_new_old": 0.8256
887
+ },
888
+ {
889
+ "col": 4098,
890
+ "relative_change": 0.9291,
891
+ "cosine_new_old": 0.7566
892
+ },
893
+ {
894
+ "col": 4361,
895
+ "relative_change": 0.5705,
896
+ "cosine_new_old": 0.8744
897
+ },
898
+ {
899
+ "col": 4459,
900
+ "relative_change": 0.7656,
901
+ "cosine_new_old": 0.8083
902
+ },
903
+ {
904
+ "col": 4886,
905
+ "relative_change": 0.6983,
906
+ "cosine_new_old": 0.8308
907
+ },
908
+ {
909
+ "col": 5152,
910
+ "relative_change": 0.7196,
911
+ "cosine_new_old": 0.8236
912
+ },
913
+ {
914
+ "col": 5280,
915
+ "relative_change": 0.5233,
916
+ "cosine_new_old": 0.8904
917
+ },
918
+ {
919
+ "col": 5617,
920
+ "relative_change": 0.6315,
921
+ "cosine_new_old": 0.8536
922
+ },
923
+ {
924
+ "col": 5879,
925
+ "relative_change": 0.9974,
926
+ "cosine_new_old": 0.7367
927
+ },
928
+ {
929
+ "col": 5906,
930
+ "relative_change": 0.9448,
931
+ "cosine_new_old": 0.752
932
+ },
933
+ {
934
+ "col": 6013,
935
+ "relative_change": 0.7595,
936
+ "cosine_new_old": 0.8103
937
+ },
938
+ {
939
+ "col": 6275,
940
+ "relative_change": 0.6149,
941
+ "cosine_new_old": 0.8593
942
+ },
943
+ {
944
+ "col": 6359,
945
+ "relative_change": 1.368,
946
+ "cosine_new_old": 0.6479
947
+ },
948
+ {
949
+ "col": 7034,
950
+ "relative_change": 0.7529,
951
+ "cosine_new_old": 0.8125
952
+ },
953
+ {
954
+ "col": 7401,
955
+ "relative_change": 0.7396,
956
+ "cosine_new_old": 0.8169
957
+ },
958
+ {
959
+ "col": 7906,
960
+ "relative_change": 1.7923,
961
+ "cosine_new_old": 0.5818
962
+ },
963
+ {
964
+ "col": 8317,
965
+ "relative_change": 0.7482,
966
+ "cosine_new_old": 0.8141
967
+ },
968
+ {
969
+ "col": 8377,
970
+ "relative_change": 0.6601,
971
+ "cosine_new_old": 0.8438
972
+ },
973
+ {
974
+ "col": 8565,
975
+ "relative_change": 0.6079,
976
+ "cosine_new_old": 0.8617
977
+ },
978
+ {
979
+ "col": 8591,
980
+ "relative_change": 0.5076,
981
+ "cosine_new_old": 0.8957
982
+ },
983
+ {
984
+ "col": 8751,
985
+ "relative_change": 0.8861,
986
+ "cosine_new_old": 0.7697
987
+ },
988
+ {
989
+ "col": 8994,
990
+ "relative_change": 0.758,
991
+ "cosine_new_old": 0.8108
992
+ },
993
+ {
994
+ "col": 9715,
995
+ "relative_change": 0.8364,
996
+ "cosine_new_old": 0.7853
997
+ },
998
+ {
999
+ "col": 9914,
1000
+ "relative_change": 0.9489,
1001
+ "cosine_new_old": 0.7507
1002
+ },
1003
+ {
1004
+ "col": 9962,
1005
+ "relative_change": 0.7564,
1006
+ "cosine_new_old": 0.8113
1007
+ },
1008
+ {
1009
+ "col": 10309,
1010
+ "relative_change": 0.6899,
1011
+ "cosine_new_old": 0.8336
1012
+ },
1013
+ {
1014
+ "col": 10426,
1015
+ "relative_change": 0.689,
1016
+ "cosine_new_old": 0.834
1017
+ },
1018
+ {
1019
+ "col": 10513,
1020
+ "relative_change": 0.9476,
1021
+ "cosine_new_old": 0.7511
1022
+ },
1023
+ {
1024
+ "col": 10524,
1025
+ "relative_change": 1.0727,
1026
+ "cosine_new_old": 0.716
1027
+ },
1028
+ {
1029
+ "col": 10569,
1030
+ "relative_change": 0.6264,
1031
+ "cosine_new_old": 0.8553
1032
+ },
1033
+ {
1034
+ "col": 10727,
1035
+ "relative_change": 0.8272,
1036
+ "cosine_new_old": 0.7882
1037
+ }
1038
+ ],
1039
+ "rank1_share": 1.0
1040
+ }
1041
+ ]
manifest.json ADDED
@@ -0,0 +1,36 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "baseline_hash": "ed8fc966d402251d",
3
+ "entries_changed": 398328,
4
+ "fraction_changed": 0.00011893130509091243,
5
+ "direct_edit": true,
6
+ "edits": [
7
+ {
8
+ "edit_id": 176,
9
+ "name": "model.layers.20.mlp.down_proj.weight",
10
+ "entries_changed": 71446,
11
+ "evidence": "SafeTune circuits12/13 agree, exclusive-direction rank_writers selects columns; L24 activation amplification selective; sparse strength4 gave borderline48/160,harmful75/96,benign1/96. Amplify only harmful-orthogonal output component.",
12
+ "method": null
13
+ },
14
+ {
15
+ "edit_id": 177,
16
+ "name": "model.layers.22.mlp.down_proj.weight",
17
+ "entries_changed": 96007,
18
+ "evidence": "SafeTune circuits12/13 agree, exclusive-direction rank_writers selects columns; L24 activation amplification selective; sparse strength4 gave borderline48/160,harmful75/96,benign1/96. Amplify only harmful-orthogonal output component.",
19
+ "method": null
20
+ },
21
+ {
22
+ "edit_id": 178,
23
+ "name": "model.layers.23.mlp.down_proj.weight",
24
+ "entries_changed": 124582,
25
+ "evidence": "SafeTune circuits12/13 agree, exclusive-direction rank_writers selects columns; L24 activation amplification selective; sparse strength4 gave borderline48/160,harmful75/96,benign1/96. Amplify only harmful-orthogonal output component.",
26
+ "method": null
27
+ },
28
+ {
29
+ "edit_id": 179,
30
+ "name": "model.layers.24.mlp.down_proj.weight",
31
+ "entries_changed": 106293,
32
+ "evidence": "SafeTune circuits12/13 agree, exclusive-direction rank_writers selects columns; L24 activation amplification selective; sparse strength4 gave borderline48/160,harmful75/96,benign1/96. Amplify only harmful-orthogonal output component.",
33
+ "method": null
34
+ }
35
+ ]
36
+ }
patch.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d74b90ce34e83e8942418907ae93f900aa170162d54256d8c73a93ba965fffd6
3
+ size 360710600