napalm commited on
Commit
498c8f3
·
verified ·
1 Parent(s): 6d8e38a

Upload 2 files

Browse files
extracted/mossImageFinalcut5GB_universal_fp16-r64-comfy.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f9034fabbbe33051854a57ed2de7fd7cb46eb7fd6c7bcab55004acc4bc32046f
3
+ size 284741736
extracted/mossImageFinalcut5GB_universal_fp16-r64-comfy.safetensors.REPORT.txt ADDED
@@ -0,0 +1,269 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ==============================================================================
2
+ KREA2 LORA EXTRACTOR - STRUCTURE & DIFFERENCE REPORT
3
+ ==============================================================================
4
+ BASE : moss_image_sft_int8_convrot.safetensors (5.04 GB)
5
+ FINETUNE : mossImageFinalcut5GB_universal_fp16.safetensors (9.47 GB)
6
+ FORMAT : base=safetensors finetune=safetensors
7
+
8
+ ------------------------------------------------------------------------------
9
+ DIFFERENCES DETECTED (structure matching):
10
+ ------------------------------------------------------------------------------
11
+ tensors base=757 finetune=378 delta=-379
12
+ .weight tensors base=362 finetune=362
13
+ .weight_scale tensors base=168 finetune=0
14
+ .comfy_quant meta tensors base=168 finetune=0
15
+ quant descriptors base=168 finetune=0
16
+ metadata tags base=[] finetune=[]
17
+
18
+ detected finetune key prefix : (none - same root)
19
+ [both share the same root]
20
+
21
+ ------------------------------------------------------------------------------
22
+ PER-LAYER COMPATIBILITY (after prefix strip):
23
+ ------------------------------------------------------------------------------
24
+ common .weight keys : 362 / 362 (100.0%)
25
+ keys only in base : 0
26
+ keys only in finetune : 0
27
+ dtype mismatches : 362
28
+ shape mismatches : 0
29
+ bytes mismatches : 168
30
+
31
+ ------------------------------------------------------------------------------
32
+ PRECISION AUDIT - BASE:
33
+ ------------------------------------------------------------------------------
34
+ dtype counts : {'F32': 169, 'BF16': 210, 'I8': 168, 'U8': 210}
35
+ descriptors: 168
36
+ formats detected: int8_tensorwise=168
37
+ with full_precision_matrix_mult: 0
38
+ with convrot: 168
39
+ with per_row: 0
40
+ groupsize_distribution: {'256': 168}
41
+
42
+ ------------------------------------------------------------------------------
43
+ PRECISION AUDIT - FINETUNE:
44
+ ------------------------------------------------------------------------------
45
+ dtype counts : {'F16': 378}
46
+ descriptors: 0
47
+ formats detected: none
48
+ with full_precision_matrix_mult: 0
49
+ with convrot: 0
50
+ with per_row: 0
51
+
52
+ ------------------------------------------------------------------------------
53
+ EXTRACTION PARAMETERS:
54
+ ------------------------------------------------------------------------------
55
+ rank : 64
56
+ precision : bf16
57
+ format : comfy
58
+ key prefix : 'diffusion_model.'
59
+ device : cuda
60
+
61
+ ------------------------------------------------------------------------------
62
+ PER-LAYER PROGRESS (185 layers):
63
+ ------------------------------------------------------------------------------
64
+ [ 1/362] final_linear_video shape=(128, 3072) R= 64 energy= 65.8% relerr=0.584
65
+ [ 6/362] layers.0.proj.ffn_down shape=(3072, 8192) R= 64 energy= 39.9% relerr=0.775
66
+ [ 7/362] layers.0.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 66.9% relerr=0.575
67
+ [ 8/362] layers.0.proj.o shape=(3072, 3072) R= 64 energy= 74.4% relerr=0.506
68
+ [ 9/362] layers.0.proj.qkv shape=(9216, 3072) R= 64 energy= 72.9% relerr=0.521
69
+ [ 14/362] layers.1.proj.ffn_down shape=(3072, 8192) R= 64 energy= 45.2% relerr=0.740
70
+ [ 15/362] layers.1.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 67.2% relerr=0.573
71
+ [ 16/362] layers.1.proj.o shape=(3072, 3072) R= 64 energy= 55.7% relerr=0.666
72
+ [ 17/362] layers.1.proj.qkv shape=(9216, 3072) R= 64 energy= 67.6% relerr=0.569
73
+ [ 22/362] layers.10.proj.ffn_down shape=(3072, 8192) R= 64 energy= 33.2% relerr=0.817
74
+ [ 23/362] layers.10.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 44.2% relerr=0.747
75
+ [ 24/362] layers.10.proj.o shape=(3072, 3072) R= 64 energy= 51.5% relerr=0.696
76
+ [ 25/362] layers.10.proj.qkv shape=(9216, 3072) R= 64 energy= 68.8% relerr=0.559
77
+ [ 30/362] layers.11.proj.ffn_down shape=(3072, 8192) R= 64 energy= 32.8% relerr=0.820
78
+ [ 31/362] layers.11.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 49.6% relerr=0.710
79
+ [ 32/362] layers.11.proj.o shape=(3072, 3072) R= 64 energy= 49.7% relerr=0.710
80
+ [ 33/362] layers.11.proj.qkv shape=(9216, 3072) R= 64 energy= 67.8% relerr=0.568
81
+ [ 38/362] layers.12.proj.ffn_down shape=(3072, 8192) R= 64 energy= 42.6% relerr=0.758
82
+ [ 39/362] layers.12.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 49.3% relerr=0.712
83
+ [ 40/362] layers.12.proj.o shape=(3072, 3072) R= 64 energy= 50.7% relerr=0.702
84
+ [ 41/362] layers.12.proj.qkv shape=(9216, 3072) R= 64 energy= 61.8% relerr=0.618
85
+ [ 46/362] layers.13.proj.ffn_down shape=(3072, 8192) R= 64 energy= 33.1% relerr=0.818
86
+ [ 47/362] layers.13.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 47.8% relerr=0.722
87
+ [ 48/362] layers.13.proj.o shape=(3072, 3072) R= 64 energy= 50.1% relerr=0.706
88
+ [ 49/362] layers.13.proj.qkv shape=(9216, 3072) R= 64 energy= 62.1% relerr=0.616
89
+ [ 54/362] layers.14.proj.ffn_down shape=(3072, 8192) R= 64 energy= 33.4% relerr=0.816
90
+ [ 55/362] layers.14.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 43.4% relerr=0.752
91
+ [ 56/362] layers.14.proj.o shape=(3072, 3072) R= 64 energy= 52.9% relerr=0.686
92
+ [ 57/362] layers.14.proj.qkv shape=(9216, 3072) R= 64 energy= 60.1% relerr=0.632
93
+ [ 62/362] layers.15.proj.ffn_down shape=(3072, 8192) R= 64 energy= 32.8% relerr=0.820
94
+ [ 63/362] layers.15.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 46.2% relerr=0.733
95
+ [ 64/362] layers.15.proj.o shape=(3072, 3072) R= 64 energy= 51.1% relerr=0.699
96
+ [ 65/362] layers.15.proj.qkv shape=(9216, 3072) R= 64 energy= 62.7% relerr=0.611
97
+ [ 70/362] layers.16.proj.ffn_down shape=(3072, 8192) R= 64 energy= 33.1% relerr=0.818
98
+ [ 71/362] layers.16.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 48.3% relerr=0.719
99
+ [ 72/362] layers.16.proj.o shape=(3072, 3072) R= 64 energy= 51.0% relerr=0.700
100
+ [ 73/362] layers.16.proj.qkv shape=(9216, 3072) R= 64 energy= 71.0% relerr=0.539
101
+ [ 78/362] layers.17.proj.ffn_down shape=(3072, 8192) R= 64 energy= 32.3% relerr=0.823
102
+ [ 79/362] layers.17.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 50.4% relerr=0.704
103
+ [ 80/362] layers.17.proj.o shape=(3072, 3072) R= 64 energy= 53.0% relerr=0.686
104
+ [ 81/362] layers.17.proj.qkv shape=(9216, 3072) R= 64 energy= 64.2% relerr=0.598
105
+ [ 86/362] layers.18.proj.ffn_down shape=(3072, 8192) R= 64 energy= 38.4% relerr=0.785
106
+ [ 87/362] layers.18.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 52.4% relerr=0.690
107
+ [ 88/362] layers.18.proj.o shape=(3072, 3072) R= 64 energy= 55.1% relerr=0.670
108
+ [ 89/362] layers.18.proj.qkv shape=(9216, 3072) R= 64 energy= 67.9% relerr=0.567
109
+ [ 94/362] layers.19.proj.ffn_down shape=(3072, 8192) R= 64 energy= 36.6% relerr=0.797
110
+ [ 95/362] layers.19.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 51.1% relerr=0.699
111
+ [ 96/362] layers.19.proj.o shape=(3072, 3072) R= 64 energy= 60.3% relerr=0.630
112
+ [ 97/362] layers.19.proj.qkv shape=(9216, 3072) R= 64 energy= 67.3% relerr=0.572
113
+ [102/362] layers.2.proj.ffn_down shape=(3072, 8192) R= 64 energy= 49.3% relerr=0.712
114
+ [103/362] layers.2.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 66.7% relerr=0.577
115
+ [104/362] layers.2.proj.o shape=(3072, 3072) R= 64 energy= 55.6% relerr=0.666
116
+ [105/362] layers.2.proj.qkv shape=(9216, 3072) R= 64 energy= 63.8% relerr=0.602
117
+ [110/362] layers.20.proj.ffn_down shape=(3072, 8192) R= 64 energy= 37.2% relerr=0.792
118
+ [111/362] layers.20.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 52.5% relerr=0.689
119
+ [112/362] layers.20.proj.o shape=(3072, 3072) R= 64 energy= 49.8% relerr=0.708
120
+ [113/362] layers.20.proj.qkv shape=(9216, 3072) R= 64 energy= 67.3% relerr=0.572
121
+ [118/362] layers.21.proj.ffn_down shape=(3072, 8192) R= 64 energy= 34.9% relerr=0.807
122
+ [119/362] layers.21.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 50.9% relerr=0.701
123
+ [120/362] layers.21.proj.o shape=(3072, 3072) R= 64 energy= 59.7% relerr=0.635
124
+ [121/362] layers.21.proj.qkv shape=(9216, 3072) R= 64 energy= 66.2% relerr=0.581
125
+ [126/362] layers.22.proj.ffn_down shape=(3072, 8192) R= 64 energy= 12.3% relerr=0.936
126
+ [127/362] layers.22.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 22.9% relerr=0.878
127
+ [128/362] layers.22.proj.o shape=(3072, 3072) R= 64 energy= 25.2% relerr=0.865
128
+ [129/362] layers.22.proj.qkv shape=(9216, 3072) R= 64 energy= 29.3% relerr=0.841
129
+ [134/362] layers.23.proj.ffn_down shape=(3072, 8192) R= 64 energy= 36.6% relerr=0.797
130
+ [135/362] layers.23.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 53.3% relerr=0.684
131
+ [136/362] layers.23.proj.o shape=(3072, 3072) R= 64 energy= 51.0% relerr=0.700
132
+ [137/362] layers.23.proj.qkv shape=(9216, 3072) R= 64 energy= 55.4% relerr=0.668
133
+ [142/362] layers.24.proj.ffn_down shape=(3072, 8192) R= 64 energy= 35.6% relerr=0.803
134
+ [143/362] layers.24.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 51.5% relerr=0.696
135
+ [144/362] layers.24.proj.o shape=(3072, 3072) R= 64 energy= 45.0% relerr=0.741
136
+ [145/362] layers.24.proj.qkv shape=(9216, 3072) R= 64 energy= 54.3% relerr=0.676
137
+ [150/362] layers.25.proj.ffn_down shape=(3072, 8192) R= 64 energy= 35.8% relerr=0.802
138
+ [151/362] layers.25.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 57.8% relerr=0.650
139
+ [152/362] layers.25.proj.o shape=(3072, 3072) R= 64 energy= 41.4% relerr=0.765
140
+ [153/362] layers.25.proj.qkv shape=(9216, 3072) R= 64 energy= 46.7% relerr=0.730
141
+ [158/362] layers.26.proj.ffn_down shape=(3072, 8192) R= 64 energy= 32.0% relerr=0.824
142
+ [159/362] layers.26.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 60.6% relerr=0.627
143
+ [160/362] layers.26.proj.o shape=(3072, 3072) R= 64 energy= 45.2% relerr=0.740
144
+ [161/362] layers.26.proj.qkv shape=(9216, 3072) R= 64 energy= 48.8% relerr=0.716
145
+ [166/362] layers.27.proj.ffn_down shape=(3072, 8192) R= 64 energy= 34.7% relerr=0.808
146
+ [167/362] layers.27.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 67.5% relerr=0.570
147
+ [168/362] layers.27.proj.o shape=(3072, 3072) R= 64 energy= 41.1% relerr=0.767
148
+ [169/362] layers.27.proj.qkv shape=(9216, 3072) R= 64 energy= 40.4% relerr=0.772
149
+ [174/362] layers.28.proj.ffn_down shape=(3072, 8192) R= 64 energy= 39.5% relerr=0.778
150
+ [175/362] layers.28.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 66.6% relerr=0.578
151
+ [176/362] layers.28.proj.o shape=(3072, 3072) R= 64 energy= 42.5% relerr=0.759
152
+ [177/362] layers.28.proj.qkv shape=(9216, 3072) R= 64 energy= 41.0% relerr=0.768
153
+ [182/362] layers.29.proj.ffn_down shape=(3072, 8192) R= 64 energy= 31.6% relerr=0.827
154
+ [183/362] layers.29.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 64.9% relerr=0.593
155
+ [184/362] layers.29.proj.o shape=(3072, 3072) R= 64 energy= 41.4% relerr=0.766
156
+ [185/362] layers.29.proj.qkv shape=(9216, 3072) R= 64 energy= 37.2% relerr=0.792
157
+ [190/362] layers.3.proj.ffn_down shape=(3072, 8192) R= 64 energy= 54.5% relerr=0.674
158
+ [191/362] layers.3.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 65.6% relerr=0.587
159
+ [192/362] layers.3.proj.o shape=(3072, 3072) R= 64 energy= 56.2% relerr=0.662
160
+ [193/362] layers.3.proj.qkv shape=(9216, 3072) R= 64 energy= 67.5% relerr=0.570
161
+ [198/362] layers.30.proj.ffn_down shape=(3072, 8192) R= 64 energy= 27.3% relerr=0.853
162
+ [199/362] layers.30.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 56.6% relerr=0.659
163
+ [200/362] layers.30.proj.o shape=(3072, 3072) R= 64 energy= 39.0% relerr=0.781
164
+ [201/362] layers.30.proj.qkv shape=(9216, 3072) R= 64 energy= 38.5% relerr=0.784
165
+ [206/362] layers.31.proj.ffn_down shape=(3072, 8192) R= 64 energy= 21.5% relerr=0.886
166
+ [207/362] layers.31.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 55.4% relerr=0.668
167
+ [208/362] layers.31.proj.o shape=(3072, 3072) R= 64 energy= 35.2% relerr=0.805
168
+ [209/362] layers.31.proj.qkv shape=(9216, 3072) R= 64 energy= 34.6% relerr=0.809
169
+ [214/362] layers.32.proj.ffn_down shape=(3072, 8192) R= 64 energy= 18.7% relerr=0.902
170
+ [215/362] layers.32.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 44.7% relerr=0.744
171
+ [216/362] layers.32.proj.o shape=(3072, 3072) R= 64 energy= 34.9% relerr=0.807
172
+ [217/362] layers.32.proj.qkv shape=(9216, 3072) R= 64 energy= 34.6% relerr=0.809
173
+ [222/362] layers.33.proj.ffn_down shape=(3072, 8192) R= 64 energy= 15.6% relerr=0.919
174
+ [223/362] layers.33.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 43.9% relerr=0.749
175
+ [224/362] layers.33.proj.o shape=(3072, 3072) R= 64 energy= 31.8% relerr=0.826
176
+ [225/362] layers.33.proj.qkv shape=(9216, 3072) R= 64 energy= 35.0% relerr=0.806
177
+ [230/362] layers.34.proj.ffn_down shape=(3072, 8192) R= 64 energy= 13.7% relerr=0.929
178
+ [231/362] layers.34.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 34.4% relerr=0.810
179
+ [232/362] layers.34.proj.o shape=(3072, 3072) R= 64 energy= 25.7% relerr=0.862
180
+ [233/362] layers.34.proj.qkv shape=(9216, 3072) R= 64 energy= 34.1% relerr=0.812
181
+ [238/362] layers.35.proj.ffn_down shape=(3072, 8192) R= 64 energy= 10.8% relerr=0.944
182
+ [239/362] layers.35.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 26.9% relerr=0.855
183
+ [240/362] layers.35.proj.o shape=(3072, 3072) R= 64 energy= 22.8% relerr=0.879
184
+ [241/362] layers.35.proj.qkv shape=(9216, 3072) R= 64 energy= 28.6% relerr=0.845
185
+ [246/362] layers.36.proj.ffn_down shape=(3072, 8192) R= 64 energy= 9.1% relerr=0.953
186
+ [247/362] layers.36.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 24.9% relerr=0.867
187
+ [248/362] layers.36.proj.o shape=(3072, 3072) R= 64 energy= 18.9% relerr=0.901
188
+ [249/362] layers.36.proj.qkv shape=(9216, 3072) R= 64 energy= 27.2% relerr=0.853
189
+ [254/362] layers.37.proj.ffn_down shape=(3072, 8192) R= 64 energy= 8.0% relerr=0.959
190
+ [255/362] layers.37.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 22.3% relerr=0.881
191
+ [256/362] layers.37.proj.o shape=(3072, 3072) R= 64 energy= 17.5% relerr=0.908
192
+ [257/362] layers.37.proj.qkv shape=(9216, 3072) R= 64 energy= 23.3% relerr=0.876
193
+ [262/362] layers.38.proj.ffn_down shape=(3072, 8192) R= 64 energy= 7.8% relerr=0.960
194
+ [263/362] layers.38.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 23.0% relerr=0.877
195
+ [264/362] layers.38.proj.o shape=(3072, 3072) R= 64 energy= 15.5% relerr=0.919
196
+ [265/362] layers.38.proj.qkv shape=(9216, 3072) R= 64 energy= 21.2% relerr=0.888
197
+ [270/362] layers.39.proj.ffn_down shape=(3072, 8192) R= 64 energy= 7.5% relerr=0.962
198
+ [271/362] layers.39.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 25.0% relerr=0.866
199
+ [272/362] layers.39.proj.o shape=(3072, 3072) R= 64 energy= 13.4% relerr=0.931
200
+ [273/362] layers.39.proj.qkv shape=(9216, 3072) R= 64 energy= 19.4% relerr=0.898
201
+ [278/362] layers.4.proj.ffn_down shape=(3072, 8192) R= 64 energy= 50.3% relerr=0.705
202
+ [279/362] layers.4.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 66.5% relerr=0.578
203
+ [280/362] layers.4.proj.o shape=(3072, 3072) R= 64 energy= 53.5% relerr=0.682
204
+ [281/362] layers.4.proj.qkv shape=(9216, 3072) R= 64 energy= 65.0% relerr=0.591
205
+ [286/362] layers.40.proj.ffn_down shape=(3072, 8192) R= 64 energy= 7.6% relerr=0.961
206
+ [287/362] layers.40.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 29.2% relerr=0.841
207
+ [288/362] layers.40.proj.o shape=(3072, 3072) R= 64 energy= 13.3% relerr=0.931
208
+ [289/362] layers.40.proj.qkv shape=(9216, 3072) R= 64 energy= 19.8% relerr=0.895
209
+ [294/362] layers.41.proj.ffn_down shape=(3072, 8192) R= 64 energy= 14.9% relerr=0.923
210
+ [295/362] layers.41.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 28.9% relerr=0.843
211
+ [296/362] layers.41.proj.o shape=(3072, 3072) R= 64 energy= 12.8% relerr=0.934
212
+ [297/362] layers.41.proj.qkv shape=(9216, 3072) R= 64 energy= 15.4% relerr=0.920
213
+ [302/362] layers.5.proj.ffn_down shape=(3072, 8192) R= 64 energy= 47.3% relerr=0.726
214
+ [303/362] layers.5.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 51.6% relerr=0.696
215
+ [304/362] layers.5.proj.o shape=(3072, 3072) R= 64 energy= 57.2% relerr=0.654
216
+ [305/362] layers.5.proj.qkv shape=(9216, 3072) R= 64 energy= 65.5% relerr=0.588
217
+ [310/362] layers.6.proj.ffn_down shape=(3072, 8192) R= 64 energy= 37.2% relerr=0.793
218
+ [311/362] layers.6.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 50.9% relerr=0.701
219
+ [312/362] layers.6.proj.o shape=(3072, 3072) R= 64 energy= 52.9% relerr=0.686
220
+ [313/362] layers.6.proj.qkv shape=(9216, 3072) R= 64 energy= 65.4% relerr=0.588
221
+ [318/362] layers.7.proj.ffn_down shape=(3072, 8192) R= 64 energy= 38.3% relerr=0.786
222
+ [319/362] layers.7.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 48.9% relerr=0.715
223
+ [320/362] layers.7.proj.o shape=(3072, 3072) R= 64 energy= 59.2% relerr=0.638
224
+ [321/362] layers.7.proj.qkv shape=(9216, 3072) R= 64 energy= 68.5% relerr=0.561
225
+ [326/362] layers.8.proj.ffn_down shape=(3072, 8192) R= 64 energy= 33.6% relerr=0.815
226
+ [327/362] layers.8.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 47.3% relerr=0.726
227
+ [328/362] layers.8.proj.o shape=(3072, 3072) R= 64 energy= 54.9% relerr=0.671
228
+ [329/362] layers.8.proj.qkv shape=(9216, 3072) R= 64 energy= 66.9% relerr=0.575
229
+ [334/362] layers.9.proj.ffn_down shape=(3072, 8192) R= 64 energy= 34.5% relerr=0.809
230
+ [335/362] layers.9.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 45.4% relerr=0.739
231
+ [336/362] layers.9.proj.o shape=(3072, 3072) R= 64 energy= 54.4% relerr=0.675
232
+ [337/362] layers.9.proj.qkv shape=(9216, 3072) R= 64 energy= 70.6% relerr=0.542
233
+ [339/362] shared_block_modulation shape=(18432, 3072) R= 64 energy= 38.1% relerr=0.787
234
+ [340/362] text_embedder.blocks.0.ffn_down shape=(3072, 8192) R= 64 energy= 6.2% relerr=0.969
235
+ [341/362] text_embedder.blocks.0.ffn_gate shape=(8192, 3072) R= 64 energy= 6.0% relerr=0.970
236
+ [342/362] text_embedder.blocks.0.ffn_up shape=(8192, 3072) R= 64 energy= 5.9% relerr=0.970
237
+ [346/362] text_embedder.blocks.0.proj shape=(3072, 3072) R= 64 energy= 9.7% relerr=0.950
238
+ [348/362] text_embedder.blocks.0.qkv shape=(9216, 3072) R= 64 energy= 8.2% relerr=0.958
239
+ [349/362] text_embedder.blocks.1.ffn_down shape=(3072, 8192) R= 64 energy= 5.6% relerr=0.972
240
+ [350/362] text_embedder.blocks.1.ffn_gate shape=(8192, 3072) R= 64 energy= 5.6% relerr=0.972
241
+ [351/362] text_embedder.blocks.1.ffn_up shape=(8192, 3072) R= 64 energy= 5.6% relerr=0.972
242
+ [355/362] text_embedder.blocks.1.proj shape=(3072, 3072) R= 64 energy= 9.3% relerr=0.953
243
+ [357/362] text_embedder.blocks.1.qkv shape=(9216, 3072) R= 64 energy= 7.4% relerr=0.962
244
+ [358/362] text_embedder.proj shape=(3072, 4096) R= 64 energy= 9.4% relerr=0.952
245
+ [359/362] time_embedding.0 shape=(3072, 256) R= 64 energy= 89.0% relerr=0.332
246
+ [360/362] time_embedding.2 shape=(3072, 3072) R= 64 energy= 93.4% relerr=0.256
247
+ [361/362] video_embedder shape=(3072, 128) R= 64 energy= 77.9% relerr=0.470
248
+ [362/362] video_head_modulation shape=(6144, 3072) R= 64 energy= 68.0% relerr=0.565
249
+
250
+ ------------------------------------------------------------------------------
251
+ EXTRACTION RESULT:
252
+ ------------------------------------------------------------------------------
253
+ layers extracted : 185
254
+ bias diffs : 16
255
+ layers skipped : 177
256
+ skipped: final_norm_video.weight (shape-mismatch), layers.0.k_norm.weight (shape-mismatch), layers.0.norm1.weight (shape-mismatch), layers.0.norm2.weight (shape-mismatch), layers.0.q_norm.weight (shape-mismatch), layers.1.k_norm.weight (shape-mismatch), layers.1.norm1.weight (shape-mismatch), layers.1.norm2.weight (shape-mismatch)
257
+ layers unsupported: 0
258
+ avg energy captured @ rank 64 : 42.02%
259
+ min / median / max energy : 5.57% / 43.93% / 93.43%
260
+ elapsed : 544.00 s
261
+
262
+ ------------------------------------------------------------------------------
263
+ OUTPUT:
264
+ ------------------------------------------------------------------------------
265
+ path : e:\python_scripts\2026\comfyui_lora_extractor_max\mossImageFinalcut5GB_universal_fp16-r64-comfy.safetensors
266
+ size : 271.55 MB
267
+ tensors : 386
268
+ STATUS : OK - LoRA saved successfully
269
+ ==============================================================================