Upload 2 files
Browse files
extracted/mossImageFinalcut5GB_universal_fp16-r64-comfy.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f9034fabbbe33051854a57ed2de7fd7cb46eb7fd6c7bcab55004acc4bc32046f
|
| 3 |
+
size 284741736
|
extracted/mossImageFinalcut5GB_universal_fp16-r64-comfy.safetensors.REPORT.txt
ADDED
|
@@ -0,0 +1,269 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
==============================================================================
|
| 2 |
+
KREA2 LORA EXTRACTOR - STRUCTURE & DIFFERENCE REPORT
|
| 3 |
+
==============================================================================
|
| 4 |
+
BASE : moss_image_sft_int8_convrot.safetensors (5.04 GB)
|
| 5 |
+
FINETUNE : mossImageFinalcut5GB_universal_fp16.safetensors (9.47 GB)
|
| 6 |
+
FORMAT : base=safetensors finetune=safetensors
|
| 7 |
+
|
| 8 |
+
------------------------------------------------------------------------------
|
| 9 |
+
DIFFERENCES DETECTED (structure matching):
|
| 10 |
+
------------------------------------------------------------------------------
|
| 11 |
+
tensors base=757 finetune=378 delta=-379
|
| 12 |
+
.weight tensors base=362 finetune=362
|
| 13 |
+
.weight_scale tensors base=168 finetune=0
|
| 14 |
+
.comfy_quant meta tensors base=168 finetune=0
|
| 15 |
+
quant descriptors base=168 finetune=0
|
| 16 |
+
metadata tags base=[] finetune=[]
|
| 17 |
+
|
| 18 |
+
detected finetune key prefix : (none - same root)
|
| 19 |
+
[both share the same root]
|
| 20 |
+
|
| 21 |
+
------------------------------------------------------------------------------
|
| 22 |
+
PER-LAYER COMPATIBILITY (after prefix strip):
|
| 23 |
+
------------------------------------------------------------------------------
|
| 24 |
+
common .weight keys : 362 / 362 (100.0%)
|
| 25 |
+
keys only in base : 0
|
| 26 |
+
keys only in finetune : 0
|
| 27 |
+
dtype mismatches : 362
|
| 28 |
+
shape mismatches : 0
|
| 29 |
+
bytes mismatches : 168
|
| 30 |
+
|
| 31 |
+
------------------------------------------------------------------------------
|
| 32 |
+
PRECISION AUDIT - BASE:
|
| 33 |
+
------------------------------------------------------------------------------
|
| 34 |
+
dtype counts : {'F32': 169, 'BF16': 210, 'I8': 168, 'U8': 210}
|
| 35 |
+
descriptors: 168
|
| 36 |
+
formats detected: int8_tensorwise=168
|
| 37 |
+
with full_precision_matrix_mult: 0
|
| 38 |
+
with convrot: 168
|
| 39 |
+
with per_row: 0
|
| 40 |
+
groupsize_distribution: {'256': 168}
|
| 41 |
+
|
| 42 |
+
------------------------------------------------------------------------------
|
| 43 |
+
PRECISION AUDIT - FINETUNE:
|
| 44 |
+
------------------------------------------------------------------------------
|
| 45 |
+
dtype counts : {'F16': 378}
|
| 46 |
+
descriptors: 0
|
| 47 |
+
formats detected: none
|
| 48 |
+
with full_precision_matrix_mult: 0
|
| 49 |
+
with convrot: 0
|
| 50 |
+
with per_row: 0
|
| 51 |
+
|
| 52 |
+
------------------------------------------------------------------------------
|
| 53 |
+
EXTRACTION PARAMETERS:
|
| 54 |
+
------------------------------------------------------------------------------
|
| 55 |
+
rank : 64
|
| 56 |
+
precision : bf16
|
| 57 |
+
format : comfy
|
| 58 |
+
key prefix : 'diffusion_model.'
|
| 59 |
+
device : cuda
|
| 60 |
+
|
| 61 |
+
------------------------------------------------------------------------------
|
| 62 |
+
PER-LAYER PROGRESS (185 layers):
|
| 63 |
+
------------------------------------------------------------------------------
|
| 64 |
+
[ 1/362] final_linear_video shape=(128, 3072) R= 64 energy= 65.8% relerr=0.584
|
| 65 |
+
[ 6/362] layers.0.proj.ffn_down shape=(3072, 8192) R= 64 energy= 39.9% relerr=0.775
|
| 66 |
+
[ 7/362] layers.0.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 66.9% relerr=0.575
|
| 67 |
+
[ 8/362] layers.0.proj.o shape=(3072, 3072) R= 64 energy= 74.4% relerr=0.506
|
| 68 |
+
[ 9/362] layers.0.proj.qkv shape=(9216, 3072) R= 64 energy= 72.9% relerr=0.521
|
| 69 |
+
[ 14/362] layers.1.proj.ffn_down shape=(3072, 8192) R= 64 energy= 45.2% relerr=0.740
|
| 70 |
+
[ 15/362] layers.1.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 67.2% relerr=0.573
|
| 71 |
+
[ 16/362] layers.1.proj.o shape=(3072, 3072) R= 64 energy= 55.7% relerr=0.666
|
| 72 |
+
[ 17/362] layers.1.proj.qkv shape=(9216, 3072) R= 64 energy= 67.6% relerr=0.569
|
| 73 |
+
[ 22/362] layers.10.proj.ffn_down shape=(3072, 8192) R= 64 energy= 33.2% relerr=0.817
|
| 74 |
+
[ 23/362] layers.10.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 44.2% relerr=0.747
|
| 75 |
+
[ 24/362] layers.10.proj.o shape=(3072, 3072) R= 64 energy= 51.5% relerr=0.696
|
| 76 |
+
[ 25/362] layers.10.proj.qkv shape=(9216, 3072) R= 64 energy= 68.8% relerr=0.559
|
| 77 |
+
[ 30/362] layers.11.proj.ffn_down shape=(3072, 8192) R= 64 energy= 32.8% relerr=0.820
|
| 78 |
+
[ 31/362] layers.11.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 49.6% relerr=0.710
|
| 79 |
+
[ 32/362] layers.11.proj.o shape=(3072, 3072) R= 64 energy= 49.7% relerr=0.710
|
| 80 |
+
[ 33/362] layers.11.proj.qkv shape=(9216, 3072) R= 64 energy= 67.8% relerr=0.568
|
| 81 |
+
[ 38/362] layers.12.proj.ffn_down shape=(3072, 8192) R= 64 energy= 42.6% relerr=0.758
|
| 82 |
+
[ 39/362] layers.12.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 49.3% relerr=0.712
|
| 83 |
+
[ 40/362] layers.12.proj.o shape=(3072, 3072) R= 64 energy= 50.7% relerr=0.702
|
| 84 |
+
[ 41/362] layers.12.proj.qkv shape=(9216, 3072) R= 64 energy= 61.8% relerr=0.618
|
| 85 |
+
[ 46/362] layers.13.proj.ffn_down shape=(3072, 8192) R= 64 energy= 33.1% relerr=0.818
|
| 86 |
+
[ 47/362] layers.13.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 47.8% relerr=0.722
|
| 87 |
+
[ 48/362] layers.13.proj.o shape=(3072, 3072) R= 64 energy= 50.1% relerr=0.706
|
| 88 |
+
[ 49/362] layers.13.proj.qkv shape=(9216, 3072) R= 64 energy= 62.1% relerr=0.616
|
| 89 |
+
[ 54/362] layers.14.proj.ffn_down shape=(3072, 8192) R= 64 energy= 33.4% relerr=0.816
|
| 90 |
+
[ 55/362] layers.14.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 43.4% relerr=0.752
|
| 91 |
+
[ 56/362] layers.14.proj.o shape=(3072, 3072) R= 64 energy= 52.9% relerr=0.686
|
| 92 |
+
[ 57/362] layers.14.proj.qkv shape=(9216, 3072) R= 64 energy= 60.1% relerr=0.632
|
| 93 |
+
[ 62/362] layers.15.proj.ffn_down shape=(3072, 8192) R= 64 energy= 32.8% relerr=0.820
|
| 94 |
+
[ 63/362] layers.15.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 46.2% relerr=0.733
|
| 95 |
+
[ 64/362] layers.15.proj.o shape=(3072, 3072) R= 64 energy= 51.1% relerr=0.699
|
| 96 |
+
[ 65/362] layers.15.proj.qkv shape=(9216, 3072) R= 64 energy= 62.7% relerr=0.611
|
| 97 |
+
[ 70/362] layers.16.proj.ffn_down shape=(3072, 8192) R= 64 energy= 33.1% relerr=0.818
|
| 98 |
+
[ 71/362] layers.16.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 48.3% relerr=0.719
|
| 99 |
+
[ 72/362] layers.16.proj.o shape=(3072, 3072) R= 64 energy= 51.0% relerr=0.700
|
| 100 |
+
[ 73/362] layers.16.proj.qkv shape=(9216, 3072) R= 64 energy= 71.0% relerr=0.539
|
| 101 |
+
[ 78/362] layers.17.proj.ffn_down shape=(3072, 8192) R= 64 energy= 32.3% relerr=0.823
|
| 102 |
+
[ 79/362] layers.17.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 50.4% relerr=0.704
|
| 103 |
+
[ 80/362] layers.17.proj.o shape=(3072, 3072) R= 64 energy= 53.0% relerr=0.686
|
| 104 |
+
[ 81/362] layers.17.proj.qkv shape=(9216, 3072) R= 64 energy= 64.2% relerr=0.598
|
| 105 |
+
[ 86/362] layers.18.proj.ffn_down shape=(3072, 8192) R= 64 energy= 38.4% relerr=0.785
|
| 106 |
+
[ 87/362] layers.18.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 52.4% relerr=0.690
|
| 107 |
+
[ 88/362] layers.18.proj.o shape=(3072, 3072) R= 64 energy= 55.1% relerr=0.670
|
| 108 |
+
[ 89/362] layers.18.proj.qkv shape=(9216, 3072) R= 64 energy= 67.9% relerr=0.567
|
| 109 |
+
[ 94/362] layers.19.proj.ffn_down shape=(3072, 8192) R= 64 energy= 36.6% relerr=0.797
|
| 110 |
+
[ 95/362] layers.19.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 51.1% relerr=0.699
|
| 111 |
+
[ 96/362] layers.19.proj.o shape=(3072, 3072) R= 64 energy= 60.3% relerr=0.630
|
| 112 |
+
[ 97/362] layers.19.proj.qkv shape=(9216, 3072) R= 64 energy= 67.3% relerr=0.572
|
| 113 |
+
[102/362] layers.2.proj.ffn_down shape=(3072, 8192) R= 64 energy= 49.3% relerr=0.712
|
| 114 |
+
[103/362] layers.2.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 66.7% relerr=0.577
|
| 115 |
+
[104/362] layers.2.proj.o shape=(3072, 3072) R= 64 energy= 55.6% relerr=0.666
|
| 116 |
+
[105/362] layers.2.proj.qkv shape=(9216, 3072) R= 64 energy= 63.8% relerr=0.602
|
| 117 |
+
[110/362] layers.20.proj.ffn_down shape=(3072, 8192) R= 64 energy= 37.2% relerr=0.792
|
| 118 |
+
[111/362] layers.20.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 52.5% relerr=0.689
|
| 119 |
+
[112/362] layers.20.proj.o shape=(3072, 3072) R= 64 energy= 49.8% relerr=0.708
|
| 120 |
+
[113/362] layers.20.proj.qkv shape=(9216, 3072) R= 64 energy= 67.3% relerr=0.572
|
| 121 |
+
[118/362] layers.21.proj.ffn_down shape=(3072, 8192) R= 64 energy= 34.9% relerr=0.807
|
| 122 |
+
[119/362] layers.21.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 50.9% relerr=0.701
|
| 123 |
+
[120/362] layers.21.proj.o shape=(3072, 3072) R= 64 energy= 59.7% relerr=0.635
|
| 124 |
+
[121/362] layers.21.proj.qkv shape=(9216, 3072) R= 64 energy= 66.2% relerr=0.581
|
| 125 |
+
[126/362] layers.22.proj.ffn_down shape=(3072, 8192) R= 64 energy= 12.3% relerr=0.936
|
| 126 |
+
[127/362] layers.22.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 22.9% relerr=0.878
|
| 127 |
+
[128/362] layers.22.proj.o shape=(3072, 3072) R= 64 energy= 25.2% relerr=0.865
|
| 128 |
+
[129/362] layers.22.proj.qkv shape=(9216, 3072) R= 64 energy= 29.3% relerr=0.841
|
| 129 |
+
[134/362] layers.23.proj.ffn_down shape=(3072, 8192) R= 64 energy= 36.6% relerr=0.797
|
| 130 |
+
[135/362] layers.23.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 53.3% relerr=0.684
|
| 131 |
+
[136/362] layers.23.proj.o shape=(3072, 3072) R= 64 energy= 51.0% relerr=0.700
|
| 132 |
+
[137/362] layers.23.proj.qkv shape=(9216, 3072) R= 64 energy= 55.4% relerr=0.668
|
| 133 |
+
[142/362] layers.24.proj.ffn_down shape=(3072, 8192) R= 64 energy= 35.6% relerr=0.803
|
| 134 |
+
[143/362] layers.24.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 51.5% relerr=0.696
|
| 135 |
+
[144/362] layers.24.proj.o shape=(3072, 3072) R= 64 energy= 45.0% relerr=0.741
|
| 136 |
+
[145/362] layers.24.proj.qkv shape=(9216, 3072) R= 64 energy= 54.3% relerr=0.676
|
| 137 |
+
[150/362] layers.25.proj.ffn_down shape=(3072, 8192) R= 64 energy= 35.8% relerr=0.802
|
| 138 |
+
[151/362] layers.25.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 57.8% relerr=0.650
|
| 139 |
+
[152/362] layers.25.proj.o shape=(3072, 3072) R= 64 energy= 41.4% relerr=0.765
|
| 140 |
+
[153/362] layers.25.proj.qkv shape=(9216, 3072) R= 64 energy= 46.7% relerr=0.730
|
| 141 |
+
[158/362] layers.26.proj.ffn_down shape=(3072, 8192) R= 64 energy= 32.0% relerr=0.824
|
| 142 |
+
[159/362] layers.26.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 60.6% relerr=0.627
|
| 143 |
+
[160/362] layers.26.proj.o shape=(3072, 3072) R= 64 energy= 45.2% relerr=0.740
|
| 144 |
+
[161/362] layers.26.proj.qkv shape=(9216, 3072) R= 64 energy= 48.8% relerr=0.716
|
| 145 |
+
[166/362] layers.27.proj.ffn_down shape=(3072, 8192) R= 64 energy= 34.7% relerr=0.808
|
| 146 |
+
[167/362] layers.27.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 67.5% relerr=0.570
|
| 147 |
+
[168/362] layers.27.proj.o shape=(3072, 3072) R= 64 energy= 41.1% relerr=0.767
|
| 148 |
+
[169/362] layers.27.proj.qkv shape=(9216, 3072) R= 64 energy= 40.4% relerr=0.772
|
| 149 |
+
[174/362] layers.28.proj.ffn_down shape=(3072, 8192) R= 64 energy= 39.5% relerr=0.778
|
| 150 |
+
[175/362] layers.28.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 66.6% relerr=0.578
|
| 151 |
+
[176/362] layers.28.proj.o shape=(3072, 3072) R= 64 energy= 42.5% relerr=0.759
|
| 152 |
+
[177/362] layers.28.proj.qkv shape=(9216, 3072) R= 64 energy= 41.0% relerr=0.768
|
| 153 |
+
[182/362] layers.29.proj.ffn_down shape=(3072, 8192) R= 64 energy= 31.6% relerr=0.827
|
| 154 |
+
[183/362] layers.29.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 64.9% relerr=0.593
|
| 155 |
+
[184/362] layers.29.proj.o shape=(3072, 3072) R= 64 energy= 41.4% relerr=0.766
|
| 156 |
+
[185/362] layers.29.proj.qkv shape=(9216, 3072) R= 64 energy= 37.2% relerr=0.792
|
| 157 |
+
[190/362] layers.3.proj.ffn_down shape=(3072, 8192) R= 64 energy= 54.5% relerr=0.674
|
| 158 |
+
[191/362] layers.3.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 65.6% relerr=0.587
|
| 159 |
+
[192/362] layers.3.proj.o shape=(3072, 3072) R= 64 energy= 56.2% relerr=0.662
|
| 160 |
+
[193/362] layers.3.proj.qkv shape=(9216, 3072) R= 64 energy= 67.5% relerr=0.570
|
| 161 |
+
[198/362] layers.30.proj.ffn_down shape=(3072, 8192) R= 64 energy= 27.3% relerr=0.853
|
| 162 |
+
[199/362] layers.30.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 56.6% relerr=0.659
|
| 163 |
+
[200/362] layers.30.proj.o shape=(3072, 3072) R= 64 energy= 39.0% relerr=0.781
|
| 164 |
+
[201/362] layers.30.proj.qkv shape=(9216, 3072) R= 64 energy= 38.5% relerr=0.784
|
| 165 |
+
[206/362] layers.31.proj.ffn_down shape=(3072, 8192) R= 64 energy= 21.5% relerr=0.886
|
| 166 |
+
[207/362] layers.31.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 55.4% relerr=0.668
|
| 167 |
+
[208/362] layers.31.proj.o shape=(3072, 3072) R= 64 energy= 35.2% relerr=0.805
|
| 168 |
+
[209/362] layers.31.proj.qkv shape=(9216, 3072) R= 64 energy= 34.6% relerr=0.809
|
| 169 |
+
[214/362] layers.32.proj.ffn_down shape=(3072, 8192) R= 64 energy= 18.7% relerr=0.902
|
| 170 |
+
[215/362] layers.32.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 44.7% relerr=0.744
|
| 171 |
+
[216/362] layers.32.proj.o shape=(3072, 3072) R= 64 energy= 34.9% relerr=0.807
|
| 172 |
+
[217/362] layers.32.proj.qkv shape=(9216, 3072) R= 64 energy= 34.6% relerr=0.809
|
| 173 |
+
[222/362] layers.33.proj.ffn_down shape=(3072, 8192) R= 64 energy= 15.6% relerr=0.919
|
| 174 |
+
[223/362] layers.33.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 43.9% relerr=0.749
|
| 175 |
+
[224/362] layers.33.proj.o shape=(3072, 3072) R= 64 energy= 31.8% relerr=0.826
|
| 176 |
+
[225/362] layers.33.proj.qkv shape=(9216, 3072) R= 64 energy= 35.0% relerr=0.806
|
| 177 |
+
[230/362] layers.34.proj.ffn_down shape=(3072, 8192) R= 64 energy= 13.7% relerr=0.929
|
| 178 |
+
[231/362] layers.34.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 34.4% relerr=0.810
|
| 179 |
+
[232/362] layers.34.proj.o shape=(3072, 3072) R= 64 energy= 25.7% relerr=0.862
|
| 180 |
+
[233/362] layers.34.proj.qkv shape=(9216, 3072) R= 64 energy= 34.1% relerr=0.812
|
| 181 |
+
[238/362] layers.35.proj.ffn_down shape=(3072, 8192) R= 64 energy= 10.8% relerr=0.944
|
| 182 |
+
[239/362] layers.35.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 26.9% relerr=0.855
|
| 183 |
+
[240/362] layers.35.proj.o shape=(3072, 3072) R= 64 energy= 22.8% relerr=0.879
|
| 184 |
+
[241/362] layers.35.proj.qkv shape=(9216, 3072) R= 64 energy= 28.6% relerr=0.845
|
| 185 |
+
[246/362] layers.36.proj.ffn_down shape=(3072, 8192) R= 64 energy= 9.1% relerr=0.953
|
| 186 |
+
[247/362] layers.36.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 24.9% relerr=0.867
|
| 187 |
+
[248/362] layers.36.proj.o shape=(3072, 3072) R= 64 energy= 18.9% relerr=0.901
|
| 188 |
+
[249/362] layers.36.proj.qkv shape=(9216, 3072) R= 64 energy= 27.2% relerr=0.853
|
| 189 |
+
[254/362] layers.37.proj.ffn_down shape=(3072, 8192) R= 64 energy= 8.0% relerr=0.959
|
| 190 |
+
[255/362] layers.37.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 22.3% relerr=0.881
|
| 191 |
+
[256/362] layers.37.proj.o shape=(3072, 3072) R= 64 energy= 17.5% relerr=0.908
|
| 192 |
+
[257/362] layers.37.proj.qkv shape=(9216, 3072) R= 64 energy= 23.3% relerr=0.876
|
| 193 |
+
[262/362] layers.38.proj.ffn_down shape=(3072, 8192) R= 64 energy= 7.8% relerr=0.960
|
| 194 |
+
[263/362] layers.38.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 23.0% relerr=0.877
|
| 195 |
+
[264/362] layers.38.proj.o shape=(3072, 3072) R= 64 energy= 15.5% relerr=0.919
|
| 196 |
+
[265/362] layers.38.proj.qkv shape=(9216, 3072) R= 64 energy= 21.2% relerr=0.888
|
| 197 |
+
[270/362] layers.39.proj.ffn_down shape=(3072, 8192) R= 64 energy= 7.5% relerr=0.962
|
| 198 |
+
[271/362] layers.39.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 25.0% relerr=0.866
|
| 199 |
+
[272/362] layers.39.proj.o shape=(3072, 3072) R= 64 energy= 13.4% relerr=0.931
|
| 200 |
+
[273/362] layers.39.proj.qkv shape=(9216, 3072) R= 64 energy= 19.4% relerr=0.898
|
| 201 |
+
[278/362] layers.4.proj.ffn_down shape=(3072, 8192) R= 64 energy= 50.3% relerr=0.705
|
| 202 |
+
[279/362] layers.4.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 66.5% relerr=0.578
|
| 203 |
+
[280/362] layers.4.proj.o shape=(3072, 3072) R= 64 energy= 53.5% relerr=0.682
|
| 204 |
+
[281/362] layers.4.proj.qkv shape=(9216, 3072) R= 64 energy= 65.0% relerr=0.591
|
| 205 |
+
[286/362] layers.40.proj.ffn_down shape=(3072, 8192) R= 64 energy= 7.6% relerr=0.961
|
| 206 |
+
[287/362] layers.40.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 29.2% relerr=0.841
|
| 207 |
+
[288/362] layers.40.proj.o shape=(3072, 3072) R= 64 energy= 13.3% relerr=0.931
|
| 208 |
+
[289/362] layers.40.proj.qkv shape=(9216, 3072) R= 64 energy= 19.8% relerr=0.895
|
| 209 |
+
[294/362] layers.41.proj.ffn_down shape=(3072, 8192) R= 64 energy= 14.9% relerr=0.923
|
| 210 |
+
[295/362] layers.41.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 28.9% relerr=0.843
|
| 211 |
+
[296/362] layers.41.proj.o shape=(3072, 3072) R= 64 energy= 12.8% relerr=0.934
|
| 212 |
+
[297/362] layers.41.proj.qkv shape=(9216, 3072) R= 64 energy= 15.4% relerr=0.920
|
| 213 |
+
[302/362] layers.5.proj.ffn_down shape=(3072, 8192) R= 64 energy= 47.3% relerr=0.726
|
| 214 |
+
[303/362] layers.5.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 51.6% relerr=0.696
|
| 215 |
+
[304/362] layers.5.proj.o shape=(3072, 3072) R= 64 energy= 57.2% relerr=0.654
|
| 216 |
+
[305/362] layers.5.proj.qkv shape=(9216, 3072) R= 64 energy= 65.5% relerr=0.588
|
| 217 |
+
[310/362] layers.6.proj.ffn_down shape=(3072, 8192) R= 64 energy= 37.2% relerr=0.793
|
| 218 |
+
[311/362] layers.6.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 50.9% relerr=0.701
|
| 219 |
+
[312/362] layers.6.proj.o shape=(3072, 3072) R= 64 energy= 52.9% relerr=0.686
|
| 220 |
+
[313/362] layers.6.proj.qkv shape=(9216, 3072) R= 64 energy= 65.4% relerr=0.588
|
| 221 |
+
[318/362] layers.7.proj.ffn_down shape=(3072, 8192) R= 64 energy= 38.3% relerr=0.786
|
| 222 |
+
[319/362] layers.7.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 48.9% relerr=0.715
|
| 223 |
+
[320/362] layers.7.proj.o shape=(3072, 3072) R= 64 energy= 59.2% relerr=0.638
|
| 224 |
+
[321/362] layers.7.proj.qkv shape=(9216, 3072) R= 64 energy= 68.5% relerr=0.561
|
| 225 |
+
[326/362] layers.8.proj.ffn_down shape=(3072, 8192) R= 64 energy= 33.6% relerr=0.815
|
| 226 |
+
[327/362] layers.8.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 47.3% relerr=0.726
|
| 227 |
+
[328/362] layers.8.proj.o shape=(3072, 3072) R= 64 energy= 54.9% relerr=0.671
|
| 228 |
+
[329/362] layers.8.proj.qkv shape=(9216, 3072) R= 64 energy= 66.9% relerr=0.575
|
| 229 |
+
[334/362] layers.9.proj.ffn_down shape=(3072, 8192) R= 64 energy= 34.5% relerr=0.809
|
| 230 |
+
[335/362] layers.9.proj.ffn_up_gate shape=(16384, 3072) R= 64 energy= 45.4% relerr=0.739
|
| 231 |
+
[336/362] layers.9.proj.o shape=(3072, 3072) R= 64 energy= 54.4% relerr=0.675
|
| 232 |
+
[337/362] layers.9.proj.qkv shape=(9216, 3072) R= 64 energy= 70.6% relerr=0.542
|
| 233 |
+
[339/362] shared_block_modulation shape=(18432, 3072) R= 64 energy= 38.1% relerr=0.787
|
| 234 |
+
[340/362] text_embedder.blocks.0.ffn_down shape=(3072, 8192) R= 64 energy= 6.2% relerr=0.969
|
| 235 |
+
[341/362] text_embedder.blocks.0.ffn_gate shape=(8192, 3072) R= 64 energy= 6.0% relerr=0.970
|
| 236 |
+
[342/362] text_embedder.blocks.0.ffn_up shape=(8192, 3072) R= 64 energy= 5.9% relerr=0.970
|
| 237 |
+
[346/362] text_embedder.blocks.0.proj shape=(3072, 3072) R= 64 energy= 9.7% relerr=0.950
|
| 238 |
+
[348/362] text_embedder.blocks.0.qkv shape=(9216, 3072) R= 64 energy= 8.2% relerr=0.958
|
| 239 |
+
[349/362] text_embedder.blocks.1.ffn_down shape=(3072, 8192) R= 64 energy= 5.6% relerr=0.972
|
| 240 |
+
[350/362] text_embedder.blocks.1.ffn_gate shape=(8192, 3072) R= 64 energy= 5.6% relerr=0.972
|
| 241 |
+
[351/362] text_embedder.blocks.1.ffn_up shape=(8192, 3072) R= 64 energy= 5.6% relerr=0.972
|
| 242 |
+
[355/362] text_embedder.blocks.1.proj shape=(3072, 3072) R= 64 energy= 9.3% relerr=0.953
|
| 243 |
+
[357/362] text_embedder.blocks.1.qkv shape=(9216, 3072) R= 64 energy= 7.4% relerr=0.962
|
| 244 |
+
[358/362] text_embedder.proj shape=(3072, 4096) R= 64 energy= 9.4% relerr=0.952
|
| 245 |
+
[359/362] time_embedding.0 shape=(3072, 256) R= 64 energy= 89.0% relerr=0.332
|
| 246 |
+
[360/362] time_embedding.2 shape=(3072, 3072) R= 64 energy= 93.4% relerr=0.256
|
| 247 |
+
[361/362] video_embedder shape=(3072, 128) R= 64 energy= 77.9% relerr=0.470
|
| 248 |
+
[362/362] video_head_modulation shape=(6144, 3072) R= 64 energy= 68.0% relerr=0.565
|
| 249 |
+
|
| 250 |
+
------------------------------------------------------------------------------
|
| 251 |
+
EXTRACTION RESULT:
|
| 252 |
+
------------------------------------------------------------------------------
|
| 253 |
+
layers extracted : 185
|
| 254 |
+
bias diffs : 16
|
| 255 |
+
layers skipped : 177
|
| 256 |
+
skipped: final_norm_video.weight (shape-mismatch), layers.0.k_norm.weight (shape-mismatch), layers.0.norm1.weight (shape-mismatch), layers.0.norm2.weight (shape-mismatch), layers.0.q_norm.weight (shape-mismatch), layers.1.k_norm.weight (shape-mismatch), layers.1.norm1.weight (shape-mismatch), layers.1.norm2.weight (shape-mismatch)
|
| 257 |
+
layers unsupported: 0
|
| 258 |
+
avg energy captured @ rank 64 : 42.02%
|
| 259 |
+
min / median / max energy : 5.57% / 43.93% / 93.43%
|
| 260 |
+
elapsed : 544.00 s
|
| 261 |
+
|
| 262 |
+
------------------------------------------------------------------------------
|
| 263 |
+
OUTPUT:
|
| 264 |
+
------------------------------------------------------------------------------
|
| 265 |
+
path : e:\python_scripts\2026\comfyui_lora_extractor_max\mossImageFinalcut5GB_universal_fp16-r64-comfy.safetensors
|
| 266 |
+
size : 271.55 MB
|
| 267 |
+
tensors : 386
|
| 268 |
+
STATUS : OK - LoRA saved successfully
|
| 269 |
+
==============================================================================
|