zhc12 commited on
Commit
219d1f2
·
verified ·
1 Parent(s): 242841f

Upload baselines/asvd_ppl.log with huggingface_hub

Browse files
Files changed (1) hide show
  1. baselines/asvd_ppl.log +162 -0
baselines/asvd_ppl.log ADDED
@@ -0,0 +1,162 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Loading model...
2
+ `torch_dtype` is deprecated! Use `dtype` instead!
3
+ 2026-04-21 06:45:33.028642: I tensorflow/core/util/port.cc:153] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable `TF_ENABLE_ONEDNN_OPTS=0`.
4
+ 2026-04-21 06:45:33.043469: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:467] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
5
+ WARNING: All log messages before absl::InitializeLog() is called are written to STDERR
6
+ E0000 00:00:1776753933.059345 804 cuda_dnn.cc:8579] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
7
+ E0000 00:00:1776753933.064594 804 cuda_blas.cc:1407] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
8
+ W0000 00:00:1776753933.078016 804 computation_placer.cc:177] computation placer already registered. Please check linkage and avoid linking the same target more than once.
9
+ W0000 00:00:1776753933.078038 804 computation_placer.cc:177] computation placer already registered. Please check linkage and avoid linking the same target more than once.
10
+ W0000 00:00:1776753933.078042 804 computation_placer.cc:177] computation placer already registered. Please check linkage and avoid linking the same target more than once.
11
+ W0000 00:00:1776753933.078044 804 computation_placer.cc:177] computation placer already registered. Please check linkage and avoid linking the same target more than once.
12
+ 2026-04-21 06:45:33.081513: I tensorflow/core/platform/cpu_feature_guard.cc:210] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
13
+ To enable the following instructions: AVX2 AVX512F AVX512_VNNI FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
14
+ AttributeError: 'MessageFactory' object has no attribute 'GetPrototype'
15
+ AttributeError: 'MessageFactory' object has no attribute 'GetPrototype'
16
+ AttributeError: 'MessageFactory' object has no attribute 'GetPrototype'
17
+ AttributeError: 'MessageFactory' object has no attribute 'GetPrototype'
18
+ AttributeError: 'MessageFactory' object has no attribute 'GetPrototype'
19
+
20
+ Collecting covariances...
21
+ Calibration: 16/256 samples
22
+ Calibration: 32/256 samples
23
+ Calibration: 48/256 samples
24
+ Calibration: 64/256 samples
25
+ Calibration: 80/256 samples
26
+ Calibration: 96/256 samples
27
+ Calibration: 112/256 samples
28
+ Calibration: 128/256 samples
29
+ Calibration: 144/256 samples
30
+ Calibration: 160/256 samples
31
+ Calibration: 176/256 samples
32
+ Calibration: 192/256 samples
33
+ Calibration: 208/256 samples
34
+ Calibration: 224/256 samples
35
+ Calibration: 240/256 samples
36
+ Calibration: 256/256 samples
37
+
38
+ ============================================================
39
+ ASVD PPL-mode at ratio=0.4
40
+ [ASVD-PPL] Measuring sensitivity: 224 layers × 6 ratios
41
+ [1/224] self_attn.q_proj layer=0 pr=0.4 ppl=5.34
42
+ [1/224] self_attn.q_proj layer=0 pr=0.5 ppl=5.34
43
+ [1/224] self_attn.q_proj layer=0 pr=0.6 ppl=5.34
44
+ [1/224] self_attn.q_proj layer=0 pr=0.7 ppl=5.34
45
+ [1/224] self_attn.q_proj layer=0 pr=0.8 ppl=5.34
46
+ [1/224] self_attn.q_proj layer=0 pr=0.9 ppl=5.34
47
+ [2/224] self_attn.k_proj layer=0 pr=0.4 ppl=5.34
48
+ [2/224] self_attn.k_proj layer=0 pr=0.5 ppl=5.34
49
+ [2/224] self_attn.k_proj layer=0 pr=0.6 ppl=5.34
50
+ [2/224] self_attn.k_proj layer=0 pr=0.7 ppl=5.34
51
+ [2/224] self_attn.k_proj layer=0 pr=0.8 ppl=5.34
52
+ [2/224] self_attn.k_proj layer=0 pr=0.9 ppl=5.34
53
+ [3/224] self_attn.v_proj layer=0 pr=0.4 ppl=5.34
54
+ [3/224] self_attn.v_proj layer=0 pr=0.5 ppl=5.34
55
+ [3/224] self_attn.v_proj layer=0 pr=0.6 ppl=5.34
56
+ [3/224] self_attn.v_proj layer=0 pr=0.7 ppl=5.34
57
+ [3/224] self_attn.v_proj layer=0 pr=0.8 ppl=5.34
58
+ [3/224] self_attn.v_proj layer=0 pr=0.9 ppl=5.34
59
+ [4/224] self_attn.o_proj layer=0 pr=0.4 ppl=5.34
60
+ [4/224] self_attn.o_proj layer=0 pr=0.5 ppl=5.34
61
+ [4/224] self_attn.o_proj layer=0 pr=0.6 ppl=5.34
62
+ [4/224] self_attn.o_proj layer=0 pr=0.7 ppl=5.34
63
+ [4/224] self_attn.o_proj layer=0 pr=0.8 ppl=5.34
64
+ [4/224] self_attn.o_proj layer=0 pr=0.9 ppl=5.34
65
+ [5/224] mlp.gate_proj layer=0 pr=0.4 ppl=5.34
66
+ [5/224] mlp.gate_proj layer=0 pr=0.5 ppl=5.34
67
+ [5/224] mlp.gate_proj layer=0 pr=0.6 ppl=5.34
68
+ [5/224] mlp.gate_proj layer=0 pr=0.7 ppl=5.34
69
+ [5/224] mlp.gate_proj layer=0 pr=0.8 ppl=5.34
70
+ [5/224] mlp.gate_proj layer=0 pr=0.9 ppl=5.34
71
+ [6/224] mlp.up_proj layer=0 pr=0.4 ppl=5.34
72
+ [6/224] mlp.up_proj layer=0 pr=0.5 ppl=5.34
73
+ [6/224] mlp.up_proj layer=0 pr=0.6 ppl=5.34
74
+ [6/224] mlp.up_proj layer=0 pr=0.7 ppl=5.34
75
+ [6/224] mlp.up_proj layer=0 pr=0.8 ppl=5.34
76
+ [6/224] mlp.up_proj layer=0 pr=0.9 ppl=5.34
77
+ [7/224] mlp.down_proj layer=0 pr=0.4 ppl=5.35
78
+ [7/224] mlp.down_proj layer=0 pr=0.5 ppl=5.34
79
+ [7/224] mlp.down_proj layer=0 pr=0.6 ppl=5.34
80
+ [7/224] mlp.down_proj layer=0 pr=0.7 ppl=5.34
81
+ [7/224] mlp.down_proj layer=0 pr=0.8 ppl=5.34
82
+ [7/224] mlp.down_proj layer=0 pr=0.9 ppl=5.34
83
+ [8/224] self_attn.q_proj layer=1 pr=0.4 ppl=5.34
84
+ [8/224] self_attn.q_proj layer=1 pr=0.5 ppl=5.34
85
+ [8/224] self_attn.q_proj layer=1 pr=0.6 ppl=5.34
86
+ [8/224] self_attn.q_proj layer=1 pr=0.7 ppl=5.34
87
+ [8/224] self_attn.q_proj layer=1 pr=0.8 ppl=5.34
88
+ [8/224] self_attn.q_proj layer=1 pr=0.9 ppl=5.34
89
+ [9/224] self_attn.k_proj layer=1 pr=0.4 ppl=5.34
90
+ [9/224] self_attn.k_proj layer=1 pr=0.5 ppl=5.34
91
+ [9/224] self_attn.k_proj layer=1 pr=0.6 ppl=5.34
92
+ [9/224] self_attn.k_proj layer=1 pr=0.7 ppl=5.34
93
+ [9/224] self_attn.k_proj layer=1 pr=0.8 ppl=5.34
94
+ [9/224] self_attn.k_proj layer=1 pr=0.9 ppl=5.34
95
+ [10/224] self_attn.v_proj layer=1 pr=0.4 ppl=5.34
96
+ [10/224] self_attn.v_proj layer=1 pr=0.5 ppl=5.34
97
+ [10/224] self_attn.v_proj layer=1 pr=0.6 ppl=5.34
98
+ [10/224] self_attn.v_proj layer=1 pr=0.7 ppl=5.34
99
+ [10/224] self_attn.v_proj layer=1 pr=0.8 ppl=5.34
100
+ [10/224] self_attn.v_proj layer=1 pr=0.9 ppl=5.34
101
+ [11/224] self_attn.o_proj layer=1 pr=0.4 ppl=5.34
102
+ [11/224] self_attn.o_proj layer=1 pr=0.5 ppl=5.34
103
+ [11/224] self_attn.o_proj layer=1 pr=0.6 ppl=5.34
104
+ [11/224] self_attn.o_proj layer=1 pr=0.7 ppl=5.34
105
+ [11/224] self_attn.o_proj layer=1 pr=0.8 ppl=5.34
106
+ [11/224] self_attn.o_proj layer=1 pr=0.9 ppl=5.34
107
+ [12/224] mlp.gate_proj layer=1 pr=0.4 ppl=5.34
108
+ [12/224] mlp.gate_proj layer=1 pr=0.5 ppl=5.34
109
+ [12/224] mlp.gate_proj layer=1 pr=0.6 ppl=5.34
110
+ [12/224] mlp.gate_proj layer=1 pr=0.7 ppl=5.34
111
+ [12/224] mlp.gate_proj layer=1 pr=0.8 ppl=5.34
112
+ [12/224] mlp.gate_proj layer=1 pr=0.9 ppl=5.34
113
+ [13/224] mlp.up_proj layer=1 pr=0.4 ppl=5.35
114
+ [13/224] mlp.up_proj layer=1 pr=0.5 ppl=5.34
115
+ [13/224] mlp.up_proj layer=1 pr=0.6 ppl=5.34
116
+ [13/224] mlp.up_proj layer=1 pr=0.7 ppl=5.34
117
+ [13/224] mlp.up_proj layer=1 pr=0.8 ppl=5.34
118
+ [13/224] mlp.up_proj layer=1 pr=0.9 ppl=5.34
119
+ [14/224] mlp.down_proj layer=1 pr=0.4 ppl=5.36
120
+ [14/224] mlp.down_proj layer=1 pr=0.5 ppl=5.35
121
+ [14/224] mlp.down_proj layer=1 pr=0.6 ppl=5.35
122
+ [14/224] mlp.down_proj layer=1 pr=0.7 ppl=5.34
123
+ [14/224] mlp.down_proj layer=1 pr=0.8 ppl=5.34
124
+ [14/224] mlp.down_proj layer=1 pr=0.9 ppl=5.34
125
+ [15/224] self_attn.q_proj layer=2 pr=0.4 ppl=5.34
126
+ [15/224] self_attn.q_proj layer=2 pr=0.5 ppl=5.34
127
+ [15/224] self_attn.q_proj layer=2 pr=0.6 ppl=5.34
128
+ [15/224] self_attn.q_proj layer=2 pr=0.7 ppl=5.34
129
+ [15/224] self_attn.q_proj layer=2 pr=0.8 ppl=5.34
130
+ [15/224] self_attn.q_proj layer=2 pr=0.9 ppl=5.34
131
+ [16/224] self_attn.k_proj layer=2 pr=0.4 ppl=5.34
132
+ [16/224] self_attn.k_proj layer=2 pr=0.5 ppl=5.34
133
+ [16/224] self_attn.k_proj layer=2 pr=0.6 ppl=5.34
134
+ [16/224] self_attn.k_proj layer=2 pr=0.7 ppl=5.34
135
+ [16/224] self_attn.k_proj layer=2 pr=0.8 ppl=5.34
136
+ [16/224] self_attn.k_proj layer=2 pr=0.9 ppl=5.34
137
+ [17/224] self_attn.v_proj layer=2 pr=0.4 ppl=5.34
138
+ [17/224] self_attn.v_proj layer=2 pr=0.5 ppl=5.34
139
+ [17/224] self_attn.v_proj layer=2 pr=0.6 ppl=5.34
140
+ [17/224] self_attn.v_proj layer=2 pr=0.7 ppl=5.34
141
+ [17/224] self_attn.v_proj layer=2 pr=0.8 ppl=5.34
142
+ [17/224] self_attn.v_proj layer=2 pr=0.9 ppl=5.34
143
+ [18/224] self_attn.o_proj layer=2 pr=0.4 ppl=5.34
144
+ [18/224] self_attn.o_proj layer=2 pr=0.5 ppl=5.34
145
+ [18/224] self_attn.o_proj layer=2 pr=0.6 ppl=5.34
146
+ [18/224] self_attn.o_proj layer=2 pr=0.7 ppl=5.34
147
+ [18/224] self_attn.o_proj layer=2 pr=0.8 ppl=5.34
148
+ [18/224] self_attn.o_proj layer=2 pr=0.9 ppl=5.34
149
+ [19/224] mlp.gate_proj layer=2 pr=0.4 ppl=5.35
150
+ [19/224] mlp.gate_proj layer=2 pr=0.5 ppl=5.34
151
+ [19/224] mlp.gate_proj layer=2 pr=0.6 ppl=5.34
152
+ [19/224] mlp.gate_proj layer=2 pr=0.7 ppl=5.34
153
+ [19/224] mlp.gate_proj layer=2 pr=0.8 ppl=5.34
154
+ [19/224] mlp.gate_proj layer=2 pr=0.9 ppl=5.34
155
+ [20/224] mlp.up_proj layer=2 pr=0.4 ppl=5.35
156
+ [20/224] mlp.up_proj layer=2 pr=0.5 ppl=5.34
157
+ [20/224] mlp.up_proj layer=2 pr=0.6 ppl=5.34
158
+ [20/224] mlp.up_proj layer=2 pr=0.7 ppl=5.34
159
+ [20/224] mlp.up_proj layer=2 pr=0.8 ppl=5.34
160
+ [20/224] mlp.up_proj layer=2 pr=0.9 ppl=5.34
161
+ [21/224] mlp.down_proj layer=2 pr=0.4 ppl=5.37
162
+ [21/224] mlp.down_proj layer=2 pr=0.5 ppl=5.36