File size: 25,569 Bytes
dda9e40
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
Failed to import Flash Attention, using ESPnet default: No module named 'flash_attn'
/home/qingzhengw/espnet/.geolid-reproduction/venv/bin/python /home/qingzhengw/espnet/.geolid-reproduction/review-code/espnet2/bin/lid_inference.py --output_dir /home/qingzhengw/espnet/.geolid-reproduction/full-dev-unified-301372e4/models/combined_shared_trainable --ngpu 1 --dtype float32 --data_path_and_name_and_type /home/qingzhengw/espnet/.geolid-reproduction/full-dev-unified-301372e4/data/voxlingua107-dev/wav.scp,speech,sound --valid_batch_size 1 --lid_train_config /home/qingzhengw/espnet/.geolid-reproduction/full-dev-unified-301372e4/models/combined_shared_trainable/config.resolved.yaml --lid_model_file /home/qingzhengw/espnet/.geolid-reproduction/round2-native/combined_shared_trainable/model.pth --use_preprocessor false --fix_duration false --num_workers 8 --extract_embd false --save_embd_per_utt false --save_embd_avg_lang false --save_tsne_plot false --checkpoint_interval 200
[host-10-0-93-146] 2026-10-23 00:53:32,012 (abs_task:2514) INFO: config file: /home/qingzhengw/espnet/.geolid-reproduction/full-dev-unified-301372e4/models/combined_shared_trainable/config.resolved.yaml

Loading weights:   0%|          | 0/806 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 806/806 [00:00<00:00, 33237.07it/s]
[transformers] Wav2Vec2Model LOAD REPORT from: facebook/mms-1b
Key                          | Status     |  | 
-----------------------------+------------+--+-
project_q.weight             | UNEXPECTED |  | 
quantizer.codevectors        | UNEXPECTED |  | 
project_hid.weight           | UNEXPECTED |  | 
quantizer.weight_proj.weight | UNEXPECTED |  | 
project_q.bias               | UNEXPECTED |  | 
project_hid.bias             | UNEXPECTED |  | 
quantizer.weight_proj.bias   | UNEXPECTED |  | 

Notes:
- UNEXPECTED:	can be ignored when loading from different task/architecture; not ok if you expect identical arch.
[host-10-0-93-146] 2026-10-23 00:53:43,296 (lid_inference:111) INFO: Model structure:
ESPnetLIDModel(
  (frontend): S3prlFrontend(
    (upstream): S3PRLUpstream(
      (upstream): UpstreamExpert(
        (model): Wav2Vec2Model(
          (feature_extractor): Wav2Vec2FeatureEncoder(
            (conv_layers): ModuleList(
              (0): Wav2Vec2LayerNormConvLayer(
                (conv): Conv1d(1, 512, kernel_size=(10,), stride=(5,))
                (layer_norm): LayerNorm((512,), eps=1e-05, elementwise_affine=True)
                (activation): GELUActivation()
              )
              (1-4): 4 x Wav2Vec2LayerNormConvLayer(
                (conv): Conv1d(512, 512, kernel_size=(3,), stride=(2,))
                (layer_norm): LayerNorm((512,), eps=1e-05, elementwise_affine=True)
                (activation): GELUActivation()
              )
              (5-6): 2 x Wav2Vec2LayerNormConvLayer(
                (conv): Conv1d(512, 512, kernel_size=(2,), stride=(2,))
                (layer_norm): LayerNorm((512,), eps=1e-05, elementwise_affine=True)
                (activation): GELUActivation()
              )
            )
          )
          (feature_projection): Wav2Vec2FeatureProjection(
            (layer_norm): LayerNorm((512,), eps=1e-05, elementwise_affine=True)
            (projection): Linear(in_features=512, out_features=1280, bias=True)
            (dropout): Dropout(p=0.1, inplace=False)
          )
          (encoder): Wav2Vec2EncoderStableLayerNorm(
            (pos_conv_embed): Wav2Vec2PositionalConvEmbedding(
              (conv): ParametrizedConv1d(
                1280, 1280, kernel_size=(128,), stride=(1,), padding=(64,), groups=16
                (parametrizations): ModuleDict(
                  (weight): ParametrizationList(
                    (0): _WeightNorm()
                  )
                )
              )
              (padding): Wav2Vec2SamePadLayer()
              (activation): GELUActivation()
            )
            (layer_norm): LayerNorm((1280,), eps=1e-05, elementwise_affine=True)
            (dropout): Dropout(p=0.1, inplace=False)
            (layers): ModuleList(
              (0-31): 32 x Wav2Vec2EncoderLayerStableLayerNorm(
                (attention): Wav2Vec2Attention(
                  (k_proj): Linear(in_features=1280, out_features=1280, bias=True)
                  (v_proj): Linear(in_features=1280, out_features=1280, bias=True)
                  (q_proj): Linear(in_features=1280, out_features=1280, bias=True)
                  (out_proj): Linear(in_features=1280, out_features=1280, bias=True)
                )
                (dropout): Dropout(p=0.1, inplace=False)
                (layer_norm): LayerNorm((1280,), eps=1e-05, elementwise_affine=True)
                (feed_forward): Wav2Vec2FeedForward(
                  (intermediate_dropout): Dropout(p=0.0, inplace=False)
                  (intermediate_dense): Linear(in_features=1280, out_features=5120, bias=True)
                  (intermediate_act_fn): GELUActivation()
                  (output_dense): Linear(in_features=5120, out_features=1280, bias=True)
                  (output_dropout): Dropout(p=0.1, inplace=False)
                )
                (final_layer_norm): LayerNorm((1280,), eps=1e-05, elementwise_affine=True)
              )
              (32): Lang2VecConditionedLayer(
                (layer): Wav2Vec2EncoderLayerStableLayerNorm(
                  (attention): Wav2Vec2Attention(
                    (k_proj): Linear(in_features=1280, out_features=1280, bias=True)
                    (v_proj): Linear(in_features=1280, out_features=1280, bias=True)
                    (q_proj): Linear(in_features=1280, out_features=1280, bias=True)
                    (out_proj): Linear(in_features=1280, out_features=1280, bias=True)
                  )
                  (dropout): Dropout(p=0.1, inplace=False)
                  (layer_norm): LayerNorm((1280,), eps=1e-05, elementwise_affine=True)
                  (feed_forward): Wav2Vec2FeedForward(
                    (intermediate_dropout): Dropout(p=0.0, inplace=False)
                    (intermediate_dense): Linear(in_features=1280, out_features=5120, bias=True)
                    (intermediate_act_fn): GELUActivation()
                    (output_dense): Linear(in_features=5120, out_features=1280, bias=True)
                    (output_dropout): Dropout(p=0.1, inplace=False)
                  )
                  (final_layer_norm): LayerNorm((1280,), eps=1e-05, elementwise_affine=True)
                )
                (encoder): IdentityEncoder()
                (pooling): ChnAttnStatPooling(
                  (attention): Sequential(
                    (0): Conv1d(3840, 128, kernel_size=(1,), stride=(1,))
                    (1): ReLU()
                    (2): BatchNorm1d(128, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
                    (3): Conv1d(128, 1280, kernel_size=(1,), stride=(1,))
                  )
                  (softmax): Softmax(dim=2)
                )
                (projector): RawNet3Projector(
                  (bn): BatchNorm1d(2560, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
                  (fc): Linear(in_features=2560, out_features=192, bias=True)
                )
                (prediction): Linear(in_features=192, out_features=299, bias=True)
                (conditioning_layer): Linear(in_features=299, out_features=1280, bias=True)
              )
              (33-35): 3 x Wav2Vec2EncoderLayerStableLayerNorm(
                (attention): Wav2Vec2Attention(
                  (k_proj): Linear(in_features=1280, out_features=1280, bias=True)
                  (v_proj): Linear(in_features=1280, out_features=1280, bias=True)
                  (q_proj): Linear(in_features=1280, out_features=1280, bias=True)
                  (out_proj): Linear(in_features=1280, out_features=1280, bias=True)
                )
                (dropout): Dropout(p=0.1, inplace=False)
                (layer_norm): LayerNorm((1280,), eps=1e-05, elementwise_affine=True)
                (feed_forward): Wav2Vec2FeedForward(
                  (intermediate_dropout): Dropout(p=0.0, inplace=False)
                  (intermediate_dense): Linear(in_features=1280, out_features=5120, bias=True)
                  (intermediate_act_fn): GELUActivation()
                  (output_dense): Linear(in_features=5120, out_features=1280, bias=True)
                  (output_dropout): Dropout(p=0.1, inplace=False)
                )
                (final_layer_norm): LayerNorm((1280,), eps=1e-05, elementwise_affine=True)
              )
              (36): Lang2VecConditionedLayer(
                (layer): Wav2Vec2EncoderLayerStableLayerNorm(
                  (attention): Wav2Vec2Attention(
                    (k_proj): Linear(in_features=1280, out_features=1280, bias=True)
                    (v_proj): Linear(in_features=1280, out_features=1280, bias=True)
                    (q_proj): Linear(in_features=1280, out_features=1280, bias=True)
                    (out_proj): Linear(in_features=1280, out_features=1280, bias=True)
                  )
                  (dropout): Dropout(p=0.1, inplace=False)
                  (layer_norm): LayerNorm((1280,), eps=1e-05, elementwise_affine=True)
                  (feed_forward): Wav2Vec2FeedForward(
                    (intermediate_dropout): Dropout(p=0.0, inplace=False)
                    (intermediate_dense): Linear(in_features=1280, out_features=5120, bias=True)
                    (intermediate_act_fn): GELUActivation()
                    (output_dense): Linear(in_features=5120, out_features=1280, bias=True)
                    (output_dropout): Dropout(p=0.1, inplace=False)
                  )
                  (final_layer_norm): LayerNorm((1280,), eps=1e-05, elementwise_affine=True)
                )
                (encoder): IdentityEncoder()
                (pooling): ChnAttnStatPooling(
                  (attention): Sequential(
                    (0): Conv1d(3840, 128, kernel_size=(1,), stride=(1,))
                    (1): ReLU()
                    (2): BatchNorm1d(128, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
                    (3): Conv1d(128, 1280, kernel_size=(1,), stride=(1,))
                  )
                  (softmax): Softmax(dim=2)
                )
                (projector): RawNet3Projector(
                  (bn): BatchNorm1d(2560, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
                  (fc): Linear(in_features=2560, out_features=192, bias=True)
                )
                (prediction): Linear(in_features=192, out_features=299, bias=True)
                (conditioning_layer): Linear(in_features=299, out_features=1280, bias=True)
              )
              (37-39): 3 x Wav2Vec2EncoderLayerStableLayerNorm(
                (attention): Wav2Vec2Attention(
                  (k_proj): Linear(in_features=1280, out_features=1280, bias=True)
                  (v_proj): Linear(in_features=1280, out_features=1280, bias=True)
                  (q_proj): Linear(in_features=1280, out_features=1280, bias=True)
                  (out_proj): Linear(in_features=1280, out_features=1280, bias=True)
                )
                (dropout): Dropout(p=0.1, inplace=False)
                (layer_norm): LayerNorm((1280,), eps=1e-05, elementwise_affine=True)
                (feed_forward): Wav2Vec2FeedForward(
                  (intermediate_dropout): Dropout(p=0.0, inplace=False)
                  (intermediate_dense): Linear(in_features=1280, out_features=5120, bias=True)
                  (intermediate_act_fn): GELUActivation()
                  (output_dense): Linear(in_features=5120, out_features=1280, bias=True)
                  (output_dropout): Dropout(p=0.1, inplace=False)
                )
                (final_layer_norm): LayerNorm((1280,), eps=1e-05, elementwise_affine=True)
              )
              (40): Lang2VecConditionedLayer(
                (layer): Wav2Vec2EncoderLayerStableLayerNorm(
                  (attention): Wav2Vec2Attention(
                    (k_proj): Linear(in_features=1280, out_features=1280, bias=True)
                    (v_proj): Linear(in_features=1280, out_features=1280, bias=True)
                    (q_proj): Linear(in_features=1280, out_features=1280, bias=True)
                    (out_proj): Linear(in_features=1280, out_features=1280, bias=True)
                  )
                  (dropout): Dropout(p=0.1, inplace=False)
                  (layer_norm): LayerNorm((1280,), eps=1e-05, elementwise_affine=True)
                  (feed_forward): Wav2Vec2FeedForward(
                    (intermediate_dropout): Dropout(p=0.0, inplace=False)
                    (intermediate_dense): Linear(in_features=1280, out_features=5120, bias=True)
                    (intermediate_act_fn): GELUActivation()
                    (output_dense): Linear(in_features=5120, out_features=1280, bias=True)
                    (output_dropout): Dropout(p=0.1, inplace=False)
                  )
                  (final_layer_norm): LayerNorm((1280,), eps=1e-05, elementwise_affine=True)
                )
                (encoder): IdentityEncoder()
                (pooling): ChnAttnStatPooling(
                  (attention): Sequential(
                    (0): Conv1d(3840, 128, kernel_size=(1,), stride=(1,))
                    (1): ReLU()
                    (2): BatchNorm1d(128, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
                    (3): Conv1d(128, 1280, kernel_size=(1,), stride=(1,))
                  )
                  (softmax): Softmax(dim=2)
                )
                (projector): RawNet3Projector(
                  (bn): BatchNorm1d(2560, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
                  (fc): Linear(in_features=2560, out_features=192, bias=True)
                )
                (prediction): Linear(in_features=192, out_features=299, bias=True)
                (conditioning_layer): Linear(in_features=299, out_features=1280, bias=True)
              )
              (41-43): 3 x Wav2Vec2EncoderLayerStableLayerNorm(
                (attention): Wav2Vec2Attention(
                  (k_proj): Linear(in_features=1280, out_features=1280, bias=True)
                  (v_proj): Linear(in_features=1280, out_features=1280, bias=True)
                  (q_proj): Linear(in_features=1280, out_features=1280, bias=True)
                  (out_proj): Linear(in_features=1280, out_features=1280, bias=True)
                )
                (dropout): Dropout(p=0.1, inplace=False)
                (layer_norm): LayerNorm((1280,), eps=1e-05, elementwise_affine=True)
                (feed_forward): Wav2Vec2FeedForward(
                  (intermediate_dropout): Dropout(p=0.0, inplace=False)
                  (intermediate_dense): Linear(in_features=1280, out_features=5120, bias=True)
                  (intermediate_act_fn): GELUActivation()
                  (output_dense): Linear(in_features=5120, out_features=1280, bias=True)
                  (output_dropout): Dropout(p=0.1, inplace=False)
                )
                (final_layer_norm): LayerNorm((1280,), eps=1e-05, elementwise_affine=True)
              )
              (44): Lang2VecConditionedLayer(
                (layer): Wav2Vec2EncoderLayerStableLayerNorm(
                  (attention): Wav2Vec2Attention(
                    (k_proj): Linear(in_features=1280, out_features=1280, bias=True)
                    (v_proj): Linear(in_features=1280, out_features=1280, bias=True)
                    (q_proj): Linear(in_features=1280, out_features=1280, bias=True)
                    (out_proj): Linear(in_features=1280, out_features=1280, bias=True)
                  )
                  (dropout): Dropout(p=0.1, inplace=False)
                  (layer_norm): LayerNorm((1280,), eps=1e-05, elementwise_affine=True)
                  (feed_forward): Wav2Vec2FeedForward(
                    (intermediate_dropout): Dropout(p=0.0, inplace=False)
                    (intermediate_dense): Linear(in_features=1280, out_features=5120, bias=True)
                    (intermediate_act_fn): GELUActivation()
                    (output_dense): Linear(in_features=5120, out_features=1280, bias=True)
                    (output_dropout): Dropout(p=0.1, inplace=False)
                  )
                  (final_layer_norm): LayerNorm((1280,), eps=1e-05, elementwise_affine=True)
                )
                (encoder): IdentityEncoder()
                (pooling): ChnAttnStatPooling(
                  (attention): Sequential(
                    (0): Conv1d(3840, 128, kernel_size=(1,), stride=(1,))
                    (1): ReLU()
                    (2): BatchNorm1d(128, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
                    (3): Conv1d(128, 1280, kernel_size=(1,), stride=(1,))
                  )
                  (softmax): Softmax(dim=2)
                )
                (projector): RawNet3Projector(
                  (bn): BatchNorm1d(2560, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
                  (fc): Linear(in_features=2560, out_features=192, bias=True)
                )
                (prediction): Linear(in_features=192, out_features=299, bias=True)
                (conditioning_layer): Linear(in_features=299, out_features=1280, bias=True)
              )
              (45-47): 3 x Wav2Vec2EncoderLayerStableLayerNorm(
                (attention): Wav2Vec2Attention(
                  (k_proj): Linear(in_features=1280, out_features=1280, bias=True)
                  (v_proj): Linear(in_features=1280, out_features=1280, bias=True)
                  (q_proj): Linear(in_features=1280, out_features=1280, bias=True)
                  (out_proj): Linear(in_features=1280, out_features=1280, bias=True)
                )
                (dropout): Dropout(p=0.1, inplace=False)
                (layer_norm): LayerNorm((1280,), eps=1e-05, elementwise_affine=True)
                (feed_forward): Wav2Vec2FeedForward(
                  (intermediate_dropout): Dropout(p=0.0, inplace=False)
                  (intermediate_dense): Linear(in_features=1280, out_features=5120, bias=True)
                  (intermediate_act_fn): GELUActivation()
                  (output_dense): Linear(in_features=5120, out_features=1280, bias=True)
                  (output_dropout): Dropout(p=0.1, inplace=False)
                )
                (final_layer_norm): LayerNorm((1280,), eps=1e-05, elementwise_affine=True)
              )
            )
          )
        )
      )
    )
    (featurizer): Featurizer()
  )
  (normalize): UtteranceMVN(norm_means=True, norm_vars=False)
  (encoder): EcapaTdnnEncoder(
    (conv): Conv1d(1280, 512, kernel_size=(5,), stride=(1,), padding=(2,))
    (relu): ReLU()
    (bn): BatchNorm1d(512, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
    (layer1): EcapaBlock(
      (conv1): Conv1d(512, 512, kernel_size=(1,), stride=(1,))
      (bn1): BatchNorm1d(512, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
      (convs): ModuleList(
        (0-6): 7 x Conv1d(64, 64, kernel_size=(3,), stride=(1,), padding=(2,), dilation=(2,))
      )
      (bns): ModuleList(
        (0-6): 7 x BatchNorm1d(64, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
      )
      (conv3): Conv1d(512, 512, kernel_size=(1,), stride=(1,))
      (bn3): BatchNorm1d(512, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
      (relu): ReLU()
      (se): SEModule(
        (se): Sequential(
          (0): AdaptiveAvgPool1d(output_size=1)
          (1): Conv1d(512, 128, kernel_size=(1,), stride=(1,))
          (2): ReLU()
          (3): BatchNorm1d(128, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
          (4): Conv1d(128, 512, kernel_size=(1,), stride=(1,))
          (5): Sigmoid()
        )
      )
    )
    (layer2): EcapaBlock(
      (conv1): Conv1d(512, 512, kernel_size=(1,), stride=(1,))
      (bn1): BatchNorm1d(512, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
      (convs): ModuleList(
        (0-6): 7 x Conv1d(64, 64, kernel_size=(3,), stride=(1,), padding=(3,), dilation=(3,))
      )
      (bns): ModuleList(
        (0-6): 7 x BatchNorm1d(64, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
      )
      (conv3): Conv1d(512, 512, kernel_size=(1,), stride=(1,))
      (bn3): BatchNorm1d(512, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
      (relu): ReLU()
      (se): SEModule(
        (se): Sequential(
          (0): AdaptiveAvgPool1d(output_size=1)
          (1): Conv1d(512, 128, kernel_size=(1,), stride=(1,))
          (2): ReLU()
          (3): BatchNorm1d(128, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
          (4): Conv1d(128, 512, kernel_size=(1,), stride=(1,))
          (5): Sigmoid()
        )
      )
    )
    (layer3): EcapaBlock(
      (conv1): Conv1d(512, 512, kernel_size=(1,), stride=(1,))
      (bn1): BatchNorm1d(512, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
      (convs): ModuleList(
        (0-6): 7 x Conv1d(64, 64, kernel_size=(3,), stride=(1,), padding=(4,), dilation=(4,))
      )
      (bns): ModuleList(
        (0-6): 7 x BatchNorm1d(64, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
      )
      (conv3): Conv1d(512, 512, kernel_size=(1,), stride=(1,))
      (bn3): BatchNorm1d(512, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
      (relu): ReLU()
      (se): SEModule(
        (se): Sequential(
          (0): AdaptiveAvgPool1d(output_size=1)
          (1): Conv1d(512, 128, kernel_size=(1,), stride=(1,))
          (2): ReLU()
          (3): BatchNorm1d(128, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
          (4): Conv1d(128, 512, kernel_size=(1,), stride=(1,))
          (5): Sigmoid()
        )
      )
    )
    (extra_layers): ModuleList()
    (layer4): Conv1d(1536, 1536, kernel_size=(1,), stride=(1,))
    (mp3): MaxPool1d(kernel_size=3, stride=3, padding=0, dilation=1, ceil_mode=False)
  )
  (pooling): ChnAttnStatPooling(
    (attention): Sequential(
      (0): Conv1d(4608, 128, kernel_size=(1,), stride=(1,))
      (1): ReLU()
      (2): BatchNorm1d(128, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
      (3): Conv1d(128, 1536, kernel_size=(1,), stride=(1,))
    )
    (softmax): Softmax(dim=2)
  )
  (projector): RawNet3Projector(
    (bn): BatchNorm1d(3072, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
    (fc): Linear(in_features=3072, out_features=192, bias=True)
  )
  (loss): ArcMarginProduct_intertopk_subcenter(
    (ce): CrossEntropyLoss()
  )
  (lang2vec_head): Linear(in_features=192, out_features=299, bias=True)
  (lang2vec_loss): MSELoss()
)

Model summary:
    Class Name: ESPnetLIDModel
    Total Number of model parameters: 977.14 M
    Number of trainable parameters: 977.14 M (100.0%)
    Size: 3.91 GB
    Type: torch.float32
/home/qingzhengw/espnet/.geolid-reproduction/venv/lib/python3.12/site-packages/torch/utils/data/dataloader.py:424: UserWarning: This DataLoader will create 8 worker processes in total. Our suggested max number of worker in current system is 2, which is smaller than what this DataLoader is going to create. Please be aware that excessive worker creation might get DataLoader running slow or even freeze, lower the worker number to avoid potential slowness/freeze if necessary.
  self.check_worker_number_rationality()
/home/qingzhengw/espnet/.geolid-reproduction/review-code/espnet2/train/reporter.py:320: UserWarning: The stats of the previous epoch=-1doesn't exist.
  warnings.warn(
[host-10-0-93-146] 2026-10-23 00:53:43,304 (lid_trainer:121) INFO: [Rank 0] Resume: 0 utterances found in /home/qingzhengw/espnet/.geolid-reproduction/full-dev-unified-301372e4/models/combined_shared_trainable/lids0
/home/qingzhengw/espnet/.geolid-reproduction/venv/lib/python3.12/site-packages/torch/utils/data/dataloader.py:432: UserWarning: This DataLoader will create 8 worker processes in total. Our suggested max number of worker in current system is 2, which is smaller than what this DataLoader is going to create. Please be aware that excessive worker creation might get DataLoader running slow or even freeze, lower the worker number to avoid potential slowness/freeze if necessary.
  self.check_worker_number_rationality()
[host-10-0-93-146] 2026-10-23 00:54:01,839 (lid_trainer:250) INFO: [Rank 0] Saved 200 utts at step 0
[host-10-0-93-146] 2026-10-23 00:54:18,771 (lid_trainer:250) INFO: [Rank 0] Saved 200 utts at step 1
[host-10-0-93-146] 2026-10-23 00:54:34,599 (lid_trainer:250) INFO: [Rank 0] Saved 200 utts at step 2
[host-10-0-93-146] 2026-10-23 00:54:50,150 (lid_trainer:250) INFO: [Rank 0] Saved 200 utts at step 3
[host-10-0-93-146] 2026-10-23 00:55:04,729 (lid_trainer:250) INFO: [Rank 0] Saved 200 utts at step 4
[host-10-0-93-146] 2026-10-23 00:55:19,633 (lid_trainer:250) INFO: [Rank 0] Saved 200 utts at step 5
[host-10-0-93-146] 2026-10-23 00:55:34,813 (lid_trainer:250) INFO: [Rank 0] Saved 200 utts at step 6
[host-10-0-93-146] 2026-10-23 00:55:49,924 (lid_trainer:250) INFO: [Rank 0] Saved 200 utts at step 7
[host-10-0-93-146] 2026-10-23 00:55:50,841 (lid_inference:274) INFO: args.save_embd_per_utt: False
[host-10-0-93-146] 2026-10-23 00:55:50,842 (lid_inference:305) INFO: args.save_tsne_plot: False