WeDefense-WavLM-Base-Pruned: Speech Anti-Spoofing Arena wrapper

Packaged for the Speech Anti-Spoofing Arena from the authors' code and paper.

WeDefense hybrid-pruning system (Peng et al., 2025): a WavLM Base+ front-end fine-tuned on ASVspoof 5 jointly with structured hard-concrete pruning (target sparsity 10%: 2 attention heads and the last FFN removed, CNN and FFN widths trimmed), then physically pruned (86.1 M params). All 13 hidden states (CNN-projection input + 12 layers, 768-d) are stacked, mean-normalised over the feature axis (the toolkit's apply_cmvn on the (B, D, T, L) layout) and pooled by Multi-Head Factorized Attentive Pooling (MHFA, 32 heads, 128-d compression, 256-d embedding), followed by BatchNorm-ReLU-Linear 256->2. Trained on ASVspoof 5 train with MUSAN/RIR augmentation, 5 epochs, last-2 checkpoint average. Authors' released checkpoint. Input: 16 kHz float waveform, no normalisation, first 64600 samples (4 s), shorter clips repeat-padded (the authors score whole utterances). score = logit[bonafide] - logit[spoof]. FP32.

  • Weights: not re-hosted (the authors grant no license for them). Get the authors' checkpoint; its sha256 is in the meta.yaml notes.
  • Params: 86.11763 M. Trained on ASVspoof 5 train with MUSAN/RIR augmentation (not an Arena split).
  • Score: higher = bona fide. J-SPAW_LA was scored with the PyTorch wrapper; the other datasets with the TensorRT drop-in class (FP32 on the RTX 4070 Ti SUPER; FP32 on the RTX 5060 Ti), which matched PyTorch on the full J-SPAW_LA set.

Arena results

arena tier arena rank

EER% (lower is better); EmoSpoofTTS and LRLspoof are spoof-only and use 1-SRR% at the model's DeepVoice EER threshold. Per-dataset scores are under .eval_results/.

EER% 17.83 on ASVspoof2019_LA EER% 23.49 on ASVspoof2021_LA EER% 15.55 on ASVspoof2021_DF EER% 4.86 on ASVspoof5 EER% 15.01 on InTheWild EER% 24.77 on ADD22_eval_31 EER% 31.3 on ADD2023_track12_test_r1 EER% 32.47 on CFAD EER% 5.14 on CD-ADD EER% 39.76 on CVoiceFake_small EER% 19.11 on DeepVoice EER% 33.21 on LibriSeVoc EER% 38.95 on SONAR EER% 22.36 on ArAD EER% 40.58 on DECRO EER% 6.25 on J-SPAW_LA EER% 21.92 on ODSS EER% 24.13 on HABLA EER% 8.61 on DFADD EER% 12.48 on PyAra EER% 14.16 on XMAD EER% 13.36 on EmoFake_test SRR COMPLEMENT 87.94 on EmoSpoofTTS SRR COMPLEMENT 32.21 on LRLspoof

Citation

@article{peng2025hybrid,
  title={Hybrid Pruning: In-Situ Compression of Self-Supervised Speech Models for Speaker Verification and Anti-Spoofing},
  author={Peng, Junyi and Zhang, Lin and Han, Jiangyu and Plchot, Old{\v{r}}ich and Rohdin, Johan and Stafylakis, Themos and Wang, Shuai and {\v{C}}ernock{\'y}, Jan},
  journal={arXiv preprint arXiv:2508.16232},
  year={2025}
}
Downloads last month
121
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Paper for SpeechAntiSpoofingBenchmarks/WeDefense-WavLM-Base-Pruned