korallll commited on
Commit
96aa555
·
verified ·
1 Parent(s): ab733e9

Add Speech Anti-Spoofing Arena badges + per-dataset backlink result.yaml

Browse files
.eval_results/SpeechAntiSpoofingBenchmarks/ASVspoof2019_LA/result.yaml ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ schema_version: 1
2
+ system:
3
+ name: Spectra-AASIST3
4
+ slug: spectra-aasist3
5
+ dataset:
6
+ id: SpeechAntiSpoofingBenchmarks/ASVspoof2019_LA
7
+ revision: 9492c4a85ad91508b6da03c92c98c58aeaa02424
8
+ split: test
9
+ scores:
10
+ eer_percent: 0.9653297076818491
11
+ n_trials: 71237
12
+ n_skipped: 0
13
+ arena:
14
+ url: https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena
15
+ system_url: https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=spectra-aasist3
16
+ artifact:
17
+ scores_url: https://huggingface.co/lab260/Spectra-AASIST3/resolve/ab733e9cd6346fad70802be6aba05fe14ee8ceac/.eval_results/SpeechAntiSpoofingBenchmarks/ASVspoof2019_LA/scores.txt
.eval_results/SpeechAntiSpoofingBenchmarks/ASVspoof2021_DF/result.yaml ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ schema_version: 1
2
+ system:
3
+ name: Spectra-AASIST3
4
+ slug: spectra-aasist3
5
+ dataset:
6
+ id: SpeechAntiSpoofingBenchmarks/ASVspoof2021_DF
7
+ revision: 16d4f7d6c68694ac9b0bd43b83df322d1bc5102e
8
+ split: test
9
+ scores:
10
+ eer_percent: 4.297773976090101
11
+ n_trials: 611829
12
+ n_skipped: 0
13
+ arena:
14
+ url: https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena
15
+ system_url: https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=spectra-aasist3
16
+ artifact:
17
+ scores_url: https://huggingface.co/lab260/Spectra-AASIST3/resolve/ab733e9cd6346fad70802be6aba05fe14ee8ceac/.eval_results/SpeechAntiSpoofingBenchmarks/ASVspoof2021_DF/scores.txt
.eval_results/SpeechAntiSpoofingBenchmarks/ASVspoof2021_LA/result.yaml ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ schema_version: 1
2
+ system:
3
+ name: Spectra-AASIST3
4
+ slug: spectra-aasist3
5
+ dataset:
6
+ id: SpeechAntiSpoofingBenchmarks/ASVspoof2021_LA
7
+ revision: dc119733697c946fcd17fe7c1541d7f26b4bbe07
8
+ split: test
9
+ scores:
10
+ eer_percent: 4.378929113375244
11
+ n_trials: 181566
12
+ n_skipped: 0
13
+ arena:
14
+ url: https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena
15
+ system_url: https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=spectra-aasist3
16
+ artifact:
17
+ scores_url: https://huggingface.co/lab260/Spectra-AASIST3/resolve/ab733e9cd6346fad70802be6aba05fe14ee8ceac/.eval_results/SpeechAntiSpoofingBenchmarks/ASVspoof2021_LA/scores.txt
.eval_results/SpeechAntiSpoofingBenchmarks/CD-ADD/result.yaml ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ schema_version: 1
2
+ system:
3
+ name: Spectra-AASIST3
4
+ slug: spectra-aasist3
5
+ dataset:
6
+ id: SpeechAntiSpoofingBenchmarks/CD-ADD
7
+ revision: c2de87d49b268b624e6af7440dc2890703098965
8
+ split: test
9
+ scores:
10
+ eer_percent: 0.0
11
+ n_trials: 20786
12
+ n_skipped: 0
13
+ arena:
14
+ url: https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena
15
+ system_url: https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=spectra-aasist3
16
+ artifact:
17
+ scores_url: https://huggingface.co/lab260/Spectra-AASIST3/resolve/ab733e9cd6346fad70802be6aba05fe14ee8ceac/.eval_results/SpeechAntiSpoofingBenchmarks/CD-ADD/scores.txt
.eval_results/SpeechAntiSpoofingBenchmarks/InTheWild/result.yaml ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ schema_version: 1
2
+ system:
3
+ name: Spectra-AASIST3
4
+ slug: spectra-aasist3
5
+ dataset:
6
+ id: SpeechAntiSpoofingBenchmarks/InTheWild
7
+ revision: a957f2582802cdb5964e118818c2e46b3d61aa35
8
+ split: test
9
+ scores:
10
+ eer_percent: 1.2022241146120323
11
+ n_trials: 31779
12
+ n_skipped: 0
13
+ arena:
14
+ url: https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena
15
+ system_url: https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=spectra-aasist3
16
+ artifact:
17
+ scores_url: https://huggingface.co/lab260/Spectra-AASIST3/resolve/ab733e9cd6346fad70802be6aba05fe14ee8ceac/.eval_results/SpeechAntiSpoofingBenchmarks/InTheWild/scores.txt
README.md CHANGED
@@ -104,6 +104,28 @@ model-index:
104
  value: 12.968
105
  ---
106
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
107
  ## Model Card: Spectra-AASIST3 (anti-spoofing / bonafide vs spoof)
108
 
109
  `Spectra-AASIST3` is a model for **speech spoofing detection** (binary classification: `bonafide` vs `spoof`) from **raw audio waveforms**. Architecture: SSL encoder (`Wav2Vec2`) → MLP projection → `AASIST3` 2-class classifier.
 
104
  value: 12.968
105
  ---
106
 
107
+ ## 🛡️ Speech Anti-Spoofing Arena
108
+
109
+ Independently evaluated on the reproducible [Speech Anti-Spoofing Arena](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=spectra-aasist3) (scores
110
+ sha-pinned; reproduced via `speech-spoof-bench reproduce --scoring`). As a pre-release /
111
+ unpublished model it is listed in the **🔓 Unpublished / Proprietary** tier (unranked).
112
+
113
+ [![EER% 0.00 on CD-ADD](https://img.shields.io/badge/EER%25%20on%20CD--ADD-0.00%25-brightgreen)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=spectra-aasist3)
114
+ [![EER% 0.97 on ASVspoof2019_LA](https://img.shields.io/badge/EER%25%20on%20ASVspoof2019__LA-0.97%25-brightgreen)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=spectra-aasist3)
115
+ [![EER% 1.20 on InTheWild](https://img.shields.io/badge/EER%25%20on%20InTheWild-1.20%25-brightgreen)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=spectra-aasist3)
116
+ [![EER% 4.30 on ASVspoof2021_DF](https://img.shields.io/badge/EER%25%20on%20ASVspoof2021__DF-4.30%25-green)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=spectra-aasist3)
117
+ [![EER% 4.38 on ASVspoof2021_LA](https://img.shields.io/badge/EER%25%20on%20ASVspoof2021__LA-4.38%25-green)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=spectra-aasist3)
118
+ [![arena tier](https://img.shields.io/endpoint?url=https://speechantispoofingbenchmarks-speechantispoofingarena.hf.space/badge/spectra-aasist3/tier.json)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=spectra-aasist3)
119
+ [![arena rank](https://img.shields.io/endpoint?url=https://speechantispoofingbenchmarks-speechantispoofingarena.hf.space/badge/spectra-aasist3/rank.json)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=spectra-aasist3)
120
+
121
+ | Dataset | EER % | Trials |
122
+ |---|---|---|
123
+ | CD-ADD | 0.00 | 20,786 |
124
+ | ASVspoof2019_LA | 0.97 | 71,237 |
125
+ | InTheWild | 1.20 | 31,779 |
126
+ | ASVspoof2021_DF | 4.30 | 611,829 |
127
+ | ASVspoof2021_LA | 4.38 | 181,566 |
128
+
129
  ## Model Card: Spectra-AASIST3 (anti-spoofing / bonafide vs spoof)
130
 
131
  `Spectra-AASIST3` is a model for **speech spoofing detection** (binary classification: `bonafide` vs `spoof`) from **raw audio waveforms**. Architecture: SSL encoder (`Wav2Vec2`) → MLP projection → `AASIST3` 2-class classifier.