Benchmark Scenario
In-The-Wild Robustness
Open-domain media speech. The scenario score aggregates its trial sets using the fixed OpenSVBench reporting protocol.
18 ranked systems
4 trial sets
5.1834 leading EER
Scenario Ranking
Systems on In-The-Wild Robustness
Evidence cells list trial-set rank and EER in this order: CN-Celeb · VoxCeleb1-O · VoxCeleb1-E · VoxCeleb1-H.
| Rank | System | Scenario EER ↓ | Scenario minDCF ↓ | Trial-Set Evidence Rank / EER |
|---|---|---|---|---|
| #1 |
wespeaker/w2vbert2
vb2-w2vbert
|
5.1834 | 0.162046 | |
| #2 |
wespeaker/samresnet100
vb2-sam100
|
5.2487 | 0.170274 | |
| #3 |
iic/eres2netv2-zh
eresv2_zh
|
5.5369 | 0.294964 | |
| #4 |
wespeaker/res152-voxceleb
wespeaker_resnet152
|
6.1011 | 0.224787 | |
| #5 |
palabraai/redimnet2-b6
redimnet2
|
6.4216 | 0.208137 | |
| #6 |
wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
|
6.5576 | 0.240625 | |
| #7 |
wespeaker/res293-voxceleb
wespeaker_resnet293
|
6.6344 | 0.231795 | |
| #8 |
iic/eres2net-en
eres_en
|
6.6673 | 0.251235 | |
| #9 |
iic/campplus
campplus
|
6.8211 | 0.361956 | |
| #10 |
wespeaker/res34-cnceleb
wespeaker_r34
|
7.8434 | 0.404734 | |
| #11 |
speechbrain/ecapa
ecapa
|
7.9977 | 0.317381 | |
| #12 |
wespeaker/campplus-voxceleb
campplus_wespeaker
|
8.4036 | 0.311533 | |
| #13 |
wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
|
8.5204 | 0.308148 | |
| #14 |
wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
|
8.9203 | 0.324306 | |
| #15 |
iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
|
14.2563 | 0.581636 | |
| #16 |
microsoft/wavlm-base-plus-sv
wavlm_base
|
16.5057 | 0.632600 | |
| #17 |
speechbrain/xvector
xvector
|
17.4683 | 0.675055 | |
| #18 |
microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
|
17.6846 | 0.670598 |