Benchmark Scenario
Speaking-Style Robustness
Speaking style shift. The scenario score aggregates its trial sets using the fixed OpenSVBench reporting protocol.
18 ranked systems
3 trial sets
2.7895 leading EER
Scenario Ranking
Systems on Speaking-Style Robustness
Evidence cells list trial-set rank and EER in this order: ESD · Whisper40 Whisper · Lombard Grid Lombard.
| Rank | System | Scenario EER ↓ | Scenario minDCF ↓ | Trial-Set Evidence Rank / EER |
|---|---|---|---|---|
| #1 |
wespeaker/w2vbert2
vb2-w2vbert
|
2.7895 | 0.157223 | |
| #2 |
wespeaker/res152-voxceleb
wespeaker_resnet152
|
4.1329 | 0.268357 | |
| #3 |
wespeaker/samresnet100
vb2-sam100
|
4.3042 | 0.238095 | |
| #4 |
wespeaker/res293-voxceleb
wespeaker_resnet293
|
4.3256 | 0.263660 | |
| #5 |
palabraai/redimnet2-b6
redimnet2
|
4.4502 | 0.291976 | |
| #6 |
wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
|
5.0359 | 0.303656 | |
| #7 |
iic/eres2net-en
eres_en
|
5.4878 | 0.330691 | |
| #8 |
iic/eres2netv2-zh
eresv2_zh
|
5.9688 | 0.361679 | |
| #9 |
wespeaker/campplus-voxceleb
campplus_wespeaker
|
6.3574 | 0.358438 | |
| #10 |
wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
|
6.5691 | 0.361235 | |
| #11 |
wespeaker/res34-cnceleb
wespeaker_r34
|
7.0743 | 0.410279 | |
| #12 |
wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
|
7.1128 | 0.367138 | |
| #13 |
speechbrain/ecapa
ecapa
|
7.2261 | 0.422165 | |
| #14 |
iic/campplus
campplus
|
7.5693 | 0.424138 | |
| #15 |
iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
|
8.6857 | 0.465867 | |
| #16 |
speechbrain/xvector
xvector
|
15.6681 | 0.597160 | |
| #17 |
microsoft/wavlm-base-plus-sv
wavlm_base
|
18.0734 | 0.805194 | |
| #18 |
microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
|
18.1898 | 0.805772 |