Benchmark Scenario
Accent / Dialect Robustness
Accent and dialect variation. The scenario score aggregates its trial sets using the fixed OpenSVBench reporting protocol.
18 ranked systems
2 trial sets
20.4352 leading EER
Scenario Ranking
Systems on Accent / Dialect Robustness
Evidence cells list trial-set rank and EER in this order: GLOBE · 3D-Speaker Dialect.
| Rank | System | Scenario EER ↓ | Scenario minDCF ↓ | Trial-Set Evidence Rank / EER |
|---|---|---|---|---|
| #1 |
wespeaker/w2vbert2
vb2-w2vbert
|
20.4352 | 0.641166 | |
| #2 |
iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
|
20.4447 | 0.733333 | |
| #3 |
palabraai/redimnet2-b6
redimnet2
|
21.1330 | 0.660821 | |
| #4 |
wespeaker/res152-voxceleb
wespeaker_resnet152
|
21.5254 | 0.675759 | |
| #5 |
wespeaker/res293-voxceleb
wespeaker_resnet293
|
21.7119 | 0.663725 | |
| #6 |
iic/eres2net-en
eres_en
|
21.9151 | 0.690782 | |
| #7 |
wespeaker/samresnet100
vb2-sam100
|
22.1939 | 0.666463 | |
| #8 |
wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
|
22.4273 | 0.700394 | |
| #9 |
speechbrain/ecapa
ecapa
|
23.5109 | 0.730128 | |
| #10 |
iic/eres2netv2-zh
eresv2_zh
|
23.8183 | 0.764092 | |
| #11 |
wespeaker/campplus-voxceleb
campplus_wespeaker
|
23.9283 | 0.721471 | |
| #12 |
wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
|
24.3163 | 0.734606 | |
| #13 |
wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
|
25.3328 | 0.762541 | |
| #14 |
wespeaker/res34-cnceleb
wespeaker_r34
|
25.8303 | 0.825746 | |
| #15 |
iic/campplus
campplus
|
28.9315 | 0.816441 | |
| #16 |
microsoft/wavlm-base-plus-sv
wavlm_base
|
31.3569 | 0.895666 | |
| #17 |
microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
|
32.6058 | 0.912056 | |
| #18 |
speechbrain/xvector
xvector
|
34.3436 | 0.829337 |