Benchmark Scenario

Accent / Dialect Robustness

Accent and dialect variation. The scenario score aggregates its trial sets using the fixed OpenSVBench reporting protocol.

25 ranked systems 2 trial sets 15.7615 leading EER
Scenario Ranking

Systems on Accent / Dialect Robustness

Evidence cells list trial-set rank and EER in this order: GLOBE · 3D-Speaker Dialect.

Rank System Submitted by Scenario EER ↓ Scenario minDCF ↓ Trial-Set Evidence Rank / EER
#1 w2v-bert2.0 + cc + ecapa-tdnn + astp + sf2
w2v-bert2.0 + cc + ecapa-tdnn + astp + sf2
JinghanPeng 15.7615 0.443685
#2 MECT-b2-czur-finetuned
MECT-b2-czur-finetuned
czur 15.9351 0.447792
#3 Agora Voiceprint (ResNet293)
agora_vp
agora 16.8217 0.520196
#4 W2V-BERT 2.0 + Adapter-MFA (cross-device consistency FT + weight soup)
ActionPower VoicePrint
ActionPower 18.3117 0.553127
#5 W2V-BERT 2.0 + MHFA (VoxCeleb2 + VoxBlink2)
Wav2Vec2-BERT
pengjy 19.1844 0.677736
#6 AntSpeaker/MECT-B2
antspeaker-mect-b2-vb2-full-core
Public checkpoint 19.9909 0.569899
#7 wespeaker/w2vbert2
vb2-w2vbert
Public checkpoint 20.4352 0.641166
#8 iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
Public checkpoint 20.4447 0.733333
#9 Dual-LoRA W2V-BERT2-Adapter-MFA (TidyVoice)
duallora-w2vbert2-tidyvoice-full-core
sgqt 20.7584 0.640224
#10 palabraai/redimnet2-b6
redimnet2
Public checkpoint 21.1330 0.660821
#11 palabraai/redimnet2-b6-vb2+vox2
redimnet2-b6-vb2vox2-lm-full-core
Public checkpoint 21.1791 0.581639
#12 wespeaker/res152-voxceleb
wespeaker_resnet152
Public checkpoint 21.5254 0.675759
#13 wespeaker/res293-voxceleb
wespeaker_resnet293
Public checkpoint 21.7119 0.663725
#14 iic/eres2net-en
eres_en
Public checkpoint 21.9151 0.690782
#15 wespeaker/samresnet100
vb2-sam100
Public checkpoint 22.1939 0.666463
#16 wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
Public checkpoint 22.4273 0.700394
#17 speechbrain/ecapa
ecapa
Public checkpoint 23.5109 0.730128
#18 iic/eres2netv2-zh
eresv2_zh
Public checkpoint 23.8183 0.764092
#19 wespeaker/campplus-voxceleb
campplus_wespeaker
Public checkpoint 23.9283 0.721471
#20 wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
Public checkpoint 24.3163 0.734606
#21 wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
Public checkpoint 25.3328 0.762541
#22 wespeaker/res34-cnceleb
wespeaker_r34
Public checkpoint 25.8303 0.825746
#23 iic/campplus
campplus
Public checkpoint 28.9315 0.816441
#24 microsoft/wavlm-base-plus-sv
wavlm_base
Public checkpoint 31.3569 0.895666
#25 microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
Public checkpoint 32.6058 0.912056