Benchmark Scenario

Cross-Lingual Robustness

Language mismatch. The scenario score aggregates its trial sets using the fixed OpenSVBench reporting protocol.

25 ranked systems 1 trial set 1.6577 leading EER
Scenario Ranking

Systems on Cross-Lingual Robustness

Evidence cells list trial-set rank and EER in this order: TidyVoiceX2-ASV.

Rank System Submitted by Scenario EER ↓ Scenario minDCF ↓ Trial-Set Evidence Rank / EER
#1 Dual-LoRA W2V-BERT2-Adapter-MFA (TidyVoice)
duallora-w2vbert2-tidyvoice-full-core
sgqt 1.6577 0.102286
#2 w2v-bert2.0 + cc + ecapa-tdnn + astp + sf2
w2v-bert2.0 + cc + ecapa-tdnn + astp + sf2
JinghanPeng 1.8522 0.125335
#3 MECT-b2-czur-finetuned
MECT-b2-czur-finetuned
czur 1.8679 0.126853
#4 W2V-BERT 2.0 + Adapter-MFA (cross-device consistency FT + weight soup)
ActionPower VoicePrint
ActionPower 2.2873 0.179755
#5 Agora Voiceprint (ResNet293)
agora_vp
agora 2.3854 0.170770
#6 AntSpeaker/MECT-B2
antspeaker-mect-b2-vb2-full-core
Public checkpoint 2.6211 0.254113
#7 W2V-BERT 2.0 + MHFA (VoxCeleb2 + VoxBlink2)
Wav2Vec2-BERT
pengjy 2.6605 0.211953
#8 palabraai/redimnet2-b6-vb2+vox2
redimnet2-b6-vb2vox2-lm-full-core
Public checkpoint 3.4191 0.259714
#9 wespeaker/w2vbert2
vb2-w2vbert
Public checkpoint 4.4676 0.330255
#10 wespeaker/samresnet100
vb2-sam100
Public checkpoint 4.7178 0.362506
#11 wespeaker/res293-voxceleb
wespeaker_resnet293
Public checkpoint 4.7483 0.298819
#12 palabraai/redimnet2-b6
redimnet2
Public checkpoint 4.7707 0.339730
#13 wespeaker/res152-voxceleb
wespeaker_resnet152
Public checkpoint 4.8269 0.305505
#14 iic/eres2netv2-zh
eresv2_zh
Public checkpoint 5.3320 0.299692
#15 iic/eres2net-en
eres_en
Public checkpoint 5.5284 0.374254
#16 wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
Public checkpoint 5.5532 0.361444
#17 wespeaker/campplus-voxceleb
campplus_wespeaker
Public checkpoint 6.1851 0.403050
#18 iic/campplus
campplus
Public checkpoint 6.4713 0.346271
#19 wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
Public checkpoint 6.5083 0.405096
#20 wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
Public checkpoint 6.9847 0.436029
#21 wespeaker/res34-cnceleb
wespeaker_r34
Public checkpoint 7.5770 0.460771
#22 speechbrain/ecapa
ecapa
Public checkpoint 7.6275 0.509746
#23 iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
Public checkpoint 8.5536 0.499376
#24 microsoft/wavlm-base-plus-sv
wavlm_base
Public checkpoint 21.7152 0.966351
#25 microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
Public checkpoint 23.2288 0.970581