OpenSVBench Speaker verification benchmark
Benchmark Scenario

Overlap Robustness

Overlapping speakers. The scenario score aggregates its trial sets using the fixed OpenSVBench reporting protocol.

25 ranked systems 2 trial sets 7.6917 leading EER
AliMeeting Overlap CHiME-6 Overlap
All scenarios Global leaderboard
Scenario Ranking

Systems on Overlap Robustness

Evidence cells list trial-set rank and EER in this order: AliMeeting Overlap · CHiME-6 Overlap.

Rank System Submitted by Scenario EER ↓ Scenario minDCF ↓ Trial-Set Evidence Rank / EER
#1 w2v-bert2.0 + cc + ecapa-tdnn + astp + sf2
w2v-bert2.0 + cc + ecapa-tdnn + astp + sf2
 JinghanPeng 7.6917 0.398388
#1 4.0333 #2 11.3500
#2 W2V-BERT 2.0 + MHFA (VoxCeleb2 + VoxBlink2)
Wav2Vec2-BERT
 pengjy 8.1093 0.560809
#5 5.1047 #1 11.1139
#3 MECT-b2-czur-finetuned
MECT-b2-czur-finetuned
 czur 8.3971 0.410954
#2 4.0720 #8 12.7222
#4 W2V-BERT 2.0 + Adapter-MFA (cross-device consistency FT + weight soup)
ActionPower VoicePrint
 ActionPower 8.5461 0.425573
#6 5.1560 #5 11.9361
#5 palabraai/redimnet2-b6-vb2+vox2
redimnet2-b6-vb2vox2-lm-full-core
 Public checkpoint 8.9944 0.440323
#7 6.1000 #4 11.8889
#6 AntSpeaker/MECT-B2
antspeaker-mect-b2-vb2-full-core
 Public checkpoint 9.0061 0.442528
#8 6.5733 #3 11.4389
#7 Agora Voiceprint (ResNet293)
agora_vp
 agora 9.3858 0.412967
#3 4.6467 #11 14.1250
#8 Dual-LoRA W2V-BERT2-Adapter-MFA (TidyVoice)
duallora-w2vbert2-tidyvoice-full-core
 sgqt 9.8938 0.450429
#10 7.3153 #7 12.4722
#9 wespeaker/w2vbert2
vb2-w2vbert
 Public checkpoint 10.1383 0.467346
#12 7.9267 #6 12.3500
#10 palabraai/redimnet2-b6
redimnet2
 Public checkpoint 10.6981 0.524446
#11 7.4240 #10 13.9722
#11 wespeaker/samresnet100
vb2-sam100
 Public checkpoint 11.0912 0.502019
#13 8.4047 #9 13.7778
#12 wespeaker/res293-voxceleb
wespeaker_resnet293
 Public checkpoint 12.3294 0.554516
#17 9.5200 #12 15.1389
#13 wespeaker/res152-voxceleb
wespeaker_resnet152
 Public checkpoint 12.9553 0.565796
#16 9.3467 #13 16.5639
#14 iic/eres2net-en
eres_en
 Public checkpoint 13.7639 0.580907
#19 10.3333 #15 17.1944
#15 wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
 Public checkpoint 13.9414 0.591408
#18 9.9940 #17 17.8889
#16 wespeaker/campplus-voxceleb
campplus_wespeaker
 Public checkpoint 14.0816 0.622128
#20 11.2187 #14 16.9444
#17 iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
 Public checkpoint 14.3667 0.552132
#4 4.9000 #22 23.8333
#18 wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
 Public checkpoint 14.6411 0.618143
#21 11.3933 #16 17.8889
#19 speechbrain/ecapa
ecapa
 Public checkpoint 14.8522 0.616222
#22 11.5933 #18 18.1111
#20 iic/eres2netv2-zh
eresv2_zh
 Public checkpoint 14.8800 0.543251
#9 6.5933 #20 23.1667
#21 wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
 Public checkpoint 14.9489 0.650355
#23 11.6200 #19 18.2778
#22 wespeaker/res34-cnceleb
wespeaker_r34
 Public checkpoint 16.4122 0.671276
#15 9.1467 #21 23.6778
#23 iic/campplus
campplus
 Public checkpoint 18.6371 0.617367
#14 8.9687 #23 28.3056
#24 microsoft/wavlm-base-plus-sv
wavlm_base
 Public checkpoint 26.0906 0.926016
#24 21.8200 #25 30.3611
#25 microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
 Public checkpoint 26.5022 0.944448
#25 23.5933 #24 29.4111