Benchmark Scenario

Distance Robustness

Distance mismatch. The scenario score aggregates its trial sets using the fixed OpenSVBench reporting protocol.

18 ranked systems 4 trial sets 9.2638 leading EER
3D-Speaker Distance AliMeeting Near/Far CHiME-6 Domestic Far-Field FFSVC 2022 Cross-Domain
Scenario Ranking

Systems on Distance Robustness

Evidence cells list trial-set rank and EER in this order: 3D-Speaker Distance · AliMeeting Near/Far · CHiME-6 Domestic Far-Field · FFSVC 2022 Cross-Domain.

Rank System Scenario EER ↓ Scenario minDCF ↓ Trial-Set Evidence Rank / EER
#1 iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
9.2638 0.454491
#2 wespeaker/w2vbert2
vb2-w2vbert
10.1885 0.403238
#3 palabraai/redimnet2-b6
redimnet2
11.0799 0.472944
#4 wespeaker/samresnet100
vb2-sam100
11.1679 0.421520
#5 iic/eres2netv2-zh
eresv2_zh
11.2737 0.537866
#6 wespeaker/res293-voxceleb
wespeaker_resnet293
11.7700 0.508920
#7 wespeaker/res152-voxceleb
wespeaker_resnet152
11.9552 0.523450
#8 iic/eres2net-en
eres_en
12.5832 0.554135
#9 wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
12.9967 0.561170
#10 speechbrain/ecapa
ecapa
14.3300 0.630306
#11 wespeaker/campplus-voxceleb
campplus_wespeaker
14.6792 0.634129
#12 wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
15.4440 0.640785
#13 wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
16.0447 0.664732
#14 iic/campplus
campplus
16.4489 0.675161
#15 wespeaker/res34-cnceleb
wespeaker_r34
16.9924 0.739294
#16 speechbrain/xvector
xvector
24.6461 0.923625
#17 microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
28.8455 0.982128
#18 microsoft/wavlm-base-plus-sv
wavlm_base
29.1056 0.976812