Benchmark Scenario

Speaking-Style Robustness

Speaking style shift. The scenario score aggregates its trial sets using the fixed OpenSVBench reporting protocol.

25 ranked systems 3 trial sets 1.9166 leading EER

Scenario Ranking

Systems on Speaking-Style Robustness

Evidence cells list trial-set rank and EER in this order: ESD · Whisper40 Whisper · Lombard Grid Lombard.

Rank	System	Submitted by	Scenario EER ↓	Scenario minDCF ↓	Trial-Set Evidence Rank / EER
#1	W2V-BERT 2.0 + MHFA (VoxCeleb2 + VoxBlink2) Wav2Vec2-BERT	pengjy	1.9166	0.153402	#5 1.7975 #1 3.9375 #2 0.0149
#2	w2v-bert2.0 + cc + ecapa-tdnn + astp + sf2 w2v-bert2.0 + cc + ecapa-tdnn + astp + sf2	JinghanPeng	1.9866	0.119754	#4 1.7975 #2 4.1250 #5 0.0373
#3	W2V-BERT 2.0 + Adapter-MFA (cross-device consistency FT + weight soup) ActionPower VoicePrint	ActionPower	2.1700	0.129878	#2 1.4529 #4 4.9938 #9 0.0633
#4	Dual-LoRA W2V-BERT2-Adapter-MFA (TidyVoice) duallora-w2vbert2-tidyvoice-full-core	sgqt	2.3500	0.152707	#3 1.7750 #5 5.2562 #3 0.0186
#5	palabraai/redimnet2-b6-vb2+vox2 redimnet2-b6-vb2vox2-lm-full-core	Public checkpoint	2.3792	0.145230	#7 2.3127 #3 4.7875 #4 0.0373
#6	wespeaker/w2vbert2 vb2-w2vbert	Public checkpoint	2.7895	0.157223	#8 2.5000 #6 5.8125 #7 0.0559
#7	AntSpeaker/MECT-B2 antspeaker-mect-b2-vb2-full-core	Public checkpoint	2.9458	0.150257	#1 1.2675 #8 7.5625 #1 0.0075
#8	MECT-b2-czur-finetuned MECT-b2-czur-finetuned	czur	3.0190	0.171062	#6 2.1225 #7 6.8750 #8 0.0596
#9	Agora Voiceprint (ResNet293) agora_vp	agora	3.9828	0.223228	#9 2.5025 #11 9.3750 #10 0.0708
#10	wespeaker/res152-voxceleb wespeaker_resnet152	Public checkpoint	4.1329	0.268357	#11 3.0742 #10 9.2500 #11 0.0745
#11	wespeaker/samresnet100 vb2-sam100	Public checkpoint	4.3042	0.238095	#10 2.7503 #14 10.1250 #6 0.0373
#12	wespeaker/res293-voxceleb wespeaker_resnet293	Public checkpoint	4.3256	0.263660	#13 3.2714 #12 9.5562 #14 0.1490
#13	palabraai/redimnet2-b6 redimnet2	Public checkpoint	4.4502	0.291976	#12 3.0850 #15 10.1875 #12 0.0782
#14	wespeaker/res34-voxceleb wespeaker_resnet34_voxceleb	Public checkpoint	5.0359	0.303656	#14 3.5211 #17 11.4375 #13 0.1490
#15	iic/eres2net-en eres_en	Public checkpoint	5.4878	0.330691	#15 4.3650 #18 11.8750 #16 0.2235
#16	iic/eres2netv2-zh eresv2_zh	Public checkpoint	5.9688	0.361679	#20 7.5779 #9 9.1250 #20 1.2034
#17	wespeaker/campplus-voxceleb campplus_wespeaker	Public checkpoint	6.3574	0.358438	#18 4.6625 #19 14.0000 #19 0.4098
#18	wespeaker/ecapa1024-voxceleb wespeaker_ecapa1024	Public checkpoint	6.5691	0.361235	#17 4.6018 #20 14.8000 #18 0.3055
#19	wespeaker/res34-cnceleb wespeaker_r34	Public checkpoint	7.0743	0.410279	#21 8.0200 #13 9.8125 #23 3.3905
#20	wespeaker/ecapa512-voxceleb wespeaker_ecapa512	Public checkpoint	7.1128	0.367138	#16 4.4900 #23 16.6250 #15 0.2235
#21	speechbrain/ecapa ecapa	Public checkpoint	7.2261	0.422165	#19 5.7925 #22 15.6250 #17 0.2608
#22	iic/campplus campplus	Public checkpoint	7.5693	0.424138	#23 9.6571 #16 11.2625 #22 1.7884
#23	iic/eres2net-large-3dspeaker eres2net_large_3dspeaker	Public checkpoint	8.6857	0.465867	#22 9.4684 #21 14.8750 #21 1.7139
#24	microsoft/wavlm-base-plus-sv wavlm_base	Public checkpoint	18.0734	0.805194	#25 13.3674 #24 32.6563 #25 8.1967
#25	microsoft/unispeech-sat-base-plus-sv unispeech_sat_base_plus	Public checkpoint	18.1898	0.805772	#24 12.8825 #25 33.6875 #24 7.9993