Trial Set

GLOBE

No upstream SV trial keys are used; trials are generated from a frozen 10k-utterance subset spanning selected Hugging Face train and test shards.

Source dataset
GLOBE
Trials
56848
Protocol source
Self-constructed protocol
Source split
GLOBE_V2 canonical HF train+test shards
globe Accent/dialect
Direct Ranking

Systems on this trial set

18 reviewed systems currently have valid results.

Rank System Trial-Set EER ↓ Trial-Set minDCF ↓
#1 wespeaker/w2vbert2
vb2-w2vbert
24.5937 0.512152
#2 wespeaker/samresnet100
vb2-sam100
24.8065 0.531753
#3 palabraai/redimnet2-b6
redimnet2
25.0193 0.533495
#4 wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
25.0600 0.531734
#5 wespeaker/res152-voxceleb
wespeaker_resnet152
25.0967 0.533224
#6 iic/eres2net-en
eres_en
25.1935 0.535991
#7 wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
25.4257 0.525755
#8 speechbrain/ecapa
ecapa
25.4450 0.533282
#9 wespeaker/res293-voxceleb
wespeaker_resnet293
25.4837 0.531618
#10 wespeaker/campplus-voxceleb
campplus_wespeaker
25.6966 0.530070
#11 wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
25.7740 0.541118
#12 wespeaker/res34-cnceleb
wespeaker_r34
26.3293 0.658746
#13 iic/eres2netv2-zh
eresv2_zh
26.7067 0.580650
#14 microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
26.9350 0.824245
#15 microsoft/wavlm-base-plus-sv
wavlm_base
27.0704 0.791331
#16 speechbrain/xvector
xvector
27.2639 0.658882
#17 iic/campplus
campplus
27.7090 0.634462
#18 iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
28.8893 0.801800