Trial Set

VoxCeleb1-O

Keeps the upstream VoxCeleb1-O verification protocol.

Source dataset
VoxCeleb1
Trials
37611
Protocol source
Official protocol
Source split
VoxCeleb1-O
voxceleb_o In-the-wild
Direct Ranking

Systems on this trial set

18 reviewed systems currently have valid results.

Rank System Trial-Set EER ↓ Trial-Set minDCF ↓
#1 wespeaker/w2vbert2
vb2-w2vbert
0.1489 0.010954
#2 wespeaker/samresnet100
vb2-sam100
0.2287 0.011966
#3 palabraai/redimnet2-b6
redimnet2
0.2871 0.019358
#4 wespeaker/res152-voxceleb
wespeaker_resnet152
0.4998 0.035524
#5 wespeaker/res293-voxceleb
wespeaker_resnet293
0.5159 0.037014
#6 wespeaker/campplus-voxceleb
campplus_wespeaker
0.7180 0.061049
#7 iic/eres2net-en
eres_en
0.8028 0.053980
#8 wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
0.8188 0.052968
#9 wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
0.8188 0.065623
#10 speechbrain/ecapa
ecapa
0.9038 0.071152
#11 wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
1.0371 0.085403
#12 microsoft/wavlm-base-plus-sv
wavlm_base
5.5047 0.436697
#13 microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
5.6037 0.466737
#14 iic/eres2netv2-zh
eresv2_zh
6.3852 0.421188
#15 wespeaker/res34-cnceleb
wespeaker_r34
7.0897 0.433848
#16 iic/campplus
campplus
7.7917 0.488954
#17 speechbrain/xvector
xvector
8.9618 0.489966
#18 iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
13.0837 0.638176