Trial Set

VoxCeleb1-O

Keeps the upstream VoxCeleb1-O verification protocol.

Source dataset
VoxCeleb1
Trials
37611
Protocol source
Official protocol
Source split
VoxCeleb1-O
voxceleb_o In-the-wild
Source Dataset

About VoxCeleb1

VoxCeleb is a large-scale speaker corpus collected from online interviews and other media. Its recordings retain real-world variation in microphones, channels, background sound, and speaking conditions. VoxCeleb1-O, E, and H use established VoxCeleb verification protocols; the short-duration entry on OpenSVBench is an additional benchmark protocol.

Language
Predominantly English
VoxCeleb1
1,251 speakers and over 100,000 recordings
Source
Speech segments mined from online videos
Conditions
In-the-wild channel and background variation
Direct Ranking

Systems on this trial set

25 reviewed systems currently have valid results.

Rank System Submitted by Trial-Set EER ↓ Trial-Set minDCF ↓
#1 wespeaker/w2vbert2
vb2-w2vbert
Public checkpoint 0.1489 0.010954
#2 w2v-bert2.0 + cc + ecapa-tdnn + astp + sf2
w2v-bert2.0 + cc + ecapa-tdnn + astp + sf2
JinghanPeng 0.1542 0.009360
#3 palabraai/redimnet2-b6-vb2+vox2
redimnet2-b6-vb2vox2-lm-full-core
Public checkpoint 0.1701 0.011700
#4 W2V-BERT 2.0 + Adapter-MFA (cross-device consistency FT + weight soup)
ActionPower VoicePrint
ActionPower 0.2286 0.016646
#5 AntSpeaker/MECT-B2
antspeaker-mect-b2-vb2-full-core
Public checkpoint 0.2287 0.011699
#6 wespeaker/samresnet100
vb2-sam100
Public checkpoint 0.2287 0.011966
#7 W2V-BERT 2.0 + MHFA (VoxCeleb2 + VoxBlink2)
Wav2Vec2-BERT
pengjy 0.2658 0.025633
#8 palabraai/redimnet2-b6
redimnet2
Public checkpoint 0.2871 0.019358
#9 Dual-LoRA W2V-BERT2-Adapter-MFA (TidyVoice)
duallora-w2vbert2-tidyvoice-full-core
sgqt 0.3776 0.026057
#10 wespeaker/res152-voxceleb
wespeaker_resnet152
Public checkpoint 0.4998 0.035524
#11 wespeaker/res293-voxceleb
wespeaker_resnet293
Public checkpoint 0.5159 0.037014
#12 Agora Voiceprint (ResNet293)
agora_vp
agora 0.6170 0.031324
#13 wespeaker/campplus-voxceleb
campplus_wespeaker
Public checkpoint 0.7180 0.061049
#14 iic/eres2net-en
eres_en
Public checkpoint 0.8028 0.053980
#15 wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
Public checkpoint 0.8188 0.052968
#16 wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
Public checkpoint 0.8188 0.065623
#17 speechbrain/ecapa
ecapa
Public checkpoint 0.9038 0.071152
#18 MECT-b2-czur-finetuned
MECT-b2-czur-finetuned
czur 0.9095 0.066421
#19 wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
Public checkpoint 1.0371 0.085403
#20 microsoft/wavlm-base-plus-sv
wavlm_base
Public checkpoint 5.5047 0.436697
#21 microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
Public checkpoint 5.6037 0.466737
#22 iic/eres2netv2-zh
eresv2_zh
Public checkpoint 6.3852 0.421188
#23 wespeaker/res34-cnceleb
wespeaker_r34
Public checkpoint 7.0897 0.433848
#24 iic/campplus
campplus
Public checkpoint 7.7917 0.488954
#25 iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
Public checkpoint 13.0837 0.638176