Trial Set

CN-Celeb

Keeps the upstream CN-Celeb evaluation trial protocol.

Source dataset
CN-Celeb
Trials
3484292
Protocol source
Official protocol
Source split
Official evaluation protocol
cnceleb In-the-wild
Direct Ranking

Systems on this trial set

18 reviewed systems currently have valid results.

Rank System Trial-Set EER ↓ Trial-Set minDCF ↓
#1 iic/eres2netv2-zh
eresv2_zh
3.8243 0.165880
#2 iic/campplus
campplus
4.7029 0.224112
#3 wespeaker/res34-cnceleb
wespeaker_r34
7.4729 0.345407
#4 wespeaker/w2vbert2
vb2-w2vbert
9.9690 0.300308
#5 wespeaker/samresnet100
vb2-sam100
9.9803 0.311502
#6 wespeaker/res152-voxceleb
wespeaker_resnet152
11.3672 0.399395
#7 wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
11.9718 0.411595
#8 iic/eres2net-en
eres_en
12.1487 0.429169
#9 palabraai/redimnet2-b6
redimnet2
12.2444 0.378920
#10 wespeaker/res293-voxceleb
wespeaker_resnet293
12.4334 0.412299
#11 iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
14.0524 0.486731
#12 speechbrain/ecapa
ecapa
15.2177 0.579855
#13 wespeaker/campplus-voxceleb
campplus_wespeaker
15.7139 0.551833
#14 wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
15.8209 0.536618
#15 wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
16.3391 0.550287
#16 speechbrain/xvector
xvector
24.2749 0.826837
#17 microsoft/wavlm-base-plus-sv
wavlm_base
27.9358 0.916549
#18 microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
29.8022 0.945410