Trial Set

CN-Celeb Short

Uses generated short utterances as a duration-robustness supplement.

Source dataset
CN-Celeb
Trials
546964
Protocol source
Self-constructed supplement
Source split
CN-Celeb prepared evaluation pool
cnceleb_short Short-duration
Direct Ranking

Systems on this trial set

18 reviewed systems currently have valid results.

Rank System Trial-Set EER ↓ Trial-Set minDCF ↓
#1 wespeaker/res34-cnceleb
wespeaker_r34
17.6675 0.600899
#2 iic/eres2netv2-zh
eresv2_zh
17.6675 0.559834
#3 iic/campplus
campplus
19.1292 0.622269
#4 palabraai/redimnet2-b6
redimnet2
24.2213 0.769876
#5 wespeaker/res152-voxceleb
wespeaker_resnet152
24.9437 0.851112
#6 wespeaker/samresnet100
vb2-sam100
25.4042 0.714774
#7 wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
25.4223 0.914387
#8 wespeaker/w2vbert2
vb2-w2vbert
25.9130 0.658933
#9 wespeaker/res293-voxceleb
wespeaker_resnet293
26.0196 0.911865
#10 iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
26.8023 0.858622
#11 iic/eres2net-en
eres_en
27.2323 0.818788
#12 wespeaker/campplus-voxceleb
campplus_wespeaker
27.4153 0.854569
#13 speechbrain/ecapa
ecapa
28.7238 0.867746
#14 wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
29.6374 0.854863
#15 wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
30.3869 0.901376
#16 microsoft/wavlm-base-plus-sv
wavlm_base
33.2598 0.989844
#17 microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
34.0117 0.998459
#18 speechbrain/xvector
xvector
37.8590 0.985247