Trial Set

ESD

Builds cross-emotion SV trials from speaker and emotion labels.

Source dataset
ESD
Trials
437408
Protocol source
Self-constructed protocol
Source split
Public ESD recordings
esd Speaking style
Direct Ranking

Systems on this trial set

18 reviewed systems currently have valid results.

Rank System Trial-Set EER ↓ Trial-Set minDCF ↓
#1 wespeaker/w2vbert2
vb2-w2vbert
2.5000 0.175313
#2 wespeaker/samresnet100
vb2-sam100
2.7503 0.223690
#3 wespeaker/res152-voxceleb
wespeaker_resnet152
3.0742 0.225959
#4 palabraai/redimnet2-b6
redimnet2
3.0850 0.221939
#5 wespeaker/res293-voxceleb
wespeaker_resnet293
3.2714 0.243165
#6 wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
3.5211 0.254288
#7 iic/eres2net-en
eres_en
4.3650 0.310919
#8 wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
4.4900 0.305853
#9 wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
4.6018 0.330355
#10 wespeaker/campplus-voxceleb
campplus_wespeaker
4.6625 0.346034
#11 speechbrain/ecapa
ecapa
5.7925 0.396047
#12 iic/eres2netv2-zh
eresv2_zh
7.5779 0.346889
#13 wespeaker/res34-cnceleb
wespeaker_r34
8.0200 0.419287
#14 iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
9.4684 0.428828
#15 iic/campplus
campplus
9.6571 0.470165
#16 microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
12.8825 0.923664
#17 speechbrain/xvector
xvector
13.0389 0.693274
#18 microsoft/wavlm-base-plus-sv
wavlm_base
13.3674 0.882281