Trial Set

3D-Speaker Device

Keeps the upstream cross-device trial file.

Source dataset
3D-Speaker
Trials
180000
Protocol source
Official protocol
Source split
3D-Speaker device trial file
speaker3d_device Channel/device
Direct Ranking

Systems on this trial set

18 reviewed systems currently have valid results.

Rank System Trial-Set EER ↓ Trial-Set minDCF ↓
#1 iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
6.8733 0.451193
#2 wespeaker/w2vbert2
vb2-w2vbert
15.3867 0.634773
#3 palabraai/redimnet2-b6
redimnet2
17.2700 0.778607
#4 iic/eres2netv2-zh
eresv2_zh
17.4433 0.869280
#5 wespeaker/samresnet100
vb2-sam100
18.9367 0.711080
#6 wespeaker/res293-voxceleb
wespeaker_resnet293
18.9420 0.831067
#7 iic/eres2net-en
eres_en
18.9467 0.845527
#8 wespeaker/res152-voxceleb
wespeaker_resnet152
18.9800 0.832393
#9 wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
19.8267 0.860520
#10 iic/campplus
campplus
20.1800 0.916793
#11 speechbrain/ecapa
ecapa
21.0200 0.926620
#12 wespeaker/campplus-voxceleb
campplus_wespeaker
23.4600 0.938000
#13 wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
23.8800 0.940667
#14 wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
25.3867 0.995540
#15 wespeaker/res34-cnceleb
wespeaker_r34
26.8967 0.998813
#16 microsoft/wavlm-base-plus-sv
wavlm_base
36.5133 0.999780
#17 microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
36.8213 0.999900
#18 speechbrain/xvector
xvector
42.6314 0.999900