Trial Set

FFSVC 2022 Cross-Domain

Filters the official dev trial pairs to the near/far domain robustness view.

Source dataset
FFSVC 2022
Trials
66546
Protocol source
Official protocol subset
Source split
FFSVC 2022 public dev trials
ffsvc2022_cross_domain Distance
Direct Ranking

Systems on this trial set

18 reviewed systems currently have valid results.

Rank System Trial-Set EER ↓ Trial-Set minDCF ↓
#1 iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
5.8125 0.357548
#2 iic/eres2netv2-zh
eresv2_zh
6.6987 0.430696
#3 iic/campplus
campplus
8.7533 0.539182
#4 palabraai/redimnet2-b6
redimnet2
8.8886 0.517318
#5 wespeaker/res293-voxceleb
wespeaker_resnet293
9.1379 0.532346
#6 wespeaker/samresnet100
vb2-sam100
9.2164 0.478007
#7 wespeaker/res152-voxceleb
wespeaker_resnet152
9.6636 0.556279
#8 wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
10.7439 0.612159
#9 wespeaker/res34-cnceleb
wespeaker_r34
11.0514 0.689180
#10 wespeaker/w2vbert2
vb2-w2vbert
11.3097 0.539530
#11 iic/eres2net-en
eres_en
11.5618 0.628141
#12 wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
12.1783 0.703849
#13 wespeaker/campplus-voxceleb
campplus_wespeaker
12.4278 0.723857
#14 speechbrain/ecapa
ecapa
12.4662 0.716863
#15 wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
13.1585 0.719381
#16 speechbrain/xvector
xvector
19.5093 0.933937
#17 microsoft/wavlm-base-plus-sv
wavlm_base
26.2121 0.996206
#18 microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
26.9545 0.999067