Trial Set

FFSVC 2022 Cross-Channel

Filters the official dev trial pairs to the channel/device robustness view.

Source dataset
FFSVC 2022
Trials
72000
Protocol source
Official protocol subset
Source split
FFSVC 2022 public dev trials
ffsvc2022_cross_channel Channel/device
Direct Ranking

Systems on this trial set

18 reviewed systems currently have valid results.

Rank System Trial-Set EER ↓ Trial-Set minDCF ↓
#1 iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
5.7472 0.351306
#2 iic/eres2netv2-zh
eresv2_zh
6.5083 0.420444
#3 palabraai/redimnet2-b6
redimnet2
8.6806 0.505111
#4 iic/campplus
campplus
8.7417 0.527583
#5 wespeaker/res293-voxceleb
wespeaker_resnet293
8.9944 0.524556
#6 wespeaker/samresnet100
vb2-sam100
9.0972 0.472500
#7 wespeaker/res152-voxceleb
wespeaker_resnet152
9.5111 0.545528
#8 wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
10.5833 0.597111
#9 wespeaker/res34-cnceleb
wespeaker_r34
10.9389 0.677111
#10 wespeaker/w2vbert2
vb2-w2vbert
11.1389 0.529167
#11 iic/eres2net-en
eres_en
11.4278 0.615056
#12 wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
12.0417 0.697056
#13 wespeaker/campplus-voxceleb
campplus_wespeaker
12.3000 0.715667
#14 speechbrain/ecapa
ecapa
12.3500 0.708500
#15 wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
13.0333 0.708806
#16 speechbrain/xvector
xvector
19.4139 0.929194
#17 microsoft/wavlm-base-plus-sv
wavlm_base
26.0500 0.995778
#18 microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
26.7500 0.998667