Trial Set

VOiCES Noise/Reverb

Uses the 6,400-recording devkit test split, not the VOiCES 2019 challenge trial keys.

Source dataset
VOiCES
Trials
55000
Protocol source
Self-constructed protocol subset
Source split
VOiCES devkit test split
voices_noise_reverb Noise/reverb
Direct Ranking

Systems on this trial set

18 reviewed systems currently have valid results.

Rank System Trial-Set EER ↓ Trial-Set minDCF ↓
#1 wespeaker/w2vbert2
vb2-w2vbert
2.5800 0.074040
#2 wespeaker/samresnet100
vb2-sam100
2.9800 0.098660
#3 palabraai/redimnet2-b6
redimnet2
3.1200 0.114220
#4 iic/eres2net-en
eres_en
4.7200 0.148640
#5 wespeaker/res152-voxceleb
wespeaker_resnet152
5.2600 0.154640
#6 wespeaker/res293-voxceleb
wespeaker_resnet293
5.3600 0.148780
#7 speechbrain/ecapa
ecapa
5.5800 0.213320
#8 wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
5.9280 0.181180
#9 wespeaker/campplus-voxceleb
campplus_wespeaker
6.4600 0.220820
#10 wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
6.6060 0.214720
#11 wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
7.6160 0.264660
#12 iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
8.7040 0.382320
#13 iic/eres2netv2-zh
eresv2_zh
11.6800 0.402500
#14 wespeaker/res34-cnceleb
wespeaker_r34
16.6400 0.531160
#15 speechbrain/xvector
xvector
19.0800 0.568120
#16 microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
20.9800 0.741000
#17 microsoft/wavlm-base-plus-sv
wavlm_base
21.0600 0.742060
#18 iic/campplus
campplus
23.4800 0.737920