Trial Set

CHiME-6 Domestic Far-Field

Uses dev sessions with location/ref metadata to build wearable-to-array domestic far-field trials.

Source dataset
CHiME-6
Trials
36487
Protocol source
Self-constructed protocol
Source split
CHiME-6 dev split
chime6_domestic_farfield Distance
Direct Ranking

Systems on this trial set

18 reviewed systems currently have valid results.

Rank System Trial-Set EER ↓ Trial-Set minDCF ↓
#1 wespeaker/w2vbert2
vb2-w2vbert
6.6928 0.260295
#2 wespeaker/samresnet100
vb2-sam100
8.4112 0.319174
#3 palabraai/redimnet2-b6
redimnet2
8.4715 0.379560
#4 wespeaker/res293-voxceleb
wespeaker_resnet293
11.1336 0.435876
#5 wespeaker/res152-voxceleb
wespeaker_resnet152
12.0320 0.480796
#6 iic/eres2net-en
eres_en
12.0892 0.487278
#7 speechbrain/ecapa
ecapa
12.4299 0.530841
#8 wespeaker/campplus-voxceleb
campplus_wespeaker
13.0540 0.549864
#9 wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
13.6569 0.577058
#10 wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
13.6871 0.500573
#11 wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
15.1040 0.585680
#12 iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
17.2988 0.733554
#13 iic/eres2netv2-zh
eresv2_zh
18.3901 0.771721
#14 wespeaker/res34-cnceleb
wespeaker_r34
22.9123 0.914742
#15 speechbrain/xvector
xvector
23.8288 0.972807
#16 iic/campplus
campplus
24.2086 0.902834
#17 microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
26.7802 0.970516
#18 microsoft/wavlm-base-plus-sv
wavlm_base
29.0021 0.989720