Trial Set
CHiME-6 Overlap
Uses dev sessions to build clean-enroll to overlap-test same-channel trials.
- Source dataset
- CHiME-6
- Trials
- 39600
- Protocol source
- Self-constructed protocol
- Source split
- CHiME-6 dev split
Direct Ranking
Systems on this trial set
18 reviewed systems currently have valid results.
| Rank | System | Trial-Set EER ↓ | Trial-Set minDCF ↓ |
|---|---|---|---|
| #1 |
wespeaker/w2vbert2
vb2-w2vbert
|
12.3500 | 0.603472 |
| #2 |
wespeaker/samresnet100
vb2-sam100
|
13.7778 | 0.612972 |
| #3 |
palabraai/redimnet2-b6
redimnet2
|
13.9722 | 0.658139 |
| #4 |
wespeaker/res293-voxceleb
wespeaker_resnet293
|
15.1389 | 0.626972 |
| #5 |
wespeaker/res152-voxceleb
wespeaker_resnet152
|
16.5639 | 0.642111 |
| #6 |
wespeaker/campplus-voxceleb
campplus_wespeaker
|
16.9444 | 0.668250 |
| #7 |
iic/eres2net-en
eres_en
|
17.1944 | 0.658028 |
| #8 |
wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
|
17.8889 | 0.675139 |
| #9 |
wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
|
17.8889 | 0.651583 |
| #10 |
speechbrain/ecapa
ecapa
|
18.1111 | 0.681778 |
| #11 |
wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
|
18.2778 | 0.716417 |
| #12 |
iic/eres2netv2-zh
eresv2_zh
|
23.1667 | 0.743694 |
| #13 |
wespeaker/res34-cnceleb
wespeaker_r34
|
23.6778 | 0.833472 |
| #14 |
iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
|
23.8333 | 0.823583 |
| #15 |
iic/campplus
campplus
|
28.3056 | 0.837667 |
| #16 |
microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
|
29.4111 | 0.923250 |
| #17 |
speechbrain/xvector
xvector
|
30.1667 | 0.964667 |
| #18 |
microsoft/wavlm-base-plus-sv
wavlm_base
|
30.3611 | 0.924111 |