Trial Set
Whisper40 Whisper
Builds same-text neutral-to-whisper SV trials because no upstream SV trial keys are used.
- Source dataset
- Whisper40
- Trials
- 17600
- Protocol source
- Self-constructed protocol
- Source split
- Provided Whisper40 archive
Direct Ranking
Systems on this trial set
18 reviewed systems currently have valid results.
| Rank | System | Trial-Set EER ↓ | Trial-Set minDCF ↓ |
|---|---|---|---|
| #1 |
wespeaker/w2vbert2
vb2-w2vbert
|
5.8125 | 0.291250 |
| #2 |
iic/eres2netv2-zh
eresv2_zh
|
9.1250 | 0.663000 |
| #3 |
wespeaker/res152-voxceleb
wespeaker_resnet152
|
9.2500 | 0.567375 |
| #4 |
wespeaker/res293-voxceleb
wespeaker_resnet293
|
9.5562 | 0.533062 |
| #5 |
wespeaker/res34-cnceleb
wespeaker_r34
|
9.8125 | 0.615313 |
| #6 |
wespeaker/samresnet100
vb2-sam100
|
10.1250 | 0.485938 |
| #7 |
palabraai/redimnet2-b6
redimnet2
|
10.1875 | 0.646312 |
| #8 |
iic/campplus
campplus
|
11.2625 | 0.683063 |
| #9 |
wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
|
11.4375 | 0.645688 |
| #10 |
iic/eres2net-en
eres_en
|
11.8750 | 0.666250 |
| #11 |
wespeaker/campplus-voxceleb
campplus_wespeaker
|
14.0000 | 0.689750 |
| #12 |
wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
|
14.8000 | 0.736062 |
| #13 |
iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
|
14.8750 | 0.868437 |
| #14 |
speechbrain/ecapa
ecapa
|
15.6250 | 0.849062 |
| #15 |
wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
|
16.6250 | 0.780062 |
| #16 |
speechbrain/xvector
xvector
|
32.1250 | 0.999063 |
| #17 |
microsoft/wavlm-base-plus-sv
wavlm_base
|
32.6563 | 0.989187 |
| #18 |
microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
|
33.6875 | 0.997938 |