Benchmark Scenario
Channel / Device Robustness
Device and channel variation. The scenario score aggregates its trial sets using the fixed OpenSVBench reporting protocol.
18 ranked systems
2 trial sets
6.3103 leading EER
Scenario Ranking
Systems on Channel / Device Robustness
Evidence cells list trial-set rank and EER in this order: 3D-Speaker Device · FFSVC 2022 Cross-Channel.
| Rank | System | Scenario EER ↓ | Scenario minDCF ↓ | Trial-Set Evidence Rank / EER |
|---|---|---|---|---|
| #1 |
iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
|
6.3103 | 0.401249 | |
| #2 |
iic/eres2netv2-zh
eresv2_zh
|
11.9758 | 0.644862 | |
| #3 |
palabraai/redimnet2-b6
redimnet2
|
12.9753 | 0.641859 | |
| #4 |
wespeaker/w2vbert2
vb2-w2vbert
|
13.2628 | 0.581970 | |
| #5 |
wespeaker/res293-voxceleb
wespeaker_resnet293
|
13.9682 | 0.677811 | |
| #6 |
wespeaker/samresnet100
vb2-sam100
|
14.0169 | 0.591790 | |
| #7 |
wespeaker/res152-voxceleb
wespeaker_resnet152
|
14.2456 | 0.688961 | |
| #8 |
iic/campplus
campplus
|
14.4608 | 0.722188 | |
| #9 |
iic/eres2net-en
eres_en
|
15.1872 | 0.730291 | |
| #10 |
wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
|
15.2050 | 0.728816 | |
| #11 |
speechbrain/ecapa
ecapa
|
16.6850 | 0.817560 | |
| #12 |
wespeaker/campplus-voxceleb
campplus_wespeaker
|
17.8800 | 0.826833 | |
| #13 |
wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
|
18.4567 | 0.824736 | |
| #14 |
wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
|
18.7142 | 0.846298 | |
| #15 |
wespeaker/res34-cnceleb
wespeaker_r34
|
18.9178 | 0.837962 | |
| #16 |
speechbrain/xvector
xvector
|
31.0227 | 0.964547 | |
| #17 |
microsoft/wavlm-base-plus-sv
wavlm_base
|
31.2817 | 0.997779 | |
| #18 |
microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
|
31.7857 | 0.999283 |