Benchmark Scenario
Cross-Lingual Robustness
Language mismatch. The scenario score aggregates its trial sets using the fixed OpenSVBench reporting protocol.
18 ranked systems
1 trial set
4.4676 leading EER
Scenario Ranking
Systems on Cross-Lingual Robustness
Evidence cells list trial-set rank and EER in this order: TidyVoiceX2-ASV.
| Rank | System | Scenario EER ↓ | Scenario minDCF ↓ | Trial-Set Evidence Rank / EER |
|---|---|---|---|---|
| #1 |
wespeaker/w2vbert2
vb2-w2vbert
|
4.4676 | 0.330255 | |
| #2 |
wespeaker/samresnet100
vb2-sam100
|
4.7178 | 0.362506 | |
| #3 |
wespeaker/res293-voxceleb
wespeaker_resnet293
|
4.7483 | 0.298819 | |
| #4 |
palabraai/redimnet2-b6
redimnet2
|
4.7707 | 0.339730 | |
| #5 |
wespeaker/res152-voxceleb
wespeaker_resnet152
|
4.8269 | 0.305505 | |
| #6 |
iic/eres2netv2-zh
eresv2_zh
|
5.3320 | 0.299692 | |
| #7 |
iic/eres2net-en
eres_en
|
5.5284 | 0.374254 | |
| #8 |
wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
|
5.5532 | 0.361444 | |
| #9 |
wespeaker/campplus-voxceleb
campplus_wespeaker
|
6.1851 | 0.403050 | |
| #10 |
iic/campplus
campplus
|
6.4713 | 0.346271 | |
| #11 |
wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
|
6.5083 | 0.405096 | |
| #12 |
wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
|
6.9847 | 0.436029 | |
| #13 |
wespeaker/res34-cnceleb
wespeaker_r34
|
7.5770 | 0.460771 | |
| #14 |
speechbrain/ecapa
ecapa
|
7.6275 | 0.509746 | |
| #15 |
iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
|
8.5536 | 0.499376 | |
| #16 |
speechbrain/xvector
xvector
|
14.0989 | 0.582957 | |
| #17 |
microsoft/wavlm-base-plus-sv
wavlm_base
|
21.7152 | 0.966351 | |
| #18 |
microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
|
23.2288 | 0.970581 |