Benchmark Scenario
Short-Duration Robustness
Short-duration speech. The scenario score aggregates its trial sets using the fixed OpenSVBench reporting protocol.
18 ranked systems
4 trial sets
12.5144 leading EER
Scenario Ranking
Systems on Short-Duration Robustness
Evidence cells list trial-set rank and EER in this order: HI-MIA · GSC Short · CN-Celeb Short · VoxCeleb Short.
| Rank | System | Scenario EER ↓ | Scenario minDCF ↓ | Trial-Set Evidence Rank / EER |
|---|---|---|---|---|
| #1 |
wespeaker/w2vbert2
vb2-w2vbert
|
12.5144 | 0.441680 | |
| #2 |
iic/eres2netv2-zh
eresv2_zh
|
12.9695 | 0.460887 | |
| #3 |
palabraai/redimnet2-b6
redimnet2
|
13.2481 | 0.531421 | |
| #4 |
wespeaker/samresnet100
vb2-sam100
|
13.4479 | 0.497755 | |
| #5 |
wespeaker/res152-voxceleb
wespeaker_resnet152
|
13.5058 | 0.545781 | |
| #6 |
wespeaker/res293-voxceleb
wespeaker_resnet293
|
14.0805 | 0.568931 | |
| #7 |
wespeaker/res34-cnceleb
wespeaker_r34
|
14.2898 | 0.579413 | |
| #8 |
iic/campplus
campplus
|
14.8056 | 0.554588 | |
| #9 |
wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
|
14.9080 | 0.610039 | |
| #10 |
iic/eres2net-en
eres_en
|
15.8159 | 0.582696 | |
| #11 |
wespeaker/campplus-voxceleb
campplus_wespeaker
|
16.3494 | 0.638979 | |
| #12 |
wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
|
16.5541 | 0.604686 | |
| #13 |
speechbrain/ecapa
ecapa
|
17.0764 | 0.621298 | |
| #14 |
iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
|
17.5708 | 0.654520 | |
| #15 |
wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
|
18.2450 | 0.644928 | |
| #16 |
speechbrain/xvector
xvector
|
25.0788 | 0.830830 | |
| #17 |
microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
|
26.1478 | 0.927872 | |
| #18 |
microsoft/wavlm-base-plus-sv
wavlm_base
|
26.7099 | 0.906048 |