Benchmark Scenario
Genre-Shift Robustness
Whether performance holds when CN-Celeb enrollment and test speech come from different source genres.
Current Leader
18 ranked
iic/eres2netv2-zh
14.2725
scenario EER
0.527525 scenario minDCF
Scenario Coverage
1 trial set
CN-Celeb Genre
Scenario Leaders
Top systems on this scenario
The current reviewed submissions for this scenario.
Scenario Ranking
Full ranking for Genre-Shift Robustness
A scenario row first averages linked trial sets within each source dataset, then averages the source means and ranks systems by the resulting EER.
| Rank | System | Rank Signal | Scenario EER | Scenario minDCF |
Evidence
Rank / EER by trial-set order: CN-Celeb Genre
|
|---|---|---|---|---|---|
| #1 |
iic/eres2netv2-zh
eresv2_zh
|
Leader
|
14.2725
|
0.527525 | |
| #2 |
wespeaker/res34-cnceleb
wespeaker_r34
|
Top 3
|
15.6955
|
0.591628 | |
| #3 |
iic/campplus
campplus
|
Top 3
|
16.8815
|
0.610655 | |
| #4 |
wespeaker/samresnet100
vb2-sam100
|
Competitive
|
25.1200
|
0.674765 | |
| #5 |
palabraai/redimnet2-b6
redimnet2
|
Competitive
|
25.4550
|
0.740052 | |
| #6 |
wespeaker/w2vbert2
vb2-w2vbert
|
Competitive
|
25.9200
|
0.656577 | |
| #7 |
wespeaker/res152-voxceleb
wespeaker_resnet152
|
Competitive
|
26.2472
|
0.806172 | |
| #8 |
wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
|
Competitive
|
26.5125
|
0.822805 | |
| #9 |
wespeaker/res293-voxceleb
wespeaker_resnet293
|
Competitive
|
26.8575
|
0.811767 | |
| #10 |
iic/eres2net-en
eres_en
|
Needs work
|
27.7395
|
0.802170 | |
| #11 |
iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
|
Needs work
|
28.4850
|
0.888960 | |
| #12 |
speechbrain/ecapa
ecapa
|
Needs work
|
29.5690
|
0.883898 | |
| #13 |
wespeaker/campplus-voxceleb
campplus_wespeaker
|
Needs work
|
29.6497
|
0.829445 | |
| #14 |
wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
|
Needs work
|
30.8550
|
0.849922 | |
| #15 |
wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
|
Needs work
|
31.1025
|
0.910323 | |
| #16 |
speechbrain/xvector
xvector
|
Needs work
|
36.7857
|
0.987563 | |
| #17 |
microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
|
Needs work
|
37.0343
|
0.985940 | |
| #18 |
microsoft/wavlm-base-plus-sv
wavlm_base
|
Needs work
|
38.3800
|
0.975515 |