Trial Set

HI-MIA

No upstream SV trial keys are used; trials are generated from the test split.

Source dataset
HI-MIA
Trials
660000
Protocol source
Self-constructed protocol
Source split
Public test split
hi_mia Short-duration
Direct Ranking

Systems on this trial set

18 reviewed systems currently have valid results.

Rank System Trial-Set EER ↓ Trial-Set minDCF ↓
#1 iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
2.8963 0.178460
#2 iic/eres2netv2-zh
eresv2_zh
3.7090 0.208377
#3 palabraai/redimnet2-b6
redimnet2
5.7113 0.276288
#4 wespeaker/res152-voxceleb
wespeaker_resnet152
5.8453 0.284905
#5 iic/campplus
campplus
5.8722 0.341062
#6 wespeaker/samresnet100
vb2-sam100
5.9033 0.273133
#7 wespeaker/res293-voxceleb
wespeaker_resnet293
6.3817 0.301015
#8 wespeaker/w2vbert2
vb2-w2vbert
7.0400 0.349597
#9 wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
7.0523 0.323703
#10 iic/eres2net-en
eres_en
7.0967 0.323343
#11 speechbrain/ecapa
ecapa
7.6850 0.369167
#12 wespeaker/res34-cnceleb
wespeaker_r34
7.7542 0.426640
#13 wespeaker/campplus-voxceleb
campplus_wespeaker
7.9797 0.395343
#14 wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
8.5340 0.404212
#15 wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
8.6250 0.381742
#16 speechbrain/xvector
xvector
12.0075 0.621905
#17 microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
23.7600 0.944420
#18 microsoft/wavlm-base-plus-sv
wavlm_base
25.0650 0.910383