Trial Set
Lombard Grid Lombard
Builds plain-to-Lombard SV trials from the public Lombard Grid release because no upstream SV trial keys are used.
- Source dataset
- Lombard Grid
- Trials
- 29524
- Protocol source
- Self-constructed protocol
- Source split
- Public Lombard Grid audio release
Direct Ranking
Systems on this trial set
18 reviewed systems currently have valid results.
| Rank | System | Trial-Set EER ↓ | Trial-Set minDCF ↓ |
|---|---|---|---|
| #1 |
wespeaker/samresnet100
vb2-sam100
|
0.0373 | 0.004657 |
| #2 |
wespeaker/w2vbert2
vb2-w2vbert
|
0.0559 | 0.005104 |
| #3 |
wespeaker/res152-voxceleb
wespeaker_resnet152
|
0.0745 | 0.011736 |
| #4 |
palabraai/redimnet2-b6
redimnet2
|
0.0782 | 0.007675 |
| #5 |
wespeaker/res34-voxceleb
wespeaker_resnet34_voxceleb
|
0.1490 | 0.010991 |
| #6 |
wespeaker/res293-voxceleb
wespeaker_resnet293
|
0.1490 | 0.014754 |
| #7 |
wespeaker/ecapa512-voxceleb
wespeaker_ecapa512
|
0.2235 | 0.015499 |
| #8 |
iic/eres2net-en
eres_en
|
0.2235 | 0.014903 |
| #9 |
speechbrain/ecapa
ecapa
|
0.2608 | 0.021386 |
| #10 |
wespeaker/ecapa1024-voxceleb
wespeaker_ecapa1024
|
0.3055 | 0.017288 |
| #11 |
wespeaker/campplus-voxceleb
campplus_wespeaker
|
0.4098 | 0.039531 |
| #12 |
iic/eres2netv2-zh
eresv2_zh
|
1.2034 | 0.075149 |
| #13 |
iic/eres2net-large-3dspeaker
eres2net_large_3dspeaker
|
1.7139 | 0.100335 |
| #14 |
iic/campplus
campplus
|
1.7884 | 0.119188 |
| #15 |
speechbrain/xvector
xvector
|
1.8405 | 0.099143 |
| #16 |
wespeaker/res34-cnceleb
wespeaker_r34
|
3.3905 | 0.196237 |
| #17 |
microsoft/unispeech-sat-base-plus-sv
unispeech_sat_base_plus
|
7.9993 | 0.495715 |
| #18 |
microsoft/wavlm-base-plus-sv
wavlm_base
|
8.1967 | 0.544113 |