System Detail

Agora Voiceprint (ResNet293)

agora_vp

Submitted by: agora

ranked review: approved custom_local_torch Contributor-provided architecture ResNet
Global position
#5 / 25
Scenario-macro EER
7.8931
Scenario-macro minDCF
0.297508
Trial-set coverage
26 / 26
Scenario top-three
4
Publicly ranked This result is included in the reviewed public ranking.
Model Provenance

Source and architecture

  • Displayed name: Agora Voiceprint (ResNet293)
  • Submitted by: agora
  • Metadata: Contributor-provided
  • Source: custom_local_torch
  • Contributor-provided architecture: ResNet293 + TSTP (256-d embedding)
  • Model family: ResNet
  • Submitted alias: agora_voiceprint
  • Created at: 2026-10-21T10:53:09.348648+00:00
Training And Links

Training data and references

  • Training data: VoxCeleb2 dev + VoxBlink2 + 3D-Speaker train split
  • Training setup: AAM-Softmax / ArcMargin Speed perturbation MUSAN noise + RIR reverberation augmentation Non-VAD diff-chunk Knowledge distillation
  • Score processing: None
  • Submission mode: full-core
Higher-Ranked Scenarios

Scenario ranks above the global position

Show 3 supporting trial sets
  • GSC Short: #1 on its trial-set ranking.
  • FFSVC 2022 Cross-Channel: #1 on its trial-set ranking.
  • FFSVC 2022 Cross-Domain: #1 on its trial-set ranking.
Lower-Ranked Scenarios

Scenario ranks below the global position

Show 3 supporting trial sets
  • VOiCES Noise/Reverb: #16 on its trial-set ranking.
  • VoxKnesset: #12 on its trial-set ranking.
  • VoxCeleb1-O: #12 on its trial-set ranking.
Scenario Rankings

Full ranking across scenarios

This table shows where the model sits on each scenario, using source-balanced scenario scores and the linked trial sets as evidence.

Scenario Rank Lens Evidence Score
Channel / Device Robustness
How resilient the model is to device and channel mismatch.
#2/25 Top 3
Device and channel variation 0.0362 EER from leader
4.0023
0.253548 minDCF
Distance Robustness
How much performance changes across meeting and domestic distance mismatch.
#2/25 Top 3
Distance mismatch 0.5626 EER from leader
5.2568
0.269814 minDCF
Short-Duration Robustness
How much performance holds up when speech evidence is limited by duration.
#2/25 Top 3
Short-duration speech 0.4401 EER from leader
9.0346
0.315093 minDCF
Accent / Dialect Robustness
How reliably the model tracks identity across accent and dialect mismatch.
#3/25 Top 3
Accent and dialect variation 1.0602 EER from leader
16.8217
0.520196 minDCF
Cross-Lingual Robustness
How well speaker identity survives enrollment-test language mismatch.
#5/25 Competitive
Language mismatch 0.7277 EER from leader
2.3854
0.170770 minDCF
Overlap Robustness
How well speaker identity survives light, mid, and heavy overlap in both meeting and domestic recordings.
#7/25 Competitive
Overlapping speakers 1.6942 EER from leader
9.3858
0.412967 minDCF
In-The-Wild Robustness
How strong the model is on unconstrained celebrity and media speech across official CN-Celeb and VoxCeleb protocols.
#8/25 Competitive
Open-domain media speech 2.4982 EER from leader
4.8843
0.165519 minDCF
Genre-Shift Robustness
Whether performance holds when CN-Celeb enrollment and test speech come from different source genres.
#8/25 Competitive
Source-genre variation 8.7425 EER from leader
21.9825
0.674857 minDCF
Speaking-Style Robustness
Whether the model can preserve identity across emotion-driven change, whispered speech, and noise-induced Lombard speaking style.
#9/25 Competitive
Speaking style shift 2.0661 EER from leader
3.9828
0.223228 minDCF
Aging Robustness
How stable identity representations remain across age-derived and longitudinal recording gaps.
#11/25 Competitive
Speaker aging and time gaps 0.8965 EER from leader
2.6882
0.094838 minDCF
Noise / Reverb Robustness
How reliably the model preserves identity when room acoustics, distractor noise, and microphone placement deviate from an easier in-corpus reference condition.
#16/25 Needs work
Noise and reverberation 4.1400 EER from leader
6.4000
0.171760 minDCF
Variant Compare

Compare ResNet variants

Compare the family variants on the overall board, a Scenario, or a Trial Set.

Show
Variant Submitted by Source Training Data Training Setup Rank EER minDCF Open
Agora Voiceprint (ResNet293)
ResNet293 + TSTP (256-d embedding)
Current
agora custom_local_torch VoxCeleb2 dev + VoxBlink2 + 3D-Speaker train split AAM-Softmax / ArcMargin Speed perturbation MUSAN noise + RIR reverberation augmentation Non-VAD diff-chunk Knowledge distillation #5 7.8931 0.297508 Open
wespeaker/res152-voxceleb
ResNet
Public checkpoint WeSpeaker VoxCeleb2 dev, 5,994 speakers ResNet152-TSTP-emb256 r-vector, ArcMargin, 150-epoch VoxCeleb2 recipe with speed perturbation and MUSAN/RIRS augmentation. #12 11.2275 0.442748 Open
wespeaker/res293-voxceleb
ResNet
Public checkpoint WeSpeaker VoxCeleb2 dev, 5,994 speakers ResNet293-TSTP-emb256 r-vector, large-margin fine-tuned; official card reports 28.62M parameters and 28.10G FLOPs. #13 11.3130 0.439607 Open
wespeaker/res34-voxceleb
ResNet
Public checkpoint WeSpeaker VoxCeleb2 dev, 5,994 speakers ResNet34-TSTP-emb256 r-vector, large-margin fine-tuned; official card reports 6.63M parameters and 4.55G FLOPs. #15 12.0516 0.477054 Open
wespeaker/res34-cnceleb
ResNet
Public checkpoint WeSpeaker CN-Celeb train ResNet34 r-vector with TSTP pooling and large-margin fine-tuning on the CN-Celeb WeSpeaker recipe. #22 14.4910 0.607964 Open
Trial-Set Results

Raw ranking by trial set

Expand this section to inspect the detailed trial-set rankings.

Show
Trial Set Rank Scenarios Trials Score
TidyVoiceX2-ASV
TidyVoiceX2-ASV
#5/25
Cross-lingual
200000
2.3854
0.170770 minDCF
HI-MIA
HI-MIA
#2/25
Short-duration
660000
2.4227
0.143702 minDCF
GSC Short
Google Speech Commands
#1/25
Short-duration
220000
2.5250
0.147370 minDCF
GLOBE
GLOBE
#7/25
Accent/dialect
56848
25.0193
0.505786 minDCF
CN-Celeb
CN-Celeb
#11/25
In-the-wild
3484292
8.9045
0.281688 minDCF
CN-Celeb Genre
CN-Celeb
#8/25
Genre shift
440000
21.9825
0.674857 minDCF
CN-Celeb Short
CN-Celeb
#9/25
Short-duration
546964
20.8157
0.607910 minDCF
VoxCeleb1-O
VoxCeleb1
#12/25
In-the-wild
37611
0.6170
0.031324 minDCF
VoxCeleb1-E
VoxCeleb1
#11/25
In-the-wild
579818
0.6878
0.043217 minDCF
VoxCeleb1-H
VoxCeleb1
#11/25
In-the-wild
550894
1.2872
0.073510 minDCF
VoxCeleb Short
VoxCeleb1
#5/25
Short-duration
394724
10.3751
0.361392 minDCF
3D-Speaker Device
3D-Speaker
#3/25
Channel/device
180000
4.8713
0.311540 minDCF
3D-Speaker Distance
3D-Speaker
#4/25
Distance
175163
6.6049
0.380226 minDCF
3D-Speaker Dialect
3D-Speaker
#3/25
Accent/dialect
180000
8.6240
0.534607 minDCF
FFSVC 2022 Cross-Channel
FFSVC 2022
#1/25
Channel/device
72000
3.1333
0.195556 minDCF
FFSVC 2022 Cross-Domain
FFSVC 2022
#1/25
Distance
66546
3.1904
0.201044 minDCF
Whisper40 Whisper
Whisper40
#11/25
Speaking style
17600
9.3750
0.516687 minDCF
Lombard Grid Lombard
Lombard Grid
#10/25
Speaking style
29524
0.0708
0.002534 minDCF
VOiCES Noise/Reverb
VOiCES
#16/25
Noise/reverb
55000
6.4000
0.171760 minDCF
CHiME-6 Domestic Far-Field
CHiME-6
#8/25
Distance
36487
7.9289
0.329545 minDCF
CHiME-6 Overlap
CHiME-6
#11/25
Overlap
39600
14.1250
0.591000 minDCF
ESD
ESD
#9/25
Speaking style
437408
2.5025
0.150464 minDCF
AliMeeting Near/Far
AliMeeting
#2/25
Distance
220000
3.3030
0.168440 minDCF
AliMeeting Overlap
AliMeeting
#3/25
Overlap
165000
4.6467
0.234933 minDCF
VoxKnesset
VoxKnesset
#12/25
Aging
158312
3.7554
0.140025 minDCF
VoxPopuli Aging
VoxPopuli
#10/25
Aging
146575
1.6210
0.049651 minDCF
Submission Notes

Packaging notes and warnings

Expand this section for metadata, warnings, and missing trial sets.

Show
Packaging Notes

Submission metadata

  • Submission mode: full-core
  • Listed on public ranking: True
  • Visibility: public
  • Review status: approved
  • Created at: 2026-10-21T10:53:09.348648+00:00
Warnings

Evaluation notes

  • Scores were extracted by a custom local PyTorch adapter with full-utterance FP32 inference; no kit model backend was rerun during packaging.