Submission

Submit to OpenSVBench

Choose the workflow that matches your contribution. Model score packages are evaluated against the fixed core; rolling dataset proposals are reviewed separately.

18 public systems 26 fixed-core trial sets

Leaderboard Evaluation

Model score package

Upload a zip containing submission metadata and per-trial-set score CSVs. Evaluation runs privately before any public-listing request.

Use the open-source OpenSVBench Submission Kit to run the fixed-core workflow and build the upload zip
submission.json plus scores/<trial_set_id>_scores.csv
Score columns: utt1,utt2,score
Full current-core coverage is required for public ranking

Get submission kit Log in and upload

Future Benchmark Coverage

Rolling dataset proposal

Submit a compact, reproducible recipe for a new dataset or trial protocol. Proposals do not change the current fixed-core ranking.

Provide source and license information
Include preparation and trial-construction code
Do not upload large raw-audio archives

Propose a dataset