Challenge results

The challenge is now ended. Results can be found at challenge result page.

Relevant papers

Papers relevant to the SASV 2022 Challenge can be found at SASV2022 Related Publications page.

Overview

ASV (automatic speaker verification) systems are intrinsically required to reject both non-target (e.g., voice uttered by different speaker) and spoofed (e.g., synthesised or converted) inputs. However, there is little consideration for how ASV systems themselves should be adapted when they are expected to encounter spoofing attacks, nor when they operate in tandem with CMs (spoofing countermeasures), much less how both systems should be jointly optimised.

The goal of the first SASV (spoofing-aware speaker verification) challenge, a special sesscion in ISCA INTERSPEECH 2022, is to promote development of integrated systems that can perform ASV and CM simultaneously.

Evaluation plan

• v0.1
• v0.2

Baseline repository

The baseline repository includes various packages for

• downloading datasets;
• calculating required metrics (i.e., three types of EERs);
• reproducing Baseline2 described in the evaluation plan.

Registration

Registration can be done by submitting below form.

Register

Submission

Submissions should be made by sending an e-mail to sasv.challenge@gmail.com with an attachment containing a system description and score files for both development and the evaluation protocols. Precise submission instructions are included in the evaluation plan.

Planned schedule

• January 20, 2022: Release of evaluation plan
• March 10 March 14, 2022: Result submission
• March 14 March 18, 2022: Release of participant ranks
• March 21, 2022: INTERSPEECH Paper submission deadline
• March 28, 2022: INTERSPEECH Paper update deadline
• June 13, 2022: INTERSPEECH Author notification
• September 18-22, 2022: SASV challenge special session at INTERSPEECH

Awards

Awards will be presented to participants/teams whose systems achieve the best performance. Additional awards will be presented to participants/teams who report the most innovative methods as judged by the organisers.

Performance awards

Top three ranking teams will be awarded as follows:

• Winner: 1,500 USD
• First runner-up: 1,000 USD
• Second runner-up: 500 USD

Innovative awards

The two participants/teams with the most innovative methods will be awarded $1,000 each.

Sponsor

Organising committee

• Jee-weon Jung (Naver Corporation, South Korea)
• Hemlata Tak (EURECOM, France)
• Hye-jin Shim (University of Seoul, South Korea)
• Hee-Soo Heo (Naver Corporation, South Korea)
• Bong-Jin Lee (Naver Corporation, South Korea)
• Soo-Whan Chung (Naver Corporation, South Korea)
• Hong-Goo Kang (Yonsei University, South Korea)
• Ha-Jin Yu (University of Seoul, South Korea)
• Nicholas Evans (EURECOM, France)
• Tomi Kinnunen (University of Eastern Finland, Finland)

Acknowledgment

The organising committee have received comments and technical support from the below list of advisors. Names in alphabetical order.

• Héctor Delgado (Nuance Communications, Spain)
• Kong Aik Lee (A*STAR, Singapore)
• Massimiliano Todisco (Eurecom, France)
• Md Sahidullah (Inria, France)
• Xuechen Liu (University of Eastern Finland, Finland)

Contact

Please send an e-mail to sasv.challenge@gmail.com if you have any questions.