Hiding speaker's sex in speech using zero-evidence speaker representation in an analysis/synthesis pipeline

The use of modern vocoders in an analysis/synthesis pipeline allows us to investigate high-quality voice conversion that can be used for privacy purposes. Here, we propose to transform the speaker embedding and the pitch in order to hide the sex of the speaker. ECAPA-TDNN-based speaker representatio...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2023-03
Main Authors: Paul-Gauthier, Noé, Miao, Xiaoxiao, Wang, Xin, Yamagishi, Junichi, Bonastre, Jean-François, Matrouf, Driss
Format: Article
Language:English
Subjects:
Discriminant analysis
Privacy
Representations
Sex
Speech
Synthesis
Vocoders
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The use of modern vocoders in an analysis/synthesis pipeline allows us to investigate high-quality voice conversion that can be used for privacy purposes. Here, we propose to transform the speaker embedding and the pitch in order to hide the sex of the speaker. ECAPA-TDNN-based speaker representation fed into a HiFiGAN vocoder is protected using a neural-discriminant analysis approach, which is consistent with the zero-evidence concept of privacy. This approach significantly reduces the information in speech related to the speaker's sex while preserving speech content and some consistency in the resulting protected voices.
ISSN:2331-8422