Privacy-Sensitive Audio Features for Speech/Nonspeech Detection

• Published in: IEEE transactions on audio, speech, and language processing speech, and language processing, 2011-11, Vol.19 (8), p.2538-2551
• Main Authors: Parthasarathi, S. H. K., Gatica-Perez, D., Bourlard, H., Magimai-Doss, Mathew
• Format: Article
• Language: English
• Subjects: Applied sciences; Detection, estimation, filtering, equalization, prediction; Exact sciences and technology; Feature extraction; Information, signal and communications theory; Multimodal sensors; Pattern recognition; Privacy; Privacy sensitive features; Robustness; Signal and communications theory; Signal processing; Signal, noise; Speech processing; speech/nonspeech detection (SND); Studies; Telecommunications and information theory
• ISSN: 1558-7916; 2329-9290; 1558-7924; 2329-9304
• DOI: 10.1109/TASL.2011.2151857

The goal of this paper is to investigate features for speech/nonspeech detection (SND) having low linguistic information from the speech signal. Towards this, we present a comprehensive study of privacy-sensitive features for SND in multiparty conversations. Our study investigates three different approaches to privacy-sensitive features. These approaches are based on: 1) simple, instantaneous feature extraction methods; 2) excitation source information based methods; and 3) feature obfuscation methods such as local (within 130 ms) temporal averaging and randomization applied on excitation source information. To evaluate these approaches for SND, we use multiparty conversational meeting data of nearly 450 hours. On this dataset, we evaluate these features and benchmark them against standard spectral shape based features such as Mel frequency perceptual linear prediction (MFPLP). Fusion strategies combining excitation source with simple features show that comparable performance can be obtained in both close-talking and far-field microphone scenarios. As one way to objectively evaluate the notion of privacy, we conduct phoneme recognition studies on TIMIT. While excitation source features yield phoneme recognition accuracies in between the simple features and the MFPLP features, obfuscation methods applied on the excitation features yield low phoneme accuracies in conjunction with SND performance comparable to that of MFPLP features.