Limited Training Data Robust Speech Recognition Using Kernel-Based Acoustic Models

• Main Authors: Schaffoner, M., Kruger, S.E., Andelic, E., Katz, M., Wendemuth, A.
• Format: Conference Proceeding
• Language: English
• Subjects: Automatic speech recognition; Hidden Markov models; Information technology; Kernel; Probability density function; Robustness; Speech recognition; Support vector machine classification; Support vector machines; Training data
• ISSN: 1520-6149; 2379-190X
• DOI: 10.1109/ICASSP.2006.1660226

Contemporary automatic speech recognition uses hidden-Markov-models (HMMs) to model the temporal structure of speech where one HMM is used for each phonetic unit. The states of the HMMs are associated with state-conditional probability density functions (PDFs) which are typically realized using mixtures of Gaussian PDFs (GMMs). Training of GMMs is error-prone especially if training data size is limited. This paper evaluates two new methods of modeling state-conditional PDFs using probabilistically interpreted support vector machines and kernel Fisher discriminants. Extensive experiments on the RMI (P. Price et al., 1988) corpus yield substantially improved recognition rates compared to traditional GMMs. Due to their generalization ability, our new methods reduce the word error rate by up to 13% using the complete training set and up to 33% when the training set size is reduced