Modulation spectrum equalization for robust speech recognition

• Main Authors: Liang-che Sun, Chang-wen Hsu, Lin-shan Lee
• Format: Conference Proceeding
• Language: English
• Subjects: Cepstral analysis; Feature extraction; feature normalization; Frequency; Histograms; Modulation spectrum; Performance evaluation; robust feature extraction; Robustness; Speech recognition; temporal filter; Testing; Training data; Working environment noise
• DOI: 10.1109/ASRU.2007.4430088

Two approaches for modulation spectrum equalization are proposed for robust feature extraction in speech recognition. In both cases the temporal trajectories of the feature parameters are first transformed into the modulation spectrum. In the spectral histogram equalization (SHE) approach, we equalize the histogram of the modulation spectrum for each utterance to a reference histogram obtained from clean training data. In the magnitude ratio equalization (MRE) approach, we equalize the magnitude ratio of lower to higher frequency components on the modulation spectrum to a reference value also obtained from clean training data. Preliminary experimental results performed on the AURORA 2 testing environment indicate that significant performance improvements are achievable with these approaches, when integrated with cepstral mean and variance normalization (CMVN), for all testing sets A, B, and C, all types of noise, for all SNR values. We also show that the approach of magnitude ratio equalization (MRE) offers additional performance improvements when integrated with other more advanced feature normalization approaches such as histogram equalization (HEQ) and higher-order cepstral moment normalization (HOCMN).