Overlapping sound event recognition using local spectrogram features and the generalised hough transform

• Published in: Pattern recognition letters 2013-07, Vol.34 (9), p.1085-1093
• Main Authors: Dennis, J., Tran, H.D., Chng, E.S.
• Format: Article
• Language: English
• Subjects: Generalised Hough Transform; Keypoint detection; Local spectrogram features; Overlapping sound event recognition
• ISSN: 0167-8655; 1872-7344
• DOI: 10.1016/j.patrec.2013.02.015

•Addressing the challenging task of simultaneous overlapping sound event recognition.•A novel approach based on local features extracted from the spectrogram.•Robust recognition is achieved by combining the independent local information.•The Generalized Hough Transform is used to generate detection hypotheses.•The method is inspired by human perception and research in image object recognition. In this paper, we address the challenging task of simultaneous recognition of overlapping sound events from single channel audio. Conventional frame-based methods are not well suited to the problem, as each time frame contains a mixture of information from multiple sources. Missing feature masks are able to improve the recognition in such cases, but are limited by the accuracy of the mask, which is a non-trivial problem. In this paper, we propose an approach based on Local Spectrogram Features (LSFs) which represent local spectral information that is extracted from the two-dimensional region surrounding “keypoints” detected in the spectrogram. The keypoints are designed to locate the sparse, discriminative peaks in the spectrogram, such that we can model sound events through a set of representative LSF clusters and their occurrences in the spectrogram. To recognise overlapping sound events, we use a Generalised Hough Transform (GHT) voting system, which sums the information over many independent keypoints to produce onset hypotheses, that can detect any arbitrary combination of sound events in the spectrogram. Each hypothesis is then scored against the class distribution models to recognise the existence of the sound in the spectrogram. Experiments on a set of five overlapping sound events, in the presence of non-stationary background noise, demonstrate the potential of our approach.