Content based audio classification and retrieval using joint time-frequency analysis

• Main Authors: Esmaili, S., Krishnan, S., Raahemifar, K.
• Format: Conference Proceeding
• Language: English
• Subjects: Applied sciences; Bandwidth; Content based retrieval; Entropy; Exact sciences and technology; Feature extraction; Information, signal and communications theory; Labeling; Linear discriminant analysis; Miscellaneous; Multiple signal classification; Music information retrieval; Signal processing; Spatial databases; Telecommunications and information theory; Time frequency analysis
• ISSN: 1520-6149; 2379-190X
• DOI: 10.1109/ICASSP.2004.1327198

We present an audio classification and retrieval technique that exploits the non-stationary behavior of music signals and extracts features that characterize their spectral change over time. Audio classification provides a solution to incorrect and inefficient manual labelling of audio files on computers by allowing users to extract music files based on content similarity rather than labels. In our technique, classification is performed using time-frequency analysis and sounds are classified into 6 music groups consisting of rock, classical, folk, jazz and pop. For each 5 second music segment, the features that are extracted include entropy, centroid, centroid ratio, bandwidth, silence ratio, energy ratio, and location of minimum and maximum energy. Using a database of 143 signals, a set of 10 time-frequency features are extracted and an accuracy of classification of around 93% using regular linear discriminant analysis or 92.3% using the leave-one-out method is achieved.