Audio thumbnailing of popular music using chroma-based representations

With the growing prevalence of large databases of multimedia content, methods for facilitating rapid browsing of such databases or the results of a database search are becoming increasingly important. However, these methods are necessarily media dependent. We present a system for producing short, re...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on multimedia 2005-02, Vol.7 (1), p.96-104
Main Authors: Bartsch, M.A., Wakefield, G.H.
Format: Article
Language:English
Subjects:
Applied sciences
Audio summarization
Broadcasting. Videocommunications. Audiovisual
chroma
Costs
Exact sciences and technology
Feature extraction
Multimedia
Multimedia databases
Multimedia systems
Multiple signal classification
Musical performances
musical structure
Pattern recognition
Pattern recognition systems
Perception
Popular music
Radiocommunications
Redundancy
Representations
Searching
Spatial databases
Spectra
Speech
Telecommunications
Telecommunications and information theory
Time frequency analysis
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:With the growing prevalence of large databases of multimedia content, methods for facilitating rapid browsing of such databases or the results of a database search are becoming increasingly important. However, these methods are necessarily media dependent. We present a system for producing short, representative samples (or "audio thumbnails") of selections of popular music. The system searches for structural redundancy within a given song with the aim of identifying something like a chorus or refrain. To isolate a useful class of features for performing such structure-based pattern recognition, we present a development of the chromagram, a variation on traditional time-frequency distributions that seeks to represent the cyclic attribute of pitch perception, known as chroma. The pattern recognition system itself employs a quantized chromagram that represents the spectral energy at each of the 12 pitch classes. We evaluate the system on a database of popular music and score its performance against a set of "ideal" thumbnail locations. Overall performance is found to be quite good, with the majority of errors resulting from songs that do not meet our structural assumptions.
ISSN:1520-9210
1941-0077
DOI:10.1109/TMM.2004.840597