Multimodal Music Mood Classification Using Audio and Lyrics

In this paper we present a study on music mood classification using audio and lyrics information. The mood of a song is expressed by means of musical features but a relevant part also seems to be conveyed by the lyrics. We evaluate each factor independently and explore the possibility to combine bot...

Full description

Saved in:
Bibliographic Details
Main Authors: Laurier, C., Grivolla, J., Herrera, P.
Format: Conference Proceeding
Language:English
Subjects:
Acoustic signal detection
audio
classification
hybrid
Information resources
lyrics
Machine learning
Mood
multimodal
Music information retrieval
Natural language processing
Performance analysis
Psychology
Recommender systems
Spatial databases
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper we present a study on music mood classification using audio and lyrics information. The mood of a song is expressed by means of musical features but a relevant part also seems to be conveyed by the lyrics. We evaluate each factor independently and explore the possibility to combine both, using natural language processing and music information retrieval techniques. We show that standard distance-based methods and latent semantic analysis are able to classify the lyrics significantly better than random, but the performance is still quite inferior to that of audio-based techniques. We then introduce a method based on differences between language models that gives performances closer to audio-based classifiers. Moreover, integrating this in a multimodal system (audio+text) allows an improvement in the overall performance. We demonstrate that lyrics and audio information are complementary, and can be combined to improve a classification system.
DOI:10.1109/ICMLA.2008.96