Semantic Tagging of Singing Voices in Popular Music Recordings

Singing voice is a key sound source in popular music. As recent music streaming and entertainment services call for more intelligent solutions to retrieve songs or evaluate musical characteristics, automatic analysis of popular music targeted to singing voice has been a significant research subject....

Full description

Saved in:
Bibliographic Details
Published in:IEEE/ACM transactions on audio, speech, and language processing speech, and language processing, 2020, Vol.28, p.1656-1668
Main Authors: Kim, Keunhyoung Luke, Lee, Jongpil, Kum, Sangeun, Park, Chae Lin, Nam, Juhan
Format: Article
Language:English
Subjects:
Annotations
Artificial neural networks
convolutional neural networks
Datasets
Instruments
K-Pop
Marking
music tagging
Musical performances
Popular music
Qualitative analysis
semantic analysis
Singing
Singing voice
Sound sources
Statistical analysis
Tagging
Timbre
Vocabulary
vocal
Voice
Words (language)
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Singing voice is a key sound source in popular music. As recent music streaming and entertainment services call for more intelligent solutions to retrieve songs or evaluate musical characteristics, automatic analysis of popular music targeted to singing voice has been a significant research subject. The majority of studies have focused on quantitative or objective information of singing voice such as pitch, lyrics or singer identity. However, singing voice has a wide variety of dimensions that are somewhat difficult to quantify and therefore we often describe by words. In this article, we address the qualitative analysis of singing voice as a music auto-tagging task that annotates songs with a set of tag words. To this end, we build a music tag dataset dedicated to singing voice. Specifically, we define a vocabulary that describes timbre and singing styles of K-pop vocalists and collect human annotations for individual tracks. We then conduct statistical analysis to understand the global and temporal characteristics of the tag words. Using the dataset, we train a deep neural network model to automatically predict the voice-specific tags from popular music recordings and evaluate the model in different conditions. We discuss the results by comparing them to the statistical analysis of tag words. Finally, we show potential applications of the vocal tagging system in music retrieval, music thumbnailing and singing evaluation.
ISSN:2329-9290
2329-9304
DOI:10.1109/TASLP.2020.2993893