SiPTH: Singing Transcription Based on Hysteresis Defined on the Pitch-Time Curve

• Published in: IEEE/ACM transactions on audio, speech, and language processing speech, and language processing, 2015-02, Vol.23 (2), p.252-263
• Main Authors: Molina, Emilio, Tardon, Lorenzo J., Barbancho, Ana M., Barbancho, Isabel
• Format: Article
• Language: English
• Subjects: Acoustic signal processing; Decision trees; Feature extraction; fundamental frequency; Hysteresis; Indexes; Labeling; pitch; singing transcription; singing voice analysis; Speech; Speech processing
• ISSN: 2329-9290; 2329-9304
• DOI: 10.1109/TASLP.2014.2331102

In this paper, we present a method for monophonic singing transcription based on hysteresis defined on the pitch-time curve. This method is designed to perform note segmentation even when the pitch evolution during the same note behaves unstably, as in the case of untrained singers. The selected approach estimates the regions in which the chroma is stable, these regions are classified as voiced or unvoiced according to a decision tree classifier using two descriptors based on aperiodicity and power. Then, a note segmentation stage based on pitch intervals of the sung signal is carried out. To this end, a dynamic averaging of the pitch curve is performed after the beginning of a note is detected in order to roughly estimate the pitch. Deviations of the actual pitch curve with respect to this average are measured to determine the next note change according to a hysteresis process defined on the pitch-time curve. Finally, each note is labeled using three single values: rounded pitch (to semitones), duration and volume. Also, a complete evaluation methodology that includes the definition of different relevant types of errors, measures and a method for the computation of the evaluation measures are presented. The proposed system improves significantly the performance of the baseline approach, and attains results similar to previous approaches.