What Constitutes a Phrase in Sound-Based Music? A Mixed-Methods Investigation of Perception and Acoustics

• Published in: PloS one 2016-12, Vol.11 (12), p.e0167643-e0167643
• Main Authors: Olsen, Kirk N, Dean, Roger T, Leung, Yvonne
• Format: Article
• Language: English
• Subjects: Acoustic phonetics; Acoustics; Adolescent; Adult; Analysis; Auditory perception; Biology and Life Sciences; Brain research; Data processing; Editors; Female; Flatness; Frequency; Humans; Male; Mixed methods research; Music; Perception; Perceptions; Physical Sciences; Piano; Pitch Perception - physiology; Psychology; Qualitative analysis; Recommender systems; Rhythm; Rhythms; Social Sciences; Sound; Spectra; Speech; Speech perception; Studies; Testing
• ISSN: 1932-6203; 1932-6203
• DOI: 10.1371/journal.pone.0167643

Phrasing facilitates the organization of auditory information and is central to speech and music. Not surprisingly, aspects of changing intensity, rhythm, and pitch are key determinants of musical phrases and their boundaries in instrumental note-based music. Different kinds of speech (such as tone- vs. stress-languages) share these features in different proportions and form an instructive comparison. However, little is known about whether or how musical phrasing is perceived in sound-based music, where the basic musical unit from which a piece is created is commonly non-instrumental continuous sounds, rather than instrumental discontinuous notes. This issue forms the target of the present paper. Twenty participants (17 untrained in music) were presented with six stimuli derived from sound-based music, note-based music, and environmental sound. Their task was to indicate each occurrence of a perceived phrase and qualitatively describe key characteristics of the stimulus associated with each phrase response. It was hypothesized that sound-based music does elicit phrase perception, and that this is primarily associated with temporal changes in intensity and timbre, rather than rhythm and pitch. Results supported this hypothesis. Qualitative analysis of participant descriptions showed that for sound-based music, the majority of perceived phrases were associated with intensity or timbral change. For the note-based piano piece, rhythm was the main theme associated with perceived musical phrasing. We modeled the occurrence in time of perceived musical phrases with recurrent event 'hazard' analyses using time-series data representing acoustic predictors associated with intensity, spectral flatness, and rhythmic density. Acoustic intensity and timbre (represented here by spectral flatness) were strong predictors of perceived musical phrasing in sound-based music, and rhythm was only predictive for the piano piece. A further analysis including five additional spectral measures linked to timbre strengthened the models. Overall, results show that even when little of the pitch and rhythm information important for phrasing in note-based music is available, phrasing is still perceived, primarily in response to changes of intensity and timbre. Implications for electroacoustic music composition and music recommender systems are discussed.