Interaction between musical emotion and facial expression as measured by event-related potentials

• Published in: Neuropsychologia 2013-02, Vol.51 (3), p.500-505
• Main Authors: Kamiyama, Keiko S., Abla, Dilshat, Iwanaga, Koichi, Okanoya, Kazuo
• Format: Article
• Language: English
• Subjects: Acoustic Stimulation; Adolescent; Adult; Affectivity. Emotion; Analysis of Variance; Auditory Perception; Behavioral psychophysiology; Biological and medical sciences; Data processing; EEG; Electroencephalogram (EEG); Electroencephalography; Electrophysiology; Emotion; Emotions; Emotions - physiology; Event-related potentials; Evoked Potentials - physiology; Face; Facial Expression; Female; Fundamental and applied biological sciences. Psychology; Humans; Male; Middle Aged; Music; N400; Pattern Recognition, Visual; Personality. Affectivity; Photic Stimulation; Psychology. Psychoanalysis. Psychiatry; Psychology. Psychophysiology; Reaction Time - physiology; Young Adult
• ISSN: 0028-3932; 1873-3514
• DOI: 10.1016/j.neuropsychologia.2012.11.031

We examined the integrative process between emotional facial expressions and musical excerpts by using an affective priming paradigm. Happy or sad musical stimuli were presented after happy or sad facial images during electroencephalography (EEG) recordings. We asked participants to judge the affective congruency of the presented face–music pairs. The congruency of emotionally congruent pairs was judged more rapidly than that of incongruent pairs. In addition, the EEG data showed that incongruent musical targets elicited a larger N400 component than congruent pairs. Furthermore, these effects occurred in nonmusicians as well as musicians. In sum, emotional integrative processing of face–music pairs was facilitated in congruent music targets and inhibited in incongruent music targets; this process was not significantly modulated by individual musical experience. This is the first study on musical stimuli primed by facial expressions to demonstrate that the N400 component reflects the affective priming effect. ► We examined the integrative process of music and facial expressions by EEG. ► Emotionally matched and mismatched face–music pairs were presented. ► Musical targets in matched pairs elicited a larger N400 effect. ► The congruency of matched pairs was judged more rapidly. ► These affective priming effects were not influenced by individual musical experience.