Emotional Sounds Guide Visual Attention to Emotional Pictures: An Eye-Tracking Study With Audio-Visual Stimuli

• Published in: Emotion (Washington, D.C.) D.C.), 2021-06, Vol.21 (4), p.679-692
• Main Authors: Gerdes, Antje B. M., Alpers, Georg W., Braun, Hanna, Köhler, Sabrina, Nowak, Ulrike, Treiber, Lisa
• Format: Article
• Language: English
• Subjects: Attentional Bias; Auditory Stimulation; Cues; Eye Movements; Female; Human; Male; Orienting Responses; Visual Attention; Visual Tracking; Visuospatial Ability
• ISSN: 1528-3542; 1931-1516
• DOI: 10.1037/emo0000729

For the realm of visual cues, it has been well documented that attention is preferentially oriented toward emotionally relevant cues. Preliminary evidence suggests that emotional cues from other sensory modalities may also steer visual attention toward emotional pictures. However, more research is needed to elucidate the mechanisms that are involved. Therefore, a novel design was used to investigate whether emotional sounds promote attentional orientation toward emotional pictures. To this end, 48 participants viewed pairs of pictures with either neutral or unpleasant content in a free-viewing paradigm. In addition, neutral or unpleasant sounds were presented either on the left-hand or on the right-hand side of the monitor. Eye movements were recorded as an index of visual spatial attention toward the pictures. Most interestingly, position and valence of the sounds independently modulated visual orienting towards unpleasant pictures. For initial capture and sustained attention, orienting towards unpleasant pictures was significantly enhanced when any sound was heard on the same side as the unpleasant picture. In addition, unpleasant sounds (irrespective of the side) boosted leftward bias of initial attention toward emotionally congruent pictures. Taken together, this study clearly shows that emotional auditory cues guide visual spatial allocation of attention specifically to emotionally congruent pictures.