Assessing automaticity in audiovisual speech integration: evidence from the speeded classification task

The McGurk effect is usually presented as an example of fast, automatic, multisensory integration. We report a series of experiments designed to directly assess these claims. We used a syllabic version of the speeded classification paradigm, whereby response latencies to the first (target) syllable...

Full description

Saved in:
Bibliographic Details
Published in:Cognition 2004-07, Vol.92 (3), p.B13-B23
Main Authors: Soto-Faraco, Salvador, Navarra, Jordi, Alsius, Agnès
Format: Article
Language:English
Subjects:
Adult
Attention
Audiovisual Communications
Audiovisual methods
Audiovisual speech
Auditory Perception
Auditory Perception - physiology
Auditory Stimuli
Biological and medical sciences
Classification
Evidence
Experiments
Female
Fundamental and applied biological sciences. Psychology
Humans
Language
Linguistics
Male
McGurk illusion
Mental Processes
Multisensory integration
Multisensory Learning
Paradigms
Production and perception of spoken language
Psychology
Psychology. Psychoanalysis. Psychiatry
Psychology. Psychophysiology
Reaction Time
Senses
Sensory Integration
Speech
Speech Communication
Speech Perception - physiology
Speeded discrimination
Stimuli
Syllables
Task Performance and Analysis
Visual Perception
Visual Perception - physiology
Visual Stimuli
Citations: Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The McGurk effect is usually presented as an example of fast, automatic, multisensory integration. We report a series of experiments designed to directly assess these claims. We used a syllabic version of the speeded classification paradigm, whereby response latencies to the first (target) syllable of spoken word-like stimuli are slowed down when the second (irrelevant) syllable varies from trial to trial. This interference effect is interpreted as a failure of selective attention to filter out the irrelevant syllable. In Experiment 1 we reproduced the syllabic interference effect with bimodal stimuli containing auditory as well as visual lip movement information, thus confirming the generalizability of the phenomenon. In subsequent experiments we were able to produce (Experiment 2) and to eliminate (Experiment 3) syllabic interference by introducing ‘illusory’ (McGurk) audiovisual stimuli in the irrelevant syllable, suggesting that audiovisual integration occurs prior to attentional selection in this paradigm.
ISSN:0010-0277
1873-7838
DOI:10.1016/j.cognition.2003.10.005