What you see isn’t always what you get: Auditory word signals trump consciously perceived words in lexical access

•Face-to-face speech involves both auditory and visual components.•We test when auditory–visual integration occurs relative to lexical access.•Lexical access precedes integration if the auditory signal is a real word.•However, AV-integration still occurs as long as the two signals are compatible.•Th...

Full description

Saved in:
Bibliographic Details
Published in:Cognition 2016-06, Vol.151, p.96-107
Main Authors: Ostrand, Rachel, Blumstein, Sheila E., Ferreira, Victor S., Morgan, James L.
Format: Article
Language:English
Subjects:
Acoustic Stimulation - methods
Adolescent
Adult
Auditory Perception - physiology
Auditory–visual integration
Female
Humans
Lexical access
Male
McGurk effect
Multisensory perception
Photic Stimulation - methods
Pilot Projects
Random Allocation
Reaction Time - physiology
Speech Perception - physiology
Visual Perception - physiology
Young Adult
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:•Face-to-face speech involves both auditory and visual components.•We test when auditory–visual integration occurs relative to lexical access.•Lexical access precedes integration if the auditory signal is a real word.•However, AV-integration still occurs as long as the two signals are compatible.•Thus, a comprehender can lexically access one word yet consciously perceive a different word. Human speech perception often includes both an auditory and visual component. A conflict in these signals can result in the McGurk illusion, in which the listener perceives a fusion of the two streams, implying that information from both has been integrated. We report two experiments investigating whether auditory–visual integration of speech occurs before or after lexical access, and whether the visual signal influences lexical access at all. Subjects were presented with McGurk or Congruent primes and performed a lexical decision task on related or unrelated targets. Although subjects perceived the McGurk illusion, McGurk and Congruent primes with matching real-word auditory signals equivalently primed targets that were semantically related to the auditory signal, but not targets related to the McGurk percept. We conclude that the time course of auditory–visual integration is dependent on the lexicality of the auditory and visual input signals, and that listeners can lexically access one word and yet consciously perceive another.
ISSN:0010-0277
1873-7838
DOI:10.1016/j.cognition.2016.02.019