The word superiority effect in audiovisual speech perception

Seeing the facial gestures of a speaker enhances phonemic identification in noise. The goal of this study was to assess whether the visual information regarding consonant articulation activates lexical representations. We conducted a phoneme monitoring task with word and pseudo-words in audio only (...

Full description

Saved in:
Bibliographic Details
Published in:Speech communication 2010-06, Vol.52 (6), p.525-532
Main Authors: Fort, Mathilde, Spinelli, Elsa, Savariaux, Christophe, Kandel, Sonia
Format: Article
Language:English
Subjects:
Acoustic noise
Acoustics
Activation
Audiovisual
Audiovisual speech
Cognitive science
Lexical access
Linguistics
Masking
Phonemes
Speech
Speech perception in noise
Visual
Word recognition
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Seeing the facial gestures of a speaker enhances phonemic identification in noise. The goal of this study was to assess whether the visual information regarding consonant articulation activates lexical representations. We conducted a phoneme monitoring task with word and pseudo-words in audio only (A) and audiovisual (AV) contexts with two levels of white noise masking the acoustic signal. The results confirmed that visual information enhances consonant detection in noisy conditions and also revealed that it accelerates the phoneme detection process. The consonants were detected faster in AV than in A only condition. Furthermore, when the acoustic signal was deteriorated, the consonant phonemes were better recognized when they were embedded in words rather than in pseudo-words in the AV condition. This provides evidence indicating that visual information on phoneme identity can contribute to lexical activation processes during word recognition.
ISSN:0167-6393
1872-7182
DOI:10.1016/j.specom.2010.02.005