The level of audiovisual print–speech integration deficits in dyslexia

• Published in: Neuropsychologia 2014-09, Vol.62 (Sep), p.245-261
• Main Authors: Kronschnabel, Jens, Brem, Silvia, Maurer, Urs, Brandeis, Daniel
• Format: Article
• Language: English
• Subjects: Acoustic Stimulation; Adolescence; Adolescent; Adult and adolescent clinical studies; Analysis of Variance; Auditory Perception - physiology; Biological and medical sciences; Brain - blood supply; Brain - pathology; Brain - physiopathology; Dyslexia - complications; Dyslexia - pathology; Electroencephalography; Female; Humans; Image Processing, Computer-Assisted; Language and communication disorders; Magnetic Resonance Imaging; Male; Medical sciences; Multisensory integration; Oxygen - blood; Perceptual Disorders - etiology; Phonetics; Phonological deficit; Photic Stimulation; Planum temporale; Psychology. Psychoanalysis. Psychiatry; Psychopathology. Psychiatry; Reaction Time; Reading; Superior temporal; Visual Perception - physiology
• ISSN: 0028-3932; 1873-3514
• DOI: 10.1016/j.neuropsychologia.2014.07.024

The classical phonological deficit account of dyslexia is increasingly linked to impairments in grapho-phonological conversion, and to dysfunctions in superior temporal regions associated with audiovisual integration. The present study investigates mechanisms of audiovisual integration in typical and impaired readers at the critical developmental stage of adolescence. Congruent and incongruent audiovisual as well as unimodal (visual only and auditory only) material was presented. Audiovisual presentations were single letters and three-letter (consonant–vowel–consonant) stimuli accompanied by matching or mismatching speech sounds. Three-letter stimuli exhibited fast phonetic transitions as in real-life language processing and reading. Congruency effects, i.e. different brain responses to congruent and incongruent stimuli were taken as an indicator of audiovisual integration at a phonetic level (grapho-phonological conversion). Comparisons of unimodal and audiovisual stimuli revealed basic, more sensory aspects of audiovisual integration. By means of these two criteria of audiovisual integration, the generalizability of audiovisual deficits in dyslexia was tested. Moreover, it was expected that the more naturalistic three-letter stimuli are superior to single letters in revealing group differences. Electrophysiological and hemodynamic (EEG and fMRI) data were acquired simultaneously in a simple target detection task. Applying the same statistical models to event-related EEG potentials and fMRI responses allowed comparing the effects detected by the two techniques at a descriptive level. Group differences in congruency effects (congruent against incongruent) were observed in regions involved in grapho-phonological processing, including the left inferior frontal and angular gyri and the inferotemporal cortex. Importantly, such differences also emerged in superior temporal key regions. Three-letter stimuli revealed stronger group differences than single letters. No significant differences in basic measures of audiovisual integration emerged. Convergence of hemodynamic and electrophysiological signals appeared to be limited and mainly occurred for highly significant and large effects in visual cortices. The findings suggest efficient superior temporal tuning to audiovisual congruency in controls. In impaired readers, however, grapho-phonological conversion is effortful and inefficient, although basic audiovisual mechanisms seem intact. This unprecedented demonst