Recognizing Young Readers' Spoken Questions

Free-form spoken input would be the easiest and most natural way for young children to communicate to an intelligent tutoring system. However, achieving such a capability poses a challenge both to instruction design and to automatic speech recognition. To address the difficulties of accepting such i...

Full description

Saved in:
Bibliographic Details
Published in:International journal of artificial intelligence in education 2013, Vol.21 (4), p.255-269
Main Authors: Chen, Wei, Mostow, Jack, Aist, Gregory
Format: Article
Language:English
Subjects:
Artificial Intelligence
Automation
Case Studies
Children
Computational Linguistics
Design engineering
Education
Expert systems
Intelligent Tutoring Systems
Linguistics
Mathematical models
Oral Reading
Questioning Techniques
Reading Comprehension
Reading Instruction
Reading Strategies
Speech
Strategy
Young Children
Citations: Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Free-form spoken input would be the easiest and most natural way for young children to communicate to an intelligent tutoring system. However, achieving such a capability poses a challenge both to instruction design and to automatic speech recognition. To address the difficulties of accepting such input, we adopt the framework of predictable response training, which aims at simultaneously achieving linguistic predictability and educational utility. We design instruction in this framework to teach children the reading comprehension strategy of self-questioning. To filter out some misrecognized speech, we combine acoustic confidence with language modeling techniques that exploit the predictability of the elicited responses. Compared to a baseline that does neither, this approach performs significantly better in concept recall (47% vs. 28%) and precision (61% vs. 39%) on 250 unseen utterances from 34 previously unseen speakers. We conclude with some design implications for future speech enabled tutoring systems. (Contains 2 tables, 3 figures and 1 footnote.)
ISSN:1560-4292
DOI:10.3233/JAI-130031