Multimodality in webconference-based language tutoring: An ecological approach integrating eye tracking

• Published in: ReCALL (Cambridge, England) England), 2022-09, Vol.34 (3), p.255-273
• Main Authors: Cappellini, Marco, Hsu, Yu-Yin
• Format: Article
• Language: English
• Subjects: Affordances; Communication; Computer assisted language learning; Computer Mediated Communication; Distance learning; Ecological effects; Education; Educational Technology; Electronic Learning; Environment; Eye Movements; Holistic Approach; Humanities and Social Sciences; Integrated Activities; Joint attention; Language; Language Teachers; Learning Activities; Linguistic Theory; Linguistics; Literature Reviews; Mandarin; Mandarin Chinese; Multimedia Instruction; Multimodality; Oral Language; Pedagogy; Preservice Teacher Education; Preservice Teachers; Researchers; Second Language Instruction; Second Language Learning; Semiotics; Sociolinguistics; Student teachers; Teacher Improvement; Teacher Student Relationship; Teachers; Teaching; Teaching Methods; Tracking; Tutoring; Validity; Video conferencing; Videoconferencing; Written Language
• ISSN: 0958-3440; 1474-0109; 0958-3440
• DOI: 10.1017/S0958344022000076

Drawing on existing research with a holistic stance toward multimodal meaning-making, this paper takes an analytic approach to integrating eye-tracking data to study the perception and use of multimodality by teachers and learners. To illustrate this approach, we analyse two webconference tutoring sessions from a telecollaborative project involving pre-service teachers and learners of Mandarin Chinese. The tutoring sessions were recorded and transcribed multimodally, and our analysis of two types of conversational side sequences shows that the integration of eye-tracking data into an ecological approach provides richer results. Specifically, our proposed approach provided a window on the participants’ cognitive management of graphic and visual affordances during interaction and uncovered episodes of joint attention.