EduLive: Re-Creating Cues for Instructor-Learners Interaction in Educational Live Streams with Learners' Transcript-Based Annotations

• Published in: Proceedings of the ACM on human-computer interaction 2024-11, Vol.8 (CSCW2), p.1-33, Article 421
• Main Authors: Fang, Jingchao, Park, Jeongeon, Kim, Juho, Wang, Hao-Chuan
• Format: Article
• Language: English
• Subjects: Human computer interaction (HCI); Human-centered computing; Interactive systems and tools
• ISSN: 2573-0142; 2573-0142
• DOI: 10.1145/3686960

Educational live streaming has become a complement to in-person teaching. While synchronous instructor-learner communication is useful, the technology-mediated nature of live streaming can obscure many interaction cues (e.g., learners' facial expressions and body language), which dampens the instructors' ability to respond to remote learners' needs. We explore the opportunity of leveraging real-time transcripts generated from instructors' audio as a basis for re-creating interaction cues. Transcripts can be leveraged to reveal the content of live streams in a form that learners can trace back and annotate, and such annotations can be further aggregated and presented to instructors as signals to assist them in tracking learners' engagement. By designing and evaluating our proof-of-concept prototype system, EduLive, we show that instructors benefited from the summative information extracted from learners' annotations, and the context provided by the transcript enhanced their ability to answer learners' questions. Our system contributes to the design space of social annotations in CSCW by employing social annotations in educational live streaming scenarios.