From data to actions: Instructors' decision making based on learners' data in online emergency remote teaching

• Published in: British journal of educational technology 2021-07, Vol.52 (4), p.1338-1356
• Main Authors: Usher, Maya, Hershkovitz, Arnon, Forkosh‐Baruch, Alona
• Format: Article
• Language: English
• Subjects: data‐driven decision‐making; emergency remote teaching; higher education; instructor perspective; online teaching
• ISSN: 0007-1013; 1467-8535
• DOI: 10.1111/bjet.13108

The outbreak of the COVID‐19 pandemic has changed education dramatically, with the sudden shift from face‐to‐face to emergency remote teaching. Online learning environments may facilitate data‐driven instructional process; yet, our understanding regarding data‐driven decisions is still limited. This quantitative study examined types of learners' data that higher education instructors have access to, are interested in, and decisions they would consider making upon exposure to, while comparing emergency remote teaching with traditional teaching. Data were collected via an online questionnaire distributed among higher education instructors during the first COVID‐19 outbreak (N = 195, affiliated with 108 different academic institutions in 35 countries). Instructors were requested to refer to a face‐to‐face course that was shifted under these emergency circumstances to online teaching. Findings indicated a broader access to learners' data while teaching the course face‐to‐face and a slightly greater interest in learners' data while teaching the course in an emergency remote teaching mode. These complimentary findings depict a situation in which instructors lack face‐to‐face cues about their students without accessing alternative sources of data. Moreover, when teaching online versus face‐to‐face, instructors showed more interest and higher intention to make decisions based on data about learners' collaborative learning and social and emotional support, which highlights instructors' interest in aspects of learning that are less visible during online teaching. Practitioner notes What is already known about this topic Evidence regarding the vital role of the instructor in online courses. Online learning environments collect digital traces of learners. Learners' data may assist in the improvement of teaching by implementing data‐driven decision making. Evidence that the COVID‐19 pandemic revealed a major liability in preparation and training for online teaching. The understanding of instructors' perspectives regarding the process of data‐driven decisions, especially in times of ERT, is still limited. What this paper adds We highlight instructors' perceived access to, interest in, and willingness to make decisions based on learners' data. We take a within‐subject approach for determining instructors' perceptions of learners' data during ERT compared with face‐to‐face teaching. We bring evidence to instructors' lesser access to (despite learners' digital traces), and