Developing the FILL+ Tool to Reliably Classify Classroom Practices Using Lecture Recordings

• Published in: Journal for STEM education research. 2021-09, Vol.4 (2), p.194-216
• Main Authors: Kinnear, George, Smith, Steph, Anderson, Ross, Gant, Thomas, MacKay, Jill R D, Docherty, Pamela, Rhind, Susan, Galloway, Ross
• Format: Article
• Language: English
• Subjects: Access to Education; Active learning; Behavior; Classroom observation; Classroom Observation Techniques; Coding; Education; Educational Practices; Educational Supply; Engineering/Technology Education; Higher education; Interrater Reliability; Lecture Method; Listening; Mathematics Education; Observation; Outcomes of Education; Peer Teaching; Public speaking; Research Article; Sampling; Science Education; Students; Teaching Methods
• ISSN: 2520-8705; 2520-8713
• DOI: 10.1007/s41979-020-00047-7

Lectures are a commonly used teaching method in higher education, but there is significant debate about the relative merits of different classroom practices. Various classroom observation tools have been developed to try to give insight into these practices, beyond the simple dichotomy of “traditional lecturing versus active learning”. Here we review of a selection of classroom observation protocols from an ethological perspective and describe how this informed the development of a new protocol, FILL+. We demonstrate that FILL+ can be applied reliably by undergraduate students after minimal training. We analysed a sample of 208 lecture recordings from Mathematics, Physics, and Veterinary Medicine and found a wide variety of classroom practices, e.g. on average lecturers spent 2.1% (± 2.6%) of the time asking questions, and 79.3% (± 19%) of the lecture talking, but individuals varied considerably. The FILL+ protocol has the potential to be widely used, both in research on effective teaching practices, and in informing discussion of pedagogical approaches within institutions and disciplines.