Comparing the Effect of Contextualized Versus Generic Automated Feedback on Students' Scientific Argumentation

• Published in: ETS research report series 2022-12, Vol.2022 (1), p.1-14
• Main Authors: Olivera‐Aguilar, Margarita, Lee, Hee‐Sun, Pallant, Amy, Belur, Vinetha, Mulholland, Matthew, Liu, Ou Lydia
• Format: Article
• Language: English
• Subjects: Automated feedback; contextualized feedback; elaboration feedback; scientific argumentation; uncertainty‐infused scientific arguments
• ISSN: 2330-8516; 2330-8516
• DOI: 10.1002/ets2.12344

This study uses a computerized formative assessment system that provides automated scoring and feedback to help students write scientific arguments in a climate change curriculum. We compared the effect of contextualized versus generic automated feedback on students' explanations of scientific claims and attributions of uncertainty to those claims. Classes were randomly assigned to the contextualized feedback condition (227 students from 11 classes) or to the generic feedback condition (138 students from 9 classes). The results indicate that the formative assessment helped students improve their scores in both explanation and uncertainty scores, but larger score gains were found in the uncertainty attribution scores. Although the contextualized feedback was associated with higher final scores, this effect was moderated by the number of revisions made, the initial score, and gender. We discuss how the results might be related to students' familiarity with writing scientific explanations versus uncertainty attributions at school.