Individualizing goal setting interventions using automated writing evaluation to support secondary school students’ text revisions

• Published in: Learning and instruction 2024-02, Vol.89, p.101847, Article 101847
• Main Authors: Jansen, Thorben, Meyer, Jennifer, Fleckenstein, Johanna, Horbach, Andrea, Keller, Stefan, Möller, Jens
• Format: Article
• Language: English
• Subjects: Automated writing evaluation; Goal setting; Revision; Writing; Writing intervention
• ISSN: 0959-4752; 1873-3263
• DOI: 10.1016/j.learninstruc.2023.101847

Revising is central in the process of writing and for acquiring writing skills. Setting revising goals is challenging especially for novice writers: students do not revise frequently, especially in homework conditions that demand high levels of self-regulation. Empirical studies of goal-setting interventions providing a detailed list of goals show positive effects on students’ revisions, and researchers have argued that individualizing such goal-setting interventions could increase intervention effectiveness. The present study individualized the list of goals based on students writing using automated writing evaluation. Participants were N = 345 academic track students from upper-secondary schools. We asked students to write a text in English as a second language (ESL) as homework and then to revise it. In a hierarchical sequence of four groups, we expanded the information to support students in self-evaluating their texts and setting appropriately challenging revising goals in a stepwise manner. Participants received a textbook passage showing a list of process goals (all groups), an assessment rubric (groups two, three, and four), an automated performance score (groups three and four), and individualized goal-setting instruction based on their performance score and the textbook passage (group four). Students receiving individualized goal-setting instructions showed the largest revision performance compared to the other groups, with and without controlling for text length. We discuss how goal-setting support in ESL writing can benefit from automated writing evaluation to provide individualized support and thus increase the effectiveness of goal setting interventions to increase students’ revision performances. •Experimental study investigating the effects of goal-setting interventions on student writing.•We individualized the provided goals based on automated writing evaluation.•Individualized goals outperformed control goal-setting interventions.•We integrated research from writing studies, educational technology, and psychology.