Effectiveness of tutoring at school: A machine learning evaluation

• Published in: Technological forecasting & social change 2024-02, Vol.199, p.123043, Article 123043
• Main Authors: Ballestar, María Teresa, Mir, Miguel Cuerdo, Pedrera, Luis Miguel Doncel, Sainz, Jorge
• Format: Article
• Language: English
• Subjects: Artificial neural networks; Machine learning; Public policy analysis; Tutoring program
• ISSN: 0040-1625; 1873-5509
• DOI: 10.1016/j.techfore.2023.123043

Tutoring programs are effective in reducing school failures among at-risk students. However, there is still room for improvement in maximising the social returns they provide on investments. Many factors and components can affect student engagement in a program and academic success. This complexity presents a challenge for Public Administrations to use their budgets as efficiently as possible. Our research focuses on providing public administration with advanced decision-making tools. First, we analyse a database with information on 2066 students of the Programa para la Mejora de Éxito Educativo (Programme for the Improvement of Academic Success) of the Junta de Comunidades de Castilla y Léon in Spain, in 2018–2019, the academic year previous to the pandemic. This program is designed to help schools with students at risk of failure in Spanish, literature, mathematics, and English. We developed a machine learning model (ML) based on Kohonen self-organising maps (SOMs), which are a type of unsupervised (ANN), to group students based on their characteristics, the type of tutoring program in which they were enrolled, and their results in both the completion of the program and the 4th year of Compulsory Secondary Education (ESO). Second, we evaluated the results of tutoring programs and identified and explained how different factors and components affect student engagement and academic success. Our findings provide Public Administrations with better decision-making tools to evaluate and measure the results of tutoring programs in terms of social return on investment, improve the design of these programs, and choose the students to enrol. •Machine learning methods greatly aid tutoring programs' effectiveness.•Tutoring programs are effective to support students at risk of school failure.•Tutoring programs help reengage students who have already had academic failures.•Students' engagement in the tutoring programs depends on many diverse factors.•Precise Identification of students at risk maximizes social return on programs.