Automatic Short Answer Grading onHigh School’s E-Learning Using Semantic Similarity Methods

Grading students’ answers has always been a daunting task which takes a lot of teachers’ time. The aim of this study is to grade students’ answers automatically in a high school’s e-learning system. The grading process must be fast, and the result must be as close as possible to the teacher assigned...

Full description

Saved in:
Bibliographic Details
Published in:TEM Journal 2023-02, Vol.12 (1), p.297-302
Main Authors: Wilianto, Daniel, Girsang, Abba Suganda
Format: Article
Language:English
Subjects:
Distance learning
Distance learning / e-learning
ICT Information and Communications Technologies
Learning
Machine learning
Online instruction
Python
Sentences
Similarity
Students
Teachers
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Grading students’ answers has always been a daunting task which takes a lot of teachers’ time. The aim of this study is to grade students’ answers automatically in a high school’s e-learning system. The grading process must be fast, and the result must be as close as possible to the teacher assigned grades. We collected a total of 840 answers from 40 students for this study, each already graded by their teachers. We used Python library sentence-transformers and three of its latest pre-trained machine learning models (all-mpnet-base-v2, all-distilroberta-v1, all-MiniLM-L6-v2) for sentence embeddings. Computer grades were calculated using Cosine Similarity. These grades were then compared with teacher assigned grades using both Mean Absolute Error and Root Mean Square Error. Our results showed that all-MiniLM-L6-v2 gave the most similar grades to teacher assigned grades and had the fastest processing time. Further study may include testing these models on more answers from more students, also fine tune these models using more school materials.
ISSN:2217-8309
2217-8333
DOI:10.18421/TEM121-37