Automated short answer grading with computer-assisted grading example acquisition based on active learning

The technology of automated short answer grading (ASAG) can efficiently process answers according to human-prepared grading examples. Computer-assisted acquisition of grading examples uses a computer algorithm to sample real student responses for potentially good examples. The process is critical fo...

Full description

Saved in:
Bibliographic Details
Published in:Interactive learning environments 2024-05, Vol.32 (5), p.2087-2104
Main Authors: Kwok-Fai Lui, Andrew, Ng, Sin-Chun, Wing-Nga Cheung, Stella
Format: Article
Language:English
Subjects:
Active Learning
Algorithms
Annotations
auto-grading
Automation
classification
Computers
cost-effectiveness
Distance learning
Educational Technology
Electronic Learning
Grading
Machine learning
Optimization
Semi-supervised learning
Short answer grading
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The technology of automated short answer grading (ASAG) can efficiently process answers according to human-prepared grading examples. Computer-assisted acquisition of grading examples uses a computer algorithm to sample real student responses for potentially good examples. The process is critical for optimizing the grading accuracy of machine learning models given a budget of human effort and the appeal of ASAG to online learning providers. This paper presents a novel method called short answer grading with active learning (SAGAL) that features a unified formulation comprising the heuristics for identifying potentially optimal examples of representative answers, borderline answers, and anomalous answers. The method is based on active learning, which iteratively samples good examples and queries for annotation to increase the sampling accuracy. SAGAL has been evaluated with three different public datasets of distinctive characteristics. The results show that the resulting models generally outperform the baseline semi-supervised learning methods on the same number of grading examples.
ISSN:1049-4820
1744-5191
DOI:10.1080/10494820.2022.2137530