Can we Use GPT-4 as a Mathematics Evaluator in Education?: Exploring the Efficacy and Limitation of LLM-based Automatic Assessment System for Open-ended Mathematics Question

Saved in:
Bibliographic Details
Published in:International journal of artificial intelligence in education 2024-12
Main Authors: Lee, Unggi, Kim, Youngin, Lee, Sangyun, Park, Jaehyeon, Mun, Jin, Lee, Eunseo, Kim, Hyeoncheol, Lim, Cheolil, Yoo, Yun Joo
Format: Article
Language:English
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites cdi_FETCH-LOGICAL-c791-828f06b8d3077ad8a8e5e0b7f0c333ee129082d0d2a2647f7bab11522b3c53ed3
container_end_page
container_issue
container_start_page
container_title International journal of artificial intelligence in education
container_volume
creator Lee, Unggi
Kim, Youngin
Lee, Sangyun
Park, Jaehyeon
Mun, Jin
Lee, Eunseo
Kim, Hyeoncheol
Lim, Cheolil
Yoo, Yun Joo
description
doi_str_mv 10.1007/s40593-024-00448-4
format article
fullrecord <record><control><sourceid>crossref</sourceid><recordid>TN_cdi_crossref_primary_10_1007_s40593_024_00448_4</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>10_1007_s40593_024_00448_4</sourcerecordid><originalsourceid>FETCH-LOGICAL-c791-828f06b8d3077ad8a8e5e0b7f0c333ee129082d0d2a2647f7bab11522b3c53ed3</originalsourceid><addsrcrecordid>eNpNkN1Kw0AQRhdRsFZfwKt5gdXJ7uan3kgpsQopVazXYZOd1UizKdlE7UP5jqatglfzMRy-GQ5jlwFeBYjxtVcYTiRHoTiiUglXR2wUhBFyJTE6_stiIk7ZmffvAxRjpEbse6YdfBK8eIL544or0B40LHT3RrXuqtJD-qHXve6aFioHqenLYd242xtIvzbrpq3cKwwwpNZWpS63oJ2BrKqrbs9BYyHLFrzQngxM-67Z18LUe_K-JtfB89Z3VIMdLiw35Dg5M6D_X3jqye_KztmJ1WtPF79zzFZ36Wp2z7Pl_GE2zXgZTwKeiMRiVCRGYhxrk-iEQsIitlhKKYkCMcFEGDRCi0jFNi50EQShEIUsQ0lGjpk41JZt431LNt-0Va3bbR5gvvOdH3zng-987ztX8gfAU3Ui</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Can we Use GPT-4 as a Mathematics Evaluator in Education?: Exploring the Efficacy and Limitation of LLM-based Automatic Assessment System for Open-ended Mathematics Question</title><source>Springer Nature</source><creator>Lee, Unggi ; Kim, Youngin ; Lee, Sangyun ; Park, Jaehyeon ; Mun, Jin ; Lee, Eunseo ; Kim, Hyeoncheol ; Lim, Cheolil ; Yoo, Yun Joo</creator><creatorcontrib>Lee, Unggi ; Kim, Youngin ; Lee, Sangyun ; Park, Jaehyeon ; Mun, Jin ; Lee, Eunseo ; Kim, Hyeoncheol ; Lim, Cheolil ; Yoo, Yun Joo</creatorcontrib><identifier>ISSN: 1560-4292</identifier><identifier>EISSN: 1560-4306</identifier><identifier>DOI: 10.1007/s40593-024-00448-4</identifier><language>eng</language><ispartof>International journal of artificial intelligence in education, 2024-12</ispartof><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c791-828f06b8d3077ad8a8e5e0b7f0c333ee129082d0d2a2647f7bab11522b3c53ed3</cites><orcidid>0000-0002-0883-4128 ; 0009-0005-2966-1755 ; 0000-0003-0555-8591 ; 0009-0004-3890-554X ; 0000-0001-8592-8446 ; 0009-0007-3419-9846 ; 0009-0005-2369-2323 ; 0009-0000-1478-473X ; 0000-0003-4769-0400</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27923,27924</link.rule.ids></links><search><creatorcontrib>Lee, Unggi</creatorcontrib><creatorcontrib>Kim, Youngin</creatorcontrib><creatorcontrib>Lee, Sangyun</creatorcontrib><creatorcontrib>Park, Jaehyeon</creatorcontrib><creatorcontrib>Mun, Jin</creatorcontrib><creatorcontrib>Lee, Eunseo</creatorcontrib><creatorcontrib>Kim, Hyeoncheol</creatorcontrib><creatorcontrib>Lim, Cheolil</creatorcontrib><creatorcontrib>Yoo, Yun Joo</creatorcontrib><title>Can we Use GPT-4 as a Mathematics Evaluator in Education?: Exploring the Efficacy and Limitation of LLM-based Automatic Assessment System for Open-ended Mathematics Question</title><title>International journal of artificial intelligence in education</title><issn>1560-4292</issn><issn>1560-4306</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNpNkN1Kw0AQRhdRsFZfwKt5gdXJ7uan3kgpsQopVazXYZOd1UizKdlE7UP5jqatglfzMRy-GQ5jlwFeBYjxtVcYTiRHoTiiUglXR2wUhBFyJTE6_stiIk7ZmffvAxRjpEbse6YdfBK8eIL544or0B40LHT3RrXuqtJD-qHXve6aFioHqenLYd242xtIvzbrpq3cKwwwpNZWpS63oJ2BrKqrbs9BYyHLFrzQngxM-67Z18LUe_K-JtfB89Z3VIMdLiw35Dg5M6D_X3jqye_KztmJ1WtPF79zzFZ36Wp2z7Pl_GE2zXgZTwKeiMRiVCRGYhxrk-iEQsIitlhKKYkCMcFEGDRCi0jFNi50EQShEIUsQ0lGjpk41JZt431LNt-0Va3bbR5gvvOdH3zng-987ztX8gfAU3Ui</recordid><startdate>20241219</startdate><enddate>20241219</enddate><creator>Lee, Unggi</creator><creator>Kim, Youngin</creator><creator>Lee, Sangyun</creator><creator>Park, Jaehyeon</creator><creator>Mun, Jin</creator><creator>Lee, Eunseo</creator><creator>Kim, Hyeoncheol</creator><creator>Lim, Cheolil</creator><creator>Yoo, Yun Joo</creator><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0002-0883-4128</orcidid><orcidid>https://orcid.org/0009-0005-2966-1755</orcidid><orcidid>https://orcid.org/0000-0003-0555-8591</orcidid><orcidid>https://orcid.org/0009-0004-3890-554X</orcidid><orcidid>https://orcid.org/0000-0001-8592-8446</orcidid><orcidid>https://orcid.org/0009-0007-3419-9846</orcidid><orcidid>https://orcid.org/0009-0005-2369-2323</orcidid><orcidid>https://orcid.org/0009-0000-1478-473X</orcidid><orcidid>https://orcid.org/0000-0003-4769-0400</orcidid></search><sort><creationdate>20241219</creationdate><title>Can we Use GPT-4 as a Mathematics Evaluator in Education?: Exploring the Efficacy and Limitation of LLM-based Automatic Assessment System for Open-ended Mathematics Question</title><author>Lee, Unggi ; Kim, Youngin ; Lee, Sangyun ; Park, Jaehyeon ; Mun, Jin ; Lee, Eunseo ; Kim, Hyeoncheol ; Lim, Cheolil ; Yoo, Yun Joo</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c791-828f06b8d3077ad8a8e5e0b7f0c333ee129082d0d2a2647f7bab11522b3c53ed3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Lee, Unggi</creatorcontrib><creatorcontrib>Kim, Youngin</creatorcontrib><creatorcontrib>Lee, Sangyun</creatorcontrib><creatorcontrib>Park, Jaehyeon</creatorcontrib><creatorcontrib>Mun, Jin</creatorcontrib><creatorcontrib>Lee, Eunseo</creatorcontrib><creatorcontrib>Kim, Hyeoncheol</creatorcontrib><creatorcontrib>Lim, Cheolil</creatorcontrib><creatorcontrib>Yoo, Yun Joo</creatorcontrib><collection>CrossRef</collection><jtitle>International journal of artificial intelligence in education</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Lee, Unggi</au><au>Kim, Youngin</au><au>Lee, Sangyun</au><au>Park, Jaehyeon</au><au>Mun, Jin</au><au>Lee, Eunseo</au><au>Kim, Hyeoncheol</au><au>Lim, Cheolil</au><au>Yoo, Yun Joo</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Can we Use GPT-4 as a Mathematics Evaluator in Education?: Exploring the Efficacy and Limitation of LLM-based Automatic Assessment System for Open-ended Mathematics Question</atitle><jtitle>International journal of artificial intelligence in education</jtitle><date>2024-12-19</date><risdate>2024</risdate><issn>1560-4292</issn><eissn>1560-4306</eissn><doi>10.1007/s40593-024-00448-4</doi><orcidid>https://orcid.org/0000-0002-0883-4128</orcidid><orcidid>https://orcid.org/0009-0005-2966-1755</orcidid><orcidid>https://orcid.org/0000-0003-0555-8591</orcidid><orcidid>https://orcid.org/0009-0004-3890-554X</orcidid><orcidid>https://orcid.org/0000-0001-8592-8446</orcidid><orcidid>https://orcid.org/0009-0007-3419-9846</orcidid><orcidid>https://orcid.org/0009-0005-2369-2323</orcidid><orcidid>https://orcid.org/0009-0000-1478-473X</orcidid><orcidid>https://orcid.org/0000-0003-4769-0400</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 1560-4292
ispartof International journal of artificial intelligence in education, 2024-12
issn 1560-4292
1560-4306
language eng
recordid cdi_crossref_primary_10_1007_s40593_024_00448_4
source Springer Nature
title Can we Use GPT-4 as a Mathematics Evaluator in Education?: Exploring the Efficacy and Limitation of LLM-based Automatic Assessment System for Open-ended Mathematics Question
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-12T23%3A54%3A46IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-crossref&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Can%20we%20Use%20GPT-4%20as%20a%20Mathematics%20Evaluator%20in%20Education?:%20Exploring%20the%20Efficacy%20and%20Limitation%20of%20LLM-based%20Automatic%20Assessment%20System%20for%20Open-ended%20Mathematics%20Question&rft.jtitle=International%20journal%20of%20artificial%20intelligence%20in%20education&rft.au=Lee,%20Unggi&rft.date=2024-12-19&rft.issn=1560-4292&rft.eissn=1560-4306&rft_id=info:doi/10.1007/s40593-024-00448-4&rft_dat=%3Ccrossref%3E10_1007_s40593_024_00448_4%3C/crossref%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c791-828f06b8d3077ad8a8e5e0b7f0c333ee129082d0d2a2647f7bab11522b3c53ed3%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true