Loading…

Exhibiting achievement behavior during computer-based testing: What temporal trace data and personality traits tell us?

Personalizing computer-based testing services to examinees can be improved by considering their behavioral models. This study aims to contribute towards deeper understanding the examinee’s time-spent and achievement behavior during testing according to the five personality traits by exploiting asses...

Full description

Saved in:
Bibliographic Details
Published in:Computers in human behavior 2017-10, Vol.75, p.423-438
Main Authors: Papamitsiou, Zacharoula, Economides, Anastasios A.
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c325t-372129f7be8477dc969f9c65f80122b36949e4e977e5cfd6721b58fbd8ad44b43
cites cdi_FETCH-LOGICAL-c325t-372129f7be8477dc969f9c65f80122b36949e4e977e5cfd6721b58fbd8ad44b43
container_end_page 438
container_issue
container_start_page 423
container_title Computers in human behavior
container_volume 75
creator Papamitsiou, Zacharoula
Economides, Anastasios A.
description Personalizing computer-based testing services to examinees can be improved by considering their behavioral models. This study aims to contribute towards deeper understanding the examinee’s time-spent and achievement behavior during testing according to the five personality traits by exploiting assessment analytics. Further, it aims to investigate assessment analytics appropriateness for classifying students and generating enhanced student models to guide personalization of testing services. In this study, the LAERS assessment environment and the Big Five Inventory were used to track the response times of 112 undergraduate students and to extract their personality traits respectively. Partial Least Squares was used to detect fundamental relationships between the collected data, and Supervised Learning Algorithms were used to classify students. Results indicate a positive effect of extraversion and agreeableness on goal-expectancy, a positive effect of conscientiousness on both goal-expectancy and level of certainty, and a negative effect of neuroticism and openness on level of certainty. Further, extraversion, agreeableness and conscientiousness have statistically significant indirect impact on students’ response-times and level of achievement. Moreover, the ensemble RandomForest method provides accurate classification results, indicating that a time-spent driven description of students’ behavior could have added value towards dynamically reshaping the respective models. Further implications of these findings are also discussed. •We exploit assessment analytics for exploring time-spent and achievement behavior.•We associate examinees’ personality traits with time-spent and achievement behavior.•Examinees’ extraversion and agreeableness positively affect goal-expectancy.•Conscientiousness positively affects examinee goal-expectancy and level of certainty.•Examinees’ neuroticism and openness have a negative effect on level of certainty.
doi_str_mv 10.1016/j.chb.2017.05.036
format article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_1939918170</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0747563217303576</els_id><sourcerecordid>1939918170</sourcerecordid><originalsourceid>FETCH-LOGICAL-c325t-372129f7be8477dc969f9c65f80122b36949e4e977e5cfd6721b58fbd8ad44b43</originalsourceid><addsrcrecordid>eNp9kE1L5TAUhsPgwFw_foC7gOvWpG2SRhcioqMguFFchnycTnPpbWuS3tF_Pyl31q4Oh_M8h5cXoXNKSkoov9yWtjdlRagoCStJzX-gDW1FXQguqyO0IaIRBeN19Qsdx7glhDBG-Ab9vf_svfHJj3-wtr2HPexgTNhAr_d-CtgtYb3ZaTcvCUJhdASHE8RVucLvvU55281T0ANOQVvATieN9ejwDCFOox58-lpPPsWMDgNe4s0p-tnpIcLZ_3mC3h7uX-8ei-eX3093t8-FrSuWilpUtJKdMNA2Qjgrueyk5axrCa0qU3PZSGhACgHMdo5n3LC2M67VrmlMU5-gi8PfOUwfS06tttMScqaoqKylpC0VJFP0QNkwxRigU3PwOx2-FCVq7VdtVe5Xrf0qwlTuNzvXBwdy_L2HoKL1MFpwPoBNyk3-G_sf-hqEvQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1939918170</pqid></control><display><type>article</type><title>Exhibiting achievement behavior during computer-based testing: What temporal trace data and personality traits tell us?</title><source>Elsevier</source><creator>Papamitsiou, Zacharoula ; Economides, Anastasios A.</creator><creatorcontrib>Papamitsiou, Zacharoula ; Economides, Anastasios A.</creatorcontrib><description>Personalizing computer-based testing services to examinees can be improved by considering their behavioral models. This study aims to contribute towards deeper understanding the examinee’s time-spent and achievement behavior during testing according to the five personality traits by exploiting assessment analytics. Further, it aims to investigate assessment analytics appropriateness for classifying students and generating enhanced student models to guide personalization of testing services. In this study, the LAERS assessment environment and the Big Five Inventory were used to track the response times of 112 undergraduate students and to extract their personality traits respectively. Partial Least Squares was used to detect fundamental relationships between the collected data, and Supervised Learning Algorithms were used to classify students. Results indicate a positive effect of extraversion and agreeableness on goal-expectancy, a positive effect of conscientiousness on both goal-expectancy and level of certainty, and a negative effect of neuroticism and openness on level of certainty. Further, extraversion, agreeableness and conscientiousness have statistically significant indirect impact on students’ response-times and level of achievement. Moreover, the ensemble RandomForest method provides accurate classification results, indicating that a time-spent driven description of students’ behavior could have added value towards dynamically reshaping the respective models. Further implications of these findings are also discussed. •We exploit assessment analytics for exploring time-spent and achievement behavior.•We associate examinees’ personality traits with time-spent and achievement behavior.•Examinees’ extraversion and agreeableness positively affect goal-expectancy.•Conscientiousness positively affects examinee goal-expectancy and level of certainty.•Examinees’ neuroticism and openness have a negative effect on level of certainty.</description><identifier>ISSN: 0747-5632</identifier><identifier>EISSN: 1873-7692</identifier><identifier>DOI: 10.1016/j.chb.2017.05.036</identifier><language>eng</language><publisher>Elmsford: Elsevier Ltd</publisher><subject>Academic achievement ; Assessment analytics ; BFI ; Classification ; College students ; Computer-based testing ; Educational evaluation ; Machine learning ; Personality ; Personality traits ; Student behavior modelling ; Students ; Supervised classification</subject><ispartof>Computers in human behavior, 2017-10, Vol.75, p.423-438</ispartof><rights>2017 Elsevier Ltd</rights><rights>Copyright Elsevier Science Ltd. Oct 2017</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c325t-372129f7be8477dc969f9c65f80122b36949e4e977e5cfd6721b58fbd8ad44b43</citedby><cites>FETCH-LOGICAL-c325t-372129f7be8477dc969f9c65f80122b36949e4e977e5cfd6721b58fbd8ad44b43</cites><orcidid>0000-0002-0982-3623</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27923,27924</link.rule.ids></links><search><creatorcontrib>Papamitsiou, Zacharoula</creatorcontrib><creatorcontrib>Economides, Anastasios A.</creatorcontrib><title>Exhibiting achievement behavior during computer-based testing: What temporal trace data and personality traits tell us?</title><title>Computers in human behavior</title><description>Personalizing computer-based testing services to examinees can be improved by considering their behavioral models. This study aims to contribute towards deeper understanding the examinee’s time-spent and achievement behavior during testing according to the five personality traits by exploiting assessment analytics. Further, it aims to investigate assessment analytics appropriateness for classifying students and generating enhanced student models to guide personalization of testing services. In this study, the LAERS assessment environment and the Big Five Inventory were used to track the response times of 112 undergraduate students and to extract their personality traits respectively. Partial Least Squares was used to detect fundamental relationships between the collected data, and Supervised Learning Algorithms were used to classify students. Results indicate a positive effect of extraversion and agreeableness on goal-expectancy, a positive effect of conscientiousness on both goal-expectancy and level of certainty, and a negative effect of neuroticism and openness on level of certainty. Further, extraversion, agreeableness and conscientiousness have statistically significant indirect impact on students’ response-times and level of achievement. Moreover, the ensemble RandomForest method provides accurate classification results, indicating that a time-spent driven description of students’ behavior could have added value towards dynamically reshaping the respective models. Further implications of these findings are also discussed. •We exploit assessment analytics for exploring time-spent and achievement behavior.•We associate examinees’ personality traits with time-spent and achievement behavior.•Examinees’ extraversion and agreeableness positively affect goal-expectancy.•Conscientiousness positively affects examinee goal-expectancy and level of certainty.•Examinees’ neuroticism and openness have a negative effect on level of certainty.</description><subject>Academic achievement</subject><subject>Assessment analytics</subject><subject>BFI</subject><subject>Classification</subject><subject>College students</subject><subject>Computer-based testing</subject><subject>Educational evaluation</subject><subject>Machine learning</subject><subject>Personality</subject><subject>Personality traits</subject><subject>Student behavior modelling</subject><subject>Students</subject><subject>Supervised classification</subject><issn>0747-5632</issn><issn>1873-7692</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2017</creationdate><recordtype>article</recordtype><recordid>eNp9kE1L5TAUhsPgwFw_foC7gOvWpG2SRhcioqMguFFchnycTnPpbWuS3tF_Pyl31q4Oh_M8h5cXoXNKSkoov9yWtjdlRagoCStJzX-gDW1FXQguqyO0IaIRBeN19Qsdx7glhDBG-Ab9vf_svfHJj3-wtr2HPexgTNhAr_d-CtgtYb3ZaTcvCUJhdASHE8RVucLvvU55281T0ANOQVvATieN9ejwDCFOox58-lpPPsWMDgNe4s0p-tnpIcLZ_3mC3h7uX-8ei-eX3093t8-FrSuWilpUtJKdMNA2Qjgrueyk5axrCa0qU3PZSGhACgHMdo5n3LC2M67VrmlMU5-gi8PfOUwfS06tttMScqaoqKylpC0VJFP0QNkwxRigU3PwOx2-FCVq7VdtVe5Xrf0qwlTuNzvXBwdy_L2HoKL1MFpwPoBNyk3-G_sf-hqEvQ</recordid><startdate>201710</startdate><enddate>201710</enddate><creator>Papamitsiou, Zacharoula</creator><creator>Economides, Anastasios A.</creator><general>Elsevier Ltd</general><general>Elsevier Science Ltd</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0002-0982-3623</orcidid></search><sort><creationdate>201710</creationdate><title>Exhibiting achievement behavior during computer-based testing: What temporal trace data and personality traits tell us?</title><author>Papamitsiou, Zacharoula ; Economides, Anastasios A.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c325t-372129f7be8477dc969f9c65f80122b36949e4e977e5cfd6721b58fbd8ad44b43</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2017</creationdate><topic>Academic achievement</topic><topic>Assessment analytics</topic><topic>BFI</topic><topic>Classification</topic><topic>College students</topic><topic>Computer-based testing</topic><topic>Educational evaluation</topic><topic>Machine learning</topic><topic>Personality</topic><topic>Personality traits</topic><topic>Student behavior modelling</topic><topic>Students</topic><topic>Supervised classification</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Papamitsiou, Zacharoula</creatorcontrib><creatorcontrib>Economides, Anastasios A.</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Computers in human behavior</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Papamitsiou, Zacharoula</au><au>Economides, Anastasios A.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Exhibiting achievement behavior during computer-based testing: What temporal trace data and personality traits tell us?</atitle><jtitle>Computers in human behavior</jtitle><date>2017-10</date><risdate>2017</risdate><volume>75</volume><spage>423</spage><epage>438</epage><pages>423-438</pages><issn>0747-5632</issn><eissn>1873-7692</eissn><abstract>Personalizing computer-based testing services to examinees can be improved by considering their behavioral models. This study aims to contribute towards deeper understanding the examinee’s time-spent and achievement behavior during testing according to the five personality traits by exploiting assessment analytics. Further, it aims to investigate assessment analytics appropriateness for classifying students and generating enhanced student models to guide personalization of testing services. In this study, the LAERS assessment environment and the Big Five Inventory were used to track the response times of 112 undergraduate students and to extract their personality traits respectively. Partial Least Squares was used to detect fundamental relationships between the collected data, and Supervised Learning Algorithms were used to classify students. Results indicate a positive effect of extraversion and agreeableness on goal-expectancy, a positive effect of conscientiousness on both goal-expectancy and level of certainty, and a negative effect of neuroticism and openness on level of certainty. Further, extraversion, agreeableness and conscientiousness have statistically significant indirect impact on students’ response-times and level of achievement. Moreover, the ensemble RandomForest method provides accurate classification results, indicating that a time-spent driven description of students’ behavior could have added value towards dynamically reshaping the respective models. Further implications of these findings are also discussed. •We exploit assessment analytics for exploring time-spent and achievement behavior.•We associate examinees’ personality traits with time-spent and achievement behavior.•Examinees’ extraversion and agreeableness positively affect goal-expectancy.•Conscientiousness positively affects examinee goal-expectancy and level of certainty.•Examinees’ neuroticism and openness have a negative effect on level of certainty.</abstract><cop>Elmsford</cop><pub>Elsevier Ltd</pub><doi>10.1016/j.chb.2017.05.036</doi><tpages>16</tpages><orcidid>https://orcid.org/0000-0002-0982-3623</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0747-5632
ispartof Computers in human behavior, 2017-10, Vol.75, p.423-438
issn 0747-5632
1873-7692
language eng
recordid cdi_proquest_journals_1939918170
source Elsevier
subjects Academic achievement
Assessment analytics
BFI
Classification
College students
Computer-based testing
Educational evaluation
Machine learning
Personality
Personality traits
Student behavior modelling
Students
Supervised classification
title Exhibiting achievement behavior during computer-based testing: What temporal trace data and personality traits tell us?
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-08T15%3A22%3A07IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Exhibiting%20achievement%20behavior%20during%20computer-based%20testing:%20What%20temporal%20trace%20data%20and%20personality%20traits%20tell%20us?&rft.jtitle=Computers%20in%20human%20behavior&rft.au=Papamitsiou,%20Zacharoula&rft.date=2017-10&rft.volume=75&rft.spage=423&rft.epage=438&rft.pages=423-438&rft.issn=0747-5632&rft.eissn=1873-7692&rft_id=info:doi/10.1016/j.chb.2017.05.036&rft_dat=%3Cproquest_cross%3E1939918170%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c325t-372129f7be8477dc969f9c65f80122b36949e4e977e5cfd6721b58fbd8ad44b43%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=1939918170&rft_id=info:pmid/&rfr_iscdi=true