Moving beyond the study of gender differences: An analysis of measurement invariance and differential item functioning of an ICT literacy scale

Crafting a validity argument is crucial for the development of any assessment of ICT literacy. In about the context of studying gender differences in ICT literacy, it has therefore become essential to ensure that gender differences are not due to the existence of measurement bias, which might indica...

Full description

Saved in:
Bibliographic Details
Published in:Computers and education 2017-10, Vol.113, p.280-293
Main Authors: Hatlevik, Ove E., Scherer, Ronny, Christophersen, Knut-Andreas
Format: Article
Language:English
Subjects:
Differential item functioning
Gender
ICT literacy
Lower secondary students
Measurement invariance
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c380t-6f712d0a4edef2ef2485bdb401f470a1aaf3314ed9138423946254b1b252cf503
cites cdi_FETCH-LOGICAL-c380t-6f712d0a4edef2ef2485bdb401f470a1aaf3314ed9138423946254b1b252cf503
container_end_page 293
container_issue
container_start_page 280
container_title Computers and education
container_volume 113
creator Hatlevik, Ove E.
Scherer, Ronny
Christophersen, Knut-Andreas
description Crafting a validity argument is crucial for the development of any assessment of ICT literacy. In about the context of studying gender differences in ICT literacy, it has therefore become essential to ensure that gender differences are not due to the existence of measurement bias, which might indicate that an assessment instrument used to measure ICT literacy operates differently for girls and boys. Hence, researchers need to gather evidence on the validity of such gender comparisons. The present study follows this line of research by investigating the overall measurement invariance at the construct level and the differential functioning of items across gender of an ICT literacy test. Based on the data obtained from a random sample of 919 Norwegian lower secondary school students (468 girls), multi-group confirmatory factor analysis showed that the test was invariant to a sufficient degree, and girls outperformed boys in the overall test score (β = 0.35, p 
doi_str_mv 10.1016/j.compedu.2017.06.003
format article
fullrecord <record><control><sourceid>elsevier_crist</sourceid><recordid>TN_cdi_cristin_nora_10852_59789</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0360131517301392</els_id><sourcerecordid>S0360131517301392</sourcerecordid><originalsourceid>FETCH-LOGICAL-c380t-6f712d0a4edef2ef2485bdb401f470a1aaf3314ed9138423946254b1b252cf503</originalsourceid><addsrcrecordid>eNqFkNtq3DAQhkVpodskj1CqF7A7Otne3pSw9BBI6U0KuROyNEq12HKQtAt-ir5yZJL2tjAwF_P9M8NHyHsGLQPWfTy2dpkf0Z1aDqxvoWsBxCuyY0Mvmn7g96_JDkQHDRNMvSXvcj4CgOyk2pE_P5ZziA90xHWJjpbfSHM5uZUunj5gdJioC95jwmgxf6LXkZpopjWHvCEzmnxKOGMsNMSzScFUriLuX6wEM9FQcKb-FG0JS9zu1ayJ9OZwR6c6S8auNFsz4SV5482U8eqlX5BfX7_cHb43tz-_3RyubxsrBihN53vGHRiJDj2vJQc1ulEC87IHw4zxQrA63TMxSC72suNKjmzkiluvQFyQD897bQq5hKjjkoxmMCiu1b4f9pVQf4kl54ReP6Ywm7RWSm_e9VG_eNebdw2drt5r7vNzDuv754BJZxs2ey4ktEW7JfxnwxMOsZAd</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Moving beyond the study of gender differences: An analysis of measurement invariance and differential item functioning of an ICT literacy scale</title><source>NORA - Norwegian Open Research Archives</source><source>Elsevier</source><creator>Hatlevik, Ove E. ; Scherer, Ronny ; Christophersen, Knut-Andreas</creator><creatorcontrib>Hatlevik, Ove E. ; Scherer, Ronny ; Christophersen, Knut-Andreas</creatorcontrib><description>Crafting a validity argument is crucial for the development of any assessment of ICT literacy. In about the context of studying gender differences in ICT literacy, it has therefore become essential to ensure that gender differences are not due to the existence of measurement bias, which might indicate that an assessment instrument used to measure ICT literacy operates differently for girls and boys. Hence, researchers need to gather evidence on the validity of such gender comparisons. The present study follows this line of research by investigating the overall measurement invariance at the construct level and the differential functioning of items across gender of an ICT literacy test. Based on the data obtained from a random sample of 919 Norwegian lower secondary school students (468 girls), multi-group confirmatory factor analysis showed that the test was invariant to a sufficient degree, and girls outperformed boys in the overall test score (β = 0.35, p &lt; 0.001). Yet, differential item functioning existed for selected items. These results highlight the importance of testing for measurement invariance and differential item functioning that goes beyond the mere description of gender differences. Moreover, attention is brought back to the validity of ICT literacy assessments, and ways to improve these assessments are discussed. •Measuring ICT literacy and identifying potential gender differences.•Ensuring that assessment instrument of ICT literacy is not biased.•Investigating overall measurement invariance of the test.•Investigating the differential functioning of items.•Girls outperformed boys in the overall ICT literacy test score.</description><identifier>ISSN: 0360-1315</identifier><identifier>EISSN: 1873-782X</identifier><identifier>DOI: 10.1016/j.compedu.2017.06.003</identifier><language>eng</language><publisher>Elsevier Ltd</publisher><subject>Differential item functioning ; Gender ; ICT literacy ; Lower secondary students ; Measurement invariance</subject><ispartof>Computers and education, 2017-10, Vol.113, p.280-293</ispartof><rights>2017 Elsevier Ltd</rights><rights>info:eu-repo/semantics/openAccess</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c380t-6f712d0a4edef2ef2485bdb401f470a1aaf3314ed9138423946254b1b252cf503</citedby><cites>FETCH-LOGICAL-c380t-6f712d0a4edef2ef2485bdb401f470a1aaf3314ed9138423946254b1b252cf503</cites><orcidid>0000-0002-2073-1738</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>230,314,780,784,885,26566,27923,27924</link.rule.ids></links><search><creatorcontrib>Hatlevik, Ove E.</creatorcontrib><creatorcontrib>Scherer, Ronny</creatorcontrib><creatorcontrib>Christophersen, Knut-Andreas</creatorcontrib><title>Moving beyond the study of gender differences: An analysis of measurement invariance and differential item functioning of an ICT literacy scale</title><title>Computers and education</title><description>Crafting a validity argument is crucial for the development of any assessment of ICT literacy. In about the context of studying gender differences in ICT literacy, it has therefore become essential to ensure that gender differences are not due to the existence of measurement bias, which might indicate that an assessment instrument used to measure ICT literacy operates differently for girls and boys. Hence, researchers need to gather evidence on the validity of such gender comparisons. The present study follows this line of research by investigating the overall measurement invariance at the construct level and the differential functioning of items across gender of an ICT literacy test. Based on the data obtained from a random sample of 919 Norwegian lower secondary school students (468 girls), multi-group confirmatory factor analysis showed that the test was invariant to a sufficient degree, and girls outperformed boys in the overall test score (β = 0.35, p &lt; 0.001). Yet, differential item functioning existed for selected items. These results highlight the importance of testing for measurement invariance and differential item functioning that goes beyond the mere description of gender differences. Moreover, attention is brought back to the validity of ICT literacy assessments, and ways to improve these assessments are discussed. •Measuring ICT literacy and identifying potential gender differences.•Ensuring that assessment instrument of ICT literacy is not biased.•Investigating overall measurement invariance of the test.•Investigating the differential functioning of items.•Girls outperformed boys in the overall ICT literacy test score.</description><subject>Differential item functioning</subject><subject>Gender</subject><subject>ICT literacy</subject><subject>Lower secondary students</subject><subject>Measurement invariance</subject><issn>0360-1315</issn><issn>1873-782X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2017</creationdate><recordtype>article</recordtype><sourceid>3HK</sourceid><recordid>eNqFkNtq3DAQhkVpodskj1CqF7A7Otne3pSw9BBI6U0KuROyNEq12HKQtAt-ir5yZJL2tjAwF_P9M8NHyHsGLQPWfTy2dpkf0Z1aDqxvoWsBxCuyY0Mvmn7g96_JDkQHDRNMvSXvcj4CgOyk2pE_P5ZziA90xHWJjpbfSHM5uZUunj5gdJioC95jwmgxf6LXkZpopjWHvCEzmnxKOGMsNMSzScFUriLuX6wEM9FQcKb-FG0JS9zu1ayJ9OZwR6c6S8auNFsz4SV5482U8eqlX5BfX7_cHb43tz-_3RyubxsrBihN53vGHRiJDj2vJQc1ulEC87IHw4zxQrA63TMxSC72suNKjmzkiluvQFyQD897bQq5hKjjkoxmMCiu1b4f9pVQf4kl54ReP6Ywm7RWSm_e9VG_eNebdw2drt5r7vNzDuv754BJZxs2ey4ktEW7JfxnwxMOsZAd</recordid><startdate>20171001</startdate><enddate>20171001</enddate><creator>Hatlevik, Ove E.</creator><creator>Scherer, Ronny</creator><creator>Christophersen, Knut-Andreas</creator><general>Elsevier Ltd</general><scope>AAYXX</scope><scope>CITATION</scope><scope>3HK</scope><orcidid>https://orcid.org/0000-0002-2073-1738</orcidid></search><sort><creationdate>20171001</creationdate><title>Moving beyond the study of gender differences: An analysis of measurement invariance and differential item functioning of an ICT literacy scale</title><author>Hatlevik, Ove E. ; Scherer, Ronny ; Christophersen, Knut-Andreas</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c380t-6f712d0a4edef2ef2485bdb401f470a1aaf3314ed9138423946254b1b252cf503</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2017</creationdate><topic>Differential item functioning</topic><topic>Gender</topic><topic>ICT literacy</topic><topic>Lower secondary students</topic><topic>Measurement invariance</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Hatlevik, Ove E.</creatorcontrib><creatorcontrib>Scherer, Ronny</creatorcontrib><creatorcontrib>Christophersen, Knut-Andreas</creatorcontrib><collection>CrossRef</collection><collection>NORA - Norwegian Open Research Archives</collection><jtitle>Computers and education</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Hatlevik, Ove E.</au><au>Scherer, Ronny</au><au>Christophersen, Knut-Andreas</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Moving beyond the study of gender differences: An analysis of measurement invariance and differential item functioning of an ICT literacy scale</atitle><jtitle>Computers and education</jtitle><date>2017-10-01</date><risdate>2017</risdate><volume>113</volume><spage>280</spage><epage>293</epage><pages>280-293</pages><issn>0360-1315</issn><eissn>1873-782X</eissn><abstract>Crafting a validity argument is crucial for the development of any assessment of ICT literacy. In about the context of studying gender differences in ICT literacy, it has therefore become essential to ensure that gender differences are not due to the existence of measurement bias, which might indicate that an assessment instrument used to measure ICT literacy operates differently for girls and boys. Hence, researchers need to gather evidence on the validity of such gender comparisons. The present study follows this line of research by investigating the overall measurement invariance at the construct level and the differential functioning of items across gender of an ICT literacy test. Based on the data obtained from a random sample of 919 Norwegian lower secondary school students (468 girls), multi-group confirmatory factor analysis showed that the test was invariant to a sufficient degree, and girls outperformed boys in the overall test score (β = 0.35, p &lt; 0.001). Yet, differential item functioning existed for selected items. These results highlight the importance of testing for measurement invariance and differential item functioning that goes beyond the mere description of gender differences. Moreover, attention is brought back to the validity of ICT literacy assessments, and ways to improve these assessments are discussed. •Measuring ICT literacy and identifying potential gender differences.•Ensuring that assessment instrument of ICT literacy is not biased.•Investigating overall measurement invariance of the test.•Investigating the differential functioning of items.•Girls outperformed boys in the overall ICT literacy test score.</abstract><pub>Elsevier Ltd</pub><doi>10.1016/j.compedu.2017.06.003</doi><tpages>14</tpages><orcidid>https://orcid.org/0000-0002-2073-1738</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0360-1315
ispartof Computers and education, 2017-10, Vol.113, p.280-293
issn 0360-1315
1873-782X
language eng
recordid cdi_cristin_nora_10852_59789
source NORA - Norwegian Open Research Archives; Elsevier
subjects Differential item functioning
Gender
ICT literacy
Lower secondary students
Measurement invariance
title Moving beyond the study of gender differences: An analysis of measurement invariance and differential item functioning of an ICT literacy scale
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-08T17%3A32%3A30IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-elsevier_crist&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Moving%20beyond%20the%20study%20of%20gender%20differences:%20An%20analysis%20of%20measurement%20invariance%20and%20differential%20item%20functioning%20of%20an%20ICT%20literacy%20scale&rft.jtitle=Computers%20and%20education&rft.au=Hatlevik,%20Ove%20E.&rft.date=2017-10-01&rft.volume=113&rft.spage=280&rft.epage=293&rft.pages=280-293&rft.issn=0360-1315&rft.eissn=1873-782X&rft_id=info:doi/10.1016/j.compedu.2017.06.003&rft_dat=%3Celsevier_crist%3ES0360131517301392%3C/elsevier_crist%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c380t-6f712d0a4edef2ef2485bdb401f470a1aaf3314ed9138423946254b1b252cf503%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true