Predictor content matters for knowledge testing: Evidence supporting content validation

Organizations often rely on the match between job requirements and test content to justify test use. This practice has been questioned on the grounds that content validation has little relevance to criterion-related validation due to positive manifold among predictors. We analyze two large databases...

Full description

Saved in:
Bibliographic Details
Published in:Human performance 2016-01, Vol.29 (1), p.54-71
Main Authors: Sackett, Paul R., Walmsley, Philip T., Koch, Amanda J., Beatty, Adam S., Kuncel, Nathan R.
Format: Article
Language:English
Subjects:
Human resource management
Job requirements
Organizational behavior
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c369t-2fc4b58d9351f964ef01c3550ed50446b594307984c7192297e9a868893619d43
cites cdi_FETCH-LOGICAL-c369t-2fc4b58d9351f964ef01c3550ed50446b594307984c7192297e9a868893619d43
container_end_page 71
container_issue 1
container_start_page 54
container_title Human performance
container_volume 29
creator Sackett, Paul R.
Walmsley, Philip T.
Koch, Amanda J.
Beatty, Adam S.
Kuncel, Nathan R.
description Organizations often rely on the match between job requirements and test content to justify test use. This practice has been questioned on the grounds that content validation has little relevance to criterion-related validation due to positive manifold among predictors. We analyze two large databases to assess the implications of test content for (a) test interchangeability and (b) criterion-related validity. Analyses of 15 knowledge tests administered (N = 80,394) as part of Project Talent demonstrate that test content is related to predictor interchangeability. Analyses of SAT and Advanced Placement test data compare correlations among predictors and criteria drawn from matched and unmatched content domains. We conclude that test-criterion content match is likely to result in stronger criterion-related validity.
doi_str_mv 10.1080/08959285.2015.1120307
format article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1080_08959285_2015_1120307</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>3953933921</sourcerecordid><originalsourceid>FETCH-LOGICAL-c369t-2fc4b58d9351f964ef01c3550ed50446b594307984c7192297e9a868893619d43</originalsourceid><addsrcrecordid>eNp9kEtLAzEUhYMoWKs_QRhwPTWPySRxpZT6gIIuFJchTTIldZqMSdrSf-8MrS5dXTicc-69HwDXCE4Q5PAWckEF5nSCIaIThDAkkJ2AEaIElwxW5BSMBk85mM7BRUorCCGjuB6Bz7dojdM5xEIHn63PxVrlbGMqml778mHXWrO0RbYpO7-8K2ZbZ6zXtkibrgtxEP-iW9U6o7IL_hKcNapN9uo4x-DjcfY-fS7nr08v04d5qUktcokbXS0oN4JQ1Ii6sg1EmlAKraGwquoFFVX_jOCVZkhgLJgVitecC1IjYSoyBjeH3i6G701_o1yFTfT9SolYTQmDArPeRQ8uHUNK0Tayi26t4l4iKAeG8pehHBjKI8M-d3_IOd_TWKtdiK2RWe3bEJuovHZJkv8rfgApp3gI</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1765370927</pqid></control><display><type>article</type><title>Predictor content matters for knowledge testing: Evidence supporting content validation</title><source>Business Source Ultimate【Trial: -2024/12/31】【Remote access available】</source><source>Taylor &amp; Francis</source><source>SPORTDiscus with Full Text</source><creator>Sackett, Paul R. ; Walmsley, Philip T. ; Koch, Amanda J. ; Beatty, Adam S. ; Kuncel, Nathan R.</creator><creatorcontrib>Sackett, Paul R. ; Walmsley, Philip T. ; Koch, Amanda J. ; Beatty, Adam S. ; Kuncel, Nathan R.</creatorcontrib><description>Organizations often rely on the match between job requirements and test content to justify test use. This practice has been questioned on the grounds that content validation has little relevance to criterion-related validation due to positive manifold among predictors. We analyze two large databases to assess the implications of test content for (a) test interchangeability and (b) criterion-related validity. Analyses of 15 knowledge tests administered (N = 80,394) as part of Project Talent demonstrate that test content is related to predictor interchangeability. Analyses of SAT and Advanced Placement test data compare correlations among predictors and criteria drawn from matched and unmatched content domains. We conclude that test-criterion content match is likely to result in stronger criterion-related validity.</description><identifier>ISSN: 0895-9285</identifier><identifier>EISSN: 1532-7043</identifier><identifier>DOI: 10.1080/08959285.2015.1120307</identifier><language>eng</language><publisher>Philadelphia: Routledge</publisher><subject>Human resource management ; Job requirements ; Organizational behavior</subject><ispartof>Human performance, 2016-01, Vol.29 (1), p.54-71</ispartof><rights>2016 Taylor &amp; Francis 2016</rights><rights>2016 Taylor &amp; Francis</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c369t-2fc4b58d9351f964ef01c3550ed50446b594307984c7192297e9a868893619d43</citedby><cites>FETCH-LOGICAL-c369t-2fc4b58d9351f964ef01c3550ed50446b594307984c7192297e9a868893619d43</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925</link.rule.ids></links><search><creatorcontrib>Sackett, Paul R.</creatorcontrib><creatorcontrib>Walmsley, Philip T.</creatorcontrib><creatorcontrib>Koch, Amanda J.</creatorcontrib><creatorcontrib>Beatty, Adam S.</creatorcontrib><creatorcontrib>Kuncel, Nathan R.</creatorcontrib><title>Predictor content matters for knowledge testing: Evidence supporting content validation</title><title>Human performance</title><description>Organizations often rely on the match between job requirements and test content to justify test use. This practice has been questioned on the grounds that content validation has little relevance to criterion-related validation due to positive manifold among predictors. We analyze two large databases to assess the implications of test content for (a) test interchangeability and (b) criterion-related validity. Analyses of 15 knowledge tests administered (N = 80,394) as part of Project Talent demonstrate that test content is related to predictor interchangeability. Analyses of SAT and Advanced Placement test data compare correlations among predictors and criteria drawn from matched and unmatched content domains. We conclude that test-criterion content match is likely to result in stronger criterion-related validity.</description><subject>Human resource management</subject><subject>Job requirements</subject><subject>Organizational behavior</subject><issn>0895-9285</issn><issn>1532-7043</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2016</creationdate><recordtype>article</recordtype><recordid>eNp9kEtLAzEUhYMoWKs_QRhwPTWPySRxpZT6gIIuFJchTTIldZqMSdrSf-8MrS5dXTicc-69HwDXCE4Q5PAWckEF5nSCIaIThDAkkJ2AEaIElwxW5BSMBk85mM7BRUorCCGjuB6Bz7dojdM5xEIHn63PxVrlbGMqml778mHXWrO0RbYpO7-8K2ZbZ6zXtkibrgtxEP-iW9U6o7IL_hKcNapN9uo4x-DjcfY-fS7nr08v04d5qUktcokbXS0oN4JQ1Ii6sg1EmlAKraGwquoFFVX_jOCVZkhgLJgVitecC1IjYSoyBjeH3i6G701_o1yFTfT9SolYTQmDArPeRQ8uHUNK0Tayi26t4l4iKAeG8pehHBjKI8M-d3_IOd_TWKtdiK2RWe3bEJuovHZJkv8rfgApp3gI</recordid><startdate>20160101</startdate><enddate>20160101</enddate><creator>Sackett, Paul R.</creator><creator>Walmsley, Philip T.</creator><creator>Koch, Amanda J.</creator><creator>Beatty, Adam S.</creator><creator>Kuncel, Nathan R.</creator><general>Routledge</general><general>Routledge, Taylor &amp; Francis Group</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7TS</scope></search><sort><creationdate>20160101</creationdate><title>Predictor content matters for knowledge testing: Evidence supporting content validation</title><author>Sackett, Paul R. ; Walmsley, Philip T. ; Koch, Amanda J. ; Beatty, Adam S. ; Kuncel, Nathan R.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c369t-2fc4b58d9351f964ef01c3550ed50446b594307984c7192297e9a868893619d43</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2016</creationdate><topic>Human resource management</topic><topic>Job requirements</topic><topic>Organizational behavior</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Sackett, Paul R.</creatorcontrib><creatorcontrib>Walmsley, Philip T.</creatorcontrib><creatorcontrib>Koch, Amanda J.</creatorcontrib><creatorcontrib>Beatty, Adam S.</creatorcontrib><creatorcontrib>Kuncel, Nathan R.</creatorcontrib><collection>CrossRef</collection><collection>Physical Education Index</collection><jtitle>Human performance</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Sackett, Paul R.</au><au>Walmsley, Philip T.</au><au>Koch, Amanda J.</au><au>Beatty, Adam S.</au><au>Kuncel, Nathan R.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Predictor content matters for knowledge testing: Evidence supporting content validation</atitle><jtitle>Human performance</jtitle><date>2016-01-01</date><risdate>2016</risdate><volume>29</volume><issue>1</issue><spage>54</spage><epage>71</epage><pages>54-71</pages><issn>0895-9285</issn><eissn>1532-7043</eissn><abstract>Organizations often rely on the match between job requirements and test content to justify test use. This practice has been questioned on the grounds that content validation has little relevance to criterion-related validation due to positive manifold among predictors. We analyze two large databases to assess the implications of test content for (a) test interchangeability and (b) criterion-related validity. Analyses of 15 knowledge tests administered (N = 80,394) as part of Project Talent demonstrate that test content is related to predictor interchangeability. Analyses of SAT and Advanced Placement test data compare correlations among predictors and criteria drawn from matched and unmatched content domains. We conclude that test-criterion content match is likely to result in stronger criterion-related validity.</abstract><cop>Philadelphia</cop><pub>Routledge</pub><doi>10.1080/08959285.2015.1120307</doi><tpages>18</tpages></addata></record>
fulltext fulltext
identifier ISSN: 0895-9285
ispartof Human performance, 2016-01, Vol.29 (1), p.54-71
issn 0895-9285
1532-7043
language eng
recordid cdi_crossref_primary_10_1080_08959285_2015_1120307
source Business Source Ultimate【Trial: -2024/12/31】【Remote access available】; Taylor & Francis; SPORTDiscus with Full Text
subjects Human resource management
Job requirements
Organizational behavior
title Predictor content matters for knowledge testing: Evidence supporting content validation
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-27T12%3A02%3A24IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Predictor%20content%20matters%20for%20knowledge%20testing:%20Evidence%20supporting%20content%20validation&rft.jtitle=Human%20performance&rft.au=Sackett,%20Paul%20R.&rft.date=2016-01-01&rft.volume=29&rft.issue=1&rft.spage=54&rft.epage=71&rft.pages=54-71&rft.issn=0895-9285&rft.eissn=1532-7043&rft_id=info:doi/10.1080/08959285.2015.1120307&rft_dat=%3Cproquest_cross%3E3953933921%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c369t-2fc4b58d9351f964ef01c3550ed50446b594307984c7192297e9a868893619d43%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=1765370927&rft_id=info:pmid/&rfr_iscdi=true