Relating Indices of Knowledge Structure Coherence and Accuracy to Skill-Based Performance: Is There Utility in Using a Combination of Indices?

• Published in: Journal of applied psychology 2009-07, Vol.94 (4), p.1076-1085
• Main Authors: Schuelke, Matthew J, Day, Eric Anthony, McEntire, Lauren E, Boatman, Paul R, Boatman, Jazmine Espejo, Kowollik, Vanessa, Wang, Xiaoqian
• Format: Article
• Language: English
• Subjects: Ability Level; Accuracy; Adolescent; Algorithms; Applied psychology; Aptitude; Attention; Biological and medical sciences; Closeness; Cognitive Ability; Cognitive Structures; Coherence; College Students; Computer Simulation; Computer Software; Computer training; Computers; Correlation; Decision Making; Declarative Knowledge; Employee Performance Appraisal; Fundamental and applied biological sciences. Psychology; Human; Humans; Intelligence; Introductory Courses; Knowledge Level; Knowledge management; Knowledge organization; Knowledge Representation; Learning; Learning. Memory; Male; Males; Mental Models; Motor Skills; Ohio; Oklahoma; Organizational learning; Pairing; Problem Solving; Professional Competence; Psychological effects; Psychology; Psychology. Psychoanalysis. Psychiatry; Psychology. Psychophysiology; Qualitative analysis; Quantitative analysis; Rhetoric; Simulation; Skill development; Skills; Skills acquisition; Staff Development; Students - psychology; Studies; Task Performance and Analysis; Training; Transfer (Learning); Transfer (Psychology); Universities; Validity; Video Games; Young Adult
• ISSN: 0021-9010; 1939-1854
• DOI: 10.1037/a0015113

The authors examined the relative criterion-related validity of knowledge structure coherence and two accuracy-based indices (closeness and correlation) as well as the utility of using a combination of knowledge structure indices in the prediction of skill acquisition and transfer. Findings from an aggregation of 5 independent samples ( N = 958) whose participants underwent training on a complex computer simulation indicated that coherence and the accuracy-based indices yielded comparable zero-order predictive validities. Support for the incremental validity of using a combination of indices was mixed; the most, albeit small, gain came in pairing coherence and closeness when predicting transfer. After controlling for baseline skill, general mental ability, and declarative knowledge, only coherence explained a statistically significant amount of unique variance in transfer. Overall, the results suggested that the different indices largely overlap in their representation of knowledge organization, but that coherence better reflects adaptable aspects of knowledge organization important to skill transfer.