Detecting Careless Respondents in Multidimensional Forced Choice Data: An Application of lz Person-Fit Statistic to the TIRT Model

There has been growing interest in the use of multidimensional forced-choice (MFC) measures in industrial and organizational psychology. However, despite the growing popularity, there has been a lack of research on how to address the problem of careless responses and improve the quality of MFC data....

Full description

Saved in:
Bibliographic Details
Published in:Journal of business and psychology 2024-06, Vol.39 (3), p.541-564
Main Authors: Lee, Philseok, Joo, Sean, Son, Mina
Format: Article
Language:English
Subjects:
Behavioral Science and Psychology
Business and Management
Community and Environmental Psychology
Data integrity
Industrial and Organizational Psychology
Item response theory
Occupational psychology
Organizational behavior
Original Paper
Personality and Social Psychology
Psychology
Social Sciences
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:There has been growing interest in the use of multidimensional forced-choice (MFC) measures in industrial and organizational psychology. However, despite the growing popularity, there has been a lack of research on how to address the problem of careless responses and improve the quality of MFC data. This study aims to address this gap by discussing the issue of careless responses in MFC data, proposing a method for detecting careless respondents using the l z person-fit statistic in conjunction with the Thurstonian item response theory (TIRT; Brown & Maydeu-Olivares, 2011) model, and examining the performance of this method on pair and triplet MFC measures and its impact on psychometric properties. To this end, we conducted empirical and simulation studies under various experimental conditions. We also provided an R tutorial for applying the l z person-fit statistic to both pair and triplet MFC measures using the TIRT model. The results showed that our proposed method can effectively detect careless respondents without a significant risk of misclassification. The implications of the findings and practical guidelines were discussed.
ISSN:0889-3268
1573-353X
DOI:10.1007/s10869-023-09911-w