Best Practices in Data Collection and Preparation: Recommendations for Reviewers, Editors, and Authors

• Published in: Organizational research methods 2021-10, Vol.24 (4), p.678-693
• Main Authors: Aguinis, Herman, Hill, N. Sharon, Bailey, James R.
• Format: Article
• Language: English
• Subjects: Best practice; Data collection; Data management; Epistemology; Missing data; Outliers (statistics)
• ISSN: 1094-4281; 1552-7425
• DOI: 10.1177/1094428119836485

We offer best-practice recommendations for journal reviewers, editors, and authors regarding data collection and preparation. Our recommendations are applicable to research adopting different epistemological and ontological perspectives—including both quantitative and qualitative approaches—as well as research addressing micro (i.e., individuals, teams) and macro (i.e., organizations, industries) levels of analysis. Our recommendations regarding data collection address (a) type of research design, (b) control variables, (c) sampling procedures, and (d) missing data management. Our recommendations regarding data preparation address (e) outlier management, (f) use of corrections for statistical and methodological artifacts, and (g) data transformations. Our recommendations address best practices as well as transparency issues. The formal implementation of our recommendations in the manuscript review process will likely motivate authors to increase transparency because failure to disclose necessary information may lead to a manuscript rejection decision. Also, reviewers can use our recommendations for developmental purposes to highlight which particular issues should be improved in a revised version of a manuscript and in future research. Taken together, the implementation of our recommendations in the form of checklists can help address current challenges regarding results and inferential reproducibility as well as enhance the credibility, trustworthiness, and usefulness of the scholarly knowledge that is produced.