Analyzing Meta-Analysis: Potential Problems, an Unsuccessful Replication, and Evaluation Criteria

This article identifies some potential problems in meta-analysis research and suggests 14 specific criteria for evaluating the quality of meta-analysis research. The analysis is based on a review and replication of a meta-analysis research study. Our replication of the Terpstra (1981) study on metho...

Full description

Saved in:
Bibliographic Details
Published in:Journal of applied psychology 1985-02, Vol.70 (1), p.108-115
Main Authors: Bullock, R. J, Svyantek, Daniel J
Format: Article
Language:English
Subjects:
Bias
Biological and medical sciences
Experimental Replication
Fundamental and applied biological sciences. Psychology
Human
Hypothesis testing
Meta Analysis
Methodology. Experimentation
Organization development
Psychology. Psychoanalysis. Psychiatry
Psychology. Psychophysiology
Psychometrics. Statistics. Methodology
Social research
Social sciences
Statistical analysis
Systematic review
Citations: Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This article identifies some potential problems in meta-analysis research and suggests 14 specific criteria for evaluating the quality of meta-analysis research. The analysis is based on a review and replication of a meta-analysis research study. Our replication of the Terpstra (1981) study on methodological rigor in OD research found no evidence of positive-findings bias in OD. Our review of that research study identified a series of methodological problems that are applicable to other meta-analysis studies. These general problems are discussed, and some solutions are offered.
ISSN:0021-9010
1939-1854
DOI:10.1037/0021-9010.70.1.108