Effect Size and Power in Assessing Moderating Effects of Categorical Variables Using Multiple Regression: A 30-Year Review

The authors conducted a 30-year review (1969-1998) of the size of moderating effects of categorical variables as assessed using multiple regression. The median observed effect size ( f 2 ) is only.002, but 72% of the moderator tests reviewed had power of.80 or greater to detect a targeted effect con...

Full description

Saved in:
Bibliographic Details
Published in:Journal of applied psychology 2005-01, Vol.90 (1), p.94-107
Main Authors: Aguinis, Herman, Beaty, James C, Boik, Robert J, Pierce, Charles A
Format: Article
Language:English
Subjects:
Biological and medical sciences
Data analysis
Effect size
Effect Size (Statistical)
Effects
Fundamental and applied biological sciences. Psychology
Humans
Measurement
Multiple Regression
Psychology
Psychology - statistics & numerical data
Psychology. Psychoanalysis. Psychiatry
Psychology. Psychophysiology
Psychometrics. Statistics. Methodology
Regression Analysis
Reproducibility of Results
Research design
Research methods
Sample Size
Statistical Power
Statistical Variables
Statistics
Statistics. Mathematics
Studies
Variables
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The authors conducted a 30-year review (1969-1998) of the size of moderating effects of categorical variables as assessed using multiple regression. The median observed effect size ( f 2 ) is only.002, but 72% of the moderator tests reviewed had power of.80 or greater to detect a targeted effect conventionally defined as small. Results suggest the need to minimize the influence of artifacts that produce a downward bias in the observed effect size and put into question the use of conventional definitions of moderating effect sizes. As long as an effect has a meaningful impact, the authors advise researchers to conduct a power analysis and plan future research designs on the basis of smaller and more realistic targeted effect sizes.
ISSN:0021-9010
1939-1854
DOI:10.1037/0021-9010.90.1.94