Statistical Power and the Testing of Null Hypotheses: A Review of Contemporary Management Research and Recommendations for Future Studies

The purpose of this study is to determine how well contemporary management re-search fares on the issue of statistical power with regard to studies specifically predicting null relationships between phenomena of interest. This power assessment differs from traditional power studies because it focuse...

Full description

Saved in:
Bibliographic Details
Published in:Organizational research methods 2004-04, Vol.7 (2), p.151-167
Main Authors: Cashen, Luke H., Geiger, Scott W.
Format: Article
Language:English
Subjects:
Assessments
Error analysis
Hypotheses
Hypothesis testing
Management
Null hypothesis
Operations research
Organizational behavior
Power
Researchers
Samples
Statistical analysis
Statistical methods
Statistical power
Studies
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The purpose of this study is to determine how well contemporary management re-search fares on the issue of statistical power with regard to studies specifically predicting null relationships between phenomena of interest. This power assessment differs from traditional power studies because it focuses solely on studies that offered and tested null hypotheses. A sample of studies containing hypothesized null relationships was taken from five mainstream management journals over the 1990 to 1999 time period. Results of the power assessment suggest that management researchers’ abilities to affirm null hypotheses are low. On average, the power assessment revealed that for those studies that found nonsignificance of results and consequently affirmed their null hypotheses, the actual Type II error rate was nearly 15 times greater than what is advocated in the literature when failing to reject a false null hypothesis. Recommendations for researchers proposing and testing formal null hypotheses are also discussed.
ISSN:1094-4281
1552-7425
DOI:10.1177/1094428104263676