A Monte Carlo Simulation Study of the Reliability of Intraindividual Variability

Recent research has seen intraindividual variability become a useful technique to incorporate trial-to-trial variability into many types of psychological studies. Intraindividual variability, as measured by individual standard deviations (ISDs), has shown unique prediction to several types of positi...

Full description

Saved in:
Bibliographic Details
Published in:Psychology and aging 2012-09, Vol.27 (3), p.560-576
Main Authors: Estabrook, Ryne, Grimm, Kevin J., Bowles, Ryan P.
Format: Article
Language:English
Subjects:
Adherence
Biological and medical sciences
Computer Simulation
Deviation
Fundamental and applied biological sciences. Psychology
Human
Humans
Individual Differences
Individuality
Intraindividual Variability
Mean
Monte Carlo Method
Monte Carlo simulation
Psychological aspects
Psychological tests
Psychology. Psychoanalysis. Psychiatry
Psychology. Psychophysiology
Psychometrics. Statistics. Methodology
Reliability
Reproducibility of Results
Standard Deviation
Statistical Analysis
Statistical power
Statistical Reliability
Statistics
Statistics. Mathematics
Variability
Variability Measurement
Variables
Citations: Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Recent research has seen intraindividual variability become a useful technique to incorporate trial-to-trial variability into many types of psychological studies. Intraindividual variability, as measured by individual standard deviations (ISDs), has shown unique prediction to several types of positive and negative outcomes (Ram, Rabbit, Stollery, & Nesselroade, 2005). One unanswered question regarding measuring intraindividual variability is its reliability and the conditions under which optimal reliability is achieved. Monte Carlo simulation studies were conducted to determine the reliability of the ISD as compared with the intraindividual mean. The results indicate that ISDs generally have poor reliability and are sensitive to insufficient measurement occasions, poor test reliability, and unfavorable amounts and distributions of variability in the population. Secondary analysis of psychological data shows that use of individual standard deviations in unfavorable conditions leads to a marked reduction in statistical power, although careful adherence to underlying statistical assumptions allows their use as a basic research tool.
ISSN:0882-7974
1939-1498
DOI:10.1037/a0026669