The Early Roots of Statistical Learning in the Psychometric Literature: A review and two new results

Machine and Statistical learning techniques become more and more important for the analysis of psychological data. Four core concepts of machine learning are the bias variance trade-off, cross-validation, regularization, and basis expansion. We present some early psychometric papers, from almost a c...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2019-11
Main Authors: de Rooij, Mark, Pratiwi, Bunga Citra, Fokkema, Marjolein, Dusseldorp, Elise, Kelderman, Henk
Format: Article
Language:English
Subjects:
Empirical analysis
Literature reviews
Machine learning
Predictions
Psychometrics
Quantitative psychology
Regression analysis
Regression coefficients
Regularization
Reliability
Statistical analysis
Textbooks
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Machine and Statistical learning techniques become more and more important for the analysis of psychological data. Four core concepts of machine learning are the bias variance trade-off, cross-validation, regularization, and basis expansion. We present some early psychometric papers, from almost a century ago, that dealt with cross-validation and regularization. From this review it is safe to conclude that the origins of these lie partly in the field of psychometrics. From our historical review, two new ideas arose which we investigated further: The first is about the relationship between reliability and predictive validity; the second is whether optimal regression weights should be estimated by regularizing their values towards equality or shrinking their values towards zero. In a simulation study we show that the reliability of a test score does not influence the predictive validity as much as is usually written in psychometric textbooks. Using an empirical example we show that regularization towards equal regression coefficients is beneficial in terms of prediction error.
ISSN:2331-8422