Cautionary Remarks on the Use of Clusterwise Regression

Clusterwise linear regression is a multivariate statistical procedure that attempts to cluster objects with the objective of minimizing the sum of the error sums of squares for the within-cluster regression models. In this article, we show that the minimization of this criterion makes no effort to d...

Full description

Saved in:
Bibliographic Details
Published in:Multivariate behavioral research 2008-01, Vol.43 (1), p.29-49
Main Authors: Brusco, Michael J., Cradit, J. Dennis, Steinley, Douglas, Fox, Gavin L.
Format: Article
Language:English
Subjects:
Benchmarking
Benchmarks
Cluster analysis
Cluster Grouping
Educational evaluation
Errors
Multivariate Analysis
Regression (Statistics)
Regression analysis
Research Methodology
Simulation
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Clusterwise linear regression is a multivariate statistical procedure that attempts to cluster objects with the objective of minimizing the sum of the error sums of squares for the within-cluster regression models. In this article, we show that the minimization of this criterion makes no effort to distinguish the error explained by the within-cluster regression models from the error explained by the clustering process. In some cases, most of the variation in the response variable is explained by clustering the objects, with little additional benefit provided by the within-cluster regression models. Accordingly, there is tremendous potential for overfitting with clusterwise regression, which is demonstrated with numerical examples and simulation experiments. To guard against the misuse of clusterwise regression, we recommend a benchmarking procedure that compares the results for the observed empirical data with those obtained across a set of random permutations of the response measures. We also demonstrate the potential for overfitting via an empirical application related to the prediction of reflective judgment using high school and college performance measures.
ISSN:0027-3171
1532-7906
DOI:10.1080/00273170701836653