A Bounded Influence, High Breakdown, Efficient Regression Estimator

• Published in: Journal of the American Statistical Association 1993-09, Vol.88 (423), p.872-880
• Main Authors: Coakley, Clint W., Hettmansperger, Thomas P.
• Format: Article
• Language: English
• Subjects: Breakdown point; Coefficients; Estimation methods; Estimators; General M estimator; Influence function; Linear models; Linear regression; Logical givens; Newton-Raphson; Objective functions; One-step estimator; Outliers; Point estimators; Preliminary estimates; Regression; Regression analysis; Standard error; Theory and Methods
• ISSN: 0162-1459; 1537-274X
• DOI: 10.1080/01621459.1993.10476352

We consider the multiple linear regression model y i = x′ i β + ε i , i = 1, 2, ..., n, with random carriers and focus on the estimation of β. This article's main contribution is to present an estimator that is affine, regression, and scale equivariant; has both a high breakdown point and a bounded influence function; and has an asymptotic efficiency greater than .95 versus least squares under Gaussian errors. We give conditions under which the estimator-a one-step general M estimator that uses Schweppe weights and is based on a high breakdown initial estimator-satisfies these properties. The major conditions necessary for the estimator are (a) it must be based on a √n-consistent initial estimator with a 50% breakdown point, and (b) it must be based on a psi function that is odd, bounded, and strictly increasing. The advantage of this estimator over previous approaches is that it does not downweight high leverage points without first considering how they fit the bulk of the data. Methods of computing diagnostics and constructing Wald-type tests about β are given. We illustrate the features of the estimator on a data set with two regressors, showing how a good leverage point is not downweighted, whereas a bad leverage point is downweighted.