Journal of Mathematics and Statistics

MODEL SELECTION VIA ROBUST VERSION OF R-SQUARED

Shokrya Saleh

DOI : 10.3844/jmssp.2014.414.420

Journal of Mathematics and Statistics

Volume 10, Issue 3

Pages 414-420

Abstract

R-squared (R2) is a popular method for variable selection in linear regression models. R2 based on Least Squares (LS) regression minimizes the sum of the squared residuals; LS is sensitive to outlier observation. Alternative criterion based on M-estimators, which is less sensitive to outlying observation has been proposed. In this study explicit expression for such criterion is obtained when the Least Trimmed Squares (LTS) estimator is used. The influence function of R2 is also discussed. In our simulation study, the performance of proposed criterion is compared to the existing criteria based on M-estimators (R2M) and to the classical non-robust based on least squares estimators (R2LS). We observe that the proposed (R2LTS) selects more appropriate models in the case of bad leverage points (outliers in the X-direction) are present.

Copyright

© 2014 Shokrya Saleh. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.