Research Article Open Access

Robust Linear Discriminant Analysis

Sharipah Soaad Syed Yahaya1, Yai-Fung Lim1, Hazlina Ali1 and Zurni Omar1
  • 1 UUM College of Arts and Science 06010 Universiti Utara Malaysia, Malaysia

Abstract

Linear Discriminant Analysis (LDA) is the most commonly employed method for classification. This method which creates a linear discriminant function yields optimal classification rule between two or more groups under the assumptions of normality and homoscedasticity (equal covariance matrices). However, the calculation of parametric LDA highly relies on the sample mean vectors and pooled sample covariance matrix which are sensitive to non-normality. To overcome the sensitivity of this method towards non-normality as well as homoscedasticity, this study proposes two new robust LDA models. In these models, an automatic trimmed mean and its corresponding winsorized mean are employed to replace the mean vector in the parametric LDA. Meanwhile, for the covariance matrix, this study introduces two robust approaches namely the winsorization and the multiplication of Spearman's rho with the corresponding robust scale estimator used in the trimming process. Simulated and real financial data are used to test the performance of the proposed methods in terms of misclassification rate. The numerical result shows that the new method performs better if compared to the parametric LDA and the robust LDA with S-estimator. Thus, these new models can be recommended as alternatives to the parametric LDA when non-normality and heteroscedasticity (unequal covariance matrices) exist.

Journal of Mathematics and Statistics
Volume 12 No. 4, 2016, 312-316

DOI: https://doi.org/10.3844/jmssp.2016.312.316

Submitted On: 22 June 2016 Published On: 4 January 2017

How to Cite: Yahaya, S. S. S., Lim, Y., Ali, H. & Omar, Z. (2016). Robust Linear Discriminant Analysis. Journal of Mathematics and Statistics, 12(4), 312-316. https://doi.org/10.3844/jmssp.2016.312.316

  • 3,642 Views
  • 4,283 Downloads
  • 11 Citations

Download

Keywords

  • Discriminant Analysis
  • Classification
  • Normality
  • Homoscedasticity
  • Robust
  • Trimmed Mean
  • Winsorized