Open Access. Powered by Scholars. Published by Universities.®
Numerical Analysis and Computation
Mathematics, Physics, and Computer Science Faculty Articles and Research
Articles 1 - 1 of 1
Full-Text Articles in Mathematics
On The Application Of Principal Component Analysis To Classification Problems, Jianwei Zheng, Cyril Rakovski
On The Application Of Principal Component Analysis To Classification Problems, Jianwei Zheng, Cyril Rakovski
Mathematics, Physics, and Computer Science Faculty Articles and Research
Principal Component Analysis (PCA) is a commonly used technique that uses the correlation structure of the original variables to reduce the dimensionality of the data. This reduction is achieved by considering only the first few principal components for a subsequent analysis. The usual inclusion criterion is defined by the proportion of the total variance of the principal components exceeding a predetermined threshold. We show that in certain classification problems, even extremely high inclusion threshold can negatively impact the classification accuracy. The omission of small variance principal components can severely diminish the performance of the models. We noticed this phenomenon in …