Open Access. Powered by Scholars. Published by Universities.®

Operations Research, Systems Engineering and Industrial Engineering Commons

Open Access. Powered by Scholars. Published by Universities.®

2016

Purdue University

Open Access Dissertations

Text preprocessing

Articles 1 - 1 of 1

Full-Text Articles in Operations Research, Systems Engineering and Industrial Engineering

Examination And Utilization Of Rare Features In Text Classification Of Injury Narratives, Hsin-Ying Huang Dec 2016

Examination And Utilization Of Rare Features In Text Classification Of Injury Narratives, Hsin-Ying Huang

Open Access Dissertations

Thanks to the advances in computing and information technology, analyzing injury surveillance data with statistical machine learning methods has grown in popularity, complexity, and quality over recent years. During that same time, researchers have recognized the limitations of statistical text analysis with limited training data. In response to the two primary challenges for statistical text analysis, dimensionality reduction and sparse data, many studies have focused on improving machine learning algorithms. Less research has been done, though, to examine and improve statistical machine learning methods in text classification from a linguistic perspective.

This study addresses this research gap by examining the …