Other Computer Engineering Commons^™

Brief Study Of Classification Algorithms In Machine Learning, Ramesh Sankara Subbu

Dissertations and Theses

The purpose of this study is to briefly learn the theory and implementation of three most commonly used Machine Learning algorithms: k-Nearest Neighbors (kNN), Decision Trees and Naïve Bayes. All these algorithms fall under the Classification algorithm category of Unsupervised Machine Learning. This paper is constructed structurally in explaining the working theory behind each algorithm and an implementation of a Machine Learning problem solved by each algorithm. KNN algorithm is designed using Euclidean distance measurement and Decision Trees make use of ID3 algorithm as a basis. We conclude the study by providing an overall picture of its strengths and weaknesses …