Data Science Commons^™

Optimizing Ai With Advanced Data Structuring: A Comparative Analysis Of K-Means And Gmm Clustering Techniques, Amir Alipour Yengejeh

Data Science and Data Mining

This study presents a detailed comparison of Kmeans and Gaussian Mixture Model (GMM) clustering algorithms, illustrating their unique capabilities and limitations across various synthetic datasets. By utilizing metrics such as the Adjusted Rand Index (ARI) and Normalized Mutual Information (NMI), the research provides nuanced insights into how these algorithms handle datasets with varying structures and complexities. For instance, while both K-means and GMM show robust performance on well-separated clusters, GMM demonstrates a distinct advantage in scenarios with overlapping clusters or unbalanced data distributions. Conversely, K-means excels in identifying clear, distinct groupings, highlighting its utility in simpler clustering contexts. This study …

Predicting Road Accident Injury Severity For Drivers In Automobile Crashes In United States Using Machine Learning Models And Ai, Emil Agbemade, Benedict Kongyir

Data Science and Data Mining

This study analyzes data from the National Highway Trafc Safety Administration’s 2021 Crash Report Sampling System to identify key factors contributing to the severity of injuries in car accidents. By utilizing various machine learning algorithms and cross-validation techniques, we assessed metrics such as accuracy, sensitivity, precision, specifcity, and the area under the curve (AUC) to evaluate the efectiveness of predictive models. All data preprocessing and model building was done using KNIME Analytical software [9]. Our fndings reveal signifcant correlations between certain variables such as airbag injection, weather conditions, intoxication, vehicle state, driver distractions, and injury severity. These insights underscore the …

Predicting Telecommunication Customer Attrition Using The Hopfeld Neural Network Model., Benedict Kongyir, Emil Agbemade, Kelvin Njuki

Data Science and Data Mining

Customer churn prediction has become one of the crucial steps for customer retention. Telecommunication companies rely on loyal customers to make their proft. It is often very easy for customers to switch from one service provider to the other. To prevent or reduce the rate of customer attrition, there needs to be a model that can identify customers who are at risk of churning in the future in advance. Previous literature has shown that predictive models are efective in predicting customer churn. In this work, four tentative machine-learning models are built using data obtained from Kaggle on telecommunication customer attrition …

The Hazard Prediction Problem, Mary E. Helander, Brendan Smith, Sylvia Charchut, Erika Swiatowy, Calvin Nau, Gregory Cavaretta, Timothy Schuler, Adam Schunk, Héctor Ortiz-Peña

Social Science - All Scholarship

This work formulates the hazard prediction problem while addressing the research question: Can machine learning create a model to automatically recognize patterns that correspond to hazard state conditions during a mission-critical operation? Supervised learning models were trained and tested on data observed from mission simulators, which allowed for safe observation of dynamic system states and undesirable casualty events. The prediction task was formulated as a binary classification problem, producing the probability of being in a hazard state at time t and providing situational awareness of a possible imminent loss. Several modeling architectures were investigated: neural networks, logistic regression, a support …

Reducing Generalization Error In Multiclass Classification Through Factorized Cross Entropy Loss, Oleksandr Horban

CMC Senior Theses

This paper introduces Factorized Cross Entropy Loss, a novel approach to multiclass classification which modifies the standard cross entropy loss by decomposing its weight matrix W into two smaller matrices, U and V, where UV is a low rank approximation of W. Factorized Cross Entropy Loss reduces generalization error from the conventional O( sqrt(k / n) ) to O( sqrt(r / n) ), where k is the number of classes, n is the sample size, and r is the reduced inner dimension of U and V.

Exploring U.S. Natural Disasters And Psychological Distress: From Time Series Trends To Machine Learning Insights On Hurricane Helene, Sarah Jane Fullerton

CMC Senior Theses

This research investigates the historical trends of psychological distress in the U.S. in relation to natural disaster occurrences. By analyzing long-term data, we examine how significant natural disasters relate to levels of psychological distress over time. The research employs Exploratory Data Analysis (EDA) and Time Series Analysis to identify patterns and trends between the frequency and intensity of natural disasters and the rise of psychological distress across various periods in U.S. history. Additionally, real-time data from Reddit was collected through a custom-built Reddit web scraper specialized for Hurricane Helene. This dataset was labeled for sentiment and used to train machine …

Towards Algorithmic Justice: Human Centered Approaches To Artificial Intelligence Design To Support Fairness And Mitigate Bias In The Financial Services Sector, Jihyun Kim

CMC Senior Theses

Artificial Intelligence (AI) has positively transformed the Financial services sector but also introduced AI biases against protected groups, amplifying existing prejudices against marginalized communities. The financial decisions made by biased algorithms could cause life-changing ramifications in applications such as lending and credit scoring. Human Centered AI (HCAI) is an emerging concept where AI systems seek to augment, not replace human abilities while preserving human control to ensure transparency, equity and privacy. The evolving field of HCAI shares a common ground with and can be enhanced by the Human Centered Design principles in that they both put humans, the user, at …

Data Science In Finance: Challenges And Opportunities, Xianrong Zheng, Elizabeth Gildea, Sheng Chai, Tongxiao Zhang, Shuxi Wang

Information Technology & Decision Sciences Faculty Publications

Data science has become increasingly popular due to emerging technologies, including generative AI, big data, deep learning, etc. It can provide insights from data that are hard to determine from a human perspective. Data science in finance helps to provide more personal and safer experiences for customers and develop cutting-edge solutions for a company. This paper surveys the challenges and opportunities in applying data science to finance. It provides a state-of-the-art review of financial technologies, algorithmic trading, and fraud detection. Also, the paper identifies two research topics. One is how to use generative AI in algorithmic trading. The other is …

Examining Information Systems Use To Facilitate The Workplace Accommodation Process, Shiya Cao

Statistical and Data Sciences: Faculty Publications

BACKGROUND: The workplace accommodation process is often affected by ineffective and inefficient communications and information exchanges among disabled employees and other stakeholders. Information systems (IS) can play a key role in facilitating a more effective and efficient accommodation process since IS has been shown to facilitate business processes and effect positive organizational changes.

OBJECTIVE: Since there is little to no research that exists on IS use to facilitate the workplace accommodation process, this paper, as a critical first step, examines how IS have been used in the accommodation process.

METHODS: Thirty-six interviews were conducted with disabled employees from various organizations. …

Questions (And Answers) For Incorporating Nontraditional Grading In Your Statistics Courses, Brenna Curley

Statistical and Data Sciences: Faculty Publications

Nontraditional grading methods have recently become more common, and as with any large pedagogical shift, there are a number of questions to consider when applying a new grading scheme to a course. This article summarizes four types of nontraditional grading and shares experiences from the authors who have applied them to a variety of courses in statistics. This article is structured as a set of questions and answers, seeking to address many of the concerns and considerations that one may face as they transition a course’s grading structure. Supplementary materials for this article are available online.

Efficiently Learning An Encoder That Classifies Token Replacements And Masked Permuted Network-Based Bigru Attention Classifier For Enhancing Sentiment Classification Of Scientific Text, Muhammad Inaam Ul Haq, Khalid Mahmood, Qianmu Li, Ashok Kumar Das, Sachin Shetty, Majid Hussain

VMASC Publications

The exponential growth of scientific literature in digital repositories poses challenges in interpreting complex attitudes within academic texts. Traditional sentiment analysis methods often struggle with nuanced word meanings due to contextual variations. To address this, we propose the Electra-MPNet-based BiGRU attention classifier that extracts the high-level semantic features from citation sentences using the combined strength of Electra and MPNet encoder layers. These features are then combined to extract long-range dependencies through a stacked BiGRU layer. A linear attention mechanism is imposed to estimate the attention weights and context vector which enables the model to selectively focus on relevant information. The …

Bayesian Variable Selection With Shrinkage Priors And Generative Adversarial Networks For Fraud Detection, Amina Issoufou Anaroua

Graduate Thesis and Dissertation 2023-2024

This research paper focuses on fraud detection in the financial industry using Generative Adversarial Networks (GANs) in conjunction with Uni and Multi Variate Bayesian Model with Shrinkage Priors (BMSP). The problem addressed is the need for accurate and advanced fraud detection techniques due to the increasing sophistication of fraudulent activities. The methodology involves the implementation of GANs and the application of BMSP for variable selection to generate synthetic fraud samples for fraud detection using the augmented dataset. Experimental results demonstrate the effectiveness of the BMSP GAN approach in detecting fraud with improved performance compared to other methods. The conclusions drawn …

Deep Learning One-Class Classification With Support Vector Methods, Hayden D. Hampton

Graduate Thesis and Dissertation 2023-2024

Through the specialized lens of one-class classification, anomalies–irregular observations that uncharacteristically diverge from normative data patterns–are comprehensively studied. This dissertation focuses on advancing boundary-based methods in one-class classification, a critical approach to anomaly detection. These methodologies delineate optimal decision boundaries, thereby facilitating a distinct separation between normal and anomalous observations. Encompassing traditional approaches such as One-Class Support Vector Machine and Support Vector Data Description, recent adaptations in deep learning offer a rich ground for innovation in anomaly detection. This dissertation proposes three novel deep learning methods for one-class classification, aiming to enhance the efficacy and accuracy of anomaly detection in …

A Novel K-Nearest Neighbors Method Based On Generalized Feature Optimization For Precipitation Forecasting, Sean Guidry Stanteen

Mathematics Dissertations - Archive

This study introduces a novel k-nearest neighbors (kNN) method of forecasting precipitation at weather-observing stations. The method identifies numerous monthly temporal patterns to produce precipitation forecasts for a specific month. Compared to climatological forecasts, which average the observed precipitation over the prior thirty years, and other existing contemporary iterations of kNN, the proposed novel kNN method produces more accurate forecasts on a consistent basis. Specifically, the novel kNN method produces improved root mean square errors (RMSE), mean relative errors, and Nash-Sutcliffe coefficients when compared to climatological and other kNN forecasts at five weather …

Integrating Machine Learning With Cure Models And Associated Inference, Wisdom Aselisewine

Mathematics Dissertations - Archive

Recent advancements in medical treatments have significantly enhanced the rates of recovery for numerous chronic illnesses. This progress has sparked growing interest in developing suitable statistical models capable of handling survival data that includes substantial cure fractions. The mixture cure model finds extensive application in analyzing survival data when there exists a cured subgroup. Standard logistic regression-based approaches for modeling the incidence part of the mixture cure model may suffer from poor predictive accuracy, especially in the presence of high dimensional covariates and/or non-linear covariate effects. To overcome this limitation, we propose the integration of distinct machine learning algorithms with …

Language Models For Rare Disease Information Extraction: Empirical Insights And Model Comparisons, Shashank Gupta

Theses and Dissertations--Computer Science

End-to-end relation extraction (E2ERE) is a crucial task in natural language processing (NLP) that involves identifying and classifying semantic relationships between entities in text. This thesis compares three paradigms for end-to-end relation extraction (E2ERE) in biomedicine, focusing on rare diseases with discontinuous and nested entities. We evaluate Named Entity Recognition (NER) to Relation Extraction (RE) pipelines, sequence-to-sequence models, and generative pre-trained transformer (GPT) models using the RareDis information extraction dataset. Our findings indicate that pipeline models are the most effective, followed closely by sequence-to-sequence models. GPT models, despite having eight times as many parameters, perform worse than sequence-to-sequence models and …

Evaluating The Performance Of Different Long Short-Term Memory Networks (Lstm’S) On Financial Timeseries Data Using Mean Squared Error In Order To Identify The Optimum Lstm Variant For Regression Performance On Financial Timeseries Data., Patrick O’ Connor

ICT

This study explores the use of Long Short Term Memory (LSTM) networks, a variant of Recurrent Neural Networks (RNNs), in the context of financial forecasting, specifically oil price prediction. The research follows the CRISP-DM (Cross-Industry Standard Process for Data Mining) methodology and tests six different LSTM variants. The models are evaluated based on Mean Squared Error (MSE), aiming to determine the optimal parameter settings for each LSTM type. Among the variants tested, the Gated Recurrent Unit (GRU) emerged as the highest performer, achieving an MSE of 0.100. This was surprising, as simpler variants outperformed more complex ones, suggesting that simpler …

Ml Predictive Model For Earthquakes Integrating Mass, Distance, Gravity, And Magnitude., Aadarsh Kushwaha

ICT

This research investigates the application of machine learning regression models to improve earthquake prediction by integrating geophysical and astronomical factors such as Earth-Moon gravitational forces, their varying distances, and localized gravity fluctuations. Using data from 2011 to 2024, sourced from the US Geological Survey (USGS) and web scraping, the study tested models across four dataset proportions (25%, 50%, 80%, and 100%) with a 70:30 train-test split. The XGBRegressor model emerged as the best performer, achieving an R² score of 0.8706 on training data and 0.8632 on test data, along with a Mean Squared Error (MSE) of 0.1114 and Mean Absolute …

Maize Crop Pests And Diseases Classification Using Hybrid Models., Diana Flora Namaemba

ICT

This research focuses on improving the detection and classification of maize crop pests and diseases to enhance agricultural yield and food security. A dataset comprising 5389 images of maize conditions (healthy, pest-affected, and disease-affected) across seven classes was used. The images underwent preprocessing, including resizing to 299x299, class balancing using augmentation techniques, and noise reduction with Gaussian filtering.

Feature extraction utilised EfficientNetB0 and InceptionV3 architectures, with PCA employed for feature selection. Classification was conducted using a Support Vector Machine (SVM) with a One-vs-One strategy, alongside a baseline 2D CNN model. Data engineering included label encoding, standardisation, and an 80:10:10 train-test-validation …

Statistical And Machine Learning Techniques For Predicting Solar Power Generation In A Microgrid., Conor Dillon

ICT

This study investigates statistical and machine learning models for forecasting solar power generation in microgrids, focusing on the solar installation at Powell-Focht Bioengineering Hall, UC San Diego. Accurate predictions are critical due to the variability of solar energy, aiming to optimise microgrid operations and solar power efficiency. The research compares the performance of SARIMAX, LSTM, Random Forest, and ANN models using meteorological and solar power time series data. It finds that current meteorological inputs, especially solar radiation, enhance short-term forecasting accuracy over reliance on historical patterns.

The Random Forest Auto Regressor (RFAR) outperformed other models in 10-day-ahead solar power forecasting, …