Applied Statistics Commons^™

Developing A Humpback Whale Vocalization Detector Using Machine Learning Models, Lucas Kantorowski

Master's Theses

Humpback whale songs are notoriously complex. Identification of humpback whale song units requires bioacousticians to tediously listen, analyze, and annotate collected sound data. Even sparse data requires listening to the entirety of the collected acoustic data. In this study, three hours of audio containing over one-thousand humpback whale song units was collected in Monterey Bay, California.

Prior studies have seen success using convolutional neural networks by performing image classification on hundreds of hours worth of spectrograms. Our study uses traditional machine learning models, as they are less computationally demanding, and require less data.

We use time splitting and Mel-frequency cepstrum …

Crab: A Novel Clustering Score Using Clustering With Rivals And Buddies For Unsupervised Learning, Allen Choi

Master's Theses

Unsupervised clustering algorithms today are used across a wide variety of fields such as biology, engineering, and industry in order to classify observations into groups where labels are not provided. This can provide important latent information regarding the observations within groups, as well as insight regarding the groups themselves. In order to judge the optimal number of clusters for an unsupervised clustering algorithm, many methods exist such as the Elbow Method and Silhouette Score; however, these methods come with drawbacks and are not necessarily flexible across many unsupervised methods. We present a novel clustering score framework relying on a resampling-based …

Multimodal Machine Learning For Soil Burn Severity Mapping Across California Wildfires, Sanjana Checker

Master's Theses

Accurate mapping of soil burn severity (SBS) is critical for post-fire watershed management, erosion risk assessment, and ecological recovery planning, yet traditional field-based approaches remain costly, time-intensive, and spatially limited. This thesis presents a machine learning pipeline for wall-to-wall SBS classification across California wildfires using multi-sensor satellite imagery, terrain derivatives, and bioclimatic covariates. Field-collected SBS observations (n = 2,180) from 52 wildfires occur- ring between 2013 and 2025, sourced from the U.S. Forest Service and CAL FIRE, were used to train and evaluate multiple classification architectures within a Google Earth Engine and Google Cloud-based prediction framework. After upsampling the unburned …

Efficacy Analysis In Clinical Trials: A Comprehensive Review Of Statistical And Machine Learning Approaches, Dhrubajyoti Ghosh, Samhita Pal

Faculty Articles

Efficacy testing is a cornerstone of clinical trials, ensuring that medical interventions achieve their intended therapeutic effects. Over the decades, a wide range of statistical methodologies have been developed to address the complexities of clinical trial data, including parametric, nonparametric, Bayesian, and machine learning approaches. Parametric methods, such as t-tests, ANOVA, and LMMs, have traditionally been the foundation of efficacy testing due to their efficiency under well-defined assumptions. Nonparametric techniques, including the Friedman test, Brunner-Munzel test, and modern extensions like nparLD, have emerged as robust alternatives, particularly for skewed, ordinal, or non-normal data. Bayesian methodologies have enabled the incorporation of …

Comparative Machine Learning Models For Disease Risk Prediction, Mercy Mawusi Agbley

Theses, Dissertations and Capstones

Accurate prediction of disease outcomes is crucial for improving clinical decision-making and enabling early intervention. This study compares the performance of various statistical and machine learning models for clinical risk prediction using two healthcare datasets: diabetic retinopathy and heart disease. The models assessed include Logistic Regression, LASSO, k-Nearest Neighbors (KNN), Support Vector Machines (SVM), Neural Networks, Random Forests, Gradient Boosting Machines (GBM), and a stacked ensemble model. Prior to modeling, datasets were split into train and test sets. Standardization was applied to numeric features whilst categorical features were one-hot encoded. These transformations were later applied to the test set. Principal …

Serum Biomarker Trajectory Clusters Predict Functional Outcome And Quality Of Life For Traumatic Brain Injury, Thanh Son Do, Chantal Carnes, Zhihui Yang, Firas Kobeissy, Hamad Yadikar, Gayla R. Olbricht, Olli Tenovuo, Jussi P. Posti, Ewout W. Steyerberg, Lindsay Wilson, Nicole Von Steinbüchel, Endre Czeiter, Andras Buki, David K. Menon

Mathematics and Statistics Faculty Research & Creative Works

Serum brain-enriched biomarkers are increasingly employed in the clinical evaluation of traumatic brain injury (TBI) to assist with triage, neuroimaging decisions, and prognostication. However, the potential of temporal biomarker trajectories to inform disease monitoring and long-term outcomes remains underexplored. We aim to identify distinct biomarker trajectory (TRAJ) profiles in traumatic brain injury patients and to examine their associations with long-term clinical outcomes. The study included 373, CT-positive Intensive Care Unit (ICU) traumatic brain injury patients (256 with initial Glasgow Coma Scale 3–12) from the Collaborative European Neurotrauma Effectiveness Research in TBI (CENTER-TBI) core study who had at least two serum …

An Integrated Data-Driven Framework For Arctic Shipping: Analyzing Vessel Speed, Environmental And Ecological Factors Through Innovative Statistical Spatio-Temporal Methods, Inverse Optimization And Machine Learning, Mauli Pant

Theses and Dissertations

This dissertation develops an integrated data-driven framework to analyze vessel navigation and ecological risk in the United States Arctic from 2010 to 2019. As environmental change and maritime activity increase in the region, understanding how vessels respond to dynamic conditions and how those responses interact with marine ecosystems has become increasingly important. A central theme of this dissertation is the treatment of vessel speed as both an observed outcome and a decision variable reflecting trade- offs among operational, environmental, and ecological factors. The first chapter develops a predictive framework for vessel speed over ground (SOG) using Gaussian Process Boosting (GPBoost), …

Machine Learning-Based Intrusion Detection System For Iot Networks Using The Rt-Iot 2022 Dataset, Bukunmi Ebenezer Afolabi

Theses, Dissertations and Capstones

The rapid expansion of the Internet of Things (IoT) has transformed modern computing by enabling seamless connectivity among heterogeneous devices across diverse application domains. However, this increased interconnectivity has significantly enlarged the attack surface of IoT networks, exposing them to a wide range of sophisticated cyber threats. Conventional security mechanisms often lack the capability to detect emerging attacks in real time, thereby necessitating the development of intelligent Intrusion Detection Systems (IDS) capable of accurately identifying malicious network activities. This study developed and evaluated a machine learning-based intrusion detection framework for multiclass IoT attack detection using the RT-IoT2022 dataset. The dataset …

Trends And Predictive Modeling Of Real Estate Prices In Major Saudi Arabia Cities, Meshal S. Aldahas

Theses and Dissertations

his research examines historical trends and explanatory modeling of real estate prices in major Saudi cities, with a focus on Riyadh, Jeddah, and Dammam. Using a mixed-methods approach, the study integrates quantitative data from 2010–2023, including housing and macroeconomic indicators, with qualitative insights drawn from over 320 survey responses that captured consumer sentiment on affordability, job security, and housing policies. A combination of descriptive statistics, ARIMA and Exponential Smoothing techniques was applied to detect long-term patterns, seasonal variations, and market shocks. Predictive modeling was conducted using Linear Regression, Decision Trees, and Neural Networks, with results showing that job security consistently …

Comparative Analysis Of Sequential And Non-Sequential Modeling Techniques For Ddos Attack Detection With Explainable Ai, Vincent Agbenyeavu

Theses and Dissertations

Cybersecurity is known today as one of the greatest challenges of the modern era. Among the various types of cyber-attacks that threaten our security, the Distributed Denial of Service (DDoS) attack is among some of the most common, effective, and well-recognized attack strategies. Since this form of attack is meant to disrupt the availability factor covertly, it can be detrimental to the targeted machines and difficult to discover. Because of that, there have been several approaches, as well as solutions that have been devised to detect it as accurately and efficiently as possible. In this study, four sequential data modeling …

Enhancing Animal Shelter Operations With Time Series And Machine Learning, Sakava L. Kiv, Donald L. Anderson, Shivam Negi, Jacquelyn Cheun

SMU Data Science Review

Enhancing animal shelter operations through machine learning involves employing a variety of advanced techniques aimed at increasing efficiency, promoting animal welfare, and optimizing resource allocation. This paper explores predictive analytics for adoption rates using regression models to estimate the likelihood of adoption based on historical data, encompassing variables such as breed, health status, and previous adoption trends. Additionally, classification algorithms are utilized to categorize animals by adoption probability, facilitating better resources and marketing prioritization. Clustering algorithms are employed to group animals according to behavior patterns and/or physical health, enabling tailored medical care and enrichment activities that improve their mental and …

On Large Language Models In National Security Applications, William N. Caballero, Phillip R. Jenkins

Faculty Publications

The overwhelming success of GPT-4 in early 2023 highlighted the transformative potential of large language models (LLMs) across various sectors, including national security. This article explores the implications of LLM integration within national security contexts, analyzing their potential to revolutionize information processing, decision-making, and operational efficiency. Whereas LLMs offer substantial benefits, such as automating tasks and enhancing data analysis, they also pose significant risks, including hallucinations, data privacy concerns, and vulnerability to adversarial attacks. Through their coupling with decision-theoretic principles and Bayesian reasoning, LLMs can significantly improve decision-making processes within national security organizations. Namely, LLMs can facilitate the transition from …

Methods In Statistics, Machine Learning, And Deep Learning For Combining Multi-Omics Dataset, Md Mutasim Billah

Dissertations, Master's Theses and Master's Reports

Transcriptome-wide association studies (TWAS) have emerged as a powerful strategy to bridge genome-wide association studies (GWAS) with gene regulatory mechanisms by integrating genotypic data with gene expression data. While early TWAS methods typically rely on linear models and single-tissue expression references, recent advances underscore the need for flexible, multi-tissue approaches that can capture heterogeneous regulatory architectures and tissue-specific expression patterns. This dissertation introduces a three‑part research project that advances multi‑tissue transcriptome‑wide association studies (TWAS) along complementary axes of methodology, statistical power, and modelling flexibility.

In chapter One, TWAS‑CTL introduces a two‑stage cross‑tissue learner that trains any user‑chosen single‑tissue imputers (STLs) …

Multi-Label Classification Using Conformal Prediction, Chhavi Tyagi

Dissertations

In many machine learning applications, such as image tagging, document classi-fication, and medical diagnosis, a data instance can be associated with multiple classes in parallel so that each instance is associated with multiple response variables simultaneously defining multi-label classification. Standard multi-label classification methods that provide point predictions have been developed. They lack in quantifying the uncertainty of predictions. These methods also lack in accounting for label dependencies and are very computationally expensive. This dissertation develops two methods of multi-label classification using conformal prediction that quantify the uncertainty of predictions. Chapter 1 introduces notations and tools that have been used in …

Optimizing Sports Outcome Prediction Through Feature Engineering And Machine Learning, Vitor S. Freitas

Graduate Theses/Dissertations

The challenge of predicting the outcome of a team game lies in the high complexity and dynamics of the sports data. This thesis focuses on the aspect of using feature engineering and the genetic algorithm to predict the winner and the score of various sports events. Generally, it deals with how machine learning algorithms are combined with state-of-the-art feature engineering techniques in sports datasets derived from various sports disciplines. In this thesis, five different machine learning models have been applied, classification and regression trees (CART), random forest (RF), stochastic gradient boosting (SGB), eXtreme gradient boosting (XGBoost), and extreme learning machine …

Differentiation Of Human, Dog, And Cat Hair Fibers Using Dart Tofms And Machine Learning, Laura Ahumada, Erin R. Mcclure-Price, Chad Kwong, Edgard O. Espinoza, John Santerre

SMU Data Science Review

Hair is found in over 90% of crime scenes and has long been analyzed as trace evidence. However, recent reviews of traditional hair fiber analysis techniques, primarily morphological examination, have cast doubt on its reliability. To address these concerns, this study employed machine learning algorithms, specifically Linear Discriminant Analysis (LDA) and Random Forest, on Direct Analysis in Real Time time-of-flight mass spectra collected from human, cat, and dog hair samples. The objective was to develop a chemistry- and statistics-based classification method for unbiased taxonomic identification of hair. The results of the study showed that LDA and Random Forest were highly …

Statistical And Machine Learning Approaches To Describe Factors Affecting Preweaning Mortality Of Piglets, Md Towfiqur Rahman, Tami M. Brown-Brandl, Gary A. Rohrer, Sudhendu R. Sharma, Vamsi Manthena, Yeyin Shi

Department of Agricultural and Biological Systems Engineering: Faculty Publications

High preweaning mortality (PWM) rates for piglets are a significant concern for the worldwide pork industries, causing economic loss and well-being issues. This study focused on identifying the factors affecting PWM, overlays, and predicting PWM using historical production data with statistical and machine learning models. Data were collected from 1,982 litters from the United States Meat Animal Research Center, Nebraska, over the years 2016 to 2021. Sows were housed in a farrowing building with three rooms, each with 20 farrowing crates, and taken care of by well-trained animal caretakers. A generalized linear model was used to analyze the various sow, …

Quantifying Implicit Bias In Judicial Legal Opinions: A Natural Language Processing Approach, Philip N. Surendran

Quantitative Social Science Undergraduate Senior Theses

Implicit bias and criminal justice are two concepts that have long been intertwined. There is no justice without neutrality, and yet how do we tell if the actors enforcing the system are actually impartial? In this thesis, I utilize recent advancements in machine learning to attempt to answer this question. Specifically, I use natural language processing to examine the text of opinions written by judges in appellate courts, and I leverage these findings to build quantifiable measures of implicit bias. In particular, I look at the over/under-representation of certain emotions, sentiments and linguistic styles as a proxy for disparate treatment …

Statistical And Biological Analyses Of Acoustic Signals In Estrildid Finches, Moises Rivera

Dissertations, Theses, and Capstone Projects

Acoustic communication is a process that involves auditory perception and signal processing. Discrimination and recognition further require cognitive processes and supporting mechanisms in order to successfully identify and appropriately respond to signal senders. Although acoustic communication is common across birds, classical research has largely disregarded the perceptual abilities of perinatal altricial taxa. Chapter 1 reviews the literature of perinatal acoustic stimulation in birds, highlighting the disproportionate focus on precocial birds (e.g., chickens, ducks, quails). The long-held belief that altricial birds were incapable of acoustic perception in ovo was only recently overturned, as researchers began to find behavioral and physiological evidence …

Data-Optimized Spatial Field Predictions For Robotic Adaptive Sampling: A Gaussian Process Approach, Zachary Nathan

Computer Science Senior Theses

We introduce a framework that combines Gaussian Process models, robotic sensor measurements, and sampling data to predict spatial fields. In this context, a spatial field refers to the distribution of a variable throughout a specific area, such as temperature or pH variations over the surface of a lake. Whereas existing methods tend to analyze only the particular field(s) of interest, our approach optimizes predictions through the effective use of all available data. We validated our framework on several datasets, showing that errors can decline by up to two-thirds through the inclusion of additional colocated measurements. In support of adaptive sampling, …

Reducing Restaurant Inventory Costs Through Sales Forecasting, Tyler Mason, Chris Schoen, Trevor Gilbert, Jonathan Enriquez

Senior Design Project For Engineers

Family Restaurant is a local restaurant in the greater Atlanta area that serves a variety of dishes that include an assortment of 19 different proteins. Currently, Family Restaurant places protein orders based on business intuition, and tends to over-stock and sometimes under-stock. To minimize inventory costs by reducing over-stocking and preventing under-stocking of proteins, we applied Facebook Prophet (FB Prophet), ARIMA, and XG Boost machine learning models to predict protein demand and then fed these results into a Fixed Time Period inventory model to make an overall order suggestion based on the specified time period. We trained our models on …

Problems With Machine Learning, High-Dimensional Data And Forecasting Stock Returns, Erik Mekelburg

Electronic Theses and Dissertations

Using a multi-level ensemble design, we forecast international stock market returns with a novel high-dimensional data set of aggregated cross sectional firm-level predictors. The method includes considerations of model uncertainty, parameter instability, model density and non-linearities with machine learning, shrinkage and model averaging. We provide evidence that it is important to systematically focus on all four sources of forecast failure, shed light on the sparsity/density debate in the stock return forecasting dialogue and contribute interesting findings on the efficacy dimensionality reduction with principal components analysis and partial least squares. The robustness of the approach is demonstrated through applications in four …

A Course In Data Science: R And Prediction Modeling, Adam Kapelner

Open Educational Resources

This is a self-contained course in data science and machine learning using R. It covers philosophy of modeling with data, prediction via linear models, machine learning including support vector machines and random forests, probability estimation and asymmetric costs using logistic regression and probit regression, underfitting vs. overfitting, model validation, handling missingness and much more. There is formal instruction of data manipulation using dplyr and data.table, visualization using ggplot2 and statistical computing.

Generating A Dataset For Comparing Linear Vs. Non-Linear Prediction Methods In Education Research, Jack Mauro, Elena Martinez, Anna Bargagliotti

Honors Thesis

Machine learning is often used to build predictive models by extracting patterns from large data sets. Such techniques are increasingly being utilized to predict outcomes in the social sciences. One such application is predicting student success. Machine learning can be applied to predicting student acceptance and success in academia. Using these tools for education-related data analysis, may enable the evaluation of programs, resources and curriculum. Currently, research is needed to examine application, admissions, and retention data in order to address equity in college computer science programs. However, most student-level data sets contain sensitive data that cannot be made public. To …

Intraday Algorithmic Trading Using Momentum And Long Short-Term Memory Network Strategies, Andrew R. Whitinger Ii

Undergraduate Honors Theses

Intraday stock trading is an infamously difficult and risky strategy. Momentum and reversal strategies and long short-term memory (LSTM) neural networks have been shown to be effective for selecting stocks to buy and sell over time periods of multiple days. To explore whether these strategies can be effective for intraday trading, their implementations were simulated using intraday price data for stocks in the S&P 500 index, collected at 1-second intervals between February 11, 2021 and March 9, 2021 inclusive. The study tested 160 variations of momentum and reversal strategies for profitability in long, short, and market-neutral portfolios, totaling 480 portfolios. …

Intra-Hour Solar Forecasting Using Cloud Dynamics Features Extracted From Ground-Based Infrared Sky Images, Guillermo Terrén-Serrano

Electrical and Computer Engineering ETDs

Due to the increasing use of photovoltaic systems, power grids are vulnerable to the projection of shadows from moving clouds. An intra-hour solar forecast provides power grids with the capability of automatically controlling the dispatch of energy, reducing the additional cost for a guaranteed, reliable supply of energy (i.e., energy storage). This dissertation introduces a novel sky imager consisting of a long-wave radiometric infrared camera and a visible light camera with a fisheye lens. The imager is mounted on a solar tracker to maintain the Sun in the center of the images throughout the day, reducing the scattering effect produced …

Finding The Best Predictors For Foot Traffic In Us Seafood Restaurants, Isabel Paige Beaulieu

Honors Theses and Capstones

COVID-19 caused state and nation-wide lockdowns, which altered human foot traffic, especially in restaurants. The seafood sector in particular suffered greatly as there was an increase in illegal fishing, it is made up of perishable goods, it is seasonal in some places, and imports and exports were slowed. Foot traffic data is useful for business owners to have to know how much to order, how many employees to schedule, etc. One issue is that the data is very expensive, hard to get, and not available until months after it is recorded. Our goal is to not only find covariates that …

Classification Of Chess Games: An Exploration Of Classifiers For Anomaly Detection In Chess, Masudul Hoque

All Graduate Theses, Dissertations, and Other Capstone Projects

Chess is a strategy board game with its inception dating back to the 15th century. The Covid-19 pandemic has led to a chess boom online with 95,853,038 chess games being played during January, 2021 on lichess.com. Along with the chess boom, instances of cheating have also become more rampant. Classifications have been used for anomaly detection in different fields and thus it is a natural idea to develop classifiers to detect cheating in chess. However, there are no specific examples of this, and it is difficult to obtain data where cheating has occurred. So, in this paper, we develop 4 …

Ensemble Protein Inference Evaluation, Kyle Lee Lucke

Graduate Student Theses, Dissertations, & Professional Papers

The Protein inference problem is becoming an increasingly important tool that aids in the characterization of complex proteomes and analysis of complex protein samples. In bottom-up shotgun proteomics experiments the metrics for evaluation (like AUC and calibration error) are based on an often imperfect target-decoy database. These metrics make the inherent assumption that all of the proteins in the target set are present in the sample being analyzed. In general, this is not the case, they are typically a mix of present and absent proteins. To objectively evaluate inference methods, protein standard datasets are used. These datasets are special in …

Analyzing The Fractal Dimension Of Various Musical Pieces, Nathan Clark

Industrial Engineering Undergraduate Honors Theses

One of the most common tools for evaluating data is regression. This technique, widely used by industrial engineers, explores linear relationships between predictors and the response. Each observation of the response is a fixed linear combination of the predictors with an added error element. The method is built on the assumption that this error is normally distributed across all observations and has a mean of zero. In some cases, it has been found that the inherent variation is not the result of a random variable, but is instead the result of self-symmetric properties of the observations. For data with these …