Statistical Models Commons^™

No Intelligence Without Statistics: The Invisible Backbone Of Artificial Intelligence, Ernest Fokoue

Articles

The rapid ascent of artificial intelligence (AI) is often portrayed as a revolution born from computer science and engineering. This narrative, however, obscures a fundamental truth: the theoretical and methodological core of AI is, and has always been, statistical. This paper systematically argues that the field of statistics provides the indispensable foundation for machine learning and modern AI. We deconstruct AI into nine foundational pillars—Inference, Density Estimation, Sequential Learning, Generalization, Representation Learning, Interpretability, Causality, Optimization, and Unification—demonstrating that each is built upon century-old statistical principles. From the inferential frameworks of hypothesis testing and estimation that underpin model evaluation, to the …

Decorrelation, Diversity, And Emergent Intelligence: The Isomorphism Between Social Insect Colonies And Ensemble Machine Learning, Ernest Fokoue, Gregory Babbitt, Yuval Levental

Articles

Social insect colonies and ensemble machine learning methods represent two of the most successful examples of decentralized information processing in nature and computation respectively. Here we develop a rigorous mathematical framework demonstrating that ant colony decision-making and random forest learning are isomorphic under a common formalism of stochastic ensemble intelligence. We show that the mechanisms by which genetically identical ants achieve functional differentiation— through stochastic response to local cues and positive feedback—map precisely onto the bootstrap aggregation and random feature subsampling that decorrelate decision trees. Using tools from Bayesian inference, multi-armed bandit theory, and statistical learning theory, we prove that …

A General Weighting Theory For Ensemble Learning: Beyond Variance Reduction Via Spectral And Geometric Structure, Ernest Fokoue

Articles

Ensemble learning is traditionally justified as a variance-reduction strategy, explaining its strong performance for unstable predictors such as decision trees. This explanation, however, does not account for ensembles constructed from intrinsically stable estimators-including smoothing splines, kernel ridge regression, Gaussian process regression, and other regularized reproducing kernel Hilbert space (RKHS) methods whose variance is already tightly controlled by regularization and spectral shrinkage. This paper develops a general weighting theory for ensemble learning that moves beyond classical variance-reduction arguments. We formalize ensembles as linear operators acting on a hypothesis space and endow the space of weighting sequences with geometric and spectral constraints. …

On Fibonacci Ensembles: An Alternative Approach To Ensemble Learning Inspired By The Timeless Architecture Of The Golden Ratio, Ernest Fokoue

Articles

Nature rarely reveals her secrets bluntly, yet in the Fibonacci sequence she grants us a glimpse of her quiet architecture of growth, harmony, and recursive stability \citep{Koshy2001Fibonacci, Livio2002GoldenRatio}. From spiral galaxies to the unfolding of leaves, this humble sequence reflects a universal grammar of balance. In this work, we introduce \emph{Fibonacci Ensembles}, a mathematically principled yet philosophically inspired framework for ensemble learning that complements and extends classical aggregation schemes such as bagging, boosting, and random forests \citep{Breiman1996Bagging, Breiman2001RandomForests, Friedman2001GBM, Zhou2012Ensemble, HastieTibshiraniFriedman2009ESL}. Two intertwined formulations unfold: (1) the use of normalized Fibonacci weights -- tempered through orthogonalization and Rao--Blackwell optimization -- …

Learning Ordinal Geometry: Semantic–Aware Kernels For Ordered Categorical Data, Ernest Fokoue

Articles

Ordinal data arise ubiquitously in survey research, psychology, medicine, economics, and recommender systems, yet kernel methods for such data typically rely on either nominal encodings or arbitrary numeric codings. The former discards order information; the lat- ter imposes a fictitious metric structure. This paper develops a principled framework for kernel design on ordinal scales and introduces a new class of Semantic–Aware Ordinal Ker- nels (SAOK) that simultaneously capture ordinal order and semantic proximity between categories. We begin by formalizing order–preserving embeddings of finite chains and characterizing a broad family of chain distances that are conditionally negative definite. Through Schoen- berg …

Measuring Market Risk Through Entropic Var, Dragomir Nedeltchev, Tsvetelin Zaevski

Mathematical Modelling and Numerical Simulation with Applications

The article aims to measure the market risk beyond the basic risk measures like the Value-at-Risk (VaR) and the Expected Shortfall (ES). The Entropic Value-at-Risk is selected among the available measures based on its advantages -- it is the coherent upper bound of the VaR and ES. This risk measure is applied to the classical Black-Scholes model as well as to some more realistic ones, such as the exponential tempered stable model (the log-returns are presented by a tempered stable L\'evy process), the stochastic volatility model of Heston, its jump extension of Bates, and another stochastic volatility model but with …

Availability Model To Evaluate Ai Data Centers’ Role In Grid Stability, Troy Mcsimov, Trevor S. Kunz, Jeffrey Billo

SMU Data Science Review

The United States has made it clear; it is imperative that the US wins the global AI race. This paper focuses on one of the most challenging puzzle pieces surfaced at the POWER Data Center conference (San Antonio, Sept. 30.); for Electric Reliability Council of Texas (ERCOT) the limiting factor is not generation alone but the need to balance generation and load to preserve grid reliability.

The regulatory landscape fundamentally changed with the passage of Texas Senate Bill 6 in June 2025, which mandates new large loads must "contribute to the recovery of the interconnecting electric utility’s costs" (Texas Legislature, …

A Note On Sufficient Dimension Folding For Regression Mean Function With Categorical Predictors, Bilin Zeng, Akim Adekpedjou, Xuerong Meggie Wen

Mathematics and Statistics Faculty Research & Creative Works

Multi-dimensional arrays are referred to as tensors. Tensor-valued predictors are commonly encountered in modern biomedical applications, such as electroencephalogram (EEG), magnetic resonance imaging (MRI), functional MRI (fMRI), diffusion-weighted MRI, and longitudinal health data. In survival analysis, it is both important and challenging to integrate clinically relevant information, such as gender, age, and disease state along with medical imaging tensor data or longitudinal health data to predict disease outcomes. Most existing higher-order sufficient dimension reduction regressions for matrix- or array-valued data focus solely on tensor data, often neglecting established clinical covariates that are readily available and known to have predictive value. …

Derivation Of An Updated Brief Multivariable Prediction Model To Detect Panic-Related Anxiety In Emergency Department Patients With Cardiopulmonary Complaints, Sharon C. Sung, Felicia J. L. Ang, Arul Earnest, Leslie E. C. Lim, Shreshtha Jolly, Gilaine Rui Ng, A. John Rush, Marcus E. H. Ong

Research Collection School of Social Sciences

Background Patients with panic related-anxiety (i.e., panic attacks or panic disorder) frequently present to emergency departments (EDs) with cardiopulmonary complaints but are often undiagnosed, which can lead to recurrent visits and prolonged distress. This study aimed to derive a new symptom-based multivariable diagnostic prediction model to detect panic-related anxiety in ED patients with cardiopulmonary symptoms.Methods We conducted a single-blind prospective derivation study over 15 months in the ED of a major tertiary hospital in Singapore. Patients presenting with symptoms of palpitations, chest pain, dizziness, or difficulty breathing were assessed using the Structured Clinical Interview for DSM Disorders (SCID) to diagnose …

Statistical Analysis Of Log Transformation Effectiveness In Air Traffic Movement Forecasting During Covid-19 In South Africa, John Lehlaka Masekoameng

Journal of Aviation Technology and Engineering

This study evaluates the effectiveness of log transformation in enhancing multiple regression models used to forecast air traffic movements (ATMs) in South Africa during the COVID-19 pandemic. Using 60 monthly observations from October 2016 to September 2021, the analysis incorporates variables such as revenue, lockdown levels, COVID-19 metrics, exchange rates, gross domestic product, and population. Two models are compared: one using raw ATMs and another with log-transformed ATMs as the dependent variable.

While the untransformed model shows stronger explanatory power (R² = 0.904, adjusted R² = 0.891) compared to the log-transformed model (R² = 0.772, adjusted R² = 0.741), the …

Evaluating Lunch Plan Data In The St. Charles School District (Scsd), Maddy Alexander, Guillermo Bilbao Olarreaga, Duncan Krige, Alyssa Schreiber, Nick Wintz, Wojciech Golik

The Confluence

The SCSD is a public school district in St. Charles, with, on average, 4500 students a year. The SCSD is subdivided into an early childhood center, six elementary schools, two intermediate (5-6,7-8) schools, and two high schools. Vocational schools are also within this district but were not included in this report. The SCSD is concerned with the impact of the Covid-19 pandemic on their district’s population and on the number of students that needed assistance with lunch. They have asked Lindenwood’s 2024-25 PIC Math group to analyze their data from the years 2020-25 and identify any trends. Identifying these trends …

Comparative Machine Learning Models For Disease Risk Prediction, Mercy Mawusi Agbley

Theses, Dissertations and Capstones

Accurate prediction of disease outcomes is crucial for improving clinical decision-making and enabling early intervention. This study compares the performance of various statistical and machine learning models for clinical risk prediction using two healthcare datasets: diabetic retinopathy and heart disease. The models assessed include Logistic Regression, LASSO, k-Nearest Neighbors (KNN), Support Vector Machines (SVM), Neural Networks, Random Forests, Gradient Boosting Machines (GBM), and a stacked ensemble model. Prior to modeling, datasets were split into train and test sets. Standardization was applied to numeric features whilst categorical features were one-hot encoded. These transformations were later applied to the test set. Principal …

Predicting Criminal Behavior In Major Us Cities, Madison A. Price

SPARK Symposium Presentations

In recent years, especially post pandemic, there has been a decrease in crime in the United States. Unfortunately, the country’s violent crime rates are still significantly higher compared to similar high-income countries, so what predicts crime in major American cities? There is tons of research to support the idea that demographics can offer some insight into predicting crime. There are countless online resources that seek to identify major crime centrals in the United States (Petrino, 2025). In the late 1990s, researchers noticed that crime rates in cities had a downward slope due to an important contributor: demographic change (Fox & …

Investigating The Role Of Humic Acid In The Adsorption Mechanics Of Acetaminophen On Potassium Persulfate-Aged Polyethylene Terephthalate (Pet), Andrew Littleton, Maria Danielle Garrett, Phd

SPARK Symposium Presentations

Pharmaceutical contaminants such as acetaminophen (APAP) are showing a rising presence in aquatic environments, where their interactions with microplastics (MPs) can potentially modulate natural degradation mechanisms. Concurrent presence of the two substances has been shown to potentiate increase their individual harmful effects. This study investigates whether oxidative aging and humic-acid surface modification of PET microplastics influence APAP adsorption.

In this study, UV-aging was reproduced using an iron (II)-activated potassium persulfate (Fe(II)-KPS) oxidation system. Aqueous dissolved organic matter (DOM) is simulated using multi-hour exposure to humic acid. The MPs are then removed from the solution to examine adsorption mechanisms. While most …

A Comparative Evaluation Of Data Imbalance Handling Techniques In Machine Learning Models For One-Year Mortality Prediction In Liver Cirrhosis, Sumiya Hasan Trisha

UNF Graduate Theses and Dissertations

Liver cirrhosis is associated with substantial morbidity and mortality, making one-year mortality prediction a clinically relevant problem. Using a liver cirrhosis dataset as the motivating application, this thesis evaluates five machine learning classifiers—Logistic Regression, Random Forest, XGBoost, LightGBM, and CatBoost—under five class-imbalance handling strategies: Baseline learning, Random Oversampling, SMOTE-NC, ADASYN, and Cost-Sensitive Learning. Hyperparameter tuning was conducted using randomized search, and predictive performance was assessed over 200 iterations of Monte Carlo Cross-Validation using Accuracy, Precision, Recall, Fl-score, and ROC-AUC.

The results suggest that imbalance-handling strategies can materially affect predictive performance, particularly recall. Because the outcome of interest is death within …

Using Camera-Based Unmarked Spatial Capture-Recapture Modeling To Estimate Reintroduced Elk (Cervus Canadensis) Population Parameters And Distribution In Southeastern Kentucky, Claire Marie Muia

Theses and Dissertations--Forestry and Natural Resources

Estimation of population parameters is important for wildlife management decisions. Elk reintroduced to southeastern Kentucky experienced early irruptive population growth and are currently monitored using a statewide harvest-based statistical population reconstruction model (SPR) across the Kentucky Elk Restoration Zone (KERZ). Because the SPR model is spatially coarse and difficult to scale to the smaller management units comprising the KERZ, we conducted a spatially explicit capture-recapture study using a clustered camera-trapping array deployed for 10 weeks from June–August 2024 to estimate elk population parameters within Management Unit 4. Due to a lack of resights of GPS-marked elk, population parameters were estimated …

Volatility Modeling With An Application To Risk Parity Portfolios, Kenneth Hou

CMC Senior Theses

This thesis studies volatility modeling in the context of risk parity portfolio construction. I compare three risk parity portfolios that differ only in their underlying volatility model: a historical covariance baseline, a Bayesian stochastic volatility model, and a GRU–GARCH hybrid neural network. Using daily returns on Kenneth French’s five industry portfolios from January 2016 through December 2025, I construct monthly rebalanced portfolios under each model, with the SV and GRU forecasts embedded in hybrid covariance matrices that combine forecasted volatilities with rolling historical correlations. The results document a divergence between forecast accuracy and portfolio performance: the SV model is the …

Rank Rebalancing In Commodity And Foreign Exchange Markets, Prateek D. Vyas

CMC Senior Theses

This thesis empirically tests the rank-rebalancing mechanism of Stochastic Portfolio Theory (SPT) across commodity futures, foreign exchange futures, and equity ETFs. The Reverse Price-Weighted strategy (RPW) assigns, to each asset, the market weight of the asset at the opposite price rank, and generates an annualized excess return of 2.90% over the price-weighted (MKT) commodity benchmark, during the period of November 1977 to October 2025 (HAC t = 2.058, p = 0.040). The differential Sharpe ratio (dSharpe) of 0.245 is confirmed by a stationary block bootstrap, with a 𝑝-value of 0.015, and factor regressions controlling for carry, momentum, and value yield …

Computational And Ai Frameworks For Identifying Key Regulatory Genes And Their Target Genes In Plants And Humans, Md Khairul Islam

Dissertations, Master's Theses and Master's Reports

This dissertation presents computational and AI-driven frameworks for identifying key regulatory genes and their downstream targets across plant and human biological systems. Three studies address distinct challenges in genomic regulation using advanced machine learning and bioinformatics approaches.

The first study introduces DyGAF (Dynamic Gene Attention Focus), a dual-attention transformer framework that identifies and ranks disease-relevant biomarker genes by simultaneously modeling independent molecular responses and interdependent regulatory network behavior. Two attention models provide complementary perspectives on gene importance and are fused through a novel combination metric. Applied to COVID-19 nasopharyngeal swab profiles, the attention-weighted representations achieved 94.23% classification accuracy, high sensitivity, …

Bayesian Analysis Of Nominal Outcomes With Missing Values Using Multinomial And Multivariate Multinomial Probit Models, Suwash Silwal

Dissertations, Master's Theses and Master's Reports

Nominal outcomes frequently arise in health sciences, transportation, economics, market research, and related fields. These data often contain missing values, while longitudinal and panel studies generate multiple correlated nominal responses. Bayesian estimation of multinomial probit (MNP) and multivariate multinomial probit (MMNP) models provides a flexible framework for analyzing such data but remains computationally challenging due to high-dimensional likelihood integration, restrictive covariance identification constraints, and poor mixing of Markov chain Monte Carlo (MCMC) algorithms, particularly in the presence of missing data. This dissertation develops parameter-expanded data augmentation (PX-DA) methods for MNP and MMNP models with missing nominal outcomes by incorporating parameter …