Artificial Intelligence and Robotics Commons^™

You Can’T Spell Audit Without Ai: The Current Uses Of Artificial Intelligence In Audit, Jena Perkins

Senior Honors Theses

The accounting profession continuously adapts to the innovations provided by the broader context in which it exists. Artificial intelligence (AI) is a forerunner among tools used to enhance and optimize auditing services within the accounting profession. The realm of AI offers advancements to procedures used within an audit to detect misstatements. Based on the proprietary platforms developed by Big 4 accounting firms, AI is a key component in maintaining an advanced approach towards auditing.

Aircraft Fault Detection Via Weight And Bias Analysis Of A Custom First Neural Network Layer, George Harrison Chen

Theses and Dissertations

Fault detection in aircraft is traditionally handled through redundant hardware and comparison algorithms to detect failures. Alternatives like model-based residual generation and data-driven approaches such as supervised fault classification and unsupervised anomaly detection have been explored, but they suffer from practical limitations; model-based methods require accurate system models, and data-driven methods have large constraints on the data limiting scalability and adaptability. This work presents a purely data-driven neural network architecture featuring a custom first layer designed for real-time fault detection where the weights and biases of this layer are used to detect faults. The network requires zero supervision and complements …

Material Reconstruction From Single Image Combining Neural Networks With Singular Value Decomposition, Zhiqiang Li, Xukun Shen, Yong Hu, Xueyang Zhou, Yifan Chen

Journal of System Simulation

Abstract: The tabulated BRDFs (bidirectional reflectance distribution function) can realistically reproduce the surface appearance of objects. However, due to their high-dimensional characteristics and the fact that a single planar image contains limited reflectance information and small differences, methods for estimating tabulated BRDFs typically require complex equipment or the capture of multiple images. To address this issue, a method is proposed for reconstructing material properties from a single image by combining neural networks with singular value decomposition. The singular value decomposition is introduced to compress the material into a lower-dimensional space. The task of solving the tabulated BRDFs is simplified to …

Maxgrnet: A Multi-Axis Vision Transformer With Improved Generalization For Eye Disease Classification Using Explainable Ai With Insertion-Deletion Operations On Fundus Images, Md Mehedi Hasan Santo, Fuyad Hasan Bhoyan, Fuad Ibne Jashim Farhad, Fahmid Al Farid, Sovon Chakraborty, Md Humaion Kabir Mehedi, Jia Uddin, Hezerul Bin Abdul Karim

Computer Science Faculty Publications

Eye diseases, including diabetic retinopathy (DR), glaucoma, and cataracts, represent a major global health concern and can lead to severe visual impairment or blindness if not identified in a timely manner. This study proposes a novel eye disease classification framework based on a multi-axis vision transformer (MaxViT) applied to color fundus images with Explainable Artificial Intelligence (XAI) techniques to enhance model transparency. The proposed architecture integrates transformer-based attention mechanisms with Global Response Normalization (GRN)-based multi-layer perceptron (MLP) layers to capture complex spatial and contextual relationships within fundus images effectively. The model was evaluated on a publicly available eye disease classification …

Explainable Convolutional Neural Network Model Provides An Alternative Genome-Wide Association Perspective On Mutations In Sars-Cov-2, Parisa C. Hatami, Richard Annan, Luis Miranda, Jane L. Gorman, Mengjun Xie, Letu Qingge, Hong Qin

Computer Science Faculty Publications

Identifying informative genomic features in SARS-CoV-2 can help clarify patterns of viral evolution. In this study, we developed an explainable convolutional neural network (CNN) model to classify SARS-CoV-2 genomic sequences into the WHO-designated Variants of Concern (VOCs), Alpha, Beta, Gamma, Delta, and Omicron. Using a balanced dataset of genomes, the classification CNN achieved 99.96% accuracy on the held-out test set. To interpret the model’s predictions, we applied SHapley Additive exPlanations (SHAP) to estimate the contribution of each nucleotide position to VOC-label prediction and compared aggregated attributions with a chi-square GWAS baseline applied to the same categorical labels. SHAP prioritized several …

Synergistic Modeling Of Hydrogel Gelation Via Time-Delay Dynamics And Machine Learning Algorithms, Mine Babaoglu, Dipesh ., Pankaj Kumar, Jagjit Singh Dhatterwal, Mansoor Alsulami

Mathematical Modelling and Numerical Simulation with Applications

This paper presents an integrated framework in which delay differential equation (DDE) modeling and machine learning (ML) approaches are coupled to study hydrogel formation kinetics, with emphasis on delayed crosslinker addition. Conventional mechanistic models disclose many physical and kinetic complexities of reacting mixtures; they seldom depict the nonlinear and time-evolving complexities inherent in developing polymer networks. To address this, a mathematical model is developed that examines how the insertion of crosslinkers affects system stability and equilibrium. Analytical and numerical results show that delays nearing critical levels cause bifurcation behavior with substantial implications on gelation kinetics. Sophisticated machine learning systems, including …

Intelligence Architectures And Machine Learning Applications In Contemporary Spine Care, Rahul Kumar, Conor Dougherty, Kyle Sporn, Akshay Khanna, Puja Ravi, Pranay Prabhakar, Nasif Zaman

SKMC Student Presentations and Publications

The rapid evolution of artificial intelligence (AI) and machine learning (ML) technologies has initiated a paradigm shift in contemporary spine care. This narrative review synthesizes advances across imaging-based diagnostics, surgical planning, genomic risk stratification, and post-operative outcome prediction. We critically assess high-performing AI tools, such as convolutional neural networks for vertebral fracture detection, robotic guidance platforms like Mazor X and ExcelsiusGPS, and deep learning-based morphometric analysis systems. In parallel, we examine the emergence of ambient clinical intelligence and precision pharmacogenomics as enablers of personalized spine care. Notably, genome-wide association studies (GWAS) and polygenic risk scores are enabling a shift from …

Computational Complexity Of Soundness Verification For Neural Networks, Scott Sirri

McKelvey School of Engineering Graduate Student Theses & Dissertations

Neural networks are an increasingly ubiquitous tool in systems of varying complexity across a range of domains. While these tools can be used to learn and predict complex functions, their opaque nature limits the scope of their acceptable applications. In particular, a lack of performance guarantees means that they are unsuitable for safety-critical applications such as self-driving cars and scheduling systems. Neural networks trained to solve NP-complete problems, in particular, are unlikely to be able to solve the problem exactly. However, a weaker soundness guarantee may be sufficient for some systems, e.g., that positive instances of the problem may be …

Identification Of Subtypes Of Post-Stroke And Neurotypical Gait Behaviors Using Neural Network Analysis Of Gait Cycle Kinematics, Andrian Kuch, Nicolas Schweighofer, James M. Finley, Alison Mckenzie, Yuxin Wen, Natalia Sánchez

Physical Therapy Faculty Articles and Research

Gait impairment post-stroke is highly heterogeneous. Prior studies classified heterogeneous gait patterns into subgroups using peak kinematics, kinetics, or spatiotemporal variables. A limitation of this approach is the need to select discrete features in the gait cycle. Using continuous gait cycle data, we accounted for differences in magnitude and timing of kinematics. Here, we propose a machine-learning pipeline combining supervised and unsupervised learning. We first trained a Convolutional Neural Network and a Temporal Convolutional Network to extract features that distinguish impaired from neurotypical gait. Then, we used unsupervised time-series k-means and Gaussian Mixture Models to identify gait clusters. We tested …

Enhancing The Accuracy Of Image Classification For Degenerative Brain Diseases With Cnn Ensemble Models Using Mel-Spectrograms, Sang-Ha Sung, Michael Pokojovy, Do-Young Kang, Woo-Yong Bae, Yeon-Jae Hong, Sangjin Kim

Mathematics & Statistics Faculty Publications

Alzheimer’s disease (AD) and Parkinson’s disease (PD) are prevalent neurodegenerative disorders among the elderly, leading to cognitive decline and motor impairments. As the population ages, the prevalence of these neurodegenerative disorders is increasing, providing motivation for active research in this area. However, most studies are conducted using brain imaging, with relatively few studies utilizing voice data. Using voice data offers advantages in accessibility compared to brain imaging analysis. This study introduces a novel ensemble-based classification model that utilizes Mel spectrograms and Convolutional Neural Networks (CNNs) to distinguish between healthy individuals (NM), AD, and PD patients. A total of 700 voice …

Skinrisk Ai, Spencer Simms

Williams Honors College, Honors Research Projects

SkinRisk AI is an exploration of the opportunities for implementing machine learning (ML) and artificial intelligence (AI) in the medical technology field, specifically in the early detection of skin cancer. This project presents the design, development, and evaluation of a mobile application that allows users to capture images of skin lesions and receive a machine learning assisted risk assessment. The system combines a convolutional neural network (CNN) for image analysis with an intuitive mobile app built using Flutter, FastAPI, and Supabase to deliver real time screening.

Motivated by the rising skin cancer rates and importance of early detection, SkinRisk AI …

Deep Reinforcement Learning With Explicit Context Representation, Francisco Munguia-Galeano, Ah-Hwee Tan, Ze Ji

Research Collection School Of Computing and Information Systems

Though reinforcement learning (RL) has shown an outstanding capability for solving complex computational problems, most RL algorithms lack an explicit method that would allow learning from contextual information. On the other hand, humans often use context to identify patterns and relations among elements in the environment, along with how to avoid making wrong actions. However, what may seem like an obviously wrong decision from a human perspective could take hundreds of steps for an RL agent to learn to avoid. This article proposes a framework for discrete environments called Iota explicit context representation (IECR). The framework involves representing each state …

Gramseq-Dta: A Grammar-Based Drug-Target Affinity Prediction Approach Fusing Gene Expression Information, Kasul Debnath, Pratip Rana, Preetam Ghosh

Computer Science Faculty Publications

Drug–target affinity (DTA) prediction is a critical aspect of drug discovery. The meaningful representation of drugs and targets is crucial for accurate prediction. Using 1D string-based representations for drugs and targets is a common approach that has demonstrated good results in drug–target affinity prediction. However, these approach lacks information on the relative position of the atoms and bonds. To address this limitation, graph-based representations have been used to some extent. However, solely considering the structural aspect of drugs and targets may be insufficient for accurate DTA prediction. Integrating the functional aspect of these drugs at the genetic level can enhance …

Key Brain Region Identification In Obesity Prediction With Structural Mri And Probabilistic Uncertainty Aware Model, Walia Farzana, Megan A. Witherow, Ahmed Temtam, Liangsuo Ma, Melanie Bean, F. Gerry Moeller, K. M. Iftekharuddin

Electrical & Computer Engineering Faculty Publications

Objectives/Goals: Predictive performance alone may not determine a model’s clinical utility. Neurobiological changes in obesity alter brain structures, but traditional voxel-based morphometry is limited to group-level analysis. We propose a probabilistic model with uncertainty heatmaps to improve interpretability and personalized prediction. Methods/Study Population: The data for this study are sourced from the Human Connectome Project (HCP), with approval from the Washington University in St. Louis Institutional Review Board. We preprocessed raw T1-weighted structural MRI scans from 525 patients using an automated pipeline. The dataset is divided into training (357 cases), calibration (63 cases), and testing (105 cases). Our probabilistic model …

Adaptive Fusion Neural Networks For Sparse-Angle X-Ray 3d Reconstruction, Shaoyong Hong, Bo Yang, Yan Chen, Hao Quan, Shan Liu, Minyi Tang, Jiawei Tian

Electrical & Computer Engineering Faculty Publications

3D medical image reconstruction has significantly enhanced diagnostic accuracy, yet the reliance on densely sampled projection data remains a major limitation in clinical practice. Sparse-angle X-ray imaging, though safer and faster, poses challenges for accurate volumetric reconstruction due to limited spatial information. This study proposes a 3D reconstruction neural network based on adaptive weight fusion (AdapFusionNet) to achieve high-quality 3D medical image reconstruction from sparse-angle X-ray images. To address the issue of spatial inconsistency in multi-angle image reconstruction, an innovative adaptive fusion module was designed to score initial reconstruction results during the inference stage and perform weighted fusion, thereby improving …

Decoding Neural Networks: An Information-Theoretic Guide To Interpretability, Error Analysis And Efficiency, Mackenzie J. Meni

Theses and Dissertations

This dissertation addresses critical challenges in neural network design by leveraging entropy-based techniques to improve model efficiency, interpretability, and bias reduction. Focusing on the unique demands of computer vision applications, particularly object detection and classification for real-time systems, this work introduces a series of innovative methods centered on information theory. At the core of these methods is the Probabilistic Explanations of Entropic Knowledge (PEEK) framework, a tool developed to analyze and visualize entropy distributions across feature maps. PEEK offers insights into information flow within neural networks, making it possible to pinpoint layers that contribute meaningfully to decision-making or identify those …

Latent Representation Learning For Geospatial Entities, Ween Jiann Lee, Hady Wirawan Lauw

Research Collection School Of Computing and Information Systems

Representation learning has been instrumental in the success of machine learning, offering compact and performant data representations for diverse downstream tasks. In the spatial domain, it has been pivotal in extracting latent patterns from various data types, including points, polylines, polygons, and networked structures. However, existing approaches often fall short of explicitly capturing both semantic and spatial information, relying on proxies and synthetic features. This article presents GeoNN, a novel graph neural network-based model designed to learn spatially-aware embeddings for geospatial entities. GeoNN leverages edge features generated from geodesic functions, dynamically selecting relevant features based on relative locations. It introduces …

High Prevalence Of Artifacts In Optical Coherence Tomography With Adequate Signal Strength, Wei-Chun Lin, Aaron Coyner, Charles Amankwa, Abigail Lucero, Gadi Wollstein, Joel Schuman, Hiroshi Ishikawa

Wills Eye Hospital Papers

PURPOSE: This study aims to investigate the prevalence of artifacts in optical coherence tomography (OCT) images with acceptable signal strength and evaluate the performance of supervised deep learning models in improving OCT image quality assessment.

METHODS: We conducted a retrospective study on 4555 OCT images from 546 patients, with each image having an acceptable signal strength (≥6). A comprehensive analysis of prevalent OCT artifacts was performed, and five pretrained convolutional neural network models were trained and tested to infer images based on quality.

RESULTS: Our results showed a high prevalence of artifacts in OCT images with acceptable signal strength. Approximately …

Achieving Domain-Independent Certified Robustness Via Knowledge Continuity, Alan Wenyuan Sun

Computer Science Senior Theses

We present knowledge continuity, a novel definition inspired by Lipschitz continuity which aims to certify the robustness of neural networks across input domains (such as continuous and discrete domains in vision and language, respectively). Most existing approaches that seek to certify robustness, especially Lipschitz continuity, lie within the continuous domain with norm and distribution-dependent guarantees. In contrast, our proposed definition yields certification guarantees that depend only on the loss function and the intermediate learned metric spaces of the neural network. These bounds are independent of domain modality, norms, and distribution. We further demonstrate that the expressiveness of a model …

Text-Attributed Graph Representation Learning : Methods, Applications, And Challenges, Ce Zhang, Menglin Yang, Rex Ying, Hady Wirawan Lauw

Research Collection School Of Computing and Information Systems

Text documents are usually connected in a graph structure, resulting in an important class of data named text-attributed graph, e.g., paper citation graph and Web page hyperlink graph. On the one hand, Graph Neural Networks (GNNs) consider text in each document as general vertex attribute and do not specifically deal with text data. On the other hand, Pre-trained Language Models (PLMs) and Topic Models (TMs) learn effective document embeddings. However, most models focus on text content in each single document only, ignoring link adjacency across documents. The above two challenges motivate the development of text-attributed graph representation learning, combining GNNs …

Mathematically Rigorous Deep Learning Paradigms For Data-Driven Scientific Modeling, Owen Nicholas Davis

Mathematics & Statistics ETDs

This dissertation explores the crucial role of data-driven modeling in science and engineering, with a focus on developing surrogate models to accelerate large-scale computational tasks, aiding in both outer-loop functions like uncertainty quantification and expensive inner-loop tasks within broader computational frameworks. Challenges arise with increased problem dimension and sparse, noisy training data, particularly significant when constructing surrogates for very expensive computational models where acquiring sufficient high-fidelity training data is unfeasible. In such scenarios, training surrogates from an ensemble of multifidelity information sources of varying accuracy and cost becomes essential. We emphasize neural network-based modeling paradigms, which are flexible in integrating …

Conditional Neural Heuristic For Multiobjective Vehicle Routing Problems, Mingfeng Fan, Yaoxin Wu, Zhiguang Cao, Wen Song, Guillaume Sartoretti, Huan Liu, Guohua Wu

Research Collection School Of Computing and Information Systems

Existing neural heuristics for multiobjective vehicle routing problems (MOVRPs) are primarily conditioned on instance context, which failed to appropriately exploit preference and problem size, thus holding back the performance. To thoroughly unleash the potential, we propose a novel conditional neural heuristic (CNH) that fully leverages the instance context, preference, and size with an encoder–decoder structured policy network. Particularly, in our CNH, we design a dual-attention-based encoder to relate preferences and instance contexts, so as to better capture their joint effect on approximating the exact Pareto front (PF). We also design a size-aware decoder based on the sinusoidal encoding to explicitly …

Latent Space Dynamics Learning For Stiff Collisional-Radiative Models, Xuping Xie, Qi Tang, Xianzhu Tang

Mathematics & Statistics Faculty Publications

In this work, we propose a data-driven method to discover the latent space and learn the corresponding latent dynamics for a collisional-radiative (CR) model in radiative plasma simulations. The CR model, consisting of high-dimensional stiff ordinary differential equations, must be solved at each grid point in the configuration space, leading to significant computational costs in plasma simulations. Our method employs a physics-assisted autoencoder to extract a low-dimensional latent representation of the original CR system. A flow map neural network is then used to learn the latent dynamics. Once trained, the reduced surrogate model predicts the entire latent dynamics given only …

On Generative Models And Joint Architectures For Document-Level Relation Extraction, Aviv Brokman

Theses and Dissertations--Statistics

Biomedical text is being generated at a high rate in scientific literature publications and electronic health records. Within these documents lies a wealth of potentially useful information in biomedicine. Relation extraction (RE), the process of automating the identification of structured relationships between entities within text, represents a highly sought-after goal in biomedical informatics, offering the potential to unlock deeper insights and connections from this vast corpus of data. In this dissertation, we tackle this problem with a variety of approaches.

We review the recent history of the field of document-level RE. Several themes emerge. First, graph neural networks dominate the …

Deep Transfer Learning-Based Bird Species Classification Using Mel Spectrogram Images, Mrinal Kanti Baowaly, Bisnu Chandra Sarkar, Md.Abul Ala Walid, Md. Martuza Ahamad, Bikash Chandra Singh, Eduardo Silva Alvarado, Imran Ashraf, Md. Abdus Samad

School of Cybersecurity Faculty Publications

The classification of bird species is of significant importance in the field of ornithology, as it plays an important role in assessing and monitoring environmental dynamics, including habitat modifications, migratory behaviors, levels of pollution, and disease occurrences. Traditional methods of bird classification, such as visual identification, were time-intensive and required a high level of expertise. However, audio-based bird species classification is a promising approach that can be used to automate bird species identification. This study aims to establish an audio-based bird species classification system for 264 Eastern African bird species employing modified deep transfer learning. In particular, the pre-trained EfficientNet …

Classification Of Instructional Activities In Classroom Videos Using Neural Networks, Jonathan K. Foster, Matthew Korban, Peter Youngs, Ginger S. Watson, Scott T. Acton

VMASC Publications

Classroom videos have become an integral part of classroom observation and instructional quality studies. Researchers encounter substantial financial and time-consuming costs gathering trained personnel to catalogue and analyze a large quantity (i.e., hundreds of hours) of classroom videos. In this chapter, we argue that deep-learning neural networks have potential to help with these tasks by detecting features of instruction in videos. We evaluated the performance of three neural networks in detecting instructional activities in classroom videos. The video dataset included a total of forty-six hours, which was evenly split between elementary mathematics and English language arts lesson recordings. Results showed …

Automatic Classification Of Activities In Classroom Videos, Jonathan K. Foster, Matthew Korban, Peter Youngs, Ginger S. Watson, Scott T. Acton

VMASC Publications

Classroom videos are a common source of data for educational researchers studying classroom interactions as well as a resource for teacher education and professional development. Over the last several decades emerging technologies have been applied to classroom videos to record, transcribe, and analyze classroom interactions. With the rise of machine learning, we report on the development and validation of neural networks to classify instructional activities using video signals, without analyzing speech or audio features, from a large corpus of nearly 250 h of classroom videos from elementary mathematics and English language arts instruction. Results indicated that the neural networks performed …

Advancing Household Robotics: Deep Interactive Reinforcement Learning For Efficient Training And Enhanced Performance, Arpita Soni, Sujatha Alla, Suresh Dodda, Hemanth Volikatla

Engineering Management & Systems Engineering Faculty Publications

The market for domestic robots—made to perform household chore, is growing as these robots relieve people of everyday responsibilities. Domestic robots are generally welcomed for their role in easing human labour, in contrast to industrial robots, which are frequently criticised for displacing human workers. But before these robots can carry out domestic chores, they need to become proficient in a number of minor activities, such as recognizing their surroundings, making decisions, and picking up on human behaviours. Reinforcement learning, or RL, has emerged as a key robotics technology that enables robots to interact with their environment and learn how to …

Identifying New Cancer Genes Based On The Integration Of Annotated Gene Sets Via Hypergraph Neural Networks, Chao Deng, Hong-Dong Li, Li-Shen Zhang, Yiwei Liu, Yaohang Li, Jianxin Wang

Computer Science Faculty Publications

Motivation

Identifying cancer genes remains a significant challenge in cancer genomics research. Annotated gene sets encode functional associations among multiple genes, and cancer genes have been shown to cluster in hallmark signaling pathways and biological processes. The knowledge of annotated gene sets is critical for discovering cancer genes but remains to be fully exploited.

Results

Here, we present the DIsease-Specific Hypergraph neural network (DISHyper), a hypergraph-based computational method that integrates the knowledge from multiple types of annotated gene sets to predict cancer genes. First, our benchmark results demonstrate that DISHyper outperforms the existing state-of-the-art methods and highlight the advantages of …

Bayesian Neural Netwok Variational Autoencoder Inverse Mapper (Bnn-Vaim) And Its Application In Compton Form Factors Extraction, Md Fayaz Bin Hossen, Tareq Alghamdi, Manal Almaeen, Yaohang Li

Computer Science Faculty Publications

We extend the Variational Autoencoder Inverse Mapper (VAIM) framework for the inverse problem of extracting Compton Form Factors (CFFs) from deeply virtual exclusive reactions, such as the unpolarized Deeply virtual exclusive scattering (DVCS) cross section. VAIM is an end-to-end deep learning framework to address the solution ambiguity issue in ill-posed inverse problems, which comprises of a forward mapper and a backward mapper to simulate the forward and inverse processes, respectively. In particular, we incorporate Bayesian Neural Network (BNN) into the VAIM architecture (BNN-VAIM) for uncertainty quantification. By sampling the weights and biases distributions of the BNN in the backward mapper …