Artificial Intelligence and Robotics Commons^™

Multimodal Representation Learning For Face Understanding: From Caption Supervision To Foundation Model Adaptation, Md Mahedi Hasan

Graduate Theses, Dissertations, and Problem Reports (ETD)

The rapid advancement of intelligent surveillance systems and the increasing demand for reliable biometric identification in border security, public safety, and digital forensics require robust face understanding under unconstrained conditions, including low resolution, pose variation, and occlusion. While Vision Transformer (ViT)-based foundation models have greatly improved visual representation learning, their patch-based tokenization and lack of spatial inductive bias limit their ability to capture fine-grained details in low-resolution inputs. This dissertation investigates multimodal representation learning for face understanding through natural language supervision, large-scale face-caption pre-training, and parameter-efficient foundation model adaptation. It hypothesizes that textual supervision provides complementary semantic cues that improve …

Deep Learning-Based Co-Current Upward Gas-Liquid Two-Phase Flow Regime Identification In An Annular Conduit, Joshua Robert Macomber

Graduate Theses, Dissertations, and Problem Reports (ETD)

Flow regime identification in co-current upward gas-liquid flow through annular conduits remains a significant challenge in petroleum engineering, with major safety and operational implications. It is also important across industries involving the transport of multiphase fluids. Misidentifying flow regimes can introduce major operational risk, yet regime boundaries in annular gas-liquid flow are often visually complex and context dependent.

The objective of this study was to evaluate the utility of convolutional neural network (CNN) classifiers for flow regime identification. The CNN was trained using annular flow image dataset published by Texas A&M University. The dataset consists of approximately 947 RGB images …

Neural And Computational Approach To Understanding Environmental Modulation Of Behavioral Identity In Zebrafish, John W. Hageter

Graduate Theses, Dissertations, and Problem Reports (ETD)

Organisms rely on behavior for survival. Animals engage in behaviors that allow for feeding, mating, exploring and navigating their environment among others. Necessary for these behaviors to develop are the environmental factors and underlying circuitry which make behavior possible. Specifically, how the environment guides underlying neural circuitry to develop unique facets or phenotypes of a larger behavior are key to understanding why unique behaviors exist. In this thesis, I build foundational evidence for determining these mechanisms through the use of the zebrafish local search behavior. This is a behavior that zebrafish employ following the loss of environmental illumination where they …

Using Visual Prompts To Analyze Ejection Fraction In Echocardiograms, Kevin Reisch

Graduate Theses, Dissertations, and Problem Reports (ETD)

Left ventricular ejection fraction (LVEF) is a critical biomarker for heart failure, but manual estimation from echocardiograms is time-consuming. Artificial intelligence can be used to accelerate this process, allowing clinicians to focus on other critical tasks. Current methods typically train models from scratch on echocardiogram datasets; however, this approach is limited by the scarcity of large medical imaging datasets, which are expensive and difficult to acquire. We present a transfer learning approach that leverages pretrained models from massive datasets, enabling continuous improvement as foundation models advance. Our method employs visual prompting to generate trainable masks for echocardiogram videos, transforming the …

Applications Of Deep Learning For Optimizing Fingerphoto And Latent Fingerprint Biometrics, Amol Sanjay Joshi

Graduate Theses, Dissertations, and Problem Reports (ETD)

Fingerprint-based biometric recognition remains one of the most dependable and widely adopted approaches for identity verification due to its permanence and distinctiveness. Recent advancements in mobile and contactless imaging have extended fingerprint acquisition beyond controlled environments into unconstrained, real-world conditions through fingerphotos, contactless fingerprint images captured by digital or smartphone cameras. While this paradigm shift enhances accessibility and user convenience, it introduces significant technical challenges. Variations in illumination, focus, and motion blur often degrade ridge patterns, making accurate feature extraction and matching more difficult. Similarly, in forensic applications, latent fingerprints, incomplete or smudged prints lifted from surfaces, pose unique challenges …

The Effect Of Facial Phenotypes On Differential Performance Of Facial Recognition, Evan R. Garrett

Graduate Theses, Dissertations, and Problem Reports (ETD)

Facial recognition technology is utilized in many facets of life. As the use has become more widespread these systems have improved in reliability and performance approaching the level of human accuracy. With these improvements the problem of bias still remains as a persistent problem. Efforts have been made to minimize the bias prevalent in the systems via studies into various demographic factors, creating training datasets that have a more uniform distribution of subjects, and other methods. As facial recognition is one of the most utilized forms of biometric recognition it is vital to analyze potential causes of bias to help …

Implementing Unmanned Aerial Vehicles To Collect Human Gait Data At Distance And Altitude For Identification And Re-Identification, Donn E. Bartram

Graduate Theses, Dissertations, and Problem Reports (ETD)

Gait patterns are a class of biometric information pertaining to the way a person moves and poses. Gait information is unique to each person and can be used to identify and reidentify people. Historically, this task has been achieved through the use of multiple ground-based imaging sensors. However, as Unmanned Aerial Vehicles (UAVs) advance, they present the opportunity to evolve the process of persons identification and re-identification. Collecting human gait data using UAVs at distances ranging from 20m to 500m and altitudes ranging from 0m to 120m is a challenging task. The current biometric data collection methods, primarily designed for …

Foraging Economies: A Market Based Methodology For Robotic Swarm Foraging, John A. Little

Graduate Theses, Dissertations, and Problem Reports (ETD)

Swarm robotics involves coordinating large groups of autonomous agents to accomplish complex tasks through decentralized, adaptive behaviors, providing a robust and scalable approach suited to dynamic and unpredictable environments. While traditional swarm models frequently draw inspiration from biological systems such as ant colonies or bee foraging, other approaches use techniques from physics, control theory, and economics to achieve effective coordination. This study distinguishes itself by applying economic principles—specifically, market-driven mechanisms like auctions, utility functions based on opportunity cost, and supply-demand dynamics based on fluctuating resource values at a central base—to improve task allocation within a swarm foraging context. This approach …

Machine Learning Based Intrusion Detection Framework For Can Bus Vulnerabilities In Modern Vehicles, Obinna C. Agbo

Graduate Theses, Dissertations, and Problem Reports (ETD)

The Controller Area Network (CAN) bus is a crucial communication backbone in modern vehicles, connecting various Electronic Control Units (ECUs). However, inherent design weaknesses such as the lack of encryption and authentication make CAN networks vulnerable to cyber-attacks, including spoofing, Denial of Service (DoS), and fuzzing attacks. This thesis thoroughly evaluates these vulnerabilities and the limitations of existing security frameworks like Message Authentication Codes (MACs) and encryption, advocating for the adoption of Intrusion Detection Systems (IDS) as a more practical solution for CAN bus security. The proposed IDS leverages advanced machine learning techniques to accurately detect intrusions, even under complex …

A Self-Supervised Knowledge Distillation Approach To Anomaly Detection In X-Ray Imagery, Kaden Quinn Mceldowney

Graduate Theses, Dissertations, and Problem Reports (ETD)

Many cargo containers enter the United States every day by truck, rail, and sea. As a result of the large number of cargo containers entering the United States, not all of them can be thoroughly inspected. Most of these containers contain properly documented and legal cargo, but some people take advantage of this situation by hiding illicit items in the cargo containers such as drugs. To more efficiently and thoroughly inspect cargo containers, Customs and Border Protection (CBP) uses X-ray imaging machines to obtain images that reveal the interior of cargo containers. These X-ray images must be inspected to ensure …

Efficient Classification Of Very High Resolution Images, Mohammad I. Nouyed

Graduate Theses, Dissertations, and Problem Reports (ETD)

In recent decades, deep learning approaches have shown significant improvement in various image understanding tasks. However, analysis of high-resolution images remains a major challenge. In this work, we address the challenge of very high-resolution histopathological image (VHRHI) classification using a new information-theoretic discriminative patch selection approach. We show results on a high-resolution image dataset, namely, gigapixel whole slide tissue images for cancer tumors. Then we address how to efficiently classify challenging histopathology images, such as gigapixel whole-slide images for cancer diagnostics with image-level annotation. These ``weak labels'' are applied throughout the image but describe tumor regions of variable sizes and …

Machine Learning And Rna Bioinformatics, Jason Rafe Miller

Graduate Theses, Dissertations, and Problem Reports (ETD)

The applied science of bioinformatics encompasses computational analysis of molecular biology data. Advances in genomics and DNA sequencing technology have enabled computational analysis of ribonucleic acids (RNAs), which play diverse and critical roles in most cells. To assist the study of human RNA, we trained machine learning models on RNA nucleotide sequences, devoid of domain knowledge. We built models that distinguish long non-coding lncRNA from protein-coding mRNA, and models that predict the cytoplasmic vs. nuclear preferences of lncRNAs. In a review of published lncRNA subcellular localization classifiers, we show that the commonly used validation protocol generates optimistic performance measures, and …

Advanced Techniques In Time Series Forecasting: From Deterministic Models To Deep Learning, Xue Bai

Graduate Theses, Dissertations, and Problem Reports (ETD)

This dissertation discusses three instances of temporal prediction, applied to population dynamics and deep learning.

In population modeling, dynamic processes are frequently represented by systems of differential equations, allowing for the analysis of various phenomena. The first application explores modeling cloned hematopoiesis in chronic myeloid leukemia (CML) via a nonlinear system of differential equations. By tracking the evolution of different cell compartments, including cycling and quiescent stem cells, progenitor cells, differentiated cells, and terminally differentiated cells, the model captures the transition from normal hematopoiesis to the chronic and accelerated-acute phases of CML. Three distinct non-zero steady states are identified, representing …

Investigation Of Space Charge Effects On Co2 Electrocatalytic Reduction On Gd-Doped Ceria Via Scanning Kelvin Probe And Model-Based Bayesian Analysis, Alejandro Mejia

Graduate Theses, Dissertations, and Problem Reports (ETD)

In studying novel energy conversion and storage systems, such as high-temperature electrolysis, numerous underlying fundamental physical processes remain unclear or inadequately understood. Among these, the modeling and comprehension of surface reaction mechanisms, coupled with the intricate effects of space‑charge interfaces, remains an unclear and challenging area of research.

The work of this dissertation involves the development of a 2D finite element analysis model, leveraging the robust MOOSE framework from INL. This model, featuring inhomogeneous defect thermodynamics for near-surface chemistry, formulated through Poisson‑Cahn variational theory, has been exploited for studying the electrocatalytic reduction of CO₂ on gadolinia doped ceria. The …

Exploiting The Advantages And Overcoming The Challenges Of The Cable In A Tethered Drone System, Rogerio Rodrigues Lima

Graduate Theses, Dissertations, and Problem Reports (ETD)

This dissertation proposes solutions for motion planning, localization, and landing of tethered drones using only tether variables. A tether-based multi-model localization framework for tethered drones is proposed. This framework comprises three independent localization strategies based on a different model. The first strategy uses simple trigonometric relations assuming that the tether is taut; the second method relies on a set of catenary equations for the slack tether case; the third estimator is a neural network-based predictor that can cover different tether shapes. Multi-layer perceptron networks previously trained with a dataset comprised of the tether variables (i.e., length, tether angles on the …

Multimodal Neuron Classification Based On Morphology And Electrophysiology, Aqib Ahmad

Graduate Theses, Dissertations, and Problem Reports (ETD)

Categorizing neurons into different types to understand neural circuits and ultimately brain function is a major challenge in neuroscience. While electrical properties are critical in defining a neuron, its morphology is equally important. Advancements in single-cell analysis methods have allowed neuroscientists to simultaneously capture multiple data modalities from a neuron. We propose a method to classify neurons using both morphological structure and electrophysiology. Current approaches are based on a limited analysis of morphological features. We propose to use a new graph neural network to learn representations that more comprehensively account for the complexity of the shape of neuronal structures. In …

Sequence Checking And Deduplication For Existing Fingerprint Databases, Tahsin Islam Sakif

Graduate Theses, Dissertations, and Problem Reports (ETD)

Biometric technology is a rapidly evolving field with applications that range from access to devices to border crossing and entry/exit processes. Large-scale applications to collect biometric data, such as border crossings result in multimodal biometric databases containing thousands of identities. However, due to human operator error, these databases often contain many instances of image labeling and classification; this is due to the lack of training and throughput pressure that comes with human error. Multiple entries from the same individual may be assigned to a different identity. Rolled fingerprints may be labeled as flat images, a face image entered into a …

Development Of Machine Learning Based Approach To Predict Fuel Consumption And Maintenance Cost Of Heavy-Duty Vehicles Using Diesel And Alternative Fuels, Sasanka Katreddi

Graduate Theses, Dissertations, and Problem Reports (ETD)

One of the major contributors of human-made greenhouse gases (GHG) namely carbon dioxide (CO2), methane (CH4), and nitrous oxide (NOX) in the transportation sector and heavy-duty vehicles (HDV) contributing to about 27% of the overall fraction. In addition to the rapid increase in global temperature, airborne pollutants from diesel vehicles also present a risk to human health. Even a small improvement that could potentially drive energy savings to the century-old mature diesel technology could yield a significant impact on minimizing greenhouse gas emissions. With the increasing focus on reducing emissions and operating costs, there is a need for efficient and …

Generative Prior For Unsupervised Image Restoration, Ahmed Cheikh Sidiya

Graduate Theses, Dissertations, and Problem Reports (ETD)

The challenge of restoring real world low-quality images is due to a lack of appropriate training data and difficulty in determining how the image was degraded. Recently, generative models have demonstrated great potential for creating high- quality images by utilizing the rich and diverse information contained within the model’s trained weights and learned latent representations. One popular type of generative model is the generative adversarial network (GAN). Many new methods have been developed to harness the information found in GANs for image manipulation. Our proposed approach is to utilize generative models for both understanding the degradation of an image and …

An Analysis On Adversarial Machine Learning: Methods And Applications, Ali Dabouei

Graduate Theses, Dissertations, and Problem Reports (ETD)

Deep learning has witnessed astonishing advancement in the last decade and revolutionized many fields ranging from computer vision to natural language processing. A prominent field of research that enabled such achievements is adversarial learning, investigating the behavior and functionality of a learning model in presence of an adversary. Adversarial learning consists of two major trends. The first trend analyzes the susceptibility of machine learning models to manipulation in the decision-making process and aims to improve the robustness to such manipulations. The second trend exploits adversarial games between components of the model to enhance the learning process. This dissertation aims to …

Application Of Artificial Intelligence For Co2 Storage In Saline Aquifer (Smart Proxy For Snap-Shot In Time), Marwan Mohammed Alnuaimi

Graduate Theses, Dissertations, and Problem Reports (ETD)

In recent years, artificial intelligence (AI) and machine learning (ML) technology have grown in popularity. Smart Proxy Models (SPM) are AI/ML based data-driven models which have proven to be quite crucial in petroleum engineering domain with abundant data, or operations in which large surface/ subsurface volume of data is generated. Climate change mitigation is one application of such technology to simulate and monitor CO2 injection into underground formations.

The goal of the SPM developed in this study is to replicate the results (in terms of pressure and saturation outputs) of the numerical reservoir simulation model (CMG) for CO2 injection into …

A Domain Adaptation Approach For Segmenting Cell Instances In Microscopy Data, Matthew R. Keaton

Graduate Theses, Dissertations, and Problem Reports (ETD)

Automated cellular instance segmentation is a process that has been utilized for accelerating biological research since before the deep learning era, and recent advancements have produced higher quality results with less effort from the biologist. Most current endeavors focus on completely cutting the researcher out of the picture by generating highly generalized models. However, these models invariably fail when faced with novel data and effectively opt to miss out on the full capabilities of deep learning in pursuit of this goal. In our work, we demonstrate how, with even a minimal amount of annotated data, dominant approaches in this space …

Generation Of High Performing Morph Datasets, Kelsey Lynn O'Haire

Graduate Theses, Dissertations, and Problem Reports (ETD)

Facial recognition systems play a vital role in our everyday lives. We rely on this technology from menial tasks to issues as vital as national security. While strides have been made over the past ten years to improve facial recognition systems, morphed face images are a viable threat to the reliability of these systems. Morphed images are generated by combining the face images of two subjects. The resulting morphed face shares the likeness of the contributing subjects, confusing both humans and face verification algorithms. This vulnerability has grave consequences for facial recognition systems used on international borders or for law …

Classifying Blood Glucose Levels Through Noninvasive Features, Rishi Reddy

Graduate Theses, Dissertations, and Problem Reports (ETD)

Blood glucose monitoring is a key process in the prevention and management of certain chronic diseases, such as diabetes. Currently, glucose monitoring for those interested in their blood glucose levels are confronted with options that are primarily invasive and relatively costly. A growing topic of note is the development of non-invasive monitoring methods for blood glucose. This development holds a significant promise for improvement to the quality of life of a significant portion of the population and is overall met with great enthusiasm from the scientific community as well as commercial interest. This work aims to develop a potential pipeline …

Deep Learning Detection In The Visible And Radio Spectrums, Greg Clancy Murray

Graduate Theses, Dissertations, and Problem Reports (ETD)

Deep learning models with convolutional neural networks are being used to solve some of the most difficult problems in computing today. Complicating factors to the use and development of deep learning models include lack of availability of large volumes of data, lack of problem specific samples, and the lack variations in the specific samples available. The costs to collect this data and to compute the models for the task of detection remains a inhibitory condition for all but the most well funded organizations. This thesis seeks to approach deep learning from a cost reduction and hybrid perspective — incorporating techniques …

Ensemble Encoder-Decoder Models For Predicting Land Transformation, Pariya Pourmohammadi

Graduate Theses, Dissertations, and Problem Reports (ETD)

In studying dynamic and complex processes which are influenced by a system of inter-connected driving variables, it is crucial to apply models that can learn the complexity of the interactions. Land transformation is one of such complex processes, prediction of which can help to mitigate severe climate situations and improve the resiliency of communities. In this study, a multi-spectral set of data cubes is used to capture various characteristics of a geographic region. Based on the data cube, a feature space is constructed using socio-economic attributes, terrain characteristics, and landscape traits of the study region. Two-dimensional and three-dimensional convolutional neural …

Association Of Incident Cancer To Low-Value Care And Healthcare Cost Burden Among Elderly Medicare Beneficiaries, Chibuzo Iloabuchi

Graduate Theses, Dissertations, and Problem Reports (ETD)

In the United States (US), 25% of healthcare spending is considered wasteful because it is spent reimbursing low-value care. Low-value care is the utilization of healthcare services, medical tests, and procedures that have unclear or no clinical benefit to patients but still exposes them to risk. World-wide, low-value care imposes a significant economic burden on patients, payers, governments, and society. Cancer care among older adults > 65 years is one of the biggest drivers of healthcare expenditure in the US and accounts for nearly 40% of all spending, and low-value care among cancer patients is prevalent and contributes to the financial …

Deep Fingerprint Matching From Contactless To Contact Fingerprints For Increased Interoperability, Alexander James Wilson

Graduate Theses, Dissertations, and Problem Reports (ETD)

Contactless fingerprint matching is a common form of biometric security today. Most smartphones and associated apps now let users opt into using this form of biometric security. However, it’s difficult to match a finger-photo to a fingerprint because of perspective distortion occurring at the edges of the finger-photo, so direct matching using conventional methods will not be as accurate due to a lack of sufficient matching minutiae points. To address this issue, we propose a deep model, Perspective Distortion Rectification Model (PDRM), to estimate the fingerprint correspondence for finger-photo images in order to recover more minutiae points. Not only do …

Single And Differential Morph Attack Detection, Baaria Chaudhary

Graduate Theses, Dissertations, and Problem Reports (ETD)

Face recognition systems operate on the assumption that a person's face serves as the unique link to their identity. In this thesis, we explore the problem of morph attacks, which have become a viable threat to face verification scenarios precisely because of their inherent ability to break this unique link. A morph attack occurs when two people who share similar facial features morph their faces together such that the resulting face image is recognized as either of two contributing individuals. Morphs inherit enough visual features from both individuals that both humans and automatic algorithms confuse them. The contributions of this …

Identification And Classification Of Radio Pulsar Signals Using Machine Learning, Di Pang

Graduate Theses, Dissertations, and Problem Reports (ETD)

Automated single-pulse search approaches are necessary as ever-increasing amount of observed data makes the manual inspection impractical. Detecting radio pulsars using single-pulse searches, however, is a challenging problem for machine learning because pul- sar signals often vary significantly in brightness, width, and shape and are only detected in a small fraction of observed data.

The research work presented in this dissertation is focused on development of ma- chine learning algorithms and approaches for single-pulse searches in the time domain. Specifically, (1) We developed a two-stage single-pulse search approach, named Single- Pulse Event Group IDentification (SPEGID), which automatically identifies and clas- …