Digital Commons Network^™

Multimodal Learning For Visual Perception And Robotic Action, Taisei Hanyu

Electrical Engineering and Computer Science Undergraduate Honors Theses

Multimodal learning aims to weave information from images, language, depth, and other sensors into one coherent representation, much as people naturally combine sight, speech, and sound. Progress toward that goal is slowed by three gaps: vision encoders that cannot balance crisp object boundaries with global context, 3-D semantic maps that are computationally prohibitive for real-time, open-vocabulary queries, and vision-language-action pipelines that depend on large token pools with weak relational grounding.

We first introduce AerialFormer, a lightweight hybrid of convolutional and Transformer layers that captures long-range structure without sacrificing fine detail. On the large-scale iSAID benchmark it reaches 69.3% mean IoU, …

Rotation-Adaptive Point Cloud Domain Generalization Via Intricate Orientation Learning, Bangzhen Liu, Chenxi Zheng, Xuemiao Xu, Cheng Xu, Huaidong Zhang, Shengfeng He

Research Collection School Of Computing and Information Systems

The vulnerability of 3D point cloud analysis to unpredictable rotations poses an open yet challenging problem: orientation-aware 3D domain generalization. Cross-domain robustness and adaptability of 3D representations are crucial but not easily achieved through rotation augmentation. Motivated by the inherent advantages of intricate orientations in enhancing generalizability, we propose an innovative rotation-adaptive domain generalization framework for 3D point cloud analysis. Our approach aims to alleviate orientational shifts by leveraging intricate samples in an iterative learning process. Specifically, we identify the most challenging rotation for each point cloud and construct an intricate orientation set by optimizing intricate orientations. Subsequently, we employ …

Worldcuisines: A Massive-Scale Benchmark For Multilingual And Multicultural Visual Question Answering On Global Cuisines, Genta Indra Winata, Et. Al

Research Collection School Of Computing and Information Systems

Vision Language Models (VLMs) often struggle with culture-specific knowledge, particularly in languages other than English and in underrepresented cultural contexts. To evaluate their understanding of such knowledge, we introduce WorldCuisines, a massive-scale benchmark for multilingual and multicultural, visually grounded language understanding. This benchmark includes a visual question answering (VQA) dataset with text-image pairs across 30 languages and dialects, spanning 9 language families and featuring over 1 million data points, making it the largest multicultural VQA benchmark to date. It includes tasks for identifying dish names and their origins. We provide evaluation datasets in two sizes (12k and 60k instances) alongside …

Reverse Modeling In Large Language Models, Sicheng Yu, Yuanchen Xu, Cunxiao Du, Yanying Zhou, Minghui Qiu, Qianru Sun, Hao Zhang, Jiawei Wu

Research Collection School Of Computing and Information Systems

Humans are accustomed to reading and writing in a forward manner, and this natural bias extends to text understanding in auto-regressive large language models (LLMs). This paper investigates whether LLMs, like humans, struggle with reverse modeling, specifically with reversed text inputs. We found that publicly available pre-trained LLMs cannot understand such inputs. However, LLMs trained from scratch with both forward and reverse texts can understand them equally well during inference. Our case study shows that different-content texts result in different losses if input (to LLMs) in different directions---some get lower losses for forward while some for reverse. This leads us …

Query Understanding In Llm-Based Conversational Information Seeking, Yifei Yuan, Zahra Abbasiantaeb, Yang Deng, Mohammad Aliannejadi

Research Collection School Of Computing and Information Systems

Query understanding in Conversational Information Seeking (CIS) involves accurately interpreting user intent through context-aware interactions. This includes resolving ambiguities, refining queries, and adapting to evolving information needs. Large Language Models (LLMs) enhance this process by interpreting nuanced language and adapting dynamically, improving the relevance and precision of search results in real-time. In this tutorial, we explore advanced techniques to enhance query understanding in LLM-based CIS systems. We delve into LLM-driven methods for developing robust evaluation metrics to assess query understanding quality in multiturn interactions, strategies for building more interactive systems, and applications like proactive query management and query reformulation. We …

Multiobjective Linear Ensembles For Robust And Sparse Training Of Few-Bit Neural Networks, Ambrogio Maria Bernardelli, Stefano Gualandi, Simone Milanesi, Hoong Chuin Lau, Neil Yorke-Smith

Research Collection School Of Computing and Information Systems

Training neural networks (NNs) using combinatorial optimization solvers has gained attention in recent years. In low-data settings, the use of state-of-the-art mixed integer linear programming solvers, for instance, has the potential to exactly train an NN while avoiding computing-intensive training and hyperparameter tuning and simultaneously training and sparsifying the network. We study the case of few-bit discrete-valued neural networks, both binarized neural networks (BNNs) whose values are restricted to ±1 and integer-valued neural networks (INNs) whose values lie in the range {−P,…,P}. Few-bit NNs receive increasing recognition because of their lightweight architecture and ability to run on low-power devices: for …

Time Series Deep Learning Approach For The Intermittent Operational Performance Of A Wellhead Water Treatment And Desalination System, Michael G. Clement

Electronic Theses, Projects, and Dissertations

Distributed water treatment and desalination (DWTD) systems are becoming significant for serving disadvantaged communities that are geographically segregated from centralized water distribution networks. However, given the remote nature of the communities, these systems must operate autonomously adapting to intermittent operations due to varying water use patterns and unavailability of continuous manual labor support. Machine Learning models describing and forecasting system performance are critical, allowing for model-based control, performance forecasting, fault detection, and determination of causal relationships among process attributes. Accordingly, graph convolutional neural networks with an attention mechanism (GATConv) were developed to describe the intermittent operational profiles of a wellhead …

Learning Behaviors In Physics-Informed Deep Learning, Alex Glover

Electronic Theses and Dissertations

Physics-informed deep learning is a methodology in artificial intelligence aimed at combating the large training data requirement and the barrier of domain awareness that deep learning architectures commonly face in applications. Stochastic modeling integrated into the predictive models provides that domain knowledge. Variations of the Intelligent Driving Model impact the learning behaviors of the joint-training architecture. This thesis examines the effect of substituting the standard linear Intelligent Driving Model with a modified nonlinear version, as applied to real human driving behavior on the I-80 interstate. The experimentation also critically evaluates the complications that impede the viability of this architecture in …

Towards Reliable Ml: Data Attribution And Adversarial Robustness, Xiaosen Zheng

Dissertations and Theses Collection (Open Access)

Modern machine learning (ML) models achieve remarkable success, but face critical reliability challenges. This thesis advances two pillars of reliable ML systems: interpretability through data attribution and robustness against adversarial threats.

In the first part, we develop novel data attribution methods to elucidate the data-model relationship. We establish the critical role of memorization in model generalization through token-level influence analysis, extend sample-level attribution to diffusion models with effective approximation techniques, and introduce REGMIX, a group-level approach that predicts data mixture performance using small-scale experiments. These contributions provide practitioners with scalable tools to audit training data impacts across modalities.

The second …

On Bed Posture Recognition Using Deep Learning With Pressure Sensors, Farheen Akhter Ms

Electronic Theses, Projects, and Dissertations

In healthcare applications such as disease prevention, sleep quality evaluation, and patient monitoring, bed posture recognition is essential. Using pressure sensor arrays placed on top of or embedded in mattresses, this study investigates the application of deep learning models for non-invasive posture classification. Although they have been widely employed, traditional machine learning approaches like support vector machines (SVM) and k-nearest neighbors (KNN) sometimes struggle with feature extraction and real-time performance necessitating considerable processing resources. I implemented a model using conventional approaches to get over these restrictions, then fine-tuned it using the following deep learning architectures for bed posture recognition: ResNet-50, …

Comparative Analysis Of Classical And Machine Learning Pathfinding Approaches, Miguel Gapud

Honors Theses

Pathfinding is an essential task for any autonomous robot. Graph-based classical pathfinding algorithms and machine learning approaches have both been used for this end, but they are often not compared against each other. An implementation of end-to-end (E2E) pathfinding using Proximal Policy Optimization (PPO) and an Alexnet architecture is compared against an implementation of Hybrid A*. A digital twin in Unity3D is used as the testing environment with the Clearpath Dingo as the pathfinding robot. In machine learning, the robot is controlled using PPO through ROS-Noetic with a camera as its sensor. Hybrid A* and its controls are implemented directly …

Exploring The Biasing Effects Of Gender On Personality Disorder Diagnoses Formulated By Artificial Intelligence, Zoe Colclough

Student Theses

Gender bias is prevalent in personality disorder assessments, and while artificial intelligence has been posited as a solution to improve diagnostic objectivity and accuracy, the potential for such technologies to propagate human gender bias in mental health contexts remains underexplored. This study investigated the influences of gender bias on the diagnostic performance of ChatGPT-4o for personality disorders using three factorial research designs, which involved experimentally manipulating patient gender in a combined sample of 360 vignettes and case studies. Vignettes were synthesized through a novel artificial intelligence-assisted methodology established for this research, and case studies were identified from the literature. Significant …

Towards Mitigation Of The Light Network Load Performance Penalty Of The Network Link Outlier Factor (Nlof), Jaime Merin Guzman

Open Access Theses & Dissertations

Detecting and localizing faults in communication networks is critical to maintaining reliable and efficient network operations. The Network Link Outlier Factor with Most Likely Link (NLOF: MLL) algorithm has demonstrated its potential to automate this task but suffers from significant performance degradation under low network load conditions, where limited network flow data reduces its ability to localize faults. This thesis proposes and evaluates the performance of a synthetic traffic generation algorithm to be used with NLOF:MLL. This algorithm strategically injects synthetic flows that supplement the insufficient real network flows, thereby improving NLOF:MLL's performance under low-load conditions. Specifically, we select network …

Hidden Layer Reshaping On Convolutional Neural Network, Alan Delgado

Open Access Theses & Dissertations

Artificial Intelligence (AI) technologies have become really popular in recent years. From ChatGPT to Tesla cars, many applications can benefit from these type of technologies. Automotive, healthcare, biomedical, cybersecurity, finances, and retail are some of the fields that take advantage of it. It has been seen that AI can solve complex problems, but there is still work to be done to optimize it. A deep learning neural network (DLNN) tries to simulate how a human brain operates. These DLNNs are made up of artificial neurons which are connected by weight that are modified when the network is trained. These networks …

Generative Ai For 3d Printed Antenna Design, Jennifer Ann Chavez

Open Access Theses & Dissertations

This research explores the integration of generative artificial intelligence (AI) with a physics-informed particle swarm optimizer (PSO) to develop 3D printable microstrip patch antennas. A neural network was trained on a dataset of microstrip patch antenna geometries and their corresponding performance metrics: return loss and gain. The PSO used a fitness function prioritizing low return loss in potential antennas, eventually yielding novel antenna geometries with parasitic components. 3D printing constraints were also hard coded into the framework, thus preventing any geometries being generated that cannot be fabricated. When simulated using Ansys HFSS, the AI generated microstrip patch antennas exceeded the …

Achieving Flexible Fairness And Privacy In Federated Learning, Alycia N. Carey

Graduate Theses and Dissertations

Having access to large, high-quality datasets is crucial for training machine learning models that achieve satisfactory performance. Unfortunately, it is common that a single entity (e.g., mobile device or organization) does not have access to such datasets due to monetary or resource constraints. Traditional machine learning requires that all training data reside in a centralized location during the entire duration of model training, however, in many circumstances it is difficult or even impossible (e.g., due to governmental regulations) for multiple parties to combine their data to meet this constraint. Federated learning is a machine learning paradigm that facilitates the joint …

Strengthening The Bonds Between Us: An Empirical Investigation Of Morale In Human-Ai Teams And The Socially Supportive Ai Teammates Who Empower It, Rohit Mallick

All Dissertations

This dissertation investigates how artificial intelligence (AI) can be designed to improve the collective emotion within a team. A team's collective emotion, or morale, describes how motivated, optimistic, and enthusiastic the group is in accomplishing its goals. We conducted four studies that compared different social support strategies that AI teammates can provide to the team. Study 1A found that AI teammates who communicate with emotions can better motivate human team members and promote awareness of team dynamics and environmental changes. Study 1B found that human teammates become more motivated and happier when their AI teammates express joy and are close …

Deepfakes On Trial: Developing A High-Accuracy, Court-Admissible Ai Pipeline For Deepfake Detection In Corporate Fraud Litigation, Aiden J. Green

Honors College Theses

As deepfake technology advances, cybercriminals are increasingly using AI-generated videos and audios to impersonate executives and carry out sophisticated CEO fraud schemes. These synthetic forgeries target human trust and corporate communication systems, creating an urgent need for forensic tools capable of authenticating digital evidence with legal accuracy. This thesis presents a forensic-grade AI deepfake detection pipeline designed for this purpose, emphasizing courtroom admissibility, reproducibility, and evidentiary integrity. Built entirely with free, opensource tools, the framework combines metadata analysis, AI-powered spectrogram analysis, neural artifact detection, and facial manipulation recognition into a transparent workflow that accurately identifies synthetic media. It was trained …

The Efficacy Of Incorporating Artificial Intelligence (Ai) Chatbots In Brief Gratitude And Self-Affirmation Interventions: Evidence From Two Exploratory Experiments, Jing Wen Hung, Andree Hartanto, Adalia Y.H. Goh, Zoey K.Y. Eun, K. T. A. Sandeeshwara Kasturiratna, Zhi Xuan Lee, Nadyanna M. Majeed

Research Collection School of Social Sciences

Numerous studies have demonstrated that positive psychology interventions, including brief interventions, can significantly improve well-being outcomes. These findings are particularly important given that many of these interventions are brief and self-administered, making them both accessible and scalable for large populations. However, the efficacy of positive psychology interventions is often constrained by small effect sizes. In light of advancements in generative Artificial Intelligence (AI), this study explored whether integrating AI chatbots into positive psychology interventions could enhance their efficacy compared to traditional self-administered approaches. Study 1 examined the efficacy of a gratitude intervention delivered through Snapchat's My AI, while Study 2 …

Disentangling User Preferences Towards Self-Interpretable Recommender Systems, Nhu Thuat Tran

Dissertations and Theses Collection (Open Access)

Understanding user preferences remains a central challenge in recommender systems due to their inherently complex, unstructured, and multi-faceted nature, exacerbated by the sparsity of user interaction data. Traditional approaches often compress user interests into a single latent vector, overlooking the fact that user preferences are typically shaped by multiple underlying factors that differ across individuals. These latent drivers are not directly observable and must be discovered through unsupervised modeling, further complicated by limited historical interactions per user.

This dissertation addresses these challenges by introducing a principled framework for multiinterest modeling, which disentangles user behaviors into multiple latent factors to better …

Empirically Exploring The Physical Realizability Of Adversarial Examples, Ruoyao Wen

McKelvey School of Engineering Graduate Student Theses & Dissertations

The development of autonomous vehicles (AVs) has been accelerated by advancements in deep neural networks (DNNs), which power the complex perception systems necessary for safe and efficient real-world navigation. However, as AVs increasingly integrate into public transportation networks, the robustness of their perception systems against potential vulnerabilities is critical. Among these threats, adversarial attacks—particularly through the use of adversarial patches—pose significant risks. These patches are carefully crafted perturbations designed to mislead DNNs, potentially compromising AV safety by causing incorrect object recognition or misclassification.

While extensive research has demonstrated high attack success rates for adversarial patches in controlled digital environments, their …

On Learning Informative Trajectory Embeddings For Imitation, Classification And Regression, Zichang Ge, Changyu Chen, Arunesh Sinha, Pradeep Varakantham

Research Collection School Of Computing and Information Systems

In real-world sequential decision making tasks like autonomousdriving, robotics, and healthcare, learning from observed state-action trajectories is critical for tasks like imitation, classification,and clustering. For example, self-driving cars must replicate humandriving behaviors, while robots and healthcare systems benefitfrom modeling decision sequences, whether or not they come fromexpert data. Existing trajectory encoding methods often focus onspecific tasks or rely on reward signals, limiting their ability togeneralize across domains and tasks.Inspired by the success of embedding models like CLIP andBERT in static domains, we propose a novel method for embeddingstate-action trajectories into a latent space that captures the skillsand competencies in the …

Animal Burrow Detection In Levee Systems Using Res-Net 34, Christopher D. Moore

LSU New Orleans Theses and Dissertations

Animal burrow detection is a time-consuming and costly task for levee inspectors. Annual budgets run up to approximately $16 million per state. The inspectors typically will have to travel to the inspection sites using government-assigned transportation. Depending on the distance to the site, it may take minutes or hours to arrive before any productive inspections occur. Once at the site, the inspectors were subject to human error, overgrown foliage, severe weather, or prohibitive landscaping that would make any human inspection impossible. Also, animal burrows could be small enough or overgrown, so the human inspector misses the problem areas. We aimed …

From The Bleachers To The Browser: Redefining Fan Experience With Ar And Ai In Smaller Teams, Jennifer Lee Wunder

Theses

This project documents the creation and deployment of HootyHoo, an interactive augmented reality (AR) mascot experience designed for the O’Fallon Hoots, a small-scale collegiate summer baseball team. Built using accessible, open-source tools such as WebXR, Mixamo, Meshy, Botpress, Claude and ChatGPT, this prototype merges AI-driven conversation with animated 3D avatar interaction—redefining how fans engage with sports organizations digitally. Unlike enterprise-level applications used by professional franchises, HootyHoo is entirely browser-based, eliminating the need for app downloads and ensuring maximum accessibility for families and new fans with smartphones. The experience centers on Hooty, the team mascot, who answers questions about baseball and …

Global Sporadic-E Prediction And Climatology Using Deep Learning, J. A. Ellis, Daniel J. Emmons, M. B. Cohen

Faculty Publications

Sporadic-E (E_s) is an ionospheric phenomenon defined by strong layers of plasma which may interfere with radio wave propagation. In this work, we develop deep learning models to improve the understanding of E_s, including the presence, intensity and height of the layers. We developed three separate models. The first, building off earlier work in (J. A. Ellis et al., 2024, link in AFIT Scholar, 10.1029/2023sw003669), includes only the main features from radio occultation (RO) measurements. The second adds to that time, date, location, geomagnetic and solar indices, solar winds, x-ray flux, weather and lightning. A …

Expressive And Interpretable User Engagement Prediction Using Multivariate Survival Processes, Akshay Aravamudan

Theses and Dissertations

The ability to characterize how information diffuses online is of paramount importance to stakeholders that are interested in tasks such as proposing solutions for mitigating and countering dis/misinformation, predicting user engagement of content in social media, planning marketing campaigns to roll-out products and planning dissemination of political campaign messaging among others. One such facet of learning the dynamics of information diffusion is the ability to predict user engagement or the popularity of a single piece of information as it spreads through an online medium. Existing works in this regard mainly either obfuscate user level information or utilize frameworks that are …

Robot-Integrated 4d Building Information Modeling (4d Bim): Framework For Planning Safe Autonomous Construction Operations In Dynamic Environments, Hafiz Oyedimeji Oyediran

Dissertations and Doctoral Documents, University of Nebraska-Lincoln, 2023–

In the construction industry, the use of autonomous robots is considered a solution to overcome the heavy reliance on human workers to perform repetitive, strenuous, and hazardous tasks. While these robots offer the advantage of autonomous operation, ensuring their safe and efficient integration within construction sites requires precise planning. Such planning must account for the varying project complexities such as scope, site layout, tasks, timelines, existence of human workers, and other spatiotemporal conditions of the construction site. Currently, there are no methods to safely plan autonomous robot operations considering these factors within the overarching construction planning process. Thus, autonomous robots …

Greening Intelligence: Why Ai Infrastructure And Governance Must Evolve Together, Heng Wang, Poh Seng Lee

Research Collection Yong Pung How School Of Law

AI infrastructure is evolving faster than the regulation and governance needed to ensure it serves public and planetary interests.

Adversarial Machine Learning: Methods For Attacks And Defenses, Minh Hao Van

Graduate Theses and Dissertations

With the rapid development of machine learning in real-world applications, enhancing security plays an important role. Adversarial machine learning focuses on understanding malicious actions from attackers and developing defensive techniques against such threats when deploying machine learning systems. An attack can occur in different scenarios, such as poisoning attacks during the training stage and evasion attacks during the testing stage. Although extensive research has explored defense strategies to deal with these harmful attacks, there is a need for further research into areas such as how to counteract malicious attacks with healthy noise or how to train an adaptive defense against …

Creating Talking Points For Client Advisers At Banks To Promote Sustainable Investing, Wewe Zi Yi, Pradeep Varakantham, Alan Megargel

Research Collection School Of Computing and Information Systems

Environmental, social and governance (ESG) factors have become key nonfinancial factors for investors to evaluate companies with respect to understanding material risks and growth opportunities. While not mandatory, companies are providing ESG reports that outline progress in different ESG metrics (six broad metrics and 15 specific ones). Client advisers (CAs) read these reports to identify key metrics of interest to investors. Given the number of companies and investment products, however, it is not feasible for CAs to read all the reports, which can sometimes run into tens or hundreds of pages). The authors have developed multiple frameworks building on leading …