Artificial Intelligence and Robotics Commons^™

Application Of Machine Learning And Large Language Models In Healthcare For Data Prediction And Summarization, Chiazam Chisom Izuchukwu

College of Graduate Studies: Theses & Dissertations

This study aims to examine the use of machine learning (ML) and large language models (LLMs) in healthcare to enhance disease prediction, clinical decision-making, and information management. Five supervised ML models—Logistic Regression (LR), Support Vector Machine (SVM), Random Forest (RF), Decision Trees (DT), and Naïve Bayes (NB)—on three different computing platforms—Google Colab, Databricks, and Snowflake—were employed for disease classification. Data preprocessing included treating missing values, encoding categorical variables utilizing one-hot-encoding, feature scaling when needed, and tackling class imbalance with Synthetic Minority Over-sampling Technique (SMOTE) before an 80-20 train-test separation. Models were created with Scikit-learn (Google Collab), Spark MLlib (Databricks), and …

Temporal Machine Learning For Predicting Accidents And Violations In The Mining Industry, Nathan T. Kelley

Theses and Dissertations--Mining Engineering

This thesis examines the predictive capability of a temporal machine learning model for forecasting future accidents and violations at individual mines, based on historical data. Mine accidents were categorized by accident classification and violations were categorized by the Part Section. The primary datasets utilized were the mine safety and health administration’s (MSHA’s) Accident Injuries and Violations datasets. The available datasets were cleaned and organized by mine type and commodity, then divided into separate subsets for training, validating, and testing. Different models, cutoff metrics, learning rates, number of hidden layers, data processing methods, data processing divisions, number of points observed …

Pca Text Sentiment Analysis Tool, Luke Gegick

Williams Honors College, Honors Research Projects

This project applies principal component analysis (PCA) to sentiment analysis of text to identify complex emotional responses from plain text. Existing sentiment analysis tools often rely on large language models or struggle to achieve high accuracy when processing large collections of short inputs, such as social media comments. By contrast, this project uses PCA as a lightweight, mathematically grounded alternative that can scale efficiently while still capturing meaningful emotional structure in text data.

PCA has shown strong effectiveness in text analysis, particularly when supported by a sufficiently large dataset and a robust preprocessing pipeline. To create consistent, information-rich input vectors, …

Generating Negotiations For Iago, Kylee R. Weener

Honors Undergraduate Theses

Negotiation is a complex field that can benefit from introducing artificial intelligence (AI); doing so would benefit researchers as they try to deepen their understanding of human-human and human-agent negotiation. Investigating how large language models (LLMs) can generate negotiation dialogue with emotional context would bring agents closer to acting more human. This study explores how fine-tuning and prompt engineering can achieve this goal and the possibilities for an AI that fills these criteria to be included in the Interactive Arbitration Guide Online platform (IAGO). Doing so will make the negotiation interactions in IAGO feel more complex and natural, allowing researchers …

Learning From Non-Stationary Data Streams, Gabriel Jonas Aguiar

Theses and Dissertations

The rapid growth of data from sources such as mobile applications, sensors, and network monitoring has increased the need for machine learning algorithms capable of handling non-stationary data streams. However, learning from such streams presents significant challenges due to their evolving nature and the presence of concept drift. One of the most complex issues is learning from imbalanced data streams, where shifting data distributions, combined with feature space drifts, complicate continuous adaptation. These challenges become even more pronounced in multi-class scenarios, which are common in real-world applications. Detecting concept drift in such contexts is particularly demanding, as it requires tracking …

Generalizing Classification Of Pilot Workload: Transfer Learning Versus A Jepa-Inspired Transformer Architecture, Naim Barnett, Shivani Nagrecha, Morgan Glover, Clayton Harper, Justin Wilson, James Maher, Eric C. Larson

International Journal of Aviation, Aeronautics, and Aerospace

Within the context of learning, there poses difficulty when objectively measuring human performance. In this work, we investigate the evaluation of human performance via its relation to the individual's mental capacity by classification of cognitive load within the domain of aviation. By utilizing a mixed virtual and physical flight simulation environment in conjunction with biometric sensing, we create and evaluate the predictive capabilities of a Joint-Embedding Predictive Architecture (JEPA) and compare the architecture and results to traditional methods for transfer learning and domain adaptation. We find that our JEPA inspired architecture can achieve more than 70% accuracy of cognitive workload, …

Fedart: A Neural Model Integrating Federated Learning And Adaptive Resonance Theory, Shubham Pateria, Budhitama Subagdja, Ah-Hwee Tan

Research Collection School Of Computing and Information Systems

Federated Learning (FL) has emerged as a promising paradigm for collaborative model training across distributed clients while preserving data privacy. However, prevailing FL approaches aggregate the clients’ local models into a global model through multi-round iterative parameter averaging. This leads to the undesirable bias of the aggregated model towards certain clients in the presence of heterogeneous data distributions among the clients. Moreover, such approaches are restricted to supervised classification tasks and do not support unsupervised clustering. To address these limitations, we propose a novel one-shot FL approach called Federated Adaptive Resonance Theory (FedART) which leverages self-organizing Adaptive Resonance Theory (ART) …

Ensemble Learning For Mri-Based Brain Tumor Classification: A Weighted Voting Approach, Ha Anh Vu

All Master's Theses

MRI is essential for detecting and diagnosing brain tumors, where accurately distinguishing glioma, meningioma, and pituitary tumors is vital for effective treatment planning. However, tumors' complex morphology and MRI imaging variations present significant challenges for reliable classification. Deep learning models, particularly Convolutional Neural Networks (CNN) and ResNet architectures, have demonstrated impressive performance in medical image analysis but often struggle with generalization across different datasets. On the other hand, traditional classifiers such as Support Vector Machines (SVM) and K-Nearest Neighbors (KNN) leverage handcrafted features like Histogram of Oriented Gradients (HOG), which can effectively capture structural details but may lack the adaptability …

Machine Learning Methods For Intrusion Detection And Response In Network Security, Ayomide Oyemaja

College of Graduate Studies: Theses & Dissertations

Intrusion Detection Systems (IDS) play a crucial role in computer network security by identifying malicious activities and potential cyberattacks. This thesis combines machine learning and cybersecurity by applying Reinforcement Learning (RL) in intrusion detection and response using the NSL-KDD dataset.

We designed and implemented a Q-learning framework where an agent learns to classify network traffic over time by interacting with the environment and receiving rewards based on detection accuracy. We also look at the importance of feature selection and classification techniques and how effective they are in improving model performance, reducing the complexity of computation, and producing more desirable results. …

How Does Augmentation Affect Feature Space: A Study Using Various Augmentation Methods In Distributed Learning, Nikil Sharan Prabahar Balasubramanian

Computer Science Theses

This thesis examines the impact of data augmentation techniques on model performance within a distributed learning framework, focusing on enhancing feature diversity and improving representation for under-represented classes. Data augmentation, commonly used to address data imbalance, significantly influences the feature space learned by deep learning models, with varied effects in distributed settings where data is split across nodes. Our study reveals that inconsistencies in feature learning across nodes reduce the benefits of local augmentation in capturing complex patterns, leading to suboptimal model performance. To address this, we propose a coherent augmentation approach that embeds consistent transformations in the central server, …

Applying Positive Unlabeled Learning Techniques And Using The Kullback-Leibler Divergence To Improve Geothermal Surveying Assessments, Martín Thomas Rodriguez

Dissertations and Theses

As we face the current climate crisis, the discovery of geothermal energy resources has the potential to greatly reduce our dependence on fossil fuels worldwide. However, the development of any new energy infrastructure is expensive and depends on the willingness of energy agencies and developers to make initial investments based on calculated risk measures. One such measure, called geothermal favorability, is the likelihood that a site has conditions favorable for geothermal systems containing recoverable energy potential. Its prediction from existing geophysical datasets proves to be a nontrivial task. The prediction of geothermal favorability can be framed as a binary classification …

Graph Neural Networks Powered Scientific Paper Recommendation, Junhao Shen

Computer Science and Engineering Theses and Dissertations

Scientific paper recommendation systems aim to help researchers discover relevant papers amidst the vast and ever-growing body of literature. With the exponential yearly increase in scientific publications, the demand for effective paper recommendation solutions has become both critical and increasingly challenging. In recent years, deep learning techniques have revolutionized recommender systems, and scientific paper recommendations have naturally integrated these advancements. In this dissertation, we address these challenges through three progressive contributions.

First, we enhance traditional content-based methods using Graph Neural Networks (GNNs) by introducing a Graph Convolutional Network-strengthened Topic Modeling (GCN-TM) approach. This method improves upon conventional topic modeling techniques …

Using Llms To Establish Implicit User Sentiment Of Software Desirability, Sherri Weitl-Harms, John D. Hastings, Jonah Lum

Research & Publications

This study explores the use of LLMs for providing quantitative zero-shot sentiment analysis of implicit software desirability, addressing a critical challenge in product evaluation where traditional review scores, though convenient, fail to capture the richness of qualitative user feedback. Innovations include establishing a method that 1) works with qualitative user experience data without the need for explicit review scores, 2) focuses on implicit user satisfaction, and 3) provides scaled numerical sentiment analysis, offering a more nuanced understanding of user sentiment, instead of simply classifying sentiment as positive, neutral, or negative.

Data is collected using the Microsoft Product Desirability Toolkit (PDT), …

Enhancing Password Security And Memorability Using Machine Learning And Linguistic Patterns, Jared Wise

LSU New Orleans Theses and Dissertations

In the digital age, text-based passwords remain a primary method for securing online accounts. Yet, users frequently face a dilemma between creating passwords that are easy to remember and sufficiently secure against cyberattacks. This research introduces an approach to password generation that bridges this gap by utilizing linguistic patterns, particularly song lyrics, to develop highly secure and naturally memorable passwords. Using large lyric datasets gained from web scrapes from popular song lyric websites (AZ Lyrics, Genius), features are extracted from a corpus of over 5 million lyrics using sentence structure and natural language processing in a novel way. In using …

Real-Time Network Simulations For Ml/Dl Ddos Detection Using Docker, Luis D. Garcia

Master's Theses

As the integration of artificial intelligence (AI) within cybersecurity continues to

grow, machine learning (ML) and deep learning (DL) models are increasingly used to

detect cyber attacks. However, these models are rarely evaluated in real-time attack

scenarios to see how subtle changes from the real networking environment can affect

their predictions. To address this issue, we propose a scalable, platform-independent

Docker testbed specifically designed for simulating real-time Distributed Denial of

Service (DDoS) attack scenarios that allows researchers to deploy and evaluate their

pre-trained, ML and DL detection models. Our framework is simple to configure

and can run across Intel and …

Computational Representation, Analysis And Verification Of Requirements In Engineering Design And Systems Engineering, Chandan Kumar Sahu

All Dissertations

Systems are developed to satisfy a set of requirements derived from stakeholders’ needs, defining the problem space for which the system is created as a feasible solution. The system design process begins with eliciting these requirements and concludes with validating whether the created system meets them. Requirements engineering (RE) encompasses elicitation, representation, analysis, documentation, verification, and validation. However, challenges in RE, such as imprecision in natural language (NL), proprietary restrictions, and a lack of standardized quality metrics, hinder the creation of well-formed and comprehensive requirements. These challenges complicate formalization and analysis of requirements.

This dissertation addresses these challenges by proposing …

Artificial Intelligence And Machine Learning In Cancer Pain: A Systematic Review, Vivian Salama, Brandon Godinich, Yimin Geng, Laia Humbert-Vidan, Laura Maule, Kareem A Wahid, Mohamed A Naser, Renjie He, Abdallah S R Mohamed, Clifton D Fuller, Amy C Moreno

Faculty, Staff and Student Publications

Background/objectives: Pain is a challenging multifaceted symptom reported by most cancer patients. This systematic review aims to explore applications of artificial intelligence/machine learning (AI/ML) in predicting pain-related outcomes and pain management in cancer.

Methods: A comprehensive search of Ovid MEDLINE, EMBASE and Web of Science databases was conducted using terms: "Cancer," "Pain," "Pain Management," "Analgesics," "Artificial Intelligence," "Machine Learning," and "Neural Networks" published up to September 7, 2023. AI/ML models, their validation and performance were summarized. Quality assessment was conducted using PROBAST risk-of-bias andadherence to TRIPOD guidelines.

Results: Forty four studies from 2006 to 2023 were included. Nineteen studies used …

What Do We Know About Hugging Face? A Systematic Literature Review And Quantitative Validation Of Qualitative Claims, Jason Jones, Wenxin Jiang, Nicholas Synovic, George K. Thiruvathukal, James C. Davis

Computer Science: Faculty Publications and Other Works

Background: Collaborative Software Package Registries (SPRs) are an integral part of the software supply chain. Much engineering work synthesizes SPR package into applications. Prior research has examined SPRs for traditional software, such as NPM (JavaScript) and PyPI (Python). Pre-Trained Model (PTM) Registries are an emerging class of SPR of increasing importance, because they support the deep learning supply chain.
Aims: Recent empirical research has examined PTM registries in ways such as vulnerabilities, reuse processes, and evolution. However, no existing research synthesizes them to provide a systematic understanding of the current knowledge. Some of the existing research includes qualitative …

Bi-Directional Transformers Vs. Word2vec: Discovering Vulnerabilities In Lifted Compiled Code, Gary Mccully, John Hastings, Shengjie Xu, Adam Fortier

Research & Publications

Detecting vulnerabilities within compiled binaries is challenging due to lost high-level code structures and other factors such as architectural dependencies, compilers, and optimization options. To address these obstacles, this research explores vulnerability detection using natural language processing (NLP) embedding techniques with word2vec, BERT, and RoBERTa to learn semantics from intermediate representation (LLVM IR) code. Long short-term memory (LSTM) neural networks were trained on embeddings from encoders created using approximately 48k LLVM functions from the Juliet dataset. This study is pioneering in its comparison of word2vec models with multiple bidirectional transformers (BERT, RoBERTa) embeddings built using LLVM code to train neural …

Confronting The Reproducibility Crisis: A Case Study Of Challenges In Cybersecurity Ai, Richard H. Moulton, Gary A. Mccully, John D. Hastings

Research & Publications

In the rapidly evolving field of cybersecurity, ensuring the reproducibility of AI-driven research is critical to maintaining the reliability and integrity of security systems. This paper addresses the reproducibility crisis within the domain of adversarial robustness—a key area in AI-based cybersecurity that focuses on defending deep neural networks against malicious perturbations. Through a detailed case study, we attempt to validate results from prior work on certified robustness using the VeriGauge toolkit, revealing significant challenges due to software and hardware incompatibilities, version conflicts, and obsolescence. Our findings underscore the urgent need for standardized methodologies, containerization, and comprehensive documentation to ensure the …

Surrogate Models For Stress-Strain Mapping Of Microscale Physics, Samuel Roach, Dr. Eric Ocegueda

College of Engineering Summer Undergraduate Research Program

•Learn the difference between different neural networks within machine learning (ML) •Develop a working understanding of the ML tool Pytorch and machine learning operator: Recurrent Neural Operator •Use MATLAB to create and process time dependent stress/strain matrices to display the hyper-parameters for different RNOs •Apply RNO to train the strain-stress mapping of tri-laminate and granular cases

A Guideline For Open-Source Tools To Make Medical Imaging Data Ready For Artificial Intelligence Applications: A Society Of Imaging Informatics In Medicine (Siim) Survey, Sanaz Vahdati, Bardia Khosravi, Elham Mahmoudi, Kuan Zhang, Pouria Rouzrokh, Shahriar Faghani, Mana Moassefi, Aylin Tahmasebi, Katherine Andriole, Peter Chang, Keyvan Farahani, Mona Flores, Les Folio, Sina Houshmand, Maryellen Giger, Judy Gichoya, Bradley Erickson

Department of Radiology Faculty Papers

In recent years, the role of Artificial Intelligence (AI) in medical imaging has become increasingly prominent, with the majority of AI applications approved by the FDA being in imaging and radiology in 2023. The surge in AI model development to tackle clinical challenges underscores the necessity for preparing high-quality medical imaging data. Proper data preparation is crucial as it fosters the creation of standardized and reproducible AI models while minimizing biases. Data curation transforms raw data into a valuable, organized, and dependable resource and is a fundamental process to the success of machine learning and analytical projects. Considering the plethora …

Rethinking Retrieval Augmented Fine-Tuning In An Evolving Llm Landscape, Nicholas Sager, Timothy Cabaza, Matthew Cusack, Ryan Bass, Joaquin Dominguez

SMU Data Science Review

This study explores the utilization of Retrieval Augmented Fine-Tuning (RAFT) to enhance the performance of Large Language Models (LLMs) in domain-specific Retrieval Augmented Generation (RAG) tasks. By integrating domain-specific information during the retrieval process, RAG aims to reduce hallucination and improve the accuracy of LLM outputs. We investigate the use of RAFT, an approach that enhances LLMs by incorporating domain-specific knowledge and effectively handling distractor documents. This paper validates previous work, which found that RAFT can considerably improve the performance of Llama2-7B in specific domains. We also expand upon previous work into new state-of-the-art open-source models and other datasets with …

Leveraging Generative Ai For Sustainable Farm Management Techniques Correspond To Optimization And Agricultural Efficiency Prediction, Samira Samrose

All Graduate Reports and Creative Projects, Fall 2023 to Present

Sustainable farm management practice is a multifaceted challenge. Uncovering the optimal state for production while reduction of environmental negative impacts and guaranteed inter-generational assets supervision needs balanced management. Also, considering lots of different factors (cost, profit, employment etc), the agricultural based management technique requires rigorous concentration. In this project machine learning models are applied to develop, achieve and improve the farm management techniques. This experiment ensures the resultant impacts being environment friendly and necessary resource availability and efficiency. Predicting the type of crop and rotational recommendations will disclose potentiality of productive agricultural based farming. Additionally, this project is designed to …

Physics-Informed Machine Learning Methods For Inverse Design Of Multi-Phase Materials With Targeted Mechanical Properties, Yunpeng Wu

All Dissertations

Advances in machine learning algorithms and applications have significantly enhanced engineering inverse design capabilities. This work focuses on the machine learning-based inverse design of material microstructures with targeted linear and nonlinear mechanical properties. It involves developing and applying predictive and generative physics-informed neural networks for both 2D and 3D multiphase materials.

The first investigation aims to develop a machine learning method for the inverse design of 2D multiphase materials, particularly porous materials. We first develop machine learning methods to understand the implicit relationship between a material's microstructure and its mechanical behavior. Specifically, we use ResNet-based models to predict the elastic …

Genomic Data Science Approaches For Understanding Human Diseases, Snehal Shah

All Dissertations

The intricate interplay of genetic predisposition, environmental influences, and lifestyle acts as the multifactorial landscape of diseases. Understanding this complexity presents a significant challenge. Molecular insights into disease mechanisms, particularly the interactions of DNA, RNA, and proteins with environmental and lifestyle factors, have revolutionized disease diagnosis, prognosis, and treatment. High-throughput technologies, such as next-generation sequencing, generate large amounts of molecular data, holding a wealth of knowledge. These datasets unveil the roles of genes and their interactions with various factors through analysis, shedding light on previously unknown molecular mechanisms underlying disease pathogenesis. Furthermore, they facilitate the discovery of biomarkers crucial for …

Exploring A Multimodal Fusion-Based Deep Learning Network For Detecting Facial Palsy, Heng Yim Nicole Oo, Min Hun Lee, J. H. Lim

Research Collection School Of Computing and Information Systems

Algorithmic detection of facial palsy offers the potential to improve current practices, which usually involve labor-intensive and subjective assessment by clinicians. In this paper, we present a multimodal fusion-based deep learning model that utilizes unstructured data (i.e. an image frame with facial line segments) and structured data (i.e. features of facial expressions) to detect facial palsy. We then contribute to a study to analyze the effect of different data modalities and the benefits of a multimodal fusion-based approach using videos of 21 facial palsy patients. Our experimental results show that among various data modalities (i.e. unstructured data - RGB images …

Personalized Driving Using Inverse Reinforcement Learning, Rodrigo J. Gonzalez Salinas

Theses and Dissertations

This thesis introduces an autonomous driving controller designed to replicate individual driving behaviors based on a provided demonstration. The controller employs Inverse Reinforcement Learning (IRL) to formulate the reward function associated with the provided demonstration. IRL is implemented through a dual-feedback loop system. The inner loop utilizes Q-learning, a model-free reinforcement learning technique, to optimize the Hamilton-Jacobi-Bellman (HJB) equation and derive an appropriate control solution. The outer loop leverages this derived control solution to generate parameters for the reward function, which are subsequently integrated into the HJB equation. The ultimate control policy is deduced from the final reward function obtained …

Vysion Software, Isaias Hernandez-Dominguez Jr, Chander Luderman Miller

2024 Symposium

Vision loss presents significant challenges in daily life. Existing solutions for blind and visually impaired individuals are often limited in functionality, expensive, or complex to use. Vysion Software addresses this gap by developing a user-friendly, all-in-one AI companion app that provides features including text summarization, real-time audio descriptions, and AI-enhanced navigation. This project details the development plan, initial functionalities, and future vision for Vysion Software.

Machine Learning Multimodal Framework For Fake News Detection And Mitigation, Nada A. Gaballah

Theses and Dissertations

Social media has become our new reality, people wake up every morning and the first thing they do before getting out of bed, is check their social media. Nowadays, people rarely read newspapers, they even rarely watch TV news or listen to radio broadcasts. In recent years, we have witnessed lots of fake news roaming social media every second, with people simply believing it and spreading it even more without checking the credibility of this news. This fake news affected several domains like what happened in the US election in 2016 and again in 2020, the false information about Covid-19 …