Data Science Commons^™

Application Of Machine Learning And Large Language Models In Healthcare For Data Prediction And Summarization, Chiazam Chisom Izuchukwu

College of Graduate Studies: Theses & Dissertations

This study aims to examine the use of machine learning (ML) and large language models (LLMs) in healthcare to enhance disease prediction, clinical decision-making, and information management. Five supervised ML models—Logistic Regression (LR), Support Vector Machine (SVM), Random Forest (RF), Decision Trees (DT), and Naïve Bayes (NB)—on three different computing platforms—Google Colab, Databricks, and Snowflake—were employed for disease classification. Data preprocessing included treating missing values, encoding categorical variables utilizing one-hot-encoding, feature scaling when needed, and tackling class imbalance with Synthetic Minority Over-sampling Technique (SMOTE) before an 80-20 train-test separation. Models were created with Scikit-learn (Google Collab), Spark MLlib (Databricks), and …

Cognitive Map Generation For Vision And Language Navigation, Alexander Sandoval Mesa

Dissertations and Theses

Visual-Language Navigation (VLN) presents significant challenges for autonomous agents, such as robots and virtual assistants, particularly in complex, dynamic environments where the seamless integration of visual perception and natural language understanding is critical. Traditional VLN systems often struggle with effectively aligning language instructions and visual scene understanding, limiting their adaptability and navigation efficiency.

This thesis proposes a novel Cognitive Map-based framework that addresses these challenges by transforming natural language navigation instructions into structured graph representations. The Cognitive Map consists of nodes representing waypoints, landmarks, decision points, and edges encoding spatial relationships and navigational actions. These maps are generated using Large …

Cmc Thesis Chatbot, Luis Gomez

CMC Senior Theses

This GitHub repo is a senior thesis for Claremont McKenna College; it is a thesis about theses. The project is an interactive RAG-based chatbot that helps students, researchers, and faculty explore Claremont McKenna College senior theses. The goal was to create a domain-specific chatbot to show that it is possible to combat the limitations of AI, including hallucinations, outdated data, and lack of domain expertise. The website link is:

CMCThesisChatbot

Large Scale Machine Learning Over Knowledge Graphs, Bedirhan Gergin

Electronic Theses & Dissertations (2024 - present)

Knowledge graphs (KGs) have become popular across various fields, providing convenient access to web-based knowledge while storing and formalizing domain-specific information. By analyzing KGs, patterns, connections, and dependencies can be identified across different data sources, enabling the inference of new knowledge from given facts. As the use of KGs expands, the size of modern KGs has grown significantly, making them impossible to process within the main memory of a single computer. Distributed computing offers a viable solution to this challenge by leveraging the combined capabilities of multiple servers within a cluster. This thesis explores how distributed computing can be effectively …

Evaluating Multimodal Ai Systems: A Comparative Analysis Of Large Languagel Model-Based Models For Text, Image, And Video Generation, Azeezat O. Akinola

College of Graduate Studies: Theses & Dissertations

In the era of rapid technological advancement, efficient content generation, application development, and data management are crucial for meeting the demands of dynamic digital environments. This thesis uses state-of-the-art models to explore three core areas: AI-driven video content creation, text-to-image-to-text consistency, and automatic text summarization. The first study investigates the potential of AI-powered text-to-video generation to democratize video production and enhance storytelling. By comparing the performance of three models—ModelScope, Text2Video (Zero), and Motion Consistency—this study assessed the quality of generated videos using CLIP scores. It evaluated statistical significance through t-tests and homogeneity tests. Results indicate that ModelScope outperformed the others, …

The Effect Of Facial Phenotypes On Differential Performance Of Facial Recognition, Evan R. Garrett

Graduate Theses, Dissertations, and Problem Reports (ETD)

Facial recognition technology is utilized in many facets of life. As the use has become more widespread these systems have improved in reliability and performance approaching the level of human accuracy. With these improvements the problem of bias still remains as a persistent problem. Efforts have been made to minimize the bias prevalent in the systems via studies into various demographic factors, creating training datasets that have a more uniform distribution of subjects, and other methods. As facial recognition is one of the most utilized forms of biometric recognition it is vital to analyze potential causes of bias to help …

Error In The Loop: How Human Mistakes Can Improve Algorithmic Learning, Ryan W. Copus, Cait Spackman, Hannah Laqueur

Faculty Works

Algorithms often outperform humans in making decisions, in large part because they are more consistent. Despite this, there remains widespread demand to keep a “human in the loop” to address concerns about fairness and transparency. Although evidence suggests that most human overrides are errors, we argue these errors can provide value: they generate new data from which algorithms can learn. To remain accurate, algorithms must be updated over time, but data generated solely from algorithmic decisions is biased, including only cases selected by the algorithm (e.g., individuals released on parole). Training on this algorithmically selected data can significantly reduce predictive …

T3-Ciders: Fostering A Community Of Practice In Ci-And Data Enabled Cybersecurity Research Through A Train-The-Trainer Program, Wirawan Purwanto, Mohan Yang, Peng Jiang, Masha Sosonkina

Electrical & Computer Engineering Faculty Publications

We present a training program named T³-CIDERS, the Train- The-Trainer approach to fostering cyberinfrastructure (CI)- and Data-Enabled Research in CyberSecurity. T³-CIDERS is a train-the-trainer program for advanced cyberinfrastructure (CI) skills that is designed to be synergistic with research, teaching, and learning activities in cybersecurity and cyber-related disciplines. The participants, termed 'future trainers' (FTs), are trained in effective instructional design and CI hands-on materials from DeapSECURE, developed in a previous CyberTraining program. T³-CIDERS aims to enhance cybersecurity research and education through broader adoption of advanced CI techniques such as artificial intelligence, big data, parallel programming, and platforms like high-performance computing (HPC) …

High-Fidelity Soh Prediction In Lithium-Ion Batteries Using Hybrid Ml Networks, Shafiyee Islam, Gon Namkoong

Electrical & Computer Engineering Faculty Publications

Accurate and efficient prediction of lithium-ion battery state of health (SOH) is critical for ensuring reliability in electric vehicles, grid storage, and aerospace systems. Traditional SOH estimation methods often struggle with nonlinear degradation behaviors and lack sensitivity to subtle electrochemical signals, limiting their real-world deployment. To address these challenges, this study examines hybrid deep learning models that integrate differential capacity (dQ/dV) analysis to enhance predictive accuracy. Four hybrid architectures - hybrid CNN-LSTM multihead, CNN extractor for LSTM, DNN-LSTM, and DNN Bi-LSTM - were developed and evaluated using the NASA randomized battery usage dataset, offering a realistic benchmark under diverse operational …

Machine Learning Models Leveraging Patient-Similarity And Clinical Temporality For Disease Prognoses, Ahmad F. Al Musawi

Theses and Dissertations

Electronic Health Records (EHRs) constitute a comprehensive and high-dimensional repository of clinical data, encompassing a wide array of patient-level information such as diagnoses, procedures, medications, laboratory results, and unstructured clinical narratives. These data hold immense potential for advancing predictive modeling in healthcare, including tasks such as disease progression modeling, hospital readmission prediction, and length of stay (LoS) estimation. However, the intrinsic complexity of EHR data—manifested in its heterogeneity, sparsity, and temporal dynamics—poses significant analytical challenges that limit the generalizability and interpretability of conventional machine learning models. Recent methodological advancements in deep learning and graph-based learning, particularly Graph Neural Networks (GNNs), …

Learning From Non-Stationary Data Streams, Gabriel Jonas Aguiar

Theses and Dissertations

The rapid growth of data from sources such as mobile applications, sensors, and network monitoring has increased the need for machine learning algorithms capable of handling non-stationary data streams. However, learning from such streams presents significant challenges due to their evolving nature and the presence of concept drift. One of the most complex issues is learning from imbalanced data streams, where shifting data distributions, combined with feature space drifts, complicate continuous adaptation. These challenges become even more pronounced in multi-class scenarios, which are common in real-world applications. Detecting concept drift in such contexts is particularly demanding, as it requires tracking …

Multi-Lingual And Cross-Domain Frontiers In Machine-Generated Content Detection, Gurunameh Singh Chhatwal

Theses and Dissertations (Comprehensive)

The rapid advancement of generative artificial intelligence, particularly Large Language Models (LLMs) such as GPT-4 and their multilingual capabilities, has significantly blurred the distinction between human-authored and machine-generated content. This technological evolution introduces critical challenges concerning the detection and attribution of textual authenticity and authorship, exacerbating societal issues like misinformation proliferation and compromising academic and professional integrity. Traditional detection methodologies, predominantly monolingual and heuristic-based, have demonstrated inadequate generalizability and efficacy against the sophisticated, multilingual capabilities of contemporary generative models.

This thesis addresses two major problems arising from these advancements. Firstly, it introduces novel multilingual detection methodologies explicitly designed to differentiate …

Privshap: A Finer-Granularity Network Linearization Method For Private Inference, Xiangrui Xu, Zhenzhen Wang, Rui Ning, Chunsheng Xiu, Hongyi Wu

Computer Science Faculty Publications

Private inference applies cryptographic techniques like homomorphic encryption, garble circuit and secret sharing to keep both sides privacy in a client-server setting during inference. It is often hindered by the high communication overheads, especially at non-linear activation layers such as ReLU. Hence ReLU pruning has been widely recognized as an efficient way to accelerate private inference. Existing approaches to ReLU pruning typically rely on coarse hypothesis, which assume an inverse correlation between the importance of ReLU and linear layers or shallow activation layers have less importance for universal models, to assign the budgets according to the layer while preserving the …

Neural Topic Modeling Via Contextual And Graph Information Fusion, Jiyuan Liu, Jiaxing Yan, Chunjiang Zhu, Xingyu Liu, Qing Li, Yanghui Rao

Computer Science Faculty Publications

Topic modeling is a powerful unsupervised tool for knowledge discovery. However, existing work struggles with generating limited-quality topics that are uninformative and incoherent, which hindering interpretable insights from managing textual data. In this paper, we improve the original variational autoencoder framework by incorporating contextual and graph information to address the above issues. First, the encoder utilizes topic fusion techniques to combine contextual and bag-of-words information well, and meanwhile exploits the constraints of topic alignment and topic sharpening to generate informative topics. Second, we develop a simple word co-occurrence graph information fusion strategy that efficiently increases topic coherence. On three benchmark …

Decode The Workload: Training Deep Learning Models For Efficient Compute Cluster Representation, Ahmed Hossam Mohammed, Mark Jones, Diana Mcspadden, Malachi Schram, Bryan Hess, Kishansingh Rajput

Computer Science Faculty Publications

In this study, we address the mounting challenge of monitoring high throughput computing clusters running computationally intensive jobs, which increasingly strains system administrators. We develop autoencoders that analyze traces of Linux kernel CPU metrics to capture salient system features by producing robust compressed embeddings for various downstream tasks. In addition, we employ graph neural networks to incorporate contextual information from surrounding CPUs and assess their performance. We also demonstrate the enhanced job differentiation achieved by increasing the sampling rate of these traces. Our models are evaluated based on their ability to generate meaningful latent representations, detect anomalies, and distinguish between …

S²Il: Structurally Stable Incremental Learning, S. Balasubramanian, P. Yedu Krishna, Talasu Sai Sriram, M. Sai Subramaniam, Manepalli Pranav Phanindra Sai, Ravi Mukkamala

Computer Science Faculty Publications

Feature Distillation (FD) strategies are proven to be effective in mitigating Catastrophic Forgetting (CF) seen in Class Incremental Learning (CIL). However, current FD approaches enforce strict alignment of feature magnitudes and directions across incremental steps, limiting the model’s ability to adapt to new knowledge. In this paper, we propose Structurally Stable Incremental Learning (S²IL), a FD method for CIL that mitigates forgetting by focusing on preserving the overall spatial patterns of features which promote flexible (plasticity) yet stable representations that preserve old knowledge (stability). We also demonstrate that our proposed method S²IL achieves strong incremental accuracy and outperforms other FD …

Energy-Based Deep Incomplete Multi-View Clustering, Ziyu Wang, Yiming Du, Rui Ning, Lusi Li

Computer Science Faculty Publications

Incomplete multi-view clustering (IMVC) deals with real-world scenarios where certain views are partially missing, posing significant challenges to effective clustering. Most existing IMVC approaches face a trade-off: imputation-free methods suffer from information bias and imbalance, while full-imputation methods risk introducing and propagating noise. To overcome these limitations, we propose Energy-Based Deep Incomplete Multi-View Clustering (Energy-DIMC), a novel selective-imputation framework that leverages energy-based models (EBMs) to guide reliable imputations and robust clustering. EBMs assess data compatibility by assigning lower energy to more coherent structures, effectively modeling complex inter-view and inter-sample dependencies. Inspired by EBMs, Energy-DIMC integrates four key components: 1) a …

Cropsync: Ai-Powered Sustainable Crop Management, Ziad Doughan, Ibrahim Mneimneh, Zouheir Nakouzi, Noor Al Khaib, Samer Damaj, Jamal Chaaban, Hamza Mrad, Sari Itani

BAU Journal - Science and Technology

CropSync is a smart agriculture system that uses AI and IoT technologies to enable sustain- able crop management and precision farming. The system aims to address the challenges faced by the agriculture sector, such as increasing food production to meet global population demands while minimizing environmental impact. CropSync integrates sensors, cameras, and cloud-based analytics to provide farmers with real-time insights and recommendations for optimizing crop cul- tivation. The system upholds engineering professional and ethical standards, considering broader social, environmental, and economic implications. From a social perspective, CropSync improves food security and enhances farmers’ livelihoods through increased productivity and efficient re- …

Safety And Optimality Monitors For Learning-Enabled Systems Using Conformal Prediction, Jackson Cox

McKelvey School of Engineering Graduate Student Theses & Dissertations

The use of machine learning to create data-driven plant models and controllers has led to an increased need for safety and optimality monitors for model-based systems. System plant models are subject to uncertainty due to learning constraints such as unseen data and overfitting or physical constraints such as unknown dynamics and noise. This uncertainty is detrimental to safety-critical systems and must be properly regulated. To curb this uncertainty, we create prediction sets using the guarantees provided by Conformal Prediction. With a user-specified high probability, these prediction sets contain the true plant system states for an entire prediction horizon, which we …

Predictive Maintenance Analysis Of Turbofan Engine Sensor Data, Stanley A. Melkumian

The Journal of Purdue Undergraduate Research

Predictive maintenance in aviation and aerospace applications is among the most explored problems in machine learning (ML) and artificial intelligence (AI), and datasets such as NASA’s C-MAPPS turbofan engine degradation simulation data have proven invaluable, helping researchers explore numerous questions on engine performance, maintenance, and failure. The purpose of this study was to extend the current research on predicting the remaining useful life (RUL) of engines and their risk classification. Starting with simple yet under-investigated nonlinear survival and random forest models, the analysis implemented eXtreme Gradient Boosting (XGBoost) and long short-term memory (LSTM) from TensorFlow’s Keras library. For both regression …

Graph Neural Networks Powered Scientific Paper Recommendation, Junhao Shen

Computer Science and Engineering Theses and Dissertations

Scientific paper recommendation systems aim to help researchers discover relevant papers amidst the vast and ever-growing body of literature. With the exponential yearly increase in scientific publications, the demand for effective paper recommendation solutions has become both critical and increasingly challenging. In recent years, deep learning techniques have revolutionized recommender systems, and scientific paper recommendations have naturally integrated these advancements. In this dissertation, we address these challenges through three progressive contributions.

First, we enhance traditional content-based methods using Graph Neural Networks (GNNs) by introducing a Graph Convolutional Network-strengthened Topic Modeling (GCN-TM) approach. This method improves upon conventional topic modeling techniques …

Applications Of Neural Networks In Parkinson’S Disease Diagnosis, Saladin Minhaaj

Theses

Parkinson's disease (PD) is a complex and debilitating neurodegenerative disorder that affects millions of people worldwide. Early and accurate diagnosis is crucial for effective treatment and management of PD. This thesis explores the application of neural networks in PD diagnosis, leveraging their ability to learn patterns from large datasets and make accurate predictions.

Thesis provides an overview of PD, including its symptoms, diagnosis, and current challenges in diagnosis. We then delve into the fundamentals of neural networks, including supervised learning, mathematical interpretations, and parametric models. This research focuses on the development of neural network models that can accurately diagnose PD …

Basic Safety Message Generation Through A Video-Based Analytics For Potential Safety Application, Abyad Enan

All Theses

With the advancement of modern artificial intelligence techniques, computer vision can play a vital role in enhancing roadway safety by reducing the risk of imminent collisions. To do so, a vision-based safety application is required, where a roadside camera can monitor the roadway traffic and predict potential risks of crashes in real-time. If any risky situation or behavior is observed that may lead to a crash, then a safety application can send warnings to the vehicles at risk. For vision-based safety applications on a roadway section, it is important to accurately monitor each vehicle’s location, speed, acceleration, heading direction, etc. …

Enhancing Password Security And Memorability Using Machine Learning And Linguistic Patterns, Jared Wise

LSU New Orleans Theses and Dissertations

In the digital age, text-based passwords remain a primary method for securing online accounts. Yet, users frequently face a dilemma between creating passwords that are easy to remember and sufficiently secure against cyberattacks. This research introduces an approach to password generation that bridges this gap by utilizing linguistic patterns, particularly song lyrics, to develop highly secure and naturally memorable passwords. Using large lyric datasets gained from web scrapes from popular song lyric websites (AZ Lyrics, Genius), features are extracted from a corpus of over 5 million lyrics using sentence structure and natural language processing in a novel way. In using …

Addressing Ethical Issues In Healthcare Artificial Intelligence Using A Lifecycle-Informed Process, Benjamin X Collins, Jean-Christophe Bélisle-Pipon, Barbara J Evans, Kadija Ferryman, Xiaoqian Jiang, Camille Nebeker, Laurie Novak, Kirk Roberts, Martin Were, Zhijun Yin, Vardit Ravitsky, Joseph Coco, Rachele Hendricks-Sturrup, Ishan Williams, Ellen W Clayton, Bradley A Malin, Bridge2ai Ethics And Trustworthy Ai Working Group

Faculty, Staff and Student Publications

OBJECTIVES: Artificial intelligence (AI) proceeds through an iterative and evaluative process of development, use, and refinement which may be characterized as a lifecycle. Within this context, stakeholders can vary in their interests and perceptions of the ethical issues associated with this rapidly evolving technology in ways that can fail to identify and avert adverse outcomes. Identifying issues throughout the AI lifecycle in a systematic manner can facilitate better-informed ethical deliberation.

MATERIALS AND METHODS: We analyzed existing lifecycles from within the current literature for ethical issues of AI in healthcare to identify themes, which we relied upon to create a lifecycle …

Computational Representation, Analysis And Verification Of Requirements In Engineering Design And Systems Engineering, Chandan Kumar Sahu

All Dissertations

Systems are developed to satisfy a set of requirements derived from stakeholders’ needs, defining the problem space for which the system is created as a feasible solution. The system design process begins with eliciting these requirements and concludes with validating whether the created system meets them. Requirements engineering (RE) encompasses elicitation, representation, analysis, documentation, verification, and validation. However, challenges in RE, such as imprecision in natural language (NL), proprietary restrictions, and a lack of standardized quality metrics, hinder the creation of well-formed and comprehensive requirements. These challenges complicate formalization and analysis of requirements.

This dissertation addresses these challenges by proposing …

Decoding Neural Networks: An Information-Theoretic Guide To Interpretability, Error Analysis And Efficiency, Mackenzie J. Meni

Theses and Dissertations

This dissertation addresses critical challenges in neural network design by leveraging entropy-based techniques to improve model efficiency, interpretability, and bias reduction. Focusing on the unique demands of computer vision applications, particularly object detection and classification for real-time systems, this work introduces a series of innovative methods centered on information theory. At the core of these methods is the Probabilistic Explanations of Entropic Knowledge (PEEK) framework, a tool developed to analyze and visualize entropy distributions across feature maps. PEEK offers insights into information flow within neural networks, making it possible to pinpoint layers that contribute meaningfully to decision-making or identify those …

Dynamic Knowledge Elicitation: Leveraging Student Feedback For Improved Language Model Distillation, Reuven Muller

Master's Theses

Large Language Models (LLMs) have significantly advanced the field of natural language processing but remain resource-intensive and impractical for many organizations. Specialist models offer a viable alternative, often developed through Knowledge Distillation (KD) techniques. However, traditional KD methods rely on predefined static datasets to elicit knowledge from the teacher model, failing to dynamically address the weaknesses of the student model during training. This research introduces two novel methods for adaptive knowledge elicitation: Feedback-Driven Question Generation and Agent-Based Targeted Question Generation. These methods iteratively expand the training dataset based on the student model’s performance, leveraging a teacher model to generate targeted …

Video Label Refinement And Temporal Localization Using Motion Signal Patterns, Jennifer Piane

College of Computing and Digital Media Dissertations

Performing video analysis for activity recognition presents challenges beyond classification, including obtaining class labels and performing temporal localization. One such challenge is precisely labeling a video with class labels having the exact start and end frames of an activity - a difficult task for a human to perform. Moreover, the task of annotating a video at any level of precision can quickly become tedious, impacting the attentiveness of the annotator and resulting in class label errors. Temporally localizing an activity within a video presents a second challenge. This dissertation investigates novel signal and image processing methods for motion features extracted …

Key Technology Selection And Countermeasures To Promote Full Lifecycle Data Governance, Yuyao Feng, Hongyun Zhang, Pengfei Wang, Jianping Li, Zongben Xu

Bulletin of Chinese Academy of Sciences (Chinese Version)

In recent years, the digital economy, driven by data as a critical element, has developed rapidly. Nevertheless, China’s progress in data factorization and valorization is still at a preliminary stage. The data governance system remains underdeveloped, with numerous challenges and technical issues arising in the full lifecycle governance of data, including supply, circulation, application, and security protection. Against this backdrop, this study analyzes the primary technical bottlenecks encountered during the modernization of China’s data governance framework. By employing bibliometric analysis, patent data analysis, Delphi surveys, and expert opinions, a critical technology list to support the modernization of data governance in …