Computer Sciences Commons^™

Learning From Non-Stationary Data Streams, Gabriel Jonas Aguiar

Theses and Dissertations

The rapid growth of data from sources such as mobile applications, sensors, and network monitoring has increased the need for machine learning algorithms capable of handling non-stationary data streams. However, learning from such streams presents significant challenges due to their evolving nature and the presence of concept drift. One of the most complex issues is learning from imbalanced data streams, where shifting data distributions, combined with feature space drifts, complicate continuous adaptation. These challenges become even more pronounced in multi-class scenarios, which are common in real-world applications. Detecting concept drift in such contexts is particularly demanding, as it requires tracking …

Impact Of Urban Development On Uv Exposure: A Clustering And Machine Learning Assessment, Taufik Roni Sahroni Mr., Verdi Yasin, Lulut Alfaris, Reza Ariefka, Ruben Cornelius Siagian, Mohammad Alfin Karim, Nana Rahdiana, Ade Suhara

Journal of Environmental Science and Sustainable Development

The relocation of Indonesia's capital city is anticipated to promote inclusive economic growth while embracing cultural diversity. However, this transition may affect ultraviolet (UV) radiation exposure patterns. The study investigated variations in UV exposure in the IKN region, focusing on urban development factors such as land use and population density that affect public health, sun protection, and skin cancer prevention. The research hypothesized that UV radiation is significantly correlated with these factors. UV Index data from 2010-2023, a hierarchical clustering method, identifies complex data patterns without determining the number of clusters. XGBoost, a machine learning model, was used for handling …

Advanced Models For Linking Process In Data Washing Machine, Bushra Sajid

Theses and Dissertations

Entity Resolution (ER) is a critical process in data integration and quality improvement that identifies and links multiple records referring to the same real-world entity. As data volumes and heterogeneity increase, traditional ER methods face new challenges, prompting research into more advanced techniques. The Proof-of-Concept Data Washing Machine (DWM), developed under the NSF DART Data Life Cycle and Curation research theme, aims to automatically detect and correct data quality errors through unsupervised entity resolution. Recent research focuses on enhancing DWM's effectiveness by replacing rule-based methods with machine learning and deep learning approaches, particularly in the linking process. Deep learning models, …

How Does Augmentation Affect Feature Space: A Study Using Various Augmentation Methods In Distributed Learning, Nikil Sharan Prabahar Balasubramanian

Computer Science Theses

This thesis examines the impact of data augmentation techniques on model performance within a distributed learning framework, focusing on enhancing feature diversity and improving representation for under-represented classes. Data augmentation, commonly used to address data imbalance, significantly influences the feature space learned by deep learning models, with varied effects in distributed settings where data is split across nodes. Our study reveals that inconsistencies in feature learning across nodes reduce the benefits of local augmentation in capturing complex patterns, leading to suboptimal model performance. To address this, we propose a coherent augmentation approach that embeds consistent transformations in the central server, …

Applying Positive Unlabeled Learning Techniques And Using The Kullback-Leibler Divergence To Improve Geothermal Surveying Assessments, Martín Thomas Rodriguez

Dissertations and Theses

As we face the current climate crisis, the discovery of geothermal energy resources has the potential to greatly reduce our dependence on fossil fuels worldwide. However, the development of any new energy infrastructure is expensive and depends on the willingness of energy agencies and developers to make initial investments based on calculated risk measures. One such measure, called geothermal favorability, is the likelihood that a site has conditions favorable for geothermal systems containing recoverable energy potential. Its prediction from existing geophysical datasets proves to be a nontrivial task. The prediction of geothermal favorability can be framed as a binary classification …

Graph Neural Networks Powered Scientific Paper Recommendation, Junhao Shen

Computer Science and Engineering Theses and Dissertations

Scientific paper recommendation systems aim to help researchers discover relevant papers amidst the vast and ever-growing body of literature. With the exponential yearly increase in scientific publications, the demand for effective paper recommendation solutions has become both critical and increasingly challenging. In recent years, deep learning techniques have revolutionized recommender systems, and scientific paper recommendations have naturally integrated these advancements. In this dissertation, we address these challenges through three progressive contributions.

First, we enhance traditional content-based methods using Graph Neural Networks (GNNs) by introducing a Graph Convolutional Network-strengthened Topic Modeling (GCN-TM) approach. This method improves upon conventional topic modeling techniques …

Using Llms To Establish Implicit User Sentiment Of Software Desirability, Sherri Weitl-Harms, John D. Hastings, Jonah Lum

Research & Publications

This study explores the use of LLMs for providing quantitative zero-shot sentiment analysis of implicit software desirability, addressing a critical challenge in product evaluation where traditional review scores, though convenient, fail to capture the richness of qualitative user feedback. Innovations include establishing a method that 1) works with qualitative user experience data without the need for explicit review scores, 2) focuses on implicit user satisfaction, and 3) provides scaled numerical sentiment analysis, offering a more nuanced understanding of user sentiment, instead of simply classifying sentiment as positive, neutral, or negative.

Data is collected using the Microsoft Product Desirability Toolkit (PDT), …

Enhancing Password Security And Memorability Using Machine Learning And Linguistic Patterns, Jared Wise

LSU New Orleans Theses and Dissertations

In the digital age, text-based passwords remain a primary method for securing online accounts. Yet, users frequently face a dilemma between creating passwords that are easy to remember and sufficiently secure against cyberattacks. This research introduces an approach to password generation that bridges this gap by utilizing linguistic patterns, particularly song lyrics, to develop highly secure and naturally memorable passwords. Using large lyric datasets gained from web scrapes from popular song lyric websites (AZ Lyrics, Genius), features are extracted from a corpus of over 5 million lyrics using sentence structure and natural language processing in a novel way. In using …

A Machine Learning Approach For Estimating Evapotranspiration For Urban Landscaping Vegetation In Semi-Arid Regions, Damian Lorenzo Gallegos Espinoza

Open Access Theses & Dissertations

Water management is important for residents in semi-arid urban areas due to increasing demand, water scarcity, and rising costs. It is estimated that in semi-arid regions, 40-70% of the household water consumption is used in landscaping. Therefore, urban landscaping water use can substantially contribute to water conservation. This work aims to estimate the water needs of urban landscaping vegetation to inform residents in semi-arid regions.Evapotranspiration indicates water and energy exchange between the atmosphere, soil, and vegetation. This interaction depends on solar radiation, evaporation, transpiration, and other biophysical parameters. Evapotranspiration has become a reference for water management in agriculture (e.g., crop …

Computational Representation, Analysis And Verification Of Requirements In Engineering Design And Systems Engineering, Chandan Kumar Sahu

All Dissertations

Systems are developed to satisfy a set of requirements derived from stakeholders’ needs, defining the problem space for which the system is created as a feasible solution. The system design process begins with eliciting these requirements and concludes with validating whether the created system meets them. Requirements engineering (RE) encompasses elicitation, representation, analysis, documentation, verification, and validation. However, challenges in RE, such as imprecision in natural language (NL), proprietary restrictions, and a lack of standardized quality metrics, hinder the creation of well-formed and comprehensive requirements. These challenges complicate formalization and analysis of requirements.

This dissertation addresses these challenges by proposing …

Addressing Inference Time Of Machine Learning Models In Embedded Systems, Samuel Black

UNLV Theses, Dissertations, Professional Papers, and Capstones

Embedded Systems are used for a wide range of specialized computing purposes including surveyal, safety, security, and quality of life. Many areas that embedded systems are used in require the use of machine learning models. Constraints can be placed on embedded systems. Timeliness of execution, user satisfaction, security, power, and resource limitations must be considered when designing for embedded systems. Neural networks excel at complex tasks that are otherwise intractable, but their relatively high computational cost poses a challenge for inclusion in embedded systems. Neural network architectures should be optimized to reduce the total number of operations performed while maintaining …

Artificial Intelligence And Machine Learning In Cancer Pain: A Systematic Review, Vivian Salama, Brandon Godinich, Yimin Geng, Laia Humbert-Vidan, Laura Maule, Kareem A Wahid, Mohamed A Naser, Renjie He, Abdallah S R Mohamed, Clifton D Fuller, Amy C Moreno

Faculty, Staff and Student Publications

Background/objectives: Pain is a challenging multifaceted symptom reported by most cancer patients. This systematic review aims to explore applications of artificial intelligence/machine learning (AI/ML) in predicting pain-related outcomes and pain management in cancer.

Methods: A comprehensive search of Ovid MEDLINE, EMBASE and Web of Science databases was conducted using terms: "Cancer," "Pain," "Pain Management," "Analgesics," "Artificial Intelligence," "Machine Learning," and "Neural Networks" published up to September 7, 2023. AI/ML models, their validation and performance were summarized. Quality assessment was conducted using PROBAST risk-of-bias andadherence to TRIPOD guidelines.

Results: Forty four studies from 2006 to 2023 were included. Nineteen studies used …

Real-Time Network Simulations For Ml/Dl Ddos Detection Using Docker, Luis D. Garcia

Master's Theses

As the integration of artificial intelligence (AI) within cybersecurity continues to

grow, machine learning (ML) and deep learning (DL) models are increasingly used to

detect cyber attacks. However, these models are rarely evaluated in real-time attack

scenarios to see how subtle changes from the real networking environment can affect

their predictions. To address this issue, we propose a scalable, platform-independent

Docker testbed specifically designed for simulating real-time Distributed Denial of

Service (DDoS) attack scenarios that allows researchers to deploy and evaluate their

pre-trained, ML and DL detection models. Our framework is simple to configure

and can run across Intel and …

Improving Students’ Cognitive Abilities In Remote Learning Environment Using Brain Computer Interface And Eye-Tracking, Nuraini Jamil

Thesis/ Dissertation Defenses

Attention and cognitive engagement are crucial factors in remote learning environments, where the absence of physical presence often diminishes learning outcomes. Traditional methods for assessing these cognitive states, such as observation and self-reporting, are limited by subjectivity and inefficiency. Automated solutions, particularly those based on biometric data like EEG and eye-tracking, offer a more accurate and scalable alternative. However, developing robust systems that leverage biometric data in real-time presents significant challenges. These include handling large volumes of complex data, ensuring low-latency processing, and adapting machine learning models to diverse learning environments and individual cognitive states. Additionally, the integration of neurofeedback …

Competitive Conquest: Charting The Climb To Pokémon Supremacy, Robert Dilworth

BCoE Publications

This manuscript presents a comprehensive exploration of optimizing Pokémon gameplay through data-driven methodologies, aimed at enhancing competitive performance in high-stakes environments. In the first section, we introduce a robust Pokémon teambuilding algorithm that leverages statistical analysis of championship-winning compositions. By employing multiple linear regression techniques, we predict team performance based on critical factors such as Base Stat Totals (BSTs) and various coverage types. This integration of data science principles into Pokémon strategy underscores the importance of offensive capabilities over defensive considerations, ultimately contributing to advancements in teambuilding strategies. Our proficiency in R programming facilitated the development of an efficient codebase …

Permission Recommendation For Android Applications: Leveraging Natural Language Processing On App Descriptions, Saeed Salem Al Shebli

Thesis/ Dissertation Defenses

This study develops an NLP-based system to recommend essential permissions for Android apps by analyzing app descriptions. It leverages advanced models, including LSTM and ensemble techniques, to align permissions with app functionality while minimizing unnecessary requests.

Enhancing Post Silicon Visibility Using Language Modelling Techniques, Nathaniel Joseph Fender

USF Tampa Graduate Theses and Dissertations

The debugging phase is a critical time in the development of a new system on chip product. Specifically, the post-silicon validation phase is one of the most important, as it allows engineers to test the behavior of a device in a real world setting. However, the issue of noisy or incomplete data is a frequent issue when attempting to debug an SoC design during this step. This thesis examines the utility of utilizing machine learning models for the purpose of repairing missing data in a system trace. We trained various models using the transformer architecture to identify missing data in …

Effect Of Virtual Reality Technology On Computer Science/Engineering Based Laboratories Education – A Case Study, Saeed Salem Al Shebli

Theses

The rapid growth in mobile applications raises critical concerns about the security of apps and users' privacy, especially in permission control. Mobile apps access sensitive information of users, and the current cybersecurity landscape faces a huge challenge in ensuring the least required permissions are granted. This research focuses on designing an advanced permission recommendation system that couples the strengths of Natural Language Processing (NLP) and Machine Learning (ML) in solving most of the existing gaps in permission management, thus guiding which permissions are mostly needed by Android applications.

The research thus follows a multi-classification approach, integrating state-of-the-art ML techniques with …

A Large Scale Multi Institutional Study For Radiomics Driven Machine Learning For Meningioma Grading, Mert Karabacak, Shiv Patil, Rui Feng, Raj K. Shrivastava, Konstantinos Margetis

Department of Medicine Faculty Papers

This study aims to develop and evaluate radiomics-based machine learning (ML) models for predicting meningioma grades using multiparametric magnetic resonance imaging (MRI). The study utilized the BraTS-MEN dataset's training split, including 698 patients (524 with grade 1 and 174 with grade 2-3 meningiomas). We extracted 4872 radiomic features from T1, T1 with contrast, T2, and FLAIR MRI sequences using PyRadiomics. LASSO regression reduced features to 176. The data was split into training (60%), validation (20%), and test (20%) sets. Five ML algorithms (TabPFN, XGBoost, LightGBM, CatBoost, and Random Forest) were employed to build models differentiating low-grade (grade 1) from high-grade …

What Do We Know About Hugging Face? A Systematic Literature Review And Quantitative Validation Of Qualitative Claims, Jason Jones, Wenxin Jiang, Nicholas Synovic, George K. Thiruvathukal, James C. Davis

Computer Science: Faculty Publications and Other Works

Background: Collaborative Software Package Registries (SPRs) are an integral part of the software supply chain. Much engineering work synthesizes SPR package into applications. Prior research has examined SPRs for traditional software, such as NPM (JavaScript) and PyPI (Python). Pre-Trained Model (PTM) Registries are an emerging class of SPR of increasing importance, because they support the deep learning supply chain.
Aims: Recent empirical research has examined PTM registries in ways such as vulnerabilities, reuse processes, and evolution. However, no existing research synthesizes them to provide a systematic understanding of the current knowledge. Some of the existing research includes qualitative …

Bi-Directional Transformers Vs. Word2vec: Discovering Vulnerabilities In Lifted Compiled Code, Gary Mccully, John Hastings, Shengjie Xu, Adam Fortier

Research & Publications

Detecting vulnerabilities within compiled binaries is challenging due to lost high-level code structures and other factors such as architectural dependencies, compilers, and optimization options. To address these obstacles, this research explores vulnerability detection using natural language processing (NLP) embedding techniques with word2vec, BERT, and RoBERTa to learn semantics from intermediate representation (LLVM IR) code. Long short-term memory (LSTM) neural networks were trained on embeddings from encoders created using approximately 48k LLVM functions from the Juliet dataset. This study is pioneering in its comparison of word2vec models with multiple bidirectional transformers (BERT, RoBERTa) embeddings built using LLVM code to train neural …

Confronting The Reproducibility Crisis: A Case Study Of Challenges In Cybersecurity Ai, Richard H. Moulton, Gary A. Mccully, John D. Hastings

Research & Publications

In the rapidly evolving field of cybersecurity, ensuring the reproducibility of AI-driven research is critical to maintaining the reliability and integrity of security systems. This paper addresses the reproducibility crisis within the domain of adversarial robustness—a key area in AI-based cybersecurity that focuses on defending deep neural networks against malicious perturbations. Through a detailed case study, we attempt to validate results from prior work on certified robustness using the VeriGauge toolkit, revealing significant challenges due to software and hardware incompatibilities, version conflicts, and obsolescence. Our findings underscore the urgent need for standardized methodologies, containerization, and comprehensive documentation to ensure the …

Surrogate Models For Stress-Strain Mapping Of Microscale Physics, Samuel Roach, Dr. Eric Ocegueda

College of Engineering Summer Undergraduate Research Program

•Learn the difference between different neural networks within machine learning (ML) •Develop a working understanding of the ML tool Pytorch and machine learning operator: Recurrent Neural Operator •Use MATLAB to create and process time dependent stress/strain matrices to display the hyper-parameters for different RNOs •Apply RNO to train the strain-stress mapping of tri-laminate and granular cases

A Guideline For Open-Source Tools To Make Medical Imaging Data Ready For Artificial Intelligence Applications: A Society Of Imaging Informatics In Medicine (Siim) Survey, Sanaz Vahdati, Bardia Khosravi, Elham Mahmoudi, Kuan Zhang, Pouria Rouzrokh, Shahriar Faghani, Mana Moassefi, Aylin Tahmasebi, Katherine Andriole, Peter Chang, Keyvan Farahani, Mona Flores, Les Folio, Sina Houshmand, Maryellen Giger, Judy Gichoya, Bradley Erickson

Department of Radiology Faculty Papers

In recent years, the role of Artificial Intelligence (AI) in medical imaging has become increasingly prominent, with the majority of AI applications approved by the FDA being in imaging and radiology in 2023. The surge in AI model development to tackle clinical challenges underscores the necessity for preparing high-quality medical imaging data. Proper data preparation is crucial as it fosters the creation of standardized and reproducible AI models while minimizing biases. Data curation transforms raw data into a valuable, organized, and dependable resource and is a fundamental process to the success of machine learning and analytical projects. Considering the plethora …

Rethinking Retrieval Augmented Fine-Tuning In An Evolving Llm Landscape, Nicholas Sager, Timothy Cabaza, Matthew Cusack, Ryan Bass, Joaquin Dominguez

SMU Data Science Review

This study explores the utilization of Retrieval Augmented Fine-Tuning (RAFT) to enhance the performance of Large Language Models (LLMs) in domain-specific Retrieval Augmented Generation (RAG) tasks. By integrating domain-specific information during the retrieval process, RAG aims to reduce hallucination and improve the accuracy of LLM outputs. We investigate the use of RAFT, an approach that enhances LLMs by incorporating domain-specific knowledge and effectively handling distractor documents. This paper validates previous work, which found that RAFT can considerably improve the performance of Llama2-7B in specific domains. We also expand upon previous work into new state-of-the-art open-source models and other datasets with …

Leveraging Generative Ai For Sustainable Farm Management Techniques Correspond To Optimization And Agricultural Efficiency Prediction, Samira Samrose

All Graduate Reports and Creative Projects, Fall 2023 to Present

Sustainable farm management practice is a multifaceted challenge. Uncovering the optimal state for production while reduction of environmental negative impacts and guaranteed inter-generational assets supervision needs balanced management. Also, considering lots of different factors (cost, profit, employment etc), the agricultural based management technique requires rigorous concentration. In this project machine learning models are applied to develop, achieve and improve the farm management techniques. This experiment ensures the resultant impacts being environment friendly and necessary resource availability and efficiency. Predicting the type of crop and rotational recommendations will disclose potentiality of productive agricultural based farming. Additionally, this project is designed to …

Neural Networks For Decisions Under Uncertainty, Edwin Tomy George

Open Access Theses & Dissertations

Neural networks are used in many real-world applications, ranging from classification tasks to medical diagnostics. For each task, a neural network is typically able to make predictions due to its ability to extract meaningful patterns from processing large amounts of data. Thus, given the increases in available data in recent decades, the performance of neural networks in making accurate predictions has greatly increased. However, this data often comes with ingrained uncertainties due to measurement errors or the inherent variability of individual data points. Neural networks can learn despite the errors in the overall data, but what if we want them …

Physics-Informed Machine Learning Methods For Inverse Design Of Multi-Phase Materials With Targeted Mechanical Properties, Yunpeng Wu

All Dissertations

Advances in machine learning algorithms and applications have significantly enhanced engineering inverse design capabilities. This work focuses on the machine learning-based inverse design of material microstructures with targeted linear and nonlinear mechanical properties. It involves developing and applying predictive and generative physics-informed neural networks for both 2D and 3D multiphase materials.

The first investigation aims to develop a machine learning method for the inverse design of 2D multiphase materials, particularly porous materials. We first develop machine learning methods to understand the implicit relationship between a material's microstructure and its mechanical behavior. Specifically, we use ResNet-based models to predict the elastic …

Genomic Data Science Approaches For Understanding Human Diseases, Snehal Shah

All Dissertations

The intricate interplay of genetic predisposition, environmental influences, and lifestyle acts as the multifactorial landscape of diseases. Understanding this complexity presents a significant challenge. Molecular insights into disease mechanisms, particularly the interactions of DNA, RNA, and proteins with environmental and lifestyle factors, have revolutionized disease diagnosis, prognosis, and treatment. High-throughput technologies, such as next-generation sequencing, generate large amounts of molecular data, holding a wealth of knowledge. These datasets unveil the roles of genes and their interactions with various factors through analysis, shedding light on previously unknown molecular mechanisms underlying disease pathogenesis. Furthermore, they facilitate the discovery of biomarkers crucial for …

Exploring A Multimodal Fusion-Based Deep Learning Network For Detecting Facial Palsy, Heng Yim Nicole Oo, Min Hun Lee, J. H. Lim

Research Collection School Of Computing and Information Systems

Algorithmic detection of facial palsy offers the potential to improve current practices, which usually involve labor-intensive and subjective assessment by clinicians. In this paper, we present a multimodal fusion-based deep learning model that utilizes unstructured data (i.e. an image frame with facial line segments) and structured data (i.e. features of facial expressions) to detect facial palsy. We then contribute to a study to analyze the effect of different data modalities and the benefits of a multimodal fusion-based approach using videos of 21 facial palsy patients. Our experimental results show that among various data modalities (i.e. unstructured data - RGB images …