Computer Sciences Commons^™

Semantic Segmentation Of Point Cloud Sequences Using Point Transformer V3, Marion Sisk

Master's Theses

Semantic segmentation of point clouds is a basic step for many autonomous systems including automobiles. In autonomous driving systems, LiDAR sensors are frequently used to produce point cloud sequences that allow the system to perceive the environment and navigate safely. Modern machine learning techniques for segmentation have predominately focused on single-scan segmentation, however sequence segmentation has often proven to perform better on common segmentation metrics. Using the popular Semantic KITTI dataset, we show that by providing point cloud sequences to a segmentation pipeline based on Point Transformer v3, we increase the segmentation performance between seven and fifteen percent when compared …

Designing For Deployable, Secure, And Generic Machine Learning Systems, Li-Yun Wang

Dissertations and Theses

Machine learning systems have catalyzed numerous image-centric applications owing to the significant achievements of machine learning algorithms and models. While these systems have showcased the efficacy of machine learning models, certain challenges persist, such as machine learning system design and security vulnerabilities inherent in deep neural networks. Moreover, the deployment of deep neural network models remains a significant hurdle. This dissertation introduces a multimedia prototyping framework tailored for visual analytical applications, improving the reusability of video analysis software tools with minimal performance overhead. Furthermore, we present novel image-processing techniques designed to bolster the robustness of deep neural networks and propose …

Sign-A-Mander: A Mobile App That Enhances Asl Learning With Computer Vision, Sandrine Adap

Honors Theses

Several machine learning researchers have developed algorithms recognizing American Sign Language (ASL), but few have applied the algorithms to real-world situations, such as with portable ASL learning applications. This project develops a beta version of a mobile application designed to allow beginner ASL learners to practice basic ASL vocabulary and receive feedback about their signing accuracy. Building on Dongxu Li et al.’s I3D sign language recognition algorithm and 2000-word dataset, the app seeks to determine whether the I3D algorithm can sufficiently recognize a user’s motions when recorded from a mobile device and accurately classify whether or not the user signed …

Asl-Catboost Method For Wind Turbine Fault Detection Integrated With Digital Twin, Hongtao Liang, Lingchao Kong, Guozhu Liu, Wenxuan Dong, Xiangyi Liu

Journal of System Simulation

Abstract: In view of the low visibility of the current wind farm status monitoring and insufficient realtime operation and maintenance, based on the concept of digital twin five-dimensional model, the framework of wind farm digital twin five-dimensional model is constructed. Aiming at the insufficient fault detection capability of traditional algorithms and unbalanced positive and negative samples in fan fault data set, the improved ASL-CatBoost algorithm is proposed to achieve the accurate detection of fan fault status. Based on the digital twinning platform, combined with MATLAB/Simulink, the simulation mathematical model of doubly-fed wind turbine under the condition of blade mass imbalance …

Context-Aware Affective Behavior Modeling And Analytics, Md Taufeeq Uddin

USF Tampa Graduate Theses and Dissertations

Affective computing (AC) is a sub-domain of AI that has the potential to assist people by assessing mental states and making appropriate recommendations to patients, loved ones, caregivers, and domain experts. Humans usually produce an enormous amount of data (such as face videos) every day. One of the major challenges for affective computer vision is to efficiently deal with high volumes of data to facilitate automated model development. To cope with this challenge, we developed computer vision algorithms that measure the expressivity of the human face from video data. More precisely, the developed algorithms can map complex affect information from …

Cardiogpt: An Ecg Interpretation Generation Model, Guohua Fu, Jianwei Zheng, Islam Abudayyeh, Chizobam Ani, Cyril Rakovski, Louis Ehwerhemuepha, Hongxia Lu, Yongjuan Guo, Shenglin Liu, Huimin Chu, Bing Yang

Mathematics, Physics, and Computer Science Faculty Articles and Research

Numerous supervised learning models aimed at classifying 12-lead electrocardiograms into different groups have shown impressive performance by utilizing deep learning algorithms. However, few studies are dedicated to applying the Generative Pre-trained Transformer (GPT) model in interpreting electrocardiogram (ECG) using natural language. Thus, we are pioneering the exploration of this uncharted territory by employing the CardioGPT model to tackle this challenge. We used a dataset of ECGs (standard 10s, 12-channel format) from adult patients, with 60 distinct rhythms or conduction abnormalities annotated by board-certified, actively practicing cardiologists. The ECGs were collected from The First Affiliated Hospital of Ningbo University and Shanghai …

Redefining Readiness: Higher Education's Role In An Ai World How Higher Education Can Bridge The Gap Between Human Talent And Machine Intelligence For The Workforce Of Tomorrow, Paloma Shelton

Honors 499 Theses and Creative Projects

As the world changes all around us in the landscape of Artificial Intelligence (AI), our educational pathways need to adapt quickly. This paper presents a comprehensive analysis of the current and future state of higher education, its relationship with AI and technology, and the evolving requirements of the workforce. It outlines the historical progression of higher education since the Colonial Era, emphasizing the need for constant adaptation to societal and economic demands. It reflects how higher education must evolve to equip students with the necessary skills and adaptability for future careers in the digital and AI-augmented landscape. As AI advances …

Enhancing Rotating Machinery Fault Diagnosis: A Dual-Head Attention Mechanism In Deep Learning Neural Networks, Qing Snyder

Dissertations

Rotating machinery is crucial to production efficiency and safety in manufacturing industries for an extended time. Ensuring machinery reliability necessitates effective diagnostic systems, particularly for rotating bearings, the key components of such equipment. Fault diagnosis in rotating machinery is essential to prevent failures and minimize downtime, thereby playing an important role in industrial operations. The application of advanced neural network techniques in industry has risen recently. Among these, attention-based neural networks, especially the Transformer models, are originally noteworthy for their sequential data handling capability. This research delves into attention-based algorithms for rotating machinery fault diagnosis, signifying a substantial advancement in …

Predicting Biomolecular Properties And Interactions Using Numerical, Statistical And Machine Learning Methods, Elyssa Sliheet

Mathematics Theses and Dissertations

We investigate machine learning and electrostatic methods to predict biophysical properties of proteins, such as solvation energy and protein ligand binding affinity, for the purpose of drug discovery/development. We focus on the Poisson-Boltzmann model and various high performance computing considerations such as parallelization schemes.

Multi-Aspect Rule-Based Ai: Methods, Taxonomy, Challenges And Directions Towards Automation, Intelligence And Transparent Cybersecurity Modeling For Critical Infrastructures, Iqbal H. Sarker, Helge Janicke, Mohamed A. Ferrag, Alsharif Abuadbba

Research outputs 2022 to 2026

Critical infrastructure (CI) typically refers to the essential physical and virtual systems, assets, and services that are vital for the functioning and well-being of a society, economy, or nation. However, the rapid proliferation and dynamism of today's cyber threats in digital environments may disrupt CI functionalities, which would have a debilitating impact on public safety, economic stability, and national security. This has led to much interest in effective cybersecurity solutions regarding automation and intelligent decision-making, where AI-based modeling is potentially significant. In this paper, we take into account “Rule-based AI” rather than other black-box solutions since model transparency, i.e., human …

Time Series Models For Predicting Application Gpu Utilization And Power Draw Based On Trace Data, Dorothy Xiaoshuang Parry

Electrical & Computer Engineering Theses & Dissertations

This work explores collecting performance metrics and leveraging various statistical and machine learning time series predictive models on a memory-intensive application, Inception v3. Trace data collected using nvidia-smi measured GPU utilization and power draw for two runs of Inception3. Experimental results from the statistical and machine learning-based time series predictive algorithms showed that the predictions from statistical-based models were unable to capture the complex changes in the trace data. The Probabilistic TNN model provided the best results for the power draw trace, according to the test evaluation metrics. For the GPU utilization trace, the RNN models produced the most accurate …

Development Of An Explainable Artificial Intelligence Model For Asian Vascular Wound Images, Zhiwen Joseph Lo, Malcolm Han Wen Mak, Shanying Liang, Yam Meng Chan, Cheng Cheng Goh, Tina Peiting Lai, Audrey Hui Min Tan, Patrick Thng, Patrick Thng, Tillman Weyde, Sylvia Smit

Research Collection School Of Computing and Information Systems

Chronic wounds contribute to significant healthcare and economic burden worldwide. Wound assessment remains challenging given its complex and dynamic nature. The use of artificial intelligence (AI) and machine learning methods in wound analysis is promising. Explainable modelling can help its integration and acceptance in healthcare systems. We aim to develop an explainable AI model for analysing vascular wound images among an Asian population. Two thousand nine hundred and fifty-seven wound images from a vascular wound image registry from a tertiary institution in Singapore were utilized. The dataset was split into training, validation and test sets. Wound images were classified into …

Advanced Machine Learning Approaches For Predicting Mental Health Disorders Following Long Covid Diagnosis, Manoj Purohit

Master's Theses (2009 -)

After the global spread of COVID-19, the enduring effects of Long COVID and its health implications have emerged as a significant global issue, affecting people worldwide. The lingering symptoms post a COVID-19 infection can significantly affect individuals who had previously contracted the virus, exerting considerable influence over their mental well-being. Prolonged recuperation associated with Long COVID has been connected with the emergence of symptoms such as depression and anxiety, all of which can have adverse effects on emotional health. This project delves into an in-depth analysis of healthcare data pertaining to Long COVID from the Froedtert Health (FH) Medical System …

Network Level Detection Of Iot Attacks Via Time Series Shape Mining, Srijani Basu

Masters Theses

This research proposes a method, for detecting intrusions in the Internet of Things (IoT) realm. This approach was specifically tested using datasets containing both benign, and attacks on smart home devices like the Belkin Wemo Power Switch, Lifx Smart Bulb, Amazon Echo, and Netatmo Welcome Camera. These attacks consist of specification-compliant volumetric DDoS attacks, which can be both direct and reflective, with very low traffic volumes implemented in an ON-OFF pattern. Here, the ON-OFF pattern can be referred to as a pulse attack strategy.

We combined non-linear statistical moving averages, and Dynamic Time Warping into a single framework that can …

A Computer Vision Solution To Cross-Cultural Food Image Classification And Nutrition Logging​, Rohan Sethi, George K. Thiruvathukal

Computer Science: Faculty Publications and Other Works

The US is a culturally and ethnically diverse country, and with this diversity comes a myriad of cuisines and eating habits that expand well beyond that of western culture. Each of these meals have their own good and bad effects when it comes to the nutritional value and its potential impact on human health. Thus, there is a greater need for people to be able to access the nutritional profile of their diverse daily meals and better manage their health. A revolutionary solution to democratize food image classification and nutritional logging is using deep learning to extract that information from …

Preserving Linguistic Diversity In The Digital Age: A Scalable Model For Cultural Heritage Continuity, James Hutson, Pace Ellsworth, Matt Ellsworth

Faculty Scholarship

In the face of the rapid erosion of both tangible and intangible cultural heritage globally, the urgency for effective, wide-ranging preservation methods has never been greater. Traditional approaches in cultural preservation often focus narrowly on specific niches, overlooking the broader cultural tapestry, particularly the preservation of everyday cultural elements. This article addresses this critical gap by advocating for a comprehensive, scalable model for cultural preservation that leverages machine learning and big data analytics. This model aims to document and archive a diverse range of cultural artifacts, encompassing both extraordinary and mundane aspects of heritage. A central issue highlighted in the …

Artificial Intelligence Usage And Data Privacy Discoveries Within Mhealth, Jennifer Schulte

Research & Publications

Advancements in artificial intelligence continue to impact nearly every aspect of human life by providing integration options that aim to supplement or improve current processes. One industry that continues to benefit from artificial intelligence integration is healthcare. For years now, elements of artificial intelligence have been used to assist in clinical decision making, helping to identify potential health risks at earlier stages, and supplementing precision medicine. An area of healthcare that specifically looks at wearable devices, sensors, phone applications, and other such devices is mobile health (mHealth). These devices are used to aid in health data collection and delivery. This …

Using Chatgpt To Generate Gendered Language, Shweta Soundararajan, Manuela Nayantara Jeyaraj, Sarah Jane Delany

Conference papers

Gendered language is the use of words that denote an individual's gender. This can be explicit where the gender is evident in the actual word used, e.g. mother, she, man, but it can also be implicit where social roles or behaviours can signal an individual's gender - for example, expectations that women display communal traits (e.g., affectionate, caring, gentle) and men display agentic traits (e.g., assertive, competitive, decisive). The use of gendered language in NLP systems can perpetuate gender stereotypes and bias. This paper proposes an approach to generating gendered language datasets using ChatGPT which will provide data for data-driven …

Construction Of Machine Learning Data Set For Analyzing The Replay Of The Wargaming, Dayong Zhang, Jingyu Yang, Jun Ma, Chenye Song

Journal of System Simulation

Abstract: The first problem to be solved in the application of machine learning to the analysis of the replay of the wargaming is the construction of data sets. Due to the standardization requirements of machine learning for data structure, as well as the limitations of computing power and storage, building a machine learning data set through the wargaming data still faces many problems in terms of how to describe the wargaming situation, how to describe the wargaming process, how to handle high dimensional data, and how to prevent data distortion. To solve these problems, this paper constructs a mapping model …

Detecting Anomalies In Time Series Using Kernel Density Approaches, Robin Frehner, Kesheng Wu, Alexander Sim, Jinoh Kim

Faculty Publications

This paper introduces a novel anomaly detection approach tailored for time series data with exclusive reliance on normal events during training. Our key innovation lies in the application of kernel-density estimation (KDE) to scrutinize reconstruction errors, providing an empirically derived probability distribution for normal events post-reconstruction. This non-parametric density estimation technique offers a nuanced understanding of anomaly detection, differentiating it from prevalent threshold-based mechanisms in existing methodologies. In post-training, events are encoded, decoded, and evaluated against the estimated density, providing a comprehensive notion of normality. In addition, we propose a data augmentation strategy involving variational autoencoder-generated events and a smoothing …

Voice Synthesis Improvement By Machine Learning Of Natural Prosody, Joseph Kane, Michael N. Johnstone, Patryk Szewczyk

Research outputs 2022 to 2026

Since the advent of modern computing, researchers have striven to make the human–computer interface (HCI) as seamless as possible. Progress has been made on various fronts, e.g., the desktop metaphor (interface design) and natural language processing (input). One area receiving attention recently is voice activation and its corollary, computer-generated speech. Despite decades of research and development, most computer-generated voices remain easily identifiable as non-human. Prosody in speech has two primary components—intonation and rhythm—both often lacking in computer-generated voices. This research aims to enhance computer-generated text-to-speech algorithms by incorporating melodic and prosodic elements of human speech. This study explores a novel …

Artificial Intelligence And Perception: An Empirical Study, Anthony J. Neil

Theses and Dissertations

This thesis investigates the impact of adjusting artificial intelligence explainability levels’ outputs on user perception. The overarching study extends within the Explainable Artificial Intelligence (XAI) domain. It examines a spectrum of variables, including performance, cognizance, familiarity, transparency, system bias, and the overall impact of AI, to understand their collective and individual effects that enable effective professional use in an organization. The study aims to illuminate the relationship between the degree of explainability provided by large language models such as ChatGPT, Bard, and Bing AI and the performance of these models when tasked with XAI adjustments.

Sensor-Based Vehicle Classification Using Machine Learning, Luke Mcfadden

Theses and Dissertations

This research investigates the classification of vehicles into heavy and light categories using acoustic, seismic, and magnetic sensor data. The effectiveness of using frequency domain data and classical machine learning techniques, is compared with the effectiveness of using time-series data and neural networks. The primary aim in doing so was to understand if modern neural network architectures could effectively remove the need for more traditional frequency based signals processing. A significant deliverable of this thesis was the feature importance determined for each of the three phenomenological types found within the data (acoustic, seismic, and magnetic). By analyzing the importance of …

Weakly Supervised Attention-Based Recognition Under Spectral, Turbulence, And Resource Variations, Kshitij Naresh Nikhal

Dissertations and Doctoral Documents, University of Nebraska-Lincoln, 2023–

While supervised optimization paradigms are ubiquitous across diverse recognition systems, the risk of over-fitting and increasing bias have limited their applicability.

This dissertation focuses on unsupervised learning—learning without precisely curated data—and argues that unsupervised learning methods can enable both discriminability and generalizability. Through the use of attention-based machine learning and advanced clustering, unsupervised methods are able to focus on fine-grained information in images without any explicit supervision. The dissertation introduces a domain-bridging framework for tasks like cross-spectrum matching and long-range recognition, utilizing intra-domain clustering and inter-domain matching to generate pseudo-labels. Additionally, a hash-based network is proposed to accelerate the search …

U.S. Army Cadet Command Branch Prediction Model, Daniel M. Krizan

Theses and Dissertations

The current system for providing US Army ROTC cadets their branches leaves significant uncertainty until the final pronouncement of branch assigned. This uncertainty can be alleviated by providing a prediction model for cadets to input personal data and desired branch to identify likelihood of receiving the request. This thesis produces a machine learning model capable of producing branch prediction for cadets.

A Random Forest-Based Q-Learning Algorithm: Toward Interpretable Artificial Intelligence, Victor R. Rae

Theses and Dissertations

A growing demand exists for interpretable artificial intelligence models, leading to extensive research efforts to enhance the explainability and transparency of policies generated by reinforcement learning (RL) methods. This research develops random forest-based RL algorithms as a logical progression in this academic pursuit. The algorithms are evaluated using three standard benchmark environments from OpenAI gym — CartPole, MountainCar, and LunarLander — and compared to implementations of the Deep Q-learning Network (DQN) and Double DQN (DDQN) algorithms for various metrics, including performance, robustness, efficiency, and interpretability. The random forest-based algorithms exhibit superior performance to both neural network-based algorithms in two out …

Federated Analysis Of Wearables Data For United States Air Force Mental And Physical Readiness, Sung Yong O

Theses and Dissertations

This thesis investigates the use of machine learning and deep learning models within a federated learning framework to predict physical and mental readiness in military personnel, using wearable technology data. The collaboration with the 711th Human Performance Wing’s STRONG Lab highlights the importance of readiness as emphasized by the National Defense and Security Strategies. The study evaluates various predictive models, incorporating federated learning to ensure data privacy and security in healthcare systems. By analyzing a comprehensive dataset, the research aims to contribute to military readiness enhancement through technological advancements, supporting health and wellness initiatives to bolster the effectiveness of military …

The Impact Of Artificial Intelligence And Machine Learning On Organizations Cybersecurity, Mustafa Abdulhussein

Doctoral Dissertations and Projects

As internet technology proliferate in volume and complexity, the ever-evolving landscape of malicious cyberattacks presents unprecedented security risks in cyberspace. Cybersecurity challenges have been further exacerbated by the continuous growth in the prevalence and sophistication of cyber-attacks. These threats have the capacity to disrupt business operations, erase critical data, and inflict reputational damage, constituting an existential threat to businesses, critical services, and infrastructure. The escalating threat is further compounded by the malicious use of artificial intelligence (AI) and machine learning (ML), which have increasingly become tools in the cybercriminal arsenal. In this dynamic landscape, the emergence of offensive AI introduces …

Cancergpt For Few Shot Drug Pair Synergy Prediction Using Large Pretrained Language Models, Tianhao Li, Sandesh Shetty, Advaith Kamath, Ajay Jaiswal, Xiaoqian Jiang, Ying Ding, Yejin Kim

Faculty, Staff and Student Publications

Large language models (LLMs) have been shown to have significant potential in few-shot learning across various fields, even with minimal training data. However, their ability to generalize to unseen tasks in more complex fields, such as biology and medicine has yet to be fully evaluated. LLMs can offer a promising alternative approach for biological inference, particularly in cases where structured data and sample size are limited, by extracting prior knowledge from text corpora. Here we report our proposed few-shot learning approach, which uses LLMs to predict the synergy of drug pairs in rare tissues that lack structured data and features. …

Self-Optimizing Feature Generation Via Categorical Hashing Representation And Hierarchical Reinforcement Crossing, Wangyang Ying, Dongjie Wang, Kunpeng Liu, Leilei Sun, Yanjie Fu

Computer Science Faculty Publications and Presentations

Feature generation aims to generate new and meaningful features to create a discriminative representation space. A generated feature is meaningful when the generated feature is from a feature pair with inherent feature interaction. In the real world, experienced data scientists can identify potentially useful feature-feature interactions, and generate meaningful dimensions from an exponentially large search space in an optimal crossing form over an optimal generation path. But, machines have limited human-like abilities. We generalize such learning tasks as self-optimizing feature generation. Self-optimizing feature generation imposes several under-addressed challenges on existing systems: meaningful, robust, and efficient generation. To tackle these challenges, …