Physical Sciences and Mathematics Commons^™

Sugar: A Sequence Unfolding Based Transformer Model For Group Activity Recognition, Yash U. Gondkar

Graduate Masters Theses

Large Language Models have improved significantly in the past couple of years due to the adoption of transformers. However, transformers still find it challenging to process videos due to limited context size caused by their quadratic computing cost. Therefore, we studied a booming field in machine learning which powers applications like social scene analysis and video surveillance systems called Group Activity Recognition (GAR). We found that recent models were able to achieve more than 90% accuracy on popular datasets like the Volleyball dataset, however, it turned out that even they relied on transformers.

Therefore, in this work, we developed a …

Ddos Attack Detection In Edge-Iiot Digital Twin Environment Using Deep Learning Approach, Feras Al-Obeidat, Adnan Amin, Ahmed Shuhaiber, Inam Ul Haq

All Works

The industrial Internet of Things (IIoT) and digital twins are redefining how digital models and physical systems interact. IIoT connects physical intelligence, and digital twins virtually represent their physical counterparts. With the rapid growth of Edge-IIoT, it is crucial to create security and privacy regulations to prevent vulnerabilities and threats (i.e., distributed denial of service (DDoS)). DDoS attacks use botnets to overload the target system with requests. In this study, we introduce a novel approach for detecting DDoS attacks in an Edge-IIoT digital twin-based generated dataset. The proposed approach is designed to retain already learned knowledge and easily adapt to …

Domain Obedient Deep Learning, Soumadeep Saha

Doctoral Theses

Deep learning, a family of data-driven artificial intelligence techniques, has shown immense promise in a plethora of applications, and it has even outpaced experts in several domains. However, unlike symbolic approaches to learning, these methods fall short when it comes to abiding by and learning from pre-existing established principles. This is a significant deficit for deployment in critical applications such as robotics, medicine, industrial automation, etc. For a decision system to be considered for adoption in such fields, it must demonstrate the ability to adhere to specified constraints, an ability missing in deep learning-based approaches. Exploring this problem serves as …

A Time Series Forecasting Model Integrating Spatial Features For Inter-Borehole Resistivity And Its Application, Wang Jianghong, Liu Shuo, Wang Gang, Xue Wuqiang, Li Bofan

Coal Geology & Exploration

Background Mine resistivity prediction serves as a core technique for water hazards monitoring in coal mines. However, due to sparse monitoring points and insufficient spatial resolution, conventional prediction approaches fail to capture dynamic resistivity variations under complex geological conditions.Objective and Methods To address this challenge, this study developed a deep learning-based time series forecasting model integrating spatial features for inter-borehole resistivity. Using a prediction framework constructed based on long short-term memory (LSTM) and critical spatial monitoring points selected through Pearson correlation analysis, this model (also referred to as the LSTM model) enabled high-precision prediction of resistivity in unknown areas. …

Evaluating Nfl Quarterback Decision Making Through Tracking Data, Jesse N. Melville

Theses and Dissertations

Quarterback decision-making is one of the most critical determinants of success in the National Football League (NFL), yet traditional statistics fail to account for the spatial, temporal, and contextual factors influencing each play. This thesis proposes a data-driven methodology for evaluating quarterback decisions using NFL player tracking data from the 2022 season. We replicate and extend the DeepQB framework by training deep learning models to estimate expected completion probabilities and expected yards gained for each receiver at the moment of the throw. Our extension applies the approach to a newer dataset with additional contextual features, enabling a more detailed evaluation …

Roadside Asset Extraction From Mobile Lidar Point Cloud, Yushin Ahn, Riadh Munjy, Stephen Choi

Mineta Transportation Institute

Mobile LiDAR systems are powerful tools that help us map roads and their surroundings in 3D with great speed and precision. The data provided by these systems support urban planning efforts, digital mapping, transportation infrastructure maintenance, and more. This report presents a comprehensive workflow for roadside asset extraction using Mobile Terrestrial Laser Scanning (MTLS) data, focusing on road lane detection, cross-section slope analysis, and point cloud classification. Roadside asset extraction is the identification and classification of roadside features like signs and poles. The dataset, acquired using a high-resolution mobile LiDAR system, contains over 5.7 billion points (pieces of data) across …

Comparative Analysis Of Sequential And Non-Sequential Modeling Techniques For Ddos Attack Detection With Explainable Ai, Vincent Agbenyeavu

Theses and Dissertations

Cybersecurity is known today as one of the greatest challenges of the modern era. Among the various types of cyber-attacks that threaten our security, the Distributed Denial of Service (DDoS) attack is among some of the most common, effective, and well-recognized attack strategies. Since this form of attack is meant to disrupt the availability factor covertly, it can be detrimental to the targeted machines and difficult to discover. Because of that, there have been several approaches, as well as solutions that have been devised to detect it as accurately and efficiently as possible. In this study, four sequential data modeling …

Predicting Music Origin With Deep Learning, Fruzsina Ladanyi

Electronic Theses, Projects, and Dissertations

This project explores the usage of a late fusion deep learning architecture to predict the geographic origin of music. Mel-Frequency Cepstral Coefficients (MFCCs) and the language of the music sample are used as features. MFCCs were extracted from audio files to capture sound features. The language was identified using OpenAI’s Whisper model to provide additional context. A late fusion neural network architecture combining Long Short-Term Memory (LSTM) layers for sequential MFCC input and dense layers for non-sequential language features were employed to support both classification and regression tasks. The classification model achieved an accuracy of 33.03% across 56 countries or …

Use Of A Preliminary Artificial Intelligence-Based Laryngeal Cancer Screening Framework For Low-Resource Settings: Development And Validation Study, Shao Wei Sean Lam, Min Hun Lee, Michael Dorosan, Samuel Altonji, Hiang Khoon Tan, Walter T. Lee

Research Collection School Of Computing and Information Systems

Background: Early-stage diagnosis of laryngeal cancer significantly improves patient survival and quality of life. However, the scarcity of specialists in low-resource settings hinders the timely review of flexible nasopharyngoscopy (FNS) videos, which are essential for accurate triage of at-risk patients.Objective: We introduce a preliminary AI-based screening framework to address this challenge for the triaging of at-risk patients in low-resource settings. This formative research addresses multiple challenges common in high-dimensional FNS videos: (1) selecting clear, informative images; (2) deriving regions within frames that show an anatomical landmark of interest; and (3) classifying patients into referral grades based on the FNS video …

Gene Regulatory Network Prediction Using Machine Learning, Deep Learning, And Hybrid Approaches, Sai Teja Mummadi, Md Khairul Islam, Victor Busov, Hairong Wei

Michigan Tech Publications

Construction of gene regulatory networks (GRNs) is essential for elucidating the regulatory mechanisms underlying metabolic pathways, biological processes, and complex traits. In this study, we developed and evaluated machine learning, deep learning, and hybrid approaches for constructing GRNs by integrating prior knowledge and large-scale transcriptomic data from Arabidopsis thaliana, poplar, and maize. Among these, hybrid models that combined convolutional neural networks and machine learning consistently outperformed traditional machine learning and statistical methods, achieving over 95% accuracy on the holdout test datasets. These models not only identified a greater number of known transcription factors regulating the lignin biosynthesis pathway but also …

Research On Requirements And Methods For Intelligent Assessment Of Simulation Credibility, Bingheng Wang, Tingrui Liu, Fan Yang, Huan Zhang, Wei Li, Ping Ma, Ming Yang

Journal of System Simulation

Abstract: The accuracy of simulations in representing real-world systems is a critical concern for users. Simulation credibility assessment ensures trustworthiness by evaluating the correctness and effectiveness of simulations to meet application requirements. As simulation technologies are widely adopted, and new simulation paradigms emerge, traditional assessment methods are increasingly showing limitations in their dependence on experts, data processing capabilities, and assessment efficiency. This paper systematically reviewed the research demands, current progress, new technologies, and future trends of intelligent simulation credibility assessment. Based on the simulation credibility assessment process and problem analysis, the requirements for intelligent credibility assessment were discussed. Intelligent technologies …

Machine Learning Crime Prediction Models And The Gap Between Research And Implementation: A Systematic Review, Ricardo Huamantingo, Miguel Cano-Lengua, Ciro Rodriguez

Karbala International Journal of Modern Science

A crime is an illegal or violent act committed by one individual against another. The increasing crime rate has become a major concern as it negatively affects people's quality of life and generates significant social and economic costs. This study aims to identify the most widely used machine learning (ML) models for crime prediction, determine evaluation metrics for assessing model performance, and analyze key data characteristics to enhance real-world implementation. The study follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) methodology. A search string was formulated using the population, intervention, comparison, and outcomes (PICO) framework and applied …

A Machine Learning Approach To Quantitative X-Ray Diffraction Analysis, Spencer Snow Chandler

Theses and Dissertations

X-ray Powder Diffraction (XRPD) is a powerful method in material sciences that gives insights into the atomical and crystallographic structure of a material, revealing information into the material's properties and suitability for industrial and scientific application. In geology, XRPD analysis is frequently leveraged to identify and quantify the present mineral phases in an unknown mixture. Despite it's widespread use, interpreting XRPD patterns requires highly-specialized knowledge, making the analysis largely dependent upon the background experience of the analyst. To assist experts, computational methods have been developed over the years. Some of these techniques involve fitting diffraction patterns using pseudo-Voigt functions, which …

Graph Traverse Reference Network For Sign Language Corpus Retrieval In The Wild, Kun Hu, Fengxiang He, Adam Schembri, Zhiyong Wang

Research outputs 2022 to 2026

Sign languages are the primary languages of the deaf community as well as hearing individuals who are unable to speak, which engage the visual-manual modality to convey meanings. In recent years, there has been an explosive growth of sign language videos available from video streaming and social media service platforms. Given the size of these corpora, sign language users often face significant challenges in effectively acquiring the information they need. Therefore, we propose a novel deep learning architecture, namely Graph Traverse Reference Network (GTRN), allowing visual signing queries to retrieve relevant sign language videos (documents) from a large corpus. GTRN …

Adapting A Segmentation Foundation Model For Medical Image Classification, Pengfei Gu, Haoteng Tang, Islam A. Ebeid, Jose Angel Nunez, Fabian Vazquez Jr., Diego Adame

Computer Science Faculty Publications

Recent advancements in foundation models, such as the Segment Anything Model (SAM), have shown strong performance in various vision tasks, particularly image segmentation, due to their impressive zero-shot segmentation capabilities. However, effectively adapting such models for medical image classification is still a less explored topic. In this paper, we introduce a new framework to adapt SAM for medical image classification. First, we utilize the SAM image encoder as a feature extractor to capture segmentation-based features that convey important spatial and contextual details of the image, while freezing its weights to avoid unnecessary overhead during training. Next, we propose a novel …

Aircraft Bird Strike Risk Prediction Using Machine Learning And Analytic Hierarchy Process, Jason Anthony Powell

Doctoral Dissertations and Master's Theses

To address the limitations of Next Generation Radar-based bird strike forecasting, this study modeled 12 spatiotemporal weather features from the National Oceanic and Atmospheric Administration alongside bird strike risk using Long Short-Term Memory Recurrent Neural Network (LSTM-RNN), XGBoost regression tree, and Bayesian network algorithms. Five years of bird strike data from four geographically diverse airfields served as the target risk variable, categorized as low, moderate, or severe based on Department of the Air Force risk models. The ensemble model, which combines the LSTM-RNN and XGBoost regression algorithms, yielded the most accurate forecasts, achieving 80% to 93% accuracy across all airfields, …

Toward A Simplified Framework For Sequential Character Recognition, Nicholas Howe

Computer Science: Faculty Publications

This paper proposes a novel approach to handwritten charac- ter recognition using convolutional non-recurrent deep neural networks. Such a network can run in parallel at every point of a document, offer- ing potential advantages in speed over recurrent approaches. The net- work’s output feeds into a beam search optimization for final decoding. Preliminary quantitative results show that the framework can achieve bootstrap training from labeled word images. It provides an alternative to sequential models that rely on connectionist temporal classification for alignment.

Causal Neuro-Symbolic Artificial Intelligence: Synergy Between Neuro-Symbolic And Causal Artificial Intelligence, Utkarshani Jaimini

Theses and Dissertations

Understanding and reasoning about cause and effect is innate to human cognition. In everyday life, humans continuously engage in causal reasoning and hypothetical retrospection to make decisions, plan actions, and interpret events. This cognitive ability allows us to ask questions such as: “What caused this situation?”, “What will happen if I take this action?”, or “What would have happened had I chosen differently?” This intuitive capacity to form mental models of the world, infer causal relationships, and reason about alternative scenarios, particularly counterfactuals, is central to our intelligence and adaptability. In contrast, current machine learning (ML) and artificial intelligence (AI) …

A Comparative Study Of Machine Learning And Deep Learning Models In Binary And Multiclass Classification For Intrusion Detection Systems, Ayesha Alharthi, Meera Alaryani, Sanaa Kaddoura

All Works

Network infrastructure evolution has significantly expanded the attack surface, leading to increasingly complex and sophisticated cybersecurity threats. Traditional rule-based intrusion detection systems (IDS) often fail to detect emerging attack vectors, prompting the need for intelligent, data-driven approaches. This study evaluates and compares the performance of machine learning (ML) and deep learning (DL) models for network intrusion detection. Two publicly available datasets were utilized: a binary-labeled software-defined networking (SDN) dataset and a multiclass industrial control system dataset based on the IEC 60870-5-104 protocol. Preprocessing steps included normalization, label encoding, and a 70:10:20 train-validation-test split. Seven models, Random Forest, Decision Tree, K-Nearest …

Simulation Study On Adaptive Signal Control Of Deformed Intersection Based On Lstm-Gnn, Kun Chen, Liang Chen, Jiming Xie, Fengbo Liu, Taixiong Chen, Lukuan Wei

Journal of System Simulation

Abstract: Aiming at the traffic congestion at deformed intersections, an improved adaptive traffic signal control scheme based on deep learning is designed, the scheme integrates the adaptive signal control of LSTM and GNN at deformed intersections. LSTM is used to capture the dependence between time series traffic data, while GNN is used to construct a spatial interaction model between lanes. By integrating the information of time and space dimensions, the model can dynamically adjust the phase duration of signal lights according to real-time traffic conditions. The results indicate that the LSTM-GNN adaptive control scheme improves overall traffic throughput efficiency by …

Arson Event Detection Using Yolov9, Ali Abbas Abbod, Matheel E. Abdulmunimb, Ismail A. Mageed

Journal of Soft Computing and Computer Applications

Detecting event anomalies is crucial for surveillance systems, as it enables the identification of occurrences in videos, both temporally and spatially. It can identify deviations from patterns without requiring human oversight by learning from past information to distinguish normal behavior and pinpoint irregularities. Early detection of arson fires is critical to mitigating damage, public safety, property, and the environment, as well as saving lives and aiding in law enforcement investigations. The objective of this study is to evaluate a system for detecting events using the You Only Look Once version 9 (YOLOv9) model in surveillance videos with a focus on …

Application Of Deep Learning In Analysis Of Stellar Spectra, Piyush Yayati

Master’s Dissertations

In recent years, the analysis of high-resolution stellar spectra has become increasingly important for estimating key stellar parameters such as effective temperature (Teff ), surface gravity (log g), metallicity ([M/H]), and rotational velocity (v sin i). Traditional methods often rely on manual calibration or spectrum synthesis, which can be time-consuming and error-prone, especially for M dwarfs whose spectra are dense with molecular features. In this study, we investigate the use of convolutional neural networks (CNNs) to automate the estimation of stellar parameters using synthetic and observed data.We adopt a StarNet-like CNN architecture trained on synthetic spectra generated from the PHOENIX-ACES …

Enabling Automatic Solar Pv Array Identification Using Big Satellite Imagery, Qi Li, Keyang Yu, Carson Snow, Dong Chen

Computer Science Faculty Research and Publications

Recently, there has been a growing interest in automatically collecting distributed solar photovoltaic (PV) installation information in smart grid systems, including the quantity and locations of solar PV deployments, as well as their profiling information across a given geospatial region. Most recent approaches are still suffering low detection accuracy due to insufficient sample and principal feature learning when building their models and also separation of rooftop object segmentation and identification during their detection processes. In addition, they cannot report accurate multi-deployment results. To address these problems, we design a new system-SolarDetector+, which can automatically and accurately detect and profile distributed …

Advancing Fake News Detection With Graph Neural Network And Deep Learning, Haji Gul, Feras Al-Obeidat, Muhammad Wasim, Adnan Amin, Fernando Moreira

All Works

In the modern era of digital technology, the rapid distribution of news via social media platforms substantially contributes to the propagation of false information, presenting challenges in upholding the accuracy and reliability of information. This study presents an updated approach that utilizes graph neural networks (GNNs) alongside with advanced deep learning techniques to improve the identification of false information. In contrast to traditional approaches that primarily rely on analyzing text and assessing the credibility of sources, our methodology utilizes the structural information of news propagation networks. This allows for a detailed comprehension of the interconnections and patterns that are indicative …

Enriching Vision Representation By Deep Neural Networks And Self-Supervised Learning, Yucong Shen

Dissertations

Nowadays, more and more interesting computer vision tasks are tackled by deep learning approaches. However, the increasing model complexity imposes significant computational and storage costs. To address this challenge, this dissertation explores efficient deep learning techniques, proposing morphological layer, an efficient feature extraction layer. It achieves competitive image classification accuracy with significantly decreased model parameters. Another attempt at efficient deep learning is a proposed channel pruning approach that compresses deep neural networks by identifying and removing redundant channels using optimal transport theory. This approach achieves significant reductions in model size and computational cost while maintaining or even improving performance across …

A Seismic Random Noise Suppression Method Based On Cnn-Mamba, Wei Xiujuan, Liu Xingye, Zhou Huailai

Coal Geology & Exploration

Background Seismic random noise suppression is recognized as a key step to improve the quality of seismic data. Data-driven deep learning provides an intelligent solution for the noise suppression. However, mainstream random noise intelligent methods based on convolutional neural networks (CNNs) are constrained by their local receptive fields. This limitation results in insufficient collaborative optimization between local details and macroscopic structures during denoising, further reducing the noise suppression accuracy. Transformer models, which are widely applied to global feature extraction, can effectively capture long-distance dependencies through the self-attention mechanism, theoretically overcoming the limitations of CNNs in global modeling. However, these models …

An Edge Computing Device Optimized And Transfer Learning Enhanced Deep Learning Model For Detecting Wildfire Flame And Smoke, Giovanny Vazquez

UNLV Theses, Dissertations, Professional Papers, and Capstones

The integration of autonomous unmanned aerial vehicles (UAVs) with edge computing technology and deep learning (DL)-based object detection offers a groundbreaking solution for real-time wildfire detection, enabling rapid data processing directly on devices and minimizing response delays in critical scenarios. However, although showing early promise, performance is often constrained by limited training data and edge computing devices that lack graphics processing unit (GPU) acceleration. This thesis seeks to address these limitations in two stages.First, this work explores the transformative potential of Transfer Learning (TL) to enhance wildfire object detection model accuracy while also investigating TL’s impact, for DL-based object detection …

White Light Specular Reflection Data Augmentation For Deep Learning Polyp Detection, Jose Angel Nuñez, Fabian Vazquez Jr., Diego Adame, Xiaoyan Fu, Pengfei Gu, Bin Fu

Computer Science Faculty Publications

Colorectal cancer is one of the deadliest cancers today, but it can be prevented through early detection of malignant polyps in the colon, primarily via colonoscopies. While this method has saved many lives, human error remains a significant challenge, as missing a polyp could have fatal consequences for the patient. Deep learning (DL) polyp detectors offer a promising solution. However, existing DL polyp detectors often mistake white light reflections from the endoscope for polyps, which can lead to false this http URL address this challenge, in this paper, we propose a novel data augmentation approach that artificially adds more white …

Computational Modeling And Structural Generation Of Piano Music In The Classical Style, Yijing Feng

Dartmouth College Ph.D Dissertations

Listening to fast-tempo piano sonatas of the Classical period (circa 1750-1820) has been shown to have therapeutic effects for neurological disorders such as epilepsy. The limited existing repertoire of music in this style motivates the creation of more long-form, coherent compositions with clearly defined structure. Despite the long history of computer-based music generation and recent progress in deep learning, particularly transformer-based models, generating structurally coherent long-form music remains a major challenge. This difficulty stems from the scarcity of reliable structural annotation datasets, the computational demands of modeling very long musical sequences, and the lack of effective structural encoding in both …

Hybridize Functions: A Tool For Automatically Refactoring Imperative Deep Learning Programs To Graph Execution, Raffi Khatchadourian, Tatiana Castro Vélez, Mehdi Bagherzadeh, Nan Jia, Anita Raja

Publications and Research

Efficiency is essential to support responsiveness w.r.t. ever-growing datasets, especially for Deep Learning (DL) systems. DL frameworks have traditionally embraced deferred execution-style DL code—supporting symbolic, graph-based Deep Neural Network (DNN) computation. While scalable, such development is error-prone, non-intuitive, and difficult to debug. Consequently, more natural, imperative DL frameworks encouraging eager execution have emerged but at the expense of run-time performance. Though hybrid approaches aim for the “best of both worlds,” using them effectively requires subtle considerations to make code amenable to safe, accurate, and efficient graph execution—avoiding performance bottlenecks and semantically inequivalent results. We discuss the engineering aspects of a …