Physical Sciences and Mathematics Commons^™

Detection Of Phase-Binning And Interpolation Artifacts In 4-Dimensional Computed Tomography Imaging Using Deep Learning And Rule-Based Approaches, Jorge Cisneros, Nathan H. Feldt, Yevgeniy Vinogradskiy, Richard Castillo, Edward Castillo

Department of Radiation Oncology Faculty Papers

BACKGROUND: Four-dimensional computed tomography (4DCT) imaging is a crucial component to lung cancer radiotherapy planning and enables CT-ventilation-based functional avoidance planning to mitigate radiation toxicity. However, 4DCT scans are frequently impaired by acquisition artifacts that corrupt downstream analyses that depend on lung segmentation and deformable image registration, such as CT-ventilation and dose accumulation.

PURPOSE: This study develops 3D deep learning models to identify phase-binning artifacts at the voxel level and a heuristic, rule-based method to identify interpolation slices within 4DCT images.

METHODS: We introduce a generator that systematically inserts synthetic phase-binning and interpolation artifacts into any artifact-free breathing phase obtained …

Deep Learning With Kalman Filter, Rexford Julius Quaye

Electronic Theses and Dissertations

This thesis presents an extension of the Kalman filter to handle nonlinear and non-Gaussian systems. The standard Kalman filter is optimal under Gaussian assumptions but struggles with more complex noise models. This work introduces a novel loss function based on the Mahalanobis distance, which incorporates the covariance structure of measurement errors, enabling the filter to adapt to non-Gaussian scenarios. The neural network framework is applied to predict the system’s process model, while retaining the classical Kalman measurement update. The proposed methodology is demonstrated through examples of car position and rocket altitude tracking. The results show that the new approach performs …

Learning-Assisted Schedulability Analysis: Opportunities And Limitations, Sanjoy Baruah, Pontus Ekberg, Marion Sudvarg

Computer Science Faculty Research & Creative Works

We present the first (to our knowledge) Deep-Learning based framework for real-time schedulability-analysis that guarantees to never incorrectly mis-classify an unschedulable system as being schedulable, and is hence suitable for use in safety-critical scenarios. We relate applicability of this framework to well-understood concepts in computational complexity theory: membership in the complexity class NP. We apply the framework upon the widely-studied schedulability analysis problems of determining whether a given constrained-deadline sporadic task system is schedulable on a preemptive uniprocessor under both Deadline-Monotonic and EDF scheduling. As a proof-of-concept, we implement our framework for Deadline-Monotonic scheduling, and demonstrate that it has a …

Precision Agriculture In The Age Of Ai: A Systematic Review Of Machine Learning Methods For Crop Disease Detection, Munir Majdalawieh, Carla Martins, Mohammed Radi, Maher Alaraj, Shafaq Khan

All Works

Artificial Intelligence (AI) has become a critical tool in modern precision agriculture, particularly in the detection of plant diseases and pests. This study provides a comprehensive review of current AI methodologies applied to crop disease detection, with a focus on machine learning models, dataset availability, and performance metrics. Our findings indicate that Convolutional Neural Networks (CNNs) are the most widely used and cost-effective approach, while Vision Transformers (ViTs) exhibit superior accuracy but require significantly higher computational resources. We identify key research gaps, including the geographic bias in dataset origins, the trade-off between data quality and quantity, and the limited exploration …

A Feature-Free Deep Learning Approach For Midair Hand Gesture Recognition From Surface Electromyogram (Semg) Data, Yasir Altaf, Abdul Wahid, Mudasir Manzoor Kirmani

Turkish Journal of Electrical Engineering and Computer Sciences

Midair hand gesture recognition plays a crucial role in applications such as sign language recognition and human-computer interaction, particularly for supporting individuals with partial or complete hearing loss. However, recognizing gestures in midair remains challenging due to the rapid and complex nature of hand movements. To address this, noninvasive techniques like surface electromyography (sEMG)—which captures muscle activity through sensors placed on the skin—have gained attention. sEMG provides rich time-series data that reflect both spatial and temporal muscle dynamics. In this study, we propose a deep learning architecture that combines convolutional neural networks (CNNs) and recurrent neural networks (RNNs) to classify …

Speculative Automated Refactoring Of Imperative Deep Learning Programs To Graph Execution, Raffi Khatchadourian Ph.D., Tatiana Castro Vélez, Mehdi Bagherzadeh, Nan Jia, Anita Raja

Publications and Research

Efficiency is essential to support ever-growing datasets, especially for Deep Learning (DL) systems. DL frameworks have traditionally embraced deferred execution-style DL code---supporting symbolic, graph-based Deep Neural Network (DNN) computation. While scalable, such development is error-prone, non-intuitive, and difficult to debug. Consequently, more natural, imperative DL frameworks encouraging eager execution have emerged but at the expense of run-time performance. Though hybrid approaches aim for the "best of both worlds," using them effectively requires subtle considerations. Our key insight is that, while DL programs typically execute sequentially, hybridizing imperative DL code resembles parallelizing sequential code in traditional systems. Inspired by this, we …

Speculative Automated Refactoring Of Imperative Deep Learning Programs To Graph Execution, Raffi Khatchadourian Ph.D., Tatiana Castro Vélez, Mehdi Bagherzadeh, Nan Jia, Anita Raja

Publications and Research

Efficiency is essential to support ever-growing datasets, especially for Deep Learning (DL) systems. DL frameworks have traditionally embraced deferred execution-style DL code---supporting symbolic, graph-based Deep Neural Network (DNN) computation. While scalable, such development is error-prone, non-intuitive, and difficult to debug. Consequently, more natural, imperative DL frameworks encouraging eager execution have emerged but at the expense of run-time performance. Though hybrid approaches aim for the "best of both worlds," using them effectively requires subtle considerations. Our key insight is that, while DL programs typically execute sequentially, hybridizing imperative DL code resembles parallelizing sequential code in traditional systems. Inspired by this, we …

Speculative Automated Refactoring Of Imperative Deep Learning Programs To Graph Execution, Raffi T. Khatchadourian Ph.D., Tatiana Castro Vélez, Mehdi Bagherzadeh, Nan Jia, Anita Raja

Publications and Research

Efficiency is essential to support ever-growing datasets, especially for Deep Learning (DL) systems. DL frameworks have traditionally embraced deferred execution-style DL code---supporting symbolic, graph-based Deep Neural Network (DNN) computation. While scalable, such development is error-prone, non-intuitive, and difficult to debug. Consequently, more natural, imperative DL frameworks encouraging eager execution have emerged but at the expense of run-time performance. Though hybrid approaches aim for the "best of both worlds," using them effectively requires subtle considerations. Our key insight is that, while DL programs typically execute sequentially, hybridizing imperative DL code resembles parallelizing sequential code in traditional systems. Inspired by this, we …

When Deep Learning Meets Information Retrieval-Based Bug Localization: A Survey, Feifei Niu, Chuanyi Li, Kui Liu, Xin Xia, David Lo

Research Collection School Of Computing and Information Systems

Bug localization is a crucial aspect of software maintenance, running through the entire software lifecycle. Information retrieval-based bug localization (IRBL) identifies buggy code based on bug reports, expediting the bug resolution process for developers. Recent years have witnessed significant achievements in IRBL, propelled by the widespread adoption of deep learning (DL). To provide a comprehensive overview of the current state of the art and delve into key issues, we conduct a survey encompassing 61 IRBL studies leveraging DL. We summarize best practices in each phase of the IRBL workflow, undertake a meta-analysis of prior studies, and suggest future research directions. …

Damslnet: Dual-Attention Multi-Scale Lightweight Network For Plant Disease Classification, Linfan Deng, Juan Qin, Kun Li, Jinhua Zhu, Zhaoxia Wang

Research Collection School Of Computing and Information Systems

Accurately identifying crop diseases plays a crucial role in advancing intelligent and modern agricultural production. Deep learning techniques have performed robust performance in classifying plant disease images. However, current studies face the challenge that many plant disease datasets are generated in controlled environments, leading to reduced model performance in real-world agricultural settings. This paper aims to provide a lightweight model that can accurately classify plant diseases in natural environments. Specifically, this paper investigates the Dual-Attention Multi-Scale Lightweight Network (DAMSLNet), which combines dual-attention-based multi-scale feature extraction and deep information fusion, to classify plant diseases. At the front end, the model employs …

Image Captioning Through The Lens Of The Gricean Maxims: Generating Meaningful And Relevant Image Descriptions, Annika Lindh

Doctoral

Image captioning models enable us to automatically generate natural language image descriptions for previously unseen images. It combines the two fields of computer vision and natural language generation, allowing models to interpret the con tent of an image and communicate that knowledge through natural language text.

Research into image captioning has the potential benefit of reducing the gap in digital information availability between fully sighted individuals and those who are visually impaired. However, automatically generated captions often fail to provide the required level of detail and specificity to achieve this goal. Furthermore, current standard evaluation methods are insufficient at measuring …

Deep Learning Based Contactless Fingerprint Identification, Mohammad Alsmirat, M. Moneb Khaled, Aghyad A.L. Sayadi

Faculty Publications

Biometric authentication systems, particularly contactless fingerprint methods, offer enhanced security and convenience across various domains like access control, law enforcement, and finance. Despite these advantages, contactless systems face significant challenges related to image quality, finger orientation, and environmental factors. To address this, our paper presents the first extensive deep learning-based study on contactless fingerprint recognition using a large dataset of 2,143 images from 175 individuals. Our proposed approach integrates state-of-the-art preprocessing techniques with deep learning models to boost identification performance. After studying various transfer learning models, we achieved a high accuracy of 93.5%. We also conducted two further studies on …

Soft Sensor Modeling Based On Improved Transformer In Dual-Stream Framework, Hao Gu, Jiayu Wang, Weili Xiong

Journal of System Simulation

Abstract: Industrial process information is highly nonlinear and dynamic, with long-term dependencies between data, making it difficult to adequately extract time-series features. To address this issue, an improved Transformer-based soft sensor model in a dual-stream framework was proposed. The data were segmented and expanded. The features were extracted in parallel using a dual-stream structure combining a convolutional neural network with a self-attention mechanism and the improved Transformer model. The dual-stream features were fused for soft sensor regression. Residual connections were further introduced to accelerate the convergence speed of the model, and an orthogonal random features-based improved multi-head attention mechanism was …

Deep Learning For Hate Speech Detection: A Comparative Study, Jitendra Singh Malik, Hezhe Qiao, Guansong Pang, Anton Van Den Hengel

Research Collection School Of Computing and Information Systems

Automated hate speech detection is an important tool in combating the spread of hate speech, particularly in social media. Numerous methods have been developed for the task, including a recent proliferation of deep-learning based approaches. A variety of datasets have also been developed, exemplifying various manifestations of the hate-speech detection problem. We present here a largescale empirical comparison of deep and shallow hate-speech detection methods, mediated through the three most commonly used datasets. Our goal is to illuminate progress in the area, and identify strengths and weaknesses in the current state-of-the-art. We particularly focus our analysis on measures of practical …

Attenuation Characteristics And Wave Impedance Inversion Of Depth-Domain Nonstationary Seismic Data, Ma Ming, Ma Feng

Coal Geology & Exploration

Background The efficient application of depth migration methods has enabled the extensive implementation of depth-domain seismic data interpretation. Previous studies on the impacts of time-to-depth conversion and velocity models merely determine that an increase in depth corresponds to reduced dominant wavenumber of seismic waves and waveform stretching, without considering the changes in amplitude and phase. Objective This study aims to accurately characterize the waveforms of nonstationary seismic signals in the depth domain and enhance the impedance inversion accuracy. Methods First, based on energy dissipation and frequency dispersion effects during the propagation of seismic waves, this study investigated the complex mapping …

High-Precision Reconstruction Of Seismic Data Based On Improved U-Net++, Wang Minling, Zhou Fei, Wang Honghua, He Xiang, Hou Zhiyang

Coal Geology & Exploration

Objective Conventional reconstruction methods are insufficient for the reconstruction of seismic data with missing consecutive traces, producing a negative impact on subsequent processing accuracy. Hence, this study proposed CU-Net++, a deep learning network based on the U-Net++ architecture combined with the convolutional block attention module (CBAM). Methods During the reconstruction of missing data, the independent decoder for each sub-U-Net in the nested U-Net++ architecture enables the utilization of information from different depths. The long and short skip connections can effectively enhance the network's capability to extract multi-scale features from data. The core innovation of CU-Net++ is the introduction of CBAM, …

Artificial Intelligence In Head And Neck Cancer: Towards Precision Medicine, Jacob Hagen, Logan Hornung, William Barham, Supratik Mukhopadhyay, Adam Bess, Kevin Contrera, Devraj Basu, Vlad Sandulache, Guillaume Spielmann, Sagar Kansara

School of Medicine Faculty Publications

Over the past 20 years, the capabilities of artificial intelligence (AI) have gained significant interest. While AI has been implemented to various degrees in several disciplines, its unique applications in head and neck cancer (HNC) remain underdeveloped. This narrative review examines the existing body of literature regarding the use of AI in HNC. Studies to date have demonstrated AI’s utility across multiple phases of the HNC treatment continuum. Despite its promise, integrating AI into clinical practice faces several challenges, including concerns about system integrity, generalizability, privacy, and bias. In this review, we address these challenges and offer insights into future …

Greedy Algorithm For Neural Networks For Indefinite Elliptic Problems, Qingguo Hong, Jiwei Jia, Young Ju Lee, Ziqian Li

Mathematics and Statistics Faculty Research & Creative Works

The paper presents a priori error analysis of the shallow neural network approximation to the solution to the indefinite elliptic equation and a cutting-edge implementation of the Orthogonal Greedy Algorithm (OGA) tailored to overcome the challenges of indefinite elliptic problems, which is a domain where conventional approaches often struggle due to the lack of coerciveness. A rigorous priori error analysis that shows the neural network's ability to approximate the solution of indefinite problems is confirmed numerically by OGA. We also present the error analysis of the relevant numerical quadrature. In particular, massive numerical implementations are conducted to justify the theory, …

Adaptive Water Body Detection: Integrating Deep Learning, Normalised Difference Water Index, And Vector Data For Farm Dam Water Monitoring With Omniwatermask, Nicholas J. Wright, John M A Duncan, Nik Callow, Sally E. Thompson, Richard J. George

Natural Resources Research Articles

Farm dams are important water security features supporting both agricultural production and the natural environment. In Australia alone, over two million farm dams provide the water resources underpinning rural and regional primary industries with an annual export value of $80 billion. However, monitoring these water bodies to understand water security and vulnerability is challenging, primarily because of their large quantity, size and highly variable spectral signatures. These characteristics result in difficulty determining thresholds for index-based water detection methods and add to the difficulty of creating adequate training datasets for deep learning methods. We present an adaptive approach named OmniWaterMask (OWM) …

Harnessing Graphs For Knowledge Representation In Natural Language Processing, Uras Varolgunes

Dissertations

This work proposes innovative methods for integrating domain-specific knowledge into natural language processing tasks through the use of graphs, aiming to enhance the performance of models across various domains, including finance and healthcare. Several novel approaches are proposed that fuse graph structures with modern deep learning techniques, addressing the challenges of missing word embeddings, label prediction, and graph representation learning for large language models.

First, a powerful embedding method built on top of the recent advances in latent graph learning is introduced to address the critical problem of word embedding imputation. Second, a graph-enhanced label attention model designed for medical …

Sugar: A Sequence Unfolding Based Transformer Model For Group Activity Recognition, Yash U. Gondkar

Graduate Masters Theses

Large Language Models have improved significantly in the past couple of years due to the adoption of transformers. However, transformers still find it challenging to process videos due to limited context size caused by their quadratic computing cost. Therefore, we studied a booming field in machine learning which powers applications like social scene analysis and video surveillance systems called Group Activity Recognition (GAR). We found that recent models were able to achieve more than 90% accuracy on popular datasets like the Volleyball dataset, however, it turned out that even they relied on transformers.

Therefore, in this work, we developed a …

Ddos Attack Detection In Edge-Iiot Digital Twin Environment Using Deep Learning Approach, Feras Al-Obeidat, Adnan Amin, Ahmed Shuhaiber, Inam Ul Haq

All Works

The industrial Internet of Things (IIoT) and digital twins are redefining how digital models and physical systems interact. IIoT connects physical intelligence, and digital twins virtually represent their physical counterparts. With the rapid growth of Edge-IIoT, it is crucial to create security and privacy regulations to prevent vulnerabilities and threats (i.e., distributed denial of service (DDoS)). DDoS attacks use botnets to overload the target system with requests. In this study, we introduce a novel approach for detecting DDoS attacks in an Edge-IIoT digital twin-based generated dataset. The proposed approach is designed to retain already learned knowledge and easily adapt to …

Domain Obedient Deep Learning, Soumadeep Saha

Doctoral Theses

Deep learning, a family of data-driven artificial intelligence techniques, has shown immense promise in a plethora of applications, and it has even outpaced experts in several domains. However, unlike symbolic approaches to learning, these methods fall short when it comes to abiding by and learning from pre-existing established principles. This is a significant deficit for deployment in critical applications such as robotics, medicine, industrial automation, etc. For a decision system to be considered for adoption in such fields, it must demonstrate the ability to adhere to specified constraints, an ability missing in deep learning-based approaches. Exploring this problem serves as …

A Time Series Forecasting Model Integrating Spatial Features For Inter-Borehole Resistivity And Its Application, Wang Jianghong, Liu Shuo, Wang Gang, Xue Wuqiang, Li Bofan

Coal Geology & Exploration

Background Mine resistivity prediction serves as a core technique for water hazards monitoring in coal mines. However, due to sparse monitoring points and insufficient spatial resolution, conventional prediction approaches fail to capture dynamic resistivity variations under complex geological conditions.Objective and Methods To address this challenge, this study developed a deep learning-based time series forecasting model integrating spatial features for inter-borehole resistivity. Using a prediction framework constructed based on long short-term memory (LSTM) and critical spatial monitoring points selected through Pearson correlation analysis, this model (also referred to as the LSTM model) enabled high-precision prediction of resistivity in unknown areas. …

Evaluating Nfl Quarterback Decision Making Through Tracking Data, Jesse N. Melville

Theses and Dissertations

Quarterback decision-making is one of the most critical determinants of success in the National Football League (NFL), yet traditional statistics fail to account for the spatial, temporal, and contextual factors influencing each play. This thesis proposes a data-driven methodology for evaluating quarterback decisions using NFL player tracking data from the 2022 season. We replicate and extend the DeepQB framework by training deep learning models to estimate expected completion probabilities and expected yards gained for each receiver at the moment of the throw. Our extension applies the approach to a newer dataset with additional contextual features, enabling a more detailed evaluation …

Comparative Analysis Of Sequential And Non-Sequential Modeling Techniques For Ddos Attack Detection With Explainable Ai, Vincent Agbenyeavu

Theses and Dissertations

Cybersecurity is known today as one of the greatest challenges of the modern era. Among the various types of cyber-attacks that threaten our security, the Distributed Denial of Service (DDoS) attack is among some of the most common, effective, and well-recognized attack strategies. Since this form of attack is meant to disrupt the availability factor covertly, it can be detrimental to the targeted machines and difficult to discover. Because of that, there have been several approaches, as well as solutions that have been devised to detect it as accurately and efficiently as possible. In this study, four sequential data modeling …

Predicting Music Origin With Deep Learning, Fruzsina Ladanyi

Electronic Theses, Projects, and Dissertations

This project explores the usage of a late fusion deep learning architecture to predict the geographic origin of music. Mel-Frequency Cepstral Coefficients (MFCCs) and the language of the music sample are used as features. MFCCs were extracted from audio files to capture sound features. The language was identified using OpenAI’s Whisper model to provide additional context. A late fusion neural network architecture combining Long Short-Term Memory (LSTM) layers for sequential MFCC input and dense layers for non-sequential language features were employed to support both classification and regression tasks. The classification model achieved an accuracy of 33.03% across 56 countries or …

Roadside Asset Extraction From Mobile Lidar Point Cloud, Yushin Ahn, Riadh Munjy, Stephen Choi

Mineta Transportation Institute

Mobile LiDAR systems are powerful tools that help us map roads and their surroundings in 3D with great speed and precision. The data provided by these systems support urban planning efforts, digital mapping, transportation infrastructure maintenance, and more. This report presents a comprehensive workflow for roadside asset extraction using Mobile Terrestrial Laser Scanning (MTLS) data, focusing on road lane detection, cross-section slope analysis, and point cloud classification. Roadside asset extraction is the identification and classification of roadside features like signs and poles. The dataset, acquired using a high-resolution mobile LiDAR system, contains over 5.7 billion points (pieces of data) across …

Use Of A Preliminary Artificial Intelligence-Based Laryngeal Cancer Screening Framework For Low-Resource Settings: Development And Validation Study, Shao Wei Sean Lam, Min Hun Lee, Michael Dorosan, Samuel Altonji, Hiang Khoon Tan, Walter T. Lee

Research Collection School Of Computing and Information Systems

Background: Early-stage diagnosis of laryngeal cancer significantly improves patient survival and quality of life. However, the scarcity of specialists in low-resource settings hinders the timely review of flexible nasopharyngoscopy (FNS) videos, which are essential for accurate triage of at-risk patients.Objective: We introduce a preliminary AI-based screening framework to address this challenge for the triaging of at-risk patients in low-resource settings. This formative research addresses multiple challenges common in high-dimensional FNS videos: (1) selecting clear, informative images; (2) deriving regions within frames that show an anatomical landmark of interest; and (3) classifying patients into referral grades based on the FNS video …

Gene Regulatory Network Prediction Using Machine Learning, Deep Learning, And Hybrid Approaches, Sai Teja Mummadi, Md Khairul Islam, Victor Busov, Hairong Wei

Michigan Tech Publications

Construction of gene regulatory networks (GRNs) is essential for elucidating the regulatory mechanisms underlying metabolic pathways, biological processes, and complex traits. In this study, we developed and evaluated machine learning, deep learning, and hybrid approaches for constructing GRNs by integrating prior knowledge and large-scale transcriptomic data from Arabidopsis thaliana, poplar, and maize. Among these, hybrid models that combined convolutional neural networks and machine learning consistently outperformed traditional machine learning and statistical methods, achieving over 95% accuracy on the holdout test datasets. These models not only identified a greater number of known transcription factors regulating the lignin biosynthesis pathway but also …