Artificial Intelligence and Robotics Commons^™

Deep Learning-Based Co-Current Upward Gas-Liquid Two-Phase Flow Regime Identification In An Annular Conduit, Joshua Robert Macomber

Graduate Theses, Dissertations, and Problem Reports (ETD)

Flow regime identification in co-current upward gas-liquid flow through annular conduits remains a significant challenge in petroleum engineering, with major safety and operational implications. It is also important across industries involving the transport of multiphase fluids. Misidentifying flow regimes can introduce major operational risk, yet regime boundaries in annular gas-liquid flow are often visually complex and context dependent.

The objective of this study was to evaluate the utility of convolutional neural network (CNN) classifiers for flow regime identification. The CNN was trained using annular flow image dataset published by Texas A&M University. The dataset consists of approximately 947 RGB images …

Research On Infrared And Visible Light Fusion Method Based On Resnet-50 And Laplacian Filtering, Xiao Wang, Xiangyang Li, Feng Liang, Zhili Zhang

Journal of System Simulation

Abstract: In order to solve the problem that existing infrared and visible light image fusion techniques often suffer from artifacts caused by insufficient contrast, spectral distortion, and high computational complexity, a fusion framework based on ResNet-50 and Laplacian filtering was proposed. ResNet-50 was used to extract shallow and deep features, followed by multi-scale feature fusion. Laplacian filtering was applied to optimize feature information, and an automatic discriminator was introduced to further improve the fusion effect. Simulation results show that, compared with comparison algorithms, the proposed method achieves an average increase of 2.71% and 2.16% in information entropy, 5.98% and …

Speculative Automated Refactoring Of Imperative Deep Learning Programs To Graph Execution, Raffi Khatchadourian Ph.D., Tatiana Castro Vélez, Mehdi Bagherzadeh, Nan Jia, Anita Raja

Publications and Research

Efficiency is essential to support ever-growing datasets, especially for Deep Learning (DL) systems. DL frameworks have traditionally embraced deferred execution-style DL code---supporting symbolic, graph-based Deep Neural Network (DNN) computation. While scalable, such development is error-prone, non-intuitive, and difficult to debug. Consequently, more natural, imperative DL frameworks encouraging eager execution have emerged but at the expense of run-time performance. Though hybrid approaches aim for the "best of both worlds," using them effectively requires subtle considerations. Our key insight is that, while DL programs typically execute sequentially, hybridizing imperative DL code resembles parallelizing sequential code in traditional systems. Inspired by this, we …

Speculative Automated Refactoring Of Imperative Deep Learning Programs To Graph Execution, Raffi Khatchadourian Ph.D., Tatiana Castro Vélez, Mehdi Bagherzadeh, Nan Jia, Anita Raja

Publications and Research

Efficiency is essential to support ever-growing datasets, especially for Deep Learning (DL) systems. DL frameworks have traditionally embraced deferred execution-style DL code---supporting symbolic, graph-based Deep Neural Network (DNN) computation. While scalable, such development is error-prone, non-intuitive, and difficult to debug. Consequently, more natural, imperative DL frameworks encouraging eager execution have emerged but at the expense of run-time performance. Though hybrid approaches aim for the "best of both worlds," using them effectively requires subtle considerations. Our key insight is that, while DL programs typically execute sequentially, hybridizing imperative DL code resembles parallelizing sequential code in traditional systems. Inspired by this, we …

Speculative Automated Refactoring Of Imperative Deep Learning Programs To Graph Execution, Raffi T. Khatchadourian Ph.D., Tatiana Castro Vélez, Mehdi Bagherzadeh, Nan Jia, Anita Raja

Publications and Research

Efficiency is essential to support ever-growing datasets, especially for Deep Learning (DL) systems. DL frameworks have traditionally embraced deferred execution-style DL code---supporting symbolic, graph-based Deep Neural Network (DNN) computation. While scalable, such development is error-prone, non-intuitive, and difficult to debug. Consequently, more natural, imperative DL frameworks encouraging eager execution have emerged but at the expense of run-time performance. Though hybrid approaches aim for the "best of both worlds," using them effectively requires subtle considerations. Our key insight is that, while DL programs typically execute sequentially, hybridizing imperative DL code resembles parallelizing sequential code in traditional systems. Inspired by this, we …

When Deep Learning Meets Information Retrieval-Based Bug Localization: A Survey, Feifei Niu, Chuanyi Li, Kui Liu, Xin Xia, David Lo

Research Collection School Of Computing and Information Systems

Bug localization is a crucial aspect of software maintenance, running through the entire software lifecycle. Information retrieval-based bug localization (IRBL) identifies buggy code based on bug reports, expediting the bug resolution process for developers. Recent years have witnessed significant achievements in IRBL, propelled by the widespread adoption of deep learning (DL). To provide a comprehensive overview of the current state of the art and delve into key issues, we conduct a survey encompassing 61 IRBL studies leveraging DL. We summarize best practices in each phase of the IRBL workflow, undertake a meta-analysis of prior studies, and suggest future research directions. …

Soft Sensor Modeling Based On Improved Transformer In Dual-Stream Framework, Hao Gu, Jiayu Wang, Weili Xiong

Journal of System Simulation

Abstract: Industrial process information is highly nonlinear and dynamic, with long-term dependencies between data, making it difficult to adequately extract time-series features. To address this issue, an improved Transformer-based soft sensor model in a dual-stream framework was proposed. The data were segmented and expanded. The features were extracted in parallel using a dual-stream structure combining a convolutional neural network with a self-attention mechanism and the improved Transformer model. The dual-stream features were fused for soft sensor regression. Residual connections were further introduced to accelerate the convergence speed of the model, and an orthogonal random features-based improved multi-head attention mechanism was …

Artificial Intelligence In Head And Neck Cancer: Towards Precision Medicine, Jacob Hagen, Logan Hornung, William Barham, Supratik Mukhopadhyay, Adam Bess, Kevin Contrera, Devraj Basu, Vlad Sandulache, Guillaume Spielmann, Sagar Kansara

School of Medicine Faculty Publications

Over the past 20 years, the capabilities of artificial intelligence (AI) have gained significant interest. While AI has been implemented to various degrees in several disciplines, its unique applications in head and neck cancer (HNC) remain underdeveloped. This narrative review examines the existing body of literature regarding the use of AI in HNC. Studies to date have demonstrated AI’s utility across multiple phases of the HNC treatment continuum. Despite its promise, integrating AI into clinical practice faces several challenges, including concerns about system integrity, generalizability, privacy, and bias. In this review, we address these challenges and offer insights into future …

Sugar: A Sequence Unfolding Based Transformer Model For Group Activity Recognition, Yash U. Gondkar

Graduate Masters Theses

Large Language Models have improved significantly in the past couple of years due to the adoption of transformers. However, transformers still find it challenging to process videos due to limited context size caused by their quadratic computing cost. Therefore, we studied a booming field in machine learning which powers applications like social scene analysis and video surveillance systems called Group Activity Recognition (GAR). We found that recent models were able to achieve more than 90% accuracy on popular datasets like the Volleyball dataset, however, it turned out that even they relied on transformers.

Therefore, in this work, we developed a …

Use Of A Preliminary Artificial Intelligence-Based Laryngeal Cancer Screening Framework For Low-Resource Settings: Development And Validation Study, Shao Wei Sean Lam, Min Hun Lee, Michael Dorosan, Samuel Altonji, Hiang Khoon Tan, Walter T. Lee

Research Collection School Of Computing and Information Systems

Background: Early-stage diagnosis of laryngeal cancer significantly improves patient survival and quality of life. However, the scarcity of specialists in low-resource settings hinders the timely review of flexible nasopharyngoscopy (FNS) videos, which are essential for accurate triage of at-risk patients.Objective: We introduce a preliminary AI-based screening framework to address this challenge for the triaging of at-risk patients in low-resource settings. This formative research addresses multiple challenges common in high-dimensional FNS videos: (1) selecting clear, informative images; (2) deriving regions within frames that show an anatomical landmark of interest; and (3) classifying patients into referral grades based on the FNS video …

Roadside Asset Extraction From Mobile Lidar Point Cloud, Yushin Ahn, Riadh Munjy, Stephen Choi

Mineta Transportation Institute

Mobile LiDAR systems are powerful tools that help us map roads and their surroundings in 3D with great speed and precision. The data provided by these systems support urban planning efforts, digital mapping, transportation infrastructure maintenance, and more. This report presents a comprehensive workflow for roadside asset extraction using Mobile Terrestrial Laser Scanning (MTLS) data, focusing on road lane detection, cross-section slope analysis, and point cloud classification. Roadside asset extraction is the identification and classification of roadside features like signs and poles. The dataset, acquired using a high-resolution mobile LiDAR system, contains over 5.7 billion points (pieces of data) across …

Research On Requirements And Methods For Intelligent Assessment Of Simulation Credibility, Bingheng Wang, Tingrui Liu, Fan Yang, Huan Zhang, Wei Li, Ping Ma, Ming Yang

Journal of System Simulation

Abstract: The accuracy of simulations in representing real-world systems is a critical concern for users. Simulation credibility assessment ensures trustworthiness by evaluating the correctness and effectiveness of simulations to meet application requirements. As simulation technologies are widely adopted, and new simulation paradigms emerge, traditional assessment methods are increasingly showing limitations in their dependence on experts, data processing capabilities, and assessment efficiency. This paper systematically reviewed the research demands, current progress, new technologies, and future trends of intelligent simulation credibility assessment. Based on the simulation credibility assessment process and problem analysis, the requirements for intelligent credibility assessment were discussed. Intelligent technologies …

Graph Traverse Reference Network For Sign Language Corpus Retrieval In The Wild, Kun Hu, Fengxiang He, Adam Schembri, Zhiyong Wang

Research outputs 2022 to 2026

Sign languages are the primary languages of the deaf community as well as hearing individuals who are unable to speak, which engage the visual-manual modality to convey meanings. In recent years, there has been an explosive growth of sign language videos available from video streaming and social media service platforms. Given the size of these corpora, sign language users often face significant challenges in effectively acquiring the information they need. Therefore, we propose a novel deep learning architecture, namely Graph Traverse Reference Network (GTRN), allowing visual signing queries to retrieve relevant sign language videos (documents) from a large corpus. GTRN …

Aircraft Bird Strike Risk Prediction Using Machine Learning And Analytic Hierarchy Process, Jason Anthony Powell

Doctoral Dissertations and Master's Theses

To address the limitations of Next Generation Radar-based bird strike forecasting, this study modeled 12 spatiotemporal weather features from the National Oceanic and Atmospheric Administration alongside bird strike risk using Long Short-Term Memory Recurrent Neural Network (LSTM-RNN), XGBoost regression tree, and Bayesian network algorithms. Five years of bird strike data from four geographically diverse airfields served as the target risk variable, categorized as low, moderate, or severe based on Department of the Air Force risk models. The ensemble model, which combines the LSTM-RNN and XGBoost regression algorithms, yielded the most accurate forecasts, achieving 80% to 93% accuracy across all airfields, …

Simulation Study On Adaptive Signal Control Of Deformed Intersection Based On Lstm-Gnn, Kun Chen, Liang Chen, Jiming Xie, Fengbo Liu, Taixiong Chen, Lukuan Wei

Journal of System Simulation

Abstract: Aiming at the traffic congestion at deformed intersections, an improved adaptive traffic signal control scheme based on deep learning is designed, the scheme integrates the adaptive signal control of LSTM and GNN at deformed intersections. LSTM is used to capture the dependence between time series traffic data, while GNN is used to construct a spatial interaction model between lanes. By integrating the information of time and space dimensions, the model can dynamically adjust the phase duration of signal lights according to real-time traffic conditions. The results indicate that the LSTM-GNN adaptive control scheme improves overall traffic throughput efficiency by …

Enriching Vision Representation By Deep Neural Networks And Self-Supervised Learning, Yucong Shen

Dissertations

Nowadays, more and more interesting computer vision tasks are tackled by deep learning approaches. However, the increasing model complexity imposes significant computational and storage costs. To address this challenge, this dissertation explores efficient deep learning techniques, proposing morphological layer, an efficient feature extraction layer. It achieves competitive image classification accuracy with significantly decreased model parameters. Another attempt at efficient deep learning is a proposed channel pruning approach that compresses deep neural networks by identifying and removing redundant channels using optimal transport theory. This approach achieves significant reductions in model size and computational cost while maintaining or even improving performance across …

Computational Modeling And Structural Generation Of Piano Music In The Classical Style, Yijing Feng

Dartmouth College Ph.D Dissertations

Listening to fast-tempo piano sonatas of the Classical period (circa 1750-1820) has been shown to have therapeutic effects for neurological disorders such as epilepsy. The limited existing repertoire of music in this style motivates the creation of more long-form, coherent compositions with clearly defined structure. Despite the long history of computer-based music generation and recent progress in deep learning, particularly transformer-based models, generating structurally coherent long-form music remains a major challenge. This difficulty stems from the scarcity of reliable structural annotation datasets, the computational demands of modeling very long musical sequences, and the lack of effective structural encoding in both …

Hybridize Functions: A Tool For Automatically Refactoring Imperative Deep Learning Programs To Graph Execution, Raffi Khatchadourian, Tatiana Castro Vélez, Mehdi Bagherzadeh, Nan Jia, Anita Raja

Publications and Research

Efficiency is essential to support responsiveness w.r.t. ever-growing datasets, especially for Deep Learning (DL) systems. DL frameworks have traditionally embraced deferred execution-style DL code—supporting symbolic, graph-based Deep Neural Network (DNN) computation. While scalable, such development is error-prone, non-intuitive, and difficult to debug. Consequently, more natural, imperative DL frameworks encouraging eager execution have emerged but at the expense of run-time performance. Though hybrid approaches aim for the “best of both worlds,” using them effectively requires subtle considerations to make code amenable to safe, accurate, and efficient graph execution—avoiding performance bottlenecks and semantically inequivalent results. We discuss the engineering aspects of a …

Hybridize Functions: A Tool For Automatically Refactoring Imperative Deep Learning Programs To Graph Execution, Raffi Khatchadourian, Tatiana Castro Vélez, Mehdi Bagherzadeh, Nan Jia, Anita Raja

Publications and Research

Efficiency is essential to support responsiveness w.r.t. ever-growing datasets, especially for Deep Learning (DL) systems. DL frameworks have traditionally embraced deferred execution-style DL code—supporting symbolic, graph-based Deep Neural Network (DNN) computation. While scalable, such development is error-prone, non-intuitive, and difficult to debug. Consequently, more natural, imperative DL frameworks encouraging eager execution have emerged but at the expense of run-time performance. Though hybrid approaches aim for the “best of both worlds,” using them effectively requires subtle considerations to make code amenable to safe, accurate, and efficient graph execution—avoiding performance bottlenecks and semantically inequivalent results. We discuss the engineering aspects of a …

Hybridize Functions: A Tool For Automatically Refactoring Imperative Deep Learning Programs To Graph Execution, Raffi Khatchadourian, Tatiana Castro Vélez, Mehdi Bagherzadeh, Nan Jia, Anita Raja

Publications and Research

Efficiency is essential to support responsiveness w.r.t. ever-growing datasets, especially for Deep Learning (DL) systems. DL frameworks have traditionally embraced deferred execution-style DL code—supporting symbolic, graph-based Deep Neural Network (DNN) computation. While scalable, such development is error-prone, non-intuitive, and difficult to debug. Consequently, more natural, imperative DL frameworks encouraging eager execution have emerged but at the expense of run-time performance. Though hybrid approaches aim for the "best of both worlds," using them effectively requires subtle considerations to make code amenable to safe, accurate, and efficient graph execution—avoiding performance bottlenecks and semantically inequivalent results. We discuss the engineering aspects of a …

Unpaired Virtual Histological Staining Of Tissue From Autofluorescence Using Regularized Cycle-Consistent Adversarial Networks, Zhesi Wen

Theses and Dissertations

We present a regularized CycleGAN with a Dense Residual U-Net to virtually stain autofluorescence images of tissue into H&E-like images. Our method outperforms standard architectures, reduces artifacts, and achieves superior FID scores, enabling efficient, label-free, and accurate digital pathology for unpaired datasets using multi-channel fluorescence inputs.

Controlling A Mobile Inverted Pendulum And Optimizing Leaning Angle To Apply Force Using Reinforcement Learning, Aryan Mediratta

2025 Spring Honors Capstone Projects - Archive

Reinforcement Learning is a Machine Learning paradigm that involves simulating learning through rewards and penalties in intelligent systems. This technique is often employed in robotics when traditional control methods are insufficient or when human intuition does not provide a good solution on how to control robot systems, This project involves training a Segway-style Mobile Inverted Pendulum (MIP) robot to balance and push a box forward. The BeagleBone Blue board is used that includes a built-in Inertial Measurement Unit (IMU) and encoder ports. These sensors enable the system to measure its current state. The goal is to find the optimal leaning …

Time Series Deep Learning Approach For The Intermittent Operational Performance Of A Wellhead Water Treatment And Desalination System, Michael G. Clement

Electronic Theses, Projects, and Dissertations

Distributed water treatment and desalination (DWTD) systems are becoming significant for serving disadvantaged communities that are geographically segregated from centralized water distribution networks. However, given the remote nature of the communities, these systems must operate autonomously adapting to intermittent operations due to varying water use patterns and unavailability of continuous manual labor support. Machine Learning models describing and forecasting system performance are critical, allowing for model-based control, performance forecasting, fault detection, and determination of causal relationships among process attributes. Accordingly, graph convolutional neural networks with an attention mechanism (GATConv) were developed to describe the intermittent operational profiles of a wellhead …

On Bed Posture Recognition Using Deep Learning With Pressure Sensors, Farheen Akhter Ms

Electronic Theses, Projects, and Dissertations

In healthcare applications such as disease prevention, sleep quality evaluation, and patient monitoring, bed posture recognition is essential. Using pressure sensor arrays placed on top of or embedded in mattresses, this study investigates the application of deep learning models for non-invasive posture classification. Although they have been widely employed, traditional machine learning approaches like support vector machines (SVM) and k-nearest neighbors (KNN) sometimes struggle with feature extraction and real-time performance necessitating considerable processing resources. I implemented a model using conventional approaches to get over these restrictions, then fine-tuned it using the following deep learning architectures for bed posture recognition: ResNet-50, …

Advancing Precision And Autonomy In Agriculture And Medical Imaging Through Ai And Computer Visions, Tan-Hanh Pham

Theses and Dissertations

Deep learning has revolutionized numerous fields by enhancing precision, automation, and decision-making capabilities. This dissertation explores its applications in agriculture and medical image processing, introducing novel methodologies to improve accuracy and efficiency in these domains. These fields hold critical societal importance -- agriculture underpins global food security and sustainability, while medical imaging drives advancements in diagnostics and personalized healthcare, both benefiting significantly from data-driven innovations. In agriculture, deep learning is applied to precision spray systems through droplet analysis. Specifically, a generative model is designed to create synthetic droplet images, addressing the challenge of limited training samples, which are expensive …

Artificial Intelligence Applications For Grid-Connected Solar Inverters, Utkirjon Ubaydullaev, Sarvinoz Mirzaeva, Hasan Mustafoev

Chemical Technology, Control and Management

The increasing global demand for renewable energy has highlighted the importance of grid-connected solar inverters in ensuring efficient and stable power conversion. However, challenges such as fluctuations in solar energy generation, grid disturbances, and power quality issues necessitate advanced control strategies. The integration of artificial intelligence (AI) into solar inverters presents a transformative solution, enhancing performance, adaptability, and reliability in real-world applications.

This review explores the role of AI techniques, including machine learning (ML), deep learning (DL), fuzzy logic, and reinforcement learning (RL), in optimizing key inverter functionalities such as maximum power point tracking (MPPT), fault detection, power quality enhancement, …

A Hybrid Deep Learning-Based Approach For Visual Field Test Forecasting, Ashkan Abbasi, Sowjanya Gowrisankaran, Wei-Chun Lin, Xubo Song, Bhavna Josephine Antony, Gadi Wollstein, Joel Schuman, Hiroshi Ishikawa

Wills Eye Hospital Papers

OBJECTIVE: Longitudinal assessment of visual field (VF) testing is essential in glaucoma management. Conventional VF forecasting methods require numerous prior tests, while deep learning techniques have shown promising results with fewer tests. This study introduces a hybrid deep learning framework to enhance flexibility and accuracy in VF test forecasting.

DESIGN: A retrospective longitudinal study using deep learning-based VF forecasting models.

SUBJECTS AND CONTROLS: A total of 1750 subjects (healthy and glaucoma patients) with 19 437 Humphrey VF (24-2 Swedish Interactive Threshold Algorithm) tests collected from longitudinal glaucoma cohorts at the University of Pittsburgh and New York University.

METHODS: Three deep …

Leveraging Attention Mechanism To Unlock Gene And Protein Attributes, Ala Jararweh

Computer Science ETDs

Advancing personalized medicine depends on effectively integrating and interpreting the vast, heterogeneous landscape of biological data, from genomic sequences and transcriptomics to the insights embedded in scientific literature. Current machine learning models often focus on single data modalities, limiting their capacity to capture the multifaceted nature of biological systems. We address this gap by developing three attention-based machine-learning models integrating diverse data modalities. Firstly, DeepVul is a multi-task model that leverages cancer transcriptome data to predict genes critical for cancer survival and their corresponding drugs. Subsequently, LitGene refines gene representations by integrating textual information from the scientific literature. Finally, Protein2Text …

Cutting-Edge Deep Learning Methods For Image-Based Object Detection In Autonomous Driving: In-Depth Survey, Narges Saeedizadeh, Seyed Mohammad Jafar Jalali, Burhan Khan, Shady Mohamed

Research outputs 2022 to 2026

Object detection is a critical aspect of computer vision (CV) applications, especially within autonomous driving systems (AVs), where it is fundamental to ensuring safety and reducing traffic accidents. Recent advancements in computational resources have enabled the widespread adoption of Deep Learning (DL) techniques, significantly enhancing the efficiency and accuracy of object detection tasks. However, the technology for autonomous driving has yet to reach a level of maturity that guarantees consistent performance, reliability, and safety, with several challenges remaining unresolved. This study specifically focuses on 2D image-based object detection methods, which offer several advantages over other modalities, such as cost-effectiveness and …

Research On Air Target Threat Assessment Technology Based On Deep Learning, Dawei Jiang, Yangyang Dong, Lidong Zhang, Xiao Lu, Chunxi Dong

Journal of System Simulation

Abstract: In order to realize the effective assessment of air combat targets, a deep learning-based air target threat assessment method is proposed. According to threat characteristics of the air target, the threat attributes of air target faced by electronic countermeasure operation are analyzed from the two perspectives of platform layer and equipment layer, the air target threat assessment index system is constructed, and the air target threat assessment index data set is established. Based on convolutional neural network, a residual structure is introduced to optimize the network, a threat assessment model is established, and the threat ranking of air targets …