Artificial Intelligence and Robotics Commons^™

Smart Highway Construction Site Monitoring Using Artificial Intelligence, Mehran Mazari, Yahaira Nava-Gonzalez, Ly Jacky N. Nhiayi, Mohamad H. Saleh

Mineta Transportation Institute

Construction is a large sector of the economy and plays a significant role in creating economic growth and national development,and construction of transportation infrastructure is critical. This project developed a method to detect, classify, monitor, and track objects during the construction, maintenance, and rehabilitation of transportation infrastructure by using artificial intelligence and a deep learning approach. This study evaluated the performance of AI and deep learning algorithms to compare their performance in detecting and classifying the equipment in various construction scenes. Our goal was to find the optimized balance between the model capabilities in object detection and memory processing requirements. …

Artificial Intelligence (Ai) In Pharmacy, Giang Nguyen, Elizabeth Sartschev, John Reyes, Allie Honigford, Marisa Petrunich, Kiley Devoll, Brianna Lu, Joshua Honaker, T'Bony M. Jewell

Pharmacy and Wellness Review

Artificial Intelligence (AI) has transformed the pharmaceutical field by enabling computer software systems to learn and perform human behavior. Specifically, AI has revolutionized chronic diabetes management through continuous glucose monitoring, showcasing its immense potential in healthcare. However, alongside its transformative impact, AI’s increasing role in healthcare has prompted concerns over privacy and its premature integration. Despite these challenges, AI offers limitless opportunities to improve medication management and treatment regimens, driving advancements across various domains. From improving CT imaging to enhancing adenoma detection in colonoscopies and facilitating medication adherence, AI’s impact on healthcare is profound. Furthermore, AI plays a pivotal role …

Deep Learning-Based Auto-Segmentation For Liver Yttrium-90 Selective Internal Radiation Therapy, Jun Li, Wookjin Choi, Rani Anne

Department of Radiation Oncology Faculty Papers

The aim was to evaluate a deep learning-based auto-segmentation method for liver delineation in Y-90 selective internal radiation therapy (SIRT). A deep learning (DL)-based liver segmentation model using the U-Net3D architecture was built. Auto-segmentation of the liver was tested in CT images of SIRT patients. DL auto-segmented liver contours were evaluated against physician manually-delineated contours. Dice similarity coefficient (DSC) and mean distance to agreement (MDA) were calculated. The DL-model-generated contours were compared with the contours generated using an Atlas-based method. Ratio of volume (RV, the ratio of DL-model auto-segmented liver volume to manually-delineated liver volume), and ratio of activity (RA, …

Quantum-Augmented Ai/Ml For O-Ran: Hierarchical Threat Detection For Synergistic Intelligence And Interpretability, Tan Le, Vanessa Le, Sachin Shetty

VMASC Publications

Open Radio Access Networks (O-RAN) enhance modularity and telemetry granularity but also widen the cybersecurity attack surface across disaggregated control, user and management planes. We propose a hierarchical defense framework with three coordinated layers—anomaly detection, intrusion confirmation, and multiattack classification—each aligned with O-RAN’s telemetry stack. Our approach integrates hybrid quantum computing and machine learning, leveraging amplitude- and entanglement-based feature encodings with deep and ensemble classifiers. We conduct extensive benchmarking across synthetic and real-world telemetry, evaluating encoding depth, architectural variants, and diagnostic fidelity. The framework consistently achieves near-perfect accuracy, high recall, and strong class separability. Multi-faceted evaluation across decision boundaries, probabilistic …

Deepsecure: A Novel Deep Learning Model For Effective Detection Of Attacks On Big Data In Internet Of Urban Things, Laiba Sabir, Nadeem Javaid, Mariam Akbar, Nabil Alrajeh, Safdar Hussain Bouk, Abdulaziz Aldegheishem

School of Cybersecurity Faculty Publications

The Internet of Urban Things (IoUTs) regularly generates large amounts of data, making it a focus of cyberthreats such as denial-of-service attacks and malware bot networks. Traditional intrusion detection systems struggle to detect intricate attack patterns, handle class imbalance, capture temporal dependencies, and exhibit transparency. To address these limitations, we introduce a novel deep machine learning model, DeepSecure, a hybrid model that combines Deep Belief Networks (DBN) for hierarchical feature extraction and Deep Neural Networks for attack classification. DBN is used for feature selection through unsupervised learning to extract hierarchical representations in the IoUTs network data. We assess the random …

An Integrated Machine Learning Approach For Identifying Emergency Rescue Messages On Social Media During Natural Disasters, Wael Khallouli, Jiang Li, Jingwei Huang, Ghaith Rabadi, Samuel Kovacic

School of Cybersecurity Faculty Publications

During large-scale disasters, emergency call centers are often overwhelmed by the large volume of rescue requests and calls for help. Consequently, people are turning to social media platforms to seek assistance. Rescue information posted on these platforms is extremely valuable for first responders to make informed rescue decisions. Therefore, the automatic identification of these requests from the vast amount of data posted on social media during crises is critical yet challenging. This work presents our ongoing research on applying deep learning techniques to extract actionable rescue information from social media during crises. We proposed a novel deep learning model that …

Development Of An Ecg-Based Deep Learning Model For Pediatric Congenital Heart Disease (Chd) Diagnosis, Annbar Mekouar

Selected Full-Text Master Theses 2021-

Congenital heart disease (CHD) stands as the leading congenital anomaly which affects pediatric populations throughout the world. The effectiveness of treatment depends on both early diagnosis and accurate identification but echocardiography requires manual interpretation which proves time-consuming and inconsistent especially when examining pediatric patients with their distinct cardiac systems. The research aims to create a deep learning-based diagnostic framework which uses ECG data to identify coronary artery disease subtypes in pediatric patients. The model uses high-quality datasets from Dr. Ignacio Lugones to extract R-R intervals and QRS durations through convolutional neural networks (CNNs). The system addresses pediatric-specific challenges while enhancing …

Physics-Informed Deep Learning With Kalman Filter Mixture For Traffic State Prediction, Niharika Deshpande, Hyoshin (John) Park

Engineering Management & Systems Engineering Faculty Publications

Accurate traffic forecasting is crucial for understanding and managing congestion for efficient transportation planning. However, conventional approaches often neglect epistemic uncertainty, which arises from incomplete knowledge across different spatiotemporal scales. This study addresses this challenge by introducing a novel methodology to establish dynamic spatiotemporal correlations that captures the unobserved heterogeneity in travel time through distinct peaks in probability density functions, guided by physics-based principles. We propose an innovative approach to modifying both prediction and correction steps of the Kalman Filter (KF) algorithm by leveraging established spatiotemporal correlations. Central to our approach is the development of a novel deep learning model …

Leveraging Transformer-Based Ocr Model With Generative Data Augmentation For Engineering Document Recognition, Wael Khallouli, Mohammad Shahab Uddin, Andres Sousa-Poza, Jiang Li, Samuel Kovacic

Engineering Management & Systems Engineering Faculty Publications

The long-standing practice of document-based engineering has resulted in the accumulation of a large number of engineering documents across various industries. Engineering documents, such as 2D drawings, continue to play a significant role in exchanging information and sharing knowledge across multiple engineering processes. However, these documents are often stored in non-digitized formats, such as paper and portable document format (PDF) files, making automation difficult. As digital engineering transforms processes in many industries, digitizing engineering documents presents a crucial challenge that requires advanced methods. This research addresses the problem of automatically extracting textual content from non-digitized legacy engineering documents. We introduced …

Gramseq-Dta: A Grammar-Based Drug-Target Affinity Prediction Approach Fusing Gene Expression Information, Kasul Debnath, Pratip Rana, Preetam Ghosh

Computer Science Faculty Publications

Drug–target affinity (DTA) prediction is a critical aspect of drug discovery. The meaningful representation of drugs and targets is crucial for accurate prediction. Using 1D string-based representations for drugs and targets is a common approach that has demonstrated good results in drug–target affinity prediction. However, these approach lacks information on the relative position of the atoms and bonds. To address this limitation, graph-based representations have been used to some extent. However, solely considering the structural aspect of drugs and targets may be insufficient for accurate DTA prediction. Integrating the functional aspect of these drugs at the genetic level can enhance …

Multi-Modal Mri Based Segmentation Of Brain Metastases Using Adaptive Self-Attention, Evan Savaria

Computer Science Faculty Publications

Brain metastases (BMs) are the most common adult central nervous system malignancy, affecting 20–40% of cancer patients. Accurate segmentation of metastatic lesions in multi-modal MRI is essential for treatment planning and prognosis however, manual delineation is time consuming and prone to variability. Traditional deep learning models such as U-Net, have improved segmentation accuracy but capture limited long-range dependencies and struggle with variations in metastasis size, shape, and distribution. This study introduces the Adaptive Integrated Multi-modal Segmentation (AIMS) model, an adaptive self-attention framework within a hybrid U-Net and Transformer architecture to enhance BM segmentation by leveraging multi-modal MRI integration. The proposed …

A Survey On Deep Learning For Drug-Target Binding Prediction: Models, Benchmarks, Evaluation, And Case Studies, Kusal Debnath, Pratip Rana, Preetam Ghosh

Computer Science Faculty Publications

Conventional drug discovery is expensive, time-consuming, and prone to failure. Artificial intelligence has become a potent substitute over the last decade, providing strong answers to challenging biological issues in this field. Among these difficulties, drug-target binding (DTB) is a key component of drug discovery techniques. In this context, drug-target affinity and drug–target interaction are complementary and essential frameworks that work together to improve our comprehension of DTB dynamics. In this work, we thoroughly analyze the most recent deep learning models, popular benchmark datasets, and assessment metrics for DTB prediction. We look at the paradigm shift in the development of drug …

Optimizing Ai Language Models: A Study Of Chatgpt-4 Vs. Chatgpt-4o, Md Nurul Absar Siddiky, Muhammad Enayetur Rahman, Md Fayaz Bin Hossen, Muhammad Rezaur Rahman, Md. Shahadat Jaman

Electrical & Computer Engineering Faculty Publications

This paper presents a comparative analysis of OpenAI's GPT-4 and its optimized variant, GPT-4o, focusing on their architectural differences, performance, and real-world applications. GPT-4, built upon the Transformer architecture, has set new standards in natural language processing (NLP) with its capacity to generate coherent and contextually relevant text across a wide range of tasks. However, its computational demands, requiring substantial hardware resources, make it less accessible for smaller organizations and real-time applications. In contrast, GPT-4o addresses these challenges by incorporating optimizations such as model compression, parameter pruning, and memory-efficient computation, allowing it to deliver similar performance with significantly lower computational …

Deepssetracer 2.0: Improved Deep Learning Model Performance For Protein Secondary Structure Segmentation From Cryo-Em Maps, Bryan Hawickhorst, Thu Nguyen, Willy Wriggers, Jiangwen Sun, Jing He

Computer Science Faculty Publications

DeepSSETracer is a method for segmenting protein secondary structure from medium-resolution (5-10Å) cryogenic electron microscopy (cryo-EM) density maps. We conducted experiments and ablation studies to examine the effects of normalization methods, max-pooling, activation functions, and loss calculation region on DeepSSETracer. By combining multiple technical improvements, the performance of the new version, DeepSSETracer 2.0, was significantly enhanced compared to DeepSSETracer 1.1. On a set of 77 test cases, the weighted average per-voxel F1 score increased from 62.1% to 70.3% for helix detection, and from 47.8% to 62.5% for β-sheet detection. While each of the five modifications in the network enhanced the …

Benchmarking And Improving Foundation Model Dietary Estimates From Meal Images, Yongcheng Mu, Jiangwen Sun, Jing He

Computer Science Faculty Publications

Accurate quantifying dietary contents, such as calories, proteins, carbohydrates, and fats, from an image of a meal plate is vital for managing diabetes. Recently, Large Multimodal Models (LMMs) have excelled in complex vision-language tasks due to their use of very large, highly diverse data. This study benchmarked the use of seven LMMs that include full and lightweight models of GPT, Gemini, and Llama for nutrition estimation based on Google's Nutrition5k dataset and our own phone-collected DonateAndLearn dataset. We analyzed the performance of LMMs and the RGB-D fusion model, in which the RGB-D model was specifically trained using Nutrition5k data. On …

Ai-Based Steganography Method To Enhance The Information Security Of Hidden Messages In Digital Images, Nhi Do Ngoc Huynh, Jiajun Jiang, Chung-Hao Chen, Wen-Chao Yang

Electrical & Computer Engineering Faculty Publications

With the increasing sophistication of Artificial Intelligence (AI), traditional digital steganography methods face a growing risk of being detected and compromised. Adversarial attacks, in particular, pose a significant threat to the security and robustness of hidden information. To address these challenges, this paper proposes a novel AI-based steganography framework designed to enhance the security of concealed messages within digital images. Our approach introduces a multi-stage embedding process that utilizes a sequence of encoder models, including a base encoder, a residual encoder, and a dense encoder, to create a more complex and secure hiding environment. To further improve robustness, we integrate …

A Fast Framework For Generating Radioactive Mixture Spectra And Its Application To Remote High-Performance Mixture Identification, Chiman Kwan, Bulent Ayhan, Adam Stavola, Kazi Aminul Islam, Hongfang Zhang, Jiang Li

Electrical & Computer Engineering Faculty Publications

Remote detection of radioactive materials in mixtures using handheld or portal detectors remains a challenge because of factors such as low concentration, environmental interference, sensor noise, and other complications. This work introduces a fast framework for generating realistic mixture spectra. Moreover, we present mixture isotope identification using data generated by the fast framework. Researchers have examined a range of conventional and recent algorithms within the fields of machine learning and deep learning. An application to uranium enrichment-level prediction has been included. Extensive simulation experiments validated the efficacy of the proposed framework.

Land Target Detection Algorithm In Remote Sensing Images Based On Deep Learning, Wenyi Hu, Xiaomeng Jiang, Jiawei Tian, Shitong Ye, Shan Liu

Electrical & Computer Engineering Faculty Publications

Remote sensing technology plays a crucial role across various sectors, such as meteorological monitoring, city planning, and natural resource exploration. A critical aspect of remote sensing image analysis is land target detection, which involves identifying and classifying land-based objects within satellite or aerial imagery. However, despite advancements in both traditional detection methods and deep-learning-based approaches, detecting land targets remains challenging, especially when dealing with small and rotated objects that are difficult to distinguish. To address these challenges, this study introduces an enhanced model, YOLOv5s-CACSD, which builds upon the YOLOv5s framework. Our model integrates the channel attention (CA) mechanism, CARAFE, and …

Adaptive Fusion Neural Networks For Sparse-Angle X-Ray 3d Reconstruction, Shaoyong Hong, Bo Yang, Yan Chen, Hao Quan, Shan Liu, Minyi Tang, Jiawei Tian

Electrical & Computer Engineering Faculty Publications

3D medical image reconstruction has significantly enhanced diagnostic accuracy, yet the reliance on densely sampled projection data remains a major limitation in clinical practice. Sparse-angle X-ray imaging, though safer and faster, poses challenges for accurate volumetric reconstruction due to limited spatial information. This study proposes a 3D reconstruction neural network based on adaptive weight fusion (AdapFusionNet) to achieve high-quality 3D medical image reconstruction from sparse-angle X-ray images. To address the issue of spatial inconsistency in multi-angle image reconstruction, an innovative adaptive fusion module was designed to score initial reconstruction results during the inference stage and perform weighted fusion, thereby improving …

Pushing The Boundaries Of Large Language Models: Innovations And Limitations In Nlp, Finance, And Mathematics, A M Muntasir Rahman

Dissertations

Large Language Models (LLMs) have emerged as transformative tools across a spectrum of domains, yet their practical deployment reveals a blend of remarkable potential and notable limitations. This research explores innovative methodologies to extend the capabilities of LLMs while addressing critical challenges in their evaluation and application. By leveraging rule-based approaches, the in-context learning capabilities of LLMs, and human-in-the-loop validation across three focused studies, this research introduces robust strategies for dataset synthesis, model enhancement, and model assessment in three distinct domains: natural language processing, financial sentiment analysis, and mathematical reasoning

The first study proposes an efficient data augmentation framework, EASE, …

Automated Segmentation Of The Ulnar Nerve In Mri Using Deep Learning Techniques, Akhil Nagulapalli

Theses

Cubital Tunnel Syndrome (CuTS), a condition caused by compression of the ulnar nerve, results in numbness, tingling, pain, and even muscle atrophy, affecting fine motor skills and diminishing patient quality of life. Accurate diagnosis of CuTS is challenging, as current diagnostic methods—including clinical exams, nerve conduction studies, and unaided MRI—often lack the precision to reliably identify the nerve and detect compression in its early stages. Deep learning-based segmentation offers a promising solution, enabling precise and automated identification of nerve structures in MRI images, which could significantly improve diagnostic accuracy and support timely intervention.

A novel deep learning model for segmenting …

Artificial Intelligence In Fetal And Pediatric Echocardiography, Alan Wang, Tam T Doan, Charitha Reddy, Pei-Ni Jone

Faculty, Staff and Students Publications

Echocardiography is the main modality in diagnosing acquired and congenital heart disease (CHD) in fetal and pediatric patients. However, operator variability, complex image interpretation, and lack of experienced sonographers and cardiologists in certain regions are the main limitations existing in fetal and pediatric echocardiography. Advances in artificial intelligence (AI), including machine learning (ML) and deep learning (DL), offer significant potential to overcome these challenges by automating image acquisition, image segmentation, CHD detection, and measurements. Despite these promising advancements, challenges such as small number of datasets, algorithm transparency, physician comfort with AI, and accessibility must be addressed to fully integrate AI …

Decoding Neural Networks: An Information-Theoretic Guide To Interpretability, Error Analysis And Efficiency, Mackenzie J. Meni

Theses and Dissertations

This dissertation addresses critical challenges in neural network design by leveraging entropy-based techniques to improve model efficiency, interpretability, and bias reduction. Focusing on the unique demands of computer vision applications, particularly object detection and classification for real-time systems, this work introduces a series of innovative methods centered on information theory. At the core of these methods is the Probabilistic Explanations of Entropic Knowledge (PEEK) framework, a tool developed to analyze and visualize entropy distributions across feature maps. PEEK offers insights into information flow within neural networks, making it possible to pinpoint layers that contribute meaningfully to decision-making or identify those …

Designing Customized Loss Functions For Training Deep Neural Networks, Ali Pourramezan Fard

Electronic Theses and Dissertations

This dissertation explores the critical role of loss functions in enhancing the predictive performance of deep machine learning models. Loss functions are an integral element of all the ongoing advances we witness daily in this domain. I design custom loss functions and their impacts on various machine learning tasks, particularly in computer vision.

In the first stage of my research, I aim to improve the prediction performance of deep learning models by providing them with more precise feedback associated with task requirements. This led me to create the concept of assistive loss functions. My first proposed loss function, inspired by …

Predicting And Monitoring Immune Checkpoint Inhibitor Therapy Using Artificial Intelligence In Pancreatic Cancer, Guangbo Yu, Zigeng Zhang, Aydin Eresen, Qiaoming Hou, Farideh Amirrad, Sha Webster, Surya M. Nauli, Vahid Yaghmai, Zhuoli Zhang

Pharmacy Faculty Articles and Research

Pancreatic cancer remains one of the most lethal cancers, primarily due to its late diagnosis and limited treatment options. This review examines the challenges and potential of using immunotherapy to treat pancreatic cancer, highlighting the role of artificial intelligence (AI) as a promising tool to enhance early detection and monitor the effectiveness of these therapies. By synthesizing recent advancements and identifying gaps in the current research, this review aims to provide a comprehensive overview of how AI and immunotherapy can be integrated to develop more personalized and effective treatment strategies. The insights from this review may guide future research efforts …

Collectively Advancing Deep Learning For Animal Detection In Drone Imagery: Successes, Challenges, And Research Gaps, Daniel Axford, Ferdous Sohel, Mathew A. Vanderklift, Amanda J. Hodgson

Research outputs 2022 to 2026

Drones have emerged as a powerful tool in animal detection, significantly advancing wildlife monitoring, conservation, and management by capturing high-resolution, real-time imagery over areas often inaccessible or challenging for human observers to reach. However, manual analysis of drone imagery for animal detection is labour-intensive and time-consuming. The application of deep learning methods, particularly convolutional neural networks, in automating animal detection from drone imagery has the potential to revolutionise wildlife monitoring, conservation, and management protocols. This review provides a comprehensive overview of the increasing use and prospects of deep learning in animal detection using drone imagery. It explores successful applications of …

Search Technology For Aircraft Debris Integrating Data Augmentation And Deep Learning Algorithm, Zhe Yang, Yinghan Cui, Lingxi Guo, Jiaxin Li, Xusheng Wu

Journal of System Simulation

Abstract: The reliable recovery of aircraft debris is of great significance for the complete acquisition of flight test data and the subsequent research and development of models. To ensure the safety of flight tests,the landing area of aircraft experiments is generally an unmanned area,and the actual landing point of the aircraft often deviates from the theoretical landing point. The characteristics of the debris target are complex and the dispersion area is large, making it difficult to search for aircraft debris solely by manpower. Aiming at the difficult problem of aircraft debris recovery in the landing area, through on UAV platforms …

Risurconv : Rotation Invariant Surface Attention-Augmented Convolutions For 3d Point Cloud Classification And Segmentation, Zhiyuan Zhang, Licheng Yang, Xiang Zhiyu

Research Collection School Of Computing and Information Systems

Despite the progress on 3D point cloud deep learning, most prior works focus on learning features that are invariant to translation and point permutation, and very limited efforts have been devoted for rotation invariant property. Several recent studies achieve rotation invariance at the cost of lower accuracies. In this work, we close this gap by proposing a novel yet effective rotation invariant architecture for 3D point cloud classification and segmentation. Instead of traditional pointwise operations, we construct local triangle surfaces to capture more detailed surface structure, based on which we can extract highly expressive rotation invariant surface properties which are …

A Multimodal Residual Spatial-Temporal Fusion Model Based On Automatic Sleep Classification, Yecai Guo, Shuang Tong

Journal of System Simulation

Abstract: Highly accurate sleep staging plays a crucial role in correctly assessing sleep conditions. Aiming at the problem that the existing convolutional network cannot obtain the topological characteristics of physiological signals, a sleep staging algorithm based on multi-modal residual spatio-temporal fusion is proposed. Time-frequency images and spatio-temporal images are obtained using short-time Fourier transform and adaptive map convolution, which are converted into high-dimensional feature vectors; lightweight interaction of feature information flow is realized through time-frequency feature and spatiotemporal feature extraction modules; the feature enhancement fusion module fuses feature information to outputs sleep staging results. The results show that the model …

Interoperability In Deep Learning: A User Survey And Failure Analysis Of Onnx Model Converters, Purvish Jajal, Wenxin Jiang, Arav Tewari, Erik Kocinare, Joseph Woo, Anusha Sarraf, Yung-Hsiang Lu, George Thiruvathukal, James C. Davis

Computer Science: Faculty Publications and Other Works

Software engineers develop, fine-tune, and deploy deep learning (DL) models using a variety of development frameworks and runtime environments. DL model converters move models between frameworks and to runtime environments. Conversion errors compromise model quality and disrupt deployment. However, the failure characteristics of DL model converters are unknown, adding risk when using DL interoperability technologies. This paper analyzes failures in DL model converters. We survey software engineers about DL interoperability tools, use cases, and pain points (N=92). Then, we characterize failures in model converters associated with the main interoperability tool, ONNX (N=200 issues in PyTorch and TensorFlow). Finally, we formulate …