Other Electrical and Computer Engineering Commons^™

Deep Learning Approaches For Ctenophore Identification And Tracking, Anagha Bharadwaj

Theses

Ctenophores are translucent marine organisms with nearly invisible tentacles and pose significant challenges due to their transparent morphology and ambiguous structural features. This research addresses the classification and tracking of these organisms and evaluates the performance of current computer vision models under sparse-data environments.

A dataset from the NJIT Life History Lab consisting of microscopic laboratory videos and photographs of different growth stages is used to train and assess a number of convolutional neural network designs, including VGG16, ResNet, BioCLIP2, YOLO, and DeepLabCut. Additionally, a web-based interface is developed to evaluate expert-labeled ground truth with the model's performance.

The findings …

Multi-Modal Tensor Fusion For Alzheimer’S Disease Recognition, Mason Li, Tiffany Le, Jiajing Huang, Yuxin Wen

Engineering Faculty Articles and Research

Accurate and early diagnosis of Alzheimer’s disease (AD) is critical for effective intervention, disease monitoring, and patient care. Traditional diagnostic approaches rely on a single modality, such as clinical assessments, neuroimaging, or genetic markers, which may fail to capture the complex, multifaceted nature of AD. Multimodal learning has therefore been explored to integrate complementary information across data sources. However, conventional fusion strategies, including early feature concatenation and late decision-level fusion, often model modalities independently and fail to capture high-order cross-modal interactions. To address these limitations, we propose a multimodal tensor fusion network (MTFN) that integrates heterogeneous data sources, including visual …

Code-Net++: An Attention-Guided Deep Learning Framework With Grad-Cam-Based Explainability For Covid-19 Detection Using Chest X-Ray Images, Fareesa Amina, Dr Krishnanaik Vankdoth

Mansoura Engineering Journal

Chest radiograph imaging has emerged as a practical and scalable diagnostic modality for respiratory diseases, including COVID-19. However, accurate discrimination of COVID-19 manifestations from other pulmonary abnormalities remains challenging because of low contrast, imaging noise, and overlapping radiographic patterns. This work presents CODE-NET++, an enhanced attention-guided deep learning framework with Grad-CAM-based explainability for reliable COVID-19 detection using chest X-ray images. The proposed framework integrates adaptive trilateral filtering for image enhancement, Reverse Edge Attention Network (RE-Net) for lesion-aware segmentation, and an Enhanced LinkNet architecture with dilated convolutions for multiscale feature extraction and classification. Grad-CAM-based explainable artificial intelligence visualization is incorporated to …

M3t-Lm: A Multi-Modal Multi-Task Learning Model For Jointly Predicting Patient Length Of Stay And Mortality, Junde Chen, Qing Li, Feng Liu, Yuxin Wen

Engineering Faculty Articles and Research

Ensuring accurate predictions of inpatient length of stay (LoS) and mortality rates is essential for enhancing hospital service efficiency, particularly in light of the constraints posed by limited healthcare resources. Integrative analysis of heterogeneous clinic record data from different sources can hold great promise for improving the prognosis and diagnosis level of LoS and mortality. Currently, most existing studies solely focus on single data modality or tend to single-task learning, i.e., training LoS and mortality tasks separately. This limits the utilization of available multi-modal data and prevents the sharing of feature representations that could capture correlations between different tasks, ultimately …

Reinforcement Learning Assisted Communication Resources Optimization In Advanced Air Mobility., Ruixuan Han

Electronic Theses and Dissertations

Advanced air mobility (AAM), which envisages a safe and efficient aviation transportation system, has drawn significant attention to support the increasing mobility demand in metropolitan areas. Communication services for AAM aerial vehicles (AVs) are crucial for ensuring flight safety. This dissertation explores three research topics on communication resource allocation problems in AAM applications. The first topic, addressed in Chapter II, investigates the joint velocity selection and spectrum allocation problem for AAM applications to enhance spectrum utilization efficiency (SUE). In the AAM scenario, multiple AVs travel along predefined paths for passenger and cargo deliveries. Given that AAM aims to provide fast …

Toward Intuitive 3d Interactions In Virtual Reality: A Deep Learning- Based Dual-Hand Gesture Recognition Approach, Trudi Di Qi, Franceli L. Cibrian, Meghna Raswan, Tyler Kay, Hector M. Camarillo-Abad, Yuxin Wen

Engineering Faculty Articles and Research

Dual-hand gesture recognition is crucial for intuitive 3D interactions in virtual reality (VR), allowing the user to interact with virtual objects naturally through gestures using both handheld controllers. While deep learning and sensor-based technology have proven effective in recognizing single-hand gestures for 3D interactions, research on dual-hand gesture recognition for VR interactions is still underexplored. In this work, we introduce CWT-CNN-TCN, a novel deep learning model that combines a 2D Convolution Neural Network (CNN) with Continuous Wavelet Transformation (CWT) and a Temporal Convolution Network (TCN). This model can simultaneously extract features from the time-frequency domain and capture long-term dependencies using …

Faults Segmentation In Levee Systems Using Deep Learning Approaches, Manisha Panta

LSU New Orleans Theses and Dissertations

Levees are earthen structures constructed to mitigate flooding in low-lying areas. Although levee systems can reduce flood risks, they cannot completely eliminate them. Failures within flood control systems due to inadequate maintenance or strong water currents can lead to significant property damage and catastrophic loss of life, as was seen during Hurricane Katrina. Consequently, regular inspections are essential to identify and address any issues with the levees promptly. However, current inspection methods rely on manual techniques that are time-consuming, labor-intensive, and prone to human error. Therefore, this study proposes using deep learning models for more efficient and frequent assessment of …

Spam Detection Using Machine Learning And Deep Learning, Olubodunde Agboola

LSU Doctoral Dissertations

Text messages are essential these days; however, spam texts have contributed negatively to the success of this communication mode. The compromised authenticity of such messages has given rise to several security breaches. Using spam messages, malicious links have been sent to either harm the system or obtain information detrimental to the user. Spam SMS messages as well as emails have been used as media for attacks such as masquerading and smishing ( a phishing attack through text messaging), and this has threatened both the user and service providers. Therefore, given the waves of attacks, the need to identify and remove …

Exploratory Analysis Of Machine Learning For Images: Methods And Applications, Meenu Ajith

Electrical and Computer Engineering ETDs

This research focuses on implementing four different applications of machine learning on images. The various categories of digital images considered for these applications are grayscale, RGB, and infra-red images. The first framework uses an unsupervised learning strategy for detecting fire and smoke from an infra-red image dataset. This problem was solved using a classical machine learning algorithm since the dataset was small and unlabeled. Next, a semi-supervised deep learning model was used for facial expression recognition. Here we detect emotions from a moderately large dataset containing labeled and unlabeled grayscale images. The third application focused on single image superresolution, which …

Combinatorial Cnn Meta-Structures In Deep Learning Applications, Aswathy Rajendra Kurup

Electrical and Computer Engineering ETDs

The study aims in applying combinatorial structures motivated from the basic CNN in various applications. Convolutional neural networks (CNNs) have grown to be very popular in the field of deep learning. The ability of such networks to learn both Spatial and temporal characteristics in the data have helped in deploying them in various fields. Through this research we explore different kinds of CNN-derived architectures and how these structures can be trained and setup in combinatorial environment to solve problems in deep learning applications. First, we introduce the basic idea of a deep learning meta-structures which is used in the application …

A Deep Learning-Based Approach To Extraction Of Filler Morphology In Sem Images With The Application Of Automated Quality Inspection, Md. Fashiar Rahman, Tzu-Liang Bill Tseng, Jianguo Wu, Yuxin Wen, Yirong Lin

Engineering Faculty Articles and Research

Automatic extraction of filler morphology (size, orientation, and spatial distribution) in Scanning Electron Microscopic (SEM) images is essential in many applications such as automatic quality inspection in composite manufacturing. Extraction of filler morphology greatly depends on accurate segmentation of fillers (fibers and particles), which is a challenging task due to the overlap of fibers and particles and their obscure presence in SEM images. Convolution Neural Networks (CNNs) have been shown to be very effective at object recognition in digital images. This paper proposes an automatic filler detection system in SEM images, utilizing a Mask Region-based CNN architecture. The proposed system …

Ai-Driven Automated Medical Imaging Analysis, Jingya Liu

Dissertations and Theses

Medical imaging has been applied widely in many clinical diagnoses to detect and differentiate abnormalities by revealing the internal structure of the human body at normal anatomical and physiological levels. Manual analyzing medical images demands attention and is time-consuming, requiring well-trained expertise. The speed, fatigue, and experience may limit the diagnostic performance, leading to delays and even false diagnoses that significantly impact patient treatment. Therefore, accurate systematic systems based on medical image analysis are crucial for timely clinical diagnosis.

This dissertation focuses on advancing automatic computer-aided diagnosis systems to detect cancer, assisting radiologists with early intervention to improve survival rates. …

Deep Learning-Guided Prediction Of Material’S Microstructures And Applications To Advanced Manufacturing, Jianan Tang

All Dissertations

Material microstructure prediction based on processing conditions is very useful in advanced manufacturing. Trial-and-error experiments are very time-consuming to exhaust numerous combinations of processing parameters and characterize the resulting microstructures. To accelerate process development and optimization, researchers have explored microstructure prediction methods, including physical-based modeling and feature-based machine learning. Nevertheless, they both have limitations. Physical-based modeling consumes too much computational power. And in feature-based machine learning, low-dimensional microstructural features are manually extracted to represent high-dimensional microstructures, which leads to information loss.

In this dissertation, a deep learning-guided microstructure prediction framework is established. It uses a conditional generative adversarial network (CGAN) …

Learning In The Machine: To Share Or Not To Share?, Jordan Ott, Erik Linstead, Nicholas Lahaye, Pierre Baldi

Engineering Faculty Articles and Research

Weight-sharing is one of the pillars behind Convolutional Neural Networks and their successes. However, in physical neural systems such as the brain, weight-sharing is implausible. This discrepancy raises the fundamental question of whether weight-sharing is necessary. If so, to which degree of precision? If not, what are the alternatives? The goal of this study is to investigate these questions, primarily through simulations where the weight-sharing assumption is relaxed. Taking inspiration from neural circuitry, we explore the use of Free Convolutional Networks and neurons with variable connection patterns. Using Free Convolutional Networks, we show that while weight-sharing is a pragmatic optimization …

Deep Learning Towards Intelligent Vehicle Fault Diagnosis, Mohammed Al-Zeyadi, Javier Andreu-Perez, Hani Hagras, Chris Royce, Darren Smith, Piotr Rzonsowski, Ali Malik

Conference papers

Recently, the rapid development of automotive industries has given rise to large multidimensional datasets both in the production sites and after-sale services. Fault diagnostic systems are one of the services that the automotive industries provide. As a consequence of the rapid development of cars features, traditional rule-based diagnostic systems became very limited. Therefore, more sophisticated AI approaches need to be investigated towards more efficient solutions. In this paper, we focus on utilising deep learning so as to build a diagnostic system that is able to estimate the required services in an efficient and effective way. We propose a new model, …

Amodal Instance Segmentation And Multi-Object Tracking With Deep Pixel Embedding, Yanfeng Liu

Department of Electrical and Computer Engineering: Dissertations, Theses, and Student Research

This thesis extends upon the representational output of semantic instance segmentation by explicitly including both visible and occluded parts. A fully convolutional network is trained to produce consistent pixel-level embedding across two layers such that, when clustered, the results convey the full spatial extent and depth ordering of each instance. Results demonstrate that the network can accurately estimate complete masks in the presence of occlusion and outperform leading top-down bounding-box approaches.

The model is further extended to produce consistent pixel-level embeddings across two consecutive image frames from a video to simultaneously perform amodal instance segmentation and multi-object tracking. No post-processing …

Receptive Fields Optimization In Deep Learning For Enhanced Interpretability, Diversity, And Resource Efficiency., Babajide Odunitan Ayinde

Electronic Theses and Dissertations

In both supervised and unsupervised learning settings, deep neural networks (DNNs) are known to perform hierarchical and discriminative representation of data. They are capable of automatically extracting excellent hierarchy of features from raw data without the need for manual feature engineering. Over the past few years, the general trend has been that DNNs have grown deeper and larger, amounting to huge number of final parameters and highly nonlinear cascade of features, thus improving the flexibility and accuracy of resulting models. In order to account for the scale, diversity and the difficulty of data DNNs learn from, the architectural complexity and …

Multi-Column Neural Networks And Sparse Coding Novel Techniques In Machine Learning, Ammar O. Hoori

Theses and Dissertations

Accurate and fast machine learning (ML) algorithms are highly vital in artificial intelligence (AI) applications. In complex dataset problems, traditional ML methods such as radial basis function neural network (RBFN), sparse coding (SC) using dictionary learning, and particle swarm optimization (PSO) provide trivial results, large structure, slow training, and/or slow testing. This dissertation introduces four novel ML techniques: the multi-column RBFN network (MCRN), the projected dictionary learning algorithm (PDL) and the multi-column adaptive and non-adaptive particle swarm optimization techniques (MC-APSO and MC-PSO). These novel techniques provide efficient alternatives for traditional ML techniques. Compared to traditional ML techniques, the novel ML …

Multi-Label Latent Spaces With Semi-Supervised Deep Generative Models, Rastin Rastgoufard

LSU New Orleans Theses and Dissertations

Expert labeling, tagging, and assessment are far more costly than the processes of collecting raw data. Generative modeling is a very powerful tool to tackle this real-world problem. It is shown here how these models can be used to allow for semi-supervised learning that performs very well in label-deficient conditions.

The foundation for the work in this dissertation is built upon visualizing generative models' latent spaces to gain deeper understanding of data, analyze faults, and propose solutions. A number of novel ideas and approaches are presented to improve single-label classification. This dissertation's main focus is on extending semi-supervised Deep Generative …

Respiratory Prediction And Image Quality Improvement Of 4d Cone Beam Ct And Mri For Lung Tumor Treatments, Seonyeong Park

Theses and Dissertations

Identification of accurate tumor location and shape is highly important in lung cancer radiotherapy, to improve the treatment quality by reducing dose delivery errors. Because a lung tumor moves with the patient's respiration, breathing motion should be correctly analyzed and predicted during the treatment for prevention of tumor miss or undesirable treatment toxicity. Besides, in Image-Guided Radiation Therapy (IGRT), the tumor motion causes difficulties not only in delivering accurate dose, but also in assuring superior quality of imaging techniques such as four-dimensional (4D) Cone Beam Computed Tomography (CBCT) and 4D Magnetic Resonance Imaging (MRI). Specifically, 4D CBCT used in CBCT …