Artificial Intelligence and Robotics Commons^™

Human Identification And Action Recognition Using Small Data And Deep Domain Adaptation, Alexander M. Glandon

Electrical & Computer Engineering Theses & Dissertations

Human identification and human action recognition problems are two important research areas for real-world security and surveillance applications. In both human identification and action recognition, it is necessary to operate by collecting small datasets in the field, possibly in a short time window of observation. This dissertation studies and develops computational modeling and high-performance machine learning (ML) and deep learning (DL) models for human identification and human action recognition using small amounts of data. These methods and computational models may be useful for different security and surveillance applications.

This dissertation on human recognition develops a ML computational model to estimate …

Input Structure Based Optimization For Privacy Preserving Ai Systems, Feng Yizhou

Electrical & Computer Engineering Theses & Dissertations

As Artificial Intelligence (AI) systems become increasingly integrated into critical domains, ensuring privacy-preserving model design and system deployment has become a pressing priority. Safeguarding both sensitive user data and proprietary model parameters is critical throughout the AI model and system, from data acquisition and pre-processing to model inference and deployment. However, existing privacy-preserving frameworks face several limitations, including fragmented data ownership, incomplete protection across system stages, substantial computational overhead, and poor scalability to modern architectures such as large language models. This dissertation explores a unifying optimization strategy centered on input structure design to address these challenges. The core idea is …

Towards Efficient Privacy-Preserving Deep Learning: He-Friendly Structures, Flexible Pruning, He-Efficient Architectures, And Secure Transformer Token Drop, Yifei Cai

Electrical & Computer Engineering Theses & Dissertations

Deep learning (DL) has become a powerful tool for solving complex problems, but developing DL models typically requires vast datasets, high computational resources, and expert knowledge—barriers that limit accessibility. Machine Learning as a Service (MLaaS) addresses this challenge by allowing resource-rich providers to deliver pre-trained DL models as services. However, privacy concerns arise: clients hesitate to share sensitive data, while providers protect their proprietary models. To address this, privacy-preserving MLaaS integrates cryptographic techniques into DL computations, as seen in frameworks like Cryptonets, SecureML, GAZELLE, CrypTFlow2, Cheetah, and BOLT. Among them, Homomorphic Encryption (HE) enables computation on encrypted data but remains …

From Image Enhancement To Model Protection Integrating Generative Ai And Secure Learning In Computer Vision, Mohammad Shahab Uddin

Electrical & Computer Engineering Theses & Dissertations

This dissertation aims to address critical challenges in the field of computer vision and machine learning, focusing on three key areas: image translation, denoising, and model security. The research encompasses novel methodologies and models that significantly advance existing techniques. This dissertation will not only provide valuable contributions to the academic community but also hold significant potential for practical applications in domains ranging from surveillance to autonomous systems.

Consequently, this dissertation proposes three goals. First, we present new approaches for converting optical videos to infrared videos using deep learning. To apply powerful deep learning based algorithms for object detection and classification …

Enhancing Iot Security Using Lightweight Machine Learning Algorithms: A Comprehensive Approach Using Ensemble Learning, Feature Selection, And Federated Transfer Learning, Khawlah Harahsheh

Electrical & Computer Engineering Theses & Dissertations

The rapid expansion of the Internet of Things (IoT) has introduced significant security vulnerabilities due to the resource-constrained nature of IoT devices and their exposure to cyber threats. Traditional security solutions are often infeasible due to the high computational and storage demands they impose. This dissertation presents a lightweight, AI-driven security framework that enhances IoT network resilience by integrating feature selection, ensemble learning, and federated transfer learning while maintaining data privacy and minimizing computational overhead.

The proposed framework consists of three primary components: Feature Selection for Intrusion Detection, which optimizes performance by reducing redundant data and improving detection accuracy with …

Machine Learning And Simulation Techniques For Detecting Buoys From Lidar Data, Christopher Adolphi

Electrical & Computer Engineering Theses & Dissertations

Maritime autonomy, specifically the use of autonomous and semi-autonomous maritime vessels, is a key enabling technology supporting a set of diverse and critical research areas, including coastal and environmental resilience, assessment of waterway health, ecosystem/asset monitoring and maritime port security. Critical to the safe, efficient and reliable operation of an autonomous maritime vessel is its ability to perceive the external environment through onboard sensors. The main sensor utilized in this research is a LiDAR sensor. This sensor is able to generate point clouds of the surrounding environment, of which a machine learning model is used to label each point in …

Time Series Models For Predicting Application Gpu Utilization And Power Draw Based On Trace Data, Dorothy Xiaoshuang Parry

Electrical & Computer Engineering Theses & Dissertations

This work explores collecting performance metrics and leveraging various statistical and machine learning time series predictive models on a memory-intensive application, Inception v3. Trace data collected using nvidia-smi measured GPU utilization and power draw for two runs of Inception3. Experimental results from the statistical and machine learning-based time series predictive algorithms showed that the predictions from statistical-based models were unable to capture the complex changes in the trace data. The Probabilistic TNN model provided the best results for the power draw trace, according to the test evaluation metrics. For the GPU utilization trace, the RNN models produced the most accurate …

Computational Modeling And Analysis Of Facial Expressions And Gaze For Discovery Of Candidate Behavioral Biomarkers For Children And Young Adults With Autism Spectrum Disorder, Megan Anita Witherow

Electrical & Computer Engineering Theses & Dissertations

Facial expression production and perception in autism spectrum disorder (ASD) suggest the potential presence of behavioral biomarkers that may stratify individuals on the spectrum into prognostic or treatment subgroups. High-speed internet and the ease of technology have enabled remote, scalable, affordable, and timely access to medical care, such as measurements of ASDrelated behaviors in familiar environments to complement clinical observation. Machine and deep learning (DL)-based analysis of video tracking (VT) of expression production and eye tracking (ET) of expression perception may aid stratification biomarker discovery for children and young adults with ASD. However, there are open challenges in 1) facial …

Deep-Learning-Based Classification Of Digitally Modulated Signals, John A. Snoap

Electrical & Computer Engineering Theses & Dissertations

This dissertation presents several novel deep-learning (DL)-based approaches for classifying digitally modulated signals, one method of which involves the use of capsule networks (CAPs) together with cyclic cumulant (CC) features of the signals. These were blindly estimated using cyclostationary signal processing (CSP) and were then input into the CAP for training and classification. The classification performance and the generalization abilities of the proposed approach were tested using two distinct datasets that contained the same types of digitally modulated signals but had distinct generation parameters. The results showed that the classification of digitally modulated signals using CAPs and CCs proposed in …

Towards A Robust Defense: A Multifaceted Approach To The Detection And Mitigation Of Neural Backdoor Attacks Through Feature Space Exploration And Analysis, Liuwan Zhu

Electrical & Computer Engineering Theses & Dissertations

From voice assistants to self-driving vehicles, machine learning(ML), especially deep learning, revolutionizes the way we work and live, through the wide adoption in a broad range of applications. Unfortunately, this widespread use makes deep learning-based systems a desirable target for cyberattacks, such as generating adversarial examples to fool a deep learning system to make wrong decisions. In particular, many recent studies have revealed that attackers can corrupt the training of a deep learning model, e.g., through data poisoning, or distribute a deep learning model they created with “backdoors” planted, e.g., distributed as part of a software library, so that the …

Wearable Sensor Gait Analysis For Fall Detection Using Deep Learning Methods, Haben Girmay Yhdego

Electrical & Computer Engineering Theses & Dissertations

World Health Organization (WHO) data show that around 684,000 people die from falls yearly, making it the second-highest mortality rate after traffic accidents [1]. Early detection of falls, followed by pneumatic protection, is one of the most effective means of ensuring the safety of the elderly. In light of the recent widespread adoption of wearable sensors, it has become increasingly critical that fall detection models are developed that can effectively process large and sequential sensor signal data. Several researchers have recently developed fall detection algorithms based on wearable sensor data. However, real-time fall detection remains challenging because of the wide …

Applied Deep Learning: Case Studies In Computer Vision And Natural Language Processing, Md Reshad Ul Hoque

Electrical & Computer Engineering Theses & Dissertations

Deep learning has proved to be successful for many computer vision and natural language processing applications. In this dissertation, three studies have been conducted to show the efficacy of deep learning models for computer vision and natural language processing. In the first study, an efficient deep learning model was proposed for seagrass scar detection in multispectral images which produced robust, accurate scars mappings. In the second study, an arithmetic deep learning model was developed to fuse multi-spectral images collected at different times with different resolutions to generate high-resolution images for downstream tasks including change detection, object detection, and land cover …

Emotion Detection Using An Ensemble Model Trained With Physiological Signals And Inferred Arousal-Valence States, Matthew Nathanael Gray

Electrical & Computer Engineering Theses & Dissertations

Affective computing is an exciting and transformative field that is gaining in popularity among psychologists, statisticians, and computer scientists. The ability of a machine to infer human emotion and mood, i.e. affective states, has the potential to greatly improve human-machine interaction in our increasingly digital world. In this work, an ensemble model methodology for detecting human emotions across multiple subjects is outlined. The Continuously Annotated Signals of Emotion (CASE) dataset, which is a dataset of physiological signals labeled with discrete emotions from video stimuli as well as subject-reported continuous emotions, arousal and valence, from the circumplex model, is used for …

Machine Learning Classification Of Digitally Modulated Signals, James A. Latshaw

Electrical & Computer Engineering Theses & Dissertations

Automatic classification of digitally modulated signals is a challenging problem that has traditionally been approached using signal processing tools such as log-likelihood algorithms for signal classification or cyclostationary signal analysis. These approaches are computationally intensive and cumbersome in general, and in recent years alternative approaches that use machine learning have been presented in the literature for automatic classification of digitally modulated signals. This thesis studies deep learning approaches for classifying digitally modulated signals that use deep artificial neural networks in conjunction with the canonical representation of digitally modulated signals in terms of in-phase and quadrature components. Specifically, capsule networks are …

Joint Linear And Nonlinear Computation With Data Encryption For Efficient Privacy-Preserving Deep Learning, Qiao Zhang

Electrical & Computer Engineering Theses & Dissertations

Deep Learning (DL) has shown unrivalled performance in many applications such as image classification, speech recognition, anomalous detection, and business analytics. While end users and enterprises own enormous data, DL talents and computing power are mostly gathered in technology giants having cloud servers. Thus, data owners, i.e., the clients, are motivated to outsource their data, along with computationally-intensive tasks, to the server in order to leverage the server’s abundant computation resources and DL talents for developing cost-effective DL solutions. However, trust is required between the server and the client to finish the computation tasks (e.g., conducting inference for the newly-input …

Deep Learning Approaches For Seagrass Detection In Multispectral Imagery, Kazi Aminul Islam

Electrical & Computer Engineering Theses & Dissertations

Seagrass forms the basis for critically important marine ecosystems. Seagrass is an important factor to balance marine ecological systems, and it is of great interest to monitor its distribution in different parts of the world. Remote sensing imagery is considered as an effective data modality based on which seagrass monitoring and quantification can be performed remotely. Traditionally, researchers utilized multispectral satellite images to map seagrass manually. Automatic machine learning techniques, especially deep learning algorithms, recently achieved state-of-the-art performances in many computer vision applications. This dissertation presents a set of deep learning models for seagrass detection in multispectral satellite images. It …

Secure Mobile Computing By Using Convolutional And Capsule Deep Neural Networks, Rui Ning

Electrical & Computer Engineering Theses & Dissertations

Mobile devices are becoming smarter to satisfy modern user's increasing needs better, which is achieved by equipping divers of sensors and integrating the most cutting-edge Deep Learning (DL) techniques. As a sophisticated system, it is often vulnerable to multiple attacks (side-channel attacks, neural backdoor, etc.). This dissertation proposes solutions to maintain the cyber-hygiene of the DL-Based smartphone system by exploring possible vulnerabilities and developing countermeasures.

First, I actively explore possible vulnerabilities on the DL-Based smartphone system to develop proactive defense mechanisms. I discover a new side-channel attack on smartphones using the unrestricted magnetic sensor data. I demonstrate that attackers can …

Deep Cellular Recurrent Neural Architecture For Efficient Multidimensional Time-Series Data Processing, Lasitha S. Vidyaratne

Electrical & Computer Engineering Theses & Dissertations

Efficient processing of time series data is a fundamental yet challenging problem in pattern recognition. Though recent developments in machine learning and deep learning have enabled remarkable improvements in processing large scale datasets in many application domains, most are designed and regulated to handle inputs that are static in time. Many real-world data, such as in biomedical, surveillance and security, financial, manufacturing and engineering applications, are rarely static in time, and demand models able to recognize patterns in both space and time. Current machine learning (ML) and deep learning (DL) models adapted for time series processing tend to grow in …

Demonstration Of Visible And Near Infrared Raman Spectrometers And Improved Matched Filter Model For Analysis Of Combined Raman Signals, Alexander Matthew Atkinson

Electrical & Computer Engineering Theses & Dissertations

Raman spectroscopy is a powerful analysis technique that has found applications in fields such as analytical chemistry, planetary sciences, and medical diagnostics. Recent studies have shown that analysis of Raman spectral profiles can be greatly assisted by use of computational models with achievements including high accuracy pure sample classification with imbalanced data sets and detection of ideal sample deviations for pharmaceutical quality control. The adoption of automated methods is a necessary step in streamlining the analysis process as Raman hardware becomes more advanced. Due to limits in the architectures of current machine learning based Raman classification models, transfer from pure …

Using Feature Extraction From Deep Convolutional Neural Networks For Pathological Image Analysis And Its Visual Interpretability, Wei-Wen Hsu

Electrical & Computer Engineering Theses & Dissertations

This dissertation presents a computer-aided diagnosis (CAD) system using deep learning approaches for lesion detection and classification on whole-slide images (WSIs) with breast cancer. The deep features being distinguishing in classification from the convolutional neural networks (CNN) are demonstrated in this study to provide comprehensive interpretability for the proposed CAD system using the domain knowledge in pathology. In the experiment, a total of 186 slides of WSIs were collected and classified into three categories: Non-Carcinoma, Ductal Carcinoma in Situ (DCIS), and Invasive Ductal Carcinoma (IDC). Instead of conducting pixel-wise classification (segmentation) into three classes directly, a hierarchical framework with the …

Non-Destructive Evaluation For Composite Material, Desalegn Temesgen Delelegn

Electrical & Computer Engineering Theses & Dissertations

The Nondestructive Evaluation Sciences Branch (NESB) at the National Aeronautics and Space Administration (NASA) Langley Research Center (LaRC) has conducted impact damage experiments over the past few years with the goal of understanding structural defects in composite materials. The Data Science Team within the NASA LaRC Office of the Chief Information Officer (OCIO) has been working with the Non-Destructive Evaluation (NDE) subject matter experts (SMEs), Dr. Cheryl Rose, from the Structural Mechanics & Concepts Branch and Dr. William Winfree, from the Research Directorate, to develop computer vision solutions using digital image processing and machine learning techniques that can help identify …

Speech Based Machine Learning Models For Emotional State Recognition And Ptsd Detection, Debrup Banerjee

Electrical & Computer Engineering Theses & Dissertations

Recognition of emotional state and diagnosis of trauma related illnesses such as posttraumatic stress disorder (PTSD) using speech signals have been active research topics over the past decade. A typical emotion recognition system consists of three components: speech segmentation, feature extraction and emotion identification. Various speech features have been developed for emotional state recognition which can be divided into three categories, namely, excitation, vocal tract and prosodic. However, the capabilities of different feature categories and advanced machine learning techniques have not been fully explored for emotion recognition and PTSD diagnosis. For PTSD assessment, clinical diagnosis through structured interviews is a …

Camera Viewpoint Invariant Vehicular Traffic Segmentation And Classification, Jeffrey B. Flora

Electrical & Computer Engineering Theses & Dissertations

The goal of this intelligent transportation systems work is to develop a computer vision method that is view angle independent for segmenting and classifying vehicular traffic on highway systems. In order to achieve this goal, this work implements an algorithm for vehicle segmentation, feature extraction, and classification using the existing Virginia Department of Transportation (VDOT) infrastructure on networked traffic cameras. The VDOT traffic video is analyzed for vehicle detection and segmentation using an adaptive Gaussian mixture model algorithm. Speed estimation is performed using a single camera calibration. Size and shape features from morphological properties and texture features from histogram of …

Electroencephalogram Artifact Removal Using A Wavelet Neural Network, Hoang-Anh T. Nguyen

Electrical & Computer Engineering Theses & Dissertations

A wavelet neural network (WNN) technique rs developed for electroencephalogram (EEG) artifact removal without electrooculographic (EOG) recordings. The algorithm combines the universal approximation characteristics of neural networks and the time/frequency property of wavelet, where the neural network was trained on a simulated dataset with known ground truths. The contribution of this thesis is two-fold. First, many EEG artifact removal algorithms, including regression based methods, require reference EOG signals, which are not always available. To remove EEG ai1ifacts, a WNN tries to learn the characteristics of the artifacts first and does not need reference EOG signals once trained. Second, WNNs are …

Analysis Of Partial Discharge Pulse Height Distribution Parameters, Vinay N. Nimbole

Electrical & Computer Engineering Theses & Dissertations

Partial Discharges (PD) have been traditionally used to assess the state of any insulation system and its remnant life. In earlier work, Perspex (PMMA) samples with a needle plane gap have been aged with AC voltage. Their tree growth was monitored simultaneously by collecting PD at regular intervals of time and taking microphotographs in real time without interrupting the aging voltage. The obtained partial discharge pulse amplitude records were clustered together into groups of class intervals. The sequence of PD pulse height records was quantified as a time series of shape (η), and scale (σ) parameters of a Weibull distribution. …

Brain Tumor Progression Assessment Using Multiple Mri Volumes, Yufei Shen

Electrical & Computer Engineering Theses & Dissertations

Predicting and assessing tumor progression is important in brain tumor treatment. We attempt to use machine learning techniques to achieve consistency in assessing brain tumor progression. This thesis presents a prediction method of brain tumor progression by exploring a large MR database, which contains two patients ' complete records covering all their visits in the past two years. All ten MRI series, namely, apparent diffusion coefficient (ADC) , diffusion tensor imaging (DTI) , fractional anisotropy (FA), fluid attenuated inversion recovery (FLAIR), max eigenvalue (MAX), mid eigenvalue (MID), min eigenvalue (MIN) , post-contrast T₁-weighted, T₁- weighted, and …

Tree-D-Seek: A Framework For Retrieving Three-Dimensional Scenes, Saurav Mazumdar

Electrical & Computer Engineering Theses & Dissertations

In this dissertation, a strategy and framework for retrieving 3D scenes is proposed. The strategy is to retrieve 3D scenes based on a unified approach for indexing content from disparate information sources and information levels. The TREE-D-SEEK framework implements the proposed strategy for retrieving 3D scenes and is capable of indexing content from a variety of corpora at distinct information levels. A semantic annotation model for indexing 3D scenes in the TREE-D-SEEK framework is also proposed. The semantic annotation model is based on an ontology for rapid prototyping of 3D virtual worlds.

With ongoing improvements in computer hardware and 3D …

Learning As A Nonlinear Line Of Attraction For Pattern Association, Classification And Recognition, Ming-Jung Seow

Electrical & Computer Engineering Theses & Dissertations

Development of a mathematical model for learning a nonlinear line of attraction is presented in this dissertation, in contrast to the conventional recurrent neural network model in which the memory is stored in an attractive fixed point at discrete location in state space. A nonlinear line of attraction is the encapsulation of attractive fixed points scattered in state space as an attractive nonlinear line, describing patterns with similar characteristics as a family of patterns.

It is usually of prime imperative to guarantee the convergence of the dynamics of the recurrent network for associative learning and recall. We propose to alter …

Mobius: An Omnidirectional Robotic Platform And Software Architecture For Network Teleoperation, Samuel Aaron Miller

Electrical & Computer Engineering Theses & Dissertations

The following thesis presents the results of a project to develop and test an omnidirectional robotic system (hardware and software) at NASA Langley Research Center's Robotics and Intelligent Machines Lab. The impetus for the project was the unique capabilities of omnidirectional systems. Some of the many potential benefits these systems have include improved material-handling capabilities in constrained environments (such as might be found in extraterrestrial manned habitats), efficient camera-based vehicle teleoperation, and simplified route planning for autonomous robot operations.

The project's focus was to design, build, and test a system that used Mecanum wheels to achieve omnidirectional motion. In addition …

Rapid Prototyping For The Design Of Virtual Worlds, Prabhu V. Krishnan

Electrical & Computer Engineering Theses & Dissertations

Development of Virtual Reality (VR) applications is challenging where application developers are required to have expertise in the target VR technologies along with the problem domain expertise. New VR technologies impose a significant learning curve to even the most experienced VR developer. The proposed solution relies on synthesis to automate the migration of a VR application to a new unfamiliar VR platform/technology. To solve the problem, the Common Scene Definition Framework (CSDF) was developed, that serves as a superset/model representation of the target virtual world. Input modules were developed to populate the framework with the capabilities of the virtual world …