Engineering Commons^™

A Reputation System For Provably-Robust Decision Making In Iot Blockchain Networks, Charles C. Rawlins, Sarangapani Jagannathan, Venkata Sriram Siddhardh Nadendla

Electrical and Computer Engineering Faculty Research & Creative Works

Blockchain systems have been successful in discerning truthful information from interagent interaction amidst possible attackers or conflicts, which is crucial for the completion of nontrivial tasks in distributed networking. However, the state-of-the-art blockchain protocols are limited to resource-rich applications where reliably connected nodes within the network are equipped with significant computing power to run lottery-based proof-of-work (pow) consensus. The purpose of this work is to address these challenges for implementation in a severely resource-constrained distributed network with internet of things (iot) devices. The contribution of this work is a novel lightweight alternative, called weight-based reputation (wbr) scheme, to classify new …

Convolutional Spiking Neural Networks For Intent Detection Based On Anticipatory Brain Potentials Using Electroencephalogram, Nathan Lutes, V. Sriram Siddhardh Nadendla, K. Krishnamurthy

Computer Science Faculty Research & Creative Works

Spiking neural networks (SNNs) are receiving increased attention because they mimic synaptic connections in biological systems and produce spike trains, which can be approximated by binary values for computational efficiency. Recently, the addition of convolutional layers to combine the feature extraction power of convolutional networks with the computational efficiency of SNNs has been introduced. This paper studies the feasibility of using a convolutional spiking neural network (CSNN) to detect anticipatory slow cortical potentials (SCPs) related to braking intention in human participants using an electroencephalogram (EEG). Data was collected during an experiment wherein participants operated a remote-controlled vehicle on a testbed …

Cr-Sam: Curvature Regularized Sharpness-Aware Minimization, Tao Wu, Tony Tie Luo, Donald C. Wunsch

Computer Science Faculty Research & Creative Works

The Capacity to Generalize to Future Unseen Data Stands as One of the Utmost Crucial Attributes of Deep Neural Networks. Sharpness-Aware Minimization (SAM) Aims to Enhance the Generalizability by Minimizing Worst-Case Loss using One-Step Gradient Ascent as an Approximation. However, as Training Progresses, the Non-Linearity of the Loss Landscape Increases, Rendering One-Step Gradient Ascent Less Effective. on the Other Hand, Multi-Step Gradient Ascent Will Incur Higher Training Cost. in This Paper, We Introduce a Normalized Hessian Trace to Accurately Measure the Curvature of Loss Landscape on Both Training and Test Sets. in Particular, to Counter Excessive Non-Linearity of Loss Landscape, …

Lrs: Enhancing Adversarial Transferability Through Lipschitz Regularized Surrogate, Tao Wu, Tony Tie Luo, Donald C. Wunsch

Computer Science Faculty Research & Creative Works

The Transferability of Adversarial Examples is of Central Importance to Transfer-Based Black-Box Adversarial Attacks. Previous Works for Generating Transferable Adversarial Examples Focus on Attacking Given Pretrained Surrogate Models While the Connections between Surrogate Models and Adversarial Trasferability Have Been overlooked. in This Paper, We Propose Lipschitz Regularized Surrogate (LRS) for Transfer-Based Black-Box Attacks, a Novel Approach that Transforms Surrogate Models towards Favorable Adversarial Transferability. using Such Transformed Surrogate Models, Any Existing Transfer-Based Black-Box Attack Can Run Without Any Change, Yet Achieving Much Better Performance. Specifically, We Impose Lipschitz Regularization on the Loss Landscape of Surrogate Models to Enable a Smoother …

Analyzing Biomedical Datasets With Symbolic Tree Adaptive Resonance Theory, Sasha Petrenko, Daniel B. Hier, Mary A. Bone, Tayo Obafemi-Ajayi, Erik J. Timpson, William E. Marsh, Michael Speight, Donald C. Wunsch

Chemistry Faculty Research & Creative Works

Biomedical Datasets Distill Many Mechanisms Of Human Diseases, Linking Diseases To Genes And Phenotypes (Signs And Symptoms Of Disease), Genetic Mutations To Altered Protein Structures, And Altered Proteins To Changes In Molecular Functions And Biological Processes. It Is Desirable To Gain New Insights From These Data, Especially With Regard To The Uncovering Of Hierarchical Structures Relating Disease Variants. However, Analysis To This End Has Proven Difficult Due To The Complexity Of The Connections Between Multi-Categorical Symbolic Data. This Article Proposes Symbolic Tree Adaptive Resonance Theory (START), With Additional Supervised, Dual-Vigilance (DV-START), And Distributed Dual-Vigilance (DDV-START) Formulations, For The Clustering Of …

Continual Online Learning-Based Optimal Tracking Control Of Nonlinear Strict-Feedback Systems: Application To Unmanned Aerial Vehicles, Irfan Ganie, Sarangapani Jagannathan

Electrical and Computer Engineering Faculty Research & Creative Works

A novel optimal trajectory tracking scheme is introduced for nonlinear continuous-time systems in strict feedback form with uncertain dynamics by using neural networks (NNs). The method employs an actor-critic-based NN back-stepping technique for minimizing a discounted value function along with an identifier to approximate unknown system dynamics that are expressed in augmented form. Novel online weight update laws for the actor and critic NNs are derived by using both the NN identifier and Hamilton-Jacobi-Bellman residual error. A new continual lifelong learning technique utilizing the Fisher Information Matrix via Hamilton-Jacobi-Bellman residual error is introduced to obtain the significance of weights in …

Optimal Trajectory Tracking For Uncertain Linear Discrete-Time Systems Using Time-Varying Q-Learning, Maxwell Geiger, Vignesh Narayanan, Sarangapani Jagannathan

Electrical and Computer Engineering Faculty Research & Creative Works

This Article Introduces a Novel Optimal Trajectory Tracking Control Scheme Designed for Uncertain Linear Discrete-Time (DT) Systems. in Contrast to Traditional Tracking Control Methods, Our Approach Removes the Requirement for the Reference Trajectory to Align with the Generator Dynamics of an Autonomous Dynamical System. Moreover, It Does Not Demand the Complete Desired Trajectory to Be Known in Advance, Whether through the Generator Model or Any Other Means. Instead, Our Approach Can Dynamically Incorporate Segments (Finite Horizons) of Reference Trajectories and Autonomously Learn an Optimal Control Policy to Track Them in Real Time. to Achieve This, We Address the Tracking Problem …

Adaptive Resilient Control For A Class Of Nonlinear Distributed Parameter Systems With Actuator Faults, Hasan Ferdowsi, Jia Cai, Sarangapani Jagannathan

Electrical and Computer Engineering Faculty Research & Creative Works

This paper presents a new model-based fault resilient control scheme for a class of nonlinear distributed parameter systems (DPS) represented by parabolic partial differential equations (PDE) in the presence of actuator faults. A Luenberger-like observer on the basis of nonlinear PDE representation of DPS is developed with boundary measurements. A detection residual is generated by taking the difference between the measured output of the DPS and the estimated one given by the observer. Once a fault is detected, an unknown actuator fault parameter vector together with a known basis function is utilized to adaptively estimate the fault dynamics. A novel …

Meta-Icvi: Ensemble Validity Metrics For Concise Labeling Of Correct, Under- Or Over-Partitioning In Streaming Clustering, Niklas M. Melton, Sasha A. Petrenko, Donald C. Wunsch

Electrical and Computer Engineering Faculty Research & Creative Works

Understanding the performance and validity of clustering algorithms is both challenging and crucial, particularly when clustering must be done online. Until recently, most validation methods have relied on batch calculation and have required considerable human expertise in their interpretation. Improving real-time performance and interpretability of cluster validation, therefore, continues to be an important theme in unsupervised learning. Building upon previous work on incremental cluster validity indices (iCVIs), this paper introduces the Meta- iCVI as a tool for explainable and concise labeling of partition quality in online clustering. Leveraging a time-series classifier and data-fusion techniques, the Meta- iCVI combines the outputs …

Demo-Abstract: A Dtn System For Tracking Miners Using Gae-Lstm And Contact Graph Routing In An Underground Mine, Abhay Goyal, Sanjay Kumar Madria, Samuel Frimpong

Computer Science Faculty Research & Creative Works

Localization and prediction of movement of miners in underground mines have been a constant problem more so during a mine disaster. Due to the unavailability of GPS signals, the pillars are used as a method to locate these miners, and thus, location prediction is also carried out with reference to these pillars. In this work, we demon- strate a Delay-tolerant Network (DTN) system called Miner-Finder that leverages Machine Learning (ML) framework (GAE-LSTM) that works on edge devices (e.g., mobile phones, tablets) to predict the location of miners in an underground mine. The information such as speed, angle, time, nearest pillar …

Qc-Sane: Robust Control In Drl Using Quantile Critic With Spiking Actor And Normalized Ensemble, Surbhi Gupta, Gaurav Singal, Deepak Garg, Sarangapani Jagannathan

Electrical and Computer Engineering Faculty Research & Creative Works

Recently Introduced Deep Reinforcement Learning (DRL) Techniques in Discrete-Time Have Resulted in Significant Advances in Online Games, Robotics, and So On. Inspired from Recent Developments, We Have Proposed an Approach Referred to as Quantile Critic with Spiking Actor and Normalized Ensemble (QC-SANE) for Continuous Control Problems, Which Uses Quantile Loss to Train Critic and a Spiking Neural Network (NN) to Train an Ensemble of Actors. the NN Does an Internal Normalization using a Scaled Exponential Linear Unit (SELU) Activation Function and Ensures Robustness. the Empirical Study on Multijoint Dynamics with Contact (MuJoCo)-Based Environments Shows Improved Training and Test Results Than …

A Dtn-Based Spatio-Temporal Routing Using Location Prediction Model In Underground Mines, Abhay Goyal, Sanjay Kumar Madria, Samuel Frimpong

Computer Science Faculty Research & Creative Works

Situational awareness during any disaster depends on effective communication and location tracking. In the case of underground mines, where the communication methods are mostly central, the whole communication channel would be rendered unusable during a disaster. To this end, we propose the use of Delay Tolerant Networks (DTN) to allow the miners to function in a distributed manner and help in locating the injured miners and routing distress messages. Due to the unavailability of GPS signals, the pillar numbers are used to identify the locations of the miners. For spatio-temporal routing of messages, we formulate a new scheme using Contact …

Lifelong Learning Control Of Nonlinear Systems With Constraints Using Multilayer Neural Networks With Application To Mobile Robot Tracking, Irfan Ganie, S. (Sarangapani) Jagannathan

Electrical and Computer Engineering Faculty Research & Creative Works

This Paper Presents a Novel Lifelong Multilayer Neural Network (MNN) Tracking Approach for an Uncertain Nonlinear Continuous-Time Strict Feedback System that is Subject to Time-Varying State Constraints. the Proposed Method Uses a Time-Varying Barrier Function to Accommodate the Constraints Leading to the Development of an Efficient Control Scheme. the Unknown Dynamics Are Approximated using a MNN, with Weights Tuned using a Singular Value Decomposition (SVD)-Based Technique. an Online Lifelong Learning (LL) based Elastic Weight Consolidation (EWC) Scheme is Also Incorporated to Alleviate the Issue of Catastrophic Forgetting. the Stability of the overall Closed-Loop System is Analyzed using Lyapunov Analysis. the …

Improved Intelligent Ledger Construction For Realistic Iot Blockchain Networks, Charles Rawlins, S. (Sarangapani) Jagannathan

Electrical and Computer Engineering Faculty Research & Creative Works

Scalability is essential for next generation blockchain technology to integrate with large mobile networks like Internet of Things (IoT). The IOTA distributed ledger protocol has combined transaction generation and verification to address this, but at the expense of increased reliance on connectivity to resolve conflicts with a novel ledger data structure. Intelligent Ledger Construction (ILC) was proposed as an auditable lightweight reinforcement-learning scheme to address this constraint with proposal of local conflict resolution with machine-learning classification. This effort presents an improved reliability reward model to enhance training for ILC and further reduce adversarial gaming and resource usage. Testing this revision …

Continual Reinforcement Learning Formulation For Zero-Sum Game-Based Constrained Optimal Tracking, Behzad Farzanegan, Sarangapani Jagannathan

Electrical and Computer Engineering Faculty Research & Creative Works

This study provides a novel reinforcement learning-based optimal tracking control of partially uncertain nonlinear discrete-time (DT) systems with state constraints using zero-sum game (ZSG) formulation. To address optimal tracking, a novel augmented system consisting of tracking error and its integral value, along with an uncertain desired trajectory, is constructed. A barrier function (BF) with a tradeoff factor is incorporated into the cost function to keep the state trajectories to remain within a compact set and to balance safety with optimality. Next, by using the modified value functional, the ZSG formulation is introduced wherein an actor–critic neural network (NN) framework is …

Optimal Adaptive Tracking Control Of Partially Uncertain Nonlinear Discrete-Time Systems Using Lifelong Hybrid Learning, Behzad Farzanegan, Rohollah Moghadam, Sarangapani Jagannathan, Pappa Natarajan

Electrical and Computer Engineering Faculty Research & Creative Works

This article addresses a multilayer neural network (MNN)-based optimal adaptive tracking of partially uncertain nonlinear discrete-time (DT) systems in affine form. By employing an actor–critic neural network (NN) to approximate the value function and optimal control policy, the critic NN is updated via a novel hybrid learning scheme, where its weights are adjusted once at a sampling instant and also in a finite iterative manner within the instants to enhance the convergence rate. Moreover, to deal with the persistency of excitation (PE) condition, a replay buffer is incorporated into the critic update law through concurrent learning. To address the vanishing …

Towards Robust Consensus For Intelligent Decision-Making In Iot Blockchain Networks, Charles Rawlins, S. (Sarangapani) Jagannathan

Electrical and Computer Engineering Faculty Research & Creative Works

Distributed consensus is the core aspect of blockchain protocol security design. Recent protocols like IOTA have improved concurrency and scalability over Proof-of-work (PoW) with Bitcoin but have core design decisions that are inefficient for limited devices and do not take advantage of previous network experience to reduce calculations. This work proposes the first blockchain consensus protocol based on active machine-learning decisions, called Proof-of-history (PoH). PoH is setup as a distributed reinforcement-learning task for monitoring classification and training of blockchain transactions with an inner deep classifier. Early theoretical analysis and simulations show that PoH is robust to uncoordinated byzantine attacks through …

Continual Optimal Adaptive Tracking Of Uncertain Nonlinear Continuous-Time Systems Using Multilayer Neural Networks, Irfan Ganie, S. (Sarangapani) Jagannathan

Electrical and Computer Engineering Faculty Research & Creative Works

This study provides a lifelong integral reinforcement learning (LIRL)-based optimal tracking scheme for uncertain nonlinear continuous-time (CT) systems using multilayer neural network (MNN). In this LIRL framework, the optimal control policies are generated by using both the critic neural network (NN) weights and single-layer NN identifier. The critic MNN weight tuning is accomplished using an improved singular value decomposition (SVD) of its activation function gradient. The NN identifier, on the other hand, provides the control coefficient matrix for computing the control policies. An online weight velocity attenuation (WVA)-based consolidation scheme is proposed wherein the significance of weights is derived by …

Optimal Tracking Of Nonlinear Discrete-Time Systems Using Zero-Sum Game Formulation And Hybrid Learning, Behzad Farzanegan, S. (Sarangapani) Jagannathan

Electrical and Computer Engineering Faculty Research & Creative Works

This paper presents a novel hybrid learning-based optimal tracking method to address zero-sum game problems for partially uncertain nonlinear discrete-time systems. An augmented system and its associated discounted cost function are defined to address optimal tracking. Three multi-layer neural networks (NNs) are utilized to approximate the optimal control and the worst-case disturbance inputs, and the value function. The critic weights are tuned using the hybrid technique, whose weights are updated once at the sampling instants and in an iterative manner over finite times within the sampling instants. The proposed hybrid technique helps accelerate the convergence of the approximated value functional …

Personalizing Student Graduation Paths Using Expressed Student Interests, Nicolas Dobbins, Ali R. Hurson, Sahra Sedigh

Electrical and Computer Engineering Faculty Research & Creative Works

This paper proposes an intelligent recommendation approach to facilitate personalized education and help students in planning their path to graduation. The goal is to identify a path that aligns with a student's interests and career goals and approaches optimality with respect to one or more criteria, such as time-to-graduation or credit hours taken. The approach is illustrated and verified through application to undergraduate curricula at the Missouri University of Science and Technology.

Securing The Transportation Of Tomorrow: Enabling Self-Healing Intelligent Transportation, Elanor Jackson, Sahra Sedigh Sarvestani

Electrical and Computer Engineering Faculty Research & Creative Works

The safety of autonomous vehicles relies on dependable and secure infrastructure for intelligent transportation. The doctoral research described in this paper aims to enable self-healing and survivability of the intelligent transportation systems required for autonomous vehicles (AV-ITS). The proposed approach is comprised of four major elements: qualitative and quantitative modeling of the AV-ITS, stochastic analysis to capture and quantify interdependencies, mitigation of disruptions, and validation of efficacy of the self-healing process. This paper describes the overall methodology and presents preliminary results, including an agent-based model for detection of and recovery from disruptions to the AV-ITS.

Rafid: A Lightweight Approach To Radio Frequency Interference Detection In Time Domain Using Lstm And Statistical Analysis, Luke A. Smith, Vishesh Kumar Tanwar, Maciej Jan Zawodniok, Sanjay Kumar Madria

Electrical and Computer Engineering Faculty Research & Creative Works

Recently, the utilization of Radio Frequency (RF) devices has increased exponentially over numerous vertical platforms. This rise has led to an abundance of Radio Frequency Interference (RFI) continues to plague RF systems today. The continued crowding of the RF spectrum makes RFI efficient and lightweight mitigation critical. Detecting and localizing the interfering signals is the foremost step for mitigating RFI concerns. Addressing these challenges, we propose a novel and lightweight approach, namely RaFID, to detect and locate the RFI by incorporating deep neural networks (DNNs) and statistical analysis via batch-wise mean aggregation and standard deviation (SD) calculations. RaFID investigates the …

Lifelong Deep Learning-Based Control Of Robot Manipulators, Irfan Ganie, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

This study proposes a lifelong deep learning control scheme for robotic manipulators with bounded disturbances. This scheme involves the use of an online tunable deep neural network (DNN) to approximate the unknown nonlinear dynamics of the robot. The control scheme is developed by using a singular value decomposition-based direct tracking error-driven approach, which is utilized to derive the weight update laws for the DNN. To avoid catastrophic forgetting in multi-task scenarios and to ensure lifelong learning (LL), a novel online LL scheme based on elastic weight consolidation is included in the DNN weight-tuning laws. Our results demonstrate that the resulting …

Continual Learning-Based Optimal Output Tracking Of Nonlinear Discrete-Time Systems With Constraints: Application To Safe Cargo Transfer, Behzad Farzanegan, S. (Sarangapani) Jagannathan

Electrical and Computer Engineering Faculty Research & Creative Works

This Paper Addresses a Novel Lifelong Learning (LL)-Based Optimal Output Tracking Control of Uncertain Non-Linear Affine Discrete-Time Systems (DT) with State Constraints. First, to Deal with Optimal Tracking and Reduce the Steady State Error, a Novel Augmented System, Including Tracking Error and its Integral Value and Desired Trajectory, is Proposed. to Guarantee Safety, an Asymmetric Barrier Function (BF) is Incorporated into the Utility Function to Keep the Tracking Error in a Safe Region. Then, an Adaptive Neural Network (NN) Observer is Employed to Estimate the State Vector and the Control Input Matrix of the Uncertain Nonlinear System. Next, an NN-Based …

Lifelong Learning-Based Multilayer Neural Network Control Of Nonlinear Continuous-Time Strict-Feedback Systems, Irfan Ahmad Ganie, S. (Sarangapani) Jagannathan

Electrical and Computer Engineering Faculty Research & Creative Works

In This Paper, We Investigate Lifelong Learning (LL)-Based Tracking Control for Partially Uncertain Strict Feedback Nonlinear Systems with State Constraints, employing a Singular Value Decomposition (SVD) of the Multilayer Neural Networks (MNNs) Activation Function based Weight Tuning Scheme. the Novel SVD-Based Approach Extends the MNN Weight Tuning to (Formula Presented.) Layers. a Unique Online LL Method, based on Tracking Error, is Integrated into the MNN Weight Update Laws to Counteract Catastrophic Forgetting. to Adeptly Address Constraints for Safety Assurances, Taking into Account the Effects Caused by Disturbances, We Utilize a Time-Varying Barrier Lyapunov Function (TBLF) that Ensures a Uniformly Ultimately …

Analyzing Ground Motion Records With Cvi Fuzzy Art, Dustin Tanksley, Xinzhe Yuan, Genda Chen, Donald C. Wunsch

Civil, Architectural and Environmental Engineering Faculty Research & Creative Works

This paper explores using Cluster Validity Indices Fuzzy Adaptative Resonance Theory (CVI Fuzzy ART) to cluster ground motion records (GMRs). Clustering the features extracted from a supervised network trained for predicting the structure damage results in less overfitting from the trained network. Using Cluster Validity Indices (CVIs) to evaluate the clustering gives feedback to how well the data is being classified, allowing further separation of the data. By using CVI Fuzzy ART in combination with features extracted from a trained Convolutional Neural Network (CNN), we were able to form additional clusters in the data. Within the primary clusters, accuracy was …

Jointly-Learnt Networks For Future Action Anticipation Via Self-Knowledge Distillation And Cycle Consistency, Md Moniruzzaman, Zhaozheng Yin, Zhihai He, Ming-Chuan Leu, Ruwen Qin

Mechanical and Aerospace Engineering Faculty Research & Creative Works

Future action anticipation aims to infer future actions from the observation of a small set of past video frames. In this paper, we propose a novel Jointly learnt Action Anticipation Network (J-AAN) via Self-Knowledge Distillation (Self-KD) and cycle consistency for future action anticipation. In contrast to the current state-of-the-art methods which anticipate the future actions either directly or recursively, our proposed J-AAN anticipates the future actions jointly in both direct and recursive ways. However, when dealing with future action anticipation, one important challenge to address is the future's uncertainty since multiple action sequences may come from or be followed by …

Reducing Kidney Discard With Artificial Intelligence Decision Support: The Need For A Transdisciplinary Systems Approach, Richard Threlkeld, Lirim Ashiku, Casey I. Canfield, Daniel Burton Shank, Mark A. Schnitzler, Krista L. Lentine, David A. Axelrod, Anil Choudary Reddy Battineni, Henry Randall, Cihan H. Dagli

Engineering Management and Systems Engineering Faculty Research & Creative Works

Purpose of Review: A transdisciplinary systems approach to the design of an artificial intelligence (AI) decision support system can more effectively address the limitations of AI systems. By incorporating stakeholder input early in the process, the final product is more likely to improve decision-making and effectively reduce kidney discard.

Recent Findings: Kidney discard is a complex problem that will require increased coordination between transplant stakeholders. An AI decision support system has significant potential, but there are challenges associated with overfitting, poor explainability, and inadequate trust. A transdisciplinary approach provides a holistic perspective that incorporates expertise from engineering, social science, and …

Communicating Uncertain Information From Deep Learning Models In Human Machine Teams, Harishankar V. Subramanian, Casey I. Canfield, Daniel Burton Shank, Luke Andrews, Cihan H. Dagli

Engineering Management and Systems Engineering Faculty Research & Creative Works

The role of human-machine teams in society is increasing, as big data and computing power explode. One popular approach to AI is deep learning, which is useful for classification, feature identification, and predictive modeling. However, deep learning models often suffer from inadequate transparency and poor explainability. One aspect of human systems integration is the design of interfaces that support human decision-making. AI models have multiple types of uncertainty embedded, which may be difficult for users to understand. Humans that use these tools need to understand how much they should trust the AI. This study evaluates one simple approach for communicating …

An Explainable And Statistically Validated Ensemble Clustering Model Applied To The Identification Of Traumatic Brain Injury Subgroups, Dacosta Yeboah, Louis Steinmeister, Daniel B. Hier, Bassam Hadi, Donald C. Wunsch, Gayla R. Olbricht, Tayo Obafemi-Ajayi

Electrical and Computer Engineering Faculty Research & Creative Works

We present a framework for an explainable and statistically validated ensemble clustering model applied to Traumatic Brain Injury (TBI). The objective of our analysis is to identify patient injury severity subgroups and key phenotypes that delineate these subgroups using varied clinical and computed tomography data. Explainable and statistically-validated models are essential because a data-driven identification of subgroups is an inherently multidisciplinary undertaking. In our case, this procedure yielded six distinct patient subgroups with respect to mechanism of injury, severity of presentation, anatomy, psychometric, and functional outcome. This framework for ensemble cluster analysis fully integrates statistical methods at several stages of …