Open Access. Powered by Scholars. Published by Universities.®

Operations Research, Systems Engineering and Industrial Engineering Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 30 of 54

Full-Text Articles in Operations Research, Systems Engineering and Industrial Engineering

Reinforcement-Learning-Based Output-Feedback Control Of Nonstrict Nonlinear Discrete-Time Systems With Application To Engine Emission Control, Peter Shih, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier Oct 2009

Reinforcement-Learning-Based Output-Feedback Control Of Nonstrict Nonlinear Discrete-Time Systems With Application To Engine Emission Control, Peter Shih, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier

Electrical and Computer Engineering Faculty Research & Creative Works

A novel reinforcement-learning-based output adaptive neural network (NN) controller, which is also referred to as the adaptive-critic NN controller, is developed to deliver the desired tracking performance for a class of nonlinear discrete-time systems expressed in nonstrict feedback form in the presence of bounded and unknown disturbances. The adaptive-critic NN controller consists of an observer, a critic, and two action NNs. The observer estimates the states and output, and the two action NNs provide virtual and actual control inputs to the nonlinear discrete-time system. The critic approximates a certain strategic utility function, and the action NNs minimize the strategic utility …


Neural Network Control Of Mobile Robot Formations Using Rise Feedback, Jagannathan Sarangapani, Travis Alan Dierks Apr 2009

Neural Network Control Of Mobile Robot Formations Using Rise Feedback, Jagannathan Sarangapani, Travis Alan Dierks

Electrical and Computer Engineering Faculty Research & Creative Works

In this paper, an asymptotically stable (AS) combined kinematic/torque control law is developed for leader-follower-based formation control using backstepping in order to accommodate the complete dynamics of the robots and the formation, and a neural network (NN) is introduced along with robust integral of the sign of the error feedback to approximate the dynamics of the follower as well as its leader using online weight tuning. It is shown using Lyapunov theory that the errors for the entire formation are as and that the NN weights are bounded as opposed to uniformly ultimately bounded stability which is typical with most …


A Model Based Fault Detection And Prognostic Scheme For Uncertain Nonlinear Discrete-Time Systems, Balaje T. Thumati, Jagannathan Sarangapani Dec 2008

A Model Based Fault Detection And Prognostic Scheme For Uncertain Nonlinear Discrete-Time Systems, Balaje T. Thumati, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

A new fault detection and prognostics (FDP) framework is introduced for uncertain nonlinear discrete time system by using a discrete-time nonlinear estimator which consists of an online approximator. A fault is detected by monitoring the deviation of the system output with that of the estimator output. Prior to the occurrence of the fault, this online approximator learns the system uncertainty. In the event of a fault, the online approximator learns both the system uncertainty and the fault dynamics. A stable parameter update law in discrete-time is developed to tune the parameters of the online approximator. This update law is also …


Neural Network Output Feedback Control Of A Quadrotor Uav, Jagannathan Sarangapani, Travis Alan Dierks Dec 2008

Neural Network Output Feedback Control Of A Quadrotor Uav, Jagannathan Sarangapani, Travis Alan Dierks

Electrical and Computer Engineering Faculty Research & Creative Works

A neural network (NN) based output feedback controller for a quadrotor unmanned aerial vehicle (UAV) is proposed. The NNs are utilized in the observer and for generating virtual and actual control inputs, respectively, where the NNs learn the nonlinear dynamics of the UAV online including uncertain nonlinear terms like aerodynamic friction and blade flapping. It is shown using Lyapunov theory that the position, orientation, and velocity tracking errors, the virtual control and observer estimation errors, and the NN weight estimation errors for each NN are all semi-globally uniformly ultimately bounded (SGUUB) in the presence of bounded disturbances and NN functional …


Neural-Network-Based State Feedback Control Of A Nonlinear Discrete-Time System In Nonstrict Feedback Form, Pingan He, Jagannathan Sarangapani Dec 2008

Neural-Network-Based State Feedback Control Of A Nonlinear Discrete-Time System In Nonstrict Feedback Form, Pingan He, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

In this paper, a suite of adaptive neural network (NN) controllers is designed to deliver a desired tracking performance for the control of an unknown, second-order, nonlinear discrete-time system expressed in nonstrict feedback form. In the first approach, two feedforward NNs are employed in the controller with tracking error as the feedback variable whereas in the adaptive critic NN architecture, three feedforward NNs are used. In the adaptive critic architecture, two action NNs produce virtual and actual control inputs, respectively, whereas the third critic NN approximates certain strategic utility function and its output is employed for tuning action NN weights …


A Model Based Fault Detection Scheme For Nonlinear Multivariable Discrete-Time Systems, Balaje T. Thumati, Jagannathan Sarangapani Oct 2008

A Model Based Fault Detection Scheme For Nonlinear Multivariable Discrete-Time Systems, Balaje T. Thumati, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

In this paper, a novel robust scheme is developed for detecting faults in nonlinear discrete time multi-input and multi-output systems in contrast with the available schemes that are developed in continuous-time. Both state and output faults are addressed by considering separate time profiles. The faults, which could be incipient or abrupt, are modeled using input and output signals of the system. By using nonlinear estimation techniques, the discrete-time system is monitored online. Once a fault is detected, its dynamics are characterized using an online approximator. A stable parameter update law is developed for the online approximator scheme in discrete-time. The …


Optimal Energy-Delay Routing Protocol With Trust Levels For Wireless Ad Hoc Networks, Eyad Taqieddin, Ann K. Miller, Jagannathan Sarangapani Sep 2008

Optimal Energy-Delay Routing Protocol With Trust Levels For Wireless Ad Hoc Networks, Eyad Taqieddin, Ann K. Miller, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

This paper presents the Trust Level Routing (TLR) pro- tocol, an extension of the optimized energy-delay rout- ing (OEDR) protocol, focusing on the integrity, reliability and survivability of the wireless network. TLR is similar to OEDR in that they both are link state routing proto- cols that run in a proactive mode and adopt the concept of multi-point relay (MPR) nodes. However, TLR aims at incorporating trust levels into routing by frequently changing the MPR nodes as well as authenticating the source node and contents of control packets. TLR calcu- lates the link costs based on a composite metric (delay …


Damping Inter-Area Oscillations By Upfcs Based On Selected Global Measurements, Mahyar Zarghami, Yilu Liu, Jagannathan Sarangapani, Mariesa Crow Jul 2008

Damping Inter-Area Oscillations By Upfcs Based On Selected Global Measurements, Mahyar Zarghami, Yilu Liu, Jagannathan Sarangapani, Mariesa Crow

Electrical and Computer Engineering Faculty Research & Creative Works

This paper introduces a method of using a selected set of the global data for controlling inter-area oscillations of the power network using unified power flow controllers. This novel algorithm utilizes reduced order observers for estimating the missing data the purpose of control when all the data is unavailable through frequency measurements in a wide area control approach. The paper will also address the problem of time-delay in data acquisition through examples.


Missouri S&T Mote-Based Demonstration Of Energy Monitoring Solution For Network Enabled Manufacturing Using Wireless Sensor Networks (Wsn), James W. Fonda, Maciej Jan Zawodniok, Al Salour, Jagannathan Sarangapani, Donald Miller Apr 2008

Missouri S&T Mote-Based Demonstration Of Energy Monitoring Solution For Network Enabled Manufacturing Using Wireless Sensor Networks (Wsn), James W. Fonda, Maciej Jan Zawodniok, Al Salour, Jagannathan Sarangapani, Donald Miller

Electrical and Computer Engineering Faculty Research & Creative Works

In this work, an inexpensive electric utilities monitoring solution using wireless sensor networks is demonstrated that can easily be installed, deployed, maintained and eliminate unnecessary energy costs and effort. The monitoring solution is designed to support network enabled manufacturing (NEM) program using Missouri University of Science and Technology (MST), formerly the University of Missouri-Rolla (UMR), motes.


Output Feedback Controller For Operation Of Spark Ignition Engines At Lean Conditions Using Neural Networks, Jonathan B. Vance, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier Mar 2008

Output Feedback Controller For Operation Of Spark Ignition Engines At Lean Conditions Using Neural Networks, Jonathan B. Vance, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier

Electrical and Computer Engineering Faculty Research & Creative Works

Spark ignition (SI) engines operating at very lean conditions demonstrate significant nonlinear behavior by exhibiting cycle-to-cycle bifurcation of heat release. Past literature suggests that operating an engine under such lean conditions can significantly reduce NO emissions by as much as 30% and improve fuel efficiency by as much as 5%-10%. At lean conditions, the heat release per engine cycle is not close to constant, as it is when these engines operate under stoichiometric conditions where the equivalence ratio is 1.0. A neural network controller employing output feedback has shown ability in simulation to reduce the nonlinear cyclic dispersion observed under …


A Suite Of Robust Controllers For The Manipulation Of Microscale Objects, Qinmin Yang, Jagannathan Sarangapani Feb 2008

A Suite Of Robust Controllers For The Manipulation Of Microscale Objects, Qinmin Yang, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

A suite of novel robust controllers is introduced for the pickup operation of microscale objects in a microelectromechanical system (MEMS). In MEMS, adhesive, surface tension, friction, and van der Waals forces are dominant. Moreover, these forces are typically unknown. The proposed robust controller overcomes the unknown contact dynamics and ensures its performance in the presence of actuator constraints by assuming that the upper bounds on these forces are known. On the other hand, for the robust adaptive critic-based neural network (NN) controller, the unknown dynamic forces are estimated online. It consists of an action NN for compensating the unknown system …


Generalized Hamilton-Jacobi-Bellman Formulation-Based Neural Network Control Of Affine Nonlinear Discrete-Time Systems, Zheng Chen, Jagannathan Sarangapani Jan 2008

Generalized Hamilton-Jacobi-Bellman Formulation-Based Neural Network Control Of Affine Nonlinear Discrete-Time Systems, Zheng Chen, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

In this paper, we consider the use of nonlinear networks towards obtaining nearly optimal solutions to the control of nonlinear discrete-time (DT) systems. The method is based on least squares successive approximation solution of the generalized Hamilton-Jacobi-Bellman (GHJB) equation which appears in optimization problems. Successive approximation using the GHJB has not been applied for nonlinear DT systems. The proposed recursive method solves the GHJB equation in DT on a well-defined region of attraction. The definition of GHJB, pre-Hamiltonian function, HJB equation, and method of updating the control function for the affine nonlinear DT systems under small perturbation assumption are proposed. …


Effects Of Electromagnetic Interference On Control Area Network Performance, Fei Ren, Y. Rosa Zheng, Maciej Jan Zawodniok, Jagannathan Sarangapani Nov 2007

Effects Of Electromagnetic Interference On Control Area Network Performance, Fei Ren, Y. Rosa Zheng, Maciej Jan Zawodniok, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

In this paper, the effects of electromagnetic interference (EMI) on control area network (CAN) communications are investigated by hardware experiments. Distinct CAN bit rates, communication cables, and networks are used to test effects of EMI on CAN bus. Waveforms of CAN data frames in EMI environment are observed and analyzed for figuring out details of effects. Experiments show that the EMI pulses frequently encountered in automobile and off-road machinery can cause the reduction of bit rates and errors in high-speed CAN communications. Replacing traditional unshielded parallel communication cables with shielded communication cables is proved to be an effective method of …


Predictive Congestion Control Protocol For Wireless Sensor Networks, Maciej Jan Zawodniok, Jagannathan Sarangapani Nov 2007

Predictive Congestion Control Protocol For Wireless Sensor Networks, Maciej Jan Zawodniok, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

Available congestion control schemes, for example transport control protocol (TCP), when applied to wireless networks, result in a large number of packet drops, unfair scenarios and low throughputs with a significant amount of wasted energy due to retransmissions. To fully utilize the hop by hop feedback information, this paper presents a novel, decentralized, predictive congestion control (DPCC) for wireless sensor networks (WSN). The DPCC consists of an adaptive flow and adaptive back-off interval selection schemes that work in concert with energy efficient, distributed power control (DPC). The DPCC detects the onset of congestion using queue utilization and the embedded channel …


Comparisons Of An Adaptive Neural Network Based Controller And An Optimized Conventional Power System Stabilizer, Wenxin Liu, Ganesh K. Venayagamoorthy, Jagannathan Sarangapani, Donald C. Wunsch, Mariesa Crow, Li Liu, David A. Cartes Oct 2007

Comparisons Of An Adaptive Neural Network Based Controller And An Optimized Conventional Power System Stabilizer, Wenxin Liu, Ganesh K. Venayagamoorthy, Jagannathan Sarangapani, Donald C. Wunsch, Mariesa Crow, Li Liu, David A. Cartes

Electrical and Computer Engineering Faculty Research & Creative Works

Power system stabilizers are widely used to damp out the low frequency oscillations in power systems. In power system control literature, there is a lack of stability analysis for proposed controller designs. This paper proposes a Neural Network (NN) based stabilizing controller design based on a sixth order single machine infinite bus power system model. The NN is used to compensate the complex nonlinear dynamics of power system. To speed up the learning process, an adaptive signal is introduced to the NN's weights updating rule. The NN can be directly used online without offline training process. Magnitude constraint of the …


Neural Network Based Decentralized Controls Of Large Scale Power Systems, Wenxin Liu, Jagannathan Sarangapani, Ganesh K. Venayagamoorthy, Donald C. Wunsch, Mariesa Crow, Li Liu, David A. Cartes Oct 2007

Neural Network Based Decentralized Controls Of Large Scale Power Systems, Wenxin Liu, Jagannathan Sarangapani, Ganesh K. Venayagamoorthy, Donald C. Wunsch, Mariesa Crow, Li Liu, David A. Cartes

Electrical and Computer Engineering Faculty Research & Creative Works

This paper presents a suite of neural network (NN) based decentralized controller designs for large scale power systems' generators, one is for the excitation control and the other is for the steam valve control. Though the control inputs are calculated using local signals, the transient and overall system stability can be guaranteed. NNs are used to approximate the unknown and/or imprecise dynamics of the local power system dynamics and the inter-connection terms, thus the requirements for exact system parameters are relaxed. Simulation studies with a three-machine power system demonstrate the effectiveness of the proposed controller designs.


Energy-Efficient Hybrid Key Management Protocol For Wireless Sensor Networks, Timothy J. Landstra, Maciej Jan Zawodniok, Jagannathan Sarangapani Oct 2007

Energy-Efficient Hybrid Key Management Protocol For Wireless Sensor Networks, Timothy J. Landstra, Maciej Jan Zawodniok, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

In this paper, we propose a subnetwork key management strategy in which the heterogeneous security requirements of a wireless sensor network are considered to provide differing levels of security with minimum communication overhead. Additionally, it allows the dynamic creation of high security subnetworks within the wireless sensor network and provides subnetworks with a mechanism for dynamically creating a secure key using a novel and dynamic group key management protocol. The proposed energy-efficient protocol utilizes a combination of pre-deployed group keys and initial trustworthiness of nodes to create a level of trust between neighbors in the network. This trust is later …


Online Reinforcement Learning-Based Neural Network Controller Design For Affine Nonlinear Discrete-Time Systems, Qinmin Yang, Jagannathan Sarangapani Jul 2007

Online Reinforcement Learning-Based Neural Network Controller Design For Affine Nonlinear Discrete-Time Systems, Qinmin Yang, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

In this paper, a novel reinforcement learning neural network (NN)-based controller, referred to adaptive critic controller, is proposed for general multi-input and multi- output affine unknown nonlinear discrete-time systems in the presence of bounded disturbances. Adaptive critic designs consist of two entities, an action network that produces optimal solution and a critic that evaluates the performance of the action network. The critic is termed adaptive as it adapts itself to output the optimal cost-to-go function and the action network is adapted simultaneously based on the information from the critic. In our online learning method, one NN is designated as the …


Reinforcement Learning Based Output-Feedback Control Of Nonlinear Nonstrict Feedback Discrete-Time Systems With Application To Engines, Peter Shih, Jonathan B. Vance, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier Jul 2007

Reinforcement Learning Based Output-Feedback Control Of Nonlinear Nonstrict Feedback Discrete-Time Systems With Application To Engines, Peter Shih, Jonathan B. Vance, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier

Electrical and Computer Engineering Faculty Research & Creative Works

A novel reinforcement-learning based output-adaptive neural network (NN) controller, also referred as the adaptive-critic NN controller, is developed to track a desired trajectory for a class of complex nonlinear discrete-time systems in the presence of bounded and unknown disturbances. The controller includes an observer for estimating states and the outputs, critic, and two action NNs for generating virtual, and actual control inputs. The critic approximates certain strategic utility function and the action NNs are used to minimize both the strategic utility function and their outputs. All NN weights adapt online towards minimization of a performance index, utilizing gradient-descent based rule. …


An Online Approximator-Based Fault Detection Framework For Nonlinear Discrete-Time Systems, Balaje T. Thumati, Jagannathan Sarangapani Jan 2007

An Online Approximator-Based Fault Detection Framework For Nonlinear Discrete-Time Systems, Balaje T. Thumati, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

In this paper, a fault detection scheme is developed for nonlinear discrete time systems. The changes in the system dynamics due to incipient failures are modeled as a nonlinear function of state and input variables while the time profile of the failures is assumed to be exponentially developing. The fault is detected by monitoring the system and is approximated by using online approximators. A stable adaptation law in discrete-time is developed in order to characterize the faults. The robustness of the diagnosis scheme is shown by extensive mathematical analysis and simulation results.


Near Optimal Output-Feedback Control Of Nonlinear Discrete-Time Systems In Nonstrict Feedback Form With Application To Engines, Peter Shih, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier Jan 2007

Near Optimal Output-Feedback Control Of Nonlinear Discrete-Time Systems In Nonstrict Feedback Form With Application To Engines, Peter Shih, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier

Electrical and Computer Engineering Faculty Research & Creative Works

A novel reinforcement-learning based output-adaptive neural network (NN) controller, also referred as the adaptive-critic NN controller, is developed to track a desired trajectory for a class of complex nonlinear discrete-time systems in the presence of bounded and unknown disturbances. The controller includes an observer for estimating states and the outputs, critic, and two action NNs for generating virtual, and actual control inputs. The critic approximates certain strategic utility function and the action NNs are used to minimize both the strategic utility function and their outputs. All NN weights adapt online towards minimization of a performance index, utilizing gradient-descent based rule. …


Neural Network Controller Development And Implementation For Spark Ignition Engines With High Egr Levels, Jonathan B. Vance, Atmika Singh, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier Jan 2007

Neural Network Controller Development And Implementation For Spark Ignition Engines With High Egr Levels, Jonathan B. Vance, Atmika Singh, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier

Electrical and Computer Engineering Faculty Research & Creative Works

Past research has shown substantial reductions in the oxides of nitrogen (NOx) concentrations by using 10% -25% exhaust gas recirculation (EGR) in spark ignition (SI) engines (see Dudek and Sain, 1989). However, under high EGR levels, the engine exhibits strong cyclic dispersion in heat release which may lead to instability and unsatisfactory performance preventing commercial engines to operate with high EGR levels. A neural network (NN)-based output feedback controller is developed to reduce cyclic variation in the heat release under high levels of EGR even when the engine dynamics are unknown by using fuel as the control input. A separate …


Two Neural Network Based Decentralized Controller Designs For Large Scale Power Systems, Wenxin Liu, Jagannathan Sarangapani, Ganesh K. Venayagamoorthy, Donald C. Wunsch, Mariesa Crow, David A. Cartes Jan 2007

Two Neural Network Based Decentralized Controller Designs For Large Scale Power Systems, Wenxin Liu, Jagannathan Sarangapani, Ganesh K. Venayagamoorthy, Donald C. Wunsch, Mariesa Crow, David A. Cartes

Electrical and Computer Engineering Faculty Research & Creative Works

This paper presents two neural network (NN) based decentralized controller designs for large scale power systems' generators, one is for the excitation control and the other is for the steam valve control. Though the control signals are calculated using local signals only, the transient and overall system stabilities can be guaranteed. NNs are used to approximate the unknown and/or imprecise dynamics of the local power system and the interconnection terms, thus the requirements for exact system parameters are released. Simulation studies with a three machine power system demonstrate the effectiveness of the proposed controller designs.


Spatial Diversity In Signal Strength Based Wlan Location Determination Systems, Anil Ramachandran, Jagannathan Sarangapani Jan 2007

Spatial Diversity In Signal Strength Based Wlan Location Determination Systems, Anil Ramachandran, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

Literature indicates that spatial diversity can be utilized to compensate channel uncertainties such as multipath fading. Therefore, in this paper, spatial diversity is exploited for locating stationary and mobile objects in the indoor environment. First, space diversity technique is introduced for small scale motion and temporal variation compensation of received signal strength and it is demonstrated analytically that it enhances location accuracy. Small scale motion refers to movements of the transmitter and/or the receiver of the order of sub-wavelengths while temporal effects refer to environmental variations with time. A novel metric is introduced for selection combining in order to improve …


Online Reinforcement Learning Neural Network Controller Design For Nanomanipulation, Qinmin Yang, Jagannathan Sarangapani Jan 2007

Online Reinforcement Learning Neural Network Controller Design For Nanomanipulation, Qinmin Yang, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

In this paper, a novel reinforcement learning neural network (NN)-based controller, referred to adaptive critic controller, is proposed for affine nonlinear discrete-time systems with applications to nanomanipulation. In the online NN reinforcement learning method, one NN is designated as the critic NN, which approximates the long-term cost function by assuming that the states of the nonlinear systems is available for measurement. An action NN is employed to derive an optimal control signal to track a desired system trajectory while minimizing the cost function. Online updating weight tuning schemes for these two NNs are also derived. By using the Lyapunov approach, …


Adaptive Power Control Protocol With Hardware Implementation For Wireless Sensor And Rfid Reader Networks, Kainan Cha, Jagannathan Sarangapani, David Pommerenke Jan 2007

Adaptive Power Control Protocol With Hardware Implementation For Wireless Sensor And Rfid Reader Networks, Kainan Cha, Jagannathan Sarangapani, David Pommerenke

Electrical and Computer Engineering Faculty Research & Creative Works

The development and deployment of radio frequency identification (RFID) systems render a novel distributed sensor network which enhances visibility into manufacturing processes. In RFID systems, the detection range and read rates will suffer from interference among high-power reading devices. This problem grows severely and degrades system performance in dense RFID networks. Consequently, medium access protocols (MAC) protocols are needed for such networks to assess and provide access to the channel so that tags can be read accurately. In this paper, we investigate a suite of feasible power control schemes to ensure overall coverage area of the system while maintaining a …


Neural Network Control Of Robot Formations Using Rise Feedback, Jagannathan Sarangapani, Travis Alan Dierks Jan 2007

Neural Network Control Of Robot Formations Using Rise Feedback, Jagannathan Sarangapani, Travis Alan Dierks

Electrical and Computer Engineering Faculty Research & Creative Works

In this paper, a combined kinematic/torque control law is developed for leader-follower based formation control using backstepping in order to accommodate the dynamics of the robots and the formation in contrast with kinematic-based formation controllers that are widely reported in the literature. A neural network (NN) is introduced along with robust integral of the sign of the error (RISE) feedback to approximate the dynamics of the follower as well as its leader using online weight tuning. It is shown using Lyapunov theory that the errors for the entire formation are asymptotically stable and the NN weights are bounded as opposed …


Online Reinforcement Learning Control Of Unknown Nonaffine Nonlinear Discrete Time Systems, Qinmin Yang, Jagannathan Sarangapani Jan 2007

Online Reinforcement Learning Control Of Unknown Nonaffine Nonlinear Discrete Time Systems, Qinmin Yang, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

In this paper, a novel neural network (NN) based online reinforcement learning controller is designed for nonaffine nonlinear discrete-time systems with bounded disturbances. The nonaffine systems are represented by nonlinear auto regressive moving average with exogenous input (NARMAX) model with unknown nonlinear functions. An equivalent affine-like representation for the tracking error dynamics is developed first from the original nonaffine system. Subsequently, a reinforcement learning-based neural network (NN) controller is proposed for the affine-like nonlinear error dynamic system. The control scheme consists of two NNs. One NN is designated as the critic, which approximates a predefined long-term cost function, whereas an …


Route Aware Predictive Congestion Control Protocol For Wireless Sensor Networks, Carl Larsen, Maciej Jan Zawodniok, Jagannathan Sarangapani Jan 2007

Route Aware Predictive Congestion Control Protocol For Wireless Sensor Networks, Carl Larsen, Maciej Jan Zawodniok, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

Congestion in wireless sensor networks (WSN) may lead to packet losses or delayed delivery of important information rendering the WSN-based monitoring or control system useless. In this paper a routing-aware predictive congestion control (RPCC) yet decentralized scheme for WSN is presented that uses a combination of a hop by hop congestion control mechanism to maintain desired level of buffer occupancy, and a dynamic routing scheme that works in concert with the congestion control mechanism to forward the packets through less congested nodes. The proposed adaptive approach restricts the incoming traffic thus preventing buffer overflow while maintaining the rate through an …


Adaptive Critic Neural Network Force Controller For Atomic Force Microscope-Based Nanomanipulation, Qinmin Yang, Jagannathan Sarangapani Oct 2006

Adaptive Critic Neural Network Force Controller For Atomic Force Microscope-Based Nanomanipulation, Qinmin Yang, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

Automating the task of nanomanipulation is extremely important since it is tedious for humans. This paper proposes an atomic force microscope (AFM) based force controller to push nano particles on the substrates. A block phase correlation-based algorithm is embedded into the controller for the compensation of the thermal drift which is considered as the main external uncertainty during nanomanipulation. Then, the interactive forces and dynamics between the tip and the particle, particle and the substrate are modeled and analyzed. Further, an adaptive critic NN controller based on adaptive dynamic programming algorithm is designed and the task of pushing nano particles …