Open Access. Powered by Scholars. Published by Universities.®

Engineering Commons

Open Access. Powered by Scholars. Published by Universities.®

PDF

Computer Sciences

Electrical and Computer Engineering Faculty Research & Creative Works

Lyapunov Methods

Publication Year

Articles 1 - 10 of 10

Full-Text Articles in Engineering

Control Of Nonholonomic Mobile Robot Formations Using Neural Networks, Jagannathan Sarangapani, Travis Alan Dierks Oct 2007

Control Of Nonholonomic Mobile Robot Formations Using Neural Networks, Jagannathan Sarangapani, Travis Alan Dierks

Electrical and Computer Engineering Faculty Research & Creative Works

In this paper the control of formations of multiple nonholonomic mobile robots is attempted by integrating a kinematic controller with a neural network (NN) computed-torque controller. A combined kinematic/torque control law is developed for leader-follower based formation control using backstepping in order to accommodate the dynamics of the robots and the formation in contrast with kinematic-based formation controllers. The NN is introduced to approximate the dynamics of the follower as well as its leader using online weight tuning. It is shown using Lyapunov theory that the errors for the entire formation are uniformly ultimately bounded, and numerical results are provided.


Reinforcement Learning Based Output-Feedback Control Of Nonlinear Nonstrict Feedback Discrete-Time Systems With Application To Engines, Peter Shih, Jonathan B. Vance, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier Jul 2007

Reinforcement Learning Based Output-Feedback Control Of Nonlinear Nonstrict Feedback Discrete-Time Systems With Application To Engines, Peter Shih, Jonathan B. Vance, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier

Electrical and Computer Engineering Faculty Research & Creative Works

A novel reinforcement-learning based output-adaptive neural network (NN) controller, also referred as the adaptive-critic NN controller, is developed to track a desired trajectory for a class of complex nonlinear discrete-time systems in the presence of bounded and unknown disturbances. The controller includes an observer for estimating states and the outputs, critic, and two action NNs for generating virtual, and actual control inputs. The critic approximates certain strategic utility function and the action NNs are used to minimize both the strategic utility function and their outputs. All NN weights adapt online towards minimization of a performance index, utilizing gradient-descent based rule. …


Near Optimal Output-Feedback Control Of Nonlinear Discrete-Time Systems In Nonstrict Feedback Form With Application To Engines, Peter Shih, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier Jan 2007

Near Optimal Output-Feedback Control Of Nonlinear Discrete-Time Systems In Nonstrict Feedback Form With Application To Engines, Peter Shih, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier

Electrical and Computer Engineering Faculty Research & Creative Works

A novel reinforcement-learning based output-adaptive neural network (NN) controller, also referred as the adaptive-critic NN controller, is developed to track a desired trajectory for a class of complex nonlinear discrete-time systems in the presence of bounded and unknown disturbances. The controller includes an observer for estimating states and the outputs, critic, and two action NNs for generating virtual, and actual control inputs. The critic approximates certain strategic utility function and the action NNs are used to minimize both the strategic utility function and their outputs. All NN weights adapt online towards minimization of a performance index, utilizing gradient-descent based rule. …


Online Reinforcement Learning Control Of Unknown Nonaffine Nonlinear Discrete Time Systems, Qinmin Yang, Jagannathan Sarangapani Jan 2007

Online Reinforcement Learning Control Of Unknown Nonaffine Nonlinear Discrete Time Systems, Qinmin Yang, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

In this paper, a novel neural network (NN) based online reinforcement learning controller is designed for nonaffine nonlinear discrete-time systems with bounded disturbances. The nonaffine systems are represented by nonlinear auto regressive moving average with exogenous input (NARMAX) model with unknown nonlinear functions. An equivalent affine-like representation for the tracking error dynamics is developed first from the original nonaffine system. Subsequently, a reinforcement learning-based neural network (NN) controller is proposed for the affine-like nonlinear error dynamic system. The control scheme consists of two NNs. One NN is designated as the critic, which approximates a predefined long-term cost function, whereas an …


Nanomanipulation Using Atomic Force Microscope With Drift Compensation, Qinmin Yang, Jagannathan Sarangapani Jun 2006

Nanomanipulation Using Atomic Force Microscope With Drift Compensation, Qinmin Yang, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

This paper proposes an atomic force microscope (AFM) based force controller to push nanoparticles on the substrates since it is tedious for human. A block phase correlation-based algorithm is embedded into the controller for compensating the thermal drift during nanomanipulation. Further, a neural network (NN) is employed to approximate the unknown nanoparticle and substrate contact dynamics including the roughness effects. Using the NN-based adaptive force controller the task of pushing nanoparticles is demonstrated. Finally, using the Lyapunov-based stability analysis, the uniform ultimately boundedness (UUB) of the closed-loop signals is demonstrated


Decentralized Power Control With Implementation For Rfid Networks, Kainan Cha, Anil Ramachandran, David Pommerenke, Jagannathan Sarangapani Jan 2006

Decentralized Power Control With Implementation For Rfid Networks, Kainan Cha, Anil Ramachandran, David Pommerenke, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

In radio frequency identification (RFID) systems, the detection range and read rates will suffer from interference among high power reading devices. This problem grows severely and degrades system performance in dense RFID networks. In this paper, we investigate a suite of feasible power control schemes to ensure overall coverage area of the system while maintaining a desired read rate. The power control scheme and MAC protocol dynamically adjusts the RFID reader power output in response to the interference level seen locally during tag reading for an acceptable signal-to-noise ratio (SNR). We present novel distributed adaptive power control (DAPC) and probabilistic …


Neural Network-Based Output Feedback Controller For Lean Operation Of Spark Ignition Engines, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier, Jonathan B. Vance, Pingan He Jan 2006

Neural Network-Based Output Feedback Controller For Lean Operation Of Spark Ignition Engines, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier, Jonathan B. Vance, Pingan He

Electrical and Computer Engineering Faculty Research & Creative Works

Spark ignition (SI) engines running at very lean conditions demonstrate significant nonlinear behavior by exhibiting cycle-to-cycle dispersion of heat release even though such operation can significantly reduce NOx emissions and improve fuel efficiency by as much as 5-10%. A suite of neural network (NN) controller without and with reinforcement learning employing output feedback has shown ability to reduce the nonlinear cyclic dispersion observed under lean operating conditions. The neural network controllers consists of three NN: a) A NN observer to estimate the states of the engine such as total fuel and air; b) a second NN for generating virtual input; …


A Robust Controller For The Manipulation Of Micro Scale Objects, Qinmin Yang, Jagannathan Sarangapani Jan 2005

A Robust Controller For The Manipulation Of Micro Scale Objects, Qinmin Yang, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

A suite of novel robust controllers is presented for the manipulation and handling of micro-scale objects in a micro-electromechanical system (MEMS) where adhesive, surface tension, friction and van der Waals forces are dominant. Moreover, these forces are typically unknown. The robust controller overcomes the unknown system dynamics and ensures the performance in the presence of actuator constraints by assuming that the upper bounds on these forces are known. On the other hand, for the robust adaptive controller, the unknown forces are estimated online. Using the Lyapunov approach, the uniformly ultimate boundedness (UUB) of the closed-loop manipulation error is shown for …


Predictive Congestion Control Mac Protocol For Wireless Sensor Networks, Maciej Jan Zawodniok, Jagannathan Sarangapani Jan 2005

Predictive Congestion Control Mac Protocol For Wireless Sensor Networks, Maciej Jan Zawodniok, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

Available congestion control schemes, for example transport control protocol (TCP), when applied to wireless networks results in a large number of packet drops, unfairness with a significant amount of wasted energy due to retransmissions. To fully utilize the hop by hop feedback information, a suite of novel, decentralized, predictive congestion control schemes are proposed for wireless sensor networks in concert with distributed power control (DPC). Besides providing energy efficient solution, embedded channel estimator in DPC predicts the channel quality. By using the channel quality and node queue utilizations, the onset of network congestion is predicted and congestion control is initiated. …


Neural Network Stabilizing Control Of Single Machine Power System With Control Limits, Wenxin Liu, Jagannathan Sarangapani, Ganesh K. Venayagamoorthy, Donald C. Wunsch, Mariesa Crow Jul 2004

Neural Network Stabilizing Control Of Single Machine Power System With Control Limits, Wenxin Liu, Jagannathan Sarangapani, Ganesh K. Venayagamoorthy, Donald C. Wunsch, Mariesa Crow

Electrical and Computer Engineering Faculty Research & Creative Works

Power system stabilizers are widely used to generate supplementary control signals for the excitation system in order to damp out the low frequency oscillations. This paper proposes a stable neural network (NN) controller for the stabilization of a single machine infinite bus power system. In the power system control literature, simplified analytical models are used to represent the power system and the controller designs are not based on rigorous stability analysis. This work overcomes the two major problems by using an accurate analytical model for controller development and presents the closed-loop stability analysis. The NN is used to approximate the …