Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 7 of 7
Full-Text Articles in Mechanical Engineering
Issues On Stability Of Adp Feedback Controllers For Dynamical Systems, S. N. Balakrishnan, Jie Ding, F. L. Lewis
Issues On Stability Of Adp Feedback Controllers For Dynamical Systems, S. N. Balakrishnan, Jie Ding, F. L. Lewis
Mechanical and Aerospace Engineering Faculty Research & Creative Works
This paper traces the development of neural-network (NN)-based feedback controllers that are derived from the principle of adaptive/approximate dynamic programming (ADP) and discusses their closed-loop stability. Different versions of NN structures in the literature, which embed mathematical mappings related to solutions of the ADP-formulated problems called “adaptive critics” or “action-critic” networks, are discussed. Distinction between the two classes of ADP applications is pointed out. Furthermore, papers in “model-free” development and model-based neurocontrollers are reviewed in terms of their contributions to stability issues. Recent literature suggests that work in ADP-based feedback controllers with assured stability is growing in diverse forms.
Reinforcement Learning Based Output-Feedback Control Of Nonlinear Nonstrict Feedback Discrete-Time Systems With Application To Engines, Peter Shih, Jonathan B. Vance, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier
Reinforcement Learning Based Output-Feedback Control Of Nonlinear Nonstrict Feedback Discrete-Time Systems With Application To Engines, Peter Shih, Jonathan B. Vance, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier
Electrical and Computer Engineering Faculty Research & Creative Works
A novel reinforcement-learning based output-adaptive neural network (NN) controller, also referred as the adaptive-critic NN controller, is developed to track a desired trajectory for a class of complex nonlinear discrete-time systems in the presence of bounded and unknown disturbances. The controller includes an observer for estimating states and the outputs, critic, and two action NNs for generating virtual, and actual control inputs. The critic approximates certain strategic utility function and the action NNs are used to minimize both the strategic utility function and their outputs. All NN weights adapt online towards minimization of a performance index, utilizing gradient-descent based rule. …
Neural Network-Based Output Feedback Controller For Lean Operation Of Spark Ignition Engines, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier, Jonathan B. Vance, Pingan He
Neural Network-Based Output Feedback Controller For Lean Operation Of Spark Ignition Engines, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier, Jonathan B. Vance, Pingan He
Electrical and Computer Engineering Faculty Research & Creative Works
Spark ignition (SI) engines running at very lean conditions demonstrate significant nonlinear behavior by exhibiting cycle-to-cycle dispersion of heat release even though such operation can significantly reduce NOx emissions and improve fuel efficiency by as much as 5-10%. A suite of neural network (NN) controller without and with reinforcement learning employing output feedback has shown ability to reduce the nonlinear cyclic dispersion observed under lean operating conditions. The neural network controllers consists of three NN: a) A NN observer to estimate the states of the engine such as total fuel and air; b) a second NN for generating virtual input; …
Approximate Dynamic Programming Based Optimal Neurocontrol Synthesis Of A Chemical Reactor Process Using Proper Orthogonal Decomposition, Radhakant Padhi, S. N. Balakrishnan
Approximate Dynamic Programming Based Optimal Neurocontrol Synthesis Of A Chemical Reactor Process Using Proper Orthogonal Decomposition, Radhakant Padhi, S. N. Balakrishnan
Mechanical and Aerospace Engineering Faculty Research & Creative Works
The concept of approximate dynamic programming and adaptive critic neural network based optimal controller is extended in this study to include systems governed by partial differential equations. An optimal controller is synthesized for a dispersion type tubular chemical reactor, which is governed by two coupled nonlinear partial differential equations. It consists of three steps: First, empirical basis functions are designed using the "Proper Orthogonal Decomposition" technique and a low-order lumped parameter system to represent the infinite-dimensional system is obtained by carrying out a Galerkin projection. Second, approximate dynamic programming technique is applied in a discrete time framework, followed by the …
Adaptive Critic-Based Neural Network Controller For Uncertain Nonlinear Systems With Unknown Deadzones, Pingan He, Jagannathan Sarangapani, S. N. Balakrishnan
Adaptive Critic-Based Neural Network Controller For Uncertain Nonlinear Systems With Unknown Deadzones, Pingan He, Jagannathan Sarangapani, S. N. Balakrishnan
Electrical and Computer Engineering Faculty Research & Creative Works
A multilayer neural network (NN) controller in discrete-time is designed to deliver a desired tracking performance for a class of nonlinear systems with input deadzones. This multilayer NN controller has an adaptive critic NN architecture with two NNs for compensating the deadzone nonlinearity and a third NN for approximating the dynamics of the nonlinear system. A reinforcement learning scheme in discrete-time is proposed for the adaptive critic NN deadzone compensator, where the learning is performed based on a certain performance measure, which is supplied from a critic. The adaptive generating NN rejects the errors induced by the deadzone whereas a …
Stability Analysis Of Nonlinear Machining Force Controllers, Robert G. Landers, Yen-Wen Lu
Stability Analysis Of Nonlinear Machining Force Controllers, Robert G. Landers, Yen-Wen Lu
Mechanical and Aerospace Engineering Faculty Research & Creative Works
Model parameters vary significantly during a normal operation, thus, adaptive techniques have predominately been used. However, model-based techniques that carefully account for changes in the force process have again been examined due to the reduced complexity afforded by such techniques. In this paper, the effect of model parameter variations on the closed-loop stability for two model-based force controllers is examined. It was found that the stability boundary in the process parameter space can be exactly determined for force control systems designed for static force processes. For force control systems designed for first-order force processes, it was found that the stability …
Adaptive Critic Based Neurocontroller For Autolanding Of Aircraft With Varying Glideslopes, Gaurav Saini, S. N. Balakrishnan
Adaptive Critic Based Neurocontroller For Autolanding Of Aircraft With Varying Glideslopes, Gaurav Saini, S. N. Balakrishnan
Mechanical and Aerospace Engineering Faculty Research & Creative Works
In this paper, adaptive critic based neural networks have been used to design a controller for a benchmark problem in aircraft autolanding. The adaptive critic control methodology comprises successive adaptations of two neural networks, namely `action' and `critic' networks until closed loop optimal control is achieved. The autolanding problem deals with longitudinal dynamics of an aircraft which is to be landed in a specified touchdown region in the presence of wind disturbances and gusts using elevator deflection as the control for glideslope and flare modes. The performance of the neurocontroller is compared to that of a conventional PID controller. Neurocontroller's …