Open Access. Powered by Scholars. Published by Universities.®

Engineering Commons

Open Access. Powered by Scholars. Published by Universities.®

Optimal Control

Discipline
Institution
Publication Year
Publication
Publication Type

Articles 91 - 115 of 115

Full-Text Articles in Engineering

Adaptive Critic Designs And Their Implementations On Different Neural Network Architectures, Jung-Wook Park, Ganesh K. Venayagamoorthy, Ronald G. Harley Jan 2003

Adaptive Critic Designs And Their Implementations On Different Neural Network Architectures, Jung-Wook Park, Ganesh K. Venayagamoorthy, Ronald G. Harley

Electrical and Computer Engineering Faculty Research & Creative Works

The design of nonlinear optimal neurocontrollers based on the Adaptive Critic Designs (ACDs) family of algorithms has recently attracted interest. This paper presents a summary of these algorithms, and compares their performance when implemented on two different types of artificial neural networks, namely the multilayer perceptron neural network (MLPNN) and the radial basis function neural network (RBFNN). As an example for the application of the ACDs, the control of synchronous generator on an electric power grid is considered and results are presented to compare the different ACD family members and their implementations on different neural network architectures.


State-Constrained Agile Missile Control With Adaptive-Critic-Based Neural Networks, Dongchen Han, S. N. Balakrishnan Jan 2002

State-Constrained Agile Missile Control With Adaptive-Critic-Based Neural Networks, Dongchen Han, S. N. Balakrishnan

Mechanical and Aerospace Engineering Faculty Research & Creative Works

In this study, we develop an adaptive-critic-based controller to steer an agile missile that has a constraint on the minimum flight Mach number from various initial Mach numbers to a given final Mach number in minimum time while completely reversing its flightpath angle. This class of bounded state space, free final time problems is very difficult to solve due to discontinuities in costates at the constraint boundaries. We use a two-neural-network structure called "adaptive critic" in this study to carry out the optimization process. This structure obtains an optimal controller through solving optimal control-related equations resulting from a Hamiltonian formulation. …


Adaptive Critic Based Optimal Neurocontrol For Synchronous Generator In Power System Using Mlp/Rbf Neural Networks, Jung-Wook Park, Ganesh K. Venayagamoorthy, Ronald G. Harley Jan 2002

Adaptive Critic Based Optimal Neurocontrol For Synchronous Generator In Power System Using Mlp/Rbf Neural Networks, Jung-Wook Park, Ganesh K. Venayagamoorthy, Ronald G. Harley

Electrical and Computer Engineering Faculty Research & Creative Works

This paper presents a novel optimal neurocontroller that replaces the conventional controller (CONVC),which consists of the automatic voltage regulator (AVR) and turbine governor, to control a synchronous generator in a power system using a multilayer perceptron neural network (MLPN) and a radial basis function neural network (RBFN). The heuristic dynamic programming (HDP) based on the adaptive critic design (ACD) technique is used for the design of the neurocontroller. The performance of the MLPN based HDP neurocontroller (MHDPC) is compared with the RBFN based HDP neurocontroller (RHDPC) for small as well as large disturbances to a power system, and they are …


A New Filtering Technique For A Class Of Nonlinear Systems, Ming Xin, S. N. Balakrishnan Jan 2002

A New Filtering Technique For A Class Of Nonlinear Systems, Ming Xin, S. N. Balakrishnan

Mechanical and Aerospace Engineering Faculty Research & Creative Works

In this paper, a new nonlinear filtering technique (θ-D filter) is presented. This filter is derived by constructing the dual of a new nonlinear regulator control technique, θ-D approximation which involves approximate solution to the Hamilton-Jacobi-Bellman equation. The structure of this filter is similar to the state dependent riccati equation filter (SDREF). However, this method does not need time-consuming online computation of the algebraic Riccati equation at each sample time compared with the SDREF. By manipulating the perturbation terms both the asymptotic stability and optimality properties can be obtained. A simple pendulum problem is investigated to demonstrate the effectiveness of …


Proper Orthogonal Decomposition Based Feedback Optimal Control Synthesis Of Distributed Parameter Systems Using Neural Networks, Radhakant Padhi, S. N. Balakrishnan Jan 2002

Proper Orthogonal Decomposition Based Feedback Optimal Control Synthesis Of Distributed Parameter Systems Using Neural Networks, Radhakant Padhi, S. N. Balakrishnan

Mechanical and Aerospace Engineering Faculty Research & Creative Works

A new method for optimal control design of distributed parameter systems is presented in this paper. The concept of proper orthogonal decomposition is used for the model reduction of distributed parameter systems to form a reduced order lumped parameter problem. The optimal control problem is then solved in the time domain, in a state feedback sense, following the philosophy of ''adaptive critic'' neural networks. The control solution is then mapped back to the spatial domain using the same basis functions. Numerical simulation results are presented for a linear and nonlinear one-dimensional heat equation problem in an infinite time regulator framework.


Comparison Of Heuristic Dynamic Programming And Dual Heuristic Programming Adaptive Critics For Neurocontrol Of A Turbogenerator, Ganesh K. Venayagamoorthy, Donald C. Wunsch, Ronald G. Harley Jan 2002

Comparison Of Heuristic Dynamic Programming And Dual Heuristic Programming Adaptive Critics For Neurocontrol Of A Turbogenerator, Ganesh K. Venayagamoorthy, Donald C. Wunsch, Ronald G. Harley

Electrical and Computer Engineering Faculty Research & Creative Works

This paper presents the design of an optimal neurocontroller that replaces the conventional automatic voltage regulator (AVR) and the turbine governor for a turbogenerator connected to the power grid. The neurocontroller design uses a novel technique based on the adaptive critic designs (ACDs), specifically on heuristic dynamic programming (HDP) and dual heuristic programming (DHP). Results show that both neurocontrollers are robust, but that DHP outperforms HDP or conventional controllers, especially when the system conditions and configuration change. This paper also shows how to design optimal neurocontrollers for nonlinear systems, such as turbogenerators, without having to do continually online training of …


An Optimal Control Based Treatment Strategy For Parturient Paresis Using Neural Networks, Radhakant Padhi, S. N. Balakrishnan Jan 2001

An Optimal Control Based Treatment Strategy For Parturient Paresis Using Neural Networks, Radhakant Padhi, S. N. Balakrishnan

Mechanical and Aerospace Engineering Faculty Research & Creative Works

An optimal online feedback treatment strategy is developed for the parturient paresis of cows, based on nonlinear optimal control theory. A limitation in the development of an existing mathematical model for calcium homeostasis is addressed and the model is extended to incorporate control inputs. An optimal feedback controller is synthesized for the nonlinear system using neural networks. Though the main aim of this paper is to solve the biomedical control problem, the methodology presented in this paper is a general computational tool, which can be applied to solve a fairly general class nonlinear optimal control problems.


Robust State Dependent Riccati Equation Based Robot Manipulator Control, Ming Xin, S. N. Balakrishnan, Zhongwu Huang Jan 2001

Robust State Dependent Riccati Equation Based Robot Manipulator Control, Ming Xin, S. N. Balakrishnan, Zhongwu Huang

Mechanical and Aerospace Engineering Faculty Research & Creative Works

We present a new optimal control approach to robust control of robot manipulators in the framework of state dependent Riccati equation (SDRE) technique. To treat this highly nonlinear control system, we formulate it as a nonlinear optimal regulator problem. SDRE technique was used to synthesize an optimal controller to this class of robot control problem. We also synthesize a neural network based extra controller to achieve the robustness in the presence of the parameter uncertainties. A typical two-link robot position control problem was studied to show the effectiveness of SDRE approach and robust extra control design to robotic application.


Dual Heuristic Programming Excitation Neurocontrol For Generators In A Multimachine Power System, Ganesh K. Venayagamoorthy, Donald C. Wunsch, Ronald G. Harley Jan 2001

Dual Heuristic Programming Excitation Neurocontrol For Generators In A Multimachine Power System, Ganesh K. Venayagamoorthy, Donald C. Wunsch, Ronald G. Harley

Electrical and Computer Engineering Faculty Research & Creative Works

The design of optimal neurocontrollers that replace the conventional automatic voltage regulators for excitation control of turbogenerators in a multimachine power system is presented in this paper. The neurocontroller design is based on dual heuristic programming (DHP), a powerful adaptive critic technique. The feedback variables are completely based on local measurements from the generators. Simulations on a three-machine power system demonstrate that DHP based neurocontrol is much more effective than the conventional PID control for improving dynamic performance and stability of the power grid under small and large disturbances. This paper also shows how to design optimal multiple neurocontrollers for …


A Nonlinear Voltage Controller With Derivative Adaptive Critics For Multimachine Power Systems, Ganesh K. Venayagamoorthy, Donald C. Wunsch, Ronald G. Harley Jan 2001

A Nonlinear Voltage Controller With Derivative Adaptive Critics For Multimachine Power Systems, Ganesh K. Venayagamoorthy, Donald C. Wunsch, Ronald G. Harley

Electrical and Computer Engineering Faculty Research & Creative Works

Based on derivative adaptive critics, a novel nonlinear optimal voltage/excitation control for a multimachine power system is presented. The feedback variables are completely based on local measurements. Simulations on a three-machine system demonstrate that the nonlinear controller is much more effective than the conventional PID controller equipped with a power system stabilizer for improving dynamic performance and stability under small and large disturbances.


Robust Control Of Input Limited Smart Structural Systems, Sridhar Sana, Vittal S. Rao Jan 2001

Robust Control Of Input Limited Smart Structural Systems, Sridhar Sana, Vittal S. Rao

Electrical and Computer Engineering Faculty Research & Creative Works

Integration of controllers with smart structural systems require the controllers to consume less power and to be small in hardware size. These requirements pose as limits on the control input and the order of the controllers. Use of reduced order model of the plant in the controller design can cause spill over problems in the closed-loop system due to possible excitation of the unmodeled dynamics. In this paper, we present a method to design output feedback robust controllers for smart structures in the presence of control input limits considering unmodeled dynamics as additive uncertainty in the design. The performance requirements …


Convergence Analysis Of Adaptive Critic Based Optimal Control, S. N. Balakrishnan, Xin Liu Jan 2000

Convergence Analysis Of Adaptive Critic Based Optimal Control, S. N. Balakrishnan, Xin Liu

Mechanical and Aerospace Engineering Faculty Research & Creative Works

Adaptive critic based neural networks have been found to be powerful tools in solving various optimal control problems. The adaptive critic approach consists of two neural networks which output the control values and the Lagrangian multipliers associated with optimal control. These networks are trained successively and when the outputs of the two networks are mutually consistent and satisfy the differential constraints, the controller network output produces optimal control. In this paper, we analyze the mechanics of convergence of the network solutions. We establish the necessary conditions for the network solutions to converge and show that the converged solution is optimal.


Infinite Time Optimal Neuro Control For Distributed Parameter Systems, S. N. Balakrishnan, Radhakant Padhi Jan 2000

Infinite Time Optimal Neuro Control For Distributed Parameter Systems, S. N. Balakrishnan, Radhakant Padhi

Mechanical and Aerospace Engineering Faculty Research & Creative Works

The conventional dynamic programming methodology for the solution of optimal control, despite having many desirable features, is severely restricted by its computational requirements. However, in recent times, an alternate formulation, known as the adaptive-critic synthesis, has given it a new perspective. In this paper, we have attempted to use the philosophy of adaptive-critic design to the optimal control of distributed parameter systems. An important contribution of this study is the derivation of the necessary conditions of optimality for distributed parameter systems, described in discrete domain, following the principle of approximate dynamic programming. Then the derived necessary conditions of optimality are …


Robust Adaptive Critic Based Neurocontrollers For Systems With Input Uncertainties, S. N. Balakrishnan, Zhongwu Huang Jan 2000

Robust Adaptive Critic Based Neurocontrollers For Systems With Input Uncertainties, S. N. Balakrishnan, Zhongwu Huang

Mechanical and Aerospace Engineering Faculty Research & Creative Works

A two-neural network approach to solving optimal control problems is described in this study. This approach called the adaptive critic method consists of two neural networks: one is called the supervisor or critic, and the other is called an action network or controller. The inputs to both these networks are the current states of the system to be controlled. Each network is trained through an output of the other network and the conditions for optimal control. When their outputs are mutually consistent, the controller network output is optimal. The optimality is limited to the underlying model. Hence, we develop a …


Frequency Domain Robustness Analysis Of Hopfield And Modified Hopfield Neural Networks, Jie Shen, S. N. Balakrishnan Jan 1999

Frequency Domain Robustness Analysis Of Hopfield And Modified Hopfield Neural Networks, Jie Shen, S. N. Balakrishnan

Mechanical and Aerospace Engineering Faculty Research & Creative Works

A variant of Hopfield neural network, called the modified Hopfield network, is formulated in this study. This class of networks consists of parallel recurrent networks which have variable dimensions that can be changed to fit the problem under consideration. It has a structure to implement an inverse transformation that is essential for embedding optimal control gain sequences. Equilibrium solutions of this network are discussed. The robustness of this network and the classical Hopfield network are carried out in the frequency domain using describing functions


Adaptive Critic Based Neural Networks For Control-Constrained Agile Missile Control, Dongchen Han, S. N. Balakrishnan Jan 1999

Adaptive Critic Based Neural Networks For Control-Constrained Agile Missile Control, Dongchen Han, S. N. Balakrishnan

Mechanical and Aerospace Engineering Faculty Research & Creative Works

We investigate the use of an `adaptive critic' based controller to steer an agile missile with a constraint on the angle of attack from various initial Mach numbers to a given final Mach number in minimum time while completely reversing its flightpath angle. We use neural networks with a two-network structure called `adaptive critic' to carry out the optimization process. This structure obtains an optimal controller through solving Hamiltonian equations. This approach needs no external training; each network along with the optimality equations generates the output for the other network. When the outputs are mutually consistent, the controller output is …


A Class Of Modified Hopfield Networks For Control Of Linear And Nonlinear Systems, Jie Shen, S. N. Balakrishnan Jan 1998

A Class Of Modified Hopfield Networks For Control Of Linear And Nonlinear Systems, Jie Shen, S. N. Balakrishnan

Mechanical and Aerospace Engineering Faculty Research & Creative Works

This paper presents a class of modified Hopfield neural networks (MHNN) and their use in solving linear and nonlinear control problems. This class of networks consists of parallel recurrent networks which have variable dimensions that can be changed to fit the problems under consideration. It has a structure to implement an inverse transformation that is essential for embedding optimal control gain sequences. Equilibrium solutions are discussed. Numerical results for a motivating aircraft control problem (linear) are presented. Furthermore, we formulate the state-dependent Riccati equation method (SDRE) for a class of nonlinear dynamical system and show how MHNN provides the solution. …


Adaptive Critic Designs, Danil V. Prokhorov, Donald C. Wunsch Sep 1997

Adaptive Critic Designs, Danil V. Prokhorov, Donald C. Wunsch

Electrical and Computer Engineering Faculty Research & Creative Works

We discuss a variety of adaptive critic designs (ACDs) for neurocontrol. These are suitable for learning in noisy, nonlinear, and nonstationary environments. They have common roots as generalizations of dynamic programming for neural reinforcement learning approaches. Our discussion of these origins leads to an explanation of three design families: heuristic dynamic programming, dual heuristic programming, and globalized dual heuristic programming (GDHP). The main emphasis is on DHP and GDHP as advanced ACDs. We suggest two new modifications of the original GDHP design that are currently the only working implementations of GDHP. They promise to be useful for many engineering applications …


A Robust Unit Commitment Algorithm For Hydro-Thermal Optimization, Chao-An Li, Chung-Li Tseng, E. Hsu, R. B. Johnson, A. J. Svoboda May 1997

A Robust Unit Commitment Algorithm For Hydro-Thermal Optimization, Chao-An Li, Chung-Li Tseng, E. Hsu, R. B. Johnson, A. J. Svoboda

Engineering Management and Systems Engineering Faculty Research & Creative Works

This paper presents a unit commitment algorithm which combines the Lagrangian relaxation (LR), sequential unit commitment (SUC), and optimal unit decommitment (UD) methods to solve a general hydro-thermal optimization (HTO) problem. The authors argue that this approach retains the advantages of the LR method while addressing the method''s observed weaknesses to improve overall algorithm performance and quality of solution. The proposed approach has been implemented in a version of PG&E''s HTO program, and test results are presented.


Adaptive Critic Based Neurocontroller For Autolanding Of Aircraft With Varying Glideslopes, Gaurav Saini, S. N. Balakrishnan Jan 1997

Adaptive Critic Based Neurocontroller For Autolanding Of Aircraft With Varying Glideslopes, Gaurav Saini, S. N. Balakrishnan

Mechanical and Aerospace Engineering Faculty Research & Creative Works

In this paper, adaptive critic based neural networks have been used to design a controller for a benchmark problem in aircraft autolanding. The adaptive critic control methodology comprises successive adaptations of two neural networks, namely `action' and `critic' networks until closed loop optimal control is achieved. The autolanding problem deals with longitudinal dynamics of an aircraft which is to be landed in a specified touchdown region in the presence of wind disturbances and gusts using elevator deflection as the control for glideslope and flare modes. The performance of the neurocontroller is compared to that of a conventional PID controller. Neurocontroller's …


A Dual Neural Network Architecture For Linear And Nonlinear Control Of Inverted Pendulum On A Cart, S. N. Balakrishnan, Victor Biega Jan 1996

A Dual Neural Network Architecture For Linear And Nonlinear Control Of Inverted Pendulum On A Cart, S. N. Balakrishnan, Victor Biega

Mechanical and Aerospace Engineering Faculty Research & Creative Works

The use of a self-contained dual neural network architecture for the solution of nonlinear optimal control problems is investigated in this study. The network structure solves the dynamic programming equations in stages and at the convergence, one network provides the optimal control and the second network provides a fault tolerance to the control system. We detail the steps in design and solve a linearized and a nonlinear, unstable, four-dimensional inverted pendulum on a cart problem. Numerical results are presented and compared with linearized optimal control. Unlike the previously published neural network solutions, this methodology does not need any external training, …


A New Neural Architecture For Homing Missile Guidance, S. N. Balakrishnan, Victor Biega Jan 1995

A New Neural Architecture For Homing Missile Guidance, S. N. Balakrishnan, Victor Biega

Mechanical and Aerospace Engineering Faculty Research & Creative Works

We present a new neural architecture which imbeds dynamic programming solutions to solve optimal target-intercept problems. They provide feedback guidance solutions, which are optimal with any initial conditions and time-to-go, for a 2D scenario. The method discussed in this study determines an optimal control law for a system by successively adapting two networks - an action and a critic network. This method determines the control law for an entire range of initial conditions; it simultaneously determines and adapts the neural networks to the optimal control policy for both linear and nonlinear systems. In addition, it is important to know that …


Use Of Hopfield Neural Networks In Optimal Guidance, S. N. Balakrishnan, James Edward Steck Jan 1994

Use Of Hopfield Neural Networks In Optimal Guidance, S. N. Balakrishnan, James Edward Steck

Mechanical and Aerospace Engineering Faculty Research & Creative Works

A Hopfield neural network architecture is developed to solve the optimal control problem for homing missile guidance. A linear quadratic optimal control problem is formulated in the form of an efficient parallel computing device known as a Hopfield neural network. Convergence of the Hopfield network is analyzed from a theoretical perspective, showing that the network, as a dynamical system approaches a unique fixed point which is the solution to the optimal control problem at any instant during the missile pursuit. Several target-intercept scenarios are provided to demonstrate the use of the recurrent feedback neural net formulation.


Approximate Analytical Guidance Schemes For Homing Missiles, S. N. Balakrishnan, Donald T. Stansbery Jan 1994

Approximate Analytical Guidance Schemes For Homing Missiles, S. N. Balakrishnan, Donald T. Stansbery

Mechanical and Aerospace Engineering Faculty Research & Creative Works

Closed form solutions for the guidance laws are developed using modern control techniques. The resulting two-point boundary value problem is solved through the use of the state transition matrix of the intercept dynamics. Results are presented in terms of a design parameter.


Decoupled Dynamics For Control And Estimation, S. N. Balakrishnan Jan 1991

Decoupled Dynamics For Control And Estimation, S. N. Balakrishnan

Mechanical and Aerospace Engineering Faculty Research & Creative Works

Decoupling of the dynamical equations in polar coordinates is used to develop a control scheme for use in target-intercept problems with passive measurements. By defining a pseudo control variable in the radial coordinate, the radial dynamics is made independent of the transverse dynamics. After solving for the radial control, the transverse control is determined through solutions to a two-point boundary value problem. Numerical results from a six degree-of-freedom simulation which used the decoupled control indicate that it is better than the completely Cartesian coordinate control for most of the cases considered. Decoupled control, though, is obtained iteratively through a two-point …