Open Access. Powered by Scholars. Published by Universities.®

Mechanical Engineering Commons

Open Access. Powered by Scholars. Published by Universities.®

1995

Dynamic Programming

Articles 1 - 2 of 2

Full-Text Articles in Mechanical Engineering

A New Neural Architecture For Homing Missile Guidance, S. N. Balakrishnan, Victor Biega Jan 1995

A New Neural Architecture For Homing Missile Guidance, S. N. Balakrishnan, Victor Biega

Mechanical and Aerospace Engineering Faculty Research & Creative Works

We present a new neural architecture which imbeds dynamic programming solutions to solve optimal target-intercept problems. They provide feedback guidance solutions, which are optimal with any initial conditions and time-to-go, for a 2D scenario. The method discussed in this study determines an optimal control law for a system by successively adapting two networks - an action and a critic network. This method determines the control law for an entire range of initial conditions; it simultaneously determines and adapts the neural networks to the optimal control policy for both linear and nonlinear systems. In addition, it is important to know that …


Adaptive Critic Based Neural Networks For Control (Low Order System Applications), S. N. Balakrishnan, Victor Biega Jan 1995

Adaptive Critic Based Neural Networks For Control (Low Order System Applications), S. N. Balakrishnan, Victor Biega

Mechanical and Aerospace Engineering Faculty Research & Creative Works

Dynamic programming is an exact method of determining optimal control for a discretized system. Unfortunately, for nonlinear systems the computations necessary with this method become prohibitive. This study investigates the use of adaptive neural networks that utilize dynamic programming methodology to develop near optimal control laws. First, a one dimensional infinite horizon problem is examined. Problems involving cost functions with final state constraints are considered for one dimensional linear and nonlinear systems. A two dimensional linear problem is also investigated. In addition to these examples, an example of the corrective capabilities of critics is shown. Synthesis of the networks in …