Open Access. Powered by Scholars. Published by Universities.®

Engineering Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 8 of 8

Full-Text Articles in Engineering

Reinforcement Learning Based Dual-Control Methodology For Complex Nonlinear Discrete-Time Systems With Application To Spark Engine Egr Operation, Peter Shih, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier Aug 2008

Reinforcement Learning Based Dual-Control Methodology For Complex Nonlinear Discrete-Time Systems With Application To Spark Engine Egr Operation, Peter Shih, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier

Electrical and Computer Engineering Faculty Research & Creative Works

A novel reinforcement-learning-based dual-control methodology adaptive neural network (NN) controller is developed to deliver a desired tracking performance for a class of complex feedback nonlinear discrete-time systems, which consists of a second-order nonlinear discrete-time system in nonstrict feedback form and an affine nonlinear discrete-time system, in the presence of bounded and unknown disturbances. For example, the exhaust gas recirculation (EGR) operation of a spark ignition (SI) engine is modeled by using such a complex nonlinear discrete-time system. A dual-controller approach is undertaken where primary adaptive critic NN controller is designed for the nonstrict feedback nonlinear discrete-time system whereas the secondary ...


Reinforcement Learning Based Output-Feedback Control Of Nonlinear Nonstrict Feedback Discrete-Time Systems With Application To Engines, Peter Shih, Jonathan B. Vance, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier Jul 2007

Reinforcement Learning Based Output-Feedback Control Of Nonlinear Nonstrict Feedback Discrete-Time Systems With Application To Engines, Peter Shih, Jonathan B. Vance, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier

Electrical and Computer Engineering Faculty Research & Creative Works

A novel reinforcement-learning based output-adaptive neural network (NN) controller, also referred as the adaptive-critic NN controller, is developed to track a desired trajectory for a class of complex nonlinear discrete-time systems in the presence of bounded and unknown disturbances. The controller includes an observer for estimating states and the outputs, critic, and two action NNs for generating virtual, and actual control inputs. The critic approximates certain strategic utility function and the action NNs are used to minimize both the strategic utility function and their outputs. All NN weights adapt online towards minimization of a performance index, utilizing gradient-descent based rule ...


Neural Network-Based Output Feedback Controller For Lean Operation Of Spark Ignition Engines, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier, Jonathan B. Vance, Pingan He Jan 2006

Neural Network-Based Output Feedback Controller For Lean Operation Of Spark Ignition Engines, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier, Jonathan B. Vance, Pingan He

Electrical and Computer Engineering Faculty Research & Creative Works

Spark ignition (SI) engines running at very lean conditions demonstrate significant nonlinear behavior by exhibiting cycle-to-cycle dispersion of heat release even though such operation can significantly reduce NOx emissions and improve fuel efficiency by as much as 5-10%. A suite of neural network (NN) controller without and with reinforcement learning employing output feedback has shown ability to reduce the nonlinear cyclic dispersion observed under lean operating conditions. The neural network controllers consists of three NN: a) A NN observer to estimate the states of the engine such as total fuel and air; b) a second NN for generating virtual input ...


Development And Implementation Of New Nonlinear Control Concepts For A Ua, Vijayakumar Janardhan, Derek Schmitz, S. N. Balakrishnan Jan 2004

Development And Implementation Of New Nonlinear Control Concepts For A Ua, Vijayakumar Janardhan, Derek Schmitz, S. N. Balakrishnan

Mechanical and Aerospace Engineering Faculty Research & Creative Works

A reconfigurable flight control method is developed to be implemented on an Unmanned Aircraft (UA), a thirty percent scale model of the Cessna 150. This paper presents the details of the UAV platform, system identification, reconfigurable controller design, development, and implementation on the UA to analyze the performance metrics. A Crossbow Inertial Measurement Unit provides the roll, pitch and yaw accelerations and rates along with the roll and pitch. The 100400 mini-air data boom from spaceage control provides the airspeed, altitude, angle of attack and the side slip angles. System identification is accomplished by commanding preprogrammed inputs to the control ...


Adaptive Critic-Based Neural Network Controller For Uncertain Nonlinear Systems With Unknown Deadzones, Pingan He, Jagannathan Sarangapani, S. N. Balakrishnan Jan 2002

Adaptive Critic-Based Neural Network Controller For Uncertain Nonlinear Systems With Unknown Deadzones, Pingan He, Jagannathan Sarangapani, S. N. Balakrishnan

Electrical and Computer Engineering Faculty Research & Creative Works

A multilayer neural network (NN) controller in discrete-time is designed to deliver a desired tracking performance for a class of nonlinear systems with input deadzones. This multilayer NN controller has an adaptive critic NN architecture with two NNs for compensating the deadzone nonlinearity and a third NN for approximating the dynamics of the nonlinear system. A reinforcement learning scheme in discrete-time is proposed for the adaptive critic NN deadzone compensator, where the learning is performed based on a certain performance measure, which is supplied from a critic. The adaptive generating NN rejects the errors induced by the deadzone whereas a ...


Convergence Analysis Of Adaptive Critic Based Optimal Control, S. N. Balakrishnan, Xin Liu Jan 2000

Convergence Analysis Of Adaptive Critic Based Optimal Control, S. N. Balakrishnan, Xin Liu

Mechanical and Aerospace Engineering Faculty Research & Creative Works

Adaptive critic based neural networks have been found to be powerful tools in solving various optimal control problems. The adaptive critic approach consists of two neural networks which output the control values and the Lagrangian multipliers associated with optimal control. These networks are trained successively and when the outputs of the two networks are mutually consistent and satisfy the differential constraints, the controller network output produces optimal control. In this paper, we analyze the mechanics of convergence of the network solutions. We establish the necessary conditions for the network solutions to converge and show that the converged solution is optimal.


A Recursive Least Squares Training Algorithm For Multilayer Recurrent Neural Networks, Q. Xu, K. Krishnamurthy, Bruce M. Mcmillin, Wen Feng Lu Jun 1994

A Recursive Least Squares Training Algorithm For Multilayer Recurrent Neural Networks, Q. Xu, K. Krishnamurthy, Bruce M. Mcmillin, Wen Feng Lu

Mechanical and Aerospace Engineering Faculty Research & Creative Works

Recurrent neural networks have the potential to perform significantly better than the commonly used feedforward neural networks due to their dynamical nature. However, they have received less attention because training algorithms/architectures have not been well developed. In this study, a recursive least squares algorithm to train recurrent neural networks with an arbitrary number of hidden layers is developed. The training algorithm is developed as an extension of the standard recursive estimation problem. Simulated results obtained for identification of the dynamics of a nonlinear dynamical system show promising results.


Planning And Control Of A Robotic Manipulator Using Neural Networks, Xavier J. R. Avula, Heng Ma, Anil Malkani, Jay-Shinn Tsai, Luis C. Rabelo Jan 1992

Planning And Control Of A Robotic Manipulator Using Neural Networks, Xavier J. R. Avula, Heng Ma, Anil Malkani, Jay-Shinn Tsai, Luis C. Rabelo

Chemical and Biochemical Engineering Faculty Research & Creative Works

An architecture which utilizes two artificial neural systems for planning and control of a robotic arm is presented. The first neural network system participates in the trajectory planning and the motion decision-making process. The second neural network system provides the correct sequence of control actions with a high accuracy due to the utilization of an unsupervised/supervised neural network scheme. The utilization of a hybrid hierarchical/distributed organization, supervised/unsupervised learning models, and forward modeling yielded an architecture with capabilities of high level functionality.