Open Access. Powered by Scholars. Published by Universities.®
- Discipline
Articles 1 - 11 of 11
Full-Text Articles in Engineering
Optimal Control Of Class Of Non-Linear Plants Using Artificial Immune Systems: Application Of The Clonal Selection Algorithm, S. A. Panimadai Ramaswamy, Ganesh K. Venayagamoorthy, S. N. Balakrishnan
Optimal Control Of Class Of Non-Linear Plants Using Artificial Immune Systems: Application Of The Clonal Selection Algorithm, S. A. Panimadai Ramaswamy, Ganesh K. Venayagamoorthy, S. N. Balakrishnan
Electrical and Computer Engineering Faculty Research & Creative Works
The function of natural immune system is to protect the living organisms against invaders/pathogens. Artificial Immune System (AIS) is a computational intelligence paradigm inspired by the natural immune system. Diverse engineering problems have been solved in the recent past using AIS. Clonal selection is one of the few algorithms that belong to the family of AIS techniques. Clonal selection algorithm is the computational implementation of the clonal selection principle. The process of affinity maturation of the immune system is explicitly incorporated in this algorithm. This paper presents the application of AIS for the optimal control of a class of non-linear …
Parameter Optimization Of Pss Based On Estimated Hessian Matrix From Trajectory Sensitivities, Jung-Wook Park, Ganesh K. Venayagamoorthy, Seung-Mook Baek
Parameter Optimization Of Pss Based On Estimated Hessian Matrix From Trajectory Sensitivities, Jung-Wook Park, Ganesh K. Venayagamoorthy, Seung-Mook Baek
Electrical and Computer Engineering Faculty Research & Creative Works
This paper describes the optimal tuning for the output limits of the power system stabilizer (PSS), which can improve the system damping performance immediately following a large disturbance. The non-smooth nonlinear parameters such as the saturation limits of the PSS cannot be tuned by the conventional methods based on linear approaches. To implement the systematic optimal tuning for the output limits of the PSS, a feedforward neural network (FFNN) is applied to the hybrid system model based on the differential-algebraic-impulsive-switched (DAIS) structure. The FFNN is firstly designed to identify the trajectory sensitivities obtained from the DAIS structure. Thereafter, it estimates …
Making The Power Grid More Intelligent, Salman Mohagheghi, Ronald G. Harley, Ganesh K. Venayagamoorthy
Making The Power Grid More Intelligent, Salman Mohagheghi, Ronald G. Harley, Ganesh K. Venayagamoorthy
Electrical and Computer Engineering Faculty Research & Creative Works
Summary form only given. This paper focuses on the applications of intelligent techniques for improving the performances of the power system controllers. Intelligent control techniques lay the foundation of the next generation of nonlinear controllers and have the advantage of further improving the controller's performance by incorporating heuristics and expert knowledge into its design. Most of these techniques are independent of any mathematical model of the power system, which proves to be a considerable advantage.
Online Reinforcement Learning-Based Neural Network Controller Design For Affine Nonlinear Discrete-Time Systems, Qinmin Yang, Jagannathan Sarangapani
Online Reinforcement Learning-Based Neural Network Controller Design For Affine Nonlinear Discrete-Time Systems, Qinmin Yang, Jagannathan Sarangapani
Electrical and Computer Engineering Faculty Research & Creative Works
In this paper, a novel reinforcement learning neural network (NN)-based controller, referred to adaptive critic controller, is proposed for general multi-input and multi- output affine unknown nonlinear discrete-time systems in the presence of bounded disturbances. Adaptive critic designs consist of two entities, an action network that produces optimal solution and a critic that evaluates the performance of the action network. The critic is termed adaptive as it adapts itself to output the optimal cost-to-go function and the action network is adapted simultaneously based on the information from the critic. In our online learning method, one NN is designated as the …
Reinforcement Learning Based Output-Feedback Control Of Nonlinear Nonstrict Feedback Discrete-Time Systems With Application To Engines, Peter Shih, Jonathan B. Vance, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier
Reinforcement Learning Based Output-Feedback Control Of Nonlinear Nonstrict Feedback Discrete-Time Systems With Application To Engines, Peter Shih, Jonathan B. Vance, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier
Electrical and Computer Engineering Faculty Research & Creative Works
A novel reinforcement-learning based output-adaptive neural network (NN) controller, also referred as the adaptive-critic NN controller, is developed to track a desired trajectory for a class of complex nonlinear discrete-time systems in the presence of bounded and unknown disturbances. The controller includes an observer for estimating states and the outputs, critic, and two action NNs for generating virtual, and actual control inputs. The critic approximates certain strategic utility function and the action NNs are used to minimize both the strategic utility function and their outputs. All NN weights adapt online towards minimization of a performance index, utilizing gradient-descent based rule. …
Near Optimal Output-Feedback Control Of Nonlinear Discrete-Time Systems In Nonstrict Feedback Form With Application To Engines, Peter Shih, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier
Near Optimal Output-Feedback Control Of Nonlinear Discrete-Time Systems In Nonstrict Feedback Form With Application To Engines, Peter Shih, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier
Electrical and Computer Engineering Faculty Research & Creative Works
A novel reinforcement-learning based output-adaptive neural network (NN) controller, also referred as the adaptive-critic NN controller, is developed to track a desired trajectory for a class of complex nonlinear discrete-time systems in the presence of bounded and unknown disturbances. The controller includes an observer for estimating states and the outputs, critic, and two action NNs for generating virtual, and actual control inputs. The critic approximates certain strategic utility function and the action NNs are used to minimize both the strategic utility function and their outputs. All NN weights adapt online towards minimization of a performance index, utilizing gradient-descent based rule. …
Optimal Neuro-Controller Synthesis For Impulse-Driven System, Xiaohua Wang, S. N. Balakrishnan
Optimal Neuro-Controller Synthesis For Impulse-Driven System, Xiaohua Wang, S. N. Balakrishnan
Mechanical and Aerospace Engineering Faculty Research & Creative Works
This paper presents a new controller design technique for systems driven with impulse inputs. Necessary conditions for optimal impulse control are derived. A neural network structure to solve the resulting equations is presented. The solution concepts are illustrated with a few example problems that exhibit increasing levels of difficulty. Two linear problems-one scalar and one vector-and a benchmark nonlinear problem-Van Der Pol oscillator-are used as case studies. Numerical results show the efficacy of the new solution process for impulse driven systems. Since the theoretical development and the design technique are free from restrictive assumptions, this technique is applicable to many …
Online Reinforcement Learning Neural Network Controller Design For Nanomanipulation, Qinmin Yang, Jagannathan Sarangapani
Online Reinforcement Learning Neural Network Controller Design For Nanomanipulation, Qinmin Yang, Jagannathan Sarangapani
Electrical and Computer Engineering Faculty Research & Creative Works
In this paper, a novel reinforcement learning neural network (NN)-based controller, referred to adaptive critic controller, is proposed for affine nonlinear discrete-time systems with applications to nanomanipulation. In the online NN reinforcement learning method, one NN is designated as the critic NN, which approximates the long-term cost function by assuming that the states of the nonlinear systems is available for measurement. An action NN is employed to derive an optimal control signal to track a desired system trajectory while minimizing the cost function. Online updating weight tuning schemes for these two NNs are also derived. By using the Lyapunov approach, …
Online Reinforcement Learning Control Of Unknown Nonaffine Nonlinear Discrete Time Systems, Qinmin Yang, Jagannathan Sarangapani
Online Reinforcement Learning Control Of Unknown Nonaffine Nonlinear Discrete Time Systems, Qinmin Yang, Jagannathan Sarangapani
Electrical and Computer Engineering Faculty Research & Creative Works
In this paper, a novel neural network (NN) based online reinforcement learning controller is designed for nonaffine nonlinear discrete-time systems with bounded disturbances. The nonaffine systems are represented by nonlinear auto regressive moving average with exogenous input (NARMAX) model with unknown nonlinear functions. An equivalent affine-like representation for the tracking error dynamics is developed first from the original nonaffine system. Subsequently, a reinforcement learning-based neural network (NN) controller is proposed for the affine-like nonlinear error dynamic system. The control scheme consists of two NNs. One NN is designated as the critic, which approximates a predefined long-term cost function, whereas an …
Near Optimal Neural Network-Based Output Feedback Control Of Affine Nonlinear Discrete-Time Systems, Qinmin Yang, Jagannathan Sarangapani
Near Optimal Neural Network-Based Output Feedback Control Of Affine Nonlinear Discrete-Time Systems, Qinmin Yang, Jagannathan Sarangapani
Electrical and Computer Engineering Faculty Research & Creative Works
In this paper, a novel online reinforcement learning neural network (NN)-based optimal output feedback controller, referred to as adaptive critic controller, is proposed for affine nonlinear discrete-time systems, to deliver a desired tracking performance. The adaptive critic design consist of three entities, an observer to estimate the system states, an action network that produces optimal control input and a critic that evaluates the performance of the action network. The critic is termed adaptive as it adapts itself to output the optimal cost-to-go function which is based on the standard Bellman equation. By using the Lyapunov approach, the uniformly ultimate boundedness …
Reinforcement Learning Based Output-Feedback Controller For Complex Nonlinear Discrete-Time Systems, Peter Shih, Jagannathan Sarangapani
Reinforcement Learning Based Output-Feedback Controller For Complex Nonlinear Discrete-Time Systems, Peter Shih, Jagannathan Sarangapani
Electrical and Computer Engineering Faculty Research & Creative Works
A novel reinforcement-learning based output-adaptive neural network (NN) controller, also referred as the adaptive-critic NN controller, is developed to track a desired trajectory for a class of complex feedback nonlinear discrete-time systems in the presence of bounded and unknown disturbances. This nonlinear discrete-time system consists of a second order system in nonstrict form and an affine nonlinear discrete-time system tightly coupled together. Two adaptive critic NN controllers are designed - primary one for the nonstrict system and the secondary one for the affine system. A Lyapunov function shows the uniformly ultimate boundedness (UUB) of the closed-loop tracking error, weight estimates …