Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 10 of 10
Full-Text Articles in Engineering
Reinforcement Learning Based Dual-Control Methodology For Complex Nonlinear Discrete-Time Systems With Application To Spark Engine Egr Operation, Peter Shih, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier
Reinforcement Learning Based Dual-Control Methodology For Complex Nonlinear Discrete-Time Systems With Application To Spark Engine Egr Operation, Peter Shih, Brian C. Kaul, Jagannathan Sarangapani, J. A. Drallmeier
Electrical and Computer Engineering Faculty Research & Creative Works
A novel reinforcement-learning-based dual-control methodology adaptive neural network (NN) controller is developed to deliver a desired tracking performance for a class of complex feedback nonlinear discrete-time systems, which consists of a second-order nonlinear discrete-time system in nonstrict feedback form and an affine nonlinear discrete-time system, in the presence of bounded and unknown disturbances. For example, the exhaust gas recirculation (EGR) operation of a spark ignition (SI) engine is modeled by using such a complex nonlinear discrete-time system. A dual-controller approach is undertaken where primary adaptive critic NN controller is designed for the nonstrict feedback nonlinear discrete-time system whereas the secondary …
Adaptive Critic Design Based Neuro-Fuzzy Controller For A Static Compensator In A Multimachine Power System, Salman Mohagheghi, Ganesh K. Venayagamoorthy, Ronald G. Harley
Adaptive Critic Design Based Neuro-Fuzzy Controller For A Static Compensator In A Multimachine Power System, Salman Mohagheghi, Ganesh K. Venayagamoorthy, Ronald G. Harley
Electrical and Computer Engineering Faculty Research & Creative Works
This paper presents a novel nonlinear optimal controller for a static compensator (STATCOM) connected to a power system, using artificial neural networks and fuzzy logic. The action dependent heuristic dynamic programming, a member of the adaptive Critic designs family, is used for the design of the STATCOM neuro-fuzzy controller. This neuro-fuzzy controller provides optimal control based on reinforcement learning and approximate dynamic programming. Using a proportional-integrator approach the proposed controller is capable of dealing with actual rather than deviation signals. The STATCOM is connected to a multimachine power system. Two multimachine systems are considered in this study: a 10-bus system …
Adaptive Critic Designs For Optimal Control Of Power Systems, Ganesh K. Venayagamoorthy, Ronald G. Harley
Adaptive Critic Designs For Optimal Control Of Power Systems, Ganesh K. Venayagamoorthy, Ronald G. Harley
Electrical and Computer Engineering Faculty Research & Creative Works
The increasing complexity of the modern power grid highlights the need for advanced modeling and control techniques for effective control of excitation, turbine and flexible AC transmission systems (FACTS). The crucial factors affecting the modern power systems today is voltage and load flow control. Simulation studies in the PSCAD/EMTDC environment and realtime laboratory experimental studies carried out are described and the results show the successful control of the power system elements and the entire power system with adaptive and optimal neurocontrol schemes. Performances of the neurocontrollers are compared with the conventional PI controllers for damping under different operating conditions for …
Comparison Of Non-Uniform Optimal Quantizer Designs For Speech Coding With Adaptive Critics And Particle Swarm, Wenwei Zha, Ganesh K. Venayagamoorthy
Comparison Of Non-Uniform Optimal Quantizer Designs For Speech Coding With Adaptive Critics And Particle Swarm, Wenwei Zha, Ganesh K. Venayagamoorthy
Electrical and Computer Engineering Faculty Research & Creative Works
This paper presents the design of a companding non-uniform optimal scalar quantizer for speech coding. The quantizer is designed using two neural networks to perform the nonlinear transformation. These neural networks are used in the front and back ends of a uniform quantizer. Two approaches are presented in this paper namely adaptive critic designs (ACD) and particle swarm optimization (PSO), aiming to maximize the signal to noise ratio (SNR). The comparison of these optimal quantizer designs over bit rate range of 3 to 6 is presented. The perceptual quality of the coding is evaluated by the International Telecommunication Union''s Perceptual …
Evolutionary Algorithms, Markov Decision Processes, Adaptive Critic Designs, And Clustering: Commonalities, Hybridization And Performance, Donald C. Wunsch, Samuel A. Mulder
Evolutionary Algorithms, Markov Decision Processes, Adaptive Critic Designs, And Clustering: Commonalities, Hybridization And Performance, Donald C. Wunsch, Samuel A. Mulder
Electrical and Computer Engineering Faculty Research & Creative Works
We briefly review and compare the mathematical formulation of Markov decision processes (MDP) and evolutionary algorithms (EA). In so doing, we observe that the adaptive critic design (ACD) approach to MDP can be viewed as a special form of EA. This leads us to pose pertinent questions about possible expansions of the methodology of ACD. This expansive view of EA is not limited to ACD. We discuss how it is possible to consider the powerful chained Lin Kernighan (chained LK) algorithm for the traveling salesman problem (TSP) as a degenerate case of EA. Finally, we review some recent TSP results, …
Adaptive Critic Designs And Their Implementations On Different Neural Network Architectures, Jung-Wook Park, Ganesh K. Venayagamoorthy, Ronald G. Harley
Adaptive Critic Designs And Their Implementations On Different Neural Network Architectures, Jung-Wook Park, Ganesh K. Venayagamoorthy, Ronald G. Harley
Electrical and Computer Engineering Faculty Research & Creative Works
The design of nonlinear optimal neurocontrollers based on the Adaptive Critic Designs (ACDs) family of algorithms has recently attracted interest. This paper presents a summary of these algorithms, and compares their performance when implemented on two different types of artificial neural networks, namely the multilayer perceptron neural network (MLPNN) and the radial basis function neural network (RBFNN). As an example for the application of the ACDs, the control of synchronous generator on an electric power grid is considered and results are presented to compare the different ACD family members and their implementations on different neural network architectures.
Neurocontroller Alternatives For "Fuzzy" Ball-And-Beam Systems With Nonuniform Nonlinear Friction, Danil V. Prokhorov, Donald C. Wunsch, Paul H. Eaton
Neurocontroller Alternatives For "Fuzzy" Ball-And-Beam Systems With Nonuniform Nonlinear Friction, Danil V. Prokhorov, Donald C. Wunsch, Paul H. Eaton
Electrical and Computer Engineering Faculty Research & Creative Works
The ball-and-beam problem is a benchmark for testing control algorithms. Zadeh proposed (1994) a twist to the problem, which, he suggested, would require a fuzzy logic controller. This experiment uses a beam, partially covered with a sticky substance, increasing the difficulty of predicting the ball's motion. We complicated this problem even more by not using any information concerning the ball's velocity. Although it is common to use the first differences of the ball's consecutive positions as a measure of velocity and explicit input to the controller, we preferred to exploit recurrent neural networks, inputting only consecutive positions instead. We have …
Dynamic Re-Optimization Of A Fed-Batch Fermentor Using Heuristic Dynamic Programming, Donald C. Wunsch, M. S. Iyer
Dynamic Re-Optimization Of A Fed-Batch Fermentor Using Heuristic Dynamic Programming, Donald C. Wunsch, M. S. Iyer
Electrical and Computer Engineering Faculty Research & Creative Works
Traditionally, fed-batch biochemical process optimization and control uses complicated theoretical off-line optimizers, with no online model adaptation or re-optimization. This study demonstrates the applicability, effectiveness, and economic potential of a simple phenomenological model for modeling, and an adaptive critic design, heuristic dynamic programming, for online re-optimization and control of an aerobic fed-batch fermentor. The results are compared with those obtained using a heuristic random optimizer
Fed-Batch Dynamic Optimization Using Generalized Dual Heuristic Programming, Donald C. Wunsch, M. S. Iyer
Fed-Batch Dynamic Optimization Using Generalized Dual Heuristic Programming, Donald C. Wunsch, M. S. Iyer
Electrical and Computer Engineering Faculty Research & Creative Works
Traditionally fed-batch biochemical process optimization and control uses complicated theoretical off-line optimizers, with no online model adaptation or re-optimization. This study demonstrates the applicability, effectiveness, and economic potential of a simple phenomenological model for modeling, and an adaptive critic design, generalized dual heuristic programming, for online re-optimization and control of an aerobic fed-batch fermentor. The results are compared with those obtained using a heuristic random optimizer
Adaptive Critic Design In Learning To Play Game Of Go, R. Zaman, Danil V. Prokhorov, Donald C. Wunsch
Adaptive Critic Design In Learning To Play Game Of Go, R. Zaman, Danil V. Prokhorov, Donald C. Wunsch
Electrical and Computer Engineering Faculty Research & Creative Works
This paper examines the performance of an HDP-type adaptive critic design (ACD) of the game Go. The game Go is an ideal problem domain for exploring machine learning; it has simple rules but requires complex strategies to play well. All current commercial Go programs are knowledge based implementations; they utilize input feature and pattern matching along with minimax type search techniques. But the extremely high branching factor puts a limit on their capabilities, and they are very weak compared to the relative strengths of other game programs like chess. In this paper, the Go-playing ACD consists of a critic network …