Open Access. Powered by Scholars. Published by Universities.®
- Discipline
- Keyword
Articles 1 - 2 of 2
Full-Text Articles in Controls and Control Theory
Cooperative Deep Q -Learning Framework For Environments Providing Image Feedback, Krishnan Raghavan, Vignesh Narayanan, Sarangapani Jagannathan
Cooperative Deep Q -Learning Framework For Environments Providing Image Feedback, Krishnan Raghavan, Vignesh Narayanan, Sarangapani Jagannathan
Publications
In this article, we address two key challenges in deep reinforcement learning (DRL) setting, sample inefficiency, and slow learning, with a dual-neural network (NN)-driven learning approach. In the proposed approach, we use two deep NNs with independent initialization to robustly approximate the action-value function in the presence of image inputs. In particular, we develop a temporal difference (TD) error-driven learning (EDL) approach, where we introduce a set of linear transformations of the TD error to directly update the parameters of each layer in the deep NN. We demonstrate theoretically that the cost minimized by the EDL regime is an approximation …
Event-Triggered Optimal Adaptive Control Of Partially Unknown Linear Continuous-Time Systems With State Delay, Rohollah Moghadam, Vignesh Narayanan, Sarangapani Jagannathan
Event-Triggered Optimal Adaptive Control Of Partially Unknown Linear Continuous-Time Systems With State Delay, Rohollah Moghadam, Vignesh Narayanan, Sarangapani Jagannathan
Publications
This paper proposes an event-triggered optimal adaptive output feedback control design approach by utilizing integral reinforcement learning (IRL) for linear time-invariant systems with state delay and uncertain internal dynamics. In the proposed approach, the general optimal control problem is formulated into the game-theoretic framework by treating the event-triggering threshold and the optimal control policy as players. A cost function is defined and a value functional, which includes the delayed system output, is considered. First, by using the value functional and applying stationarity conditions using the Hamiltonian function, the output game delay algebraic Riccati equation (OGDARE) and optimal control policy are …