Open Access. Powered by Scholars. Published by Universities.®

Systems and Communications Commons

Open Access. Powered by Scholars. Published by Universities.®

American University in Cairo

2021

Machine Learning

Articles 1 - 1 of 1

Full-Text Articles in Systems and Communications

Reinforcement Learning-Based Access Schemes In Cognitive Radio Networks, Ehab Maged Elguindy Jan 2021

Reinforcement Learning-Based Access Schemes In Cognitive Radio Networks, Ehab Maged Elguindy

Theses and Dissertations

In this thesis, we propose different MAC protocols based on three Reinforcement Learning (RL) approaches, namely Q-Learning, Deep Q-Network (DQN), and Deep Deterministic Policy Gradient (DDPG). We exploit the primary user (PU) feedback, in the form of ARQ and CQI bits, to enhance the performance of the secondary user (SU) MAC protocols. Exploiting the PU feedback information can be applied on the top of any SU sensing-based MAC protocol. Our proposed model relies on two main pillars, namely, an infinite-state Partially Observable Markov Decision Process (POMDP) to model the system dynamics besides a queuing-theoretic model for the PU queue; the …