Open Access. Powered by Scholars. Published by Universities.®

Robotics Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 2 of 2

Full-Text Articles in Robotics

A Memory Efficient Deep Recurrent Q-Learning Approach For Autonomous Wildfire Surveillance, Jeremy A. Cantor Jan 2024

A Memory Efficient Deep Recurrent Q-Learning Approach For Autonomous Wildfire Surveillance, Jeremy A. Cantor

UNF Graduate Theses and Dissertations

Previous literature demonstrates that autonomous UAVs (unmanned aerial vehicles) have the po- tential to be utilized for wildfire surveillance. This advanced technology empowers firefighters by providing them with critical information, thereby facilitating more informed decision-making processes. This thesis applies deep Q-learning techniques to the problem of control policy design under the objective that the UAVs collectively identify the maximum number of locations that are under fire, assuming the UAVs can share their observations. The prohibitively large state space underlying the control policy motivates a neural network approximation, but prior work used only convolutional layers to extract spatial fire information from …


Transformer-Enabled Deep Reinforcement Learning For Coverage Path Planning, Daniel B. Tiu Jan 2024

Transformer-Enabled Deep Reinforcement Learning For Coverage Path Planning, Daniel B. Tiu

UNF Graduate Theses and Dissertations

Coverage path planning (CPP) is the problem of covering all points in an environment and is a well-researched topic in robotics due to its sheer practical relevance. This paper investigates such an offline CPP problem where the primary objective is to minimize the path length to achieve complete coverage. Furthermore, the literature suggests that taking turns leads to a higher energy use than going straight. To this end, we design a novel objective function that aims to minimize the number of turns as well. We have proposed a deep reinforcement learning (DRL)-based framework that uses a Transformer model. Unlike state-of-the-art …