Open Access. Powered by Scholars. Published by Universities.®

Mechanical Engineering Commons

Open Access. Powered by Scholars. Published by Universities.®

Michigan Technological University

Series

Michigan Tech Publications

2019

Autonomous underwater vehicle

Articles 1 - 1 of 1

Full-Text Articles in Mechanical Engineering

Docking Control Of An Autonomous Underwater Vehicle Using Reinforcement Learning, Enrico Anderlini, Gordon Parker, Giles Thomas Aug 2019

Docking Control Of An Autonomous Underwater Vehicle Using Reinforcement Learning, Enrico Anderlini, Gordon Parker, Giles Thomas

Michigan Tech Publications

To achieve persistent systems in the future, autonomous underwater vehicles (AUVs) will need to autonomously dock onto a charging station. Here, reinforcement learning strategies were applied for the first time to control the docking of an AUV onto a fixed platform in a simulation environment. Two reinforcement learning schemes were investigated: one with continuous state and action spaces, deep deterministic policy gradient (DDPG), and one with continuous state but discrete action spaces, deep Q network (DQN). For DQN, the discrete actions were selected as step changes in the control input signals. The performance of the reinforcement learning strategies was compared …