University of British Columbia
Smart dynamic trajectory planning of autonomous underwater vehicles using reinforcement learning and historical data
Abstract
dc:descriptionUnderwater wireless sensors are essential in ocean studies and applications, providing continuous monitoring and recording of critical data. Their remote operation over extended periods requires energy-efficient designs, and one major challenge is collecting data from these sensors, as long-range communication increases energy consumption. Furthermore, unlike terrestrial GPS, the lack of reliable localization underwater means the exact locations of these sensors are initially unknown. Autonomous Underwater Vehicles (AUVs) play a crucial role in detecting and retrieving data from these sensors. To achieve this, intelligent AUVs must dynamically plan their trajectories based on current detection information, aiming to collect as much data as possible from wireless networks. In this thesis, we first mathematically examine the AUV dynamic trajectory planning problem. Recognizing the inherent challenges, we propose methods to improve upon existing approaches by incorporating historical AUV data into real-time decision-making. Two trajectory planning methods are introduced, with the second utilizing Deep Reinforcement Learning (DRL) to optimize path planning. Simulation results show promising improvements over prior methods, significantly narrowing the gap between dynamic trajectory planning and the upper bounds of ideal methods under strong assumptions.
Degree
thesis:*- Name thesis:degree_name
- Master of Applied Science - MASc
- Level thesis:degree_level
- master's
- Discipline thesis:degree_discipline
- Electrical Engineering
- Grantor dc:publisher
- University of British Columbia
- Year dc:date
- 2024
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Amanitehrani, Mahdi
- Contributors dc:contributor
-
- Cheng, Julian
Rights
dc:rights- Statement dc:rights
-
- Attribution-NonCommercial-NoDerivatives 4.0 International
- Language dc:language
- eng
Identifiers
dc:identifier.*- Handle dc:identifier
- http://hdl.handle.net/2429/89670