Back to search

University of British Columbia

Smart dynamic trajectory planning of autonomous underwater vehicles using reinforcement learning and historical data

Abstract

dc:description

Underwater wireless sensors are essential in ocean studies and applications, providing continuous monitoring and recording of critical data. Their remote operation over extended periods requires energy-efficient designs, and one major challenge is collecting data from these sensors, as long-range communication increases energy consumption. Furthermore, unlike terrestrial GPS, the lack of reliable localization underwater means the exact locations of these sensors are initially unknown. Autonomous Underwater Vehicles (AUVs) play a crucial role in detecting and retrieving data from these sensors. To achieve this, intelligent AUVs must dynamically plan their trajectories based on current detection information, aiming to collect as much data as possible from wireless networks. In this thesis, we first mathematically examine the AUV dynamic trajectory planning problem. Recognizing the inherent challenges, we propose methods to improve upon existing approaches by incorporating historical AUV data into real-time decision-making. Two trajectory planning methods are introduced, with the second utilizing Deep Reinforcement Learning (DRL) to optimize path planning. Simulation results show promising improvements over prior methods, significantly narrowing the gap between dynamic trajectory planning and the upper bounds of ideal methods under strong assumptions.

Degree

thesis:*
Name thesis:degree_name
Master of Applied Science - MASc
Level thesis:degree_level
master's
Discipline thesis:degree_discipline
Electrical Engineering
Grantor dc:publisher
University of British Columbia
Year dc:date
2024

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Amanitehrani, Mahdi
Contributors dc:contributor
  • Cheng, Julian

Rights

dc:rights
Statement dc:rights
  • Attribution-NonCommercial-NoDerivatives 4.0 International
Language dc:language
eng

Identifiers

dc:identifier.*
Handle dc:identifier
http://hdl.handle.net/2429/89670

Chain of custody

source
Harvested from
University of British Columbia
Base URL
circle.library.ubc.ca/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Amanitehrani, Mahdi. Smart dynamic trajectory planning of autonomous underwater vehicles using reinforcement learning and historical data. master's thesis, University of British Columbia, 2024. http://hdl.handle.net/2429/89670