University of North Florida. School of Computing
Transformer-enabled deep reinforcement learning for coverage path planning
Abstract
dc:description.abstractCoverage path planning (CPP) is the problem of covering all points in an environment and is a well-researched topic in robotics due to its sheer practical relevance. This paper investigates such an offline CPP problem where the primary objective is to minimize the path length to achieve complete coverage. Furthermore, the literature suggests that taking turns leads to a higher energy use than going straight. To this end, we design a novel objective function that aims to minimize the number of turns as well. We have proposed a deep reinforcement learning (DRL)-based framework that uses a Transformer model. Unlike state-of-the-art reinforcement learning-based CPP solutions that primarily use convolutional neural networks, Transformers need a minimal number of inductive biases for their design. We tested our proposed Transformer-based DRL framework on seven 8x8 environments with varying numbers and shapes of obstacles under fully and partially observable settings. Experimental results show that our proposed solution outperforms Breadth-first search coverage solutions in terms of the number of steps and turns needed to yield 100% coverage. Furthermore, when compared to a comparable deep Q-network-based CPP technique that uses a convolutional neural network, our proposed approach always converges to higher coverage percentages and lower turn counts.
Degree
thesis:*- Name thesis:degree_name
- Master of Science in Computer and Information Sciences (MS)
- Discipline thesis:degree_discipline
- Computing
- Grantor
- University of North Florida. School of Computing
- Date dc:date.issued
- Spring
Author and committee
dc:creator, dc:contributor.*- Authors dc:creator
-
- Tiu, Daniel B
- Tiu, Daniel, 1990-
- Advisors dc:contributor.advisor
-
- Dutta, Ayan
- Ghosh, Anirban
- Kreidl, O. Patrick
- Contributors dc:contributor
-
- Ayan Dutta, Ph.D
- Anirban Ghosh, Ph.D
- O. Patrick Kreidl, Ph.D
Subjects
dc:subject × 12- Thesis
- University of North Florida
- UNF
- Dissertations, Academic -- UNF -- Master of Science in Computer and Information Sciences
- Dissertations, Academic -- UNF -- Computing
- Robotic Systems
- Modeling of Autonomous Systems
- Deep Reinforcement Learning
- Artificial Intelligence and Robotics
- Data Science
- Robotics
- Deep learning (Machine learning) -- Industrial applications -- Testing; Reinforcement learning -- Industrial applications -- Testing; Neural networks (Computer science) -- Industrial applications -- Testing; Artificial intelligence -- Industrial applications -- Testing; Trajectory optimization -- Technological innovations -- Testing; Trajectory optimization -- Forecasting -- Planning
Rights
dc:rightsIdentifiers
dc:identifier.*- Repository record dc:identifier
- https://digitalcommons.unf.edu/etd/1256