Back to search

University of North Florida. School of Computing

Transformer-enabled deep reinforcement learning for coverage path planning

Abstract

dc:description.abstract

Coverage path planning (CPP) is the problem of covering all points in an environment and is a well-researched topic in robotics due to its sheer practical relevance. This paper investigates such an offline CPP problem where the primary objective is to minimize the path length to achieve complete coverage. Furthermore, the literature suggests that taking turns leads to a higher energy use than going straight. To this end, we design a novel objective function that aims to minimize the number of turns as well. We have proposed a deep reinforcement learning (DRL)-based framework that uses a Transformer model. Unlike state-of-the-art reinforcement learning-based CPP solutions that primarily use convolutional neural networks, Transformers need a minimal number of inductive biases for their design. We tested our proposed Transformer-based DRL framework on seven 8x8 environments with varying numbers and shapes of obstacles under fully and partially observable settings. Experimental results show that our proposed solution outperforms Breadth-first search coverage solutions in terms of the number of steps and turns needed to yield 100% coverage. Furthermore, when compared to a comparable deep Q-network-based CPP technique that uses a convolutional neural network, our proposed approach always converges to higher coverage percentages and lower turn counts.

Degree

thesis:*
Name thesis:degree_name
Master of Science in Computer and Information Sciences (MS)
Discipline thesis:degree_discipline
Computing
Grantor
University of North Florida. School of Computing
Date dc:date.issued
Spring

Author and committee

dc:creator, dc:contributor.*
Authors dc:creator
  • Tiu, Daniel B
  • Tiu, Daniel, 1990-
Advisors dc:contributor.advisor
  • Dutta, Ayan
  • Ghosh, Anirban
  • Kreidl, O. Patrick
Contributors dc:contributor
  • Ayan Dutta, Ph.D
  • Anirban Ghosh, Ph.D
  • O. Patrick Kreidl, Ph.D

Subjects

dc:subject × 12

Rights

dc:rights

Identifiers

dc:identifier.*
Repository record dc:identifier
https://digitalcommons.unf.edu/etd/1256

Chain of custody

source
Harvested from
University of North Florida
Base URL
digitalcommons.unf.edu/do/oai/
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

Tiu, Daniel B; Tiu, Daniel, 1990-. Transformer-enabled deep reinforcement learning for coverage path planning. University of North Florida. School of Computing, https://digitalcommons.unf.edu/etd/1256