Back to search

University of North Florida. School of Engineering

A memory efficient deep recurrent Q-learning approach for autonomous wildfire surveillance

Abstract

dc:description.abstract

Previous literature demonstrates that autonomous UAVs (unmanned aerial vehicles) have the po- tential to be utilized for wildfire surveillance. This advanced technology empowers firefighters by providing them with critical information, thereby facilitating more informed decision-making processes. This thesis applies deep Q-learning techniques to the problem of control policy design under the objective that the UAVs collectively identify the maximum number of locations that are under fire, assuming the UAVs can share their observations. The prohibitively large state space underlying the control policy motivates a neural network approximation, but prior work used only convolutional layers to extract spatial fire information from the current observations. This work utilizes a network that also incorporates a recurrent module to capture temporal information from the history of observations. Experiments involving two simulated fixed-wing aircraft demonstrate that the proposed technique uses approximately 20 times less memory than the approach of prior work, while achieving comparable results in locating the fires. A secondary contribution of the experiment is the inclusion of a more realistic physics-based wildfire propagation model, in con- trast to the simplified probabilistic fire propagation models assumed in prior work. This work relies on modeling fire propagation and fuel reaction rates as a pair of partial differential equations with respect to time. A wildfire simulation with a stronger temporal dependency emphasized the importance of using a neural network architecture that can effectively integrate information over time.

Degree

thesis:*
Name thesis:degree_name
Master of Science in Electrical Engineering (MSEE)
Discipline thesis:degree_discipline
Engineering
Grantor
University of North Florida. School of Engineering
Date dc:date.issued
Spring

Author and committee

dc:creator, dc:contributor.*
Authors dc:creator
  • Cantor, Jeremy A
  • Cantor, Jeremy A., 1991-
Advisors dc:contributor.advisor
  • Kreidl, O. Patrick
  • Dutta, Ayan
  • Nuszkowski, John
  • Harris, Alan
  • Klostermeyer, William
Contributors dc:contributor
  • O. Patrick Kreidl, Ph.D.
  • Ayan Dutta, Ph.D.
  • John Nuszkowski, Ph.D.
  • Alan Harris, Ph.D.
  • William Klostermeyer, Ph.D.

Subjects

dc:subject × 8

Rights

dc:rights

Identifiers

dc:identifier.*
Repository record dc:identifier
https://digitalcommons.unf.edu/etd/1251

Chain of custody

source
Harvested from
University of North Florida
Base URL
digitalcommons.unf.edu/do/oai/
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

Cantor, Jeremy A; Cantor, Jeremy A., 1991-. A memory efficient deep recurrent Q-learning approach for autonomous wildfire surveillance. University of North Florida. School of Engineering, https://digitalcommons.unf.edu/etd/1251