University of North Florida. School of Engineering
A memory efficient deep recurrent Q-learning approach for autonomous wildfire surveillance
Abstract
dc:description.abstractPrevious literature demonstrates that autonomous UAVs (unmanned aerial vehicles) have the po- tential to be utilized for wildfire surveillance. This advanced technology empowers firefighters by providing them with critical information, thereby facilitating more informed decision-making processes. This thesis applies deep Q-learning techniques to the problem of control policy design under the objective that the UAVs collectively identify the maximum number of locations that are under fire, assuming the UAVs can share their observations. The prohibitively large state space underlying the control policy motivates a neural network approximation, but prior work used only convolutional layers to extract spatial fire information from the current observations. This work utilizes a network that also incorporates a recurrent module to capture temporal information from the history of observations. Experiments involving two simulated fixed-wing aircraft demonstrate that the proposed technique uses approximately 20 times less memory than the approach of prior work, while achieving comparable results in locating the fires. A secondary contribution of the experiment is the inclusion of a more realistic physics-based wildfire propagation model, in con- trast to the simplified probabilistic fire propagation models assumed in prior work. This work relies on modeling fire propagation and fuel reaction rates as a pair of partial differential equations with respect to time. A wildfire simulation with a stronger temporal dependency emphasized the importance of using a neural network architecture that can effectively integrate information over time.
Degree
thesis:*- Name thesis:degree_name
- Master of Science in Electrical Engineering (MSEE)
- Discipline thesis:degree_discipline
- Engineering
- Grantor
- University of North Florida. School of Engineering
- Date dc:date.issued
- Spring
Author and committee
dc:creator, dc:contributor.*- Authors dc:creator
-
- Cantor, Jeremy A
- Cantor, Jeremy A., 1991-
- Advisors dc:contributor.advisor
-
- Kreidl, O. Patrick
- Dutta, Ayan
- Nuszkowski, John
- Harris, Alan
- Klostermeyer, William
- Contributors dc:contributor
-
- O. Patrick Kreidl, Ph.D.
- Ayan Dutta, Ph.D.
- John Nuszkowski, Ph.D.
- Alan Harris, Ph.D.
- William Klostermeyer, Ph.D.
Subjects
dc:subject × 8- deep learning
- reinforcement learning
- neural network
- convolutional neural network
- Artificial Intelligence and Robotics
- Other Computer Engineering
- Robotics
- Wildfire forecasting -- Technological innovations -- Testing; Wildfires -- Prevention and control -- Technological innovations -- Testing; Drone aircraft -- Industrial applications -- Testing
Rights
dc:rightsIdentifiers
dc:identifier.*- Repository record dc:identifier
- https://digitalcommons.unf.edu/etd/1251