University of North Florida. School of Computing
Robotic gas source localization and distribution mapping via deep reinforcement learning
Abstract
dc:description.abstractThis research aims to advance the fields of Gas Source Localization (GSL) and Gas Distribution Mapping (GDM) by developing deep reinforcement learning (DRL) methodologies suitable for complex, real-world environments. GSL and GDM are crucial for applications such as environmental monitoring, hazardous material detection, and search-and-rescue missions, where safe and efficient exploration is essential. Traditional methods often fall short in dynamic settings influenced by factors like wind and obstacles. To address these limitations, this study proposes novel neural network architectures and learning frameworks for adaptive exploration and mapping, integrating Convolutional Neural Networks (CNN), Long Short-Term Memory (LSTM) layers, and Deep Q-Networks (DQN). The research explores the use of DRL in single robot scenarios to enhance real-time decision-making and operational efficiency. In GSL, the study focuses on accurately tracing gas sources by leveraging temporal and spatial data to guide the robot through complex environments. For GDM, it introduces a hybrid framework combining Gaussian Process Regression (GPR) and DRL to estimate gas concentrations from sparse samples, thereby reducing computational overhead during real-time deployment. Through extensive experimentation, the research demonstrates that the proposed methods can outperform traditional greedy and random walk-based strategies. Ultimately, this work seeks to contribute robust, adaptive exploration strategies for autonomous robotic systems in dynamic, hazardous, and computationally constrained environments.
Degree
thesis:*- Name thesis:degree_name
- Master of Science in Computer and Information Sciences (MS)
- Discipline thesis:degree_discipline
- Computing
- Grantor
- University of North Florida. School of Computing
- Date dc:date.issued
- Fall
Author and committee
dc:creator, dc:contributor.*- Authors dc:creator
-
- Kulbaka, Iliya
- Kulbaka, Iliya, 2001-
- Advisors dc:contributor.advisor
-
- Dutta, Ayan
- Roy, Swapnoneel
- Kreidl, O. Patrick
- Contributors dc:contributor
-
- Ayan Dutta, Ph.D.
- Swapnoneel Roy, Ph.D.
- O. Patrick Kreidl, Ph.D.
Subjects
dc:subject × 12- Thesis
- University of North Florida
- UNF
- Dissertations, Academic -- UNF -- Master of Science in Computer and Information Sciences
- Dissertations, Academic -- UNF -- Computing
- Reinforcement Learning
- Deep Learning
- Gas Source Localization
- Gas Distribution Mapping
- Other Computer Engineering
- Robotics
- Gas leakage; Gas distribution -- Technological innovations; Hazardous substances; Deep learning (Machine learning) -- Industrial applications; Reinforcement learning -- Industrial applications; Machine learning -- Industrial applications; Deep learning (Machine learning) --Technological innovations; Reinforcement learning -- Technological innovations; Machine learning -- Technological innovations; Environmental monitoring --Technological innovations
Rights
dc:rightsIdentifiers
dc:identifier.*- Repository record dc:identifier
- https://digitalcommons.unf.edu/etd/1309