Back to search

University of North Florida. School of Computing

Robotic gas source localization and distribution mapping via deep reinforcement learning

Abstract

dc:description.abstract

This research aims to advance the fields of Gas Source Localization (GSL) and Gas Distribution Mapping (GDM) by developing deep reinforcement learning (DRL) methodologies suitable for complex, real-world environments. GSL and GDM are crucial for applications such as environmental monitoring, hazardous material detection, and search-and-rescue missions, where safe and efficient exploration is essential. Traditional methods often fall short in dynamic settings influenced by factors like wind and obstacles. To address these limitations, this study proposes novel neural network architectures and learning frameworks for adaptive exploration and mapping, integrating Convolutional Neural Networks (CNN), Long Short-Term Memory (LSTM) layers, and Deep Q-Networks (DQN). The research explores the use of DRL in single robot scenarios to enhance real-time decision-making and operational efficiency. In GSL, the study focuses on accurately tracing gas sources by leveraging temporal and spatial data to guide the robot through complex environments. For GDM, it introduces a hybrid framework combining Gaussian Process Regression (GPR) and DRL to estimate gas concentrations from sparse samples, thereby reducing computational overhead during real-time deployment. Through extensive experimentation, the research demonstrates that the proposed methods can outperform traditional greedy and random walk-based strategies. Ultimately, this work seeks to contribute robust, adaptive exploration strategies for autonomous robotic systems in dynamic, hazardous, and computationally constrained environments.

Degree

thesis:*
Name thesis:degree_name
Master of Science in Computer and Information Sciences (MS)
Discipline thesis:degree_discipline
Computing
Grantor
University of North Florida. School of Computing
Date dc:date.issued
Fall

Author and committee

dc:creator, dc:contributor.*
Authors dc:creator
  • Kulbaka, Iliya
  • Kulbaka, Iliya, 2001-
Advisors dc:contributor.advisor
  • Dutta, Ayan
  • Roy, Swapnoneel
  • Kreidl, O. Patrick
Contributors dc:contributor
  • Ayan Dutta, Ph.D.
  • Swapnoneel Roy, Ph.D.
  • O. Patrick Kreidl, Ph.D.

Subjects

dc:subject × 12

Rights

dc:rights

Identifiers

dc:identifier.*
Repository record dc:identifier
https://digitalcommons.unf.edu/etd/1309

Chain of custody

source
Harvested from
University of North Florida
Base URL
digitalcommons.unf.edu/do/oai/
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

Kulbaka, Iliya; Kulbaka, Iliya, 2001-. Robotic gas source localization and distribution mapping via deep reinforcement learning. University of North Florida. School of Computing, https://digitalcommons.unf.edu/etd/1309