Back to search

NJIT

Autonomous exploration of an environment with static obstacles using a ppo agent

Abstract

dc:description.abstract

<p>Research in autonomous exploration has created many effective algorithms that have been tested and proven to work in many different virtual and physical environments. Many optimizations have also been developed to reduce computational effort and increase exploration speed.</p><p>However, despite optimizations, these algorithms can still require considerable computational effort and time to explore even small environments. To obtain further improvements in computation and exploration speed, a reinforcement learning agent using actor-critic style proximal policy optimization (PPO) is trained to explore various environments efficiently, then compared to an algorithm using contemporary exploration methods.</p><p>Testing is performed in virtual environments with ideal sensor data, then in physical environments by reconstructing virtual environment layouts in the real-world. Virtual results show the agent's computation and exploration speed is much faster than the baseline algorithm while still being move efficient, but physical results reveal the agent's weakness to noisy environments caused by external factors like LiDAR noise, positional drift, rotational drift, map distortion, etc.. The agent could not be trained on these factors in time for this paper.</p>

Degree

thesis:*
Name thesis:degree_name
Master of Science in Electrical Engineering - (M.S.)
Discipline thesis:degree_discipline
Electrical and Computer Engineering

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Knight, Brandon
Contributors dc:contributor
  • Arnob Ghosh
  • Adeel Akhtar
  • MengChu Zhou

Subjects

dc:subject × 3

Identifiers

dc:identifier.*
Repository record dc:identifier
https://digitalcommons.njit.edu/theses/3552

Chain of custody

source
Harvested from
NJIT
Base URL
digitalcommons.njit.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Knight, Brandon. Autonomous exploration of an environment with static obstacles using a ppo agent. https://digitalcommons.njit.edu/theses/3552