NJIT
Autonomous exploration of an environment with static obstacles using a ppo agent
Abstract
dc:description.abstract<p>Research in autonomous exploration has created many effective algorithms that have been tested and proven to work in many different virtual and physical environments. Many optimizations have also been developed to reduce computational effort and increase exploration speed.</p><p>However, despite optimizations, these algorithms can still require considerable computational effort and time to explore even small environments. To obtain further improvements in computation and exploration speed, a reinforcement learning agent using actor-critic style proximal policy optimization (PPO) is trained to explore various environments efficiently, then compared to an algorithm using contemporary exploration methods.</p><p>Testing is performed in virtual environments with ideal sensor data, then in physical environments by reconstructing virtual environment layouts in the real-world. Virtual results show the agent's computation and exploration speed is much faster than the baseline algorithm while still being move efficient, but physical results reveal the agent's weakness to noisy environments caused by external factors like LiDAR noise, positional drift, rotational drift, map distortion, etc.. The agent could not be trained on these factors in time for this paper.</p>
Degree
thesis:*- Name thesis:degree_name
- Master of Science in Electrical Engineering - (M.S.)
- Discipline thesis:degree_discipline
- Electrical and Computer Engineering
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Knight, Brandon
- Contributors dc:contributor
-
- Arnob Ghosh
- Adeel Akhtar
- MengChu Zhou
Subjects
dc:subject × 3Identifiers
dc:identifier.*- Repository record dc:identifier
- https://digitalcommons.njit.edu/theses/3552