Back to search

University of Minnesota

Spatial Action Maps Augmented with Visit Frequency Maps for Exploration Tasks

Abstract

dc:description.abstract

Reinforcement learning has been widely applied in exploration, navigation, manipulation, and other fields. Most of the relevant techniques generate kinematic commands (e.g., move, stop, turn) for agents based on the current state information. However, recent dense action representations based research, such as spatial action maps, pointing way-points to the agent in the same domain as its observation of the state shows great promise in mobile manipulation tasks. Inspired by that, we make the first step towards using a spatial action maps based method to effectively explore novel environmental spaces. To reduce the chance of redundant exploration, the visit frequency map (VFM) and its corresponding reward function are introduced to direct the agent to actively search previously unexplored areas. In the experimental section, our work was compared to the same method without VFM and the method based on traditional steering commands with the same input data in various environments. The results show conclusively that our method is more efficient than other methods.

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Wang, Zixing

Subjects

dc:subject × 4

Rights

Language dc:language.iso
en

Identifiers

dc:identifier.*
Dc Identifier Citation
Wang, Zixing. (2021). Spatial Action Maps Augmented with Visit Frequency Maps for Exploration Tasks. Retrieved from the University Digital Conservancy, https://hdl.handle.net/11299/226342.

Chain of custody

source
Harvested from
University of Minnesota
Base URL
conservancy.umn.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Wang, Zixing. Spatial Action Maps Augmented with Visit Frequency Maps for Exploration Tasks. 2021. https://hdl.handle.net/11299/226342