Back to results

Georgia Institute of Technology

Improving Sparse Reward Classifiers for Model-Based Reinforcement Learning in Low-Data Regimes

Abstract

dc:description.abstract

Model-Based Reinforcement Learning consists of learning a model of an environment in which we can train an agent. This approach is useful when we are limited in the number of interactions the agent can take with the environment: learning a model enables to simulate additional interactions. However, when dealing with sparse-reward environments, teaching the model when to deliver rewards can be challenging: the model is built upon few interactions, of which only a small subset contains rewards. In this work, I show that different training methods involving the decoupling of the model’s reward classifier from its transition estimator considerably improves the performance and robustness in sparse-reward, low-data regimes. Additionally, I propose modifications to SimPLe [1] a model-based algorithm, and show that they increase its performance for this setup. Finally, I further improve these results by leveraging the model-based setup, in particular I introduce Model-Based Aware Reward Classification (MBARC), a training method that weighs training examples based on how close they are temporally from a reward.

Degree

thesis:*
Level thesis:degree_level
Masters
Department dc:contributor.department
Computer Science
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2021

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Schillaci, Thomas
Advisor dc:contributor.advisor
  • Kira, Zsolt
Committee members dc:contributor.committeemember
  • Batra, Dhruv
  • Ha, Sehoon

Subjects

dc:subject × 5

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
http://hdl.handle.net/1853/66473

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Schillaci, Thomas. Improving Sparse Reward Classifiers for Model-Based Reinforcement Learning in Low-Data Regimes. Masters thesis, Georgia Institute of Technology, 2021. http://hdl.handle.net/1853/66473