Back to search

Georgia Institute of Technology

Improving Learning from Demonstration in Real-World Scenarios

Abstract

dc:description.abstract

To realize a vision of assistive robots in the home (e.g., care robots for older adults), robots will need the ability to learn new skills and adapt to their users and environment. Every home has a different layout, everyone has differing preferences and needs, and people's preferences and needs will change over time as they age. One solution to this challenge is Learning from Demonstration (LfD), a paradigm that enables novice end-users to teach robots new skills based on human demonstrations of a task. However, LfD is not foolproof. The real-world presents challenges from suboptimal teachers, communication errors, and unstructured environments. In this thesis, I aim to develop improvements to LfD to account for robot failure, teacher suboptimality, and target end-users. First, I conduct multiple human-subjects experiments to evaluate human perceptions of LfD across the general population and target end-users for assistive robots. I assess how people perceive different robot learning algorithms with the general and a target population of caregivers. Then I evaluate a person's perceptions of robot failure when the person is the one teaching the robot via LfD. Lastly, I compare perceptions of teaching a robot via LfD across a population of older and younger adults. Based on these findings, I develop a set of design guidelines and highlight current barriers for real-world deployment of LfD with non-expert users. One real-world challenge is that robot failure can occur due to demonstrator suboptimality. I develop a novel architecture, Mutual Information-Driven Meta-Learning from Demonstration (MIND MELD) to learn from suboptimal demonstrators' feedback. Then I contribute a method, Reciprocal MIND MELD, to enable a robot to provide feedback to a human to reduce suboptimality in a human demonstrator. Another barrier for LfD is that end-users need more feedback from the robot during failure. I create a framework that Learns Interpretable Features from Interventions (LIFI). Users can intervene the robot when the robot is making a mistake, and the robot will communicate a human intelligible feature representing the robot's understanding of its own failure. The robot then updates its policy to correctly perform the task.

Degree

thesis:*
Level thesis:degree_level
Doctoral
Department dc:contributor.department
Interactive Computing
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2024

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Botti, Erin Kathleen-Hedlund
Advisor dc:contributor.advisor
  • Gombolay, Matthew
Committee members dc:contributor.committeemember
  • Chernova, Sonia
  • Kemp, Charlie
  • Rozga, Agata
  • Cakmak, Maya

Subjects

dc:subject × 3

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1853/77732

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Botti, Erin Kathleen-Hedlund. Improving Learning from Demonstration in Real-World Scenarios. Doctoral thesis, Georgia Institute of Technology, 2024. https://hdl.handle.net/1853/77732