Abstract
dc:descriptionDeep reinforcement learning (DRL) offers a promising approach for the synthesis of control policies for legged robots locomotion. However, it remains challenging to learn policies that are robust to uncertainty in the real world to put on physical robots or policies that can handle complicated environments. In this thesis, we take several significant steps towards efficiently learning legged locomotion skills with DRL. First, we present a framework to learn feedback policies for a bipedal robotCassie, utilizing rough motion sketches. An iterative design process is then proposed to refine, compress and combine policies for effective sim-to-real transfer. Second, we explore the role of dynamics randomization on a quadrupedal robotLaikago. We demonstrate that with appropriate design choices, dynamics randomization is often not necessary for sim-to-real. We further analyze situations that randomization would become necessary. Third, we propose and analyze multiple curriculum learning approaches to solve the challenging stepping stone tasks for bipedal locomotion. We demonstrate that gradually increasing task difficulties can reliably train policies that solve challenging stepping stone sequences. Finally, we investigate the combination of reinforcement learning and model-based control by training quadrupedal policies using a centroidal model. [An errata to this thesis/dissertation was made available on 2022-02-09.]
Degree
thesis:*- Name thesis:degree_name
- Doctor of Philosophy - PhD
- Level thesis:degree_level
- doctoral
- Discipline thesis:degree_discipline
- Computer Science
- Grantor dc:publisher
- University of British Columbia
- Year dc:date
- 2021
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Xie, Zhaoming
- Contributors dc:contributor
-
- Van de Panne, M. (Michiel), 1965-
Rights
dc:rights- Statement dc:rights
-
- Attribution-NonCommercial-NoDerivatives 4.0 International
- Language dc:language
- eng
Identifiers
dc:identifier.*- Handle dc:identifier
- http://hdl.handle.net/2429/80396