Back to search

University of British Columbia

Reinforcement learning for legged robot locomotion

Abstract

dc:description

Deep reinforcement learning (DRL) offers a promising approach for the synthesis of control policies for legged robots locomotion. However, it remains challenging to learn policies that are robust to uncertainty in the real world to put on physical robots or policies that can handle complicated environments. In this thesis, we take several significant steps towards efficiently learning legged locomotion skills with DRL. First, we present a framework to learn feedback policies for a bipedal robotCassie, utilizing rough motion sketches. An iterative design process is then proposed to refine, compress and combine policies for effective sim-to-real transfer. Second, we explore the role of dynamics randomization on a quadrupedal robotLaikago. We demonstrate that with appropriate design choices, dynamics randomization is often not necessary for sim-to-real. We further analyze situations that randomization would become necessary. Third, we propose and analyze multiple curriculum learning approaches to solve the challenging stepping stone tasks for bipedal locomotion. We demonstrate that gradually increasing task difficulties can reliably train policies that solve challenging stepping stone sequences. Finally, we investigate the combination of reinforcement learning and model-based control by training quadrupedal policies using a centroidal model. [An errata to this thesis/dissertation was made available on 2022-02-09.]

Degree

thesis:*
Name thesis:degree_name
Doctor of Philosophy - PhD
Level thesis:degree_level
doctoral
Discipline thesis:degree_discipline
Computer Science
Grantor dc:publisher
University of British Columbia
Year dc:date
2021

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Xie, Zhaoming
Contributors dc:contributor
  • Van de Panne, M. (Michiel), 1965-

Rights

dc:rights
Statement dc:rights
  • Attribution-NonCommercial-NoDerivatives 4.0 International
Language dc:language
eng

Identifiers

dc:identifier.*
Handle dc:identifier
http://hdl.handle.net/2429/80396

Chain of custody

source
Harvested from
University of British Columbia
Base URL
circle.library.ubc.ca/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Xie, Zhaoming. Reinforcement learning for legged robot locomotion. doctoral thesis, University of British Columbia, 2021. http://hdl.handle.net/2429/80396