Michigan Technological University
BENCHMARKING MODEL PREDICTIVE CONTROL AND REINFORCEMENT LEARNING FOR LEGGED ROBOT LOCOMOTION
Abstract
dc:description.abstractThis research delves into the realm of quadrupedal robotics, focusing on the comparative analysis of Model Predictive Control (MPC) and Reinforcement Learning (RL) as predominant control strategies. Through the comprehensive dataset compiled and the insights derived from this analysis, this research aims to serve as a valuable resource for the legged robotics community, guiding researchers and practitioners in the selection and implementation of control strategies. The ultimate goal is to contribute to the advancement of legged robot capabilities and facilitate their successful deployment in real-world applications. In this study, we employ the Unitree Go1 quadrupedal robot as a testbed, subjecting it to a variety of conditions including different terrains and external perturbations to assess the performance of MPC and RL controllers. Our findings reveal that RL exhibits superior force rejection in scenarios involving external forces, albeit relying heavily on torque in a single joint, while MPC provides a balanced torque distribution across all joints. In stumbling scenarios, MPC outperforms RL in recovery time, although both controllers face challenges when the robot falls into a failure state. Furthermore, the generalization capabilities of RL are evaluated across different terrains, demonstrating a performance drop in slippery conditions and uneven terrains compared to flat frictional surfaces. The temporal demands of RL, encompassing optimization and training phases, are contrasted with the real-time operation and parameter flexibility of MPC.
Degree
thesis:*- Name thesis:degree_name
- Master of Science in Mechatronics (MS)
- Level thesis:degree_level
- Open Access Master's Report
- Discipline thesis:degree_discipline
- Department of Electrical and Computer Engineering
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Akki, Shivayogi
- Committee members dc:contributor.committeemember
-
- Vinh Nguyen
- Tao Liu
- Contributors dc:contributor
-
- Tan Chen
Subjects
dc:subject × 5Identifiers
dc:identifier.*- Identifier
- https://digitalcommons.mtu.edu/etdr/1677