Back to search

Georgia Institute of Technology

Generating physically based animation for multi-entity interactions using deep reinforcement learning

Abstract

dc:description.abstract

Physics-based animations offer an immersive experience for various applications such as films, video games, and virtual reality by enabling physical interactions between characters and their environments. Unlike traditional kinematic animation, physics-based animation enhances realism, allowing a character in a kitchen to dexterously handle utensils and food, or to enable accurate physical interactions in multiplayer role-playing games. However, designing controllers for these animations is challenging, as traditional methods require extensive tuning and lack agility and generality. Recent advancements in Deep Reinforcement Learning (DRL) have significantly improved the generation of complex locomotion and interaction skills, allowing for more natural and adaptable character motions. Despite these achievements, challenges remain in general physical interactions in simulations. This thesis investigates several challenging physical interaction scenarios and uses DRL to produce high-quality animations for different types of physical interactions. We first investigate a manipulation problem where a controlled tool is used to dexterously manipulate different types of amorphous non-rigid materials. We build both a fast simulation environment for amorphous materials and a training pipeline that produces control signals for a tool that manipulate the materials. We demonstrate the framework using several common manipulation tasks, including gathering materials into a pile, spreading material evenly on a flat surface, and tossing and flipping a patty in a pan. For the second type of interaction, we consider the challenge of controlling a simulated hand to perform dexterous in-hand manipulation of various types of rigid objects. We demonstrate a simulation and training pipeline that generates a hand controller capable of manipulating a rigid object by following input motion capture trajectories. Additionally, to transfer a policy to a variety of objects with different shapes, we introduce a novel curriculum learning algorithm that trains a collection of policies to reproduce the same manipulation skill on different types of objects. Lastly, we consider the scenario where a full-body character performs general physical interactions with another character or with the surrounding environment. We use a novel RL reward formulation that captures the quality of physical interaction between a controlled character and others. We demonstrate that the reward can be used to train a policy that controls a character to imitate a specific type of physical interaction with differently scaled characters while preserving the content of the interaction. We also introduce another approach that uses a two-stage training pipeline to train a single control policy that generalizes the learned motion for the character to interact with other characters. Using the new formulation, we no longer need the frame-by-frame guidance from the motion capture data during inference time, and the character is able to perform a specified physical interaction skill with other differently sized characters.

Degree

thesis:*
Level thesis:degree_level
Doctoral
Department dc:contributor.department
Interactive Computing
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2024

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Zhang, Yunbo
Advisor dc:contributor.advisor
  • Turk, Greg
Committee members dc:contributor.committeemember
  • Ha, Sehoon
  • Kemp, Charles C.
  • Ye, Yuting
  • Tan, Jie

Subjects

dc:subject × 2

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1853/76862

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Zhang, Yunbo. Generating physically based animation for multi-entity interactions using deep reinforcement learning. Doctoral thesis, Georgia Institute of Technology, 2024. https://hdl.handle.net/1853/76862