Back to search

Clemson University

Real-Time Motion Augmentation and Synthesis for Animating the Hands and Eyes of Virtual Humans and Avatars

Abstract

dc:description.abstract

Virtual Reality (VR) enables users to interact within virtual worlds via an embodied virtual representation of themselves called an “avatar”. Because avatars are essential for immersive experiences, it is important to consider how altering or augmenting avatar motion affects virtual experiences. This dissertation aims to improve virtual experiences by addressing some of the many challenges in animating avatars and virtual humans. In our first study, we addressed the lack of tactile feedback during virtual grasping by using visual feedback techniques. We augmented the avatar’s hand motion to remain outside virtual objects (“outer hand”) even when the user’s hand penetrated them. Our study revealed that while this reduced grasping performance, users preferred it over allowing hand penetration. Our second study incorporated auditory feedback alongside visual feedback to examine its impact on interaction performance and ownership. Despite a decrease in performance, users preferred the addition of audio feedback. Gaze behavior plays an important role in avatar-mediated communication. Therefore, we developed a model to synthesize eye motion during two-party conversations in VR using audio and head movement data. We conducted a user study with results that provide insight into expected conversational gaze behavior, as well as the complexities of animating untracked motion. Finally, we explored motion synthesis for applications requiring precise hand movements, such as guitar playing, a skill requiring precision in both movement and timing. We developed a model that synthesizes fretting hand animation for guitar using annotated music. Applications include virtual concerts, music instruction, and other dexterous tasks beyond music.

Degree

thesis:*
Name thesis:degree_name
Doctor of Philosophy (PhD)
Level thesis:degree_level
Dissertation
Discipline thesis:degree_discipline
Computer Science

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Canales, Ryan
Contributors dc:contributor
  • Andrew Duchowski
  • Sophie Jörg
  • Andrew Robb
  • Sabarish Babu

Subjects

dc:subject × 7

Identifiers

dc:identifier.*
Repository record dc:identifier
https://open.clemson.edu/all_dissertations/3801

Chain of custody

source
Harvested from
Clemson University
Base URL
open.clemson.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Canales, Ryan. Real-Time Motion Augmentation and Synthesis for Animating the Hands and Eyes of Virtual Humans and Avatars. Dissertation thesis, https://open.clemson.edu/all_dissertations/3801