Back to search

University of British Columbia

Gaussian shadow casting for neural characters

Abstract

dc:description

High-fidelity character models form an integral part in multiple domains, including visual effects, animation, gaming, telepresence, fashion, and more. Recently, approaches for learning and creating 3D animatable avatars through neural rendering have obtained impressive rendering results, even when learning from monocular video data. These neural characters, while achieving highly detailed geometry and texture reconstruction, bake lighting and shadow information into the model, leading to artifacts when generating novel views, novel poses, or when relighting the model. The highest quality models are trained on data that is uniformly lit, and will otherwise contain artifacts in the shape reconstruction if using illuminated data. Consequently, the use of these neural characters is limited and has not seen widespread adoption in the aforementioned industries. In this thesis, we address the limitations of neural character lighting, specifically shadow casting, enabling explicit and efficient light calculations while disentangling shadows in the learned texture. Our primary contributions include: 1) A framework for approximating the shape of neural characters using a sum of 3D anisotropic Gaussians; 2) The derivation of a simple analytic formula for integrating the sum of anisotropic Gaussians along a ray; 3) A framework to perform light and shadow calculations using a deferred rendering approach for easy integration on existing models. These contributions enable the training of neural characters from outdoor lit data, and the relighting of the neural characters in a wide array of environments, increasing their utility in industry.

Degree

thesis:*
Name thesis:degree_name
Master of Science - MSc
Level thesis:degree_level
master's
Discipline thesis:degree_discipline
Computer Science
Grantor dc:publisher
University of British Columbia
Year dc:date
2024

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Bolanos, Luis
Contributors dc:contributor
  • Rhodin, Helge

Rights

dc:rights
Statement dc:rights
  • Attribution-NonCommercial-ShareAlike 4.0 International
Language dc:language
eng

Identifiers

dc:identifier.*
Handle dc:identifier
http://hdl.handle.net/2429/88000

Chain of custody

source
Harvested from
University of British Columbia
Base URL
circle.library.ubc.ca/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Bolanos, Luis. Gaussian shadow casting for neural characters. master's thesis, University of British Columbia, 2024. http://hdl.handle.net/2429/88000