University of British Columbia
Deblurring neural radiance fields by modeling camera imperfections and using RGB-event stereo
Abstract
dc:descriptionNeural radiance fields (NeRF) have brought progress in rendering photorealistic 3D reconstruction. However, it requires clear images with correct camera poses. To address this problem, we propose to model camera imperfections that arise from the simple pinhole camera model and combine RGB images with event camera data in a stereo setup. Specifically, compared to conventional approaches that enforce physical priors on a camera model, we model measurement variation across the exposure time using embeddings using a data-driven approach. To incorporate event data into the NeRF pipeline, we propose a learnable mapper that bridges the event camera measurement space with that of the RGB camera. To validate our method, we collected our own high-resolution RGB and event stereo dataset. For further validation, we utilize the EVIMOv2 dataset consisting of limited indoor scenes.
Degree
thesis:*- Name thesis:degree_name
- Master of Science - MSc
- Level thesis:degree_level
- master's
- Discipline thesis:degree_discipline
- Computer Science
- Grantor dc:publisher
- University of British Columbia
- Year dc:date
- 2024
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Tang , Wei Zhi
- Contributors dc:contributor
-
- Yi, Kwang Moo
Rights
dc:rights- Statement dc:rights
-
- Attribution 4.0 International
- Language dc:language
- eng
Identifiers
dc:identifier.*- Handle dc:identifier
- http://hdl.handle.net/2429/89208