Back to search

University of British Columbia

Structure-aware computational imaging

Abstract

dc:description

While traditional imaging systems directly measure scene properties, computational imaging systems add computation to the measurement process, allowing such systems to extract non-trivially encoded scene features. This dissertation demonstrates that exploiting structure in this process allows to even recover information that is usually considered to be completely lost. Relying on temporally and spatially convolutional structure, we extract two novel image modalities that were essentially “invisible” before: a new temporal dimension of light propagation, and a new per-pixel radial velocity dimension, both obtained using consumer Time-of-Flight cameras. These two novel types of images represent first steps toward the inversion of light transport. Specifically, we demonstrate that Non-Line-of-Sight imaging and imaging in scattering media can be made feasible with additional temporal information. Furthermore, structure-aware imaging also represents a completely new approach to traditional color image processing. We show that classical hand-crafted image processing pipelines can be replaced by a single optimization problem exploiting image structure. This approach does not only outperform the state-of-the-art for classical image processing problems, but enables completely new color camera designs. In particular, we demonstrate camera designs with radically simplified optical systems, as well as novel sensor designs. The computation for all imaging problems from this dissertation relies on Bayesian inference using large-scale proximal optimization methods. We present a mathematical framework and a corresponding domain-specific language to automate the development of efficient, structure-aware solvers, allowing to immediately apply the insights gained in this dissertation to new imaging problems.

Degree

thesis:*
Name thesis:degree_name
Doctor of Philosophy - PhD
Level thesis:degree_level
doctoral
Discipline thesis:degree_discipline
Computer Science
Grantor dc:publisher
University of British Columbia
Year dc:date
2016

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Heide, Felix

Rights

dc:rights
Statement dc:rights
  • Attribution-NonCommercial-NoDerivatives 4.0 International
Language dc:language
eng

Identifiers

dc:identifier.*
Handle dc:identifier
http://hdl.handle.net/2429/59343

Chain of custody

source
Harvested from
University of British Columbia
Base URL
circle.library.ubc.ca/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Heide, Felix. Structure-aware computational imaging. doctoral thesis, University of British Columbia, 2016. http://hdl.handle.net/2429/59343