Back to search

Georgia Institute of Technology

Deep Multi-view Stereo for GTSFM

Abstract

dc:description.abstract

Current structure-from-motion (SFM) pipelines integrated with multi-view stereo (MVS) module often applies traditional MVS algorithms. These algorithms cannot be well parallelized and can be slow when the data size and the resolution increase. For view synthesis, there are seldom SFM pipelines integrating it. This thesis focuses on how to integrate MVS and view synthesis efficiently into SFM pipelines, especially for the latest deep learning approaches. I first do a thorough survey in both domains, compare the advantages and disadvantages of the latest studies, and select the best-fit approach for our distributed SFM pipeline, Georgia Tech Structure from Motion (GTSFM). We implement the deep multi-view optimizer with PatchmatchNet and integrate it into the working graph of GTSFM. We also design an algorithm to boost a novel deep view synthesis algorithm, Instant-NGP, by forcing the reconstruction region on the overlapping Field-of-Views. This also enables us to extract high-quality dense polygon meshes of foreground objects directly from the reconstructed depth field. Experiments run on DTU and Skydio Crane Mast datasets suggest our MVS approach is more efficient than some popular SFM pipelines with MVS implemented.

Degree

thesis:*
Level thesis:degree_level
Masters
Department dc:contributor.department
Computer Science
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2022

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Liu, Ren
Advisor dc:contributor.advisor
  • Dellaert, Frank
Committee members dc:contributor.committeemember
  • Hays, James
  • Pradalier, Cedric

Subjects

dc:subject × 4

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
http://hdl.handle.net/1853/66613

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Liu, Ren. Deep Multi-view Stereo for GTSFM. Masters thesis, Georgia Institute of Technology, 2022. http://hdl.handle.net/1853/66613