Back to search

University of British Columbia

Full 3D model reconstruction via object motion tracking without external information : a deep learning-based approach

Abstract

dc:description

This thesis presents an end-to-end object reconstruction pipeline that includes image data acquisition, processing, and visualization. The proposed system produces high-fidelity 3D models by tracking a handheld object in a sequence of RGB-D frames. In this process, a semantic segmentation network is used to remove the operator hand from the frame to create an object mask. The mask is then used to track the pose of the object over time. A truncated signed distance function representation is used to fuse the aligned frames into a global model. Previous approaches either target static scene reconstruction therefore ignoring dynamic elements, or depend on the availability of a well-defined reference platform for scanning. As opposed to conventional scanning approaches, the proposed scanning pipeline involves the handling of the object by an operator in the field of view of a stationary depth-enabled camera, similar to how humans visually inspect objects. As a result, the scanning process is intuitive and easy to use for the end-users. Further, a two-stage training regime is proposed to enhance hand segmentation accuracy. Our approach can serve as an end-to-end scanning module capable of producing true-to-scale 3D CAD models ready for use in other computer vision tasks such as object tracking or pose estimation. A manually labeled hand segmentation dataset was created to evaluate the effectiveness of the proposed training regime, different segmentation algorithms, and normalization techniques. The performance of the proposed pipeline is demonstrated by scanning a variety of objects scanned using two different camera setups. Reconstructed models are compared against ground truth with reconstruction accuracy being measured through a normalized error metric.

Degree

thesis:*
Name thesis:degree_name
Master of Applied Science - MASc
Level thesis:degree_level
master's
Discipline thesis:degree_discipline
Mechanical Engineering
Grantor dc:publisher
University of British Columbia
Year dc:date
2021

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Salari, Aria
Contributors dc:contributor
  • Najjaran, Homayoun

Rights

dc:rights
Statement dc:rights
  • Attribution-NonCommercial-NoDerivatives 4.0 International
Language dc:language
eng

Identifiers

dc:identifier.*
Handle dc:identifier
http://hdl.handle.net/2429/80381

Chain of custody

source
Harvested from
University of British Columbia
Base URL
circle.library.ubc.ca/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Salari, Aria. Full 3D model reconstruction via object motion tracking without external information : a deep learning-based approach. master's thesis, University of British Columbia, 2021. http://hdl.handle.net/2429/80381