Back to search

Georgia Institute of Technology

Monocular Reconstruction during Colonoscopy and Engine Inspection

Abstract

dc:description.abstract

Monocular reconstruction of surfaces has become possible in recent years with the advent of efficient and accurate algorithms like Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS), but reconstruction can be difficult to perform in real-time depending on the nature of the environment and the precision required. Alongside this, acquiring ground-truth data in hard-to-reach environments poses additional challenges for validatingthese algorithms. Prior work has tackled this problem using generated datasets; this paper proposes validating this in silico and experimentally. This is accomplished by testing and optimizing state-of-the-art monocular reconstruction algorithms for endoscopy, specifically targeting colorectal endoscopy with the auxiliary application of borescope engine inspection. Proposed algorithms build off of 3DGS and its dynamic extension, EndoGaussian, for storing temporal deformation. Temporal and spatial features are stored in a compressed yet explainable representation called a HexPlane. The introduced opimization also computes an illumination context using the BRDF and light source location, which is particularly applicable to dim, watertight settings where the lighting model of the endoscope or borescope can be of great utility. The proposed method, Light Encoded Gaussian Splatting (LE-GS), demonstrated an average PSNR of 27.29 on the C3VD dataset, compared to an average PSNR of 25.49 using EndoGaussian. The Simultaneous Localization and Mapping using Gassian Splatting (GS-SLAM) algorithm tested on a 3D printed pipe demonstrated a PSNR of 4.59, demonstrating the potential efficacy of our context-based optimization to reconstruction in medical settings.

Degree

thesis:*
Level thesis:degree_level
Masters
Department dc:contributor.department
Computer Science
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2024

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Chadha, Ishan
Advisors dc:contributor.advisor
  • Chen, Yue
  • Hutchinson, Seth
Committee member dc:contributor.committeemember
  • Noel, Alexis

Subjects

dc:subject × 4

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1853/75671

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Chadha, Ishan. Monocular Reconstruction during Colonoscopy and Engine Inspection. Masters thesis, Georgia Institute of Technology, 2024. https://hdl.handle.net/1853/75671