Back to search

Cal Poly

Sentinel: Evaluating Occlusion-Centered Next-Best-View Selection Using RGB-Derived Pseudo-Geometry

Abstract

dc:description.abstract

Three-dimensional cameras provide direct geometric measurements, but their cost, weight, power requirements, and calibration constraints can limit their use in various lightweight or large-scale sensing systems. A potential alternative is to use conventional two-dimensional RGB cameras together with geometric reconstruction models that infer a partial three-dimensional representation from images. This thesis evaluates that possibility for next-best-view (NBV) selection through Sentinel, an occlusion-centered system for static, object-centric scenes with known camera poses and intrinsics. Sentinel converts source RGB observations into pseudo-geometry using monocular depth or point-map predictions, combines those predictions with camera-ray evidence, identifies occluded unknown regions, and selects a candidate view expected to reveal the most previously hidden content. The resulting pseudo-3D state is used for view planning rather than treated as a complete reconstruction, allowing the study to focus on whether inexpensive, widely deployable RGB cameras can provide useful geometric guidance to systems traditionally built around dedicated 3D sensors. The primary contribution is an evaluation of source-only view-selection quality under a controlled source-only evaluation protocol. Sentinel is compared with random, object-centered, pose-only, and geometry-based baselines on a reproducible synthetic benchmark built from BOP HOPEv2 object models. This evaluation is especially timely because monocular depth and geometric reconstruction have become a rapidly advancing area of computer vision. Sentinel therefore provides a common downstream evaluation for evolving RGB-to-geometry models and examines whether their predictions are sufficiently reliable for next-view decisions.

Degree

thesis:*
Name thesis:degree_name
MS in Computer Science
Discipline thesis:degree_discipline
Computer Science

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Nassar, Paul
Contributors dc:contributor
  • Jonathan Ventura
  • Computer Science
  • College of Engineering

Subjects

dc:subject × 6

Identifiers

dc:identifier.*
Repository record dc:identifier
https://digitalcommons.calpoly.edu/theses/3412

Chain of custody

source
Harvested from
Cal Poly
Base URL
digitalcommons.calpoly.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Nassar, Paul. Sentinel: Evaluating Occlusion-Centered Next-Best-View Selection Using RGB-Derived Pseudo-Geometry. https://digitalcommons.calpoly.edu/theses/3412