Back to search

Cornell University

Active Vision and Perception

Abstract

dc:description.abstract

Active vision and perception for resource-constrained autonomous vehicles, such as small ground robots and quadrotors, are limited in their allowable algorithmic complexity and slow reaction times. For an autonomous mobile robot to safely and reliably perform a useful task or behavior, real-time visual perception that informs a controller with a fast reaction time is needed. This dissertation covers new research developments in the areas of active vision, planning, and control for directional sensors with a focus on event-cameras and RGB cameras. Event-cameras, also known as neuromorphic cameras, are biologically inspired visual sensors that measure local changes in light intensity, mitigating latency and redundant data. Several high-level active vision algorithms, interfaced with autonomous vehicle controllers, are developed for event-cameras and quantitatively compared to analogous RGB camera algorithms, in terms of both accuracy and computational cost. In particular, motion-based perception algorithms for object recognition and tracking, action recognition, and depth estimation are developed for use on a moving quadrotor tasked with reacting to the perceived environment. Novel active vision algorithms for RGB cameras are also developed in which an autonomous ground vehicle or quadrotor interact with a human target of interest using novel action recognition and tracking perception capabilities paralleled with new control methods for target following. Furthermore, a novel occlusion-avoiding path planning algorithm that is applicable to both event-cameras and RGB cameras is developed. The proposed method computes a closed-form collection of subsets of the sensor's configuration space, referred to as visibility regions, that quantify the visibility of targets subject to the sensor field of view geometry and line of sigh visibility. This method is quantitatively compared to several existing sensor path planning methods in terms of analytical computational complexity, experimental path performance, and experimental computational cost analysis. The results of this work enable active vision, perception, and planning for resource-constrained mobile robots equipped with directional sensors such as an event-camera or RGB camera.

Degree

thesis:*
Name thesis:degree_name
Ph. D., Mechanical Engineering
Level thesis:degree_level
Doctor of Philosophy
Discipline thesis:degree_discipline
Mechanical Engineering
Grantor
Cornell University
Year dc:date.issued
2020

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Gemerek, Jake
Chair dc:contributor.chair
  • Ferrari, Silvia
Committee members dc:contributor.committeemember
  • Campbell, Mark
  • Weinberger, Kilian Quirin

Subjects

dc:subject × 5

Rights

Language dc:language.iso
en

Identifiers

dc:identifier.*
Dc Identifier Bibid
13277845
Dc Identifier Other
ProQuest Submission ID: 12178
ProQuest Publication ID: 28087085

Chain of custody

source
Harvested from
Cornell University
Base URL
ecommons.cornell.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Gemerek, Jake. Active Vision and Perception. Doctor of Philosophy thesis, Cornell University, 2020. https://hdl.handle.net/1813/102961