Back to search

Rochester Institute of Technology

Seeing, sensing, and selection: modeling visual perception in complex environments

Abstract

dc:description.abstract

The purpose of this thesis is to investigate human visual perception at the level of eye movements by describing the interaction between vision and action during natural, everyday tasks in a real-world environment. The results of the investigation provide motivation for the development of a biologically-based model of selective visual perception that relies on the relative perceptual conspicuity of certain regions within the field of view. Several experiments were designed and conducted that form the basis for the model. The experiments provide evidence that the visual system is not passive, nor is it general-purpose, but rather it is active and specific, tightly coupled to the requirements of planned behavior and action. The implication for an active and task-specific visual system is that an explicit representation of the environment can be eschewed in favor of a compact representation with large potential savings in computational efficiency. The compact representation is in the form of a topographic map of relative perceptual conspicuity values. Other recent attempts at compact scene representations have focused mainly on low-level maps that code certain salient features of the scene including color, edges, and luminance. This study has found that the low-level maps do not correlate well with subjects' fixation locations, therefore, a map of perceptual conspicuity is presented that incorporates high-level information. The high-level information is in the form of figure/ground segmentation, potential object detection, and task-specific location bias. The resulting model correlates well with the fixation densities of human viewers of natural scenes, and can be used as a pre-processing module for image understanding or intelligent surveillance applications.

Degree

thesis:*
Level thesis:degree_level
Dissertation
Discipline thesis:degree_discipline
Chester F. Carlson Center for Imaging Science (COS)

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Canosa, Roxanne
Contributors dc:contributor
  • Pelz, Jeff

Subjects

dc:subject × 3

Identifiers

dc:identifier.*
Repository record dc:identifier
https://repository.rit.edu/theses/1086

Chain of custody

source
Harvested from
Rochester Institute of Technology
Base URL
repository.rit.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Canosa, Roxanne. Seeing, sensing, and selection: modeling visual perception in complex environments. Dissertation thesis, https://repository.rit.edu/theses/1086