Back to search

University of Denver

SIFT-ME: A New Feature for Human Activity Recognition

Abstract

dc:description.abstract

Action representation for robust human activity recognition is still a challenging problem. This thesis proposed a new feature for human activity recognition named SIFT-Motion Estimation (SIFT-ME). SIFT-ME is derived from SIFT correspondences in a sequence of video frames and adds tracking information to describe human body motion. This feature is an extension of SIFT and is used to represent both translation and rotation in plane rotation for the key features. Compare with other features, SIFT-ME is new as it uses rotation of key features to describe action and it robust to the environment changes. Because SIFT-ME is derived from SIFT correspondences, it is invariant to noise, illumination, and small view angle change. It is also invariant to horizontal motion direction due to the embedded tracking information. For action recognition, we use Gaussian Mixture Model to learn motion patterns of several human actions (e.g., walking, running, turning, etc) described by SIFT-ME features. Then, we utilize the maximum log-likelihood criterion to classify actions. As a result, an average recognition rate of 96.6% was achieved using a dataset of 261 videos comprised of six actions performed by seven subjects. Multiple comparisons with existing implementations including optical flow, 2D SIFT and 3D SIFT were performed. The SIFT-ME approach outperforms the other approaches which demonstrate that SIFT-ME is a robust method for human activity recognition.

Degree

thesis:*
Name thesis:degree_name
M.S.
Level thesis:degree_level
Masters Thesis

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Wu, Guosheng
Contributors dc:contributor
  • Richard M. Voyles, Ph.D.
  • Mohammad H. Mahoor, Ph.D.
  • Matthew Rutherford

Subjects

dc:subject × 8

Rights

dc:rights
Statement dc:rights
  • <p>Copyright is held by the author. User is responsible for all copyright compliance.</p>
  • Guosheng Wu
Language dc:language
en

Identifiers

dc:identifier.*
Repository record dc:identifier
https://digitalcommons.du.edu/etd/718

Chain of custody

source
Harvested from
University of Denver
Base URL
digitalcommons.du.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Wu, Guosheng. SIFT-ME: A New Feature for Human Activity Recognition. Masters Thesis thesis, https://digitalcommons.du.edu/etd/718