Back to search

University of South Florida

A Vision-Based Approach For Unsupervised Modeling Of Signs Embedded In Continuous Sentences

Abstract

dc:description

The common practice in sign language recognition is to first construct individual sign models, in terms of discrete state transitions, mostly represented using Hidden Markov Models, from manually isolated sign samples and then to use them to recognize signs in continuous sentences. In this thesis we use a continuous state space model, where the states are based on purely image-based features, without the use of special gloves. We also present an unsupervised approach to both extract and learn models for continuous basic units of signs, which we term as signemes, from continuous sentences. Given a set of sentences with a common sign, we can automatically learn the model for part of the sign,or signeme, that is least affected by coarticulation effects. We tested our idea using the publicly available Boston SignStreamDataset by building signeme models of 18 signs. We test the quality of the models by considering how well we can localize the sign in a new sentence. We also present the concept of smooth continuous curve based models formed using functional splines and curve registration. We illustrate this idea using 16 signs.

Degree

thesis:*
Level thesis:degree_level
Thesis
Discipline thesis:degree_discipline
Computer Science
Grantor
University of South Florida
Year dc:date
2005

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Nayak, Sunita
Contributors dc:contributor
  • Sudeep Sarkar, Ph.D.
  • Barbara Loeding, Ph.D.
  • Rangachar Kasturi, Ph.D.

Subjects

dc:subject × 7

Rights

Language dc:language
EN-US

Identifiers

dc:identifier.*
Repository record dc:identifier
https://digitalcommons.usf.edu/etd/788

Chain of custody

source
Harvested from
University of South Florida
Base URL
digitalcommons.usf.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Nayak, Sunita. A Vision-Based Approach For Unsupervised Modeling Of Signs Embedded In Continuous Sentences. Thesis thesis, University of South Florida, 2005. https://digitalcommons.usf.edu/etd/788