Back to search

University of North Texas

Real-Time Finger Spelling American Sign Language Recognition Using Deep Convolutional Neural Networks

Abstract

dc:description

This thesis presents design and development of a gesture recognition system to recognize finger spelling American Sign Language hand gestures. We developed this solution using the latest deep learning technique called convolutional neural networks. This system uses blink detection to initiate the recognition process, Convex Hull-based hand segmentation with adaptive skin color filtering to segment hand region, and a convolutional neural network to perform gesture recognition. An ensemble of four convolutional neural networks are trained with a dataset of 25254 images for gesture recognition and a feedback unit called head pose estimation is implemented to validate the correctness of predicted gestures. This entire system was developed using Python programming language and other supporting libraries like OpenCV, Tensor flow and Dlib to perform various image processing and machine learning tasks. This entire application can be deployed as a web application using Flask to make it operating system independent.

Degree

thesis:*
Grantor dc:publisher
University of North Texas
Year dc:date
2018

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Viswavarapu, Lokesh Kumar
Contributors dc:contributor
  • Namuduri, Kamesh
  • Li, Xinrong
  • Guturu, Parthasarathy

Subjects

dc:subject × 13

Rights

dc:rights
Statement dc:rights
  • Public
  • Viswavarapu, Lokesh Kumar
  • Copyright
  • Copyright is held by the author, unless otherwise noted. All rights Reserved.
Language dc:language
English

Identifiers

dc:identifier.*
Identifier
local-cont-no: submission_1314
https://digital.library.unt.edu/ark:/67531/metadc1404616/
ark: ark:/67531/metadc1404616

Chain of custody

source
Harvested from
University of North Texas
Base URL
digital.library.unt.edu/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Viswavarapu, Lokesh Kumar. Real-Time Finger Spelling American Sign Language Recognition Using Deep Convolutional Neural Networks. University of North Texas, 2018. https://doi.org/10.12794/metadc1404616