University of North Texas
Real-Time Finger Spelling American Sign Language Recognition Using Deep Convolutional Neural Networks
Abstract
dc:descriptionThis thesis presents design and development of a gesture recognition system to recognize finger spelling American Sign Language hand gestures. We developed this solution using the latest deep learning technique called convolutional neural networks. This system uses blink detection to initiate the recognition process, Convex Hull-based hand segmentation with adaptive skin color filtering to segment hand region, and a convolutional neural network to perform gesture recognition. An ensemble of four convolutional neural networks are trained with a dataset of 25254 images for gesture recognition and a feedback unit called head pose estimation is implemented to validate the correctness of predicted gestures. This entire system was developed using Python programming language and other supporting libraries like OpenCV, Tensor flow and Dlib to perform various image processing and machine learning tasks. This entire application can be deployed as a web application using Flask to make it operating system independent.
Degree
thesis:*- Grantor dc:publisher
- University of North Texas
- Year dc:date
- 2018
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Viswavarapu, Lokesh Kumar
- Contributors dc:contributor
-
- Namuduri, Kamesh
- Li, Xinrong
- Guturu, Parthasarathy
Subjects
dc:subject × 13Rights
dc:rights- Statement dc:rights
-
- Public
- Viswavarapu, Lokesh Kumar
- Copyright
- Copyright is held by the author, unless otherwise noted. All rights Reserved.
- Language dc:language
- English
Identifiers
dc:identifier.*- Identifier
-
local-cont-no: submission_1314
https://digital.library.unt.edu/ark:/67531/metadc1404616/
ark: ark:/67531/metadc1404616