Back to search

University of North Florida. School of Computing

Designing 2D Interfaces For 3D Gesture Retrieval Utilizing Deep Learning

Abstract

dc:description.abstract

Gesture retrieval can be defined as the process of retrieving the correct meaning of the hand movement from a pre-assembled gesture dataset. The purpose of the research discussed here is to design and implement a gesture interface system that facilitates retrieval for an American Sign Language gesture set using a mobile device. The principal challenge discussed here will be the normalization of 2D gestures generated from the mobile device interface and the 3D gestures captured from video samples into a common data structure that can be utilized by deep learning networks. This thesis covers convolutional neural networks and auto encoders which are used to transform 2D gestures into the correct form, before being classified by a convolutional neural network. The architecture and implementation of the front-end and back-end systems and each of their respective responsibilities are discussed. Lastly, this thesis covers the results of the experiment and breakdown the final classification accuracy of 83% and how this work could be further improved by using depth based videos for the 3D data.

Degree

thesis:*
Name thesis:degree_name
Master of Science in Computer and Information Sciences (MS)
Discipline thesis:degree_discipline
Computing
Grantor
University of North Florida. School of Computing
Date dc:date.issued
Fall

Author and committee

dc:creator, dc:contributor.*
Authors dc:creator
  • Southard, Spencer
  • Southard, Spencer, 1990-
Advisors dc:contributor.advisor
  • Chuan, Ching-Hua
  • Martin, Kenneth
  • Elfayoumy, Sherif
Contributors dc:contributor
  • Dr. Ching-Hua Chuan
  • Dr. Kenneth Martin
  • Dr. Sherif Elfayoumy

Subjects

dc:subject × 10

Rights

dc:rights

Identifiers

dc:identifier.*
Repository record dc:identifier
https://digitalcommons.unf.edu/etd/774

Chain of custody

source
Harvested from
University of North Florida
Base URL
digitalcommons.unf.edu/do/oai/
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

Southard, Spencer; Southard, Spencer, 1990-. Designing 2D Interfaces For 3D Gesture Retrieval Utilizing Deep Learning. University of North Florida. School of Computing, https://digitalcommons.unf.edu/etd/774