Return to search

Enabling the Blind to See Gestures

Mathematics instruction and discourse typically involve two modes of communication: speech and graphical presentation. For the communication to remain situated, dynamic synchrony must be maintained between the speech and dynamic focus in the graphics. Sighted students use vision for two purposes: access to graphical material and awareness of embodied behavior. This embodiment awareness keeps communication situated with visual material and speech. Our goal is to assist students who are blind or visually impaired (SBVI) in the access to such instruction/communication. We employ the typical approach of sensory replacement for the missing visual sense. Haptic fingertip reading can replace visual material. We want to make the SBVI aware of the deictic gestures performed by the teacher over the graphic in conjunction with speech. We employ a haptic glove interface to facilitate this embodiment awareness. In this research, we address issues from the conception through the design, implementation, evaluation to the effective and successful use of our Haptic Deictic System (HDS) in inclusive classrooms. / Ph. D.

Identiferoai:union.ndltd.org:VTETD/oai:vtechworks.lib.vt.edu:10919/28508
Date02 September 2010
CreatorsOliveira, Francisco Carlos De Mattos Brito
ContributorsComputer Science, Quek, Francis K. H., Harrison, Steven R., Tatar, Deborah Gail, Gracanin, Denis, Smith-Jackson, Tonya L.
PublisherVirginia Tech
Source SetsVirginia Tech Theses and Dissertation
Detected LanguageEnglish
TypeDissertation
Formatapplication/pdf
RightsIn Copyright, http://rightsstatements.org/vocab/InC/1.0/
Relationoliveira_dissertation_final_version_08262010.pdf

Page generated in 0.0021 seconds