Return to search

Game Based Visual-to-Auditory Sensory Substitution Training

There has been a great deal of research devoted to computer vision related assistive technologies. Unfortunately, this area of research has not produced many usable solutions. The
long cane and the guard dog are still far more useful than most of these devices. Through the push for advanced mobile and gaming systems, new low-cost solutions have become available for
building innovative and creative assistive technologies. These technologies have been used for sensory substitution projects that attempt to convert vision into either auditory or tactile
stimuli. These projects have reported some degree of measurable success. Most of these projects focused on converting either image brightness or depth into auditory signals. This research
was devoted to the design and creation of a video game simulator that was capable of performing research and training for these sensory substitution concepts that converts vision into
auditory stimuli. The simulator was used to perform direct comparisons between some of the popular sensory substitution techniques as well as exploring new concepts for conversion. This
research of 42 participants tested different techniques for image simplification and discovered that using depth-to-tone sensory substitution may be more usable than brightness-to-tone
simulation. The study has shown that using 3D game simulators can be used in lieu of building costly prototypes for testing new sensory substitution concepts. / A Dissertation submitted to the Department of Computer Science in partial fulfillment of the requirements for the degree of Doctor of Philosophy. / Fall Semester 2015. / November 6, 2015. / auditory vision, image to tone conversion, Sensory Substitution Training, Serious Gaming, Vision Impairment / Includes bibliographical references. / Gary Tyson, Professor Directing Dissertation; Gordon Erlebacher, University Representative; Xiuwen Liu, Committee Member; Margareta Ackerman, Committee
Member.

Identiferoai:union.ndltd.org:fsu.edu/oai:fsu.digital.flvc.org:fsu_291370
ContributorsMarshall, Justin B. (authoraut), Tyson, Gary Scott (professor directing dissertation), Erlebacher, Gordon, 1957- (university representative), Liu, Xiuwen, 1966- (committee member), Ackerman, Margareta (committee member), Florida State University (degree granting institution), College of Arts and Sciences (degree granting college), Department of Computer Science (degree granting department)
PublisherFlorida State University
Source SetsFlorida State University
LanguageEnglish, English
Detected LanguageEnglish
TypeText, text
Format1 online resource (128 pages), computer, application/pdf

Page generated in 0.0021 seconds