Return to search

Speechreading's Benefit to the Recognition of Sentences as a Function of Signal-to-Noise Ratio

Despite attempts to improve speech recognition in noise via hearing aid algorithms, communication where there is background noise continues to present serious challenges to hearing aid users. The viability of using speech reading to augment amplification to improve communication in noise has not been fully investigated. One reason for this oversight is the assumption that the decline in speech recognition performance with decreases in S/N ratio is similar for communicative situations in which speech reading is available and for those in which it is not. In this study, comparison of speech recognition performance for auditory only (A) and audio-visual (AV) presentation of sentences was made at four signal-to-noise-ratios ranging from 0 to –6 dB. Twenty-six participants with normal hearing and vision, 20 to 30 years, responded to eight experimental conditions (A and AV presentation of speech at each of four signal-to-noise ratios). Speech recognition performance was evaluated using a 2 X 4 repeated measures ANOVA. The main effects of presentation mode and S/N ratio were statistically significant. More importantly, there was a significant interaction between these factors for speech recognition performance. The interaction revealed a growing benefit of speech reading, defined as the difference between audio-visual and auditory only performance (AV-A), with decreasing signal-to-noise ratios. This finding of increasing benefit with deteriorating listening conditions refutes the assumption that performance decline with increasing background noise is independent of presentation mode. This finding suggests that the need for individuals with hearing impairment to avail themselves of visual speech cues increases with a deteriorating listening environment. In view of these findings, hearing aid evaluations involving both A and AV presentation of speech at different signal-to-noise ratios are recommended. Such procedures allow for both objective and subjective assessment of speech recognition performance under combinations of presentation mode and S/N ratios. / A Dissertation Submitted to the Department of Communication Disorders in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy. / Fall Semester, 2003. / October 31, 2003. / Comparison of audio with audio-visual speech recognition / Includes bibliographical references. / Richard J. Morris, Professor Directing Dissertation; Akihito Kamata, Outside Committee Member; Virginia Walker, Committee Member; Howard Goldstein, Committee Member; Lee Terrio, Committee Member.

Identiferoai:union.ndltd.org:fsu.edu/oai:fsu.digital.flvc.org:fsu_176124
ContributorsSouthard, Stuart D. (authoraut), Morris, Richard J. (professor directing dissertation), Kamata, Akihito (outside committee member), Walker, Virginia (committee member), Goldstein, Howard (committee member), Terrio, Lee (committee member), School of Communication (degree granting department), Florida State University (degree granting institution)
PublisherFlorida State University, Florida State University
Source SetsFlorida State University
LanguageEnglish, English
Detected LanguageEnglish
TypeText, text
Format1 online resource, computer, application/pdf
RightsThis Item is protected by copyright and/or related rights. You are free to use this Item in any way that is permitted by the copyright and related rights legislation that applies to your use. For other uses you need to obtain permission from the rights-holder(s). The copyright in theses and dissertations completed at Florida State University is held by the students who author them.

Page generated in 0.0232 seconds