Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 13 of 13 for “"Audio-visual speech recognition"”.
-
CROSS-MODALITY COMPLEMENTARITY FOR AUDIO-VISUAL SPEECH RECOGNITION
Speech recognition is an indispensable tool for human-robot interaction. Inspired by human processes, the integration of audio and visual modalities enhances robustness in transcribing texts. However, corruption may occur in either modality or both, leading to a degradation in speech recognition. …
-
Information Fusion for Robust Audio -Visual Speech Recognition
… novel sensory modalities have been used. Speech, gestures, and emotional states can be detected and understood to some extent. However, integrating these information sources to achieve performances superior to any single modal alone remains a challenging problem. Humans naturally and …
-
Multimodal Fusion With Applications to Audio -Visual Speech Recognition
… characteristics of the intermodal couplings in audio-visual speech recognition and in multichannel biometrics defy a universal fusion method for both applications. For audio-visual speech modeling, we propose a novel sensory fusion method based on the coupled hidden Markov models (CHMMs). The …
-
A Multimodal Sensor Fusion Architecture for Audio-Visual Speech Recognition
… The work of this thesis aims at improving speech recognition-based interfaces by making use of the visual modality conveyed by the movements of the lips. Designing a good visual front end is a major part of this framework. For this purpose, this work derives the optical flow fields for …
-
Temporal constraints on human and artificial muliti-sensory speech recognition
Audio Visual Speech Recognition (AVSR) is the process of perceiving and understanding speech using audio and visual information. Combining visual information with auditory stimuli has been shown to improve AVSR performance when compared to purely auditory speech recognition when the task is …
-
Face Detection and Lip Localization
Integration of audio and video signals for automatic speech recognition has become an important field of study. The Audio-Visual Speech Recognition (AVSR) system is known to have accuracy higher than audio-only or visual-only system. The research focused on the visual front end and has been …
-
Efficient Knowledge Transfer and Adaptation for Speech and Beyond
… transfer and adaptation in the realm of speech processing. It is structured to address the limitations of transfer learning in dynamically evolving audio and speech processing contexts, particularly through novel approaches for class-incremental learning, parameter-efficient adaptation, …
-
The application of manifold based visual speech units for visual speech recognition
… representation that is referred to as a Visual Speech Unit for visual speech recognition (VSR). The automated recognition of human speech using only features from the visual domain has become a significant research topic that plays an essential role in the development of many multimedia …
-
Audio-visual deep learning
… modalities, by processing, for instance, video, audio or speech separately. The goal of this thesis is instead utilizing the natural co-occurrence of audio and visual information in videos to learn useful tasks.</p> <p>The thesis is structured around four main themes: (i) lip reading and …
-
Ανάλυση εικόνας και όραση υπολογιστών: θεωρία και εφαρμογές στην αποκατάσταση αρχαίων τοιχογραφιών
… aspect of our doctoral thesis research on audiovisual speech recognition. Our main research contribution in this area is the development of a theoretical framework for optimal adaptive fusion of multimodal data based on careful modeling of the individual feature measurement uncertainty …