Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 20 of 23 for “"Visual speech recognition"”.

  1. Hidden Markov model based visual speech recognition

    Speech recognition can be made more accurate if visual speech information such as the movement of the lips is taken into consideration. In this thesis, studies on visual speech processing are presented. Classifiers based on Hidden Markov Model (HMM) are first explored for modeling and identifying …

    nus Repository record for Hidden Markov model based visual speech recognition (opens in a new tab) Download file for Hidden Markov model based visual speech recognition (opens in a new tab)

  2. Visual speech recognition in sparse data domains

    This work is focused on the development of Visual Speech recognition systems within sparse data domains. The use of Visual Speech recognition as this basis for a Liveness Verification system is discussed. This thesis also explores the adaptation of models trained within one domain to be used with …

    qu-belfast Repository record for Visual speech recognition in sparse data domains (opens in a new tab) Download PDF for Visual speech recognition in sparse data domains (opens in a new tab)

  3. CROSS-MODALITY COMPLEMENTARITY FOR AUDIO-VISUAL SPEECH RECOGNITION

    Speech recognition is an indispensable tool for human-robot interaction. Inspired by human processes, the integration of audio and visual modalities enhances robustness in transcribing texts. However, corruption may occur in either modality or both, leading to a degradation in speech recognition. …

    nus Repository record for CROSS-MODALITY COMPLEMENTARITY FOR AUDIO-VISUAL SPEECH RECOGNITION (opens in a new tab) Download file for CROSS-MODALITY COMPLEMENTARITY FOR AUDIO-VISUAL SPEECH RECOGNITION (opens in a new tab)

  4. Visual Speech Recognition Using Multiple Deformable Lip Models

    Motivated by the fact that human speech perception is a bimodal process (auditory and visual), several researchers have designed and implemented automatic speech recognition (ASR) systems consisting of both audio and visual subsystems, and shown improved performance relative to traditional purely …

    odu Repository record for Visual Speech Recognition Using Multiple Deformable Lip Models (opens in a new tab)

  5. Visual Speech Recognition using Histogram of Oriented Displacements

    Lip reading is the recognition of spoken words from the visual information of lips. It has been of considerable interest in the Computer Vision and Speech Recognition communities to automate this process using computer algorithms. In this thesis, we have developed a novel method involving …

    clemson Repository record for Visual Speech Recognition using Histogram of Oriented Displacements (opens in a new tab)

  6. Information Fusion for Robust Audio -Visual Speech Recognition

    … novel sensory modalities have been used. Speech, gestures, and emotional states can be detected and understood to some extent. However, integrating these information sources to achieve performances superior to any single modal alone remains a challenging problem. Humans naturally and …

    uiuc Repository record for Information Fusion for Robust Audio -Visual Speech Recognition (opens in a new tab)

  7. Visual Speech Recognition Using a 3D Convolutional Neural Network

    Main stream automatic speech recognition (ASR) makes use of audio data to identify spoken words, however visual speech recognition (VSR) has recently been of increased interest to researchers. VSR is used when audio data is corrupted or missing entirely and also to further enhance the accuracy of …

    calpoly Repository record for Visual Speech Recognition Using a 3D Convolutional Neural Network (opens in a new tab)

  8. Multimodal Fusion With Applications to Audio -Visual Speech Recognition

    … of the intermodal couplings in audio-visual speech recognition and in multichannel biometrics defy a universal fusion method for both applications. For audio-visual speech modeling, we propose a novel sensory fusion method based on the coupled hidden Markov models (CHMMs). The CHMM …

    uiuc Repository record for Multimodal Fusion With Applications to Audio -Visual Speech Recognition (opens in a new tab)

  9. A Multimodal Sensor Fusion Architecture for Audio-Visual Speech Recognition

    … The work of this thesis aims at improving speech recognition-based interfaces by making use of the visual modality conveyed by the movements of the lips. Designing a good visual front end is a major part of this framework. For this purpose, this work derives the optical flow fields for …

    waterloo Repository record for A Multimodal Sensor Fusion Architecture for Audio-Visual Speech Recognition (opens in a new tab)

  10. The application of manifold based visual speech units for visual speech recognition

    … representation that is referred to as a Visual Speech Unit for visual speech recognition (VSR). The automated recognition of human speech using only features from the visual domain has become a significant research topic that plays an essential role in the development of many multimedia …

    dcu Download PDF for The application of manifold based visual speech units for visual speech recognition (opens in a new tab)

  11. Lightweight methods and models for practical visual speech recognition from video sequences

    Visual Speech Recognition (VSR) is a computer vision problem that aims to decode spoken words of one or more speakers from visual media without the presence of sound. Applications of VSR are found in numerous domains, with profound impacts on various aspects of everyday life. A notable application …

    greece Repository record for Lightweight methods and models for practical visual speech recognition from video sequences (opens in a new tab)

  12. A DATA-CENTRIC APPROACH TO VISUAL SPEECH RECOGNITION USING 3D RECONSTRUCTIONS FROM MONOCULAR VIDEOS

    Visual Speech Recognition (VSR) aims to recognize spoken language from visual information, primarily lip movements. Although recent deep learning approaches have achieved promising results, many existing systems rely on large, controlled datasets and often exhibit limited robustness under …

    openu Repository record for A DATA-CENTRIC APPROACH TO VISUAL SPEECH RECOGNITION USING 3D RECONSTRUCTIONS FROM MONOCULAR VIDEOS (opens in a new tab) Download PDF for A DATA-CENTRIC APPROACH TO VISUAL SPEECH RECOGNITION USING 3D RECONSTRUCTIONS FROM MONOCULAR VIDEOS (opens in a new tab)

  13. Interactions of Area V5/MT and the Lateral Geniculate Nucleus in the Context of Visual Speech Recognition

    The human ability to recognize speech from visual input alone, commonly referred to as visual speech recognition, lipreading or speechreading, relies on complex neural mechanisms that extend beyond classical feedforward processing streams in the visual system. While considerable research has …

    qucosa-diss

  14. Temporal constraints on human and artificial muliti-sensory speech recognition

    Audio Visual Speech Recognition (AVSR) is the process of perceiving and understanding speech using audio and visual information. Combining visual information with auditory stimuli has been shown to improve AVSR performance when compared to purely auditory speech recognition when the task is …

    lethbridge Repository record for Temporal constraints on human and artificial muliti-sensory speech recognition (opens in a new tab)

  15. Using Facial Landmarks for Lip Motion Interpretation Applications

    … movement, carries rich information about human speech that can be leveraged for a variety of computer vision and speech-processing tasks. Unlike other pixel-based methods, this work investigates the use of facial landmarks as a compact, privacy- preserving, and computationally efficient …

    byu Repository record for Using Facial Landmarks for Lip Motion Interpretation Applications (opens in a new tab) Download PDF for Using Facial Landmarks for Lip Motion Interpretation Applications (opens in a new tab)

  16. Face Detection and Lip Localization

    … of audio and video signals for automatic speech recognition has become an important field of study. The Audio-Visual Speech Recognition (AVSR) system is known to have accuracy higher than audio-only or visual-only system. The research focused on the visual front end and has been centered …

    calpoly Repository record for Face Detection and Lip Localization (opens in a new tab)

  17. Efficient Knowledge Transfer and Adaptation for Speech and Beyond

    … transfer and adaptation in the realm of speech processing. It is structured to address the limitations of transfer learning in dynamically evolving audio and speech processing contexts, particularly through novel approaches for class-incremental learning, parameter-efficient adaptation, …

    trento Repository record for Efficient Knowledge Transfer and Adaptation for Speech and Beyond (opens in a new tab)

  18. Audio-visual deep learning

    … by processing, for instance, video, audio or speech separately. The goal of this thesis is instead utilizing the natural co-occurrence of audio and visual information in videos to learn useful tasks.</p> <p>The thesis is structured around four main themes: (i) lip reading and Audio-Visual …

    oxford Repository record for Audio-visual deep learning (opens in a new tab)

Page 1 of 2