Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 20 of 22 for “"Audio-visual speech"”.

  1. Audio-Visual Speech Processing for Multimedia Localisation

    … the alignment of content, such as subtitles or audio, when adapting content from one region to another. One method of automating this is through using audio content as a guide, providing a solution via audio-to-text alignment. While many approaches for audio-to-text alignment currently exist, …

    whiterose Download PDF for Audio-Visual Speech Processing for Multimedia Localisation (opens in a new tab)

  2. CROSS-MODALITY COMPLEMENTARITY FOR AUDIO-VISUAL SPEECH RECOGNITION

    Speech recognition is an indispensable tool for human-robot interaction. Inspired by human processes, the integration of audio and visual modalities enhances robustness in transcribing texts. However, corruption may occur in either modality or both, leading to a degradation in speech recognition. …

    nus Repository record for CROSS-MODALITY COMPLEMENTARITY FOR AUDIO-VISUAL SPEECH RECOGNITION (opens in a new tab) Download file for CROSS-MODALITY COMPLEMENTARITY FOR AUDIO-VISUAL SPEECH RECOGNITION (opens in a new tab)

  3. Audio-Visual Speech Enhancement Using Unsupervised Learning Methods

    Speech enhancement in noisy environments remains a fundamental challenge in signal processing, with direct impact on speech recognition, telecommunications, and assistive hearing technologies. Although deep learning-based approaches have achieved remarkable progress, most existing methods rely on …

    carleton Repository record for Audio-Visual Speech Enhancement Using Unsupervised Learning Methods (opens in a new tab)

  4. Information Fusion for Robust Audio -Visual Speech Recognition

    … novel sensory modalities have been used. Speech, gestures, and emotional states can be detected and understood to some extent. However, integrating these information sources to achieve performances superior to any single modal alone remains a challenging problem. Humans naturally and …

    uiuc Repository record for Information Fusion for Robust Audio -Visual Speech Recognition (opens in a new tab)

  5. Multimodal Fusion With Applications to Audio -Visual Speech Recognition

    … characteristics of the intermodal couplings in audio-visual speech recognition and in multichannel biometrics defy a universal fusion method for both applications. For audio-visual speech modeling, we propose a novel sensory fusion method based on the coupled hidden Markov models (CHMMs). The …

    uiuc Repository record for Multimodal Fusion With Applications to Audio -Visual Speech Recognition (opens in a new tab)

  6. A Multimodal Sensor Fusion Architecture for Audio-Visual Speech Recognition

    … The work of this thesis aims at improving speech recognition-based interfaces by making use of the visual modality conveyed by the movements of the lips. Designing a good visual front end is a major part of this framework. For this purpose, this work derives the optical flow fields for …

    waterloo Repository record for A Multimodal Sensor Fusion Architecture for Audio-Visual Speech Recognition (opens in a new tab)

  7. Lip Reading for Singing: Audio-Visual Approaches to Singing Voice Separation

    Singing voice separation is a challenging audio source separation task that has been approached predominantly through audio-only methods. This thesis investigates whether visual information derived from audio-visual speech embeddings can improve separation performance, and examines how training …

    gatech Repository record for Lip Reading for Singing: Audio-Visual Approaches to Singing Voice Separation (opens in a new tab)

  8. Temporal constraints on human and artificial muliti-sensory speech recognition

    Audio Visual Speech Recognition (AVSR) is the process of perceiving and understanding speech using audio and visual information. Combining visual information with auditory stimuli has been shown to improve AVSR performance when compared to purely auditory speech recognition when the task is …

    lethbridge Repository record for Temporal constraints on human and artificial muliti-sensory speech recognition (opens in a new tab)

  9. AUDIO-VISUAL ACTIVE SPEAKER DETECTION AND RECOGNITION

    Audio-visual speech processing aims to solve the speech-related problem with audio and visual information. Research in biology has proved that humans can perceive the world from multi-modalities since speech and face modalities can provide complementary information. In this thesis, we focus on …

    nus Repository record for AUDIO-VISUAL ACTIVE SPEAKER DETECTION AND RECOGNITION (opens in a new tab) Download file for AUDIO-VISUAL ACTIVE SPEAKER DETECTION AND RECOGNITION (opens in a new tab)

  10. Biologically plausible energy-efficient context-sensitive neural networks

    … (MM) non-linear regression tasks, such as audio-visual speech enhancement (AVSE). It is then compared against a conventional point neuron-inspired DCN in terms of perceptual evaluation of speech (PESQ) and short-time objective intelligibility (STOI). This research shows that the two-point …

    wlv Repository record for Biologically plausible energy-efficient context-sensitive neural networks (opens in a new tab) Download file for Biologically plausible energy-efficient context-sensitive neural networks (opens in a new tab)

  11. Face Detection and Lip Localization

    Integration of audio and video signals for automatic speech recognition has become an important field of study. The Audio-Visual Speech Recognition (AVSR) system is known to have accuracy higher than audio-only or visual-only system. The research focused on the visual front end and has been …

    calpoly Repository record for Face Detection and Lip Localization (opens in a new tab)

  12. Audio-visual deep learning

    … modalities, by processing, for instance, video, audio or speech separately. The goal of this thesis is instead utilizing the natural co-occurrence of audio and visual information in videos to learn useful tasks.</p> <p>The thesis is structured around four main themes: (i) lip reading and …

    oxford Repository record for Audio-visual deep learning (opens in a new tab)

  13. Multi-Level Audio-Visual Interactions in Speech and Language Perception

    … rather than individual streams of auditory, visual, and other sensory information has recently provided motivation to move past the long-held tradition of studying these systems separately. Although they are each unique in their transduction organs, neural pathways, and cortical primary …

    maryland Repository record for Multi-Level Audio-Visual Interactions in Speech and Language Perception (opens in a new tab)

  14. Efficient Knowledge Transfer and Adaptation for Speech and Beyond

    … transfer and adaptation in the realm of speech processing. It is structured to address the limitations of transfer learning in dynamically evolving audio and speech processing contexts, particularly through novel approaches for class-incremental learning, parameter-efficient adaptation, …

    trento Repository record for Efficient Knowledge Transfer and Adaptation for Speech and Beyond (opens in a new tab)

  15. Combining speech with sight and touch : investigating the benefits of audio-visual and audio-tactile speech on speech intelligibility and cortical speech-envelope tracking accuracy

    Speech plays a critical role in communication in our everyday lives. Understanding how speech is processed in the brain, from mechanoelectrical transduction in the ear to processing in the subcortical and cortical regions of the auditory pathway, provides insight into how we may improve speech …

    lancaster Download PDF for Combining speech with sight and touch : investigating the benefits of audio-visual and audio-tactile speech on speech intelligibility and cortical speech-envelope tracking accuracy (opens in a new tab)

  16. Speech enhancement using multisensory cooperative computing

    This thesis investigates novel approaches for audio-visual speech enhancement (AVSE) through biologically inspired architectures, lightweight multimodal learning, and hybrid classical–deep frameworks. It advances three complementary themes of the speech enhancement problem. First, Multisensory …

    wlv Repository record for Speech enhancement using multisensory cooperative computing (opens in a new tab) Download file for Speech enhancement using multisensory cooperative computing (opens in a new tab)

  17. The application of manifold based visual speech units for visual speech recognition

    … representation that is referred to as a Visual Speech Unit for visual speech recognition (VSR). The automated recognition of human speech using only features from the visual domain has become a significant research topic that plays an essential role in the development of many multimedia …

    dcu Download PDF for The application of manifold based visual speech units for visual speech recognition (opens in a new tab)

  18. Selective attention and speech processing in the cortex

    … neuronal networks underlying attention to speech stimuli and find that the Frontal Eye Fields play a central 'hub' role in the auditory spatial attention network in a cocktail party experiment. We use magnetoencephalography (MEG) to measure neural signals with high temporal precision, while …

    bu Repository record for Selective attention and speech processing in the cortex (opens in a new tab)

Page 1 of 2