Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 6 of 6 for “"Audio-visual fusion"”.
-
Human Interaction Recognition with Audio and Visual Cues
… just to mention a few. However, the pervasive diffusion of cameras capable of recording audio also makes available to those applications a complementary modality. Despite the sizable progress made in the area of modeling and recognizing group activities, and actions performed by people in …
-
Adaptive multimodal fusion based similarity measures in music information retrieval
… sources of information, e.g., textual metadata, audio content, video content, images, etc. but also multiple aspects of information, e.g., genre, mood, rhythm, etc. Fusing the multiple modalities effectively and efficiently is essential in discovering good similarity measures. In this thesis, I …
-
Audio-Visual Speech Enhancement Using Unsupervised Learning Methods
… and generalization to unseen acoustic and visual conditions. Moreover, many models operate exclusively on audio signals, making them vulnerable in highly adverse noise scenarios. This thesis investigates unsupervised audio-visual speech enhancement using a Recurrent Variational Autoencoder …
-
CROSS-MODALITY COMPLEMENTARITY FOR AUDIO-VISUAL SPEECH RECOGNITION
… Inspired by human processes, the integration of audio and visual modalities enhances robustness in transcribing texts. However, corruption may occur in either modality or both, leading to a degradation in speech recognition. Therefore, utilizing audio-visual complementarity to mitigate corruption …
-
Deep regression models for spatio-temporal expression recognition in videos
… pain, which can be found with the correlation of Visual Analog Scores (VASs) of fatigue and pain. Often pain expressions happen over a shorter period of time, while fatigue happens over a longer duration. Some of the major challenges in dealing with regression of expressions are subtle variations …
-
A multimedia content modeling and classification methodology using visual information for the protection of sensitive user groups
The thesis concerns the problems of visual tracking and violence detection in video sequences. For the visual tracking problem, two feature fusion frameworks are presented. The first tracking framework called 'Model Fusion via Proposal' (MFP) framework, provides a way to efficiently fuse visual …