Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 100 for “"Multimodal fusion"”.
-
Robust Multimodal Fusion for Oncology
Multimodal deep learning models have the potential to significantly improve survival predictions and treatment planning for cancer patients. These models integrate diverse data modalities using early, intermediate, or late fusion techniques. However, many existing multimodal models either …
-
Neural Architecture Search for Multimodal Fusion
… μια διαδικασία γνωστή ως πολυτροπική σύντηξη (multimodal fusion). Παρόλο που έχει αποδειχθεί ότι τα πολυτροπικά συστήματα μπορούν να επιτύχουν βελτιωμένη απόδοση σε σύγκριση με τα μονοτροπικά, ο σχεδιασμός βέλτιστων αρχιτεκτονικών σύντηξης πα- ραμένει μια πρόκληση λόγω του τεράστιου αριθμού …
-
Optimising multimodal fusion for biometric identification systems
… modality at the same time, is known as a multimodal system. Multimodal biometric systems consolidate the evidence presented by multiple biometric sources and typically provide better recognition performance compared to systems based on a single biometric modality. This thesis addresses …
-
Deep Multimodal Fusion Networks for Semantic Segmentation
… segmentation model ENet [39] to learn using a multimodal representation of the environment. Namely we investigate learning from disparity images generated by SGM [20] in conjunction with RGB color images from the Cityscapes dataset [10]. To do this we create a network architecture called …
-
Evidential Reasoning for Multimodal Fusion in Human Computer Interaction
Fusion of information from multiple modalities in Human Computer Interfaces (HCI) has gained a lot of attention in recent years, and has far reaching implications in many areas of human-machine interaction. However, a major limitation of current HCI fusion systems is that the fusion process tends …
-
Multimodal Fusion With Applications to Audio -Visual Speech Recognition
… and in multichannel biometrics defy a universal fusion method for both applications. For audio-visual speech modeling, we propose a novel sensory fusion method based on the coupled hidden Markov models (CHMMs). The CHMM framework allows the fusion of two temporally coupled information sources to …
-
Adaptive multimodal fusion based similarity measures in music information retrieval
… propose and investigate a comprehensive adaptive multimodal fusion framework to construct more effective similarity measures for MIR applications. The basic philosophy is that music documents with different content require different fusion strategies to combine their multiple modalities. Besides, …
-
Multimodal Music Information Retrieval: From Content Analysis to Multimodal Fusion
… (e.g., metadata, audio content). For effective multimodal music retrieval, therefore, it is essential to discover users' information needs and to appropriately combine the multiple facets. Most existing music search engines are intended for general search using textual metadata or example …
-
Any-way and Sparse Analyses for Multimodal Fusion and Imaging Genomics
… to improve the performance of current ICA-based multimodal fusion approaches. These algorithms are further applied to both simulated data and real neuroimaging and genomic data to examine their performance. The identified neuroimaging and genomic patterns can help better delineate the pathology …
-
Multimodal fusion for assessing functional segregation and integration in the human brain
… thesis, we aim to bridge this divide using novel multimodal techniques. In particular, we present techniques to reconcile information regarding anatomical and functional connectivity (AC and FC) in the brain estimated from diffusion MRI (dMRI) and functional MRI (fMRI) data, respectively. Our …
-
A Multi-head Attention Approach with Complementary Multimodal Fusion for Vehicle Detection
… the development of an improved version of the Multimodal Vehicle Detection Network (MVDNet), distinguished by the integration of a multi-head attention layer. This key enhancement significantly refines the network's capability to process and integrate multimodal sensor data, an aspect that …
-
Enhancing Microsleep Prediction Performance Through Temporal Modeling, Multimodal Fusion, and Label-Efficient Learning
… features, and insufficient understanding of multimodal physiological interactions underlying vigilance decline. This thesis addresses these challenges through the development of robust EEG–EOG-based machine learning and deep learning frameworks for multimodal microsleep prediction, with a …
-
Scaling resolution via guided priors: from explicit multimodal fusion to inference-time adaptation of generative foundation models
… tracing a methodological evolution from explicit multimodal fusion in supervised settings to implicit inference-time priors within generative foundation models across 2D and 3D domains. First, we address depth sensor resolution limits through explicit guidance. We propose IGAF (Incremental Guided …
-
MMF-DRL: Multimodal Fusion-Deep Reinforcement Learning Approach with Domain-Specific Features for Classifying Time Series Data
… technique as a supervised classifier by using multimodal (joint representation) scalograms and RP images. The motivation for using such domain-specific features is that they provide additional information to the ML models by capturing domain-specific features (patterns) and also help in taking …
-
Attention and Fusion of Deep Representations for Computer Vision
… we make contributions related to attention andfusion at the intersection of the deep learning and computer vision fields. In our first article, we investigate the design of neural network operators that fuse features extracted from different modalities to make predictions on a single task. We …
-
Comparing multimodal and unimodal representation learning for Rare cancer prediction
Multimodal fusion of Whole-Slide Images (WSIs) and RNA-Sequencing (RNASeq) is expected to improve clinical predictions by integrating complementary morphological and molecular information, yet this premise remains largely untested in rare cancers where sample scarcity limits model training. Here, …
-
Multimodal Depression Detection: An Investigation of Features and Fusion Techniques for Automated Systems
… an in-depth investigation of features and fusion techniques for depression detection systems. We also present OpenMM: a novel tool for multimodal feature extraction. Lastly, we present novel techniques for multimodal fusion. The contributions of this work add considerably to our knowledge …
-
Exploring the Feasibility of Machine Learning Techniques in Recognizing Complex Human Activities
… recognition, multi-person pose estimation, and multimodal fusion. To tackle the problem of monitoring coordinated team activities from spatio-temporal traces, we introduce a new framework that incorporates field of view data to predict team performance. Our framework uses Spatial Temporal Graph …
-
Contactless sensing for future hearing aid device
… overcome these challenges, this thesis explores Multimodal (MM) sensing approach for hearing impairments, focusing on sign language recognition, facial expression analysis, hand and head movement detection, phrase recognition in British Sign Language (BSL) and common signs in American Sign …
Page 1 of 5