Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 21 for “"Modality Fusion"”.
-
Multi-modality fusion : registering photographs, videos, and LIDAR range scans
… traditional photographs. However, fusing multi-modality data is a very challenging task given the repetition and ambiguity that often occur in man-made scenes as well as the variety of properties different renderings of the same subject can possess. Image sets collected over a period of time …
-
SAMFusion3D: Self-adaptive multi-modality fusion for 3D object detection in autonomous driving
… computational efficiency. Furthermore, as each modality’s features are processed through Vision Transformers, particularly in the self-attention mechanism where the attention values for features are computed, it has been observed that adhering to the conventional pipeline approach results in …
-
Further Improvements in Human Emotion and Wellbeing Prediction: Personalization, Modality Fusion, and Semi-Supervised Learning
… there are challenges that remain, such as modality missing, heterogeneity among subjects, and label sparseness. In this thesis, we addressed obstacles in modeling physiological and behavioral data. (1) We proposed a job-role based multi-task and multi-label learning to build models for …
-
Multimodal Conversational AI: Understanding, Reasoning, and Generation
… by two cross-cutting methodological themes: modality fusion and reinforcement learning. Part I: Understanding. Efficient speech processing is foundational to real-time conversational systems. We first introduce STAR, which dynamically segments and compresses streaming speech through learned …
-
Effective multi-modal and multi-domain graph-based recommender systems via self-supervised learning
… designed to explicitly mine and integrate multi-modality and multi-domain signals. This thesis aims to address existing research gaps in the literature by proposing a suite of novel graph-based recommender techniques using the SSL paradigm. It addresses three primary challenges: (i) enhancing the …
-
Quantum Cognitively Motivated Context-Aware Multimodal Representation Learning for Human Language Analysis
… visual acoustic), i.e., <i>multimodal fusion</i>. In the last few years, significant strides have been made towards the interpretation of human language due to simultaneous advancement in deep learning, data gathering and computing infrastructure. AI models have been investigated to …
-
Video understanding using multimodal deep learning
… Representation Learning, and (iii) Modality Fusion.</p> <p>In cross-modal supervision, data labels from a supervision-rich modality are used to learn representations in another, supervision-starved target modality, eschewing the need for costly manual annotation in the target …
-
Σημασιολογική ανάλυση πολυμεσικού περιεχομένου με χρήση τεχνικών μηχανικής μάθησης
… analysis is proposed for jointly performing modality fusion and temporal context exploitation.
-
Design of Multi-modality Deep Fusion Architecture for Deep Acoustic Analytics
… the features are extracted from the audio, how modality represents the audio data, and how much noise is present in raw audio. With the rapid increase of environmental datasets, extracting relevant data to create an adequate environmental sound classification is a crucial challenge. Deep …
-
Investigating Notification Presentation and Interaction in Augmented Reality
… we examined notification positioning, modality, interaction methods, real-world smartglasses usage, and task resumption strategies for interruptions. Our findings provide insights into designing effective AR notification systems while balancing usability and intrusiveness. First, we …
-
Retrieval-First HD-Map Maintenance through Semantic Conditioning and Multimodal Predictive Pretraining
… mask transitions. The second uses learned fusion over RGB, semantic-mask, and semantically conditioned image streams. Its semantic-span joint-embedding predictive-pretraining strategy predicts semantically coherent masked-region representations and is providing significant enhancement over …
-
Glioma Segmentation in MRI using a 3D Hybrid U-NET with Adaptive Self-Attention and Multi-Modal Fusion
… segmentation methods do not fully preserve modality-specific information, process all modalities and slices uniformly, and often rely on a single shared fusion strategy for all sub-regions. These limitations can reduce segmentation accuracy, increase computational cost, and limit clinical …
-
Investigating notification presentation and interaction in augmented reality
… we examined notification positioning, modality, interaction methods, real-world smartglasses usage, and task resumption strategies for interruptions. Our findings provide insights into designing effective AR notification systems while balancing usability and intrusiveness. First, we …
-
Automatic, integrated and structured reporting for radiology image examinations
… data sources has expanded the potential for modality translation tasks in artificial intelligence, particularly in converting images into natural language descriptions. In the clinical domain, particularly in chest X-ray (CXR) analysis, advancing Computer-Aided Detection (CAD) and Diagnosis …
-
Αναγνώριση και μοντελοποίηση της προσοχής και του ενδιαφέροντος του χρήστη σε περιβάλλοντα μη παρεμβατικής αλληλεπίδρασης
… environments, using face analysis as input modality. Research focuses on those cases where no specific knowledge regarding the set up, or specialized equipment exists, apart from simple hardware, like a common web-camera. Normally, such systems are based on admissions regarding user …
-
High Accuracy Distributed Target Detection and Classification in Sensor Networks Based on Mobile Agent Framework
… that the distributed scheme with the Bayesian fusion method have better performance in the sense that they have the highest detection probability and the most stable performance. In addition, the progressive intra-cluster estimation can reduce data transmission by 83.22% and conserve energy by …
-
Design of deep learning models for real-time gas leak monitoring
… demonstrating the importance of multi-modality fusion. The findings of the thesis establish a foundation for future research on quantifying volumes or identifying types of gas leaks.
-
Geolocation in Cartographic Maps Using Street-Level Images
… develop a triplet-like architecture with a multi-modality fusion module to learn an image-map embedded space. By capturing complementary information, our method generates representative location embeddings from images and multi-modal maps, yielding Top-1 recall rates between 60% and 82%.<br/>A …
-
Deep Multimodal Fusion Networks for Semantic Segmentation
… feature extraction branches followed by a modality fusion network. We avoid using depth encoding strategies such as HHA [15] due to their computational cost and instead operate on raw disparity images. We also constrain the resolution of training and testing images to be relatively small, …
-
Multi-modal Multi-Level Neuroimaging Fusion with Modality-Aware Mask-Guided Attention and Deep Canonical Correlation Analysis to Improve Dementia Risk Prediction
… leverages a two-stage pipeline involving modality-specific feature extraction using ResNet50 backbones, followed by middle fusion enhanced with a Modality-Aware Mask-Guided Attention (MAMGA) mechanism. To address missing modalities and inter-modal misalignment, the model incorporates …
Page 1 of 2