Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 38 for “"Multi-modal Fusion"”.
-
Observation Points based Multi-modal Fusion Systems for Skeleton Action Recognition
… using them to create fused representations from multiple modalities such as joints and bones, can enhance the discriminative power of the original modalities. Moreover, such representations can be used to create new streams in multi-stream networks that fuse constructively with other streams …
-
Exploiting Multi-Modal Fusion for Urban Autonomous Driving Using Latent Deep Reinforcement Learning
… for autonomous driving. However, exploiting multi-modal fusion to generate pixel-wise perception and motion prediction and then leveraging these predictions to train a latent DRL has not been targeted yet. Unlike other DRL algorithms, the latent DRL algorithm distinguishes representation …
-
Glioma Segmentation in MRI using a 3D Hybrid U-NET with Adaptive Self-Attention and Multi-Modal Fusion
Accurate glioma segmentation from multi-modal Magnetic Resonance Imaging (MRI) is essential for diagnosis, treatment planning, surgical guidance, radiation targeting, and longitudinal monitoring. MRI modalities such as T1, T1Gd, T2, and FLAIR provide complementary information for identifying …
-
Millimeter-wave radar dataset for multi-modal fusion and keypoint detection in under-canopy soybean and corn row navigation
… cover). To our knowledge, this is the first multi-modal dataset of its kind in agricultural settings. Building on this resource, we investigate an end-to-end deep learning framework for radar-based keypoint prediction that leverages unprocessed range–azimuth radar data. The model employs …
-
Cooperative graph signal processing and learning for situational awareness of autonomous vehicles
… and develop innovative and efficient cooperative multi-modal data fusion solutions for cooperative localization and tracking of connected and automated vehicles, implemented in a distributed manner by an ego vehicle along with either its connected neighborhood or non-cooperative static landmarks. …
-
A multi-resolution multi-source and multi-modal (M3) transductive framework for concept detection in news video
… (shot), single source (training data), and multi-modal fusion methods under a supervised inductive inference framework. In this thesis, we present a novel multi-resolution, multi-source and multi-modal transductive learning framework. As different modal features only work well in different …
-
Missing Modality Robustness in Semi-supervised Multi-modal Semantic Segmentation
Using multiple spatial modalities has been proven helpful in improving semantic segmentation performance. However, there are several real-world challenges that have yet to be addressed: (a) improving label efficiency and (b) enhancing robustness in realistic scenarios where modalities are missing …
-
Video Game Genre Classification Based on Deep Learning
… For the third approach, we constructed a multi-modal fusion model, which concatenates extracted features from one image-based model and one text-based model. We analysed our results and revealed some challenges that exist in the task of genre classification for video games. Some future …
-
Learning Rich Representations for 4D Scene Understanding
… volumes of sensory data in real-time; (2) robust fusion of heterogeneous data modalities; (3) information bottlenecks and compounding errors in modular architectures. To address these challenges, this thesis proposes a principled approach: \textit{learning rich spatiotemporal representations with …
-
Book Genre Classification By Its Cover Using A Multi-view Learning Approach
… Inception V2. Moreover, we add an extra modality by extracting text from the cover image. We explore some text classification algorithms such as LSTM and Universal Sentence Encoder. Moreover, we focus on multi-modal fusion based on two best performing models on cover images and text. …
-
Convolutional Neural Networks for Early Diagnosing of Breast Cancer
… This study takes a novel approach to the fusion model because only a few models have been developed to integrate both clinical and imaging data for diagnostic purposes, and few of them have included both EHR and longitudinal imaging data. Therefore, this study compared various multi-modal …
-
Resilient Multi-Modal Robot Localization in Perception Degraded Environments
… aerial robotics domain. However, such sensing modalities cannot penetrate and provide informative data in all conditions. In particular, visible light cameras cannot provide accurate data in poorly-illuminate or dark environments, while LiDAR systems are sensitive to geometric self-similarity …
-
Deformable lung registration for pulmonary image analysis of MRI and CT scans
… namely: designing an image similarity for multi-modal scans or scans of locally changing contrast, modelling of complex lung motion, which includes sliding motion, and approximately globally optimal mathematical optimisation to deal with large motion of small anatomical features. The two …
-
Remote Respiratory Monitoring from Video Data
… complementary strengths; (4) Recording a public multimodal dataset featuring synchronized thermal and RGB video with ground-truth respiratory and ECG signals, enabling robust multi-modal model development. Additionally, this thesis introduces a multi-modal fusion approach combining RGB and …
-
Intelligent Industrial Maintenance: Using Natural Language Processing Technology and Domain Knowledge for Decision Support
… struggle to effectively integrate and analyse multi-modal and heterogeneous data sources, leading to suboptimal maintenance decisions. This thesis presents a comprehensive and integrated framework for intelligent maintenance system that leverages advanced natural language processing techniques, …
-
Camera-LiDAR Fusion-based 3D Object Detection for Autonomous Driving
… and dynamic real-world conditions. Although multi-modal fusion methods have shown promise, existing approaches often exhibit limited cross-modal interaction and rigid fusion strategies, resulting in suboptimal performance in complex scenarios. To overcome these limitations, this research …
-
Machine Learning-Based State of Health and Aging-Aware Power Capability Estimation for Battery Systems
… methodology is developed and validated across multiple commercial cell chemistries, pulse durations, temperatures, and aging levels, offering significant accuracy improvements over conventional hybrid pulse power characterization (HPPC) techniques. Data generated from this work reveals key …
-
Investigations on deep learning techniques for property assessment
… network (CNN) based method, attention-based multi-modal fusion (AMMF), is proposed to estimate property values with house attributes and corresponding street maps which contain features of topography. The experimental results indicate the proposed method outperforms the contemporary …
-
Automated Head Impact Detection in Youth Ice Hockey: A Two-Stage Deep Learning Approach
… approach (Model A) and a full-frame multi-modal fusion approach (Model B). Experiments show that the optimal deployment strategy uses a player-centric architecture for Stage 1 and a full-frame architecture for Stage 2. The best Stage 1 model (Model A: TSM + Motion) achieves 75% recall …
-
3D object detection and tracking for autonomous vehicles
… advances in neural networks for single-modality approaches. However, it has been surprisingly difficult to train networks to use multiple modalities in a way that demonstrates gain over single-modality networks. In this dissertation, we first propose three networks for Camera-LiDAR and …
Page 1 of 2