Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 284 for “"Multimodal Data"”.
-
On effective learning for multimodal data
… we aim to broaden the scope of learning from multimodal information, enhance its integration, and solve problems related to humancentric spatio-temporal perception in a manner that does not necessarily require complete supervision (e.g., granular spatio-temporal multi-modal alignment). …
-
Analyzing emotion regulation using multimodal data
… This is done by analyzing electrocardiography data (EKG), electroencephalogram data (EEG), galvanic skin response (GSR), and facial action units (FAU) data with machine learning algorithms such as convolutional neural networks (CNN), gated recurrent units (GRU), long short term memory (LSTM) …
-
Multimodal Data Fusion for BEV Perception
… perception is the transformation of multi-sensor data from perspective view (PV) to BEV. The quality and efficiency of this transformation play a critical role in influencing the performance of subsequent specific tasks. This thesis project aims to study comprehensive multimodal data fusion …
-
Analysis of Contextual Emotions Using Multimodal Data
… emotions, without taking bias (e.g. gender, data bias), context, or temporal information into account. Psychology has shown the difficulty of analyzing emotions without incorporating this type of information. In this dissertation, we have proposed new approaches to recognizing emotions by …
-
Deep Learning with Multimodal Data for Healthcare
… healthcare information is well known for its big data that is too vast and complex to manage manually. The healthcare data is heterogeneous, containing different modalities or types of information such as text, audio, images, and multi-type. Over the last few years, the Deep Learning (DL) approach …
-
Leveraging Multimodal Data for Egocentric Video Understanding
… to date has focused narrowly on 2D visual data. This overlooks the rich, multimodal signals humans naturally integrate to perceive and act in the world. This thesis argues for a more holistic paradigm, asserting that a true understanding of egocentric activity requires the fusion of diverse …
-
Learning without Expert Labels for Multimodal Data
… due to the availability of large-scale labeled datasets, obtaining labeled datasets at the required granularity is challenging in many real-world applications, especially in scientific domains, due to the costly and labor-intensive nature of generating annotations. Hence, there is a need to …
-
Learning latent structures in audio from multimodal data
… of learning latent structures in audio through multimodal data, enabling applications across speech and audio recognition and generation while simplifying pipelines and advancing state-of-the-art performance. The first half of the dissertation explores visually grounded speech (VGS), a learning …
-
Toward More Predictive Models by Leveraging Multimodal Data
<p>Data is often composed of structured and unstructured data. Both forms of data have information that can be exploited by machine learning models to increase their prediction performance on a task. However, integrating the features from both these data forms is a hard, complicated task. This is …
-
Recognizing Emotion in the Wild Using Multimodal Data
… I will present our approach of using multi-modal data for recognizing human emotion and behavior in the wild. The study is divided into four tasks: group emotion recognition, driver gaze prediction, student engagement prediction, and emotion recognition using physiological signals. We explore …
-
Multimodal data analysis applied to a medical setting
… have traditionally been studied using genetic data, or images alone. To understand the biology of such diseases, joint analysis of multiple data modalities could provide interesting insights. We propose the use of canonical correlation analysis (CCA) as a preliminary discovery tool for …
-
Multimodal Data Fusion and Attack Detection in Recommender Systems
… missing values, imbalanced and heterogeneous data, and noisy observations. Such characteristics render the process of exploiting the information nontrivial, as one should carefully address them during the data fusion process. In addition to the degenerative characteristics, some entries can be …
-
Accessible and Automated Optical Motion Capture with Multimodal Data
… is difficult. However, we found that augmenting data with RGB monocular video helps with marker labeling and solving. We introduce an optimization framework for labeling and solving with unknown marker layouts that leverages a pose and shape estimate from monocular video. Finally, we extend the …
-
Analysis of Multimodal Data Integrating Genomics and Spatial Information
… the way for the processing of high-dimensional data. Benefiting from this, current research in the bioinformatics field has been utilizing sophisticated deep learning architecture to understand the complex human biological system. Spatial Transcriptomics (ST), a popular recent technology, …
-
Multimodal Data Fusion and Machine Learning for Advancing Biomedical Applications
… examining the transformative potential of data fusion techniques to refine our understanding and diagnosis of health conditions. Daily influxes of diverse biomedical data prompt an exploration into the challenges arising from relying solely on individual imaging modalities. The central …
-
Multimodal Data Fusion and Model Compression Methods for Computer Vision
… object detection methods when applied to RS data. Traditional techniques often struggle due to the small size of targets, limited training data, and diverse modalities involved. To overcome these challenges, we introduce YOLOrs, a novel CNN designed specifically for real-time object detection …
-
Strategies for Analysis of Unimodal and Multimodal Data for Simulation
… thesis is to provide strategies for analysis for data associated with simulation. Data analysis is an important part of the simulation process. Typically more stress is laid upon the development of the computer simulation while the data analysis takes a back seat. However, the accuracy of a …
-
Learning-based Methods for Optimising Shared Mobility Systems with Multimodal Data
… in Shared Mobility Systems (SMS), utilising multimodal data to address three key operational challenges: improper parking behaviour, energy consumption prediction, and pollution-aware routing. The overarching goal is to improve the efficiency, sustainability, and user experience of SMS …
-
ORCHESTRATED APPROXIMATE MESSAGE PASSING: A NOVEL WAY OF MULTIMODAL DATA INTEGRATION
Multimodal data analysis has garnered considerable attention in data science due to its wide applicability across several scientific disciplines. However, developing efficient and statistically sound procedures for information integration in multimodal datasets remains a challenge. In this …
Page 1 of 15