Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 59 for “"multimodal representation"”.
-
Multimodal Representation Learning for Geospatial Soundscape Mapping
… mapping problem from the perspective of multimodal representation learning and have developed a series of frameworks—GeoCLAP, PSM, and Sat2Sound—to address this task. For each framework, we demonstrate the effectiveness of a shared multimodal representation space in generating soundscape …
-
Self-Supervised Multimodal Representation Learning for Neuroimaging
… have to build computationally and data-efficient multimodal models while ensuring interpretability, robustness, and fairness. We have taken two significant steps toward this goal. First, we introduce a fast, accurate, and multimodal architecture for segmenting brain tissues and atlas regions that …
-
Multimodal representation learning for fine art analysis
This thesis develops multimodal representation learning methods for fine art analysis. Fine art exists within historically situated systems of creation, interpretation, and institutional evaluation in which artworks, artists, movements, and institutions are simultaneously represented as visual …
-
Multimodal Representation Learning Using Self-Supervision and Attention
… the efficiency of the system. Hence, learning representations simultaneously from multiple modalities is better than learning from a single modality while approaching problems like image/text classification, image-to-text/text-to-image transformation, object detection and segmentation. A method …
-
Multimodal representation learning with application in sentiment analysis
Multimodal learning is the computational paradigm focused on learning and integrating heterogeneous and interconnected information sources, i.e., modalities. At the core of any multimodal learning system lies multimodal representation learning, which aims to learn representations that both reflect …
-
Multimodal Representation Learning in Medical Using Vision-Language Models
Recent advances in multimodal models such as LLaVA and InstructBLIP highlight the importance of high-quality image encoders, particularly in the biomedical domain where figures and captions are complex. Existing medical vision–language datasets primarily emphasize scale, often overlooking data …
-
Multimodal Representation Learning for Textual Reasoning over Knowledge Graphs
… search. This creates a need for multi-modal representations that capture both the semantic and structural features from the KGs. The primary objective of the proposed work is to extend the accessibility of KGs to non-expert users/institutions by enabling them to utilize non-technical textual …
-
Quantum Cognitively Motivated Context-Aware Multimodal Representation Learning for Human Language Analysis
… systems that can perceive and understand human multimodal language. This requires both the consideration of context in the form of surrounding utterances in a conversation, i.e., <i>context modelling</i>, as well as the impact of different modalities (e.g., linguistic, visual acoustic), i.e., …
-
Multimodal Representation Learning Frameworks for Modeling Progression and Heterogeneity in Alzheimer’s Disease
… capabilities, particularly in deep learning, multimodal representation learning frameworks aim to integrate diverse clinical modalities into a cohesive framework, capturing the most significant patterns within each modality. Existing data-driven multimodal representation learning frameworks in …
-
Multimodal Representation Learning Frameworks for Modeling Progression and Heterogeneity in Alzheimer’s Disease
… capabilities, particularly in deep learning, multimodal representation learning frameworks aim to integrate diverse clinical modalities into a cohesive framework, capturing the most significant patterns within each modality. Existing data-driven multimodal representation learning frameworks in …
-
Multimodal representation and translation of the official UK tourism website into Chinese
This thesis investigates the online multimodal representation of tourism destinations, and examines how these representations are communicated in a different locale through translation and localisation processes. It takes the official UK tourism website VisitBritain as a case study. Visual and …
-
Towards image-based node embedding: A novel approach for enriching multimodal representation
Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2024-08-01
-
Multimodal Representation Learning for Face Understanding: From Caption Supervision to Foundation Model Adaptation
… foundation models have greatly improved visual representation learning, their patch-based tokenization and lack of spatial inductive bias limit their ability to capture fine-grained details in low-resolution inputs. This dissertation investigates multimodal representation learning for face …
-
Toward Generalist Ophthalmic Intelligence: From Scalable Multimodal Representation Learning to a Clinical World Model
… moved from hand-specified rules into the learned representation; that doing so increases the range of clinical questions a single model can answer without making the architecture grow with the number of modalities; and that the resulting gain concentrates on tasks requiring integration across …
-
Efficient and Interpretable Representations: From Medical Representation Learning to Vision-Language Multimodal Representation Engineering
Visual representation learning has achieved remarkable progress on natural image benchmarks, but faces critical challenges when deployed in specialized domains like medical imaging. This thesis addresses two interconnected problems: developing efficient architectures that maintain performance while …
-
Multimodal representation learning for personalized cardiovascular care : predicting disease progression and treatment from clinical data
… thesis presents a series of deep learning-based multimodal representation learning frameworks for personalized cardiovascular disease management, using routinely collected and non-invasive clinical data. The thesis first introduces TREAT-Net, an acute coronary syndrome treatment prediction …
-
AN ANALYSIS OF BOTTOM-UP ATTENTION MODELS AND MULTIMODAL REPRESENTATION LEARNING FOR VISUAL QUESTION ANSWERING
… performance (accuracy) of VQA. The first is a representation learning approach (utilizing the state-of-the-art Generative Adversarial Models (GANs) (Goodfellow, et al., 2014)) to improve the image encoding system of VQA. This thesis evaluates four variants of GANs to identify a GAN architecture …
-
Multimodal representation of power dynamics in todd field’s film “tár” (2022) and its rendition into lithuanian in professional subtitles and ai translation /
… subtitles, examining how power is constructed multimodally and rendered in translation. The study is grounded in Allen’s (1998) theory of power modalities (Power Over, Power To, Power With), Butler’s (1999) concept of gender performativity, cinematic gaze theories by Mulvey (1975), Kaplan …
-
REPRESENTATION LEARNING OF DATA WITH MULTIPLE MODALITIES WITH APPLICATIONS TO VISUAL QUESTION ANSWERING
… With this thesis, I address the challenges of representation learning of multimodal data. First, I develop a novel multimodal representation learning and fusion method. The proposed method employs a modular deep neural network where each module learns a representation of a different aspect of …
Page 1 of 3