Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 6 of 6 for “"Modality alignment"”.
-
Geometric deep learning in drug discovery
… representation learning. These methods target modality alignment, multiscale feature integration, interpretable analysis, and target imbalance in regression. Together, they enable the learning of robust and geometry-aware molecular representations, supporting diverse downstream tasks under …
-
Extending Multimodal Large Language Models Beyond Single Modalities
… MLP projectors. A two-stage training protocol—modality alignment pretraining followed by supervised instruction tuning—is employed using carefully curated datasets for each modality. Experimental results demonstrate that true joint training, especially when paired with high-quality, targeted …
-
Learning Deep Features for Limited-data Visual Problems
… for audio-visual samples. Moreover, cross-modality alignment in the hyperbolic space is key in this approach, leading to clear improvements in several benchmark datasets. Moving to the challenge of open-set recognition, curved space embeddings continue to take the spotlight in the third …
-
Adaptation of deep object detectors for new modalities
… as pixel-level translation and feature-space alignment, are often limited to specific modalities or require extensive retraining, leading to increased computational cost and potential loss of previously acquired knowledge. In contrast to the dominant approach of adapting the model, here we …
-
Grounding in multimodal foundation models: evaluating and improving modality-specific reasoning and generation
… often fail to ground their outputs in the modality that actually contains the relevant evidence. Instead, they tend to rely on dominant priors, particularly textual cues or vision input, even when the task requires reasoning from another modality. This insufficient grounding leads to …
-
Effective multi-modal and multi-domain graph-based recommender systems via self-supervised learning
… designed to explicitly mine and integrate multi-modality and multi-domain signals. This thesis aims to address existing research gaps in the literature by proposing a suite of novel graph-based recommender techniques using the SSL paradigm. It addresses three primary challenges: (i) enhancing the …