Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 24 for “"Multimodal Understanding"”.
-
Multimodal understanding and generation : bridging vision and language
… networks have fundamentally transformed visual understanding and generation. However, traditional vision models are single-modal, failing to generalize to real-world scenarios. In contrast, humans naturally leverage language to both comprehend and create visual content. This dissertation …
-
Multimodal understanding of long documents : from topic modeling to question answering
Long multimodal documents, which contain text, images, and other types of content, are common in real-world settings but remain difficult for natural language processing (NLP) models to process. These documents pose challenges in both understanding their content and training models when labeled …
-
Composition as Bodily Rhetoric: A Multimodal Understanding of Student-Athlete Literacy Practices
“Composition as Bodily Rhetoric: A Multimodal Understanding of Student-Athlete Literacy Practices” examines aspects of the lives, scholarly identities, and different writing that student-athletes engage in while on the field for their sport and off the field in their academics. Utilizing embodied …
-
DIALOG SYSTEMS GO MULTIMODAL
… the development of dialogue systems with multimodal understanding ability. Second, to make the system “smart”, knowledge should be incorporated as a foundation to achieve human-like abilities. Third, due to the interactive nature of dialogues, optimizing the policy of interaction is …
-
Towards Multimodal Interactive Intelligence
Great progress has been made in multimodal generative AI models. However, these models still have limitations. For example, they struggle when handling multimodal data and multi-turn interactions. One reason is the lack of training data for these problems. The research community lacks multimodal …
-
Synergizing Probabilistic Models with Deep Learning: A Novel Framework for Topic Modeling and Multimodal Analysis
… limitations become particularly pronounced in multimodal and cross-domain settings, where textual, visual, and spectral signals interact nonlinearly and where distribution shifts across platforms, languages, and domains are pervasive. While deep learning methods have advanced multimodal …
-
Towards Efficient Deep Learning: From Compression, Search to Unification
… computer vision, natural language processing, multimodal understanding, etc. Meanwhile, deep neural networks are usually parameter-heavy, inefficient, and highly specialized. As a result, there has been a growing demand to improve the efficiency and interoperability of deep neural networks …
-
ADVANCING VISION-LANGUAGE PRETRAINING: UNIFIED ARCHITECTURES AND IMPROVED GROUNDING ABILITIES
… in content retrieval, visual reasoning, and multimodal understanding. However, challenges remain in achieving fine-grained semantic alignment and efficient processing of temporal dynamics in video. Addressing these issues, recent innovations have introduced Object-aware Transformers, which …
-
The Transductive Flu: Disruptive Virality and Biosocial Immunity
… collective immunity against the flu requires a multimodal understanding and approach that integrates biological, social, and cyber-technological perspectives, and that building adaptive, flexible resilience involves fostering community connections through shared experiences and relational …
-
SELF-SUPERVISED MODELING FOR MULTI-MODAL UNDERSTANDING
… understand or interact with the world. These multimodal clues offer different but complementary information. Currently, self-supervised learning has emerged as a promising approach to learn meaningful representations from many modalities separately, including text, speech, and vision. In this …
-
Commonsense for Zero-Shot Natural Language Video Localization
… of leveraging commonsense reasoning abilities in multimodal understanding tasks.
-
Towards Unified and Generalizable Multimodal Foundation Models
Recent advances in multimodal models have reshaped multimodal learning by leveraging large language models (LLMs) as backbones and integrating them with vision encoders or diffusion models. These approaches have achieved strong performance in either multimodal understanding or multimodal …
-
Knowledge-Centric Multimodal Intelligence: Understanding, Reasoning, and Generation
Generative multimodal foundation models now handle a wide range of tasks spanning understanding, reasoning, and generation. Yet the knowledge they draw on at inference time is bounded by what their finite parameters memorized during training, leading to fabricated content, missed low-frequency …
-
Bridging Multimodal Learning and Planning for Intelligent Task Assistance
Task-assistance systems provide adaptive, multimodal guidance for complex, step-based activities such as cooking and DIY projects. A central challenge lies in enabling these systems to interpret real-world scenarios—understanding user intent from verbal, visual, or textual cues and generating …
-
Participants’ Perceptions of a Receptive Raga Music Therapy Experience: An Interpretative Neurophenomenological and Arts-Based Analysis
… offered a more embodied and comprehensive understanding of the phenomenon. The results were integrated in the discussion. This study contributes to an intercultural and multimodal understanding of raga in receptive music therapy and explores potential applications in guided imagery and …
-
TOWARD HUMAN-CENTRIC VISUAL INTELLIGENCE THROUGH MULTIMODAL LEARNING
… interpretations aligned with human expectations. Multimodal Large Language Models (MLLMs) provide rich semantic priors, yet remain limited in spatial grounding, computational efficiency, and reliable preference alignment. This dissertation addresses these challenges through multimodal methods that …
-
Physical-World Visual Intelligence Through Structured and Generative Representations
… dense prediction, vision-language alignment, and multimodal understanding. The second part focuses on structured reasoning about the physical world. I introduce a framework that extracts explicit 3D representations from visual inputs and encodes them as structured programs that language models can …
-
Understanding and Modeling Explicit and Implicit Representations of the Visual World
… the same time worth more than a million pixels. Understanding the local and global structures of these pixels, and their meaning, has been a core problem since the birth of computer vision, enabling tasks like classification and image generation. Storing such massive amounts of pixels is another …
-
High sensitivity stimulated Raman microscopy for metabolism mapping
… systems due to two key limitations: the lack of multimodal information integration and the sensitivity constraints that limit detection to millimolar concentrations. My thesis work addresses these challenges with two major innovations. To enable multimodal understanding of complex biological …
-
A critical multimodal discourse analysis of German language motivation in Deutsche Welle's website media and its relation to soft power
… guide on user-centred design principles, and the multimodal analysis of the aesthetics and functionality of interactivity (the affordance of a text being acted upon) is applied from Adami’s (2015) Social semiotic framework. The third analysis is literary and studies the narrative elements of …
Page 1 of 2