Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 140 for “"Vision and language"”.
-
Interactive Vision and Language Learning
Effective and efficient interactions with humans in real environments is an appealing though challenging task for an artificial agent. Despite recent advances in deep learning, especially in the branch of vision and language learning, there are still unsolved issues in the way of reaching such an …
-
Representations from vision and language
Replicating a human-level understanding of the physical world in computers is a monumental task. Achieving this requires building representations of concepts that manifest themselves visually, linguistically or through other senses. Furthermore concepts do not exist in isolation but are related to …
-
General Vision and Language Methods in Real Applications: A Focus on Vision-and-Language Navigation
The field of Vision and Language has aroused significant interest and holds tremendous potential for real applications, particularly in the area of Vision-and-Language Navigation (VLN). The VLN task enables robots to understand navigation instructions expressed in natural language, perceive the …
-
Event Structure In Vision And Language
… thematic roles (e.g., Agent), Causation, Motion, and Transfer. For example, “Alex gave Jesse flowers” and “Jesse gave Alex flowers” both refer to an event of transfer, with the directionality of the transfer having different social consequences. The goal of the present research is to examine the …
-
Knowledge-Augmented Vision-and-Language Assistant
… the concept of knowledge augmentation in vision-and-language (VL) models, a pivotal area in artificial intelligence that enhances how machines perceive and articulate visual content. While the potential of these models is immense, their development is hampered by a notable shortfall in …
-
UNDERSTANDING ALIGNMENT FOR VISION AND LANGUAGE MODELS
Alignment plays a central role in enabling vision and language models (VLMs) to generalize, adapt, and perform effectively across a wide range of tasks and domains. This thesis investigates alignment as a key principle across multiple stages of model development, providing a unified perspective on …
-
VISION AND LANGUAGE LEARNING WITH LIMITED RESOURCES
Vision-and-language (VL) understanding aims to equip machines with human-like capabilities for cross-modal comprehension. This involves simultaneously processing and integrating visual and textual inputs to produce meaningful, human-understandable responses. Representative tasks within this domain …
-
Vision and Language: Information Integration and Transformation
Images and text are large-scale data sources for deep learning models to mimic how humans perceive and understand multimodal information. Combining images and text can construct better feature representations by involving complementary information from different sources. For example, text …
-
Vision and language understanding with localized evidence
Enabling machines to solve computer vision tasks with natural language components can greatly improve human interaction with computers. In this thesis, we address vision and language tasks with deep learning methods that explicitly localize relevant visual evidence. Spatial evidence localization in …
-
Toward embodied navigation through vision and language
… based on a challenging task. In particular, the Vision-and-Language Navigation (VLN) task requires a robot to navigate based on a descriptive human-language instruction. This thesis aims to improve VLN agents on four key aspects - their understanding of the environment, training via additional …
-
Multimodal understanding and generation : bridging vision and language
Over the last decade, deep learning and neural networks have fundamentally transformed visual understanding and generation. However, traditional vision models are single-modal, failing to generalize to real-world scenarios. In contrast, humans naturally leverage language to both comprehend and …
-
Vision-and-Language Navigation in the Real-World
In recent years, Vision-and-Language Navigation (VLN) has emerged as a crucial challenge in the field of artificial intelligence, focusing on training intelligent agents to navigate to specified target locations by following natural language instructions. This thesis delves into the realm of VLN by …
-
Unfolding shared semantic representations in vision and language
When we interact with language, the brain effortlessly draws vivid mental images that resemble representations of directly perceived visual scenes. Similarly, research shows that the visual system encodes representations of visual scenes in a manner akin to how embeddings from large language models …
-
Generative and Multimodal Learning for Vision and Language
L'abstract è presente nell'allegato / the abstract is in the attachment
-
Deep Generative Models for Vision and Language Intelligence
… with applications in various tasks involving vision and language intelligence. In this dissertation, I will mainly discuss the contributions that I have made in this field during my Ph.D. study. Specifically, the dissertation is divided into two parts. </p><p>In the first part, I will mainly …
-
Cognitive Map Generation for Vision and Language Navigation
Visual-Language Navigation (VLN) presents significant challenges for autonomous agents, such as robots and virtual assistants, particularly in complex, dynamic environments where the seamless integration of visual perception and natural language understanding is critical. Traditional VLN systems …
-
Joint Vision and Language Modeling for Semantic Understanding
Vision-and-language is the intersection of computer vision and natural language processing. It is a broad field of study which aims to jointly understand and interpret both visual contents, e.g., images or videos, and texts. Vision-and-language is critical for building intelligent agents that can …
-
Efficient vision and language models for autonomous systems
The transition of vision-based systems, including autonomous vehicles, from controlled lab environments to real-world deployment poses significant challenges due to constraints such as limited data availability and computational resources. Current approaches often rely on sending data to remote …
Page 1 of 7