Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 16 of 16 for “"Vision-and-language navigation"”.
-
Vision-and-Language Navigation in the Real-World
In recent years, Vision-and-Language Navigation (VLN) has emerged as a crucial challenge in the field of artificial intelligence, focusing on training intelligent agents to navigate to specified target locations by following natural language instructions. This thesis delves into the realm of VLN by …
-
Cognitive Map Generation for Vision and Language Navigation
Visual-Language Navigation (VLN) presents significant challenges for autonomous agents, such as robots and virtual assistants, particularly in complex, dynamic environments where the seamless integration of visual perception and natural language understanding is critical. Traditional VLN systems …
-
Improving Grounding Ability of Vision and Language Navigation Agents
Thesis (Ph.D.)--Michigan State University. Computer Science - Doctor of Philosophy, 2025
-
Bayesian State Tracking and Sim-to-Real Transfer for Vision-and-Language Navigation
A visually-grounded navigation instruction can be interpreted as a sequence of expected observations and actions an agent following the correct trajectory would encounter and perform. Based on this intuition, we formulate the problem of finding the goal location in Vision-and-Language Navigation …
-
General Vision and Language Methods in Real Applications: A Focus on Vision-and-Language Navigation
The field of Vision and Language has aroused significant interest and holds tremendous potential for real applications, particularly in the area of Vision-and-Language Navigation (VLN). The VLN task enables robots to understand navigation instructions expressed in natural language, perceive the …
-
COMPOSITIONAL GENERALIZATION IN INSTRUCTION FOLLOWING TASKS
Understanding instructions expressed in natural language is a fundamental task in artificialintelligence. A key feature of natural language that humans use while giving and following instructions is compositionality: the capacity to understand and produce a potentially infinite number of novel …
-
Sim2Robot: Training Robots for the Real-World with Imperfect Simulators
… real-world can be slow, dangerous, expensive, and difficult to reproduce. Thus, one paradigm in robot learning is to leverage simulation for training robots (where gathering experience is scalable, safe, cheap, and reproducible) before being deployed in the real world. However, no simulator is …
-
Multi-modality Data Analysis Using Deep Reinforcement Learning
… mimics human learning behaviours through trial-and-error. Deep Reinforcement Learning has been developing steadily after decades of research and development. It has a wide range of applications that can deal with multi-modality data, such as robot navigation, traffic signal control, self-driving …
-
On the Knowledge Transfer via Pretraining, Distillation and Federated Learning
… in many pragmatic domains such as computer vision(CV) and natural language processing(NLP). The very standard paradigm is \emph{pre-training}: a large model with billions of parameters is trained on a surrogate task and then adapted to the downstream task of interest via fine-tuning. …
-
Toward grounded spatio-temporal reasoning
… Intelligence (AI) system that can understand the world around us, it needs to be able to interpret and reason about the world we see and the language we speak. In recent years, there has been a lot of attention to research at the intersection of vision, temporal reasoning, and language. …
-
Toward embodied navigation through vision and language
… various tasks. This thesis studies the embodied navigation problem in which a robotic agent navigates in a previously unseen indoor environment based on a challenging task. In particular, the Vision-and-Language Navigation (VLN) task requires a robot to navigate based on a descriptive …
-
Interactive Vision and Language Learning
Effective and efficient interactions with humans in real environments is an appealing though challenging task for an artificial agent. Despite recent advances in deep learning, especially in the branch of vision and language learning, there are still unsolved issues in the way of reaching such an …
-
Finding the Optimal Path in Real-World Environments Using Natural Language Instructions
… in real indoor environments by following natural language instructions is a long-term goal in artificial intelligence research. In this regard, vision-and-language navigation (VLN) has attracted increasing attention recently. Among the proposed benchmarks, remote embodied visual referring …
-
Learning 3D Robotics Perception using Inductive Priors
… the potential to ingest a large amount of data and be really good at performing digital tasks such as text-to-image generation, machine-human conversation, and image recognition. This thesis covers the topic of learning with structured inductive bias and priors to design approaches and …
-
Vision and Language Learning: From Image Captioning and Visual Question Answering towards Embodied Agents
… we are converting information between visual and linguistic representations. Indeed, for many tasks it is essential to reason jointly over visual and linguistic information. People do this with ease, typically without even noticing. Intelligent systems that perform useful tasks in unstructured …