Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 19 of 19 for “"language grounding"”.
-
Graph-based language grounding
In recent years, phrase (or more generally language) grounding has emerged as a fundamental task in computer vision. Phrase grounding is a generalization of more traditional computer vision tasks with the goal of localizing a natural language phrase spatially in a given image. Most recent work use …
-
Spatial language driven robot
… a robot to interact with human using spatial language. A prototype system of human-robot interaction using spatial language running on an autonomous robot is proposed in the dissertation. The system includes two complementary works. One is to control the robot by human natural spatial language …
-
Language Guided Localization and Navigation
… require active perception are key to improving language grounding models and creating holistic social agents. In this dissertation we explore four multi-modal embodied perception tasks and which require localization or navigation of an agent in an unknown temporal or 3D space with limited …
-
Joint Perceptual Learning and Natural Language Acquisition for Autonomous Robots
… robots face a similar challenge in understanding language and perception to allow for a natural and effortless human-robot interaction. Acquiring such knowledge is a challenging task, unless this knowledge is preprogrammed, which is no easy task either, nor does it solve the problem of language …
-
The design, education and evolution of a robotic baby
… of the robotic baby are demonstrated in natural language acquisition and semantic parsing in English and Chinese, as well as in natural language grounding, natural language reinforcement learning, natural language programming and system introspection for explainability. Furthermore, the education …
-
Labeling and Automatically Identifying Basic-Level Categories
… basic-level categories may be a useful signal in language grounding applications.
-
Modeling physical causality of action verbs for grounded language understanding
… understand and communicate through human natural language is one of the ultimate goals in AI. Decades of natural language processing research has been mainly focused on learning from large amounts of language corpora. However, human communication relies on a significant amount of unverbalized …
-
Adopting Markov Logic Networks for Big Spatial Data and Applications
… MLN is composed of two main components, namely, grounding using factor graphs and inference using Gibbs sampling. The factor graph is used as the main data structure for learning and inferring the weights of the MLN features, while Gibbs sampling infers the values of model variables and computes …
-
Seeing Grace: Religious Rhetoric in the Deaf Community
… has provided the deaf community with a powerful language to convey their authority in struggles to preserve sign language. Employing religious rhetoric, the American deaf community historically overcame the oppression of a dominant hearing community that suppressed the use of sign language. …
-
Training efficient agents for long-term decision making
… a rich inductive prior over object geometry and language grounding. In manipulation and open-vocabulary navigation tasks, SCRs cut the number of gradient steps needed to reach a given return by up to an order of magnitude and consistently outperform contrastively trained encoders, all without …
-
FAIR-Coach: Biomechanically Informed Evidence Representation for Movement Diagnosis with Offline Squat-Based Evaluation
… only one of three tested labels satisfied the grounding criterion, so diagnosis-level grounding was not demonstrated. At the language layer, LoRA-DPO trained on template-constructed preference pairs improved diagnosis-to-language grounding under an automatic evaluation protocol on 40 held-out …
-
Using natural language to aid task specification in sequential decision making problems
… In this dissertation, we explore using natural language as an auxiliary signal to aid task specification, which reduces the burden on the end user. To make reward design easier, we propose a novel framework that is used to generate language-based rewards in addition to the extrinsic rewards from …
-
Detection and Tracking of Instruments for Robotic Surgery Guidance with Limited Supervision
… temporal motion dynamics with natural language grounding via vision-language models for robust, context-aware surgical understanding.<br/><br/>This thesis tackles the scarcity of annotated surgical instrument segmentation datasets by leveraging large-scale unlabelled data through …
-
Reasoning and Learning in Interactive Natural Language Systems
Systems that support expressive, situated natural language interactions are essential for expanding access to complex computing systems, such as robots and databases, to non-experts. Reasoning and learning in such natural language interactions is a challenging open problem. For example, resolving …
-
Grounded language processing for action understanding and justification
… agents need to understand the meaning of human language, especially the actions, and connect them to the physical world. Furthermore, to make the communication more transparent and trustworthy, the agents should have human-like action justification ability to explain their decision-making …
-
Grounding language in image, video and audio modalities
… jointly learning representations of the audio, language and visual modalities for the purpose of automated applications including virtual assistants, chatbots and robotics. In particular, learning a multimodal representation that facilitates grounding of language in multiple modalities is of …
-
From Web to World: Harnessing Foundation Models for Intelligent Robotic Assistants in Real-World Environments
… how simulated embodied experience and spatial grounding can enhance foundation models for robotics, bridging the gap between abstract reasoning capabilities and physical robotic interaction. We present three key contributions: (1) Adaptive Skill Coordination (ASC) and Language-guided Skill …
-
Talking to Robots: Learning to Ground Human Language in Perception and Execution
… and learn about tasks from nonspecialists using language and other natural modalities. At the same time, physically grounded settings provide exciting opportunities for language learning. This thesis describes work on learning to acquire language for human-robot interaction in a physically …
-
Talking Back: An Examination of Legislative Sequels Produced by the National Assembly of Quebec in Response to Judicial Invalidation of the Charter of the French Language
Grounding its approach in historical and discursive institutionalist frameworks, this thesis examines the process of judicial review through an evaluation of Hogg et al.’s Charter dialogue hypothesis as it pertains to judicial invalidation of sections of the Charter of the French Language (CFL) and …