Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 95 for “"Visual question answering"”.
-
Visual question answering and beyond
… Artificial Intelligence (AI) task called Visual Question Answering (VQA) -- given an image and a natural language question about the image (e.g., "What kind of store is this?", "Is it safe to cross the street?"), the machine's task is to automatically produce an accurate natural language …
-
Visual question answering using external knowledge
Accurately answering a question about a given image requires combining observations with general knowledge. While this is effortless for humans, reasoning with general knowledge remains an algorithmic challenge. To advance research in this direction, a novel `fact-based' visual question answering …
-
Incorporating external information for visual question answering
Visual question answering (VQA) has recently emerged as a challenging multi-modal task and has gained popularity. The goal is to answer questions that query information associated with the visual content in the given image. Since the required information could be from both inside and outside the …
-
Visual question answering with contextualized commonsense knowledge
There has been a growing interest in solving Visual Question Answering (VQA) tasks that require the model to reason beyond the content present in the image. In this work, we focus on questions that require commonsense reasoning. In contrast to previous methods which inject knowledge from static …
-
Symbolic Neural Reasoning for Visual Question Answering
The evolution of Visual Question Answering (VQA) systems and the latest Large Vision and Language Models (LVMs) represents a significant intersection in multimodal intelligence, which is a fundamental aspect of human intelligence. Humans excel at using multimodal data, combining vision, language, …
-
Role of Premises in Visual Question Answering
… work, we make a simple but important observation questions about images often contain premises -- objects and relationships implied by the question -- and that reasoning about premises can help Visual Question Answering (VQA) models respond more intelligently to irrelevant or previously unseen …
-
Visual Question Answering in the Medical Domain
… Thus, it becomes crucial to have a reliable Visual Question Answering (VQA) system which can provide a "second opinion" on medical cases. However, most of the VQA systems that work today cater to real-world problems and are not specifically tailored for handling medical images. Moreover, the …
-
Reducing Training Time in Text Visual Question Answering
… meaning they use only one modality such as visual recognition or text recognition. However, real-world challenges are often a combination of different modalities of data such as text, audio and images. This thesis focuses on solving the Visual Question Answering (VQA) problem which is a …
-
Inverse Visual Question Answering with Multi-Level Attentions
Inverse Visual Question Answering (iVQA) is a contemporary task emerged from the need for improving visual and language understanding. It tackles the challenging problem of generating a corresponding question for a given image-answer pair. Current state-of-the-art iVQA models use the conventional …
-
Visual question answering : representing authentic use cases and ambiguity
Visual question answering (VQA) is a popular artificial intelligence (AI) task of having a machine return the answer to any natural language question about any image. Limitations of existing AI work are that existing datasets supporting model development are (1) typically contrived and (2) don't …
-
Image captioning and visual question answering with external knowledge
… processing have made significant advances in visual question answering (VQA) and image captioning. However, a limitation of models in use today is they typically perform poorly when the task requires common sense or external knowledge. Motivated by this observation, this work offers an …
-
Developing a System for Free-Form Visual Question Answering
… witnessed significant advances in the field of visual question answering (VQA). This complex task connects the areas of computer vision and natural language processing research to build a step towards solving artificial intelligence (AI). A crucial feature of any AI-complete problem is the …
-
Fact-based visual question answering using knowledge graph embeddings
… through vision and language. Fact-based Visual Question Answering (FVQA), a challenging variant of VQA, requires a QA-system to mimic this human ability. It must include facts from a diverse knowledge graph (KG) in its reasoning process to produce an answer. Large KGs, especially …
-
Visual Question Answering: Exploring Trade-offs Between Task Accuracy and Explainability
Given visual input and a natural language question about it, the visual question answering (VQA) task is to answer the question correctly. To improve a system's reliability and trustworthiness, it is imperative that it links the text (question and answer) to specific visual regions. This …
-
Context Based Multi-Image Visual Question Answering (VQA) in Deep Learning
Image question answering has gained huge popularity in recent years due to advancements in Deep Learning technologies and computer processing hardware which are able to achieve higher accuracies with faster processing capabilities. Processing image details over natural language information is one …
-
Exploring Vagueness and Ambiguity in Humans and Models Through Visual Question Answering
… studies the impact of vagueness and ambiguity in visual question answering (VQA) on language understanding and computational models, offering insights important for advancing the field of computational linguistics and natural language processing. In Chapter 1, I discuss the fundamental role of …
-
Sub-Question Oriented Tuning of Visual Question Answering Models for Improved Consistency
Recent research in Visual Question Answering (VQA) has revealed state-of-the-art models to be inconsistent in their understanding of the world -- they answer seemingly difficult questions requiring reasoning correctly but get simpler associated sub-questions wrong. These sub-questions pertain to …
-
REPRESENTATION LEARNING OF DATA WITH MULTIPLE MODALITIES WITH APPLICATIONS TO VISUAL QUESTION ANSWERING
Deep learning has started a new era in Artificial Intelligence research with major breakthroughs in multiple fields. Now, as the field strives to achieve Artificial General Intelligence the focus has shifted to tasks involving data of multiple modalities. With this thesis, I address the challenges …
-
Path-RAG : knowledge-guided key region retrieval for open-ended pathology visual question answering
… in the PathVQA-Open dataset. For longer-form question and answer pairs, our model consistently achieves significant improvements of 32.5% in ARCH-Open PubMed and 30.6% in ARCH-Open Books on H&E images. All our relevant codes and data sets are open source: …
-
Vision and Language Learning: From Image Captioning and Visual Question Answering towards Embodied Agents
… figures, we are converting information between visual and linguistic representations. Indeed, for many tasks it is essential to reason jointly over visual and linguistic information. People do this with ease, typically without even noticing. Intelligent systems that perform useful tasks in …
Page 1 of 5