Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 7 of 7 for “"Large Vision-Language Model"”.
-
Large Vision Language Model Driven Differential Profiling of Brain Spatial Proteomics Data
… on cell segmentation or classification and often model cells and protein channels independently, while large language models cannot directly interpret and differentially profile whole-slice brain images. We propose a data-driven framework that integrates multichannel molecular signals, spatial …
-
Connecting Text and Charts Using Large Vision-Language Models
… documents. In this thesis, we propose two large vision-language model (LVLM)-based frameworks—a single-agent baseline and a multi-agent architecture—for automatically linking textual descriptions with their corresponding chart data. Both frameworks extract structured data from chart images …
-
Talk Through It: End User Directed Manipulation Learning
… based on end-user preferences. Given a factory model that lets an end user instruct a robot to perform lower-level actions (e.g. ‘Move left’), we show that end users can collect demonstrations using language to train their home model for higher-level tasks specific to their needs (e.g. ‘Open the …
-
VIDEO UNDERSTANDING: THROUGH TEMPORAL LENS
… an automatic annotation approach that uses large vision-language models to capture temporal progressions, coupled with a contrastive learning objective to mitigate noise. For resource-constrained scenarios, we propose recurrent adapters with parameter-efficient training to better model …
-
A Unified Non-Visual Explainable AI Framework for Neonatal Pain Assessment
With the power of parallel processing, large datasets, and fast computational resources,deep neural networks (DNNs) have outperformed highly trained and experienced human experts in medical applications. However, the large global community of healthcare professionals, many of whom routinely face …
-
Towards More Human-like Multi-Modal Understanding and Prediction using Novel Benchmark, Evaluation Frameworks and Modeling Strategies
… overcome these shortcomings. Current multimodal models frequently struggle when faced with distractions, unexpected environmental changes, or complex multimodal tasks, resulting in systems that are difficult and less ideal to use in real-life. In contrast, human cognition naturally exhibits …
-
Advanced Methods for Remote Sensing Image Captioning
… captioning (IC) involves generating natural language descriptions for images, enabling machines to communicate their perception through language. This approach provides a flexible framework to convey diverse semantics. Despite significant advancements, IC systems face challenges in …