Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 34 for “"Video captioning"”.
-
Automatic Video Captioning using Deep Neural Network
Video understanding has become increasingly important as surveillance, social, and informational videos weave themselves into our everyday lives. Video captioning offers a simple way to summarize, index, and search the data. Most video captioning models utilize a video encoder and captioning …
-
Large Multi-modal Model for Video Captioning
Video detailed captioning is a key task which aims to generate comprehensive and coherent textual descriptions of video content, benefiting both video understanding and generation. In this paper, we propose AuroraCap, a video captioner based on a large multimodal model. We follow the simplest …
-
Learning to evaluate video captioning systems through human assessment
… most representative tasks of this sub-field is video captioning. There are numerous difficulties involved in creating these descriptions, ranging from effectively conveying the essence of the scene to generating text that is grammatically accurate and flows smoothly. In this thesis, we examine …
-
PERSONALIZED VISUAL INFORMATION CAPTIONING
… thesis explores personalized visual information captioning, targeting images and videos, acknowledging the limitations of existing models that lack diversity in expressions. It introduces a framework to incorporate user information like age, gender, and prior knowledge to create more personalized …
-
Deep learning techniques in digital media
… based image retrieval, image classification, and video captioning, utilizing DL techniques. The principal goals of this thesis can be summarized in developing deep representation learning methods oriented to the specific digital media analysis tasks, and in developing lightweight DL methods that …
-
Attention-Based Models For Deep Reinforcement Learning
… in many fields of machine learning such as image captioning and machine translation. In this work, we focus on attention-based models for deep reinforcement learning. We concentrate on developing deep neural networks that are fed with a sequence of high-dimensional raw pixels. Particularly, we …
-
Connecting vision and language via image retrieval and captioning
… understanding vision and language, e.g. image/video captioning, multi-modal image retrieval, visual question answering. In this thesis, we consider several problems in cross-modal learning from vision and language. First, the problem of composed query image retrieval is studied. In this …
-
On effective learning for multimodal data
… challenges like image-text matching, video captioning, and generation of audiovisual content. In this thesis, we aim to broaden the scope of learning from multimodal information, enhance its integration, and solve problems related to humancentric spatio-temporal perception in a manner …
-
Language-based Visual Understanding
… First, we study the problem of Image Captioning. We introduce the Discrete Mode Learning (DML) paradigm to address the “mode collapse” problem in existing methods. It consists of a conditioned discrete variational autoencoder branch and a mode-conditioned image captioning branch. The …
-
Vision and language understanding with localized evidence
… of the model, while temporal localization in video is necessary to remove irrelevant content. We apply our methods to various vision and language tasks, including visual question answering, temporal activity detection, dense video captioning and cross-modal retrieval. First, we tackle the …
-
Examining the Effectiveness of Experiential Learning: in a Self-Directed TV Broadcast Journalism Environment
… a system of production (Robison, 2013) editing video, captioning pictures, creating packages, and interviewing to develop meaning for the audience (Boers, et. al, 2012). Blooms Taxonomy is an imperative instructional tool used within education, but it is not inherently experiential (Hamilton & …
-
Spatio-Temporal Representation for Reasoning with Action Genome
Representing Spatio-temporal information in videos has proven to be a difficult task compared to action recognition in videos involving multiple actions. A single activity consists many smaller actions that can provide a better understanding of the activity. This paper tries to represent the …
-
Special Genres Text Summarization
… In the second half, we tackle the task of video captioning. We introduce a two-step method that first generates captions for frames within the video, followed by summarizing these generated captions to form concise video captions. Our experimental results demonstrate that our proposed …
-
General and Fine-Grained Video Understanding using Machine Learning & Standardised Neural Network Architectures
… useful information from this data. Interpreting video data is of particular importance for many applications including surveillance, cataloguing, and robotics, however it is also particularly difficult due to video’s natural sparseness - for lots of data there is small amounts of useful …
-
Efficient deep learning models for video abstraction
With the revolution in digital video technology, video data are ubiquitous and explosively growing. There is a compelling need to develop efficient automated techniques to manage video data. Therefore, video abstraction is of significant interest to the computer vision research community. The …
-
Natural-language video description with deep recurrent neural networks
For most people, watching a brief video and describing what happened (in words) is an easy task. For machines, extracting meaning from video pixels and generating a sentence description is a very complex problem. The goal of this thesis is to develop models that can automatically generate natural …
-
Towards Achieving General Video Understanding
… dissertation investigates the problem of general video understanding, aiming to develop models capable of robust, adaptable, and semantically rich interpretation of video data across diverse domains and tasks. Despite significant progress in video analysis, existing methods remain limited by …
-
A Comprehensive Approach to Automated Sign Language Translation
… vision processes, specifically image and video captioning, related methods can be further researched to boost automated sign language understanding. This is an especially challenging AI research area due to the involvement of a continuous visual-spatial modality, where meaning is often …
-
Multi-Modal Deep Learning to Understand Vision and Language
… modeled using a continuous function for video understanding. The use of an attention based hierarchical approach along with automatic boundary detection advances state-of-the-art video captioning results. We also develop techniques for summarizing and annotating long videos. In the second …
-
Vision and language : representation learning, commonsense reasoning, and consistency
… of commonsense knowledge in multi-sentence video captioning. We introduce a Transformer-based model that incorporates both implicit (visuo-lingual and purely linguistic) and explicit (knowledge-base) commonsense information, which demonstrates that incorporating prior knowledge leads to more …
Page 1 of 2