Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 20 for “"Multi-modal deep learning"”.
-
Multi-Modal Deep Learning to Understand Vision and Language
… progress has been made towards this goal and deep learning has been attributed to recent incredible advances in general visual and language understanding. Convolutional neural networks have been used to learn image representations while recurrent neural networks have demonstrated the ability …
-
Advancing Multi-Modal Deep Learning: Towards Language-Grounded Visual Understanding
Using deep learning, computer vision now rivals people at object recognition and detection, opening doors to tackle new challenges in image understanding. Among these challenges, understanding and reasoning about language grounded visual content is of fundamental importance to advancing artificial …
-
Multi-Modal Deep Learning for Computer Vision and Its Application
… between pieces of information from different modalities. In this thesis, I investigate three directions to achieve an effective interaction between multi-modal information. The first direction focuses on building a consistent representation for information with the similar semantic meaning. …
-
Multi-Modal Deep Learning for Cardiovascular Disease Diagnosis and Risk Prediction Using Retinal Imaging
… from the UK Biobank, combined with advanced deep learning techniques, to develop predictive models of CVDs risk and investigate causal links between cardiovascular outcomes and retinal features. First, we investigated the use of optical coherence tomography (OCT), combined with minimal …
-
An End-to-End Multi-Modal Deep Learning Framework for Transparent and Interpretable AI-assisted Neuroimaging
… solutions evaluate one disease given one imaging modality and output classification scores with no accompanying structured rationale, anatomical grounding, or clinical report language. A single framework to jointly evaluate these diseases across multiple imaging modalities with interpretable …
-
End-to-end learning framework for circular RNA classification from other long non-coding RNAs using multi-modal deep learning.
… availability of a faster, more accurate machine learning method for the identification of circular RNAs, which will take into account the specific features of circular RNA, is essential in the development of systematic annotation. Here we present an End to-End multimodal deep learning framework, …
-
A graph-based multi-modal deep learning framework for automated energy performance assessment and retrofit decision support in Chinese residential buildings
… to the Chinese housing context. Third, a multi-modal deep learning model, FusionGNN, is proposed to predict household annual Energy Use Intensity (EUI). The model is first pre-trained on the simulation dataset and then fine-tuned using measured data collected from 120 households. Finally, …
-
Multi-Modal Guided Depth Super-Resolution Via Single-Photon Counting and Simultaneous Color Imaging
… to provide structural guidance and by training a multi-modal deep learning model to spatially disambiguate the depth measurement probability distributions. Our guided super-resolution approach achieves a 16x resolution increase in image height and width and yields comparable performance to current …
-
Deep Learning Applications for Particle Physics in Tracking and Calorimetry
… presents an in-depth exploration of advanced deep learning applications in particle physics, particularly in the context of tracking, calorimetry, and energy reconstruction within High Energy Physics (HEP) experiments. It encompasses three studies, each underscoring the potential of deep …
-
Structure-aware deep learning model for peptide toxicity prediction
… In response to this need, I introduce tAMPer, a multi-modal deep learning model that predicts peptide toxicity by integrating the underlying amino acid sequence composition and the predicted three-dimensional (3D) structure. tAMPer adopts a graph-based representation for peptides, encoding their …
-
Automated Code Generation from Flowcharts: A Multimodal Deep Learning Framework for Accurate Translation and Debugging
… diverse flowchart representations into multilingual programming code with minimal user intervention remains an industry challenge. To address these challenges, this thesis research introduces the Dynamic Flow-to-Code Generator (DFCG), a novel system designed to automate the process of …
-
Novel Computational Approaches For Multidimensional Brain Image Analysis
… that combine signal processing and machine learning techniques. One of these challenging tasks is the accurate localization of the eloquent language cortex in brain resection pre-surgery patients. This is especially important since inaccurate localization can lead to diminshed …
-
Vision-based seam tracking and multi-modal defect detection in GMAW fillet welding using artificial intelligence
… • Vision-Based Seam Tracking: We develop a deep learning classification model to detect tacks, where the seam is not visible, and a keypoint detection model to locate the seam in non-tack images. Optimizing image input size and leveraging temporal information improved seam tracking accuracy …
-
Classifying Sidewalk Materials Using Multi-Modal Data
… this problem, this master’s thesis investigates deep learning approaches specifically designed for the classification of multi-modal sidewalk materials. The proposed framework aims to empower individuals with BLV to automatically gather information about sidewalk materials while navigating their …
-
Data-Driven Approaches for Managing Water Quality in Urban Rivers
… that integrate low-cost sensor surrogates, multi-modal environmental data, and advanced machine learning (ML) to enable proactive water quality management, with studies drawn from the Yarra River in Melbourne, Australia, and about 1800 rivers and lakes in China. This thesis first evaluated …
-
Artificial neural networks for problems in computational cognition
… specifically detailing the logic behind the deep learning approaches that are used in the empirical chapters of the thesis. While a full understanding of this chapter requires a stronger mathematical background than the previous chapter, the concepts are explained in such a way that a …
-
Contextual AI: Integrating Macro-Context with Transformer Architectures for Social Media Analysis, Federated Learning, and Recommender Systems
… three use cases: online discussions, federated learning, and recommender systems. For each, we motivate the need to leverage existing macro context and propose context-aware solutions based on the transformer architecture. In online discussion boards, the rich conversational and multimodal macro …
-
Depth-Aware Deep Learning Networks for Object Detection and Image Segmentation
… and depth images, combining features from both modalities through the use of novel fusion modules. For each task, the models developed are competitive with state-of-the-art RGBD architectures. In particular, the proposed RGBD object detection approach achieves 53.5% mAP on the SUN RGBD 19-class …
-
Innovative technologies for smart production: augmented reality, computer vision and machine learning in manufacturing maintenance and waste segregation
… Reality (AR), Machine Vision, and Machine Learning (ML) are crucial as they assist humans in manufacturing operations, whereas advanced sensing technologies combined with intelligent capabilities reduce production defects and improve waste segregation flows by separating material agnostic …