Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 20 of 20 for “"Multi-modal deep learning"”.

  1. Multi-Modal Deep Learning to Understand Vision and Language

    … progress has been made towards this goal and deep learning has been attributed to recent incredible advances in general visual and language understanding. Convolutional neural networks have been used to learn image representations while recurrent neural networks have demonstrated the ability …

    rit Repository record for Multi-Modal Deep Learning to Understand Vision and Language (opens in a new tab)

  2. Advancing Multi-Modal Deep Learning: Towards Language-Grounded Visual Understanding

    Using deep learning, computer vision now rivals people at object recognition and detection, opening doors to tackle new challenges in image understanding. Among these challenges, understanding and reasoning about language grounded visual content is of fundamental importance to advancing artificial …

    rit Repository record for Advancing Multi-Modal Deep Learning: Towards Language-Grounded Visual Understanding (opens in a new tab)

  3. Multi-Modal Deep Learning for Computer Vision and Its Application

    … between pieces of information from different modalities. In this thesis, I investigate three directions to achieve an effective interaction between multi-modal information. The first direction focuses on building a consistent representation for information with the similar semantic meaning. …

    oxford Repository record for Multi-Modal Deep Learning for Computer Vision and Its Application (opens in a new tab)

  4. Multi-Modal Deep Learning for Cardiovascular Disease Diagnosis and Risk Prediction Using Retinal Imaging

    … from the UK Biobank, combined with advanced deep learning techniques, to develop predictive models of CVDs risk and investigate causal links between cardiovascular outcomes and retinal features. First, we investigated the use of optical coherence tomography (OCT), combined with minimal …

    whiterose Download PDF for Multi-Modal Deep Learning for Cardiovascular Disease Diagnosis and Risk Prediction Using Retinal Imaging (opens in a new tab)

  5. An End-to-End Multi-Modal Deep Learning Framework for Transparent and Interpretable AI-assisted Neuroimaging

    … solutions evaluate one disease given one imaging modality and output classification scores with no accompanying structured rationale, anatomical grounding, or clinical report language. A single framework to jointly evaluate these diseases across multiple imaging modalities with interpretable …

    unt Repository record for An End-to-End Multi-Modal Deep Learning Framework for Transparent and Interpretable AI-assisted Neuroimaging (opens in a new tab)

  6. End-to-end learning framework for circular RNA classification from other long non-coding RNAs using multi-modal deep learning.

    … availability of a faster, more accurate machine learning method for the identification of circular RNAs, which will take into account the specific features of circular RNA, is essential in the development of systematic annotation. Here we present an End to-End multimodal deep learning framework, …

    louisville Repository record for End-to-end learning framework for circular RNA classification from other long non-coding RNAs using multi-modal deep learning. (opens in a new tab)

  7. A graph-based multi-modal deep learning framework for automated energy performance assessment and retrofit decision support in Chinese residential buildings

    … to the Chinese housing context. Third, a multi-modal deep learning model, FusionGNN, is proposed to predict household annual Energy Use Intensity (EUI). The model is first pre-trained on the simulation dataset and then fine-tuned using measured data collected from 120 households. Finally, …

    whiterose Download PDF for A graph-based multi-modal deep learning framework for automated energy performance assessment and retrofit decision support in Chinese residential buildings (opens in a new tab)

  8. Multi-Modal Guided Depth Super-Resolution Via Single-Photon Counting and Simultaneous Color Imaging

    … to provide structural guidance and by training a multi-modal deep learning model to spatially disambiguate the depth measurement probability distributions. Our guided super-resolution approach achieves a 16x resolution increase in image height and width and yields comparable performance to current …

    alabama Repository record for Multi-Modal Guided Depth Super-Resolution Via Single-Photon Counting and Simultaneous Color Imaging (opens in a new tab)

  9. Deep Learning Applications for Particle Physics in Tracking and Calorimetry

    … presents an in-depth exploration of advanced deep learning applications in particle physics, particularly in the context of tracking, calorimetry, and energy reconstruction within High Energy Physics (HEP) experiments. It encompasses three studies, each underscoring the potential of deep …

    washington Repository record for Deep Learning Applications for Particle Physics in Tracking and Calorimetry (opens in a new tab)

  10. Structure-aware deep learning model for peptide toxicity prediction

    … In response to this need, I introduce tAMPer, a multi-modal deep learning model that predicts peptide toxicity by integrating the underlying amino acid sequence composition and the predicted three-dimensional (3D) structure. tAMPer adopts a graph-based representation for peptides, encoding their …

    ubc Repository record for Structure-aware deep learning model for peptide toxicity prediction (opens in a new tab) Download PDF for Structure-aware deep learning model for peptide toxicity prediction (opens in a new tab)

  11. Automated Code Generation from Flowcharts: A Multimodal Deep Learning Framework for Accurate Translation and Debugging

    … diverse flowchart representations into multilingual programming code with minimal user intervention remains an industry challenge. To address these challenges, this thesis research introduces the Dynamic Flow-to-Code Generator (DFCG), a novel system designed to automate the process of …

    ttu Repository record for Automated Code Generation from Flowcharts: A Multimodal Deep Learning Framework for Accurate Translation and Debugging (opens in a new tab)

  12. Novel Computational Approaches For Multidimensional Brain Image Analysis

    … that combine signal processing and machine learning techniques. One of these challenging tasks is the accurate localization of the eloquent language cortex in brain resection pre-surgery patients. This is especially important since inaccurate localization can lead to diminshed …

    ucf Repository record for Novel Computational Approaches For Multidimensional Brain Image Analysis (opens in a new tab)

  13. Vision-based seam tracking and multi-modal defect detection in GMAW fillet welding using artificial intelligence

    … • Vision-Based Seam Tracking: We develop a deep learning classification model to detect tacks, where the seam is not visible, and a keypoint detection model to locate the seam in non-tack images. Optimizing image input size and leveraging temporal information improved seam tracking accuracy …

    ubc Repository record for Vision-based seam tracking and multi-modal defect detection in GMAW fillet welding using artificial intelligence (opens in a new tab) Download PDF for Vision-based seam tracking and multi-modal defect detection in GMAW fillet welding using artificial intelligence (opens in a new tab)

  14. Classifying Sidewalk Materials Using Multi-Modal Data

    … this problem, this master’s thesis investigates deep learning approaches specifically designed for the classification of multi-modal sidewalk materials. The proposed framework aims to empower individuals with BLV to automatically gather information about sidewalk materials while navigating their …

    cuny Repository record for Classifying Sidewalk Materials Using Multi-Modal Data (opens in a new tab)

  15. Data-Driven Approaches for Managing Water Quality in Urban Rivers

    … that integrate low-cost sensor surrogates, multi-modal environmental data, and advanced machine learning (ML) to enable proactive water quality management, with studies drawn from the Yarra River in Melbourne, Australia, and about 1800 rivers and lakes in China. This thesis first evaluated …

    unsw Repository record for Data-Driven Approaches for Managing Water Quality in Urban Rivers (opens in a new tab)

  16. Artificial neural networks for problems in computational cognition

    … specifically detailing the logic behind the deep learning approaches that are used in the empirical chapters of the thesis. While a full understanding of this chapter requires a stronger mathematical background than the previous chapter, the concepts are explained in such a way that a …

    glasgow Repository record for Artificial neural networks for problems in computational cognition (opens in a new tab) Download PDF for Artificial neural networks for problems in computational cognition (opens in a new tab)

  17. Contextual AI: Integrating Macro-Context with Transformer Architectures for Social Media Analysis, Federated Learning, and Recommender Systems

    … three use cases: online discussions, federated learning, and recommender systems. For each, we motivate the need to leverage existing macro context and propose context-aware solutions based on the transformer architecture. In online discussion boards, the rich conversational and multimodal macro …

    waterloo Repository record for Contextual AI: Integrating Macro-Context with Transformer Architectures for Social Media Analysis, Federated Learning, and Recommender Systems (opens in a new tab)

  18. Depth-Aware Deep Learning Networks for Object Detection and Image Segmentation

    … and depth images, combining features from both modalities through the use of novel fusion modules. For each task, the models developed are competitive with state-of-the-art RGBD architectures. In particular, the proposed RGBD object detection approach achieves 53.5% mAP on the SUN RGBD 19-class …

    ottawa-retro Repository record for Depth-Aware Deep Learning Networks for Object Detection and Image Segmentation (opens in a new tab)

  19. Innovative technologies for smart production: augmented reality, computer vision and machine learning in manufacturing maintenance and waste segregation

    … Reality (AR), Machine Vision, and Machine Learning (ML) are crucial as they assist humans in manufacturing operations, whereas advanced sensing technologies combined with intelligent capabilities reduce production defects and improve waste segregation flows by separating material agnostic …

    greece Repository record for Innovative technologies for smart production: augmented reality, computer vision and machine learning in manufacturing maintenance and waste segregation (opens in a new tab)