Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 20 of 47 for “"Long-term dependencies"”.

  1. Explainable Learning of Long-term Dependencies through Machine Learning

    … but less interpretable model able to learn long and more complex time dependencies, is modified to generate a model, named E-LSTM, with extended temporal connectivity to better capture long-term dependencies. Experimental results demonstrate improved performance with no significant increase …

    mcmaster Repository record for Explainable Learning of Long-term Dependencies through Machine Learning (opens in a new tab)

  2. Efficient deep learning for sequence data

    … algorithms to train. This leads to tediously long training processes, even with the most powerful hardware. On the other hand, capturing long-term dependencies within a sequence remains a contemporary challenge for most deep architectures. To overcome these challenges, we develop a series of …

    texas Repository record for Efficient deep learning for sequence data (opens in a new tab)

  3. Introducing biological neuronal dynamics and neuromodulation in artificial neural networks.

    … ability of recurrent neural networks to learn long-term dependencies, something which usually proves difficult. Bistable recurrent cells will be introduced as a way to help towards solving such issues. Furthermore, supported by the results obtained with those cells, a more generic method to …

    liege Repository record for Introducing biological neuronal dynamics and neuromodulation in artificial neural networks. (opens in a new tab) Download PDF for Introducing biological neuronal dynamics and neuromodulation in artificial neural networks. (opens in a new tab)

  4. Efficient Scopeformer: Towards Scalable and Rich Feature Extraction for Intracranial Hemorrhage Detection using Hybrid Convolution and Vision Transformer Networks

    … problems, but they have limitations in mapping long-term dependencies within images. To address these limitations, the study explores the use of techniques such as global average pooling and self-attention mechanisms. Additionally, the study investigates the performance of vision transformers …

    rowan Repository record for Efficient Scopeformer: Towards Scalable and Rich Feature Extraction for Intracranial Hemorrhage Detection using Hybrid Convolution and Vision Transformer Networks (opens in a new tab)

  5. Probabilistic Modelling of Sensors in Autonomous Vehicles Autoregressive Input/Output Hidden Markov Models for Time Series Analysis

    … thesis a generative model is created for the longitudinal errors in the sensors and an extension to the hidden Markov model, called autoregressive input/output hidden Markov model (AIOHMM) is implemented. In this extension the transition probabilities are conditioned on an input vector and the …

    chalmers Repository record for Probabilistic Modelling of Sensors in Autonomous Vehicles Autoregressive Input/Output Hidden Markov Models for Time Series Analysis (opens in a new tab)

  6. Spatio-temporal relational reasoning for video question answering

    … they are short-sighted and struggle with long-range dependencies in videos. To address these challenges, we present a novel spatio-temporal reasoning neural module that models complex multi-entity relationships in space and long-term dependencies in time. Our model captures both …

    ubc Repository record for Spatio-temporal relational reasoning for video question answering (opens in a new tab) Download PDF for Spatio-temporal relational reasoning for video question answering (opens in a new tab)

  7. Pre-trained CNN and bi-directional LSTM for no-reference video quality assessment

    … research is incorporating memory effects and long-term dependencies observed in subjective VQA studies. To address this challenge, we propose to use a stack of six bi-directional Long-Short Term Memory (LSTM) layers of different units to model temporal characteristics of video sequences. We …

    concordia Download PDF for Pre-trained CNN and bi-directional LSTM for no-reference video quality assessment (opens in a new tab)

  8. Training Recurrent Neural Networks

    … it can train RNNs on tasks that have extreme long-range temporal dependencies, which were previously considered to be impossibly hard. We then apply HF to character-level language modelling and get excellent results. We also apply HF to optimal control and obtain RNN control laws that can …

    toronto-retro Repository record for Training Recurrent Neural Networks (opens in a new tab)

  9. Dynamic data science applications in demand forecasting and finance

    … autoregressive (NNAR) models are explored alongside a novel fuzzy two-step forecasting framework that integrates interval temperature forecasts to generate intelligent probabilistic electricity demand forecasts. In order to address nonlinear dynamics and long-term dependencies in demand …

    manitoba Repository record for Dynamic data science applications in demand forecasting and finance (opens in a new tab)

  10. Modeling Multivariate Hopfield-Transformer Hawkes Process: Application to Sovereign Credit Default Swaps

    … Recurrent Neural Networks (RNN) fail to capture long-term dependencies among multiple point processes, and Transformer Hawkes processes only address temporal characteristics of Hawkes processes. In this thesis, we proposed a combination of neural networks and Hawkes processes to tackle the …

    wilfrid-laurier Repository record for Modeling Multivariate Hopfield-Transformer Hawkes Process: Application to Sovereign Credit Default Swaps (opens in a new tab) Download PDF for Modeling Multivariate Hopfield-Transformer Hawkes Process: Application to Sovereign Credit Default Swaps (opens in a new tab)

  11. Anomaly detection with machine learning for automotive cyber-physical systems

    … of automotive systems has resulted in very long term dependencies between messages which cannot be effectively captured by LSTMs. Hence to overcome this problem, we proposed a novel IDS framework called TENET. TENET employs a novel convolutional neural attention (TCNA) based architecture to …

    colostate Repository record for Anomaly detection with machine learning for automotive cyber-physical systems (opens in a new tab)

  12. A novel trading strategy for higher renewable generation utilization based on energy trading mechanism and multi-turbine wind power prediction

    … wind turbine power, the model consists of the long short-term memory (LSTM) algorithm for temporal correlation with long-term dependencies based on time-series SCADA data from wind turbines, and graph convolutional networks (GCN) that can extract spatial features in non-Euclidean space between …

    unsw Repository record for A novel trading strategy for higher renewable generation utilization based on energy trading mechanism and multi-turbine wind power prediction (opens in a new tab)

  13. Machine learning in transcriptome analysis using long RNA sequencing data

    The advent of long-read RNA sequencing technologies has advanced transcriptomic research by enabling the sequencing of entire transcripts. This advancement holds the promise of uncovering novel insights into the complex nature of eukaryotic transcriptomes, characterized by phenomena such as …

    ubc Repository record for Machine learning in transcriptome analysis using long RNA sequencing data (opens in a new tab) Download PDF for Machine learning in transcriptome analysis using long RNA sequencing data (opens in a new tab)

  14. Neural Network-Based Surrogate Models of Lagrangian Continuum Simulators

    … with advanced neural architectures, such as Long Short-Term Memory (LSTM) networks. Experimental results demonstrate that LSTM networks, when combined with Multi-Layer Perceptrons (MLP), significantly outperform traditional methods in capturing the intricate multi-material interactions and …

    whiterose Download PDF for Neural Network-Based Surrogate Models of Lagrangian Continuum Simulators (opens in a new tab)

  15. Statistical and computational methods for biological data

    … layers. On the other hand, to understand the long-term dependencies among motifs, we used position embedding and multi-head self-attention layers. We pursued the improvement of our model's overall efficacy through the integration of transfer learning and multi-task learning. To ascertain …

    msu Repository record for Statistical and computational methods for biological data (opens in a new tab)

  16. Short-Term Spatio-Temporal Solar Irradiance Forecasting using Multi-Resolution Deep Learning Models

    … advanced deep learning architectures, such as Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU), and GRU with Attention (AttGRU). Next, spatio-temporal solar forecasting models are constructed. A novel multi-branch Attentive Gated Recurrent Residual network (ResAttGRU) consisting of …

    temple Repository record for Short-Term Spatio-Temporal Solar Irradiance Forecasting using Multi-Resolution Deep Learning Models (opens in a new tab)

  17. Scalable machine learning algorithms using path signatures

    … graph neural networks on tasks requiring long-range reasoning. <br>• <strong>Random Fourier Signature Features:</strong> Introduces scalable random feature-based approximations for signature kernels with supporting theoretical results, overcoming computational limitations for large …

    oxford Repository record for Scalable machine learning algorithms using path signatures (opens in a new tab)

  18. Dynamic Activity Predictions using Graph-based Neural Networks for Time Series Forecasting

    … techniques need to be revised to understand interdependencies and establishing long-term dependencies when dealing with a network of time series, such as predicting energy demand on interconnected grids. To tackle these challenges, this thesis introduces a framework implementing Attention-based …

    umkc Repository record for Dynamic Activity Predictions using Graph-based Neural Networks for Time Series Forecasting (opens in a new tab)

  19. 5G Multi-Tier Handover with Multi-Access Edge Computing: A Deep Learning Approach

    … deep learning (DL), as it is great at learning long-term dependencies. A variant of artificial neural networks called a long short-term memory (LSTM) network is used in conjunction with a lookup table (LUT), as part of the proposed solution. Subsequently, edge computing virtualisation methods …

    auckland-tech Repository record for 5G Multi-Tier Handover with Multi-Access Edge Computing: A Deep Learning Approach (opens in a new tab)

  20. Toward Transformer-based Large Energy Models for Smart Energy Management

    … known for their scalability, ability to capture long-term dependencies, and efficiency in parallel processing of large datasets, are considered good candidates for GEMs. In this study, we tested the hypothesis that GEMs can be efficiently developed to outperform in-situ models trained on …

    vt Repository record for Toward Transformer-based Large Energy Models for Smart Energy Management (opens in a new tab)

Page 1 of 3