Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 20 of 44 for “"multi-head attention"”.

  1. A Multi-head Attention Approach with Complementary Multimodal Fusion for Vehicle Detection

    … the development of an improved version of the Multimodal Vehicle Detection Network (MVDNet), distinguished by the integration of a multi-head attention layer. This key enhancement significantly refines the network's capability to process and integrate multimodal sensor data, an aspect that …

    iupui Repository record for A Multi-head Attention Approach with Complementary Multimodal Fusion for Vehicle Detection (opens in a new tab)

  2. IMPROVING MULTI-VARIATE TIME SERIES FORECASTING WITH DYNAMIC MULTI-HEAD ATTENTION ADJACENCY MATRIX

    … In this project, we explored whether the attention mechanism can be effectively integrated into non-transformer-based models to enhance their ability to learn spatial information. To achieve this goal, we propose a novel framework that uses a dynamically learned adjacency matrix based on …

    ecu Repository record for IMPROVING MULTI-VARIATE TIME SERIES FORECASTING WITH DYNAMIC MULTI-HEAD ATTENTION ADJACENCY MATRIX (opens in a new tab)

  3. Weakly supervised aspect extraction for domain-specific texts

    … our proposed neural model is equipped with multi-head attention and self-training. The multi-head attention is learned from the seed words to ensure that the aspect-related words in text segments are weighted higher than those unrelated ones. The self-training mechanism provides more pseudo …

    uiuc Repository record for Weakly supervised aspect extraction for domain-specific texts (opens in a new tab)

  4. Paslaugų skelbimų automatinis klasifikavimas taikant natūralios kalbos ir mašininio mokymo metodus /

    … input, and a convolutional neural network with a multi-head attention and dual input.

    vilnius Repository record for Paslaugų skelbimų automatinis klasifikavimas taikant natūralios kalbos ir mašininio mokymo metodus / (opens in a new tab)

  5. An Effective Large Language Model-based Pipeline to Preprocess Narrative Electronic Medical Records Data for Hospital Adverse Events Detection

    … task by designing and implementing a novel multi-head attention mechanism aimed at training LLMs for the accurate identification of section headers within clinical notes. In contrast to the regular attention mechanisms that analyze all tokens within the input sentence, the proposed …

    concordia Download PDF for An Effective Large Language Model-based Pipeline to Preprocess Narrative Electronic Medical Records Data for Hospital Adverse Events Detection (opens in a new tab)

  6. Rekomendacinių sistemų grįstų transformerių neuroniniais tinklais tyrimas /

    … as: positional encoding, encoder, decoder, self-attention mechanism, multi-head attention, self-attention, direct propagation neural networks and input and input mappings are introduced. The evaluation indicators of recommender systems are described, how they are calculated and what are the …

    vilnius Repository record for Rekomendacinių sistemų grįstų transformerių neuroniniais tinklais tyrimas / (opens in a new tab)

  7. Question‐driven text summarization using an extractive‐abstractive framework

    … as plausible answers using an open‐domain multi‐hop question answering system based on a convolutional neural network, multi‐head attention mechanism and reasoning process; and (2) a novel paraphrasing generative adversarial network model based on transformers rewrites the extracted …

    essex Download PDF for Question‐driven text summarization using an extractive‐abstractive framework (opens in a new tab)

  8. Computational Approaches to Investigate Alternative Polyadenylation in Single-Cell RNA-Sequencing Data

    … a hybrid convolutional neural network with multi-head attention (CNN- MATT) model to explore APA landscapes in different brain cell types across both spo- radic and familial ALS cases, revealing novel insights into APA profiles that may con- tribute to ALS pathology. Additionally, I …

    toronto-retro Repository record for Computational Approaches to Investigate Alternative Polyadenylation in Single-Cell RNA-Sequencing Data (opens in a new tab)

  9. Modeling Multivariate Hopfield-Transformer Hawkes Process: Application to Sovereign Credit Default Swaps

    … fail to capture long-term dependencies among multiple point processes, and Transformer Hawkes processes only address temporal characteristics of Hawkes processes. In this thesis, we proposed a combination of neural networks and Hawkes processes to tackle the aforementioned challenges and to …

    wilfrid-laurier Repository record for Modeling Multivariate Hopfield-Transformer Hawkes Process: Application to Sovereign Credit Default Swaps (opens in a new tab) Download PDF for Modeling Multivariate Hopfield-Transformer Hawkes Process: Application to Sovereign Credit Default Swaps (opens in a new tab)

  10. Question Answering In Conversational Context

    … experimenting with FlowQA by (1) replacing the attention mechanism with multi-head attention, (2) integrating BERT (Bidirectional Encoder Representation from Transformer) [3]. In every experiment, there was a considerable amount of increment in the F1 score,with the highest score being 66.4% …

    chalmers Repository record for Question Answering In Conversational Context (opens in a new tab)

  11. A deeper look into multi-task learning ability of unified text-to-text transformer

    … With proper format, it could be trained on multiple tasks together and take advantage of the shared knowledge between tasks. To better understand how these models achieve better performance by multi-task learning, we designed several experiments to measure the knowledge transfer ability of a …

    uiuc Repository record for A deeper look into multi-task learning ability of unified text-to-text transformer (opens in a new tab)

  12. Stock volatility forecasting with transformer network

    … thesis work, we utilized TN architecture with multi-head attention (MHA) mechanism for stock volatility forecasting. To enhance the performance of the TN, we incorporated different variations of the feed forward layer. The performance of three distinct TN models was evaluated by implementing …

    manitoba Repository record for Stock volatility forecasting with transformer network (opens in a new tab)

  13. Visual place recognition in aerial imagery

    … LMNet employs a Siamese architecture with Multi-Patch matching to handle off-center landmarks and occlusions. LMNet++ incorporates multi-head attention mechanisms for improved computational efficiency. WS-LMNet extends this into a fully convolutional architecture for direct landmark …

    missouri Repository record for Visual place recognition in aerial imagery (opens in a new tab) Embargoed until 2026-12-01

  14. XAI-Driven Malicious Encrypted Traffic Detection and Characterization to Enhance Information Security

    … encrypted traffic classification, integrating Multi-Head Attention mechanisms for feature enhancement and LightGBM as the final classifier. The proposed model follows a two-step classification process: first, performing binary classification to separate encrypted and non-encrypted traffic, and …

    york Repository record for XAI-Driven Malicious Encrypted Traffic Detection and Characterization to Enhance Information Security (opens in a new tab)

  15. Deep learning model for scoring circular RNAs and interpreting back-splicing

    … and employs convolutional layers together with a multi-head attention mechanism to capture both local and long-range dependencies. Two simulated datasets derived from public databases and RNA-seq data from prostate cancer cell lines were used to train and evaluate the model. The model achieves …

    ubc Repository record for Deep learning model for scoring circular RNAs and interpreting back-splicing (opens in a new tab) Download PDF for Deep learning model for scoring circular RNAs and interpreting back-splicing (opens in a new tab)

  16. Large Language Models and Networks: Edge Proposal, Synthetic Corpora, and Adaptive Node Generation

    … to today’s transformer architectures whose multi-head attention enables rich contextual reasoning. Against this backdrop, this dissertation unifies three complementary investigations that deepen our understanding of how large language models (LLMs) can reason over, generate, and …

    ucf Repository record for Large Language Models and Networks: Edge Proposal, Synthetic Corpora, and Adaptive Node Generation (opens in a new tab)

  17. Latent-Space Engineering and Modular Transformer Architectures for Efficient Multimodal Intelligence

    … without the prohibitive computational overhead typical of modern Vision Transformers (ViTs). Chapter 3 establishes the foundational Binary Classification Vision Transformer (BC-ViT), integrating convolutional feature extraction with transformer-based contextual reasoning to excel in …

    unt Repository record for Latent-Space Engineering and Modular Transformer Architectures for Efficient Multimodal Intelligence (opens in a new tab)

  18. Speed Prediction for Freight Transportation: A Graph Neural Network Approach

    … predictive models capable of navigating the multifaceted and dynamic nature of transportation systems. Traditional methodologies, primarily rooted in statistical analysis and linear modeling, have provided foundational insights but are not adequate in addressing the multifaceted and dynamic …

    mcmaster Repository record for Speed Prediction for Freight Transportation: A Graph Neural Network Approach (opens in a new tab)

  19. Full System-Level Simulation of Neural Compute Architectures

    … on benchmarks including general matrix multiplication (GEMM) and complex Transformer layers like Multi-Head Attention (MHA). Architectural parameters such as systolic array dimensions (2D vs. 3D), on-chip memory size, and dataflow are systematically varied. The results reveal that …

    chalmers Repository record for Full System-Level Simulation of Neural Compute Architectures (opens in a new tab)

Page 1 of 3