Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 44 for “"multi-head attention"”.
-
A Multi-head Attention Approach with Complementary Multimodal Fusion for Vehicle Detection
… the development of an improved version of the Multimodal Vehicle Detection Network (MVDNet), distinguished by the integration of a multi-head attention layer. This key enhancement significantly refines the network's capability to process and integrate multimodal sensor data, an aspect that …
-
IMPROVING MULTI-VARIATE TIME SERIES FORECASTING WITH DYNAMIC MULTI-HEAD ATTENTION ADJACENCY MATRIX
… In this project, we explored whether the attention mechanism can be effectively integrated into non-transformer-based models to enhance their ability to learn spatial information. To achieve this goal, we propose a novel framework that uses a dynamically learned adjacency matrix based on …
-
Weakly supervised aspect extraction for domain-specific texts
… our proposed neural model is equipped with multi-head attention and self-training. The multi-head attention is learned from the seed words to ensure that the aspect-related words in text segments are weighted higher than those unrelated ones. The self-training mechanism provides more pseudo …
-
Paslaugų skelbimų automatinis klasifikavimas taikant natūralios kalbos ir mašininio mokymo metodus /
… input, and a convolutional neural network with a multi-head attention and dual input.
-
An Effective Large Language Model-based Pipeline to Preprocess Narrative Electronic Medical Records Data for Hospital Adverse Events Detection
… task by designing and implementing a novel multi-head attention mechanism aimed at training LLMs for the accurate identification of section headers within clinical notes. In contrast to the regular attention mechanisms that analyze all tokens within the input sentence, the proposed …
-
Rekomendacinių sistemų grįstų transformerių neuroniniais tinklais tyrimas /
… as: positional encoding, encoder, decoder, self-attention mechanism, multi-head attention, self-attention, direct propagation neural networks and input and input mappings are introduced. The evaluation indicators of recommender systems are described, how they are calculated and what are the …
-
Question‐driven text summarization using an extractive‐abstractive framework
… as plausible answers using an open‐domain multi‐hop question answering system based on a convolutional neural network, multi‐head attention mechanism and reasoning process; and (2) a novel paraphrasing generative adversarial network model based on transformers rewrites the extracted …
-
Computational Approaches to Investigate Alternative Polyadenylation in Single-Cell RNA-Sequencing Data
… a hybrid convolutional neural network with multi-head attention (CNN- MATT) model to explore APA landscapes in different brain cell types across both spo- radic and familial ALS cases, revealing novel insights into APA profiles that may con- tribute to ALS pathology. Additionally, I …
-
Modeling Multivariate Hopfield-Transformer Hawkes Process: Application to Sovereign Credit Default Swaps
… fail to capture long-term dependencies among multiple point processes, and Transformer Hawkes processes only address temporal characteristics of Hawkes processes. In this thesis, we proposed a combination of neural networks and Hawkes processes to tackle the aforementioned challenges and to …
-
Question Answering In Conversational Context
… experimenting with FlowQA by (1) replacing the attention mechanism with multi-head attention, (2) integrating BERT (Bidirectional Encoder Representation from Transformer) [3]. In every experiment, there was a considerable amount of increment in the F1 score,with the highest score being 66.4% …
-
A deeper look into multi-task learning ability of unified text-to-text transformer
… With proper format, it could be trained on multiple tasks together and take advantage of the shared knowledge between tasks. To better understand how these models achieve better performance by multi-task learning, we designed several experiments to measure the knowledge transfer ability of a …
-
Stock volatility forecasting with transformer network
… thesis work, we utilized TN architecture with multi-head attention (MHA) mechanism for stock volatility forecasting. To enhance the performance of the TN, we incorporated different variations of the feed forward layer. The performance of three distinct TN models was evaluated by implementing …
-
Visual place recognition in aerial imagery
… LMNet employs a Siamese architecture with Multi-Patch matching to handle off-center landmarks and occlusions. LMNet++ incorporates multi-head attention mechanisms for improved computational efficiency. WS-LMNet extends this into a fully convolutional architecture for direct landmark …
-
XAI-Driven Malicious Encrypted Traffic Detection and Characterization to Enhance Information Security
… encrypted traffic classification, integrating Multi-Head Attention mechanisms for feature enhancement and LightGBM as the final classifier. The proposed model follows a two-step classification process: first, performing binary classification to separate encrypted and non-encrypted traffic, and …
-
Deep learning model for scoring circular RNAs and interpreting back-splicing
… and employs convolutional layers together with a multi-head attention mechanism to capture both local and long-range dependencies. Two simulated datasets derived from public databases and RNA-seq data from prostate cancer cell lines were used to train and evaluate the model. The model achieves …
-
Large Language Models and Networks: Edge Proposal, Synthetic Corpora, and Adaptive Node Generation
… to today’s transformer architectures whose multi-head attention enables rich contextual reasoning. Against this backdrop, this dissertation unifies three complementary investigations that deepen our understanding of how large language models (LLMs) can reason over, generate, and …
-
Latent-Space Engineering and Modular Transformer Architectures for Efficient Multimodal Intelligence
… without the prohibitive computational overhead typical of modern Vision Transformers (ViTs). Chapter 3 establishes the foundational Binary Classification Vision Transformer (BC-ViT), integrating convolutional feature extraction with transformer-based contextual reasoning to excel in …
-
Speed Prediction for Freight Transportation: A Graph Neural Network Approach
… predictive models capable of navigating the multifaceted and dynamic nature of transportation systems. Traditional methodologies, primarily rooted in statistical analysis and linear modeling, have provided foundational insights but are not adequate in addressing the multifaceted and dynamic …
-
Full System-Level Simulation of Neural Compute Architectures
… on benchmarks including general matrix multiplication (GEMM) and complex Transformer layers like Multi-Head Attention (MHA). Architectural parameters such as systolic array dimensions (2D vs. 3D), on-chip memory size, and dataflow are systematically varied. The results reveal that …
Page 1 of 3