Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 20 of 270 for “"Transformer Models"”.

  1. Enhancing Transformer Models for Dialogue Summarization

    … improving performance and reducing the cost of transformer models. We introduce two primary types of summarization tasks: corpus-level and conversation-level. Corpus- level summarization aims to provide an overview of speaker behaviors across multiple dialogues by using a graph-based approach, …

    washington Repository record for Enhancing Transformer Models for Dialogue Summarization (opens in a new tab)

  2. The advent of transformer models in psychometrics

    Since the recent emergence of the transformer model architecture, the discipline of natural language processing has advanced significantly, as these deep neural language models demonstrate proficiency in both natural language generation and understanding. As measures in the behavioral and social …

    lmu-germany Repository record for The advent of transformer models in psychometrics (opens in a new tab)

  3. TRANSFORMER MODELS FOR ROBUST EEG SOURCE LOCALIZATION

    … different data settings. This work presents a transformer-based model for EEG source localization that supports both single-source and multi-source prediction. The model is designed to handle challenges commonly found in EEG data, including measurement noise, varying source configurations, and …

    ecu Repository record for TRANSFORMER MODELS FOR ROBUST EEG SOURCE LOCALIZATION (opens in a new tab)

  4. Effective and efficient transformer models for sequential recommendation

    … sequences resemble word sequences in language models. In particular, the arrival of the Transformer architecture transformed the field of sequential recommendation. It allowed Transformer-based models, such as BERT4Rec and SASRec, to achieve state-of-the-art results on many sequential …

    glasgow Repository record for Effective and efficient transformer models for sequential recommendation (opens in a new tab) Download PDF for Effective and efficient transformer models for sequential recommendation (opens in a new tab)

  5. OPTIMIZING TRANSFORMER MODELS FOR IMPROVED INFERENCE EFFICIENCY AND COMPACTNESS

    Transformer models, such as BERT and GPT, have revolutionized NLP and computer vision tasks, enabling advanced applications like large language models (LLMs) and Vision Transformers (ViTs). However, these models often suffer from slow inference speeds and high memory consumption due to their …

    nus Repository record for OPTIMIZING TRANSFORMER MODELS FOR IMPROVED INFERENCE EFFICIENCY AND COMPACTNESS (opens in a new tab) Download file for OPTIMIZING TRANSFORMER MODELS FOR IMPROVED INFERENCE EFFICIENCY AND COMPACTNESS (opens in a new tab)

  6. Examining Information Flows Within Transformer Models Using Transfer Entropy

    … neural networks. This is especially true for transformer architectures and large language models, which are the driving force behind the current surge in artificial intelligence. The complexity of transformer architecture foils many pre-existing methods for studying explainability in deep …

    ucf Repository record for Examining Information Flows Within Transformer Models Using Transfer Entropy (opens in a new tab)

  7. Potts and MSA Transformer models of protein fitness landscapes

    … examines how physics-based Potts Hamiltonian models of protein sequences, inferred from multiple sequence alignments (MSAs), encode biophysical interactions, epistasis, and conformational free energy landscapes, and contrasts these models with the AI-based MSA Transformer models to further …

    temple Repository record for Potts and MSA Transformer models of protein fitness landscapes (opens in a new tab)

  8. Exploring the In-Context Estimation Capabilities of Transformer Models

    … has observed the remarkable capability of transformer models to perform in-context learning (ICL). In this paradigm, the model's parameters are fixed and it must solve a problem using examples presented at test-time. This requires the model to use the given examples to both infer the …

    tamu Repository record for Exploring the In-Context Estimation Capabilities of Transformer Models (opens in a new tab)

  9. System Log File Anomaly Detection with Sparse Transformer Models

    … task. The natural language processing based transformer model has seen success in the field of log anomaly detection but may fail in cases where log data is highly unstructured and where anomalous log messages may be far apart. One reason for this could be the transformer model’s squared …

    chalmers Repository record for System Log File Anomaly Detection with Sparse Transformer Models (opens in a new tab)

  10. Transformer Models for Machine Translation and Streaming Automatic Speech Recognition

    … como en una arquitectura neuronal profunda, el Transformer, que pondremos en práctica para mejorar las soluciones de MT y ASR en algunas de sus aplicaciones. El ASR y MT pueden servir para obtener textos multilingües de alta calidad a un coste razonable para una diversidad de contenidos …

    upv Repository record for Transformer Models for Machine Translation and Streaming Automatic Speech Recognition (opens in a new tab)

  11. Investigating Neural Networks and Transformer Models for Enhanced Comic Decoding

    … δίκτυα (YOLO) και καινοτόμες αρχιτεκτονικές transformer (GroundingDINO, SAM), η έρευνά μας στοχεύει στον αυτόνομο διαχωρισμό των σελίδων κόμικς στα βασικά τους συστατικά: καρέ, χαρακτήρες κόμικς και περιοχές κειμένου. Για το σκοπό αυτό, εκπαιδεύσαμε περαιτέρω τα μοντέλα YOLOv5 και YOLOv8 για …

    athens Repository record for Investigating Neural Networks and Transformer Models for Enhanced Comic Decoding (opens in a new tab)

  12. Acceleration of Integer Transformer Models Via Structured Resource Management Using FPGAs

    The widespread adoption of Large Language Models (LLMs) in various applications has pushed the demand for efficient hardware acceleration beyond the capabilities of traditional platforms. Due to their highly parallel architecture and ease of deployment, Field Programmable Gate Arrays (FPGAs) are …

    waterloo Repository record for Acceleration of Integer Transformer Models Via Structured Resource Management Using FPGAs (opens in a new tab)

  13. A Study of Transformer Models for Emotion Classification in Informal Text

    … Emojis. In this thesis, we propose several transformer-based models for emotion classification that processes emojis as input tokens and leverages pretrained models and uses them , a model that processes Emojis as textual inputs and leverages DeepMoji to generate affective feature vectors …

    iupui Repository record for A Study of Transformer Models for Emotion Classification in Informal Text (opens in a new tab)

  14. Query-focused abstractive summarization using sequence-to-sequence and transformer models

    … In our thesis, we propose two neural network models for the query-focused abstractive summarization task. We propose a model based on the sequence-to-sequence architecture with a pointer-generator mechanism. Furthermore, we also use the transformer architecture to design a model for the …

    lethbridge Repository record for Query-focused abstractive summarization using sequence-to-sequence and transformer models (opens in a new tab)

  15. Architectural and Training Regime Modifications to Transformer Models for low data Applications

    … revolution is attributed to large language models (LLMs), which include many prominent AI systems such as ChatGPT, Bard, and Gemini. The majority of high-performance LLM models are based on the transformer architecture and the primary factor behind the recent enhancement in the performance …

    ucf Repository record for Architectural and Training Regime Modifications to Transformer Models for low data Applications (opens in a new tab)

  16. Linear mappings: semantic transfer from transformer models for cognate detection and coreference resolution

    … vision to embeddings generated from large Transformer-based language models. In particular, I study its use in two challenging linguistic tasks: cross-lingual cognate detection and cross-document coreference resolution. Cognate detection for two Low-Resource Languages (LRL), Assamese and …

    colostate Repository record for Linear mappings: semantic transfer from transformer models for cognate detection and coreference resolution (opens in a new tab)

  17. AI-Based Cryptanalysis of RSA Using Transformer Models and Quantized Fully Connected Neural Networks

    … families: Fully Connected Neural Networks (NNs), Transformer architectures, and Hybrid Quantum-classical Neural Networks (HQNNs), using only public parameters. Nine curated datasets vary the modulus, exponent, and plaintext range; two input pipelines, Bit-by-Bit and Direct Bit-stream Processing, …

    guelph Repository record for AI-Based Cryptanalysis of RSA Using Transformer Models and Quantized Fully Connected Neural Networks (opens in a new tab)

  18. Advanced boundary-enhanced instance segmentation and spatial-temporal transformer models for automated schizophrenic investigation

    … experiment with a Dynamic Spatial-Temporal Transformer Model (DySTTM) to detect schizophrenia by integrating structural and functional MRI (fMRI) modalities. The DySTTM leverages spatial attention to capture anatomical interdependencies from segmented sMRI data and temporal attention to …

    lethbridge Repository record for Advanced boundary-enhanced instance segmentation and spatial-temporal transformer models for automated schizophrenic investigation (opens in a new tab)

Page 1 of 14