Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 20 of 45 for “"pre-trained language model"”.

  1. Compression and Analysis of Pre-trained Language Model using Neural Slimming

    … in recent years. In the domain of natural language processing, BERT and its variants significantly outperform other network structures. It learns general linguistic knowledge from a large corpus in the pre-training stage and utilizes that to solve downstream tasks. However, the size of this …

    waterloo Repository record for Compression and Analysis of Pre-trained Language Model using Neural Slimming (opens in a new tab)

  2. EarthSciBERT: Pre-trained Language Model for Information Retrieval in Earth Science

    Large Language Models (LLMs), such as Generative Pre-trained Transformers (GPT) and Bidirectional Encoder Representations from Transformers (BERT), have significantly advanced Natural Language Processing (NLP), achieving state-of-the-art results in various tasks. Notably used in systems like Google …

    mississippi Repository record for EarthSciBERT: Pre-trained Language Model for Information Retrieval in Earth Science (opens in a new tab)

  3. Aspect-Based Sentiment Analysis Using The Pre-trained Language Model BERT

    … the potential of using the contextual word representations from pre-training language models to solve out-of-domain ABSA by constructing a generic ABSA model using BERT, together with the method of fine-tuning the model to make it learn when aspects are related or unrelated to a text. To our …

    chalmers Repository record for Aspect-Based Sentiment Analysis Using The Pre-trained Language Model BERT (opens in a new tab)

  4. A New Feature Engineering-Driven Pre-Trained Language Model for Enabling Semantically Enriched Natural Language Processing Tasks

    Natural language processing (NLP) techniques had significantly improved by introducing pre-trained language models (PLM). The pre-training method uses unannotated data for self-supervised training and can be applied to downstream tasks through fine-tuning and few-shot training. Even though PLMs can …

    nebraska Repository record for A New Feature Engineering-Driven Pre-Trained Language Model for Enabling Semantically Enriched Natural Language Processing Tasks (opens in a new tab)

  5. The Suitability of Generative Adversarial Training for BERT Natural Language Generation

    This thesis presents a study that was designed to test the effect of generative adversarial network (GAN) training on the quality of natural language generation (NLG) using a pre-trained language model architecture: Bidirectional Encoder Representations from Transformers (BERT). Perplexity and BLEU …

    washington Repository record for The Suitability of Generative Adversarial Training for BERT Natural Language Generation (opens in a new tab)

  6. Idiomatic sentence generation and paraphrasing

    Idiomatic expressions (IE) play an important role in natural language, and have long been a “pain in the neck” for NLP systems. Despite this, text generation tasks related to IEs remain largely under-explored. In this study, we propose two new tasks of idiomatic sentence generation and paraphrasing …

    uiuc Repository record for Idiomatic sentence generation and paraphrasing (opens in a new tab)

  7. An approach based on language models and natural language definitions for relationship classification

    … as well as for building explicit knowledge models (ontologies and knowledge graphs). In many of these tasks, experts usually manually establish these relationships by carefully analyzing each concept’s meaning and considering the domain knowledge elicited from domain practitioners or from …

    brazil-ufrgs Repository record for An approach based on language models and natural language definitions for relationship classification (opens in a new tab)

  8. Empower entity set expansion via language model probing

    … and several negative class names by probing a pre-trained language model, and further score each candidate entity based on selected class names. Experiments on two datasets show that our framework generates high-quality class names and outperforms previous state-of-the-art methods significantly.

    uiuc Repository record for Empower entity set expansion via language model probing (opens in a new tab)

  9. Pairwise embedding for event coreference resolution

    … in information extraction research and natural language understanding areas. Recently, the pre-trained language models emerging in modern Natural Language Processing (NLP) community provide a new perspective of solving classical NLP tasks. This thesis presents a novel, extensible, and …

    uiuc Repository record for Pairwise embedding for event coreference resolution (opens in a new tab)

  10. Multi-label Classification and Sentiment Analysis on Textual Records

    In this thesis we have present effective approaches for two classic Nature Language Processing tasks: Multi-label Text Classification(MLTC) and Sentiment Analysis(SA) based on two datasets. For MLTC, a robust deep learning approach based on convolution neural network(CNN) has been introduced. We …

    mcmaster Repository record for Multi-label Classification and Sentiment Analysis on Textual Records (opens in a new tab)

  11. Annotation-free location mention mining from text corpora

    Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-02-04 without embargo terms

    uiuc Repository record for Annotation-free location mention mining from text corpora (opens in a new tab)

  12. Prediction and Enhancement of Speech Intelligibility in Challenging Acoustic Environments

    … two key issues in speech intelligibility: prediction and enhancement. In the Speech Intelligibility Prediction (SIP) segment, we introduce two state-of-the-art, reference-based SIP algorithms that utilize Spectro-Temporal Modulation (STM) analysis of input speech. We present a data-driven, …

    queens Repository record for Prediction and Enhancement of Speech Intelligibility in Challenging Acoustic Environments (opens in a new tab)

  13. Large Language Models for Unsupervised Keyphrase Extraction and Biomedical Data Analytics

    Natural Language Processing (NLP), a vital branch of artificial intelligence, is designed to equip computers with the ability to comprehend and manipulate human language, facilitating the extraction and utilization of textual data. NLP plays a crucial role in harnessing the vast quantities of …

    iupui Repository record for Large Language Models for Unsupervised Keyphrase Extraction and Biomedical Data Analytics (opens in a new tab)

  14. AI-Based Methods for the Analysis of Neurolinguistic EEG Data

    … investigates the intricate mechanisms underlying language processing in the human brain. Electroencephalography (EEG) serves as a crucial tool in this field, providing non-invasive, cost-effective, and portable means to probe neural activity on the small timescales characterising language …

    bristol Repository record for AI-Based Methods for the Analysis of Neurolinguistic EEG Data (opens in a new tab) Download PDF for AI-Based Methods for the Analysis of Neurolinguistic EEG Data (opens in a new tab)

  15. Privacy threats to mobile health apps: an analysis of data collection practices

    … and discuss an automated approach that uses a pre-trained language model to identify and analyze 13,177 mHealth apps from Google Playstore. We identify the ten most common privacy threats in mHealth apps and map them to GDPR policy violations. Privacy violations pertaining to GDPR include the …

    colostate Repository record for Privacy threats to mobile health apps: an analysis of data collection practices (opens in a new tab)

  16. Comparing PSO-Based Clustering Over Contextual Vector Embeddings to Modern Topic Modeling

    Efficient topic modeling is needed to support applications that aim at identifying main themes from a collection of documents. In this thesis, a reduced vector embedding representation and particle swarm optimization (PSO) are combined to develop a topic modeling strategy that is able to identify …

    iupui Repository record for Comparing PSO-Based Clustering Over Contextual Vector Embeddings to Modern Topic Modeling (opens in a new tab)

  17. Text Simplification with Deep Neural Network Using Knowledge Transfer

    … English text sentences. Transfer learning from pre-trained text embeddings and models has recently shown great success on a range of natural language processing tasks and is, therefore, a focus method for our work. This thesis’s first focus is to avoid using parallel corpus with sentence pairs. …

    soton Download PDF for Text Simplification with Deep Neural Network Using Knowledge Transfer (opens in a new tab)

  18. Towards a Holistic and Comparative Analysis of the Free Content Web: Security, Privacy, and Performance

    … that such websites might be different from premium websites providing the same content types in terms of their security, a rigorous analysis that supports this belief is lacking from the literature. In particular, it is unclear if those websites are as safe as their premium counterparts. In …

    ucf Repository record for Towards a Holistic and Comparative Analysis of the Free Content Web: Security, Privacy, and Performance (opens in a new tab)

  19. False textual information detection, a deep learning approach

    … the lack of evidence and the inability of models to generalise across domains, we propose a style-aware model for detecting false information and improving existing performance. We discovered that our model was effective at detecting false information when we evaluated its generalisation …

    whiterose Download PDF for False textual information detection, a deep learning approach (opens in a new tab)

  20. Using Pre-trained Language Models for Toxic Comment Classification

    Toxic comment classification is a core natural language processing task for combating online toxic comments. It follows the supervised learning paradigm which requires labelled data for the training. A large amount of high-quality training data is empirically beneficial to the model performance. …

    whiterose Download PDF for Using Pre-trained Language Models for Toxic Comment Classification (opens in a new tab)

Page 1 of 3