Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 45 for “"pre-trained language model"”.
-
Compression and Analysis of Pre-trained Language Model using Neural Slimming
… in recent years. In the domain of natural language processing, BERT and its variants significantly outperform other network structures. It learns general linguistic knowledge from a large corpus in the pre-training stage and utilizes that to solve downstream tasks. However, the size of this …
-
EarthSciBERT: Pre-trained Language Model for Information Retrieval in Earth Science
Large Language Models (LLMs), such as Generative Pre-trained Transformers (GPT) and Bidirectional Encoder Representations from Transformers (BERT), have significantly advanced Natural Language Processing (NLP), achieving state-of-the-art results in various tasks. Notably used in systems like Google …
-
Aspect-Based Sentiment Analysis Using The Pre-trained Language Model BERT
… the potential of using the contextual word representations from pre-training language models to solve out-of-domain ABSA by constructing a generic ABSA model using BERT, together with the method of fine-tuning the model to make it learn when aspects are related or unrelated to a text. To our …
-
A New Feature Engineering-Driven Pre-Trained Language Model for Enabling Semantically Enriched Natural Language Processing Tasks
Natural language processing (NLP) techniques had significantly improved by introducing pre-trained language models (PLM). The pre-training method uses unannotated data for self-supervised training and can be applied to downstream tasks through fine-tuning and few-shot training. Even though PLMs can …
-
The Suitability of Generative Adversarial Training for BERT Natural Language Generation
This thesis presents a study that was designed to test the effect of generative adversarial network (GAN) training on the quality of natural language generation (NLG) using a pre-trained language model architecture: Bidirectional Encoder Representations from Transformers (BERT). Perplexity and BLEU …
-
Idiomatic sentence generation and paraphrasing
Idiomatic expressions (IE) play an important role in natural language, and have long been a “pain in the neck” for NLP systems. Despite this, text generation tasks related to IEs remain largely under-explored. In this study, we propose two new tasks of idiomatic sentence generation and paraphrasing …
-
An approach based on language models and natural language definitions for relationship classification
… as well as for building explicit knowledge models (ontologies and knowledge graphs). In many of these tasks, experts usually manually establish these relationships by carefully analyzing each concept’s meaning and considering the domain knowledge elicited from domain practitioners or from …
-
Empower entity set expansion via language model probing
… and several negative class names by probing a pre-trained language model, and further score each candidate entity based on selected class names. Experiments on two datasets show that our framework generates high-quality class names and outperforms previous state-of-the-art methods significantly.
-
Pairwise embedding for event coreference resolution
… in information extraction research and natural language understanding areas. Recently, the pre-trained language models emerging in modern Natural Language Processing (NLP) community provide a new perspective of solving classical NLP tasks. This thesis presents a novel, extensible, and …
-
Multi-label Classification and Sentiment Analysis on Textual Records
In this thesis we have present effective approaches for two classic Nature Language Processing tasks: Multi-label Text Classification(MLTC) and Sentiment Analysis(SA) based on two datasets. For MLTC, a robust deep learning approach based on convolution neural network(CNN) has been introduced. We …
-
Annotation-free location mention mining from text corpora
Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-02-04 without embargo terms
-
Prediction and Enhancement of Speech Intelligibility in Challenging Acoustic Environments
… two key issues in speech intelligibility: prediction and enhancement. In the Speech Intelligibility Prediction (SIP) segment, we introduce two state-of-the-art, reference-based SIP algorithms that utilize Spectro-Temporal Modulation (STM) analysis of input speech. We present a data-driven, …
-
Large Language Models for Unsupervised Keyphrase Extraction and Biomedical Data Analytics
Natural Language Processing (NLP), a vital branch of artificial intelligence, is designed to equip computers with the ability to comprehend and manipulate human language, facilitating the extraction and utilization of textual data. NLP plays a crucial role in harnessing the vast quantities of …
-
AI-Based Methods for the Analysis of Neurolinguistic EEG Data
… investigates the intricate mechanisms underlying language processing in the human brain. Electroencephalography (EEG) serves as a crucial tool in this field, providing non-invasive, cost-effective, and portable means to probe neural activity on the small timescales characterising language …
-
Privacy threats to mobile health apps: an analysis of data collection practices
… and discuss an automated approach that uses a pre-trained language model to identify and analyze 13,177 mHealth apps from Google Playstore. We identify the ten most common privacy threats in mHealth apps and map them to GDPR policy violations. Privacy violations pertaining to GDPR include the …
-
Comparing PSO-Based Clustering Over Contextual Vector Embeddings to Modern Topic Modeling
Efficient topic modeling is needed to support applications that aim at identifying main themes from a collection of documents. In this thesis, a reduced vector embedding representation and particle swarm optimization (PSO) are combined to develop a topic modeling strategy that is able to identify …
-
Text Simplification with Deep Neural Network Using Knowledge Transfer
… English text sentences. Transfer learning from pre-trained text embeddings and models has recently shown great success on a range of natural language processing tasks and is, therefore, a focus method for our work. This thesis’s first focus is to avoid using parallel corpus with sentence pairs. …
-
Towards a Holistic and Comparative Analysis of the Free Content Web: Security, Privacy, and Performance
… that such websites might be different from premium websites providing the same content types in terms of their security, a rigorous analysis that supports this belief is lacking from the literature. In particular, it is unclear if those websites are as safe as their premium counterparts. In …
-
False textual information detection, a deep learning approach
… the lack of evidence and the inability of models to generalise across domains, we propose a style-aware model for detecting false information and improving existing performance. We discovered that our model was effective at detecting false information when we evaluated its generalisation …
-
Using Pre-trained Language Models for Toxic Comment Classification
Toxic comment classification is a core natural language processing task for combating online toxic comments. It follows the supervised learning paradigm which requires labelled data for the training. A large amount of high-quality training data is empirically beneficial to the model performance. …
Page 1 of 3