Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 46 for “"Pretrained Language Models"”.
-
Generalization and Fairness Optimization in Pretrained Language Models
… to address the generalization challenge in pretrained language models (PLMs), which affects their performance on diverse linguistic data beyond their training scope. Improving PLMs' adaptability to out-of-distribution (OOD) data is essential for their reliability and practical utility in …
-
Future Sight: Dynamic Story Generation with Large Pretrained Language Models
… inference. We build an interactive system using pretrained transformers finetuned on a novel objective to temporally interpolate between a story context c and a future plot event f. At inference time, users can suggest future plot events along with a distance, in sentences, to coerce a …
-
Towards Effective Utilization of Pretrained Language Models — Knowledge Distillation from BERT
In the natural language processing (NLP) literature, neural networks are becoming increasingly deeper and more complex. Recent advancements in neural NLP are large pretrained language models (e.g. BERT), which lead to significant performance gains in various downstream tasks. Such models, however, …
-
From Intent Detection to Recommendations: Leveraging Pretrained Language Models for Enhanced User Experiences
Pretrained language models have started a new era in artificial intelligence in general and natural language processing (NLP) in particular. With the advent of transformer architecture, pretrained language models are at the forefront of driving advancements in machine intelligence. Scaled dot …
-
Modeling Scaled Offensiveness in Greek Texts through Regression with Best–Worst Scaling and Pretrained Language Models
Τα τελευταία χρόνια, ο προσβλητικός λόγος έχει αναδειχθεί σε ένα ευρέως διαδεδομένο φαινόμενο στις πλατφόρμες κοινωνικής δικτύωσης, ως αποτέλεσμα της αυξανόμενης χρήσης και προσβασιμότητάς τους. Όλο και περισσότεροι χρήστες δημοσιεύουν επιβλαβές ή υποτιμητικό περιεχόμενο, στοχεύοντας άτομα ή …
-
Distributed representations for multilingual language processing
… representations are a central element in natural language processing. Units of text such as words, ngrams, or characters are mapped to real-valued vectors so that they can be processed by computational models. Representations trained on large amounts of text, called static word embeddings, have …
-
Prompt-tuning in Controlled Dialogue Generation
… since the advent of Transformer. Fine-tuning pretrained language models for different downstream tasks has become the dominant paradigm in Natural Language Processing (NLP). However, fine-tuning requires storing a full copy of parameter states for every task, which is memory-consuming and …
-
Multilingual representations and models for improved low-resource language processing
… popular among researchers. In more recent years, Pretrained Language Models using large amounts of data and creating contextualized representations achieved great performance in various tasks such as Semantic Role Labeling. These large pretrained language models are capable of storing and …
-
AfriBERTa: Towards Viable Multilingual Language Models for Low-resource Languages
There are over 7000 languages spoken on earth, but many of these languages suffer from a dearth of natural language processing (NLP) tools. Multilingual pretrained language models have been introduced to help alleviate this problem. However, the largest pretrained multilingual models were trained …
-
Geometries of word embeddings
… word embeddings have transformed natural language processing (NLP) applications, recognized for their ability to capture linguistic regularities. Popular examples are word2vec, GloVe, GPT and BERT. Both word2vec and GloVe are static whose word representations are independent of its …
-
Making multilingual data count: improving cross-lingual transfer for low-resource languages through data-centric realignment
Cross-lingual transfer enables multilingual pretrained language models (mPLM) to support low-resource languages (LRLs) by leveraging knowledge learned from high-resource languages (HRLs). Motivated by the strong correlation between cross-lingual alignment and transfer, realignment using bilingual …
-
QAVSA: Question Answering Using Vector Symbolic Algebras
With the advancement of large pretrained language models (PLMs), many question answering (QA) benchmarks have been developed in order to evaluate the capabilities of these models. Augmenting PLMs with external knowledge in the form of Knowledge Graphs (KGs) has been a popular method to improve …
-
Improving Communication and Collaboration Using Artificial Intelligence: An NLP-Enabled Pair Programming Collaborative-ITS Case Study
This dissertation investigates computational models and methods to improve collaboration skills among students. The study targets pair programming, a popular collaborative learning practice in computer science education. This research led to the first machine learning models capable of detecting …
-
Towards Efficiently and Reliably Harnessing Pre-trained Language Models: A Data-centric Lens
Large Language Models (LLMs) excel across diverse tasks, but their performance depends heavily on high-quality data, which is often scarce and costly. In this talk, I will present three lines of research focused on developing data-centric approaches for enhancing LLM performance: (1) Cost-Efficient …
-
Efficient Neural Methods for Coreference Resolution
Coreference resolution is a core task in natural language processing and in creating language technologies. Neural methods and models for automatically resolving references have emerged and developed over the last several years. This progress is largely marked by continuous improvements on a single …
-
From Sesame Street to Beyond: Multi-Domain Discourse Relation Classification with Pretrained BERT
… have gained massive popularity in recent years. Pretrained language models have demonstrated the most successful results in producing high quality neural networks capable of quality inference after training across domains via transfer learning. This study expands on the domain transfer introduced …
-
Extracting Formal Process Model Information from Natural Language Text Descriptions using Machine Learning
… Automatic generation of formal business process models is a research field working on facilitating the creation of formal process models, by extracting the information contained in existing natural language process descriptions and synthesizing a formal process model. While this field of research …
-
Knowledge-Driven Text Generation
Natural Language Generation (NLG) is an automated process that produces human-like text. It can create this text either from scratch or using inputs like natural language or structured data such as database records, computer-generated reports or keywords. The main objective of NLG is to generate …
Page 1 of 3