Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 53 for “"Neural Language Models"”.
-
Integrating Linguistic Theory and Neural Language Models
Transformer-based language models have recently achieved remarkable results in many natural language tasks. However, performance on leaderboards is generally achieved by leveraging massive amounts of training data and computation, and rarely by encoding explicit linguistic knowledge into neural …
-
On Parameter Efficiency of Neural Language Models
In recent years, pre-trained neural language models have achieved remarkable capabilities across various natural language understanding and generation tasks. However, the trend of scaling these models to encompass billions of parameters, while enhancing adaptability and emergent capabilities, has …
-
Mitigating Data Scarcity for Neural Language Models
In recent years, pretrained neural language models (PNLMs) have taken the field of natural language processing by storm, achieving new benchmarks and state-of-theart performances. These models often rely heavily on annotated data, which may not always be available. Data scarcity are commonly found …
-
Scalable syntactic inductive biases for neural language models
<p>Natural language has a sequential surface form, although its underlying structure has been argued to be hierarchical and tree-structured in nature, whereby smaller linguistic units like words are recursively composed to form larger ones, such as phrases and sentences. This thesis aims to answer …
-
Emotion Analysis and Neural Language Models for Classification
… a branch of artificial intelligence and natural language processing focused on recognizing emotions hidden throughout various forms of digital data, including text, images, and multi-modal representations. In this dissertation, we present four published and planned works that investigate …
-
Emergent Syntactic Behaviors and Mechanisms in Neural Language Models
… necessary for robust generalization in natural language processing tasks. One reason for the success of large pre-trained language models (LMs) is that pre-training teaches LMs to rely on syntactic features, rather than incorrect surface features like word position or memorized n-grams. However, …
-
Improving neural language models on low-resource creole languages
When using neural models for NLP tasks, like language modelling, it is difficult to utilize a language with little data, also known as a low-resource language. Creole languages are frequently low-resource and as such it is difficult to train neural language models for them well. Creole languages …
-
Disentangled Representation Learning for Stylistic Variation in Neural Language Models
The neural network has proven to be an effective machine learning method over the past decade, prompting its usage for modelling language, among several other domains. However, the latent representations learned by these neural network function approximators remain uninterpretable, resulting in a …
-
Interpretable semantic representations from neural language models and computer vision
… linguistics is dominated by high capacity neural models that in many cases outperform even human baselines on a wide variety of language-based tasks. However, a serious drawback to the development of these semantic models is in the ambiguity of these representations, as the dimensions of …
-
Conditional Neural Language Models for Multimodal Learning and Natural Language Understanding
In this thesis we introduce conditional neural language models based on log-bilinear and recurrent neural networks with applications to multimodal learning and natural language understanding. We first introduce a LSTM encoder for learning visual-semantic embeddings for ranking the relevance of text …
-
Using neural language models to predict the psychosocial needs of cancer patients
… In this work, we investigated the use of neural natural language processing (NLP) models to predict these psychosocial needs using initial oncologist consultation documents. We compared a non-neural model, bag-of-words (BOW), with three neural models: convolutional neural networks (CNN), …
-
Adaptation, Context-aware Modeling and Rescoring Methods for Neural Language Models in Automatic Speech Recognition
Language models are a critical component of an automatic speech recognition (ASR) system. Neural network-based language models have demonstrated their superior ability to model long-range dependency compared with n-gram models and have been widely used in ASR systems. This dissertation focuses on …
-
Enhancing data accessibility in built asset digital twins with neural language models and immersive technologies
… (VR) for enhancing data representation and neural language models for improving information retrieval. In particular, the thesis examines the potential of immersive VR environments to intuitively represent the complex built asset data, offering users a more interactive and spatially coherent …
-
Improving the Computational Efficiency of Training and Application of Neural Language Models for Automatic Speech Recognition
A language model is a vital component of automatic speech recognition systems. In recent years, advancements in neural network technologies have brought vast improvement in various machine learning tasks, including language modeling. However, compared to the conventional backoff n-gram models, …
-
Understanding the Limitations of Using Large Language Models for Text Generation
State-of-the-art neural language models are capable of generating incredibly fluent English text.This success provides opportunities for novel forms of interaction, where human writers work collaboratively with a natural-language generation system toward a set of goals. However, it also poses …
-
Measuring Design Pattern Compliance Using Programming Language Models
… chances of design regression. In recent days, neural language models (like BERT) pre-trained on source code corpora are beginning to be used for automating a variety of programming tasks. The primary objective of this work is to assess whether such a language model can also be used to automate …
-
On the understanding of software engineering related texts via the transfer of prior knowledge
Software Engineering (SE) related natural language texts, such as app reviews and crowdsourced Questions-Answers (Q&A) play pivotal roles for software engineers and developers to gain knowledge regarding different stages of software life-cycle, such as application development, deployment, and …
Page 1 of 3