Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 20 of 53 for “"Neural Language Models"”.

  1. Integrating Linguistic Theory and Neural Language Models

    Transformer-based language models have recently achieved remarkable results in many natural language tasks. However, performance on leaderboards is generally achieved by leveraging massive amounts of training data and computation, and rarely by encoding explicit linguistic knowledge into neural …

    toronto-retro Repository record for Integrating Linguistic Theory and Neural Language Models (opens in a new tab)

  2. On Parameter Efficiency of Neural Language Models

    In recent years, pre-trained neural language models have achieved remarkable capabilities across various natural language understanding and generation tasks. However, the trend of scaling these models to encompass billions of parameters, while enhancing adaptability and emergent capabilities, has …

    gatech Repository record for On Parameter Efficiency of Neural Language Models (opens in a new tab)

  3. Mitigating Data Scarcity for Neural Language Models

    In recent years, pretrained neural language models (PNLMs) have taken the field of natural language processing by storm, achieving new benchmarks and state-of-theart performances. These models often rely heavily on annotated data, which may not always be available. Data scarcity are commonly found …

    arizona-thes Repository record for Mitigating Data Scarcity for Neural Language Models (opens in a new tab)

  4. Scalable syntactic inductive biases for neural language models

    <p>Natural language has a sequential surface form, although its underlying structure has been argued to be hierarchical and tree-structured in nature, whereby smaller linguistic units like words are recursively composed to form larger ones, such as phrases and sentences. This thesis aims to answer …

    oxford Repository record for Scalable syntactic inductive biases for neural language models (opens in a new tab)

  5. Emotion Analysis and Neural Language Models for Classification

    … a branch of artificial intelligence and natural language processing focused on recognizing emotions hidden throughout various forms of digital data, including text, images, and multi-modal representations. In this dissertation, we present four published and planned works that investigate …

    arkansas Repository record for Emotion Analysis and Neural Language Models for Classification (opens in a new tab)

  6. Emergent Syntactic Behaviors and Mechanisms in Neural Language Models

    … necessary for robust generalization in natural language processing tasks. One reason for the success of large pre-trained language models (LMs) is that pre-training teaches LMs to rely on syntactic features, rather than incorrect surface features like word position or memorized n-grams. However, …

    jhu Repository record for Emergent Syntactic Behaviors and Mechanisms in Neural Language Models (opens in a new tab)

  7. Improving neural language models on low-resource creole languages

    When using neural models for NLP tasks, like language modelling, it is difficult to utilize a language with little data, also known as a low-resource language. Creole languages are frequently low-resource and as such it is difficult to train neural language models for them well. Creole languages …

    uiuc Repository record for Improving neural language models on low-resource creole languages (opens in a new tab)

  8. Disentangled Representation Learning for Stylistic Variation in Neural Language Models

    The neural network has proven to be an effective machine learning method over the past decade, prompting its usage for modelling language, among several other domains. However, the latent representations learned by these neural network function approximators remain uninterpretable, resulting in a …

    waterloo Repository record for Disentangled Representation Learning for Stylistic Variation in Neural Language Models (opens in a new tab)

  9. Interpretable semantic representations from neural language models and computer vision

    … linguistics is dominated by high capacity neural models that in many cases outperform even human baselines on a wide variety of language-based tasks. However, a serious drawback to the development of these semantic models is in the ambiguity of these representations, as the dimensions of …

    qu-belfast Repository record for Interpretable semantic representations from neural language models and computer vision (opens in a new tab) Download PDF for Interpretable semantic representations from neural language models and computer vision (opens in a new tab)

  10. Conditional Neural Language Models for Multimodal Learning and Natural Language Understanding

    In this thesis we introduce conditional neural language models based on log-bilinear and recurrent neural networks with applications to multimodal learning and natural language understanding. We first introduce a LSTM encoder for learning visual-semantic embeddings for ranking the relevance of text …

    toronto-retro Repository record for Conditional Neural Language Models for Multimodal Learning and Natural Language Understanding (opens in a new tab)

  11. Using neural language models to predict the psychosocial needs of cancer patients

    … In this work, we investigated the use of neural natural language processing (NLP) models to predict these psychosocial needs using initial oncologist consultation documents. We compared a non-neural model, bag-of-words (BOW), with three neural models: convolutional neural networks (CNN), …

    ubc Repository record for Using neural language models to predict the psychosocial needs of cancer patients (opens in a new tab) Download PDF for Using neural language models to predict the psychosocial needs of cancer patients (opens in a new tab)

  12. Adaptation, Context-aware Modeling and Rescoring Methods for Neural Language Models in Automatic Speech Recognition

    Language models are a critical component of an automatic speech recognition (ASR) system. Neural network-based language models have demonstrated their superior ability to model long-range dependency compared with n-gram models and have been widely used in ASR systems. This dissertation focuses on …

    jhu Repository record for Adaptation, Context-aware Modeling and Rescoring Methods for Neural Language Models in Automatic Speech Recognition (opens in a new tab)

  13. Enhancing data accessibility in built asset digital twins with neural language models and immersive technologies

    … (VR) for enhancing data representation and neural language models for improving information retrieval. In particular, the thesis examines the potential of immersive VR environments to intuitively represent the complex built asset data, offering users a more interactive and spatially coherent …

    ets-quebec Download PDF for Enhancing data accessibility in built asset digital twins with neural language models and immersive technologies (opens in a new tab)

  14. Improving the Computational Efficiency of Training and Application of Neural Language Models for Automatic Speech Recognition

    A language model is a vital component of automatic speech recognition systems. In recent years, advancements in neural network technologies have brought vast improvement in various machine learning tasks, including language modeling. However, compared to the conventional backoff n-gram models, …

    jhu Repository record for Improving the Computational Efficiency of Training and Application of Neural Language Models for Automatic Speech Recognition (opens in a new tab)

  15. Understanding the Limitations of Using Large Language Models for Text Generation

    State-of-the-art neural language models are capable of generating incredibly fluent English text.This success provides opportunities for novel forms of interaction, where human writers work collaboratively with a natural-language generation system toward a set of goals. However, it also poses …

    penn Repository record for Understanding the Limitations of Using Large Language Models for Text Generation (opens in a new tab)

  16. Measuring Design Pattern Compliance Using Programming Language Models

    … chances of design regression. In recent days, neural language models (like BERT) pre-trained on source code corpora are beginning to be used for automating a variety of programming tasks. The primary objective of this work is to assess whether such a language model can also be used to automate …

    chalmers Repository record for Measuring Design Pattern Compliance Using Programming Language Models (opens in a new tab)

  17. On the understanding of software engineering related texts via the transfer of prior knowledge

    Software Engineering (SE) related natural language texts, such as app reviews and crowdsourced Questions-Answers (Q&A) play pivotal roles for software engineers and developers to gain knowledge regarding different stages of software life-cycle, such as application development, deployment, and …

    ubc Repository record for On the understanding of software engineering related texts via the transfer of prior knowledge (opens in a new tab) Download PDF for On the understanding of software engineering related texts via the transfer of prior knowledge (opens in a new tab)

Page 1 of 3