Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 24 for “"Multilingual Models"”.
-
Minimizing Language Interference for Multilingual Models
… language processing, enabling the development of models that can understand and generate multiple languages. Multilingual models leverage a unified architecture to support multiple languages, facilitating cross-lingual knowledge transfer and significantly benefiting low-resource languages. …
-
Computational modeling of politeness across diverse languages
… totaling 4.5K examples. We evaluate how well multilingual models can identify politeness levels -- they show a fairly robust zero-shot transfer ability, yet fall short of estimated human accuracy significantly. We further study mapping the English politeness strategy lexicon into nine …
-
AfriBERTa: Towards Viable Multilingual Language Models for Low-resource Languages
… of natural language processing (NLP) tools. Multilingual pretrained language models have been introduced to help alleviate this problem. However, the largest pretrained multilingual models were trained on only hundreds of languages. This is a small amount when compared to the number of spoken …
-
mSCAN - a Multilingual Dataset for Compositional Generalization Evaluation
Language models achieve remarkable results on a variety of tasks, yet still struggle on compositional generalization benchmarks. The majority of these benchmarks evaluate performance in English only, leaving open the question of whether these results generalize to other languages. As an initial …
-
Overcoming Vocabulary Challenges in Natural Language Processing
… it remains challenging to build language models which appropriately generalize across the world's approximately 7,000 languages and 150 scripts—a challenge which begins from one of the very first steps, designing the model vocabulary. Language models are typically defined over a finite set …
-
Multilingual Language Models: Analysis and Algorithms
While large language models (LLMs) continue to grow in scale and gain new zero-shot capabilities, their performance for languages beyond English increasingly lags behind. This gap is due to the curse of multilinguality, where multilingual language models perform worse on individual languages than a …
-
Data augmentation for automatic speech recognition for low resource languages
… We then apply the most promising combinations of models and augmentation methods to three genuinely under-resourced languages using the 40-hour Gujarati, Tamil, Telugu datasets from the 2021 Interspeech Low Resource Automatic Speech Recognition Challenge for Indian Languages. Our data augmentation …
-
Resourceful at Any Size: A Predictive Methodology Using Linguistic Corpus Metrics for Multi-Source Training in Neural Dependency Parsing
Multilingual modeling comes up in natural language processing at any scale. High-resource language corpora train high-performing models, and can be combined with other language corpora of all sizes to make better models for low-resource languages. Projects like Universal Dependencies even make it …
-
How Do Multilingual Encoders Learn Cross-lingual Representation?
… languages. From an engineering perspective, multilingual NLP benefits development and maintenance by serving multiple languages with a single system. Both cross-lingual transfer and multilingual NLP rely on cross-lingual representations serving as the foundation. As BERT revolutionized …
-
Producing synthetic instances for textual classification and natural language inference
… relationship between their meanings. Training models with NLI datasets is key for semantic systems. NLI datasets are also used to train sentence-transformer (ST) models, which use Siamese networks to learn the relationship between the pair of sentences, generating good representations in an …
-
Producing synthetic instances for textual classification and natural language inference
… relationship between their meanings. Training models with NLI datasets is key for semantic systems. NLI datasets are also used to train sentence-transformer (ST) models, which use Siamese networks to learn the relationship between the pair of sentences, generating good representations in an …
-
Fine-tuning ASR Models for Very Low-Resource Languages: A Study on Mvskoke
Recent advancements in multilingual models for automatic speech recognition (ASR) have significantly improved accuracy for languages with extremely limited resources. This study focuses on ASR modeling for the Mvskoke language, an indigenous language of America, by fine-tuning three multilingual …
-
Neural Sequence Labeling on Social Media Text
… SM platforms provide a unique space for multilingual content. This polyglot environment requires modern systems to adapt to a diverse range of languages, imposing another linguistic barrier to processing and understanding of text from SM domains. This thesis aims at providing novel …
-
Multilingual Grammatical Error Detection And Its Applications to Prompt-Based Correction
… networks. This work focuses on the study of multilingual GED models and how they can be used to improve GEC performed by large language models (LLMs). We study the difference in performance between GED models trained in a single language and models that undergo multilingual training. We …
-
Peering inside the 'Black Box': understanding and refining deep neural networks with representational similarity analysis
Deep neural networks, and Transformer models in particular, have achieved unprecedented success in natural language processing tasks. Despite this success, they are infamous for their status as black boxes. Specific details on how they encode and process high-level linguistic task-relevant …
-
SYMBOLIC AND NEURAL APPROACHES TO NATURAL LANGUAGE INFERENCE
… studies have proposed logic-based, symbolic models and neural network models to perform inference. However, in the symbolic tradition, relatively few systems are designed based on monotonicity and natural logic rules; in the neural network tradition, most work is focused exclusively on …
-
Modeling of Language-Universal Speech Attributes for Multilingual Speech Recognition and Processing
The performance of multilingual automatic speech recognition (ASR) systems critically depends on their ability to generalize across diverse languages and linguistic environments. Conventional ASR approaches typically involve training separate models for each language, which can be challenging due …
-
Neural machine translation for low-resource conditions
… in creating efficient and trustworthy NMT models which perform remarkably well. Yet, many issues such as lack of monolingual or parallel data for certain Languages and Language Pairs, and constraints in compute resources call for further analysis of the NMT pipeline, to understand model …
-
Crosslingual Sharing for Low-Resource Natural Language Processing
… settings. In the first, we present language models and supervised structured prediction models which take a joint training approach, sharing parameters across several languages, to improve performance relative to monolingual training. We begin the second with GroC, a language model with …
-
Towards Better Representations in Language Modeling
… different methods and designed different models to boost performance, we explore in the following directions: 1. unconditional text generation; 2. conditional text generation; 3. leveraging language modeling to improve downstream understanding tasks. Text generation is an important and …
Page 1 of 2