Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 3321 for “"language models"”.
-
Sequentialized Language Models
… an optimal, strictly bottom-up parseable metalanguage for a compression scheme comprising multiple grammars; a principled approach to ambiguity and agrammatical text; and an incremental analysis selection algorithm. The metalanguage construction emphasizes lexical left-corner analysis …
-
TOWARDS TRUSTWORTHY LANGUAGE MODELS
Language Models (LMs) and Large Language Models (LLMs) have significantly advanced natural language processing and enabled a wide range of real-world applications. However, their outputs are not always trustworthy, limiting reliable deployment. This thesis studies the trustworthiness of LMs across …
-
Domain Adapted Language Models
… proven it self amassive leap forward in natural language processing. Due to the tedious training required by this massive model, a pretrained BERT instance has been released as a high-performing starting point for further training on downstream tasks. The pretrained model has been trained on …
-
Language Models for Citation Classification
… is a lack of standard benchmarks for evaluating models for citation classification. Extracting valuable metadata related to the reason behind citation in scientific articles, particularly across multiple domains, is laborious and researchers still lack consensus on what should be the optimal …
-
Towards Trustworthy Large Language Models
Large language models (LLMs) have achieved remarkable performance across a wide range of tasks, including open-domain question answering, conversational agents, and mathematical reasoning. As their adoption increases, so too does user reliance on their outputs. However, current LLMs remain …
-
Language models for ontology engineering
… domains. Meanwhile, modern deep learning-based language models (LMs) represent a significant milestone in the field of Natural Language Processing (NLP), as they incorporate substantial background knowledge from the vast and complex distribution of textual data. This thesis explores the synergy …
-
Inferring Systemic Functional Language Models
Language production in the brain is a complicated process that is not yet fully understood. The bag-of-words model, which considers the frequencies of each word in a document, is a useful approach in many text mining fields, but it does not provide any information about how language is produced. …
-
Economic inferences using language models
… created by recent advances in natural language modelling, which appear to remain underexplored as an econometric methodology—a gap this thesis aims to help fill. Through this lens, I revisit three economic inference problems: estimation of the dynamic causal effects of monetary policy, …
-
Creativity in Large Language Models
As artificial intelligence systems approach human-level performance across a wide variety of domains, creative domains remain a critical yet underexplored area of research. Unlike traditional AI tasks with well-defined objectives, creative tasks rely on inherently subjective measures, making them …
-
Emotions in Large Language Models
Large language models (LLMs) through their training process learn and store a lot of general knowledge. However, the distribution of knowledge has a long-tail pattern of many infrequently used facts. This poses a challenge for LLMs when a query requires information that is on the long-tail. It is …
-
Language Models: Generator and Labeler
… been remarkable progress in the capabilities of language models. These models have been trained on massive amounts of data using advanced learning algorithms, enabling them to perform a wide range of Natural Language Processing (NLP) tasks with great accuracy. This has made them highly reliable …
-
Foundations of Diffusion Language Models
Diffusion models have recently emerged as a powerful alternative to autoregressive (AR) models for generative modeling, with strong results in continuous domains such as images and video. In the discrete setting of language, however, diffusion models still lag behind AR approaches in both …
-
Catastrophic Forgetting in Language Models
… particularly in the context of pre-trained language models. This thesis investigates the phenomenon of catastrophic forgetting in large language models (LLMs), with a focus on BERT, through a series of benchmark evaluations. Specifically, we explore the effects of fine-tuning BERT on a …
-
Learning Language Models on Graphs
Language models (LMs) have achieved remarkable success across natural language processing (NLP) tasks, yet they remain fundamentally limited by their reliance on sequential token representations. Natural language, however, is inherently relational and hierarchical: it reflects syntactic …
-
Efficient Scaling of Language Models
Large language models (LLMs) are progressively reshaping how humans interact with information, offering increasingly sophisticated access to knowledge through natural language interfaces and advancing reasoning capabilities across diverse domains. Yet, their impressive gains have hinged on a simple …
-
Language models as semantic indexers
Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2025-12-01
-
Towards trustworthy large language models
Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2024-03-01 without embargo terms
-
Large language models for code editing
… a great target for automation. Recently, Large Language Models (LLMs) have shown strong performance in many software-related generation tasks, such as code and documentation generation, significantly improving developers’ productivity. Nevertheless, these generative models are not well-suited …
-
Value estimation in Large Language Models
Large language models (LLMs) are commonly post-trained with reinforcement learning to improve reasoning performance. A central design choice in this process is whether to estimate advantages using a learned value function or directly from Monte Carlo returns. Value-based estimators can reduce …
Page 1 of 167