Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 6 of 6 for “"Evaluation of LLMs"”.

  1. A Versatility Analysis: Investigating Large Language Models' Performance Beyond Conventional Benchmarks

    Recent progress in large language models (LLMs) has marked a notable milestone in the field of artificial intelligence. The conventional evaluation of LLMs primarily relies on existing tasks and benchmarks, raising concerns about test set contamination and the genuine comprehension abilities of …

    washington Repository record for A Versatility Analysis: Investigating Large Language Models' Performance Beyond Conventional Benchmarks (opens in a new tab)

  2. SWE-Bench+: Enhanced Coding Benchmark for LLMs

    Large Language Models (LLMs) in Software Engineering (SE) can offer valuable assistance for coding tasks. To facilitate a rigorous evaluation of LLMs in practical coding contexts, Carlos et al. introduced the SWE-bench dataset, which comprises 2,294 real-world GitHub issues. Several impressive …

    york Repository record for SWE-Bench+: Enhanced Coding Benchmark for LLMs (opens in a new tab)

  3. LLM-based long-term life task planning to reduce human uncertainty

    In long-term life tasks, people often face challenges from uncertainty in tasks and information-seeking, which can create difficulties in decision-making and task completion. Recent advancements in Artificial Intelligence (AI), especially in Large Language Models (LLMs), offer transformative …

    oklahoma-thes Repository record for LLM-based long-term life task planning to reduce human uncertainty (opens in a new tab)

  4. OUT OF DISTRIBUTION EVALUATION OF NATURAL LANGUAGE PROCESSING SYSTEMS: GENERALIZATION TO LOW-RESOURCE AND DISTANT LANGUAGES AND HUMAN-AI COLLABORATIVE WRITING

    … from training on diverse text datasets have lead LLMs to be used across a variety of settings. However this increases the chance of models being used in unintended use cases and causing harm to users. This dissertation delves into empirical studies of out-of-distribution issues in text generation …

    maryland Repository record for OUT OF DISTRIBUTION EVALUATION OF NATURAL LANGUAGE PROCESSING SYSTEMS: GENERALIZATION TO LOW-RESOURCE AND DISTANT LANGUAGES AND HUMAN-AI COLLABORATIVE WRITING (opens in a new tab)

  5. Explore the In-context Learning Capability of Large Language Models

    The rapid evolution of Large Language Models (LLMs) has marked the beginning of a new age in AI capabilities, particularly in the domain of natural language understanding and processing. Among the forefront of these advancements is the exploration of in-context learning, a paradigm that enables …

    waterloo Repository record for Explore the In-context Learning Capability of Large Language Models (opens in a new tab)

  6. Statistical Methods for Performance Evaluation of Machine Learning and Artificial Intelligence Models

    … Learning (ML) have revolutionized the field of statistics by introducing advanced data analysis methods for predictive modeling and decision- making. These technologies facilitate handling both structured and unstructured data with high accuracy and efficiency. However, the performance …

    vt Repository record for Statistical Methods for Performance Evaluation of Machine Learning and Artificial Intelligence Models (opens in a new tab)