Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 2 of 2 for “"AI Agent Evaluation"”.

  1. SWE-bench-secret: Automating AI Agent Evaluation for Software Engineering Tasks

    … as new and more capable LLMs emerge, existing evaluation benchmarks (such as HumanEval and MBPP) are no longer sufficient for gauging their potential. While benchmarks like SWE-bench and SWE-bench-java provide a foundation for evaluating these models on real-world challenges, publicly available …

    waterloo Repository record for SWE-bench-secret: Automating AI Agent Evaluation for Software Engineering Tasks (opens in a new tab)

  2. Code-Upload AI Challenges on EvalAI

    … We have developed several tools such as EvalAI which helps us in evaluating the performance of these systems and to push the frontiers of machine learning and artificial intelligence. Initially, the AI community focussed on simple and traditional methods of evaluating these systems in the …

    gatech Repository record for Code-Upload AI Challenges on EvalAI (opens in a new tab)