Back to search

McMaster University

Evaluation of LLM-driven Data Preparation

Abstract

dc:description.abstract

Large language models (LLMs) have increasingly been used in data preparation pipelines due to their strong natural language understanding and reasoning capabilities. Data preparation tasks such as entity matching, and missing value imputation often rely on identifying syntactic patterns in the data, and domain-specific, contextual interpretations, the latter being a differentiating strength of LLM-based systems. However, these systems are imperfect demonstrating biases and inaccuracies. Studies have shown that 42\% of model-centric approaches lead to inaccuracies and hallucinations, and 40\% of models suffer from biases due to incomplete data. Existing work has studied LLM-based data preparation under fixed prompts and parameter configurations. In this paper, we present a systematic, comparative evaluation of LLM-driven entity matching, missing value imputation, and semantic reasoning across four state-of-the-art models. We evaluate the impact of various parameters including training example quantity, class ratios, input record lengths, missing values proportions, and the utility of key attribute values. Our results show the sensitivities and performance of these models using a suite of real data collections.

Degree

thesis:*
Department dc:contributor.department
Computing and Software
Year dc:date.issued
2026

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Yaxuan Chen
Advisor dc:contributor.advisor
  • Fei, Chiang

Subjects

dc:subject × 3

Rights

dc:rights
Statement dc:rights
  • Attribution 4.0 International
Language dc:language.iso
en

Identifiers

dc:identifier.*

Chain of custody

source
Harvested from
McMaster University
Base URL
macsphere.mcmaster.ca/server/oai/request
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

Yaxuan Chen. Evaluation of LLM-driven Data Preparation. 2026. https://hdl.handle.net/11375/33296