Abstract
dc:description.abstractLarge language models (LLMs) have increasingly been used in data preparation pipelines due to their strong natural language understanding and reasoning capabilities. Data preparation tasks such as entity matching, and missing value imputation often rely on identifying syntactic patterns in the data, and domain-specific, contextual interpretations, the latter being a differentiating strength of LLM-based systems. However, these systems are imperfect demonstrating biases and inaccuracies. Studies have shown that 42\% of model-centric approaches lead to inaccuracies and hallucinations, and 40\% of models suffer from biases due to incomplete data. Existing work has studied LLM-based data preparation under fixed prompts and parameter configurations. In this paper, we present a systematic, comparative evaluation of LLM-driven entity matching, missing value imputation, and semantic reasoning across four state-of-the-art models. We evaluate the impact of various parameters including training example quantity, class ratios, input record lengths, missing values proportions, and the utility of key attribute values. Our results show the sensitivities and performance of these models using a suite of real data collections.
Degree
thesis:*- Department dc:contributor.department
- Computing and Software
- Year dc:date.issued
- 2026
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Yaxuan Chen
- Advisor dc:contributor.advisor
-
- Fei, Chiang
Subjects
dc:subject × 3Rights
dc:rights- Statement dc:rights
-
- Attribution 4.0 International
- Licence dc:rights.uri
- Language dc:language.iso
- en
Identifiers
dc:identifier.*- Identifier URI
- https://doi.org/10.71548/158