Back to search

Cornell University

Efficient Data Systems for Scalable Analysis with Large Language Models

Abstract

dc:description.abstract

Modern data analysis increasingly relies on large language models (LLMs) to process diverse data modalities, including text, images, audio, and video. Although LLMs offer advanced reasoning capabilities for unstructured data, their high inference costs significantly exceed those of traditional relational operators. This computational overhead often becomes a critical bottleneck, limiting the scalability of LLM-driven analytical systems in real-world applications. This thesis introduces two complementary systems designed to mitigate this challenge and enable cost-efficient data analysis with LLMs. Both systems leverage principles from approximate query processing to balance computational cost and result quality. The first, ThalamusDB, reduces inference costs by minimizing the volume of data processed. Guided by specialized cost and error models, ThalamusDB identifies an optimal data subset for processing while respecting user-defined error constraints. The second system, SpareLLM, reduces costs by automatically selecting the smallest, most efficient LLM that satisfies user-defined equivalence constraints compared to a powerful reference model. Together, these systems present distinct strategies for achieving scalable data analysis with LLMs. Furthermore, this work introduces BitGourmet and AggChecker to address related challenges in specialized data processing and result verification, respectively.

Degree

thesis:*
Name thesis:degree_name
Ph. D., Computer Science
Level thesis:degree_level
Doctor of Philosophy
Discipline thesis:degree_discipline
Computer Science
Grantor
Cornell University
Year dc:date.issued
2025

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Jo, Saehan
Chair dc:contributor.chair
  • Trummer, Immanuel
Committee members dc:contributor.committeemember
  • Wagner, Aaron
  • Ellis, Kevin
  • Kuleshov, Volodymyr

Rights

Language dc:language.iso
en

Identifiers

dc:identifier.*
Dc Identifier Bibid
16938426
Dc Identifier Other
ProQuest Submission ID: 14898
ProQuest Publication ID: 31997347

Chain of custody

source
Harvested from
Cornell University
Base URL
ecommons.cornell.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Jo, Saehan. Efficient Data Systems for Scalable Analysis with Large Language Models. Doctor of Philosophy thesis, Cornell University, 2025. https://hdl.handle.net/1813/117581