Institutional Repository of Vilnius University
Design of agentic ai systems for automated data extraction in medical processes /
Abstract
dc:descriptionThis thesis examines the design and evaluation of an agentic artificial intelligence system for automated data extraction from anonymized Lithuanian pathology reports. The goal is to convert unstructured clinical narrative into structured records that follow International Collaboration on Cancer Reporting (ICCR) datasets while preserving field-level traceability: every extracted value must be linked to a verbatim source span that supports it. To address this task, an agentic extraction system was developed in which an ICCR schema is populated through separate field-level processing steps. The system first retrieves source spans relevant to a field, then extracts a candidate value, verifies it using a Chain-of-Verification step, and emits schema-constrained JSON output. This architecture is compared against a strong one-shot baseline that receives the same case, schema, and field documentation. The evaluation uses a locked suite of 38 reviewed clinical cases covering four ICCR datasets: breast invasive carcinoma, radical prostatectomy, prostate biopsy, and colorectal resection. Both conditions use the same Qwen3 235B backbone model, and the evaluation is performed with the correct ICCR schema supplied by the suite manifest. The agentic system achieves 75.7% micro F1, compared with 63.0% for the one-shot baseline, and improves citation precision from 76.0% to 90.6%. The results show that the agentic control flow improves extraction mainly by reducing false-positive values and semantically unsupported source citations. The main remaining errors involve multi-value fields, numerical interpretation, and the scoring of clinically equivalent free-text paraphrases.
Degree
thesis:*- Grantor dc:publisher
- Institutional Repository of Vilnius University
- Year dc:date
- 2026
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Lisas, Joris,
Subjects
dc:subject × 1Rights
dc:rights- Statement dc:rights
-
- info:eu-repo/semantics/openAccess
- Language dc:language
- eng
Identifiers
dc:identifier.*- Repository record dc:identifier
- https://repository.vu.lt/VU:ELABAETD308337825&prefLang=en_US