University of Alabama Birmingham
Clinical Validation Of Tabpfn-2.5: Zero-Shot Performance, Data-Scarce Robustness, And Distilled Models For Real-Time Clinical Decision Support
Abstract
dc:description.abstractAccurate clinical risk prediction plays an important role in improving patient outcomes, particularly in perioperative settings where early intervention can influence care decisions. Although machine learning has shown promising results using electronic health record (EHR) data, its use in clinical practice is often limited by complex development processes, the need for hyperparameter tuning, and variability in performance across datasets. These challenges are especially relevant in data-scarce clinical settings. This thesis evaluates TabPFN-2.5, a transformer-based tabular foundation model designed to perform classification without dataset-specific training. The model was applied to two real-world perioperative prediction tasks: unplanned care escalation (UCE) following post-anesthesia care unit (PACU) discharge and 30-day postoperative in-hospital mortality. Its performance was compared with logistic regression, XGBoost, and two clinical scorecard models. Across both datasets, TabPFN-2.5 showed comparable and, in some cases, improved performance. On the PACU UCE task, it achieved an AUROC of 0.814, slightly higher than XGBoost and the scorecard model. On the 30-day mortality dataset, it achieved an AUROC of 0.893, similar to the scorecard baseline, despite requiring no hyperparameter tuning and operating under feature constraints. The model also maintained consistent performance in smaller sample settings. These findings suggest that tabular foundation models may offer a practical alternative to traditional machine learning approaches. By reducing the need for extensive preprocessing and tuning, TabPFN-2.5 has the potential to support more accessible clinical decision-making, particularly in settings with limited data or technical resources.
Degree
thesis:*- Name thesis:degree_name
- Master of Science in Biomedical Engineering (MSBME)
- Level thesis:degree_level
- Thesis
- Discipline thesis:degree_discipline
- Biomedical Engineering
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Aljawawdeh, Baraa
- Contributors dc:contributor
-
- <p>Ryan Melvin</p>
- <p>John Osborne<br>Sandeep Bodduluri</p>
Identifiers
dc:identifier.*- Repository record dc:identifier
- https://digitalcommons.library.uab.edu/etd-2020s/248