Back to search

University of British Columbia

Uncertainty estimation of weakly supervised predictive models for out-of-distribution detection in digital pathology

Abstract

dc:description

The successful integration of deep learning in medical imaging relies upon the reliability and predictiveness of the models. It is important that these models provide accurate predictions for known classes while also delivering well-calibrated uncertainty estimates, especially for unseen classes and anomalies that are regarded as the out-of-distribution (OOD) data, distinct from the data used for model training. Accurate uncertainty estimates can potentially reduce the adverse effects of OOD regions on the target classification task in a clinical workflow. This, in turn, can prevent models from silently failing when confronted with unfamiliar diseases or abnormalities. Our work introduces two distinct approaches, namely M-Branch (Multi-Branch) and VPS (Virtual Patch Synthesis), for training multi-instance learning (MIL) models in histopathology, endowing them with the capability to effectively estimate predictive uncertainty. We conduct a comprehensive performance evaluation by comparing our proposed models to a state-of-the-art MIL model in whole-slide image (WSI) classification, equipped with temperature scaling for enhanced calibration, referred to as CLAM-T, focusing on the task of OOD detection. In our study, we consider the classification of Non-Small Cell Lung Cancer (NSCLC) subtypes, primarily distinguishing between LUAD (lung adenocarcinoma) and LUSC (lung squamous cell carcinoma) as in-distribution classes, while also differentiating NSCLC as in-distribution from Lower Grade Glioma (LGG) as out-of-distribution. Our top-performing model, M-Branch, efficiently estimates predictive uncertainty through the deployment of multiple branches of attention-based networks, complemented by a diversity-promoting loss. We employ two key evaluation metrics, FPR95 and AUC, to assess OOD detection performance. M-Branch excels in this regard, achieving an FPR95 of 38.39 and an AUC of 84.86, outperforming both VPS (FPR95: 49.76, AUC: 81.95) and CLAM-T (FPR95: 49.29, AUC: 83.00). Moreover, we demonstrate that the incorporation of a meta-loss function within M-Branch significantly enhances OOD detection, as evident from the improvements in FPR95 and AUC. Our research makes a substantial contribution to the field of medical image analysis by equipping MIL models with the ability to estimate predictive uncertainty effectively. These advancements have promising implications for enhancing the reliability and performance of deep learning models in medical imaging and digital pathology, particularly in real-world healthcare applications.

Degree

thesis:*
Name thesis:degree_name
Master of Applied Science - MASc
Level thesis:degree_level
master's
Discipline thesis:degree_discipline
Biomedical Engineering
Grantor dc:publisher
University of British Columbia
Year dc:date
2024

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Abolfath Beygi Dezfouli, Parisa
Contributors dc:contributor
  • Bashashati, Ali

Rights

dc:rights
Statement dc:rights
  • Attribution-NonCommercial-NoDerivatives 4.0 International
Language dc:language
eng

Identifiers

dc:identifier.*
Handle dc:identifier
http://hdl.handle.net/2429/87337

Chain of custody

source
Harvested from
University of British Columbia
Base URL
circle.library.ubc.ca/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Abolfath Beygi Dezfouli, Parisa. Uncertainty estimation of weakly supervised predictive models for out-of-distribution detection in digital pathology. master's thesis, University of British Columbia, 2024. http://hdl.handle.net/2429/87337