Back to search

University of South Florida

Multi-Modal Survival Prediction on Breast Cancer Mammograms and Enabling Multi-Institutional Collaborations with Federated Learning

Abstract

dc:description

Cancer remains one of the leading causes of mortality worldwide, and machine learning is well positioned to leverage the large volumes of routinely collected clinical and imaging data to improve patient outcomes. Realizing this potential at scale requires three capabilities that current practice does not yet deliver in combination: models that integrate the multiple data modalities clinicians use, training procedures that respect institutional data-sharing constraints, and tooling that enables sharing of de-identified data when federated approaches are not sufficient. This dissertation develops methods and infrastructure addressing each of these capabilities in the context of breast cancer and oncology more broadly. First, a multimodal machine-learning pipeline is developed for predicting mortality risk in breast cancer patients from screening mammograms and clinical variables. The work shows that mammographic images can compensate for missing clinical biomarkers in mortality risk stratification, that the model identifies high-risk patients even within subgroups generally associated with good prognosis, and that the contralateral (unaffected) breast carries a strong, independently prognostic signal for survival of the primary cancer. This region has been historically overlooked in survival-prediction workflows. Second, this dissertation provides a comprehensive review of federated learning for medical imaging, covering training methods, privacy-preservation techniques, and uncertainty quantification, and translates that review into practice through several real-world federatedlearning deployments at Moffitt Cancer Center as part of broader National Cancer Institute and EDRN consortia. These deployments are supported by a one-touch FL system that enables rapid conversion of existing machine-learning pipelines to a federated paradigm and the embed-thenviii federate system that allows institutions to leverage large medical foundation models without prohibitive compute and communication cost. Third, a validated and calibrated automated de-identification pipeline for medical data containing protected health information is developed in collaboration with Impact Business Information Solutions (IBIS), with calibration that allows low-confidence cases to be flagged for human review. Taken together, these contributions advance machine learning in oncology toward multimodal models that can be trained securely across institutions and that can release clean, deidentified data when needed, ultimately helping machine learning deliver on its potential to improve cancer patient outcomes.

Degree

thesis:*
Name thesis:degree_name
Doctor of Philosophy (Ph.D.)
Level thesis:degree_level
Dissertation
Discipline thesis:degree_discipline
Electrical Engineering
Grantor
University of South Florida
Year dc:date
2026

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Koutsoubis, Nikolas
Contributors dc:contributor
  • Ghulam Rasool, Ph.D.
  • Yasin Yilmaz, Ph.D.
  • Matthew Schabath, Ph.D.
  • Mia Naeini, Ph.D.
  • Susana Lai-Yuen, Ph.D.

Subjects

dc:subject × 8

Identifiers

dc:identifier.*
Repository record dc:identifier
https://digitalcommons.usf.edu/etd/11329

Chain of custody

source
Harvested from
University of South Florida
Base URL
digitalcommons.usf.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Koutsoubis, Nikolas. Multi-Modal Survival Prediction on Breast Cancer Mammograms and Enabling Multi-Institutional Collaborations with Federated Learning. Dissertation thesis, University of South Florida, 2026. https://digitalcommons.usf.edu/etd/11329