Back to search

Rochester Institute of Technology

Robust Multimodal Fusion for Oncology

Abstract

dc:description.abstract

Multimodal deep learning models have the potential to significantly improve survival predictions and treatment planning for cancer patients. These models integrate diverse data modalities using early, intermediate, or late fusion techniques. However, many existing multimodal models either underperform or show only marginal improvements over unimodal models. To establish the true efficacy of multimodal survival prediction models, it is critical to demonstrate consistent and substantial advantages over unimodal counterparts. In this thesis, we introduce the Robust Multimodal Survival Model (RMSurv), a novel discrete late fusion model that leverages synthetic data generation to compute time-dependent weights for various modalities. RMSurv utilizes up to 6 distinct data modalities from the Cancer Genome Atlas Program (TCGA) non-small cell lung cancer and the TCGA pan-cancer datasets. In our experiments, RMSurv outperforms the best unimodal model’s Concordance index (C-Index) by 0.0273 on the 6-modal TCGA Lung Adenocarcinoma (LUAD) dataset. Existing late and early fusion methods improved the C-index by only 0.0143 and 0.0072, respectively. RMSurv also performs best on the combined TCGA non-small-cell lung cancer dataset and the TCGA pan-cancer dataset. The key innovations of RMSurv are the calculation of time-dependent late fusion weights using a synthetically generated dataset and a new statistical feature normalization technique to enhance the interpretability and accuracy of discrete survival predictions. These advancements underscore RMSurv’s potential as a powerful approach for survival prediction, establishing robust multimodal benefits and setting a new benchmark for survival prediction models in pan-cancer settings.

Degree

thesis:*
Name thesis:degree_name
Imaging Science (MS)
Level thesis:degree_level
Thesis
Discipline thesis:degree_discipline
Chester F. Carlson Center for Imaging Science

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Flack, Dominic
Contributors dc:contributor
  • Dimah Dera

Subjects

dc:subject × 5

Identifiers

dc:identifier.*
Repository record dc:identifier
https://repository.rit.edu/theses/12141

Chain of custody

source
Harvested from
Rochester Institute of Technology
Base URL
repository.rit.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Flack, Dominic. Robust Multimodal Fusion for Oncology. Thesis thesis, https://repository.rit.edu/theses/12141