Back to search

University of British Columbia

Overcoming catastrophic forgetting in heterogeneous federated learning

Abstract

dc:description

Federated learning (FL) has gained prominence in the medical domain for enabling collaborative machine learning across decentralized datasets while preserving patient privacy. However, key challenges such as catastrophic forgetting and local overfitting hinder the effectiveness of FL models in heterogeneous healthcare environments. This thesis addresses these challenges through two complementary studies. The first study introduces Federated Impressions, a synthetic data generation method that extracts the knowledge of the global model without compromising privacy. By training the local model on these impressions, the method mitigates catastrophic forgetting, allowing the model to retain critical knowledge while generalizing effectively across diverse datasets. This approach ensures robustness and adaptability to evolving medical data distributions. The second study enhances FL for medical imaging by leveraging Vision Transformers (ViTs) in a DualPrompt architecture. Prompts are divided into shared and group prompts: shared prompts capture generalized medical features and are trained exclusively on Federated Impressions alongside local data to prevent overfitting, while group prompts adapt to specific client tasks using local data. This method effectively mitigates catastrophic forgetting, preserving personalization through group prompts while maintaining global generalization via shared prompts. It strikes a balance between retaining global medical knowledge and adapting to localized data distributions. Experimental evaluations on benchmark medical datasets demonstrate that the proposed approaches improve global generalization by avoiding local overfitting. These advancements make FL more robust and effective in heterogeneous medical environments, addressing critical challenges in privacy, scalability, and catastrophic forgetting. This thesis lays the groundwork for scalable and adaptive FL frameworks tailored to medical applications, fostering innovation in privacy-preserving healthcare AI.

Degree

thesis:*
Name thesis:degree_name
Master of Applied Science - MASc
Level thesis:degree_level
master's
Discipline thesis:degree_discipline
Electrical and Computer Engineering
Grantor dc:publisher
University of British Columbia
Year dc:date
2024

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Arya, Atrin
Contributors dc:contributor
  • Abolmaesumi, Purang
  • Li, Xiaoxiao

Rights

dc:rights
Statement dc:rights
  • Attribution-NonCommercial-NoDerivatives 4.0 International
Language dc:language
eng

Identifiers

dc:identifier.*
Handle dc:identifier
http://hdl.handle.net/2429/90056

Chain of custody

source
Harvested from
University of British Columbia
Base URL
circle.library.ubc.ca/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Arya, Atrin. Overcoming catastrophic forgetting in heterogeneous federated learning. master's thesis, University of British Columbia, 2024. http://hdl.handle.net/2429/90056