Back to search

University of British Columbia

Exploring heterogeneity and resource constraints in federated learning

Abstract

dc:description

One key factor in training deep learning models is having abundant training data. This often requires collecting data from multiple sources (clients), which may violate data protection regulations. Federated learning (FL) provides a training paradigm where clients collaboratively train a global model while keeping data decentralized. Despite its potential, current FL frameworks rely on restrictive assumptions, limiting their performance and applicability in real-world scenarios. In practice, client data originate from different distributions (i.e., data heterogeneity), and local models are optimized for their respective data, leading to poor performance and slow convergence. To address data heterogeneity, we first adopt a domain-invariant feature learning perspective to capture task-relevant features, and propose a generalized FL framework. We extend this framework to a label-scarce setting where only a few samples are labeled for each client, thereby reducing annotation burden. We then tackle a more challenging scenario involving both labeled and unlabeled clients, indicating that data distributions differ across the two groups. To facilitate effective knowledge transfer, we introduce a generalized FL framework that combines pseudo-labeling with a dual-selection strategy which selects pseudo-labeled samples and model components for updating. Next, we reformulate the global objective to produce personalized models for each client, addressing data heterogeneity from a new perspective. We propose a Bayesian-enhanced personalized FL framework which incorporates Bayesian learning into FL to mitigate overfitting, and designs high-quality personalized priors for each client to guide local training. We then continue our investigation of personalized FL, focusing on an underexplored yet critical form of data heterogeneity: concept drift across clients. We also explore the potential of multimodal data. To improve model performance, we propose a multimodal-enhanced personalized FL framework with personalized modules to capture individual understanding of each input and effective fusion strategies to integrate features from diverse modalities. We finally explore the feasibility of allowing clients to customize their model structures and propose a heterogeneous FL framework that tackles dual heterogeneity. In this framework, a designed 'bridge' enables collaboration between clients by representing local knowledge as logits on the bridge and a similarity-based knowledge distillation strategy supports effective cross-client knowledge absorption.

Degree

thesis:*
Name thesis:degree_name
Doctor of Philosophy - PhD
Level thesis:degree_level
doctoral
Discipline thesis:degree_discipline
Electrical and Computer Engineering
Grantor dc:publisher
University of British Columbia
Year dc:date
2025

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Yu, Xinhui
Contributors dc:contributor
  • Wang, Z. Jane
  • McKeown, Martin J.

Rights

dc:rights
Statement dc:rights
  • Attribution-NonCommercial-NoDerivatives 4.0 International
Language dc:language
eng

Identifiers

dc:identifier.*
Handle dc:identifier
http://hdl.handle.net/2429/93322

Chain of custody

source
Harvested from
University of British Columbia
Base URL
circle.library.ubc.ca/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Yu, Xinhui. Exploring heterogeneity and resource constraints in federated learning. doctoral thesis, University of British Columbia, 2025. http://hdl.handle.net/2429/93322