Back to search

Georgia Institute of Technology

Group Robustness under the Microscope: How Class Imbalance Shapes the Effectiveness of Last-Layer Retraining

Abstract

dc:description.abstract

Machine learning models trained with empirical risk minimization (ERM) often rely on spurious correlations, leading to severe performance degradation on underrepresented subpopulations. This thesis provides a comprehensive examination of group robustness in fine-tuned neural networks, focusing on how class imbalance and data composition shape the effectiveness of last-layer retraining (LLR) and related balancing techniques. Through extensive experiments on four benchmark datasets spanning vision and language domains—Waterbirds, CelebA, CivilComments, and MultiNLI—we uncover several surprising and previously underexplored behaviors in worst-group accuracy (WGA). We first diagnose failure modes in widely used class-balancing strategies. While subsetting, upsampling, and upweighting are intended to improve robustness, we show that upsampling and upweighting frequently cause catastrophic WGA collapse in imbalanced datasets, whereas subsetting may remove structurally important minority-subgroup examples. To address these limitations, we introduce mixture balancing, a hybrid method that combines subsetting with controlled resampling. Mixture balancing consistently improves WGA and mitigates the instability exhibited by prior methods. We further analyze why LLR—despite modifying only the final classification layer—achieves disproportionate gains in robustness. Contrary to hypotheses based on neural collapse or maximum-margin convergence, our results demonstrate that LLR’s effectiveness is primarily driven by improved group balance in the held-out retraining set, even when group labels are unavailable. Finally, we identify a structural phenomenon, spectral imbalance, in which minority-group feature covariances systematically exhibit larger top eigenvalues, revealing deeper geometric causes of group disparity. Together, these findings offer a unified perspective on data balance, model scaling, and representation geometry, and provide practical guidance for designing robust models under spurious correlations.

Degree

thesis:*
Name thesis:degree_name
Electrical and Computer Engineering, MS
Department thesis:degree_department
Electrical and Computer Engineering
Grantor
Georgia Institute of Technology
Year dc:date.issued
2025

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Zhang, Xinchen
Advisor dc:contributor.advisor
  • Muthukumar, Vidya
Committee members dc:contributor.committeemember
  • Romberg, Justin
  • Hoffman, Judy

Rights

Language dc:language.iso
English

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1853/80233

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Zhang, Xinchen. Group Robustness under the Microscope: How Class Imbalance Shapes the Effectiveness of Last-Layer Retraining. Georgia Institute of Technology, 2025. https://hdl.handle.net/1853/80233