Back to search

University of Leeds

Visual bias mitigation driven by Bayesian uncertainties

Abstract

dc:description.abstract

Today, intelligent models are used in applications across all of society, from recidivism prediction, identity verification, a vast collection of healthcare tasks from polyp segmentation to cancer grading, and information retrieval, among many more. The vast majority of these intelligent models are variants of deep neural networks trained on large real-world datasets. These datasets reflect our historical and societal biases; in turn, AI learns these correlations during training resulting in predictors and decision-makers exhibiting racism, ableism, sexism and other forms of prejudice. Visual data contains many potential biases given its richness of features, and the research related to developing fair vision models is a challenging, open problem. In particular, the sub-problem of implicit mitigation – or mitigation when the knowledge of bias sources in the training or testing data is unknown – is relevant to many use cases where metadata for datasets is difficult to collect. This work contributes to this domain of research by leveraging the observation that bias-conflicting samples, or input samples which are not aligned with the majority correlations, tend to have higher uncertainties in the Bayesian paradigm. By using Bayesian deep neural networks, we can both maintain the performance capabilities of a deterministic network, while gaining access to principled uncertainty estimates. Model uncertainties or epistemic uncertainties in particular provide direct insight into the training data distribution and bias landscape, as bias-conflicting samples are under-represented. We explore two novel strategies driven by the uncertainties of a Bayesian neural network. The first dynamically re-weights samples as a function of their predictive uncertainty estimates during training, encouraging the model to focus on the more difficult bias-conflicting samples. The second approach fine-tunes the posterior estimate of a converged Bayesian neural network, using the uncertainties to adjust the estimates in favour of fairer predictions. The potential of these methods for implicit visual bias mitigation is demonstrated on benchmark classification tasks and then extended to a medical image segmentation problem with known generalisability issues. Our research, while far from a solution to the bias problem, shows potential for improving model fairness and generalisability and contributes to the literature in this challenging domain.

Degree

thesis:*
Name dc:type.qualificationname
Ph.D
Level dc:type.qualificationlevel
doctoral
Grantor dc:publisher.institution
University of Leeds
Year dc:date.issued
2024

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Stone, Rebecca Shio-Ming
Advisors dc:contributor.advisor
  • Bulpitt, Andrew
  • Hogg, David
ORCID person:identifier.orcid

Rights

Language dc:language.dcterms_iso639_2
eng

Chain of custody

source
Harvested from
White Rose University Consortium
Base URL
etheses.whiterose.ac.uk/cgi/oai2
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
related terms
citation

Stone, Rebecca Shio-Ming. Visual bias mitigation driven by Bayesian uncertainties. doctoral thesis, University of Leeds, 2024.