Back to search

University of North Texas

Bias Mitigation Strategies for Facial Attribute Classification Leveraging Fine-grained Features and ChatGPT

Abstract

dc:description

Published research highlights the presence of demographic bias in automated facial attribute classification algorithms, particularly impacting women and individuals with darker skin tones. Existing bias mitigation techniques typically require demographic annotations and often obtain a trade-off between fairness and accuracy, i.e., Pareto inefficiency. As a part of this thesis, we proposed novel approaches to fair facial attribute classification by (a) framing it as a fine-grained classification problem. Our approach effectively integrates both low-level local features (like edges and color) and high-level semantic features (like shapes and structures) through cross-layer mutual attention learning, and (b) proposing a novel training framework that integrates ChatGPT’s linguistic features with vision models to improve classification accuracy, fairness and introduce explainability. An exhaustive evaluation on facial attribute annotated datasets demonstrates that our proposed models improve model accuracy by 1.32% to 1.74% and fairness by 67% to 83.6%, over the SOTA bias mitigation techniques.

Degree

thesis:*
Grantor dc:publisher
University of North Texas
Year dc:date
2025

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Manzoor, Ayesha
Contributors dc:contributor
  • Rattani, Ajita
  • Tunc, Cihan
  • Choudhury, Sagnik Ray

Subjects

dc:subject × 5

Rights

dc:rights
Statement dc:rights
  • Public
  • Manzoor, Ayesha
  • Copyright
  • Copyright is held by the author, unless otherwise noted. All rights Reserved.
Language dc:language
English

Identifiers

dc:identifier.*
Identifier
local-cont-no: submission_4367
https://digital.library.unt.edu/ark:/67531/metadc2443382/
ark: ark:/67531/metadc2443382

Chain of custody

source
Harvested from
University of North Texas
Base URL
digital.library.unt.edu/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Manzoor, Ayesha. Bias Mitigation Strategies for Facial Attribute Classification Leveraging Fine-grained Features and ChatGPT. University of North Texas, 2025. https://doi.org/10.12794/metadc2443382