Georgia Institute of Technology
Beyond Evasion: Accounting for User Perspectives in Anti-Facial Recognition Design
Abstract
dc:description.abstractAdvancements in computer vision have enabled effortless and ubiquitous surveillance through facial recognition, posing challenges for online users trying to maintain anonymity as their faces index their activities across social networks. Despite technically effective anti-facial recognition obfuscation methods, their low adoption rates can be attributed to insufficient attention to human factors in design. My dissertation addresses this gap with a mixed-methods approach that prioritizes user perspectives. In my first study, I design a novel obfuscation method that empowers users to avoid data collection by centralized OSN platforms. This PoC, evaluated with 19 marginalized users, reveals that acceptable obfuscations must support users' public presentation, even to those they are obfuscating against. In my second study, I recruit 15 users to qualitatively assess user-facing Adversarial Machine Learning obfuscations which disrupt facial recognition while optimizing for imperceptibility.I find that these systems often produce undesirable outputs when visible or are distrusted due to a lack of perceptual assurances. I synthesize these qualitative findings into a brief, validated psychometric scale -- the SAIA-8 — to ease integrating user perspectives into obfuscation evaluation. Building on the insights I gained from the prior two studies to develop AML-based obfuscations that might better align with a user's preferred presentation. I implement a set of 80 unique obfuscations that emulate an existing aesthetic image filter. These novel obfuscations maintain adversarial effectiveness against facial recognition and outperform prior work on the SAIA-8 across 630 participants. Finally, I present AuraMask, an extensible development pipeline, for rapid prototyping and evaluation of anti-facial recognition obfuscation design to accelerate future research in this space.
Degree
thesis:*- Level thesis:degree_level
- Doctoral
- Department dc:contributor.department
- Interactive Computing
- Grantor dc:publisher
- Georgia Institute of Technology
- Year dc:date.issued
- 2025
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Logas, Jacob
- Advisors dc:contributor.advisor
-
- Das, Sauvik
- Arriaga, Rosa I.
- Committee members dc:contributor.committeemember
-
- Anton, Annie
- Chau, Polo
- Starner, Thad
- Caine, Kelly
Subjects
dc:subject × 6Rights
- Language dc:language.iso
- en_US
Identifiers
dc:identifier.*- Handle dc:identifier.uri
- https://hdl.handle.net/1853/81540