Georgia Institute of Technology
The Algorithm Keeps The Score: Identity, Marginalization, and Power in the Technology-Mediated Search for Care
Abstract
dc:description.abstractSevere psychological distress and mental illness are widespread. Globally, one in every two people will experience a mental health disorder at some point over the course of their lifetime. Identity has long played a core role in how each of those individuals understands their distress, expresses it to others, and searches for care. Directly tied to identity, societal marginalization and power similarly play a core role in whether individuals in distress can successfully access the resources and care that could deliver them relief. Alongside identity, power, and marginalization, technologies increasingly play a role in how people engage with care --- people in distress may turn to mental health helplines, online support communities, large language model chatbots, and other accessible technologies as they make meaning from their distress and search for care. In turn, the design of those technologies also have an influence on people's illness experiences, just as identity, power, and marginalization do. I understand these support technologies to be technology-mediated mental health support (TMMHS) systems, in which technology mediates support provided to people in distress. This dissertation engages in the study of how identity, power, and marginalization intersect with the design of TMMHS systems to influence people's experiences of distress, as well as their subsequent engagements with care. Marginalized populations often have diverse and unmet mental health needs---I thus investigate how the design of TMMHS systems may be helpful in validating and meeting these marginalized needs, as well as how the design of TMMHS systems may further compound offline inequities, and make it more difficult for people to access acceptable and effective care. Through use of both quantitative and qualitative methods, I highlight the limitations associated with the psychiatric and computational approach that often decontextualizes and quantifies experiences of distress. I propose that one means to mitigate these limitations is to incorporate considerations of identity, power, and marginalization in the design of TMMHS systems, and argue that doing so could ensure that diverse people are able to to leverage technology for their mental health needs. I describe what these considerations may look like, including a focus on designing technologies that strengthen support relationships, an awareness of differences across people of diverse identities, and a constant eye to patterns of historical marginalization. My dissertation begins by first outlining the history of mental health support in both traditional and technology-mediated contexts, and discusses the role of colonial power relations in how both identity and mental illness have been understood, including for my areas of study in the United States and India. This provides important context for my empirical investigation of people's experiences with TMMHS systems. I then examine four areas in which identity, marginalization, and power have a direct and salient impact on how people engage with diverse TMMHS systems. First, I investigate use of Indian mental health helplines, analyzing how volunteers provide care to individuals in distress, and where (and for whom) technical and structural gaps together prevent that care from actually being accessed by callers in distress. I next shift to resource constrained areas of the United States, investigating how individuals in mental health professional shortage areas use TMMHS systems to fill structural gaps and create new identities from their experiences of distress, and the role of technical design and marginalization in what I find to often be deeply polarized environments within TMMHS systems. Building on this finding, I then examine a dimension of social identity that is particularly polarized in the U.S. today, or partisan identity. I quantitatively examine differentiated engagements among partisan users of online support communities, and investigate where there may be differences in potential avenues to care through analyzing personalized search engine results for U.S. Republican and Democrat partisan groups. I end by investigating identity-based biases within a new and emergent form of TMMHS support, or LLM-based chatbots, including a quantitative analysis of biases and qualitative analysis of lived experiences with this new tool. Across all, I use the language people use around their distress as a tool to analyze how identity, power, and marginalization interact with technical (and algorithm) design to influence people's lived experiences with their mental health. My research contributes a deeper understanding of the harms that are created when technology-mediated support is not considerate of histories of marginalization, and where support technologies can be sensitive to identity-based marginalization. In summary, with this dissertation, I ask the question --- what do we gain and lose when technology (and the algorithms that underlie it) keep the score around our experiences with mental health?
Degree
thesis:*- Level thesis:degree_level
- Doctoral
- Department dc:contributor.department
- Interactive Computing
- Grantor dc:publisher
- Georgia Institute of Technology
- Year dc:date.issued
- 2024
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Pendse, Sachin R.
- Advisors dc:contributor.advisor
-
- De Choudhury, Munmun
- Kumar, Neha
- Committee members dc:contributor.committeemember
-
- Grimes Parker, Andrea
- Best, Michael
- Schleider, Jessica
- Sharma, Amit
Subjects
dc:subject × 8Rights
- Language dc:language.iso
- en_US
Identifiers
dc:identifier.*- Handle dc:identifier.uri
- https://hdl.handle.net/1853/75681