Back to search

Cornell University

Contributions to Fairness and Transparency

Abstract

dc:description.abstract

This dissertation presents three varied topics. The first topic concerns text mining. GloVe and Skip-gram word embedding methods learn word vectors by decomposing a denoised matrix of word co-occurrences into a low-rank matrix. In this work, we propose an iterative algorithm for computing word vectors based on modeling word co-occurrence matrices with Symmetric Generalized Low Rank Models. Our algorithm generalizes both Skip-gram and GloVe as well as giving rise to other embedding methods based on the specified co-occurrence matrix, distribution of co-occurences, and the number of iterations in the iterative algorithm. For example, using a Tweedie distribution with one iteration results in GloVe and using a Multinomial distribution with full-convergence mode results in Skip-gram. The second topic concerns algorithmic fairness. A substantial portion of the literature on fairness in algorithms proposes, analyzes, and operationalizes simple formulaic criteria for assessing fairness. Two of these criteria, Equalized Odds and Calibration by Group, have gained significant attention for their simplicity and intuitive appeal, but also for their incompatibility. This chapter provides a perspective on the meaning and consequences of these and other fairness criteria using graphical models which reveals Equalized Odds and related criteria to be ultimately misleading. An assessment of various graphical models suggests that fairness criteria should ultimately be case-specific and sensitive to the nature of the information the algorithm processes. The third topic concerns the fragility index. In recent years there has been a renewed conversation concerning interpretable and proper techniques for statistical hypothesis testing. In the medical literature on clinical trials, the count of patients who must have a different outcome to reverse statistical significance in a 2 by 2 contingency table (the fragility index) has been proposed as a more interpretable supplement to classical p value based testing. We studied the sampling distribution of the fragility index and created a sample size calculation strategy which simultaneously designs for p values and fragility indices. Then, we extended the fragility index to only incorporate sufficiently likely outcome modifications. Next, we redefined what it means for an outcome modification to be sufficiently likely and studied a variant of the fragility index tailored for patients who are lost to follow up. Finally, we generalized the fragility index to any data type and any statistical test.

Degree

thesis:*
Name thesis:degree_name
Ph. D., Statistics
Level thesis:degree_level
Doctor of Philosophy
Discipline thesis:degree_discipline
Statistics
Grantor
Cornell University
Year dc:date.issued
2021

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Baer, Benjamin R.
Chair dc:contributor.chair
  • Wells, Martin Timothy
Committee members dc:contributor.committeemember
  • Basu, Sumanta
  • Booth, James

Subjects

dc:subject × 6

Rights

dc:rights
Statement dc:rights
  • Attribution 4.0 International
Language dc:language.iso
en

Identifiers

dc:identifier.*
Dc Identifier Bibid
15160084
Dc Identifier Other
ProQuest Submission ID: 12623
ProQuest Publication ID: 28648222

Chain of custody

source
Harvested from
Cornell University
Base URL
ecommons.cornell.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Baer, Benjamin R.. Contributions to Fairness and Transparency. Doctor of Philosophy thesis, Cornell University, 2021. https://hdl.handle.net/1813/110502