Clemson University
Statistical Methodologies for Sequential Online Controlled Experiments
Abstract
dc:description.abstractOnline controlled experiments, primarily used on digital platforms like websites or apps, involve varying certain variables while keeping others constant to determine their effects on specific outcomes. This method allows researchers to compare results with a control group, gaining reliable insights. These experiments have grown popular among companies for assessing product impacts and guiding decision-making. This dissertation presents a group Sequential Probability Ratio Testing (group SPRT) algorithm optimized for online experiments to balance sample number and accuracy by minimizing expected costs. It contrasts group SPRT with traditional SPRT under normal distributions, revealing differences in test power, sample size, and cost efficiency, thus guiding experimental design optimization. In addition, the work delves into the model for network sampling design in A/B testing, which involves selecting a sample from a network to assign users to different versions of a product or feature. The responses of these users are then analyzed to evaluate the impact of variations in the experimental design, building under the conditional auto-regressive model to manage large-scale data effectively. The efficacy of this approach is validated through simulations on both synthetic and real-world networks, testing its robustness in practical applications.
Degree
thesis:*- Name thesis:degree_name
- Doctor of Philosophy (PhD)
- Level thesis:degree_level
- Dissertation
- Discipline thesis:degree_discipline
- Mathematical Sciences
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Li, Yangyi
- Contributors dc:contributor
-
- Qiong Zhang
- Xiaoqian Sun
- Christopher McMahan
- Colin Gallagher
Subjects
dc:subject × 4Identifiers
dc:identifier.*- Repository record dc:identifier
- https://open.clemson.edu/all_dissertations/3570