Back to search

Cornell University

ESTIMATION AND INFERENCE OF HIGH-DIMENSIONAL INDIVIDUALIZED THRESHOLD WITH BINARY RESPONSES

Abstract

dc:description.abstract

High-dimensional data is ubiquitous nowadays in many areas. Over the last twenty to thirty years, studying the approaches for analyzing high-dimensional data, including parameter estimation and uncertainty quantification (hypothesis test, confidence interval, etc), has attracted tremendous attention and been extensively developed. This work proposes the methodology, theory and computation algorithm for estimation and inference under a high-dimensional binary response setting. In this setting, an individualized linear threshold \bbetaT\bZ, with $\bbeta$ being a high-dimensional parameter of interest, minimizes the disagreement between \sign{X-\bbetaT\bZ} and a binary response $Y$, where $X$ is a continuous variable and $\bZ$ is a high-dimensional vector. While many popular models fit into this general framework, it is not well studied in the high-dimensional setting. This work consists of two main parts. The first part discusses a general framework for estimating the unknown parameter $\bbeta$. While the problem can be formulated into the M-estimation framework, minimizing the corresponding empirical risk function is computationally intractable due to discontinuity of the sign function. Moreover, estimating $\bbeta$ even in the fixed-dimensional setting is known as a nonregular problem leading to nonstandard asymptotic theory. To tackle the computational and theoretical challenges in the estimation of the high-dimensional parameter $\bbeta$, we propose an empirical risk minimization approach based on a regularized smoothed non-convex loss function. The Fisher consistency of the proposed method is guaranteed as the bandwidth of the smoothed loss is shrunk to 0. %The statistical and computational trade-off is investigated. Statistically, we show that the finite sample error bound for estimating $\bbeta$ in \ell2 norm is (s\log d/n)\ell/(2\ell+1), where $d$ is the dimension of $\bbeta$, $s$ is the sparsity level, $n$ is the sample size and $\ell$ is the smoothness of the conditional density of $X$ given the response $Y$ and the covariates $\bZ$. The convergence rate is nonstandard and slower than that in the classical Lasso problems. Furthermore, we prove that the resulting estimator is minimax rate optimal up to a logarithmic factor. The Lepski's method is developed to achieve the adaption to both the unknown sparsity $s$ and smoothness β. Computationally, an efficient path-following algorithm is proposed to compute the solution path. We show that this algorithm achieves geometric rate of convergence for computing the whole path. The second part of this work proposes a general procedure for conducting statistical tests for the low-dimensional components of the high-dimensional parameter $\bbeta$. Based on the smoothed non-convex loss function, a smoothed decorrelated score test statistic is proposed. Different from many classical settings where the test statistic is scaled by a n1/2 factor, the proposed test statistic is scaled by (nδ)1/2, where δ\rightarrow0 is the bandwidth parameter. In addition, there is an extra approximation bias term to be eliminated for valid inference. The proposed test statistic based on the debiased smoothed decorrelated score function is shown to be asymptotic normal and the power of the test is studied under local alternatives. Moreover, as the bandwidth δ is a crucial quantity that affects the finite sample performance of the test statistic, we discuss how this parameter can be selected in a data-driven manner.

Degree

thesis:*
Name thesis:degree_name
Ph. D., Statistics
Level thesis:degree_level
Doctor of Philosophy
Discipline thesis:degree_discipline
Statistics
Grantor
Cornell University
Year dc:date.issued
2021

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Feng, Huijie
Chair dc:contributor.chair
  • Ning, Yang
Committee members dc:contributor.committeemember
  • Chen, Yudong
  • Hooker, Giles J.

Subjects

dc:subject × 4

Rights

dc:rights
Statement dc:rights
  • Attribution 4.0 International
Language dc:language.iso
en

Identifiers

dc:identifier.*
Dc Identifier Bibid
15049552
Dc Identifier Other
ProQuest Submission ID: 12516
ProQuest Publication ID: 28493505

Chain of custody

source
Harvested from
Cornell University
Base URL
ecommons.cornell.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Feng, Huijie. ESTIMATION AND INFERENCE OF HIGH-DIMENSIONAL INDIVIDUALIZED THRESHOLD WITH BINARY RESPONSES. Doctor of Philosophy thesis, Cornell University, 2021. https://hdl.handle.net/1813/109738