Back to search

University of Nevada - Reno

Variable Selection in Linear Models with Grouped Variables

Abstract

dc:description.abstract

Linear mixed models have been widely used for repeated measurements, longitudinal studies, or multilevel data. The selection of random effects in linear mixed models has received much attention recently in the literature. Random effects consider dependent structure between repeatedly measured data. Due to computational challenges, the selection of grouped random effects has yet to be studied. Grouped random effects, including genetics data or categorical variables, are commonly seen in practice. We present an efficient method for selecting random effects at group levels in linear mixed models. Specifically, the proposed method employs a restricted maximum likelihood function to estimate the covariance matrix of random effects. To achieve sparse estimation and grouped random effects selection, we then introduce a new shrinkage penalty term. In addition, we extend the idea of grouped variable selection onto the latent regression model. By incorporating regression onto latent traits, latent regression models provide a way to uncover hidden influential factors from the data and make more accurate predictions. Specifically, we develop a variable selection approach for latent regression item response theory models by introducing the group LASSO penalty into the marginal log-likelihood function of observed test responses. We derive the explicit forms of updating steps for model parameters in a modified Newton-Raphson method. Our approach selects significant covariates and estimates model parameters simultaneously. For both variable selection frameworks, we perform simulation studies to evaluate the variable selection performance of the proposed methods. We then compare them to existing or naive selection methods. Additionally, we apply the proposed methods on real data sets.

Degree

thesis:*
Level thesis:degree_level
Doctorate Degree
Department thesis:degree_department
Mathematics
Year dc:date.issued
2023

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Yang, Jingxuan
Advisors dc:contributor.advisor
  • Ahn, Mihye MA
  • Chen, Yinghan YC
Committee members dc:contributor.committeemember
  • Schmidt, Deena DS
  • Liu, Yan YL
  • Lamberg, Teruni TL

Subjects

dc:subject × 5

Identifiers

dc:identifier.*
Handle dc:identifier.uri
http://hdl.handle.net/11714/10558

Chain of custody

source
Harvested from
University of Nevada - Reno
Base URL
scholarwolf.unr.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Yang, Jingxuan. Variable Selection in Linear Models with Grouped Variables. Doctorate Degree thesis, 2023. http://hdl.handle.net/11714/10558