Back to search

University of British Columbia

Spline Gaussian Cluster-Weighted Models

Abstract

dc:description

Cluster-weighted models (CWMs) are a class of finite mixture models that jointly model the distribution of covariates and the conditional distribution of a response variable given those covariates. They are effective in uncovering latent subpopulations where both the marginal covariate structure and the regression relationship vary across clusters. However, standard Gaussian CWMs require specifying a parametric regression form within each cluster, limiting their ability to capture nonlinear relationships commonly observed in practice. To address this limitation, we propose a spline-based extension of the Gaussian CWM that uses B-spline functions to model the within-cluster regression structure. A roughness penalty on the spline coefficients is introduced to control smoothness and prevent overfitting, and this penalization is incorporated into estimation through a fully unsupervised Expectation-Maximization (EM) algorithm. The EM procedure updates spline coefficients via weighted penalized least squares while estimating variance and mixing proportions. In addition, we introduce a mixed-type kernel spline Gaussian CWM that extends the framework to datasets with both continuous and categorical covariates. Although not empirically evaluated here, the model is fully formulated, and an EM-based estimation scheme is provided. We evaluate the spline-based model using simulated and real datasets that capture a range of cluster-specific relationships with varying degrees of overlap and noise. The results indicate that polynomial Gaussian CWMs perform well when the regression structure is globally simple, such as in the Linear Crossover and the real NPreg dataset, where quadratic polynomials recover the generating form effectively. Spline Gaussian CWMs provide greater flexibility in settings with local nonlinearities, such as the Nonlinear Single and Double Crossover datasets, where they align better with the true group-wise regression functions. Penalized spline CWMs show the most stable performance, mitigating overfitting in challenging cases such as the Parallel and Half-Overlapping datasets, and offering improved classification accuracy relative to unpenalized splines. On fluctuating designs,spline-based approaches capture localized variation better than high-degree polynomials, which risk instability at boundaries. Overall, this thesis develops nonparametric extensions of Gaussian CWMs by integrating spline regression, penalization, and kernel-based methods. These extensions broaden the applicability of CWMs to complex data structures and provide a foundation for future work on mixed-type and nonparametric mixture modelling.

Degree

thesis:*
Name thesis:degree_name
Master of Science - MSc
Level thesis:degree_level
master's
Discipline thesis:degree_discipline
Mathematics
Grantor dc:publisher
University of British Columbia
Year dc:date
2025

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Xue, Ling
Contributors dc:contributor
  • Thompson, John R. J.

Rights

dc:rights
Statement dc:rights
  • Attribution-NonCommercial-NoDerivatives 4.0 International
Language dc:language
eng

Identifiers

dc:identifier.*
Handle dc:identifier
http://hdl.handle.net/2429/93180

Chain of custody

source
Harvested from
University of British Columbia
Base URL
circle.library.ubc.ca/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Xue, Ling. Spline Gaussian Cluster-Weighted Models. master's thesis, University of British Columbia, 2025. http://hdl.handle.net/2429/93180