Back to search

University of Southampton

Hierarchical experiments and likelihood approximations

Abstract

dc:description.abstract

The objective of this thesis is the development of new methods for exploiting multi- level approximations in statistical modelling and design using hierarchical Gaussian processes.<br/><br/>An important application is in multi-level approximations of intractable likelihood problems, where a hierarchy of likelihood approximations is available, each having different accuracy and cost. For example, in generalised linear mixed models, quadrature methods may be used to approximate the likelihood, and by varying the number of quadrature points used we may trade off accuracy against computational cost. Multi-level Gaussian processes methods have been established and implemented to emulate the highest level of accuracy available, using data from all stages of the hierarchy. Moreover, Gaussian process emulated likelihoods are used to conduct inference about the model parameters and to address uncertainty.<br/><br/>There exists a general design problem for hierarchical Gaussian process: to decide how many times to evaluate each level of approximation, and at which parameter values, in order to find an accurate approximation to the point maximising that function, given a limited computational budget. A decision-theoretic approach, called expected gain in utility, based on Bayesian optimisation has been developed and demonstrated through examples.<br/><br/>This thesis is focused on likelihood approximations and the aim is to compute an accurate approximation to the likelihood and to the maximum likelihood estimate (the maximiser of the high-level likelihood approximation) at minimal cost. The methodology is demonstrated on generalised linear mixed model and Ising model examples throughout the thesis. While this thesis in mainly focused on likelihood approximation, the expected gain in utility methodology for choosing the experimental design could also be used on other applications of multi-level Gaussian processes.

Degree

thesis:*
Name dc:type.qualificationname
Ph.D.
Level dc:type.qualificationlevel
doctoral
Grantor dc:publisher.institution
University of Southampton
Year dc:date.issued
2024

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Nearchou, Theodora
Advisors dc:contributor.advisor
  • Ogden, Helen
  • Woods, Dave
ORCID person:identifier.orcid

Rights

Language dc:language
English, eng

Chain of custody

source
Harvested from
University of Southampton
Base URL
eprints.soton.ac.uk/cgi/oai2
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Nearchou, Theodora. Hierarchical experiments and likelihood approximations. doctoral thesis, University of Southampton, 2024.