Back to search

University of Southampton

Topics in design of computer experiments

Abstract

dc:description.abstract

Computer models are used in many fields to simulate real-world processes. One of the goals is to optimise the value of the computer model. Due to the fact that the computer model is usually expensive to evaluate, one can only make a limited number of evaluations of this computer model. Using Gaussian processes in sequential design through the use of acquisition functions is a common approach for sample-efficient optimisation in such cases. Despite many recent successes, there are still a number of outstanding problems in that field. In this work, we address some of these problems. <br/><br/>We first give a brief overview of Bayesian optimisation and the common techniques used. After that, we focus on scenarios where one is interested in finding both the minimum and the maximum of the computer model simultaneously. We use the entropy of the location of the optima to define a sequential design algorithm. The design is then created in a way that would minimise the entropy. Monte Carlo methods are used to approximate a number of probability distributions. The resulting algorithm is then compared against a baseline algorithm to demonstrate its superior performance. <br/><br/>In the second part of this paper, we are interested in optimising high-dimensional computer models. This is a complicated task and comes with a number of additional challenges compared to the standard problems. Our focus is on computer models whose accuracy we can control by changing the amount of computational resources allocated to them. This is also often referred to as multi-fidelity optimisation. We then use a number of techniques from mathematical optimisation to define a multi-fidelity optimisation algorithm that can be used in high-dimensional settings and scaled to large number of evaluations. Its performance is then compared to that of another state-of-the-art optimisation algorithm. <br/><br/>In the final part of this paper, we explore computer models that are non-stationary. These are computer models whose properties change depending on which part of the design space it is evaluated. For example, a computer model that changes rapidly in one area and is completely flat in a different area is non-stationary. Such computer models can accurately be modelled with a non-stationary Gaussian process. However, fitting non-stationary Gaussian processes can be computationally very expensive and a large number of computer model evaluations is often needed to model the process accurately. This makes sequential design difficult. We create a novel acquisition function that allows us to create accurate sequential designs by using regular stationary Gaussian processes that are far easier to fit. Our acquisition function puts more emphasis on more interesting regions and less emphasis on less interesting regions. We then create sequential designs created by our novel acquisition function combined with stationary Gaussian processes and compare it with designs found by non-stationary Gaussian processes.

Degree

thesis:*
Name dc:type.qualificationname
Ph.D.
Level dc:type.qualificationlevel
doctoral
Grantor dc:publisher.institution
University of Southampton
Year dc:date.issued
2025

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Merila, Hendriico
Advisors dc:contributor.advisor
  • Overstall, Antony
  • Woods, Dave

Rights

Language dc:language
English, eng

Chain of custody

source
Harvested from
University of Southampton
Base URL
eprints.soton.ac.uk/cgi/oai2
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Merila, Hendriico. Topics in design of computer experiments. doctoral thesis, University of Southampton, 2025.