We present a general framework for accelerating a large class of widely used Markov chain Monte Carlo (MCMC) algorithms. This dissertation demonstrates that MCMC inference can be accelerated in a model of parallel computation that uses speculation to predict and complete computational work ahead of when it is known to be useful. By exploiting fast, iterative approximations to the target density, we can speculatively evaluate many potential future steps of the chain in parallel. In Bayesian inference problems, this approach can accelerate sampling from the target distribution, without compromising exactness, by exploiting subsets of data. It takes advantage of whatever parallel resources are available, but produces results exactly equivalent to standard serial execution. In the initial burn-in phase of chain evaluation, it achieves speedup over serial evaluation that is close to linear in the number of available cores. / Engineering and Applied Sciences
Identifer | oai:union.ndltd.org:harvard.edu/oai:dash.harvard.edu:1/13070022 |
Date | 21 October 2014 |
Creators | Angelino, Elaine Lee |
Contributors | Seltzer, Margo I., Adams, Ryan Prescott |
Publisher | Harvard University |
Source Sets | Harvard University |
Language | en_US |
Detected Language | English |
Type | Thesis or Dissertation |
Rights | open |
Page generated in 0.0119 seconds