A stochastic extension of Ramsey's theorem is established. Any Markov chain generates a filtration relative to which one may define a notion of stopping time. A stochastic colouring is any k-valued colour function defined on all pairs consisting of a bounded stopping time and a finite partial history of the chain truncated before this stopping time. For any bounded stopping time and any infinite history of the Markov chain, let denote the finite partial history up to time . It is first proved for k = 2 that for every 0 there is an increasing sequence 1 2 of bounded stopping times having the property that, with probability greater than 1, the history is such that the values assigned to all pairs , with j, are the same. Just as with the classical Ramsey theorem, an analogous finitary stochastic Ramsey theorem is obtained. Furthermore, with appropriate finiteness assumptions, the time one must wait for the last stopping time (in the finitary case) is uniformly bounded, independently of the probability transitions. The results are generalised to any finite number k of colours. A stochastic extension is derived for hypergraphs, but with rather weaker conclusions. The stochastic Ramsey theorem can be applied to the expected utility of a Markov chain to conclude that on some infinite increasing sequence of bounded stopping times the expected utility remains the same to within (also in probability).
| Identifer | oai:union.ndltd.org:bl.uk/oai:ethos.bl.uk:645915 |
| Date | January 2010 |
| Creators | Xu, Zibo |
| Publisher | London School of Economics and Political Science (University of London) |
| Source Sets | Ethos UK |
| Detected Language | English |
| Type | Electronic Thesis or Dissertation |
| Source | http://etheses.lse.ac.uk/2211/ |
Page generated in 0.0016 seconds