Article contents
Conditions Under Which a Markov Chain Converges to its Steady State in Finite Time
Published online by Cambridge University Press: 27 July 2009
Abstract
Analysis of the initial transient problem of Monte Carlo steady-state simulation motivates the following question for Markov chains: when does there exist a deterministic Tsuch that P{X(T) = y|(0) = x} = ®(y), where ρ is the stationary distribution of X? We show that this can essentially never happen for a continuous-time Markov chain; in discrete time, such processes are i.i.d. provided the transition matrix is diagonalizable.
- Type
- Articles
- Information
- Probability in the Engineering and Informational Sciences , Volume 2 , Issue 3 , July 1988 , pp. 377 - 382
- Copyright
- Copyright © Cambridge University Press 1988
References
- 8
- Cited by