Hostname: page-component-cd9895bd7-8ctnn Total loading time: 0 Render date: 2024-12-28T02:21:34.221Z Has data issue: false hasContentIssue false
  • English
  • Français

SERIES EXPANSIONS FOR FINITE-STATE MARKOV CHAINS

Published online by Cambridge University Press:  08 August 2007

Bernd Heidergott ,
Arie Hordijk  and
Miranda van Uitert
Bernd Heidergott
Affiliation:
Department of Econometrics Vrije Universiteit Amsterdam 1081 HV Amsterdam, The Netherlands E-mail: [email protected]
Arie Hordijk
Affiliation:
Mathematical Institute Leiden University 2300 RA Leiden, The Netherlands E-mail: [email protected]
Miranda van Uitert
Affiliation:
Department of Econometrics Vrije Universiteit Amsterdam 1081 HV Amsterdam, The Netherlands E-mail: [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

This article provides series expansions of the stationary distribution of a finite Markov chain. This leads to an efficient numerical algorithm for computing the stationary distribution of a finite Markov chain. Numerical examples are given to illustrate the performance of the algorithm.

Type
Research Article
Information
Probability in the Engineering and Informational Sciences , Volume 21 , Issue 3 , July 2007 , pp. 381 - 400
Copyright
2007 Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)