Hostname: page-component-586b7cd67f-rcrh6 Total loading time: 0 Render date: 2024-11-30T23:57:49.149Z Has data issue: false hasContentIssue false
  • English
  • Français

On the identification of continuous-time Markov chains with a given invariant measure

Part of: Markov processes

Published online by Cambridge University Press:  14 July 2016

P. K. Pollett
P. K. Pollett*
Affiliation:
The University of Queensland
*
∗Postal address: Department of Mathematics, The University of Queensland, QLD 4072, Australia. e-mail: [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

In [14] a necessary and sufficient condition was obtained for there to exist uniquely a Q-process with a specified invariant measure, under the assumption that Q is a stable, conservative, single-exit matrix. The purpose of this note is to demonstrate that, for an arbitrary stable and conservative q-matrix, the same condition suffices for the existence of a suitable Q-process, but that this process might not be unique. A range of examples is considered, including pure-birth processes, a birth process with catastrophes, birth-death processes and the Markov branching process with immigration.

Keywords

Q-PROCESSESSTATIONARY DISTRIBUTIONS

MSC classification

Primary: 60J27: Continuous-time Markov processes on discrete state spaces
Secondary: 60J35: Transition functions, generators and resolvents 60J80: Branching processes (Galton-Watson, birth-and-death, etc.)
Type
Research Article
Information
Journal of Applied Probability , Volume 31 , Issue 4 , December 1994 , pp. 897 - 910
Copyright
Copyright © Applied Probability Trust 1994 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

This work was funded under an Australian Research Council Grant and a University of Queensland Special Project Grant.

References

[1] Anderson, W. J. (1991) Continuous-Time Markov Chains: An Applications Oriented Approach. Springer-Verlag, New York.CrossRefGoogle Scholar
[2] Doob, J. L. (1945) Markov chains-denumerable case. Trans. Amer. Math. Soc. 58, 455–473.Google Scholar
[3] Feller, W. (1957) On boundaries and lateral conditions for the Kolmogoroff differential equations, Ann. Math. 65, 527–570.Google Scholar
[4] Chen-Ting, Hou and Mufa, Chen (1980) Markov processes and field theory. Kexue Tongbao 25, 807–811.Google Scholar
[5] Kelly, F. P. (1983) Invariant measures and the q-matrix. In Probability, Statistics and Analysis , ed. Kingman, J. F. C. and Reuter, G. E. H., London Mathematical Society Lecture Notes Series 79, pp. 143–160. Cambridge University Press.Google Scholar
[6] Kendall, D. G. (1956) Some further pathological examples in the theory of denumerable Markov processes. Quart. J. Math. Oxford 7, 39–56.CrossRefGoogle Scholar
[7] Kendall, D. G. (1959) Unitary dilations of one-parameter semigroups of Markov transition operators, and the corresponding integral representations for Markov processes with a countable infinity of states. Proc. Lond. Math. Soc. 13, 417–431.Google Scholar
[8] Nair, M. G. and Pollett, P. K. (1993) On the relationship between µ-invariant measures and quasi-stationary distributions for continuous-time Markov chains. Adv. Appl. Prob. 25, 82–102.Google Scholar
[9] Pakes, A. G. (1993) Absorbing Markov and branching processes with instantaneous resurrection. Stoch. Proc. Appl. 48, 85–106.Google Scholar
[10] Pakes, A. G. (1993) Explosive Markov branching processes: entrance laws and limiting behaviour. Adv. Appl. Prob. 25, 737–756.Google Scholar
[11] Pakes, A. G. (1995) Quasi-stationary laws for Markov processes: examples of an always proximate absorbing state. Adv. Appl. Prob. 27(1).Google Scholar
[12] Pollett, P. K. (1990) A note on the classification of Q-processes when Q is not regular. J. Appl. Prob. 27, 278–290.Google Scholar
[13] Pollett, P. K. (1991) On the construction problem for single-exit Markov chains. Bull. Austral. Math. Soc. 43, 439–450.Google Scholar
[14] Pollett, P. K. (1991) Invariant measures for Q-processes when Q is not regular. Adv. Appl. Prob. 23, 277–292.Google Scholar
[15] Reuter, G. E. H. (1957) Denumerable Markov processes and the associated contraction semigroups on l . Acta Math. 97, 1–46.Google Scholar
[16] Reuter, G. E. H. (1959) Denumerable Markov processes (II). J. Lond. Math. Soc. 34, 81–91.Google Scholar
[17] Reuter, G. E. H. (1967) Note on resolvents of denumerable submarkovian processes. Z. Wahrscheinlichkeitsth. 9, 16–19.Google Scholar