Hostname: page-component-cd9895bd7-gvvz8 Total loading time: 0 Render date: 2024-12-29T06:33:54.283Z Has data issue: false hasContentIssue false

THE DEVIATION MATRIX OF A CONTINUOUS-TIME MARKOV CHAIN

Published online by Cambridge University Press:  22 May 2002

Pauline Coolen-Schrijner
Affiliation:
Department of Mathematical Sciences, University of Durham, Durham, UK, E-mail: [email protected]
Erik A. van Doorn
Affiliation:
Faculty of Mathematical Sciences, University of Twente, Enschede, The Netherlands, E-mail: [email protected]

Abstract

The deviation matrix of an ergodic, continuous-time Markov chain with transition probability matrix P(·) and ergodic matrix Π is the matrix D ≡ ∫0(P(t) − Π) dt. We give conditions for D to exist and discuss properties and a representation of D. The deviation matrix of a birth–death process is investigated in detail. We also describe a new application of deviation matrices by showing that a measure for the convergence to stationarity of a stochastically increasing Markov chain can be expressed in terms of the elements of the deviation matrix of the chain.

Type
Research Article
Copyright
© 2002 Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)