We study convergence to non-minimal quasi-stationary distributions for one-dimensional diffusions. We give a method for reducing the convergence to the tail behavior of the lifetime via a property we call the first hitting uniqueness. We apply the results to Kummer diffusions with negative drift and give a class of initial distributions converging to each non-minimal quasi-stationary distribution.

We consider a collection of Markov chains that model the evolution of multitype biological populations. The state space of the chains is the positive orthant, and the boundary of the orthant is the absorbing state for the Markov chain and represents the extinction states of different population types. We are interested in the long-term behavior of the Markov chain away from extinction, under a small noise scaling. Under this scaling, the trajectory of the Markov process over any compact interval converges in distribution to the solution of an ordinary differential equation (ODE) evolving in the positive orthant. We study the asymptotic behavior of the quasi-stationary distributions (QSD) in this scaling regime. Our main result shows that, under conditions, the limit points of the QSD are supported on the union of interior attractors of the flow determined by the ODE. We also give lower bounds on expected extinction times which scale exponentially with the system size. Results of this type when the deterministic dynamical system obtained under the scaling limit is given by a discrete-time evolution equation and the dynamics are essentially in a compact space (namely, the one-step map is a bounded function) have been studied by Faure and Schreiber (2014). Our results extend these to a setting of an unbounded state space and continuous-time dynamics. The proofs rely on uniform large deviation results for small noise stochastic dynamical systems and methods from the theory of continuous-time dynamical systems.

In general, QSD for Markov chains with absorbing states and unbounded state spaces may not exist. We study one basic family of binomial-Poisson models in the positive orthant where one can use Lyapunov function methods to establish existence of QSD and also to argue the tightness of the QSD of the scaled sequence of Markov chains. The results from the first part are then used to characterize the support of limit points of this sequence of QSD.

We consider a strictly substochastic matrix or a stochastic matrix with absorbing states. By using quasi-stationary distributions we show that there is an associated canonical Markov chain that is built from the resurrected chain, the absorbing states, and the hitting times, together with a random walk on the absorbing states, which is necessary for achieving time stationarity. Based upon the 2-stringing representation of the resurrected chain, we supply a stationary representation of the killed and the absorbed chains. The entropies of these representations have a clear meaning when one identifies the probability measure of natural factors. The balance between the entropies of these representations and the entropy of the canonical chain serves to check the correctness of the whole construction.

We study the variance-to-mean ratio of the distributions of parasites among hosts for some models of parasite infection, using the cohort approach. We consider a model with density dependence in parasite mortality, and two different formulations of disease induced host mortality. We show that the distributions of parasites, conditional on host survival, converge to quasi-stationary distributions as host age increases. When there is density dependence in parasite mortality, the limiting variance-to-mean ratio is less than 1 (an ‘under-dispersed’ distribution). In contrast, the two modes of disease induced host mortality show that either over- or underdispersed distributions may result.

In this paper we study the conditional limiting behaviour for the virtual waiting time process for the queue M/D/1. We describe the family of conditional invariant distributions which are continuous and parametrized by the eigenvalues λ ∊ (0, λc], as it happens for diffusions. In this case, there is a periodic dependence of the limiting conditional distributions on the initial point and the minimal conditional invariant distribution is a mixture, according to an exponential law, of the limiting conditional distributions.

We study one-dimensional continuous loss networks with length distribution G and cable capacity C. We prove that the unique stationary distribution ηL of the network for which the restriction on the number of calls to be less than C is imposed only in the segment [−L,L] is the same as the distribution of a stationary M/G/∞ queue conditioned to be less than C in the time interval [−L,L]. For distributions G which are of phase type (= absorbing times of finite state Markov processes) we show that the limit as L → ∞ of ηL exists and is unique. The limiting distribution turns out to be invariant for the infinite loss network. This was conjectured by Kelly (1991).

We consider Brownian motion with a negative drift conditioned to stay positive. We give a sufficient condition for an initial measure to be in the domain of attraction of a quasi-stationary distribution. We construct a counter-example that strongly suggests that this condition is optimal.

In a recent paper [16], one of us identified all of the quasi-stationary distributions for a non-explosive, evanescent birth-death process for which absorption is certain, and established conditions for the existence of the corresponding limiting conditional distributions. Our purpose is to extend these results in a number of directions. We shall consider separately two cases depending on whether or not the process is evanescent. In the former case we shall relax the condition that absorption is certain. Furthermore, we shall allow for the possibility that the minimal process might be explosive, so that the transition rates alone will not necessarily determine the birth-death process uniquely. Although we shall be concerned mainly with the minimal process, our most general results hold for any birth-death process whose transition probabilities satisfy both the backward and the forward Kolmogorov differential equations.

Let X be a birth and death process on with absorption at zero and suppose that X is suitably recurrent, irreducible and non-explosive. In a recent paper, Roberts and Jacka (1994) showed that as T → ∞ the process conditioned to non-absortion until time T converges weakly to a time-homogeneous Markov limit, X∞, which is itself a birth and death process. However the question of the possibility of explosiveness of X∞ remained open. The major result of this paper establishes that X∞ is always non-explosive.

We prove that the quasi-invariant measures associated to a Brownian motion with negative drift X form a one-parameter family. The minimal one is a probability measure inducing the transition density of a three-dimensional Bessel process, and it is shown that it is the density of the limit distribution limt→∞Px(X A | τ > t). It is also shown that the minimal quasi-invariant measure of infinite mass induces the density of the limit distribution ) which is the law of a Bessel process with drift.

In this paper we consider a number of questions relating to the problem of determining quasi-stationary distributions for transient Markov processes. First we find conditions under which a measure or vector that is µ-invariant for a matrix of transition rates is also μ-invariant for the family of transition matrices of the minimal process it generates. These provide a means for determining whether or not the so-called stationary conditional quasi-stationary distribution exists in the λ-transient case. The process is not assumed to be regular, nor is it assumed to be uniform or irreducible. In deriving the invariance conditions we reveal a relationship between μ-invariance and the invariance of measures for related processes called the μ-reverse and the μ-dual processes. They play a role analogous to the time-reverse process which arises in the discussion of stationary distributions. Secondly we bring the related notions of detail-balance and reversibility into the realm of quasi-stationary processes. For example, if a process can be identified as being μ-reversible, the problem of determining quasi-stationary distributions is made much simpler. Finally, we consider some practical problems that emerge when calculating quasi-stationary distributions directly from the transition rates of the process. Our results are illustrated with reference to a variety of processes including examples of birth and death processes and the birth, death and catastrophe process.

In this paper we consider the long term behaviour till absorption of multitype Galton-Watson processes using the theory of quasi-stationary distributions.

Let {Xk: k ≧ 1} be a sequence of independent, identically distributed random variables with EX1 = μ < 0. Form the random walk {Sn: n ≧ 0} by setting S0 = 0, Sn = X1 + … + Xn, n ≧ 1. Let T denote the hitting time of the set (–∞, 0] by the random walk. The principal result in this paper is to show (under appropriate conditions on the distribution of X1) that Sn, conditioned on T > n converges weakly to a limit random variable, S∗, and to find the Laplace transform of the distribution of S∗. We also investigate a collection of random walks with mean μ < 0 and conditional limits S∗ (μ), and show that S∗ (μ), properly normalized, converges to a gamma distribution of second order as μ ↗ 0. These results have applications to the GI/G/1 queue, collective risk theory, and the gambler's ruin problem.

The quasi-stationary behaviour of a Markov chain which is φ-irreducible when restricted to a subspace of a general state space is investigated. It is shown that previous work on the case where the subspace is finite or countably infinite can be extended to general chains, and the existence of certain quasi-stationary limits as honest distributions is equivalent to the restricted chain being R-positive with the unique R-invariant measure satisfying a certain finiteness condition.

Consider a semi-Markov process X(t) defined on a subset of the non-negative integers with zero as an absorbing state and the non-zero states forming an irreducible class with exit to zero being possible. Conditions are given for the existence of the limits: where Xj(t) is the amount of time prior to time t spent in state j.

The limits (which are independent of the initial state) are evaluated when the sufficient conditions are satisfied.

This paper studies the existence, in a stable GI/M/1 queue, of the limit as t → ∞ of the distribution of the virtual waiting time process at time t conditioned on the event that at no time in the interval [0, t] the queue has become empty. The conditional limit distribution obtained when the traffic intensity is strictly less than one is the weighted sum of an exponential and a gamma distribution. Similar conditional limit distributions are obtained for the queue size process and the waiting time process as defined by Prabhu (1964).