The theory of L2-spectral gaps for reversible Markov chains has been studied by many authors. In this paper we consider positive recurrent general state space Markov chains with stationary transition probabilities. Replacing the assumption of reversibility with a weaker assumption, we still obtain a simple necessary and sufficient condition for the spectral gap property of the associated Markov operator in terms of the isoperimetric constant. We show that this result can be applied to a large class of Markov chains, including those that are related to positive recurrent finite-range random walks on Z.

How should a team allocate its players to achieve the optimal balance between offence and defence? By posing a simple territorial game between two teams, insight into this question is gained. The saddlepoint solution to the game is derived.

A summation formula is given for computing the spectrum of intervals of a geometric branching Poisson process from the cumulant generating function of the associated counting process.

In this paper we present a method for obtaining explicit results for some two-sided boundary problems involving sums of independent random variables with alternating distributions. We apply the method to finding the first passage time to either one of two finite barriers, and to some situations arising in queueing and dam theory. The results can be expressed in terms of a finite sum of simple repeated integrals (or sums) of known functions (cf. formulae (3.6)– (3.11)).

An expression for the first-passage density of Brownian motion to a curved boundary due to Daniels and Lerche is shown to give the same result as a different form due to the author. The equivalence is extended to continuous Gaussian Markov processes.

Consider a number of events in a probability space. Let X be a random variable that is the number of events that occur. Given some of the moments of the distribution of X, it is possible to obtain bounds on the probability that at least one event occurs. The best possible bounds are given here. If there are many equiprobable events that are d- wise independent, and d is even, then the probability that at least one event happens is at least 1 — O(µ–d/2), where μ = E(X).

In this paper we consider a new generalized finite mixture model formed by dependent and identically distributed (d.i.d.) components. We then establish results for the comparisons of lifetimes of two such generalized finite mixture models in two different cases: (i) when the two mixture models are formed from two random vectors $\textbf{X}$ and $\textbf{Y}$ but with the same weights, and (ii) when the two mixture models are formed with the same random vectors but with different weights. Because the lifetimes of k-out-of-n systems and coherent systems are special cases of the mixture model considered, we used the established results to compare the lifetimes of k-out-of-n systems and coherent systems with respect to the reversed hazard rate and hazard rate orderings.

In this paper we are concerned with the reliability properties of two coherent systems having shared components. We assume that the components of the systems are two overlapping subsets of a set of n components with lifetimes X1,...,Xn. Further, we assume that the components of the systems fail according to the model of sequential order statistics (which is equivalent, under some mild conditions, to the failure model corresponding to a nonhomogeneous pure-birth process). The joint reliability function of the system lifetimes is expressed as a mixture of the joint reliability functions of the sequential order statistics, where the mixing probabilities are the bivariate signature matrix associated to the structures of systems. We investigate some stochastic orderings and dependency properties of the system lifetimes. We also study conditions under which the joint reliability function of systems with shared components of order m can be equivalently written as the joint reliability function of systems of order n (n>m). In order to illustrate the results, we provide several examples.

This paper considers a carrier-borne epidemic in continuous time with m + 1 > 2 stages of infection. The carriers U(t) follow a pure death process, mixing homogeneously with susceptibles X0(t), and infectives Xi(t) in stages 1≦i≦m of infection. The infectives progress through consecutive stages of infection after each contact with the carriers. It is shown that under certain conditions {X0(t), X1(t), · ··, Xm(t) U(t); t≧0} is an (m + 2)-variate Markov chain, and the partial differential equation for its probability generating function derived. This can be solved after a transfomation of variables, and the probability of survivors at the end of the epidemic found.

It is well understood that a supercritical superprocess is equal in law to a discrete Markov branching process whose genealogy is dressed in a Poissonian way with immigration which initiates subcritical superprocesses. The Markov branching process corresponds to the genealogical description of prolific individuals, that is, individuals who produce eternal genealogical lines of descent, and is often referred to as the skeleton or backbone of the original superprocess. The Poissonian dressing along the skeleton may be considered to be the remaining non-prolific genealogical mass in the superprocess. Such skeletal decompositions are equally well understood for continuous-state branching processes (CSBP).

In a previous article [16] we developed an SDE approach to study the skeletal representation of CSBPs, which provided a common framework for the skeletal decompositions of supercritical and (sub)critical CSBPs. It also helped us to understand how the skeleton thins down onto one infinite line of descent when conditioning on survival until larger and larger times, and eventually forever.

Here our main motivation is to show the robustness of the SDE approach by expanding it to the spatial setting of superprocesses. The current article only considers supercritical superprocesses, leaving the subcritical case open.

In this paper the t-step maintainable regions Mt are examined in a three-graded system under the following conditions: the total size of the system remains constant during each intermediate step, demotions do not occur and recruitment control is considered.

A counterexample, showing that the monotonicity property Mt ⊆ Mt+1 does not exist in general, refutes the conjecture of Davies [3].

This paper investigates the random horizon optimal stopping problem for measure-valued piecewise deterministic Markov processes (PDMPs). This is motivated by population dynamics applications, when one wants to monitor some characteristics of the individuals in a small population. The population and its individual characteristics can be represented by a point measure. We first define a PDMP on a space of locally finite measures. Then we define a sequence of random horizon optimal stopping problems for such processes. We prove that the value function of the problems can be obtained by iterating some dynamic programming operator. Finally we prove via a simple counter-example that controlling the whole population is not equivalent to controlling a random lineage.

The Jackson network under study receives batch arrivals at i.i.d. intervals and features Markovian routing and exponentially distributed service times. The system is shown to be stable, in the sense of not being overloaded, if and only if, for each node, the total arrival rate of external and internal customers is less than the service rate. The method of proof is of more general interest.

In a classical, continuous-time, optimal stopping problem, the agent chooses the best time to stop a stochastic process in order to maximise the expected discounted return. The agent can choose when to stop, and if at any moment they decide to stop, stopping occurs immediately with probability one. However, in many settings this is an idealistic oversimplification. Following Strack and Viefers we consider a modification of the problem in which stopping occurs at a rate which depends on the relative values of stopping and continuing: there are several different solutions depending on how the value of continuing is calculated. Initially we consider the case where stopping opportunities are constrained to be event times of an independent Poisson process. Motivated by the limiting case as the rate of the Poisson process increases to infinity, we also propose a continuous-time formulation of the problem where stopping can occur at any instant.

The application of the generalised ballot theorem to queueing theory leads to elegant results for the simple M/G/1 queue. It is thought that such results are not possible for more general M/G/1-type queues. We, however, derive a batch ballot theorem which can be applied to derive the first passage distribution matrix, G, for the general M/G/1-type queue.

We consider the problem of estimating the rate of convergence to stationarity of a continuous-time, finite-state Markov chain. This is done via an estimator of the second-largest eigenvalue of the transition matrix, which in turn is based on conventional inference in a parametric model. We obtain a limiting distribution for the eigenvalue estimator. As an example we treat an M/M/c/c queue, and show that the method allows us to estimate the time to stationarity τ within a time comparable to τ.

We study a Pólya-type urn model defined as follows. Start at time 0 with a single ball of some colour. Then, at each time n≥1, choose a ball from the urn uniformly at random. With probability ½<p<1, return the ball to the urn along with another ball of the same colour. With probability 1−p, recolour the ball to a new colour and then return it to the urn. This is equivalent to the supercritical case of a random graph model studied by Backhausz and Móri (2015), (2016) and Thörnblad (2015). We prove that, with probability 1, there is a dominating colour, in the sense that, after some random but finite time, there is a colour that always has the most number of balls. A crucial part of the proof is the analysis of an urn model with two colours, in which the observed ball is returned to the urn along with another ball of the same colour with probability p, and removed with probability 1−p. Our results here generalise a classical result about the Pólya urn model (which corresponds to p=1).

The information flow in discrete Markov systems provides a method for determining that such a system is ergodic. Estimates are obtained for the information flow in some classes of Markov systems and using these estimates criteria for the ergodicity of the systems are established.

This paper presents a degree-two probability lower bound for the union of an arbitrary set of events in an arbitrary probability space. The bound is designed in terms of the first-degree Bonferroni summation and pairwise joint probabilities of events, which are represented as weights of edges in a Hamilton-type circuit in a connected graph. The proposed lower bound strengthens the Dawson–Sankoff lower bound in the same way that Hunter and Worsley's degree-two upper bound improves the degree-two Bonferroni-type optimal upper bound. It can be applied to statistical inference in time series and outlier diagnoses as well as the study of dose response curves.