Using an easy linear-algebraic method, we obtain spectral representations, without the need for eigenvector determination, of the transition probability matrices for completely general continuous time Markov chains with finite state space. Comparing the proof presented here with that of Brown (1991), who provided a similar result for a special class of finite Markov chains, we observe that ours is more concise.

The optimal strategy for a class of non-Markov decision processes is characterised and has the property that changes of action may occur between successive transitions of the process. Results are given which enable the optimal strategy to be computed iteratively.

In a single-shelf library having infinitely many books B1, B2, …, the probability of selecting each book is assumed known. Books are removed one at a time and replaced in position k prior to the next removal. Books are moved either to the right or the left as is necessary to vacate position k. Those arrangements of books where after some finite position all the books are in natural order (book i occupies position i) are considered as states in an infinite Markov chain. When k > 1, we show that the chain can never be positive recurrent. When k = 1, we find the limits of ratios of one-step transition probabilities; and when k = 1 and the chain is transient, we find the Martin exit boundary.

Stochastic models for the origin and extinction of species have been rather neglected in applied probability. As an alternative to modelling speciation and extinction as intrinsically random, I shall describe and show simulations of a rulebased model. This involves mathematical representations of notions such as genetic type of species, environmental niche, fitness of a species in a niche, and adaptation. There are underlying random mechanisms for changes of niche sizes and for disconnection and reconnection of geographical regions, and these ultimately drive the evolution of species.

Other approaches to mathematical modelling of evolution are briefly mentioned.

Randomly generated subsets of a point-set A0 in the k-dimensional Euclidean space Rk are investigated. Under suitable restrictions the probability is determined that a randomly located set which hits A0. is a subset of A0. Some results on the expected value of the measure and the surface area of the common intersection-set formed by n randomly located objects and A0 are generalized and derived for arbitrary dimension k.

It is known that for a GI/G/1 queue, if the interarrival time has finite first moment, then the (k + 1)th moment of the service time is finite if the kth moment of the stationary workload is finite. This result is extended to certain tandem and multiple-server queues.

Assume that we want to estimate – σ, the abscissa of convergence of the Laplace transform. We show that no non-parametric estimator of σ can converge at a faster rate than (log n)–1, where n is the sample size. An optimal convergence rate is achieved by an estimator of the form where xn = O(log n) and is the mean of the sample values overshooting xn. Under further parametric restrictions this (log n)–1 phenomenon is also illustrated by a weak convergence result.

Asymptotic approximations and numerical computations are used to estimate the accuracy of the diffusion approximation for the expected time to extinction for some stochastic processes. The results differ for processes with a continuant transition matrix (e.g. a birth and death process), and those with a noncontinuant transition matrix (e.g. a non-linear branching process). In the latter case, the diffusion equation does not hold near the point of exit. Consequently, high-order corrections do not result in substantial improvement over the diffusion approximation.

By considering continuous-time Markov decision processes where decisions can be made at any time, we show in the case of M/M/1 queues with discounted costs that there exists a monotone optimal policy among all the regular policies.

The problem of inferring the distribution of a random vector given that its norm is large requires modeling a homogeneous limiting density. We suggest an approach based on graphical models which is suitable for high-dimensional vectors. We introduce the notion of one-component regular variation to describe a function that is regularly varying in its first component. We extend the representation and Karamata's theorem to one-component regularly varying functions, probability distributions and densities, and explain why these results are fundamental in multivariate extreme-value theory. We then generalize the Hammersley–Clifford theorem to relate asymptotic conditional independence to a factorization of the limiting density, and use it to model multivariate tails.

Sharp upper and lower bounds for the variance of a non-negative function of a non-negative random variable are obtained under rather weak hypotheses regarding the function. Comparisons between bounds are made and some specific examples are considered.

We study the Cramér type moderate deviation for partial sums of random fields by applying the conjugate method. The results are applicable to the partial sums of linear random fields with short or long memory and to nonparametric regression with random field errors.

Our concern is with a particular problem which arises in connection with a discrete-time Markov chain model for a graded manpower system. In this model, the members of an organisation are classified into distinct classes. As time passes, they move from one class to another, or to the outside world, in a random way governed by fixed transition probabilities. In this paper, the emphasis is placed on evaluating exact values of the probabilities of attaining and maintaining a structure.

The Laplace transform is obtained for the joint length and height of an M/M/∞ queue excursion above occupancy level C.

We establish heavy-traffic limits for nearly deterministic queues, such as the G/D/n many-server queue. Since waiting times before starting service in the G/D/n queue are equivalent to waiting times in an associated Gn /D/1 model, where the Gn interarrival times are the sum of n consecutive interarrival times in the original model, we focus on the Gn /D/1 model and the generalization to Gn /Gn /1, where ‘cyclic thinning’ is applied to both the arrival and service processes. We establish different limits in two cases: (i) when (1 − ρn )√n → β as n → ∞ and (ii) when (1 − ρn )n → β as n → ∞, where ρn is the traffic intensity in model n. The nearly deterministic feature leads to interesting nonstandard scaling.

The cars are considered as points on an infinite road with no intersections. They can overtake each other without any delay and they travel at constant speeds. These are independent identically distributed random variables also independent of the initial positions of the cars. The main purpose of the paper is the study of the asymptotic distribution for the number of overtakings (and/or meetings) in increasing rectangles in the time-road plane. Under the assumption of (weighted) Poisson distributed cars along the time-axis we deduce the asymptotic distribution of the standardized number of overtakings (and/or meetings) for large rectangles in the time-road plane. Lastly we shall indicate an application of the results.

GI/M/1-type Markov chains make up a class of two-dimensional Markov chains. One dimension is usually called the level, and the other is often called the phase. Transitions from states in level k are restricted to states in levels less than or equal to k+1. For given transition probabilities in the interior of the state space, we show that it is always possible to define the boundary transition probabilities in such a way that the level and phase are independent under the stationary distribution. We motivate our analysis by first considering the quasi-birth-and-death process special case in which transitions from any state are restricted to states in the same, or adjacent, levels.

Probability properties of the measure of the union of random sets have theoretical as well as practical importance (David (1950), Garwood (1947), Hemmer (1959)). In the present paper we derive asymptotic properties of the distributions of these measures and apply the derived properties to the investigation of the asymptotic behavior of empirical distribution functions. Thus, an asymptotic distribution function for the relative lengths of steps in the empirical distribution function is obtained.

This paper establishes a compound Poisson limit theorem for the sum of a sequence of multi-state Markov chains. Our theorem generalizes an earlier one by Koopman for the two-state Markov chain. Moreover, a similar approach is used to derive a limit theorem for the sum of the k th-order two-state Markov chain.

The Markovian arrival process generalizes the Poisson process by allowing for dependent and nonexponential interarrival times. We study the autocorrelation function of the two-state Markovian arrival process. Our findings show that the correlation structure of such a process has a very specific pattern, namely, it always converges geometrically to zero. Moreover, the signs of the autocorrelation coefficients are either constant or alternating.