This paper develops expressions for the derivatives with respect to a parameter μ of the stable probabilities of a class of Markov chains whose transition matrices are of the form Q + μW. These expressions lead to iterative schemes for calculation which in turn suggest gradient algorithms for finding locally optimal chains.

Suppose that the state variables x = (x1,…,xn)′ where the dot refers to derivatives with respect to time t, and u ∊ U is a vector of controls. The object is to transfer x to x1 by choosing the controls so that the functional takes on its minimum value J(x) called the Bellman function (although we shall define it in a different way). The Dynamic Programming Principle leads to the maximisation with respect to u of and equality is obtained upon maximisation.

We study the buffer allocation problem in a two-stage cyclic queueing system. First, we show that transposing the number of buffers assigned to each queue does not affect the throughput. Second, we prove that the optimal buffer allocation scheme, in the sense of maximizing the system's throughput, is the one for which the absolute difference between the number of buffers, assigned to each queue, is minimized, i.e., it becomes either 0 or 1. This optimal allocation is insensitive to the general-type service-time distributions. These two distributions may be different and service times may even be correlated.

In this paper we show that the continuum-time version of the minority game satisfies the criteria for the application of a theorem on the existence of an invariant measure. We consider the special case of a game with a ‘sufficiently’ asymmetric initial condition, where the number of possible choices for each individual is S = 2 and Γ < +∞. An upper bound for the asymptotic behavior, as the number of agents grows to infinity, of the waiting time for reaching the stationary state is then obtained.

For a zero-mean, unit-variance stationary univariate Gaussian process we derive the probability that a record at the time n, say $X_n$ , takes place, and derive its distribution function. We study the joint distribution of the arrival time process of records and the distribution of the increments between records. We compute the expected number of records. We also consider two consecutive and non-consecutive records, one at time j and one at time n, and we derive the probability that the joint records $(X_j,X_n)$ occur, as well as their distribution function. The probability that the records $X_n$ and $(X_j,X_n)$ take place and the arrival time of the nth record are independent of the marginal distribution function, provided that it is continuous. These results actually hold for a strictly stationary process with Gaussian copulas.

In this paper we prove that a sequence of scaled generalized Jiřina processes can converge weakly to a nonlinear diffusion process with Lévy jumps under certain conditions.

The busy period of the GI/D/∞ queue is determined as the time when at least one customer is served. Let v be the number of customers served during this period. The busy period of order n is defined as a busy period for which v ≧ n. In this paper we derive the exact distributions, integral equations, characteristic functions and all moments of those periods. Finally, some properties of the idle periods of order n are established.

We consider the two-dimensional process {X(t), V(t)} where {V(t)} is Brownian motion with drift, and {X(t)} is its integral. In this note we derive the joint density function of T and V(T) where T is the time at which the process {X(t)} first returns to its initial value. A series expansion of the marginal density of T is given in the zero-drift case. When V(0) and the drift are both positive there is a positive probability that {Χ (t)} never returns to its initial value. We show how this probability grows for small drift. Finally, using the Kontorovich–Lebedev transform pair we obtain the escape probability explicitly for arbitrary values of the drift parameter.

For the delayed Bernoulli feedback queue with first come–first served discipline under weak assumptions a relationship for the generating functions of the joint queue-length distribution at various points in time is given. A decomposition for the generating function of the stationary total queue length distribution has been proven. The Laplace-Stieltjes transform of the stationary joint workload distribution function is represented by its marginal distributions. The arrival process is Poisson, renewal or arbitrary stationary, respectively. The service times can form an i.i.d. sequence at each queue. Different kinds of product form of the generating function of the joint queue-length distribution are discussed.

We study discrete-time population models where the nearest future of an individual may depend on the individual's life-stage (age and reproduction history) and the current population size. A criterion is given for whether there is a positive probability that the population survives forever. We identify the cases when population size grows exponentially and linearly and show that in the latter population size scaled by time is asymptotically Γ-distributed.

A curious connection exists between the theory of optimal stopping for independent random variables, and branching processes. In particular, for the branching process Zn with offspring distribution Y, there exists a random variable X such that the probability P(Zn = 0) of extinction of the nth generation in the branching process equals the value obtained by optimally stopping the sequence X1,…, Xn, where these variables are i.i.d. distributed as X. Generalizations to the inhomogeneous and infinite horizon cases are also considered. This correspondence furnishes a simple ‘stopping rule’ method for computing various characteristics of branching processes, including rates of convergence of the nth generation's extinction probability to the eventual extinction probability, for the supercritical, critical and subcritical Galton-Watson process. Examples, bounds, further generalizations and a connection to classical prophet inequalities are presented. Throughout, the aim is to show how this unexpected connection can be used to translate methods from one area of applied probability to another, rather than to provide the most general results.

We verify and extend a conjecture of Purdue (1981) concerning the stochastic monotonicity of absorption times in a class of compartmental urn models. We also describe the effect of increased variability in the reinforcement sizes. Finally, we investigate variability in the content process for large populations. In many applications, compartmental models substantially under-represent the variability observed in the data, so that there has been considerable interest in modifying the model to increase the variability. We show that the squared coefficient of variation of the content is not asymptotically negligible when both the size and the variability of the reinforcements are of the same order as the initial population.

An account is given of the autocorrelation theory of seasonal moving average models, using a vector representation defined by the author. It is shown that the autocorrelation structure of a seasonal moving average is reducible to that of a certain non-seasonal moving average, independently of the value of the seasonal periodicity if sufficiently large. It is pointed out that existing methods for the Cramér–Wold factorization discussed in Godolphin (1976) can easily be adapted to contend with the seasonal case.

The utility of the moments of the binomial distribution in finding the n-stage transition probabilities was indicated by Khazanie and McKean (1966). In this paper, maintaining the same breeding structure as in the two-allele case, it is proposed to extend the technique to cover the multiallelic case in general, with specific emphasis on the triallelic case. The existing literature on the multiple allelic case is at best scanty (see for example Kimura (1955)). Section 6 will briefly touch on a further extension to multiple loci which segregate independently.

We propose a stochastic model describing a process of awareness, evaluation, and decision making by agents on the d-dimensional integer lattice. Each agent may be in any of the three states belonging to the set {0, 1, 2. In this model 0 stands for ignorants, 1 for aware, and 2 for adopters. Aware and adopters inform its nearest ignorant neighbors about a new product innovation at rate λ. At rate α an agent in aware state becomes an adopter due to the influence of adopters' neighbors. Finally, aware and adopters forget the information about the new product, thus becoming ignorant, at rate 1. Our purpose is to analyze the influence of the parameters on the qualitative behavior of the process. We obtain sufficient conditions under which the innovation diffusion (and adoption) either becomes extinct or propagates through the population with positive probability.

A computable necessary and sufficient condition of separation cutoff is obtained for a sequence of continuous-time upward skip-free chains with the stochastically monotone time-reversals.

A certain single server queueing system with negative exponential service with mean rate nμ, when the system contains n customers, and Poisson arrivals, is formally equivalent to the infinite capacity system M/M/∞. This equivalence is exploited to yield in a very simple manner results for the single server system which were previously obtained by difficult analysis (see Hadidi (1969)).

This paper describes the computer simulation of a coverage problem in geometric probability, that of placing random caps on the surface of a sphere. The simulation results were compared with exact values, where known, and the differences were negligible. This suggested the use of simulation results to assess several approximation formulas in the literature.

Coffman, Courtois, Gilbert and Piret (1991) have introduced a flow process in graphs, where each vertex gets an initial random resource, and where at each time vertices with large resources tend to attract resources from neighbours. The initial resources are assumed to be i.i.d., with a continuous distribution.

We are mainly interested in the following question: does, with probability 1, the resource of each vertex change only finitely many times?

Coffman et al. concentrate mainly on the case where the graph corresponds with the integer points on the line, in which case it is easily seen that the answer to the above question is positive. For higher-dimensional lattices they make general remarks which suggest that the answer to the above question is still positive. However, no proof seems to be known.

We restrict to the case of the square lattice, and, by a percolation approach, we reduce the question above to the question whether a certain quantity, which can be obtained from a finite computation, is sufficiently small. This computation is, however, still too long to be executed in an acceptable time. We therefore apply Monte Carlo simulation for this finite problem, which gives overwhelming evidence that, for the square lattice, the answer to the main question is positive.

Two classes of finite and infinite moving-average sequences of bivariate random vectors are considered. The first class has bivariate exponential marginals while the second class has bivariate geometric marginals. The theory of positive dependence is used to show that in various cases the two classes consist of associated random variables. Association is then applied to establish moment inequalities and to obtain approximations to some joint probabilities of the bivariate processes.