Consider the GI/G/1 queue in which the interarrival/service times are parameterized. The derivatives (with respect to the parameter) of the expected delay of the nth job and its limit are derived and expressed in terms of the expectation of certain stochastic derivatives. Applications of these derivatives in stochastic optimization and random walk are illustrated.

The best upper and lower bounds for any probability generating function with mean m and finite variance are derived within the family of fractional linear functions with mean m. These are often intractable and simpler bounds, more useful for practical purposes, are then constructed. Direct applications in branching and epidemic theories are briefly presented; a slight improvement of the bounds is obtained for infinitely divisible distributions.

The parity of an individual in a population process is the number of offspring that individual has produced. If Nk(t) is the number of individuals of parity k at time t in a birth-and-death process and we show that, conditional on N(t)→ ∞,

A new technique is developed for deriving velocities of propagation and shapes of travelling wave profiles in non-linear situations. Two models are considered for the spread of infection through a linear community. In one the infected individuals move, in the other the phenomenon of infection.

In this paper, we develop the probabilistic foundations of the dynamic continuous choice problem. The underlying choice set is a compact metric space E such as the unit interval or the unit square. At each time point t, utilities for alternatives are given by a random function . To achieve a model of dynamic continuous choice, the theory of classical vector-valued extremal processes is extended to super-extremal processesY= {Yt, t > 0}. At any t > 0, Yt is a random upper semicontinuous function on a locally compact, separable, metric space E. General path properties of Y are discussed and it is shown that Y is Markov with state-space US(E). For each t > 0, Yt is associated.

For a compact metric E, we consider the argmax process M = {Mt, t > 0}, where . In the dynamic continuous choice application, the argmax process M represents the evolution of the set of random utility maximizing alternatives. M is a closed set-valued random process, and its path properties are investigated.

At which (random) sample size will every population element have been drawn at least m times? This special coupon collector's problem is often referred to as the Dixie cup problem. Some asymptotic properties of the Dixie cup problem with unequal sampling probabilities are described.

We show that the horizontal position of a random walk on a two-dimensional anisotropic lattice converges weakly to a diffusion process.

In this paper we consider a network of queues with batch services, customer coalescence and state-dependent signaling. That is, customers are served in batches at each node, and coalesce into a single unit upon service completion. There are signals circulating in the network and, when a signal arrives at a node, a batch of customers is either deleted or triggered to move as a single unit within the network. The transition rates for both customers and signals are quite general and can depend on the state of the whole system. We show that this network possesses a product form solution. The existence of a steady state distribution is also discussed. This result generalizes some recent results of Henderson et al. (1994), as well as those of Chao et al. (1996).

We consider the adaptive control of Markov chains under the weak accessibility condition with a view to minimizing the learning loss. A certainty equivalence control with a forcing scheme is constructed. We use a stationary randomized control scheme for forcing and compute a maximum likelihood estimate of the unknown parameter from the resulting observations. We obtain an exponential upper bound on the rate of decay of the probability of error. This allows us to choose the rate of forcing appropriately, whereby we achieve a o(f(n) log n) learning loss for any function as .

We prove a functional law of large numbers and a functional central limit theorem for a controlled renewal process, that is, a point process which differs from an ordinary renewal process in that the ith interarrival time is scaled by a function of the number of previous i arrivals. The functional law of large numbers expresses the convergence of a sequence of suitably scaled controlled renewal processes to the solution of an ordinary differential equation. Likewise, the functional central limit theorem establishes that the error in the law of large numbers converges weakly to the solution of a stochastic differential equation. Our proofs are based on martingale and time-change arguments.

Let X be an Ornstein–Uhlenbeck process driven by a Brownian motion. We propose an expression for the joint density / distribution function of the process and its running supremum. This law is expressed as an expansion involving parabolic cylinder functions. Numerically, we obtain this law faster with our expression than with a Monte Carlo method. Numerical applications illustrate the interest of this result.

In this paper, we consider Galton–Watson trees conditioned by size. We show that the number of k-ancestors (ancestors that have k children) of a node u is (almost) proportional to its depth. The k, j-ancestors are also studied. The methods rely on the study of ladder variables on an associated random walk. We also give an application to finite branching random walks.

In this paper, we study the classification of matrix GI/M/1-type Markov chains with a tree structure. We show that the Perron–Frobenius eigenvalue of a Jacobian matrix provides information for classifying these Markov chains. A fixed-point approach is utilized. A queueing application is presented to show the usefulness of the classification method developed in this paper.

We study the existence of moments and the tail behavior of the densities of storage processes. We give sufficient conditions for existence and nonexistence of moments using the integrability conditions of submultiplicative functions with respect to Lévy measures. We then study the asymptotical behavior of the tails of these processes using the concave or convex envelope of the release rate function.

The points of a graph G will form clusters as a result of a flow process. Initially, points i of G own resources xi which are i.i.d. random real numbers. Afterwards, resources flow between points, but always from a point to a neighbor that has accumulated a larger total resource. Thus points with small resource tend to lose it and points with large resource tend to gain. Eventually the flow stops with only two kinds of points, nulls with no resource left and absorbers with such large resource that no neighbor can take it. The final resource at an absorber is a sum of certain initial resources xi, and the corresponding points i form one cluster. Analytical results are obtainable when G is the chain of integer points on the line. Probability distributions are derived for the distance between consecutive absorbers and the size of a cluster. Indeed these distributions do not involve the given distribution for the xi. The Laplace transform of the distribution of final resources at absorbers is derived but the distribution itself is obtained by a simulation. For general graphs G only partial results are obtained.

We define a new family of multivariate stochastic processes over a finite time horizon that we call generalised Liouville processes (GLPs). GLPs are Markov processes constructed by splitting Lévy random bridges into non-overlapping subprocesses via time changes. We show that the terminal values and the increments of GLPs have generalised multivariate Liouville distributions, justifying their name. We provide various other properties of GLPs and some examples.

Consider a monoecious diploid population with nonoverlapping generations, whose size varies with time according to an irreducible, aperiodic Markov chain with states x1N,…,xKN, where K ≪ N. It is assumed that all matings except for selfing are possible and equally probable. At time 0 a random sample of n ≪ N genes is taken. Given two successive population sizes xjN and xiN, the numbers of gametes that individual parents contribute to offspring can be shown to be exchangeable random variables distributed as Gij. Under minimal conditions on the first three moments of Gij for all i and j, a suitable effective population size Ne is derived. Then if time is recorded in a backward direction in units of 2Ne generations, it can be shown that coalescent theory holds.

We study the array of point-to-point distances in random regular graphs equipped with exponential edge lengths. We consider the regime where the degree is kept fixed while the number of vertices tends to ∞. The marginal distribution of an individual entry is now well understood, thanks to the work of Bhamidi, van der Hofstad and Hooghiemstra (2010). The purpose of this note is to show that the whole array, suitably recentered, converges in the weak sense to an explicit infinite random array. Our proof consists in analyzing the invasion of the network by several mutually exclusive flows emanating from different sources and propagating simultaneously along the edges.

We first introduce a Lorenz ordering family of distributions which are related to the gamma distribution, and then prove that the weak convergence within this family is equivalent to the convergence of each moment sequence of positive orders to the corresponding moment of the limiting distribution.