Motivated by applications to wireless networks, cloud computing, data centers, etc., stochastic processing networks have been studied in the literature under various asymptotic regimes. In the heavy traffic regime, the steady-state mean queue length is proved to be $\Theta({1}/{\epsilon})$ , where $\epsilon$ is the heavy traffic parameter (which goes to zero in the limit). The focus of this paper is on obtaining queue length bounds on pre-limit systems, thus establishing the rate of convergence to heavy traffic. For the generalized switch, operating under the MaxWeight algorithm, we show that the mean queue length is within $\textrm{O}({\log}({1}/{\epsilon}))$ of its heavy traffic limit. This result holds regardless of the complete resource pooling (CRP) condition being satisfied. Furthermore, when the CRP condition is satisfied, we show that the mean queue length under the MaxWeight algorithm is within $\textrm{O}({\log}({1}/{\epsilon}))$ of the optimal scheduling policy. Finally, we obtain similar results for the rate of convergence to heavy traffic of the total queue length in load balancing systems operating under the ‘join the shortest queue’ routeing algorithm.

The sequential stochastic assignment problem (SSAP) allocates distinct workers with deterministic values to sequentially arriving tasks with stochastic parameters to maximize the expected total reward. In this paper we study an extension of the SSAP, in which the worker values are considered to be random variables, taking on new values upon each task arrival. Several SSAP models with different assumptions on the distribution of the worker values and closed-form expressions for optimal assignment policies are presented.

We study the buffer allocation problem in a two-stage cyclic queueing system. First, we show that transposing the number of buffers assigned to each queue does not affect the throughput. Second, we prove that the optimal buffer allocation scheme, in the sense of maximizing the system's throughput, is the one for which the absolute difference between the number of buffers, assigned to each queue, is minimized, i.e., it becomes either 0 or 1. This optimal allocation is insensitive to the general-type service-time distributions. These two distributions may be different and service times may even be correlated.

Momentum is the notion that an asset that has performed well in the past will continue to do so for some period. We study the optimal liquidation strategy for a momentum trade in a setting where the drift of the asset drops from a high value to a smaller one at some random change-point. This change-point is not directly observable for the trader, but it is partially observable in the sense that it coincides with one of the jump times of some exogenous Poisson process representing external shocks, and these jump times are assumed to be observable. Comparisons with existing results for momentum trading under incomplete information show that the assumption that the disappearance of the momentum effect is triggered by observable external shocks significantly improves the optimal strategy.

Suppose that the state variables x = (x1,…,xn)′ where the dot refers to derivatives with respect to time t, and u ∊ U is a vector of controls. The object is to transfer x to x1 by choosing the controls so that the functional takes on its minimum value J(x) called the Bellman function (although we shall define it in a different way). The Dynamic Programming Principle leads to the maximisation with respect to u of and equality is obtained upon maximisation.

Coffman, Courtois, Gilbert and Piret (1991) have introduced a flow process in graphs, where each vertex gets an initial random resource, and where at each time vertices with large resources tend to attract resources from neighbours. The initial resources are assumed to be i.i.d., with a continuous distribution.

We are mainly interested in the following question: does, with probability 1, the resource of each vertex change only finitely many times?

Coffman et al. concentrate mainly on the case where the graph corresponds with the integer points on the line, in which case it is easily seen that the answer to the above question is positive. For higher-dimensional lattices they make general remarks which suggest that the answer to the above question is still positive. However, no proof seems to be known.

We restrict to the case of the square lattice, and, by a percolation approach, we reduce the question above to the question whether a certain quantity, which can be obtained from a finite computation, is sufficiently small. This computation is, however, still too long to be executed in an acceptable time. We therefore apply Monte Carlo simulation for this finite problem, which gives overwhelming evidence that, for the square lattice, the answer to the main question is positive.

Many complex systems can be modeled via Markov jump processes. Applications include chemical reactions, population dynamics, and telecommunication networks. Rare-event estimation for such models can be difficult and is often computationally expensive, because typically many (or very long) paths of the Markov jump process need to be simulated in order to observe the rare event. We present a state-dependent importance sampling approach to this problem that is adaptive and uses Markov chain Monte Carlo to sample from the zero-variance importance sampling distribution. The method is applicable to a wide range of Markov jump processes and achieves high accuracy, while requiring only a small sample to obtain the importance parameters. We demonstrate its efficiency through benchmark examples in queueing theory and stochastic chemical kinetics.

In this paper we study the moment generating function order and the new better than used in the moment generating function order (NBUMG) life distributions. A closure property of this order under an independent random sum is deduced, and stochastic comparisons among the block replacement policy, the age replacement policy, the complete repair policy, and the minimal repair policy of an NBUMG component are investigated.

For a spectrally negative self-similar Markov process on $[0,\infty)$ with an a.s. finite overall supremum, we provide, in tractable detail, a kind of conditional Wiener–Hopf factorization at the maximum of the absorption time at zero, the conditioning being on the overall supremum and the jump at the overall supremum. In a companion result the Laplace transform of this absorption time (on the event that the process does not go above a given level) is identified under no other assumptions (such as the process admitting a recurrent extension and/or hitting zero continuously), generalizing some existing results in the literature.

The upper tail behaviour is explored for a stopped random product ∏j=1NXj, where the factors are positive and independent and identically distributed, and N is the first time one of the factors occupies a subset of the positive reals. This structure is motivated by a heavy-tailed analogue of the factorial n!, called the factoid of n. Properties of the factoid suggested by computer explorations are shown to be valid. Two topics about the determination of the Zipf exponent in the rank-size law for city sizes are discussed.

We study a model arising in chemistry where n elements numbered 1, 2, …, n are randomly permuted and if i is immediately to the left of i + 1 then they become stuck together to form a cluster. The resulting clusters are then numbered and considered as elements, and this process keeps repeating until only a single cluster is remaining. In this article we study properties of the distribution of the number of permutations required.

In this paper we prove that a sequence of scaled generalized Jiřina processes can converge weakly to a nonlinear diffusion process with Lévy jumps under certain conditions.

This paper is concerned with properties of the algebraic degree of the Laplace-Stieltjes transform of phase-type (PH) distributions. The main problem of interest is: given a PH generator, how do we find the maximum and the minimum algebraic degrees of all irreducible PH representations with that PH generator? Based on the matrix exponential (ME) order of ME distributions and the spectral polynomial algorithm, a method for computing the algebraic degree of a PH distribution is developed. The maximum algebraic degree is identified explicitly. Using Perron-Frobenius theory of nonnegative matrices, a lower bound and an upper bound on the minimum algebraic degree are found, subject to some conditions. Explicit results are obtained for special cases.

Looking at a large branching population we determine along which path the population that started at 1 at time 0 ended up in B at time N. The result describes the density process, that is, population numbers divided by the initial number K (where K is assumed to be large). The model considered is that of a Galton-Watson process. It is found that in some cases population paths exhibit the strange feature that population numbers go down and then increase. This phenomenon requires further investigation. The technique uses large deviations, and the rate function based on Cramer's theorem is given. It also involves analysis of existence of solutions of a certain algebraic equation.

Let {ξn, n ≧1} be a sequence of independent real random variables, F denote the common distribution function of identically distributed random variables ξn, n ≧1 and let ξ1 have an arbitrary distribution. Define Xn+1 = k max(Xn, ξ n+1), Yn+ 1 = max(Yn, ξ n+1) – c, Un+1 = l min(Un, ξ n+1), Vn+1 = min(Vn, ξ n+1) + c, n ≧ 1, 0 < k < 1, l > 1, 0 < c < ∞, and X1 = Υ1= U1 = V1 = ξ1. We establish conditions under which the limit law of max(X1, · ··, Xn) coincides with that of max(ξ2, · ··, ξ n+1) when both are appropriately normed. A similar exercise is carried out for the extreme statistics max(Y1, · ··, Yn), min(U1,· ··, Un) and min(V1, · ··, Vn).

It is proved that for families of stochastic operators on a countable tensor product, depending smoothly on parameters, any spectral projection persists smoothly, where smoothness is defined using norms based on ideas of Dobrushin. A rigorous perturbation theory for families of stochastic operators with spectral gap is thereby created. It is illustrated by deriving an effective slow two-state dynamics for a three-state probabilistic cellular automaton.

We extend the Kalman-Bucy filter to the case where both the system and observation processes are driven by finite dimensional Lévy processes, but whereas the process driving the system dynamics is square-integrable, that driving the observations is not; however it remains integrable. The main result is that the components of the observation noise that have infinite variance make no contribution to the filtering equations. The key technique used is approximation by processes having bounded jumps.

In this paper we first use the distribution of the number of records to demonstrate that the right tail probabilities of counts of rare events are generally better approximated by the right tail probabilities of a Poisson distribution than those of the normal distribution. We then show that the moderate deviations in Poisson approximation generally require an adjustment and, with suitable adjustment, we establish better error estimates of the moderate deviations in Poisson approximation than those in [18]. Our estimates contain no unspecified constants and are easy to apply. We illustrate the use of the theorems via six applications: Poisson-binomial distribution, the matching problem, the occupancy problem, the birthday problem, random graphs, and 2-runs. The paper complements the works [16], [8], and [18].

We study the uncertain dichotomous choice model. In this model, a group of expert decision makers is required to select one of two alternatives. The applications of this model are relevant to a wide variety of areas. A decision rule translates the individual opinions of the members into a group decision, and is optimal if it maximizes the probability of the group making a correct choice. In this paper, we assume the correctness probabilities of the experts to be independent random variables selected from some given distribution. Moreover, the ranking of the members in the group is (at least partly) known. Thus, one can follow rules based on this ranking. The extremes are the expert rule and the majority rule. The probabilities of the two extreme rules being optimal were compared in a series of early papers, for a variety of distributions. In most cases, the asymptotic behaviours of the probabilities of the two extreme rules followed the same patterns. Do these patterns hold in general? If not, what are the ranges of possible asymptotic behaviours of the probabilities of the two extreme rules being optimal? In this paper, we provide satisfactory answers to these questions.