The set of the attainable structures of a continuous time homogeneous Markov system (HMS) with fixed size, is considered as a continuum and the evolution of the HMS in the Euclidean space corresponds to its motion. Taking account of the velocity field of the HMS, a suitable model of continuum–defined by its stress tensor–is proposed in order to explain the motion of the system. The adoption of this model (equivalently of its stress tensor) enables us to establish the concept of the energy of a structure of the HMS.

Realization probability is a new concept pertaining to perturbation analysis of closed queuing networks. The sensitivities of throughputs in a closed single-class Jackson network can be expressed in terms of realization probabilities. In this paper, based on a discussion of perturbation analysis for networks with state-dependent service rates, we derive some new formulas for sensitivities of throughputs using realization probability.

A non-degenerate distribution function F is called maximum stable with random sample size if there exist positive integer random variables Nn, n = 1, 2, ···, with P(Nn = 1) less than 1 and tending to 1 as n → ∞ and such that F and the distribution function of the maximum value of Nn independent observations from F (and independent of Nn) are of the same type for every index n. By proving the converse of an earlier result of the author, it is shown that the set of all maximum stable distribution functions with random sample size consists of all distribution functions F satisfying where c2, c3, · ·· are arbitrary non-negative constants with 0 < c2 + c3 + · ·· <∞, and all distribution functions G and H defined by F(x)= G(c + exp(x)) and F(x) = H(c – exp(–x)), –∞ < x <∞, where c is an arbitrary real constant.

The Lévy distance, L(F,G), between two distribution functions F and G has the important property that convergence of L(Fn,F) is equivalent to convergence in distribution. The fact that L(F,G) is not invariant under a change of scale has been thought to be a disadvantage. However, simple bounds on the Lévy distance between the transformed distribution functions can be found.

This paper considers how students might be taught statistical consulting. Desirable characteristics of a good consultant are described. While skill in statistical techniques is considered, it is just one of several areas of expertise that are discussed. Suggestions are made as to what should be included in a consulting course to equip a student with these characteristics.

In this paper we obtain some ergodic properties and ergodic decompositions of a continuous-time, Borel right Markov process taking values in a locally compact and separable metric space. Initially, we assume that an invariant probability measure (IPM) μ exists for the process and, without making any further assumptions on the transition kernel, obtain some characterization results for the convergence of the expected occupation measure to a limit kernel. Under the same assumption, we present the so-called Yosida decomposition. Next, instead of assuming the existence of an IPM, we assume that the Markov process satisfies a certain condition, named the T'-condition. Under this condition it is shown that the Foster-Lyapunov criterion is necessary and sufficient for the existence of an IPM and that the process admits a Doeblin decomposition. Furthermore, it is shown that in this case the set of ergodic probability measures is countable and that every probability measure for the Markov process is nonsingular with respect to the transition kernel.

Consider a queueing system of the following type: random arrivals enter the system, where they are assigned to one of r service channels. Each arrival is then serviced and discharged from the system. The classical results for this class of problems are based upon systems where customers join a single queue and then are randomly assigned to an available server from this queue. (See, for instance, Takács (1962).)

Local linear approximations have been the main component in the construction of a class of effective numerical integrators and inference methods for diffusion processes. In this note, two local linear approximations of jump diffusion processes are introduced as a generalization of the usual ones. Their rate of uniform strong convergence is also studied.

For a determinantal point process (DPP) X with a kernel K whose spectrum is strictly less than one, André Goldman has established a coupling to its reduced Palm process $X^u$ at a point u with $K(u,u)>0$ so that, almost surely, $X^u$ is obtained by removing a finite number of points from X. We sharpen this result, assuming weaker conditions and establishing that $X^u$ can be obtained by removing at most one point from X, where we specify the distribution of the difference $\xi_u: = X\setminus X^u$. This is used to discuss the degree of repulsiveness in DPPs in terms of $\xi_u$, including Ginibre point processes and other specific parametric models for DPPs.

Consider a sequence of Markov-dependent trials where each trial produces a letter of a finite alphabet. Given a collection of patterns, we look at this sequence until one of these patterns appears as a run. We show how the method of gambling teams can be employed to compute the probability that a given pattern is the first pattern to occur.

Scale-free percolation is a stochastic model for complex networks. In this spatial random graph model, vertices $x,y\in\mathbb{Z}^d$ are linked by an edge with probability depending on independent and identically distributed vertex weights and the Euclidean distance $|x-y|$ . Depending on the various parameters involved, we get a rich phase diagram. We study graph distance and compare it to the Euclidean distance of the vertices. Our main attention is on a regime where graph distances are (poly-)logarithmic in the Euclidean distance. We obtain improved bounds on the logarithmic exponents. In the light tail regime, the correct exponent is identified.

Admission control can be employed to avoid congestion in queueing networks subject to overload. In distributed networks, the admission decisions are often based on imperfect measurements on the network state. In this paper, we study how the lack of complete state information affects the system performance, by considering a simple network model for distributed admission control. The stability region of the network is characterized and it is shown how feedback signaling makes the system very sensitive to its parameters.

The purpose of this paper is to study an optimal stopping problem with constraints for a Markov chain with general state space by using the convex analytic approach. The costs are assumed to be nonnegative. Our model is not assumed to be transient or absorbing and the stopping time does not necessarily have a finite expectation. As a consequence, the occupation measure is not necessarily finite, which poses some difficulties in the analysis of the associated linear program. Under a very weak hypothesis, it is shown that the linear problem admits an optimal solution, guaranteeing the existence of an optimal stopping strategy for the optimal stopping problem with constraints.

The limiting behavior of the probability of extinction of critical generation-dependent branching processes is determined. Lower bounds are determined for this probability. A means of classifying these branching processes is suggested.

We provide upper and lower bounds for the mean $\mathscr{M}(H)$ of $\sup_{t\geq 0} \{B_H(t) - t\}$ , with $B_H(\!\cdot\!)$ a zero-mean, variance-normalized version of fractional Brownian motion with Hurst parameter $H\in(0,1)$ . We find bounds in (semi-) closed form, distinguishing between $H\in(0,\frac{1}{2}]$ and $H\in[\frac{1}{2},1)$ , where in the former regime a numerical procedure is presented that drastically reduces the upper bound. For $H\in(0,\frac{1}{2}]$ , the ratio between the upper and lower bound is bounded, whereas for $H\in[\frac{1}{2},1)$ the derived upper and lower bound have a strongly similar shape. We also derive a new upper bound for the mean of $\sup_{t\in[0,1]} B_H(t)$ , $H\in(0,\frac{1}{2}]$ , which is tight around $H=\frac{1}{2}$ .

The classical exponential smoothing procedure to be applied to a sequence of observations is modified into some adaptive variants and also generalized to the recursive scheme

This means that given the history of observations and smoothed values up to time n, the updated smoothed value Wn +1 is given by a function u of Wn and Xn, which satisfies only certain structural properties. We study these procedures within the framework of random systems with complete connections and exploit results from Markov process theory to study the sequence . A broad class of ‘smoothing functions' u, which induce sequences with nice statistical properties, is presented. A method to estimate the limit of the expected smoothed values is also developed.,

Using Stein's method, we derive explicit upper bounds on the total variation distance between a Poisson-binomial law (the distribution of a sum of independent but not necessarily identically distributed Bernoulli random variables) and a Pólya distribution with the same support, mean, and variance; a nonuniform bound on the pointwise distance between the probability mass functions is also given. A numerical comparison of alternative distributional approximations on a somewhat representative collection of case studies is also exhibited. The evidence proves that no single one is uniformly most accurate, though it suggests that the Pólya approximation might be preferred in several parameter domains encountered in practice.

With (Qt)t denoting the stationary workload process in a queue fed by a Lévy input process (Xt)t, this paper focuses on the asymptotics of rare event probabilities of the type P(Q0 > pB, QTB > qB) for given positive numbers p and q, and a positive deterministic function TB. We first identify conditions under which the probability of interest is dominated by the ‘most demanding event’, in the sense that it is asymptotically equivalent to P(Q > max{p, q}B) for large B, where Q denotes the steady-state workload. These conditions essentially reduce to TB being sublinear (i.e. TB/B → 0 as B → ∞). A second condition is derived under which the probability of interest essentially ‘decouples’, in that it is asymptotically equivalent to P(Q > pB)P(Q > qB) for large B. For various models considered in the literature, this ‘decoupling condition’ reduces to requiring that TB is superlinear (i.e. TB / B → ∞ as B → ∞). This is not true for certain ‘heavy-tailed’ cases, for instance, the situations in which the Lévy input process corresponds to an α-stable process, or to a compound Poisson process with regularly varying job sizes, in which the ‘decoupling condition’ reduces to TB / B2 → ∞. For these input processes, we also establish the asymptotics of the probability under consideration for TB increasing superlinearly but subquadratically. We pay special attention to the case TB = RB for some R > 0; for light-tailed input, we derive intuitively appealing asymptotics, intensively relying on sample path large deviations results. The regimes obtained can be interpreted in terms of the most likely paths to overflow.

We propose a two-urn model of Pólya type as follows. There are two urns, urn A and urn B. At the beginning, urn A contains rA red and wA white balls and urn B contains rB red and wB white balls. We first draw m balls from urn A and note their colors, say i red and m - i white balls. The balls are returned to urn A and bi red and b(m - i) white balls are added to urn B. Next, we draw ℓ balls from urn B and note their colors, say j red and ℓ - j white balls. The balls are returned to urn B and aj red and a(ℓ - j) white balls are added to urn A. Repeat the above action n times and let Xn be the fraction of red balls in urn A and Yn the fraction of red balls in urn B. We first show that the expectations of Xn and Yn have the same limit, and then use martingale theory to show that Xn and Yn converge almost surely to the same limit.

We consider the problem of optimally stopping a general one-dimensional Itô diffusion X. In particular, we solve the problem that aims at maximising the performance criterion Ex[exp(-∫0τr(Xs)ds)f(Xτ)] over all stopping times τ, where the reward function f can take only a finite number of values and has a ‘staircase’ form. This problem is partly motivated by applications to financial asset pricing. Our results are of an explicit analytic nature and completely characterise the optimal stopping time. Also, it turns out that the problem's value function is not C1, which is due to the fact that the reward function f is not continuous.