We prove the conjecture formulated in Litvak and Ejov (2009), namely, that the trace of the fundamental matrix of a singularly perturbed Markov chain that corresponds to a stochastic policy feasible for a given graph is minimised at policies corresponding to Hamiltonian cycles.

Continuous-time Markov chains are a widely used modelling tool. Applications include DNA sequence evolution, ion channel gating behaviour, and mathematical finance. We consider the problem of calculating properties of summary statistics (e.g. mean time spent in a state, mean number of jumps between two states, and the distribution of the total number of jumps) for discretely observed continuous-time Markov chains. Three alternative methods for calculating properties of summary statistics are described and the pros and cons of the methods are discussed. The methods are based on (i) an eigenvalue decomposition of the rate matrix, (ii) the uniformization method, and (iii) integrals of matrix exponentials. In particular, we develop a framework that allows for analyses of rather general summary statistics using the uniformization method.

In this paper we are interested in bounding or calculating the additive functionals of the first return time on a set for discrete-time Markov chains on a countable state space, which is motivated by investigating ergodic theory and central limit theorems. To do so, we introduce the theory of the minimal nonnegative solution. This theory combined with some other techniques is proved useful for investigating the additive functionals. This method is used to study the functionals for discrete-time birth-death processes, and the polynomial convergence and a central limit theorem are derived.

We study the shape of the probability mass function of the Markov binomial distribution, and give necessary and sufficient conditions for the probability mass function to be unimodal, bimodal, or trimodal. These are useful to analyze the double-peaking results of a reactive transport model from the engineering literature. Moreover, we give a closed-form expression for the variance of the Markov binomial distribution, and expressions for the mean and the variance conditioned on the state at time n.

Sequential decision problems can often be modeled as Markov decision processes. Classical solution approaches assume that the parameters of the model are known. However, model parameters are usually estimated and uncertain in practice. As a result, managers are often interested in how estimation errors affect the optimal solution. In this paper we illustrate how sensitivity analysis can be performed directly for a Markov decision process with uncertain reward parameters using the Bellman equations. In particular, we consider problems involving (i) a single stationary parameter, (ii) multiple stationary parameters, and (iii) multiple nonstationary parameters. We illustrate the applicability of this work through a capacitated stochastic lot-sizing problem.

Enhanced by the global financial crisis, the discussion about an accurate estimation of regulatory (risk) capital a financial institution needs to hold in order to safeguard against unexpected losses has become highly relevant again. The presence of heavy tails in combination with small sample sizes turns estimation at such extreme quantile levels into an inherently difficult statistical issue. We discuss some of the problems and pitfalls that may arise. In particular, based on the framework of second-order extended regular variation, we compare different high-quantile estimators and propose methods for the improvement of standard methods by focusing on the concept of penultimate approximations.

In this paper we analyze the so-called Parisian ruin probability, which arises when the surplus process stays below 0 longer than a fixed amount of time ζ > 0. We focus on a general spectrally negative Lévy insurance risk process. For this class of processes, we derive an expression for the ruin probability in terms of quantities that can be calculated explicitly in many models. We find its Cramér-type and convolution-equivalent asymptotics when reserves tend to ∞. Finally, we analyze some explicit examples.

We study the leading term in the small-time asymptotics of at-the-money call option prices when the stock price process S follows a general martingale. This is equivalent to studying the first centered absolute moment of S. We show that if S has a continuous part, the leading term is of order √T in time T and depends only on the initial value of the volatility. Furthermore, the term is linear in T if and only if S is of finite variation. The leading terms for pure-jump processes with infinite variation are between these two cases; we obtain their exact form for stable-like small jumps. To derive these results, we use a natural approximation of S so that calculations are necessary only for the class of Lévy processes.

We derive an expansion for the (expected) difference between the continuously monitored supremum and evenly monitored discrete maximum over a finite time horizon of a jump diffusion process with independent and identically distributed normal jump sizes. The monitoring error is of the form a 0 / N 1/2 + a 1 / N 3/2 + · · · + b 1 / N + b 2 / N 2 + b 4 / N 4 + · · ·, where N is the number of monitoring intervals. We obtain explicit expressions for the coefficients {a 0, a 1, …, b 1, b 2, …}. In particular, a 0 is proportional to the value of the Riemann zeta function at ½, a well-known fact that has been observed for Brownian motion in applied probability and mathematical finance.

Consider a discrete-time insurance risk model. Within period i, the net insurance loss is denoted by a real-valued random variable X i . The insurer makes both risk-free and risky investments, leading to an overall stochastic discount factor Y i from time i to time i − 1. Assume that (X i , Y i ), i ∈ N, form a sequence of independent and identically distributed random pairs following a common bivariate Farlie-Gumbel-Morgenstern distribution with marginal distribution functions F and G. When F is subexponential and G fulfills some constraints in order for the product convolution of F and G to be subexponential too, we derive a general asymptotic formula for the finite-time ruin probability. Then, for special cases in which F belongs to the Fréchet or Weibull maximum domain of attraction, we improve this general formula to be transparent.

We give an efficient method based on minimal deterministic finite automata for computing the exact distribution of the number of occurrences and coverage of clumps (maximal sets of overlapping words) of a collection of words. In addition, we compute probabilities for the number of h-clumps, word groupings where gaps of a maximal length h between occurrences of words are allowed. The method facilitates the computation of p-values for testing procedures. A word is allowed to contain other words of the collection, making the computation more general, but also more difficult. The underlying sequence is assumed to be Markovian of an arbitrary order.

Limit theorems are established for some functionals of the distances between two nodes in weighted random b-ary recursive trees. We consider the depth of the nth node and of a random node, the distance between two random nodes, the internal path length, and the Wiener index. As an application, these limit results imply, by an imbedding argument, corresponding limit theorems for further classes of random trees: plane-oriented recursive trees and random linear recursive trees.

This paper presents an analysis of a generalized version of the coupon collector problem, in which the collector receives d coupons each run and chooses the least-collected coupon so far. In the asymptotic case when the number of coupons n goes to infinity, we show that, on average, (nlogn) / d + (n / d)(m − 1)log logn + O(mn) runs are needed to collect m sets of coupons. An exact algorithm is also developed for any finite case to compute the exact mean number of runs. Numerical examples are provided to verify our theoretical predictions.

Let x denote a vector of length q consisting of 0s and 1s. It can be interpreted as an ‘opinion’ comprised of a particular set of responses to a questionnaire consisting of q questions, each having {0, 1}-valued answers. Suppose that the questionnaire is answered by n individuals, thus providing n ‘opinions’. Probabilities of the answer 1 to each question can be, basically, arbitrary and different for different questions. Out of the 2q different opinions, what number, μn , would one expect to see in the sample? How many of these opinions, μn (k), will occur exactly k times? In this paper we give an asymptotic expression for μn / 2q and the limit for the ratios μn (k)/μn , when the number of questions q increases along with the sample size n so that n = λ2q , where λ is a constant. Let p(x ) denote the probability of opinion x . The key step in proving the asymptotic results as indicated is the asymptotic analysis of the joint behaviour of the intensities np(x ). For example, one of our results states that, under certain natural conditions, for any z > 0, ∑1 {np( x) > z} = d n z −u ,d n = o(2q ).

We consider sequential selection of an alternating subsequence from a sequence of independent, identically distributed, continuous random variables, and we determine the exact asymptotic behavior of an optimal sequentially selected subsequence. Moreover, we find (in a sense we make precise) that a person who is constrained to make sequential selections does only about 12 percent worse than a person who can make selections with full knowledge of the random sequence.

We consider the Λ-coalescent processes with a positive frequency of singleton clusters. The class in focus covers, for instance, the beta(a, b)-coalescents with a > 1. We show that some large-sample properties of these processes can be derived by coupling the coalescent with an increasing Lévy process (subordinator), and by exploiting parallels with the theory of regenerative composition structures. In particular, we discuss the limit distributions of the absorption time and the number of collisions.

Consider an independent site percolation model on Z d , with parameter p ∈ (0, 1), where all long-range connections in the axis directions are allowed. In this work we show that, given any parameter p, there exists an integer K(p) such that all binary sequences (words) ξ ∈ {0, 1} N can be seen simultaneously, almost surely, even if all connections with length larger than K(p) are suppressed. We also show some results concerning how K(p) should scale with p as p goes to 0. Related results are also obtained for the question of whether or not almost all words are seen.

We derive asymptotic properties for a stochastic dynamic network model in a stochastic dynamic population. In the model, nodes give birth to new nodes until they die, each node being equipped with a social index given at birth. During the life of a node it creates edges to other nodes, nodes with high social index at higher rate, and edges disappear randomly in time. For this model, we derive a criterion for when a giant connected component exists after the process has evolved for a long period of time, assuming that the node population grows to infinity. We also obtain an explicit expression for the degree correlation ρ (of neighbouring nodes) which shows that ρ is always positive irrespective of parameter values in one of the two treated submodels, and may be either positive or negative in the other model, depending on the parameters.

In this paper we provide some sufficient conditions to stochastically compare linear combinations of independent random variables. The main results extend those given in Proschan (1965), Ma (1998), Zhao et al. (2011), and Yu (2011). In particular, we propose a new sufficient condition to compare the peakedness of linear combinations of independent random variables which may have heavy-tailed properties.

We investigate the Zagreb index, one of the topological indices, of random recursive trees in this paper. Through a recurrence equation, the first two moments of Z n , the Zagreb index of a random recursive tree of size n, are obtained. We also show that the random process {Z n − E[Z n ], n ≥ 1} is a martingale. Then the asymptotic normality of the Zagreb index of a random recursive tree is given by an application of the martingale central limit theorem. Finally, two other topological indices are also discussed in passing.