The aim of the present paper is to introduce some techniques, based on the change of variable formula for processes of finite variation, for establishing (integro) differential equations for evaluating the distribution of jump processes for a fixed period of time. This is of interest in insurance mathematics for evaluating the distribution of the total amount of claims occurred over some period of time, and attention will be given to such issues. Firstly we will study some techniques when the process has independent increments, and then a more refined martingale technique is discussed. The building blocks are delivered by the theory of marked point processes and associated martingale theory. A simple numerical example is given.

The probability distributions of the size and the duration of simple stochastic epidemic models are well known. However, in most instances, the solutions are too complicated to be of practical use. In this note, interarrival times of the infectives are utilized to study asymptotic distributions of the duration of the epidemic for a class of simple epidemic models. A brief summary of the results on simple epidemic models in terms of interarrival times is included.

In the study of null-persistent Markov chains the sequence plays an important role. (See for example, Orey (1971), Athreya and Ney (1980).) In this paper we consider the rate of growth of UN to ∞ as N → ∞. This rate of growth is related to the rate of growth of as N → ∞ and also to the rate at which as n → ∞.

An application of the generating function to genetics has provided the probability distribution of homozygotes obtained by self-fertilization, in the case of two linked genetic loci. The individual probabilities are functions of the frequency of genetic recombination between the two loci.

The existence of a weak limit birth-and-death process on the natural integers for the simple birth-and-death process conditional on non-extinction up to time t as t→∞ is proved. Starting from the latter a new weak limiting procedure yields a diffusion Markov process on the positive infinite semi-axis.

Martingales constitute a basic tool in stochastic analysis; this paper considers their application to counting processes. We use this tool to revisit a renewal theorem and give extensions for various counting processes. We first consider a renewal process as a pilot example, deriving a new semimartingale representation that differs from the standard decomposition via the stochastic intensity function. We then revisit Blackwell’s renewal theorem, its refinements and extensions. Based on these observations, we extend the semimartingale representation to a general counting process, and give conditions under which asymptotic behaviour similar to Blackwell’s renewal theorem holds.

Suppose k balls are dropped into n boxes independently with uniform probability, where n, k are large with ratio approximately equal to some positive real $\lambda$ . The maximum box count has a counterintuitive behavior: first of all, with high probability it takes at most two values $m_n$ or $m_n+1$ , where $m_n$ is roughly $\frac{\ln n}{\ln \ln n}$ . Moreover, it oscillates between these two values with an unusual periodicity. In order to prove this statement and various generalizations, it is first shown that for $X_1,\ldots,X_n$ independent and identically distributed discrete random variables with common distribution F, under mild conditions, the limiting distribution of their maximum oscillates in three possible families, depending on the tail of the distribution. The result stated at the beginning follows from the ensemble equivalence for the order statistics in various allocations problems, obtained via conditioning limit theory. Results about the number of ties for the maximum, as well as applications, are also provided.

The Bruss–Robertson–Steele (BRS) inequality bounds the expected number of items of random size which can be packed into a given suitcase. Remarkably, no independence assumptions are needed on the random sizes, which points to a simple explanation; the inequality is the integrated form of an $\omega$-by-$\omega$ inequality, as this note proves.

Environmental stress screening (ESS) of manufactured items is used to reduce the occurrence of future failures that are caused by latent defects by eliminating the items with these defects. Some practical descriptions of the relevant ESS procedures can be found in the literature; however, the appropriate stochastic modeling and the corresponding thorough analysis have not been reported. In this paper we develop a stochastic model for the ESS, analyze the effect of this operation on the population characteristics of the screened items, and also consider the relevant optimization issues.

We consider the distribution of the age of an individual picked uniformly at random at some fixed time in a linear birth-and-death process. By exploiting a bijection between the birth-and-death tree and a contour process, we derive the cumulative distribution function for this distribution. In the critical and supercritical cases, we also give rates for the convergence in terms of the total variation and other metrics towards the appropriate exponential distribution.

Let $\{X_n\}_{n\in{\mathbb{N}}}$ be an ${\mathbb{X}}$-valued iterated function system (IFS) of Lipschitz maps defined as $X_0 \in {\mathbb{X}}$ and for $n\geq 1$, $X_n\;:\!=\;F(X_{n-1},\vartheta_n)$, where $\{\vartheta_n\}_{n \ge 1}$ are independent and identically distributed random variables with common probability distribution $\mathfrak{p}$, $F(\cdot,\cdot)$ is Lipschitz continuous in the first variable, and $X_0$ is independent of $\{\vartheta_n\}_{n \ge 1}$. Under parametric perturbation of both F and $\mathfrak{p}$, we are interested in the robustness of the V-geometrical ergodicity property of $\{X_n\}_{n\in{\mathbb{N}}}$, of its invariant probability measure, and finally of the probability distribution of $X_n$. Specifically, we propose a pattern of assumptions for studying such robustness properties for an IFS. This pattern is implemented for the autoregressive processes with autoregressive conditional heteroscedastic errors, and for IFS under roundoff error or under thresholding/truncation. Moreover, we provide a general set of assumptions covering the classical Feller-type hypotheses for an IFS to be a V-geometrical ergodic process. An accurate bound for the rate of convergence is also provided.

A family $\{Q_{\beta}\}_{\beta \geq 0}$ of Markov chains is said to exhibit metastable mixing with modes$S_{\beta}^{(1)},\ldots,S_{\beta}^{(k)}$ if its spectral gap (or some other mixing property) is very close to the worst conductance $\min\!\big(\Phi_{\beta}\big(S_{\beta}^{(1)}\big), \ldots, \Phi_{\beta}\big(S_{\beta}^{(k)}\big)\big)$ of its modes for all large values of $\beta$. We give simple sufficient conditions for a family of Markov chains to exhibit metastability in this sense, and verify that these conditions hold for a prototypical Metropolis–Hastings chain targeting a mixture distribution. The existing metastability literature is large, and our present work is aimed at filling the following small gap: finding sufficient conditions for metastability that are easy to verify for typical examples from statistics using well-studied methods, while at the same time giving an asymptotically exact formula for the spectral gap (rather than a bound that can be very far from sharp). Our bounds from this paper are used in a companion paper (O. Mangoubi, N. S. Pillai, and A. Smith, arXiv:1808.03230) to compare the mixing times of the Hamiltonian Monte Carlo algorithm and a random walk algorithm for multimodal target distributions.

While max-stable processes are typically written as pointwise maxima over an infinite number of stochastic processes, in this paper, we consider a family of representations based on ℓp-norms. This family includes both the construction of the Reich–Shaby model and the classical spectral representation by de Haan (1984) as special cases. As the representation of a max-stable process is not unique, we present formulae to switch between different equivalent representations. We further provide a necessary and sufficient condition for the existence of an ℓp-norm-based representation in terms of the stable tail dependence function of a max-stable process. Finally, we discuss several properties of the represented processes such as ergodicity or mixing.

We consider a birth–death process with killing where transitions from state i may go to either state $i-1$ or state $i+1$ or an absorbing state (killing). Stochastic ordering results on the killing time are derived. In particular, if the killing rate in state i is monotone in i, then the distribution of the killing time with initial state i is stochastically monotone in i. This result is a consequence of the following one for a non-negative tri-diagonal matrix M: if the row sums of M are monotone, so are the row sums of $M^n$ for all $n\ge 2$ .

We consider a strictly substochastic matrix or a stochastic matrix with absorbing states. By using quasi-stationary distributions we show that there is an associated canonical Markov chain that is built from the resurrected chain, the absorbing states, and the hitting times, together with a random walk on the absorbing states, which is necessary for achieving time stationarity. Based upon the 2-stringing representation of the resurrected chain, we supply a stationary representation of the killed and the absorbed chains. The entropies of these representations have a clear meaning when one identifies the probability measure of natural factors. The balance between the entropies of these representations and the entropy of the canonical chain serves to check the correctness of the whole construction.

In this paper we integrate two strands of the literature on stability of general state Markov chains: conventional, total-variation-based results and more recent order-theoretic results. First we introduce a complete metric over Borel probability measures based on ‘partial’ stochastic dominance. We then show that many conventional results framed in the setting of total variation distance have natural generalizations to the partially ordered setting when this metric is adopted.

We consider decision problems with arbitrary action spaces, deterministic transitions, and infinite time horizon. In the usual setup when probability measures are countably additive, a general version of Kuhn’s theorem implies under fairly general conditions that for every mixed strategy of the decision maker there exists an equivalent behavior strategy. We examine to what extent this remains valid when probability measures are only assumed to be finitely additive. Under the classical approach of Dubins and Savage (2014), we prove the following statements: (1) If the action space is finite, every mixed strategy has an equivalent behavior strategy. (2) Even if the action space is infinite, at least one optimal mixed strategy has an equivalent behavior strategy. The approach by Dubins and Savage turns out to be essentially maximal: these two statements are no longer valid if we take any extension of their approach that considers all singleton plays.

Individuals arrive at a geographical area that is initially empty, in accordance with a pure birth process with birth parameters λj = jλ + θ, j ≧ 0. Due to contamination, this geographical area is unsafe for its population and at some fixed time T in the future everyone in the area will be evacuated and no further immigration will be allowed.

Suppose now than an intermediate evacuation time τ, 0 ≦ τ ≦ T, at which time everyone present in the area would be evacuated, is to be chosen. The area would then again fill up with individuals between times τ and T, and, at T, the final evacuation would be made and the area would be permanently sealed off. The problem is to choose τ so as to minimise the total expected cost incurred by time T, where a cost g(x) is incurred for each individual that spends a time x in the area.