We construct a simple example, surely known to Harry Kesten, of an R-transient Markov chain on a countable state space S ∪ {δ}, where δ is absorbing. The transition matrix K on S is irreducible and strictly substochastic. We determine the Yaglom limit, that is, the limiting conditional behavior given nonabsorption. Each starting state x ∈ S results in a different Yaglom limit. Each Yaglom limit is an R-1-invariant quasi-stationary distribution, where R is the convergence parameter of K. Yaglom limits that depend on the starting state are related to a nontrivial R-1-Martin boundary.

Let X := X n ∪ {(0, 0), (1, 0)}, where X n is a planar Poisson point process of intensity n. We provide a first nontrivial lower bound for the distance between the expected length of the shortest path between (0, 0) and (1, 0) in the Delaunay triangulation associated with X when the intensity of X n goes to ∞. Simulations indicate that the correct value is about 1.04. We also prove that the expected length of the so-called upper path converges to 35 / 3π2, yielding an upper bound for the expected length of the smallest path.

Let X and Y be two independent and nonnegative random variables with corresponding distributions F and G. Denote by H the distribution of the product XY, called the product convolution of F and G. Cline and Samorodnitsky (1994) proposed sufficient conditions for H to be subexponential, given the subexponentiality of F. Relying on a related result of Tang (2008) on the long-tail of the product convolution, we obtain a necessary and sufficient condition for the subexponentiality of H, given that of F. We also study the reverse problem and obtain sufficient conditions for the subexponentiality of F, given that of H. Finally, we apply the obtained results to the asymptotic study of the ruin probability in a discrete-time insurance risk model with stochastic returns.

We formulate and prove a shape theorem for a continuous-time continuous-space stochastic growth model under certain general conditions. Similar to the classical lattice growth models, the proof makes use of the subadditive ergodic theorem. A precise expression for the speed of propagation is given in the case of a truncated free-branching birth rate.

In this paper we investigate gradient estimation for a class of contracting stochastic systems on a continuous state space. We find conditions on the one-step transitions, namely differentiability and contraction in a Wasserstein distance, that guarantee differentiability of stationary costs. Then we show how to estimate the derivatives, deriving an estimator that can be seen as a generalization of the forward sensitivity analysis method used in deterministic systems. We apply the results to examples, including a neural network model.

We consider a finite-time optimal consumption problem where an investor wants to maximize the expected hyperbolic absolute risk aversion utility of consumption and terminal wealth. We treat a stochastic factor model in which the mean returns of risky assets depend linearly on underlying economic factors formulated as the solutions of linear stochastic differential equations. We discuss the partial information case in which the investor cannot observe the factor process and uses only past information of risky assets. Then our problem is formulated as a stochastic control problem with partial information. We derive the Hamilton–Jacobi–Bellman equation. We solve this equation to obtain an explicit form of the value function and the optimal strategy for this problem. Moreover, we also introduce the results obtained by the martingale method.

A prevalent problem in general state-space models is the approximation of the smoothing distribution of a state conditional on the observations from the past, the present, and the future. The aim of this paper is to provide a rigorous analysis of such approximations of smoothed distributions provided by the two-filter algorithms. We extend the results available for the approximation of smoothing distributions to these two-filter approaches which combine a forward filter approximating the filtering distributions with a backward information filter approximating a quantity proportional to the posterior distribution of the state, given future observations.

In this paper we study the quasi-stationary behavior of absorbed one-dimensional diffusions. We obtain necessary and sufficient conditions for the exponential convergence to a unique quasi-stationary distribution in total variation, uniformly with respect to the initial distribution. An important tool is provided by one-dimensional strict local martingale diffusions coming down from infinity. We prove, under mild assumptions, that their expectation at any positive time is uniformly bounded with respect to the initial position. We provide several examples and extensions, including the sticky Brownian motion and some one-dimensional processes with jumps.

This work concerns Markov decision chains on a finite state space. The decision-maker has a constant and nonnull risk sensitivity coefficient, and the performance of a control policy is measured by two different indices, namely, the discounted and average criteria. Motivated by well-known results for the risk-neutral case, the problem of approximating the optimal risk-sensitive average cost in terms of the optimal risk-sensitive discounted value functions is addressed. Under suitable communication assumptions, it is shown that, as the discount factor increases to 1, appropriate normalizations of the optimal discounted value functions converge to the optimal average cost, and to the functional part of the solution of the risk-sensitive average cost optimality equation.

The continuum random cluster model is a Gibbs modification of the standard Boolean model with intensity z > 0 and law of radii Q. The formal unnormalised density is given by q N cc , where q is a fixed parameter and N cc is the number of connected components in the random structure. We prove for a large class of parameters that percolation occurs for large enough z and does not occur for small enough z. We provide an application to the phase transition of the Widom–Rowlinson model with random radii. Our main tools are stochastic domination properties, a detailed study of the interaction of the model, and a Fortuin–Kasteleyn representation.

The largest components of the critical Erdős–Rényi graph, G(n, p) with p = 1 / n, have size of order n2/3 with high probability. We give detailed asymptotics for the probability that there is an unusually large component, i.e. of size an2/3 for large a. Our results, which extend the work of Pittel (2001), allow a to depend upon n and also hold for a range of values of p around 1 / n. We also provide asymptotics for the distribution of the size of the component containing a particular vertex.

We consider a family of directed exponential random graph models parametrized by edges and outward stars. Much of the important statistical content of such models is given by the normalization constant of the models, and, in particular, an appropriately scaled limit of the normalization, which is called the free energy. We derive precise asymptotics for the normalization constant for finite graphs. We use this to derive a formula for the free energy. The limit is analytic everywhere except along a curve corresponding to a first-order phase transition. We examine unusual behavior of the model along the phase transition curve.

We consider a special version of random sequential adsorption (RSA) with nearest-neighbor interaction on infinite tree graphs. In classical RSA, starting with a graph with initially inactive nodes, each of the nodes of the graph is inspected in a random order and is irreversibly activated if none of its nearest neighbors are active yet. We generalize this nearest-neighbor blocking effect to a degree-dependent threshold-based blocking effect. That is, each node of the graph is assumed to have its own degree-dependent threshold and if, upon inspection of a node, the number of active direct neighbors is less than that node's threshold, the node will become irreversibly active. We analyze the activation probability of nodes on an infinite tree graph, given the degree distribution of the tree and the degree-dependent thresholds. We also show how to calculate the correlation between the activity of nodes as a function of their distance. Finally, we propose an algorithm which can be used to solve the inverse problem of determining how to set the degree-dependent thresholds in infinite tree graphs in order to reach some desired activation probabilities.