We exhibit an exact simulation algorithm for the supremum of a stable process over a finite time interval using dominated coupling from the past (DCFTP). We establish a novel perpetuity equation for the supremum (via the representation of the concave majorants of Lévy processes [27]) and use it to construct a Markov chain in the DCFTP algorithm. We prove that the number of steps taken backwards in time before the coalescence is detected is finite. We analyse the performance of the algorithm numerically (the code, written in Julia 1.0, is available on GitHub).

There are two ways of speeding up Markov chain Monte Carlo algorithms: (a) construct more complex samplers that use gradient and higher-order information about the target and (b) design a control variate to reduce the asymptotic variance. While the efficiency of (a) as a function of dimension has been studied extensively, this paper provides the first results linking the efficiency of (b) with dimension. Specifically, we construct a control variate for a d-dimensional random walk Metropolis chain with an independent, identically distributed target using the solution of the Poisson equation for the scaling limit in [30]. We prove that the asymptotic variance of the corresponding estimator is bounded above by a multiple of $\log(d)/d$ over the spectral gap of the chain. The proof hinges on large deviations theory, optimal Young’s inequality and Berry–Esseen-type bounds. Extensions of the result to non-product targets are discussed.

Using a result of Blanchet and Wallwater (2015) for exactly simulating the maximum of a negative drift random walk queue endowed with independent and identically distributed (i.i.d.) increments, we extend it to a multi-dimensional setting and then we give a new algorithm for simulating exactly the stationary distribution of a first-in–first-out (FIFO) multi-server queue in which the arrival process is a general renewal process and the service times are i.i.d.: the FIFO GI/GI/c queue with $ 2 \leq c \lt \infty$ . Our method utilizes dominated coupling from the past (DCFP) as well as the random assignment (RA) discipline, and complements the earlier work in which Poisson arrivals were assumed, such as the recent work of Connor and Kendall (2015). We also consider the models in continuous time, and show that with mild further assumptions, the exact simulation of those stationary distributions can also be achieved. We also give, using our FIFO algorithm, a new exact simulation algorithm for the stationary distribution of the infinite server case, the GI/GI/ $\infty$ model. Finally, we even show how to handle fork–join queues, in which each arriving customer brings c jobs, one for each server.

We consider a two-player zero-sum stochastic differential game with a random planning horizon and diffusive state variable dynamics. The random planning horizon is a function of a non-negative continuous random variable, which is assumed to be independent of the Brownian motion driving the state variable dynamics. We study this game using a combination of dynamic programming and viscosity solution techniques. Under some mild assumptions, we prove that the value of the game exists and is the unique viscosity solution of a certain nonlinear partial differential equation of Hamilton–Jacobi–Bellman–Isaacs type.

We study an urn process with two urns, initialized with a ball each. Balls are added sequentially, the urn being chosen independently with probability proportional to the $\alpha$th power $(\alpha >1)$ of the existing number of balls. We study the (rare) event that the urn compositions are balanced after the addition of $2n-2$ new balls. We derive precise asymptotics of the probability of this event by embedding the process in continuous time. Quite surprisingly, fine control of this probability may be leveraged to derive a lower-tail large deviation principle (LDP) for $L = \sum_{i=1}^{n} ({S_i^2}/{i^2})$, where $\{S_n \colon n \geq 0\}$ is a simple symmetric random walk started at zero. We provide an alternative proof of the LDP via coupling to Brownian motion, and subsequent derivation of the LDP for a continuous-time analog of L. Finally, we turn our attention back to the urn process conditioned to be balanced, and provide a functional limit law describing the trajectory of the urn process.

We provide a sufficient condition for the uniqueness in distribution of Gibbs point processes with non-negative pairwise interaction, together with convergent expansions of the log-Laplace functional, factorial moment densities and factorial cumulant densities (correlation functions and truncated correlation functions). The criterion is a continuum version of a convergence condition by Fernández and Procacci (2007), the proof is based on the Kirkwood–Salsburg integral equations and is close in spirit to the approach by Bissacot, Fernández, and Procacci (2010). In addition, we provide formulas for cumulants of double stochastic integrals with respect to Poisson random measures (not compensated) in terms of multigraphs and pairs of partitions, explaining how to go from cluster expansions to some diagrammatic expansions (Peccati and Taqqu, 2011). We also discuss relations with generating functions for trees, branching processes, Boolean percolation and the random connection model. The presentation is self-contained and requires no preliminary knowledge of cluster expansions.

In this paper, we study a large multi-server loss model under the SQ(d) routeing scheme when the service time distributions are general with finite mean. Previous works have addressed the exponential service time case when the number of servers goes to infinity, giving rise to a mean field model. The fixed point of the limiting mean field equations (MFEs) was seen to be insensitive to the service time distribution in simulations, but no proof was available. While insensitivity is well known for loss systems, the models, even with state-dependent inputs, belong to the class of linear Markov models. In the context of SQ(d) routeing, the resulting model belongs to the class of nonlinear Markov processes (processes whose generator itself depends on the distribution) for which traditional arguments do not directly apply. Showing insensitivity to the general service time distributions has thus remained an open problem. Obtaining the MFEs in this case poses a challenge due to the resulting Markov description of the system being in positive orthant as opposed to a finite chain in the exponential case. In this paper, we first obtain the MFEs and then show that the MFEs have a unique fixed point that coincides with the fixed point in the exponential case, thus establishing insensitivity. The approach is via a measure-valued Markov process representation and the martingale problem to establish the mean field limit.

We examine necessary and sufficient conditions for recurrence and positive recurrence of a class of irreducible, level-dependent quasi-birth-and-death (LDQBD) processes with a block tridiagonal structure that exhibits asymptotic convergence in the rows as the level tends to infinity. These conditions are obtained by exploiting a multi-dimensional Lyapunov drift approach, along with the theory of generalized Markov group inverses. Additionally, we highlight analogies to well-known average drift results for level-independent quasi-birth-and-death (QBD) processes.

In this paper, we introduce a new large family of Lévy-driven point processes with (and without) contagion, by generalising the classical self-exciting Hawkes process and doubly stochastic Poisson processes with non-Gaussian Lévy-driven Ornstein–Uhlenbeck-type intensities. The resulting framework may possess many desirable features such as skewness, leptokurtosis, mean-reverting dynamics, and more importantly, the ‘contagion’ or feedback effects, which could be very useful for modelling event arrivals in finance, economics, insurance, and many other fields. We characterise the distributional properties of this new class of point processes and develop an efficient sampling method for generating sample paths exactly. Our simulation scheme is mainly based on the distributional decomposition of the point process and its intensity process. Extensive numerical implementations and tests are reported to demonstrate the accuracy and effectiveness of our scheme. Moreover, we use portfolio risk management as an example to show the applicability and flexibility of our algorithms.

We consider de Finetti’s problem for spectrally one-sided Lévy risk models with control strategies that are absolutely continuous with respect to the Lebesgue measure. Furthermore, we consider the version with a constraint on the time of ruin. To characterize the solution to the aforementioned models, we first solve the optimal dividend problem with a terminal value at ruin and show the optimality of threshold strategies. Next, we introduce the dual Lagrangian problem and show that the complementary slackness conditions are satisfied, characterizing the optimal Lagrange multiplier. Finally, we illustrate our findings with a series of numerical examples.

We consider the nearest-neighbour simple exclusion process on the one-dimensional discrete torus $\mathbb{T}_N=\mathbb{Z}/N\mathbb{Z}$ , with random rates $c_N=\{c_{x,N}\colon x \in \mathbb{T}_N\}$ defined in terms of a homogeneous Poisson process on $\mathbb{R}$ with intensity $\lambda$ . Given a realization of the Poisson process, the jump rate along the edge $\{x,x+1\}$ is 1 if there is not any Poisson mark in $ (x,x+1) $ ; otherwise, it is $\lambda/N,\, \lambda \in( 0,1]$ . The density profile of this process with initial measure associated to an initial profile $\rho_0\colon \mathbb{R} \rightarrow [0,1]$ , evolves as the solution of a bounded diffusion random equation. This result follows from an appropriate quenched hydrodynamic limit. If $\lambda=1$ then $\rho$ is discontinuous at each Poisson mark with passage through the slow bonds, otherwise the conductance at the slow bonds decreases meaning no passage through the slow bonds in the continuum. The main results are concerned with upper and lower quenched and annealed bounds of $T_j$ , where $T_j$ is the first displacement time of a tagged particle in a stochastic cluster of size j (the cluster is defined via specific macroscopic density profiles). It is possible to observe that when time t grows, then $\mathbb{P}\{T_j \geq t\}$ decays quadratically in both the upper and lower bounds, and falls as slow as the presence of more Poisson marks neighbouring the tagged particle, as expected.

We propose an asymptotically optimal heuristic, which we term randomized assignment control (RAC) for a restless multi-armed bandit problem with discrete-time and finite states. It is constructed using a linear programming relaxation of the original stochastic control formulation. In contrast to most of the existing literature, we consider a finite-horizon problem with multiple actions and time-dependent (i.e. nonstationary) upper bound on the number of bandits that can be activated at each time period; indeed, our analysis can also be applied in the setting with nonstationary transition matrix and nonstationary cost function. The asymptotic setting is obtained by letting the number of bandits and other related parameters grow to infinity. Our main contribution is that the asymptotic optimality of RAC in this general setting does not require indexability properties or the usual stability conditions of the underlying Markov chain (e.g. unichain) or fluid approximation (e.g. global stable attractor). Moreover, our multi-action setting is not restricted to the usual dominant action concept. Finally, we show that RAC is also asymptotically optimal for a dynamic population, where bandits can randomly arrive and depart the system.

We consider random rectangles in $\mathbb{R}^2$ that are distributed according to a Poisson random measure, i.e. independently and uniformly scattered in the plane. The distributions of the length and the width of the rectangles are heavy tailed with different parameters. We investigate the scaling behaviour of the related random fields as the intensity of the random measure grows to infinity while the mean edge lengths tend to zero. We characterise the arising scaling regimes, identify the limiting random fields, and give statistical properties of these limits.

Motivated by Avram, Vu and Zhou (2017), Kyprianou and Zhou (2009), Li, Vu and Zhou (2017), Wang and Hu (2012), and Wang and Zhou (2018), we consider in this paper the problem of maximizing the expected accumulated discounted tax payments of an insurance company, whose reserve process (before taxes are deducted) evolves as a spectrally negative Lévy process with the usual exclusion of negative subordinator or deterministic drift. Tax payments are collected according to the very general loss-carry-forward tax system introduced in Kyprianou and Zhou (2009). To achieve a balance between taxation optimization and solvency, we consider an interesting modified objective function by considering the expected accumulated discounted tax payments of the company until the general draw-down time, instead of until the classical ruin time. The optimal tax return function and the optimal tax strategy are derived, and some numerical examples are also provided.

We consider subgraph counts in general preferential attachment models with power-law degree exponent $\tau > 2$. For all subgraphs H, we find the scaling of the expected number of subgraphs as a power of the number of vertices. We prove our results on the expected number of subgraphs by defining an optimization problem that finds the optimal subgraph structure in terms of the indices of the vertices that together span it and by using the representation of the preferential attachment model as a Pólya urn model.