In 2002, Benjamin and Goldman gave a complete solution to a variant of the two-player card game Le Her. We extend their result by giving optimal strategies for the authentic version played with a deck consisting of arbitrary numbers of suits and denominations. Additionally, we show that the player who has the advantage in the game when one standard deck is used does not have the advantage if nineteen or more standard decks are used.

We study the uncertain dichotomous choice model. In this model, a group of expert decision makers is required to select one of two alternatives. The applications of this model are relevant to a wide variety of areas. A decision rule translates the individual opinions of the members into a group decision, and is optimal if it maximizes the probability of the group making a correct choice. In this paper, we assume the correctness probabilities of the experts to be independent random variables selected from some given distribution. Moreover, the ranking of the members in the group is (at least partly) known. Thus, one can follow rules based on this ranking. The extremes are the expert rule and the majority rule. The probabilities of the two extreme rules being optimal were compared in a series of early papers, for a variety of distributions. In most cases, the asymptotic behaviours of the probabilities of the two extreme rules followed the same patterns. Do these patterns hold in general? If not, what are the ranges of possible asymptotic behaviours of the probabilities of the two extreme rules being optimal? In this paper, we provide satisfactory answers to these questions.

Define the non-overlapping return time of a block of a random process to be the number of blocks that pass by before the block in question reappears. We prove a central limit theorem based on these return times. This result has applications to entropy estimation, and to the problem of determining if digits have come from an independent, equidistributed sequence. In the case of an equidistributed sequence, we use an argument based on negative association to prove convergence under conditions weaker than those required in the general case.

A more general definition of MTP2 (multivariate total positivity of order 2) probability measure is given, without assuming the existence of a density. Under this definition the class of MTP2 measures is proved to be closed under weak convergence. Characterizations of the MTP2 property are proved under this more general definition. Then a precise definition of conditionally increasing measure is provided, and closure under weak convergence of the class of conditionally increasing measures is proved. As an application we investigate MTP2 properties of stationary distributions of Markov chains, which are of interest in actuarial science.

A generalized correlated random walk is a process of partial sums such that (X, Y) forms a Markov chain. For a sequence (Xn) of such processes in which each takes only two values, we prove weak convergence to a diffusion process whose generator is explicitly described in terms of the limiting behaviour of the transition probabilities for the Yn. Applications include asymptotics of option replication under transaction costs and approximation of a given diffusion by regular recombining binomial trees.

We discuss two Monte Carlo algorithms for finding the global maximum of a simple random walk with negative drift. This problem can be used to connect the analysis of random input Monte Carlo algorithms with ideas and principles from mathematical statistics.

A full-information version of the secretary problem in which the objective is to maximize the time of possession of a relatively best object is considered both in the case in which only the most recently observed object may be chosen and in the case in which any of the previously observed objects may be chosen. The main purpose of this paper is to obtain, under an optimal rule, both the asymptotic proportional durations when the number of objects tends to infinity, and the expected durations when the number of objects remains finite. The integral expressions for these asymptotic values are derived in both cases: the approximate numerical values are 0.435 in the former (no-recall) case and 0.449 in the latter (recall) case, indicating a surprisingly small difference. The expected values of the optimal stopping times are also obtained from the planar Poisson process analysis.

We consider the optimal stopping problem for g(Zn), where Zn, n = 1, 2, …, is a homogeneous Markov sequence. An algorithm, called forward improvement iteration, is presented by which an optimal stopping time can be computed. Using an iterative step, this algorithm computes a sequence B0 ⊇ B1 ⊇ B2 ⊇ · · · of subsets of the state space such that the first entrance time into the intersection F of these sets is an optimal stopping time. Various applications are given.

Let {X(s, t), s = (s1, s2) ∈ ℝ2, t ∈ ℝ} be a stationary random field defined over a discrete lattice. In this paper, we consider a set of domain of attraction criteria giving the notion of extremal index for random fields. Together with the extremal-types theorem given by Leadbetter and Rootzen (1997), this will give a characterization of the limiting distribution of the maximum of such random fields.

Methods using gambling teams and martingales are developed and applied to find formulae for the expected value and the generating function of the waiting time to observation of an element of a finite collection of patterns in a sequence generated by a two-state Markov chain of first, or higher, order.

In this paper we study polynomial and geometric (exponential) ergodicity for M/G/1-type Markov chains and Markov processes. First, practical criteria for M/G/1-type Markov chains are obtained by analyzing the generating function of the first return probability to level 0. Then the corresponding criteria for M/G/1-type Markov processes are given, using their h-approximation chains. Our method yields the radius of convergence of the generating function of the first return probability, which is very important in obtaining explicit bounds on geometric (exponential) convergence rates. Our results are illustrated, in the final section, in some examples.

We investigate the asymptotic behaviour of homogeneous multidimensional Markov chains whose states have nonnegative integer components. We obtain growth rates for these models in a situation similar to the near-critical case for branching processes, provided that they converge to infinity with positive probability. Finally, the general theoretical results are applied to a class of controlled multitype branching process in which random control is allowed.

The problem of computing the moment generating function of the first passage time T to a > 0 or −b < 0 for a one-dimensional Wiener process {X(t), t ≥ 0} is generalized by assuming that the infinitesimal parameters of the process may depend on the sign of X(t). The probability that the process is absorbed at a is also computed explicitly, as is the expected value of T.

Local linear approximations have been the main component in the construction of a class of effective numerical integrators and inference methods for diffusion processes. In this note, two local linear approximations of jump diffusion processes are introduced as a generalization of the usual ones. Their rate of uniform strong convergence is also studied.

A continuous-state population-size-dependent branching process {Xt} is a modification of the Jiřina process. We prove that such a process arises as the limit of a sequence of suitably scaled population-size-dependent branching processes with discrete states. The extinction problem for the population Xt is discussed, and the limit distribution of Xt / t obtained when Xt tends to infinity.

In this paper, we present an iterative procedure to calculate explicitly the Laplace transform of the distribution of the maximum for a Lévy process with positive jumps of phase type. We derive error estimates showing that this iteration converges geometrically fast. Subsequently, we determine the Laplace transform of the law of the upcrossing ladder process and give an explicit pathwise construction of this process.

We consider a Lévy process with no negative jumps, reflected at a stochastic boundary that is a positive constant multiple of an age process associated with a Poisson process. We show that the stability condition for this process is identical to the one for the case of reflection at the origin. In particular, there exists a unique stationary distribution that is independent of initial conditions. We identify the Laplace-Stieltjes transform of the stationary distribution and observe that it satisfies a decomposition property. In fact, it is a sum of two independent random variables, one of which has the stationary distribution of the process reflected at the origin, and the other the stationary distribution of a certain clearing process. The latter is itself distributed as an infinite sum of independent random variables. Finally, we discuss the tail behavior of the stationary distribution and in particular observe that the second distribution in the decomposition always has a light tail.

Admission control can be employed to avoid congestion in queueing networks subject to overload. In distributed networks, the admission decisions are often based on imperfect measurements on the network state. In this paper, we study how the lack of complete state information affects the system performance, by considering a simple network model for distributed admission control. The stability region of the network is characterized and it is shown how feedback signaling makes the system very sensitive to its parameters.

We consider a stationary moving average process with random coefficients, , generated by an array, {Ct,k, t ∈ Z, k ≥ 0}, of random variables and a heavy-tailed sequence, {Zt, t ∈ Z}. We analyze the limit behavior using a point process analysis. As applications of our results we compare the limiting behavior of the moving average process with random coefficients with that of a standard MA(∞) process.

We consider an insurance portfolio situation in which there is possible dependence between the waiting time for a claim and its actual size. By employing the underlying random walk structure we obtain explicit exponential estimates for infinite- and finite-time ruin probabilities in the case of light-tailed claim sizes. The results are illustrated in several examples, worked out for specific dependence structures.