We study the $R_\beta$-positivity and the existence of zero-temperature limits for a sequence of infinite-volume Gibbs measures $(\mu_{\beta}(\!\cdot\!))_{\beta \geq 0}$ at inverse temperature $\beta$ associated to a family of nearest-neighbor matrices $(Q_{\beta})_{\beta \geq 0}$ reflected at the origin. We use a probabilistic approach based on the continued fraction theory previously introduced in Ferrari and Martínez (1993) and sharpened in Littin and Martínez (2010). Some necessary and sufficient conditions are provided to ensure (i) the existence of a unique infinite-volume Gibbs measure for large but finite values of $\beta$, and (ii) the existence of weak limits as $\beta \to \infty$. Some application examples are revised to put in context the main results of this work.

Mao and Hu (2010) left an open problem about the hazard rate order between the largest order statistics from two samples of n geometric random variables. Du et al. (2012) solved this open problem when n = 2, and Wang (2015) solved for 2 ≤ n ≤ 9. In this paper we completely solve this problem for any value of n.

We consider the Bernoulli bandit problem where one of the arms has win probability α and the others β, with the identity of the α arm specified by initial probabilities. With u = max(α, β), v = min(α, β), call an arm with win probability u a good arm. Whereas it is known that the strategy of always playing the arm with the largest probability of being a good arm maximizes the expected number of wins in the first n games for all n, we conjecture that it also stochastically maximizes the number of wins. That is, we conjecture that this strategy maximizes the probability of at least k wins in the first n games for all k, n. The conjecture is proven when k = 1, and k = n, and when there are only two arms and k = n - 1.

We construct random fields with Pólya-type autocorrelation function and dampened Pólya cross-correlation function. The marginal distribution of the random fields may be taken as any infinitely divisible distribution with finite variance, and the random fields are fully characterized in terms of their joint characteristic function. This makes available a new class of non-Gaussian random fields with flexible correlation structure for use in modeling and estimation.

Based on the ratio of two block maxima, we propose a large sample test for the length of memory of a stationary symmetric α-stable discrete parameter random field. We show that the power function converges to 1 as the sample-size increases to ∞ under various classes of alternatives having longer memory in the sense of Samorodnitsky (2004). Ergodic theory of nonsingular ℤd-actions plays a very important role in the design and analysis of our large sample test.

In the present paper, results given in Natvig (1990) are generalized to a multistate, strongly coherent, nonrepairable system of independent components by considering the reduction in remaining system time above a certain state due to a jump downwards of a component. This reduction also equals the increase in remaining system time above a certain state due to a minimal repair of the component at its time of jump downwards. The expected value of the sum of such reductions/increases for the different possible jumps downwards of the component is the building block of the Natvig measure of the importance of the component in the multistate case. Hence, the whole distributions of these reductions/increases are arrived at, not only the expectations, throwing more light on the consequences for the system of the deterioration of the components.

In this paper we present a set of results relating to the occupation time α(t) of a process X(·). The first set of results concerns exact characterizations of α(t), e.g. in terms of its transform up to an exponentially distributed epoch. In addition, we establish a central limit theorem (entailing that a centered and normalized version of α(t)∕t converges to a zero-mean normal random variable as t→∞) and the tail asymptotics of ℙ(α(t)∕t≥q). We apply our findings to spectrally positive Lévy processes reflected at the infimum and establish various new occupation time results for the corresponding model.

Based on a simple object, an i.i.d. sequence of positive integer-valued random variables {an}n∊ℤ, we introduce and study two random structures and their connections. First, a population dynamics, in which each individual is born at time n and dies at time n + an. This dynamics is that of a D/GI/∞ queue, with arrivals at integer times and service times given by {an}n∊ℤ. Second, the directed random graph Tf on ℤ generated by the random map f(n) = n + an. Assuming only that E [a0] < ∞ and P [a0 = 1] > 0, we show that, in steady state, the population dynamics is regenerative, with one individual alive at each regeneration epoch. We identify a unimodular structure in this dynamics. More precisely, Tf is a unimodular directed tree, in which f(n) is the parent of n. This tree has a unique bi-infinite path. Moreover, Tf splits the integers into two categories: ephemeral integers, with a finite number of descendants of all degrees, and successful integers, with an infinite number. Each regeneration epoch is a successful individual such that all integers less than it are its descendants of some order. Ephemeral, successful, and regeneration integers form stationary and mixing point processes on ℤ.

The classical secretary problem for selecting the best item is studied when the actual values of the items are observed with noise. One of the main appeals of the secretary problem is that the optimal strategy is able to find the best observation with a nontrivial probability of about 0.37, even when the number of observations is arbitrarily large. The results are strikingly different when the qualities of the secretaries are observed with noise. If there is no noise then the only information that is needed is whether an observation is the best among those already observed. Since the observations are assumed to be independent and identically distributed, the solution to this problem is distribution free. In the case of noisy data, the results are no longer distribution free. Furthermore, we need to know the rank of the noisy observation among those already observed. Finally, the probability of finding the best secretary often goes to 0 as the number of observations, n, goes to ∞. The results heavily depend on the behavior of pn, the probability that the observation that is best among the noisy observations is also best among the noiseless observations. Results involving optimal strategies if all that is available is noisy data are described and examples are given to elucidate the results.

Consider a spectrally negative risk process where, on ruin, the deficit is immediately paid, and the process restarts from 0. When the process reaches a threshold b, all the surplus above b is paid as dividend. Applying the theory of exit times for a spectrally negative Lévy process and its reflection at the maximum and at the minimum, we obtain recursive formulae for the following moments. (i) The moments of the discounted loss until the process reaches b. This is equivalent to the moments of the discounted dividends in the dual model under the barrier strategy. (ii) The moments of the discounted loss for models with and without a dividend barrier for the infinite horizon. (iii) The moments of the discounted dividends for the infinite horizon.

In this paper we study the numerical approximation of the optimal long-run average cost of a continuous-time Markov decision process, with Borel state and action spaces, and with bounded transition and reward rates. Our approach uses a suitable discretization of the state and action spaces to approximate the original control model. The approximation error for the optimal average reward is then bounded by a linear combination of coefficients related to the discretization of the state and action spaces, namely, the Wasserstein distance between an underlying probability measure μ and a measure with finite support, and the Hausdorff distance between the original and the discretized actions sets. When approximating μ with its empirical probability measure we obtain convergence in probability at an exponential rate. An application to a queueing system is presented.

In this paper, we analyze a two-queue random time-limited Markov-modulated polling model. In the first part of the paper, we investigate the fluid version: fluid arrives at the two queues as two independent flows with deterministic rate. There is a single server that serves both queues at constant speeds. The server spends an exponentially distributed amount of time in each queue. After the completion of such a visit time to one queue, the server instantly switches to the other queue, i.e., there is no switch-over time.

For this model, we first derive the Laplace–Stieltjes transform (LST) of the stationary marginal fluid content/workload at each queue. Subsequently, we derive a functional equation for the LST of the two-dimensional workload distribution that leads to a Riemann–Hilbert boundary value problem (BVP). After taking a heavy-traffic limit, and restricting ourselves to the symmetric case, the BVP simplifies and can be solved explicitly.

In the second part of the paper, allowing for more general (Lévy) input processes and server switching policies, we investigate the transient process limit of the joint workload in heavy traffic. Again solving a BVP, we determine the stationary distribution of the limiting process. We show that, in the symmetric case, this distribution coincides with our earlier solution of the BVP, implying that in this case the two limits (stationarity and heavy traffic) commute.

We have found a mistake in the proofs of Navarro (2008, Theorem 2.3(b) and 2.3(c)) due to misapplication of properties of hazard rate and likelihood ratio orders. In this paper we show with an example that the stated results do not hold. This example is interesting since it proves some unexpected properties for these orderings under the formation of coherent systems. The result stated in Navarro (2008, Theorem 2.3(a)) for the usual stochastic order is correct.

In this paper we obtain a duality result for the exponential utility maximization problem where trading is subject to quadratic transaction costs and the investor is required to liquidate her position at the maturity date. As an application of the duality, we treat utility-based hedging in the Bachelier model. For European contingent claims with a quadratic payoff, we compute the optimal trading strategy explicitly.

The class of processes formed as the aggregation of Ornstein-Uhlenbeck processes has proved useful in modeling time series from a number of areas and includes several interesting special cases. This paper examines the second-order properties of this class. Bounds on the one-step prediction error variance are proved and consistency of the minimum contrast estimation is demonstrated.

Under certain assumptions on the dependence structure of the residual lives of the insured (i.e. their independence, positive association, or negative association), in this paper we establish some laws of large numbers for the convex upper bounds, derived by the technique of comonotonicity, of the present value function of a homogeneous portfolio composed of the whole-life insurance policies.

The Vardi casino with parameter 0 < c < 1 consists of infinitely many tables indexed by their odds, each of which returns the same (negative) expected winnings -c per dollar. A gambler seeks to maximize the probability of reaching a fixed fortune by gambling repeatedly with suitably chosen stakes and tables (odds). The optimal strategy is derived explicitly subject to the constraint that the gambler is allowed to play only a given finite number of times. Some properties of the optimal strategy are also discussed.

We consider the sum Sd of record values in a sequence of independent random variables that are uniformly distributed on 1,…,d. This sum can be interpreted as the total amount of time spent in record lifetimes in the standard renewal theoretic setup. We investigate the distributional limit of Sd and some related quantities as d→∞. Some explicit values are given for d=6, a case that can be interpreted as a simple game of chance.

A trivariate equality of laws given by Doney and Yor is extended to a quadrivariate version. Some related explicit density calculations are carried out. It is shown that a bivariate case which has been used to establish the Dassios–Port–Wendel equality of laws is in fact equivalent to it.