In this paper, a new approach is proposed to investigate Blackwell-type renewal theorems for weighted renewal functions systematically according to which of the tails of weighted renewal constants or the underlying distribution is asymptotically heavier. Some classical results are improved considerably.

We introduce a class of stochastic processes in discrete time with finite state space by means of a simple matrix product. We show that this class coincides with that of the hidden Markov chains and provides a compact framework for it. We study a measure obtained by a projection on the real line of the uniform measure on the Sierpinski gasket, finding that the dimension of this measure fits with the Shannon entropy of an associated hidden Markov chain.

Using fluctuation theory, we solve the two-sided exit problem and identify the ruin probability for a general spectrally negative Lévy risk process with tax payments of a loss-carry-forward type. We study arbitrary moments of the discounted total amount of tax payments and determine the surplus level to start taxation which maximises the expected discounted aggregate income for the tax authority in this model. The results considerably generalise those for the Cramér-Lundberg risk model with tax.

The copula of a multivariate distribution is the distribution transformed so that one-dimensional marginal distributions are uniform. We review a different transformation of a multivariate distribution which yields standard Pareto for the marginal distributions, and we call the resulting distribution the Pareto copula. Use of the Pareto copula has a certain claim to naturalness when considering asymptotic limit distributions for sums, maxima, and empirical processes. We discuss implications for aggregation of risk and offer some examples.

In this paper we study the asymptotic tail probabilities of sums of subexponential, nonnegative random variables, which are dependent according to certain general structures with tail independence. The results show that the subexponentiality of the summands eliminates the impact of the dependence on the tail behavior of the sums.

A decision-making body may utilize a wide variety of different strategies when required to make a collective decision. In principle, we would like to use the most effective decision rule, that is, the rule yielding the highest probability of making the correct decision. However, in reality we often have to choose a decision rule out of some restricted family of rules. Therefore, it is important to be able to rank various families of rules. In this paper we consider three classes of decision rules: (i) balanced expert rules, (ii) the so-called single expert rules, and (iii) restricted majority rules. For the first two classes, we show that, as we deviate from the best rule in the family, the effectiveness of the decision rule decreases. For the last class, we obtain a very different phenomenon: any inner ranking is possible.

In this paper we show that the continuum-time version of the minority game satisfies the criteria for the application of a theorem on the existence of an invariant measure. We consider the special case of a game with a ‘sufficiently’ asymmetric initial condition, where the number of possible choices for each individual is S = 2 and Γ < +∞. An upper bound for the asymptotic behavior, as the number of agents grows to infinity, of the waiting time for reaching the stationary state is then obtained.

Let Wn be a simple Markov chain on the integers. Suppose that Xn is a simple Markov chain on the integers whose transition probabilities coincide with those of Wn off a finite set. We prove that there is an M > 0 such that the Markov chain Wn and the joint distributions of the first hitting time and first hitting place of Xn started at the origin for the sets {-M, M} and {-(M + 1), (M + 1)} algorithmically determine the transition probabilities of Xn.

Recently, Makri, Philippou and Psillakis (2007b) studied the exact distribution of success run statistics defined on an urn model. They derived the exact distributions of various success run statistics for a sequence of binary trials generated by the Pólya-Eggenberger sampling scheme. In our study we derive the joint distributions of run statistics defined on the multicolor urn model using a simple unified combinatorial approach and extend some of the results of Makri, Philippou and Psillakis (2007b). As a consequence of our results, we obtain the joint distributions of success and failure runs defined on the two-color urn model. The results enable us to compute the characteristics of particular consecutive-type systems and start-up demonstration tests.

In this paper we analyze players' long-run behavior in evolutionary coordination games with imperfect monitoring in a large population. Players can observe signals corresponding to other players' unseen actions and use the proposed simple or maximum likelihood estimation algorithm to extract information from the signals. In the simple learning process we find conditions for the risk-dominant and the non-risk-dominant equilibria to emerge alone in the long run. Furthermore, we find that the two equilibria can coexist in the long run. In contrast, the coexistence of the two equilibria is the only limit distribution under the maximum likelihood estimation learning algorithm. We also analyze the long-run equilibria of other 2x2 symmetric games under imperfect monitoring.

Gabetta and Regazzini (2006b) have shown that finiteness of the initial energy (second moment) is necessary and sufficient for the solution of the Kac's model Boltzmann equation to converge weakly (Cb-convergence) to a probability measure on R. Here, we complement this result by providing a detailed analysis of what does actually happen when the initial energy is infinite. In particular, we prove that such a solution converges vaguely (C0-convergence) to the zero measure (which is identically 0 on the Borel sets of R). More precisely, we prove that the total mass of the limiting distribution splits into two equal masses (of value ½ each), and we provide quantitative estimates on the rate at which such a phenomenon takes place. The methods employed in the proofs also apply in the context of sums of weighted independent and identically distributed random variables x̃1, x̃2, …, where these random variables have an infinite second moment and zero mean. Then, with Tn := ∑j=1ηnλj,nx̃j, with max1 ≤ j ≤ ηnλj,n → 0 (as n → +∞), and ∑j=1ηnλj,n2 = 1, n = 1, 2, …, the classical central limit theorem suggests that T should in some sense converge to a ‘normal random variable of infinite variance’. Again, in this setting we prove quantitative estimates on the rate at which the mass splits into adherent masses to -∞ and +∞, or to ∞, that are analogous to those we have obtained for the Kac equation. Although the setting in this case is quite classical, we have not uncovered any previous results of a similar type.

The aim of this paper is to provide the conditions necessary to reduce the complexity of state filtering for finite stochastic systems (FSSs). A concept of lumpability for FSSs is introduced. In this paper we assert that the unnormalised filter for a lumped FSS has linear dynamics. Two sufficient conditions for such a lumpability property to hold are discussed. We show that the first condition is also necessary for the lumped FSS to have linear dynamics. Next, we prove that the second condition allows the filter of the original FSS to be obtained directly from the filter for the lumped FSS. Finally, we generalise an earlier published result for the approximation of a general FSS by a lumpable FSS.

In the classic Dubins-Savage subfair primitive casino gambling problem, the gambler can stake any amount in his possession, winning (1 − r)/r times the stake with probability w and losing the stake with probability 1 − w, 0 ≤ w ≤ r ≤ 1. The gambler seeks to maximize the probability of reaching a fixed fortune (the goal) by gambling repeatedly with suitably chosen stakes. This problem has recently been extended in a unifying framework to account for limited playing time as well as future discounting, under which bold play is known to be optimal provided that w ≤ ½ ≤ r. This paper is concerned with a further extension of the Dubins-Savage gambling problem involving time-dependent parameters, and shows that bold play not only maximizes the probability of reaching the goal, but also stochastically minimizes the number of plays needed to reach the goal. As a result, bold play also maximizes the expected utility, where the utility at the goal is only required to be monotone decreasing with respect to the number of plays needed to reach the goal. It is further noted that bold play remains optimal even when the time-dependent parameters are random.

This article proves that the on-off renewal process with Weibull sojourn times satisfies the large deviation principle on a nonlinear scale. Unusually, its rate function is not convex. Apart from on a compact set, the rate function is infinite, which enables us to construct natural processes that satisfy the large deviation principle with nontrivial rate functions on more than one time scale.

We study a particular example of a recursive distributional equation (RDE) on the unit interval. We identify all invariant distributions, the corresponding ‘basins of attraction’, and address the issue of endogeny for the associated tree-indexed problem, making use of an extension of a recent result of Warren.

In the subfair red-and-black gambling problem, a gambler can stake any amount in his possession, winning an amount equal to the stake with probability w and losing the stake with probability 1 − w, where 0 < w < ½. The gambler seeks to maximize the probability of reaching a fixed fortune (to be normalized to unity) by gambling repeatedly with suitably chosen stakes. In their classic work, Dubins and Savage (1965), (1976) showed that it is optimal to play boldly. When there is a house limit of l (0 < l < ½), so that the gambler can stake no more than l, Wilkins (1972) showed that bold play remains optimal provided that 1 / l is an integer. On the other hand, building on an earlier surprising result of Heath, Pruitt and Sudderth (1972), Schweinsberg (2005) recently showed that, for all irrational 0 < l < ½ and all 0 < w < ½, bold play is not optimal for some initial fortune. The purpose of the present paper is to present several results supporting the conjecture that, for all rational l with 1 / l not an integer and all 0 < w < ½, bold play is not optimal for some initial fortune. While most of these results are based on Schweinsberg's method, in a special case where his method is shown to be inapplicable, we argue that the conjecture can be verified with the help of symbolic-computation software.

In this paper we study the bias and the overtaking optimality criteria for continuous-time jump Markov decision processes in general state and action spaces. The corresponding transition rates are allowed to be unbounded, and the reward rates may have neither upper nor lower bounds. Under appropriate hypotheses, we prove the existence of solutions to the bias optimality equations, the existence of bias optimal policies, and an equivalence relation between bias and overtaking optimality.

We study a continuous-time random walk on the d-dimensional lattice, subject to a drift and an attraction to large clusters of a subcritical Bernoulli site percolation. We find two distinct regimes: a ballistic one, and a subballistic one taking place when the attraction is strong enough. We identify the speed in the former case, and the algebraic rate of escape in the latter case. Finally, we discuss the diffusive behavior in the case of zero drift and weak attraction.

We study investment and disinvestment decisions in situations where there is a time lag d > 0 from the time t when the decision is taken to the time t + d when the decision is implemented. In this paper we apply the probabilistic approach to the combined entry and exit decisions under the Parisian implementation delay. In particular, we prove the independence between Parisian stopping times and a general Brownian motion with drift stopped at the stopping time. Relying on this result, we solve the constrained maximization problem, obtaining an analytic solution to the optimal ‘starting’ and ‘stopping’ levels. We compare our results with the instantaneous entry and exit situation, and show that an increase in the uncertainty of the underlying process hastens the decision to invest or disinvest, extending a result of Bar-Ilan and Strange (1996).

We show that the positive Wiener-Hopf factor of a Lévy process with positive jumps having a rational Fourier transform is a rational function itself, expressed in terms of the parameters of the jump distribution and the roots of an associated equation. Based on this, we give the closed form of the ruin probability for a Lévy process, with completely arbitrary negatively distributed jumps, and finite intensity positive jumps with a distribution characterized by a rational Fourier transform. We also obtain results for the ladder process and its Laplace exponent. A key role is played by the analytic properties of the characteristic exponent of the process and by a Baxter-Donsker-type formula for the positive factor that we derive.