The notion of a quantum random walk in discrete time is formulated and the passage to a continuous time diffusion limit is established. The limiting diffusion is described in terms of solutions of certain quantum stochastic differential equations.

We consider a multi asset financial market with stochastic volatility modeled by a Wishart process. This is an extension of the one-dimensional Heston model. Within this framework we study the problem of maximizing the expected utility of terminal wealth for power and logarithmic utility. We apply the usual stochastic control approach and obtain, explicitly, the optimal portfolio strategy and the value function in some parameter settings. In particular, we do this when the drift of the assets is a linear function of the volatility matrix. In this case the affine structure of the model can be exploited. In some cases we obtain a Feynman-Kac representation of the candidate value function. Though the approach we use is quite standard, the hard part is to identify when the solution of the Hamilton-Jacobi-Bellman equation is finite. This involves a couple of matrix analytic arguments. In a numerical study we discuss the influence of the investors' risk aversion on the hedging demand.

Harlow et al. (1983) have given a recursive formula which is fundamental for computing the bundle strength distribution under a general class of load sharing rules called monotone load sharing rules. As the bundle size increases, the formula becomes prohibitively complex and, by itself, does not give much insight into the relationship of the assumed load sharing rule to the overall strength distribution. In this paper, an algorithm is given which gives some additional insight into this relationship. Here it is shown how to explicitly compute the bundle strength survival distribution by using a new type of graph called the loading diagram. The graph is parallel in structure and recursive in nature and so would appear to lend itself to large-scale computation. In addition, the graph has an interesting property (which we refer to as the cancellation property) which is related to the asymptotics of the Weibull as a minimum stable law.

A (generalized) stochastic fluid system Q is defined as the one-dimensional Skorokhod reflection of a finite variation process X (with possibly discontinuous paths). We write X as the (not necessarily minimal) difference of two positive measures, A, B, and prove an alternative ‘integral representation’ for Q. This representation forms the basis for deriving a ‘Little's law’ for an appropriately constructed stationary version of Q. For the special case where B is the Lebesgue measure, a distributional version of Little's law is derived. This is done both at the arrival and departure points of the system. The latter result necessitates the consideration of a ‘dual process’ to Q. Examples of models for X, including finite variation Lévy processes with countably many jumps on finite intervals, are given in order to illustrate the ideas and point out potential applications in performance evaluation.

New bounds are found for the reliability of consecutive-k-out-of-n:F systems with equal component failure probabilities. The expressions involved are simple, thus allowing a direct use in the derivation of theoretical properties.

These bounds can also be employed in numerical computations when the value of n or k is so large that the exact calculation of the reliability is not achievable. Comparisons show that the approximation errors exhibited by these new formulas are lower than those of other widely used bounds.

Chain-dependent processes, also called sequences of random variables defined on a Markov chain, are shown to satisfy the strong law of large numbers. A central limit theorem and a law of the iterated logarithm are given for the case when the underlying Markov chain satisfies Doeblin's hypothesis. The proofs are obtained by showing independence of the initial distribution of the chain and by then restricting attention to the stationary case.

The deterministic and stochastic models developed by Bartlett (1956) to describe the initial spatial spread of an epidemic such as measles are extended to host-vector and carrier-borne epidemics such as malaria and typhoid in which more than one type of individual is involved. If the epidemic does not die out, then the behaviour predicted by the deterministic model and an examination of the mean distributions in the stochastic model is a wave of infection spreading out from the initial source of infection.

Families of alternative bandit processes have been used as models for problems in a variety of areas. Optimal strategies for these decision processes are determined by dynamic allocation indices. These indices are here shown to play an important role in the evaluation of suboptimal strategies.

This work proposes and analyzes a family of spatially inhomogeneous epidemic models. This is our first effort to use stochastic partial differential equations (SPDEs) to model epidemic dynamics with spatial variations and environmental noise. After setting up the problem, the existence and uniqueness of solutions of the underlying SPDEs are examined. Then, definitions of permanence and extinction are given, and certain sufficient conditions are provided for permanence and extinction. Our hope is that this paper will open up windows for investigation of epidemic models from a new angle.

During the course of an R and D project, it is often meaningful and possible to evaluate its status, so that this information may be used for making better financing decisions over time. The project status changes stochastically due to the internal (technological) and the external (market) uncertainties, the former being partially controlled by expenditure of resources. In addition to the resource expenditure strategy, the manager must also decide when to terminate the project. Once the project is terminated, a terminal return is collected, whose value depends on the final project status. It is shown that the project should be terminated if the current status is either too low or too high to make further expenditure worthwhile. Otherwise, for an intermediate (promising) status of the project, an aggressive investment strategy is shown to be optimal. Thus, the model unifies the problems of optimally undertaking, financing and terminating an R and D project in face of various uncertainties.

Families of heavily dissociated random variables are defined and discussed. These include families of the form g(Yi, Yj) for some suitable function g of two arguments and independent uniformly distributed random variables Y1, Y2, ··· on the circle, the torus or the sphere. The weak convergence of the empirical distribution process is discussed. The particular case of distances between pairs of observations on the circle is considered in greater detail.

An explicit convolution representation for the equilibrium residual lifetime distribution of compound zero-modified geometric distributions is derived. Second-order reliability properties are seen to be essentially preserved under geometric compounding, and complement results of Brown (1990) and Cai and Kalashnikov (2000). The convolution representation is then extended to the nth-order equilibrium distribution. This higher-order convolution representation is used to evaluate the stop-loss premium and higher stop-loss moments of the compound zero-modified geometric distribution, as well as the Laplace transform of the kth moment of the time of ruin in the classical risk model.

The expected response time of a job that requires processing time t and meets n jobs on arrival in the M/G/1 processor-sharing system is derived.

Any probability distribution on [0,∞) can function as the mixing distribution for a Poisson mixture, i.e. a mixture of Poisson distributions. The mixing distribution is called quasi-infinitely divisible (q.i.d.) if it renders the Poisson mixture infinitely divisible, or λ-q.i.d. if it does so after scaling by a factor λ> 0, or ∗-q.i.d. if it is λ-q.i.d. for some λ. These classes of distributions include the infinitely divisible distributions, and each exhibits many of the properties of the latter class but in weakened form. The paper presents the main properties of the classes and the class of Poisson mixtures, including characterisations of membership, relation with cumulants, and closure properties. Examples are given that establish among other things strict inclusions between the classes of mixing distributions.

On a circle of unit circumference arcs of length a are placed at random. Let Nα be equal to the necessary number of arcs to cover at least the length 1 − p, 0 ≦ p < 1, of the circumference at least m (≧1) times. In the present paper limit distributions of Nα are derived when α → 0. Some results for spacings are also obtained.

The asymptotic behavior of the maximum likelihood estimators of Markov models or autoregressive models are given when the true distribution is not a member of the assumed parametric family. The derivation of Akaike's Information Criterion is reviewed for this case.

The distributions for continuous, discrete, and conditional discrete scan statistics are studied. The approach of finite Markov chain imbedding, which has been applied to random permutations as well as to runs and patterns, is extended to compute the distribution of the conditional discrete scan statistic, defined from a sequence of Bernoulli trials. It is shown that the distribution of the continuous scan statistic induced by a Poisson process defined on (0, 1] is a limiting distribution of weighted distributions of conditional discrete scan statistics. Comparisons of rates of convergence as well as numerical comparisons of various bounds and approximations are provided to illustrate the theoretical results.

Very little is known about the quantitative behaviour of dynamical systems with random excitation, unless the system is linear. Known techniques imply the resolution of parabolic partial differential equations (Fokker–Planck–Kolmogorov equation), which are degenerate and of high dimension and for which there is no effective known method of resolution. Therefore, users (physicists, mechanical engineers) concerned with such systems have had to design global linearization techniques, known as equivalent statistical linearization (Roberts and Spanos (1990)). So far, there has been no rigorous justification of these techniques, with the notable exception of the paper by Kozin (1987). In this contribution, using large deviation principles, several mathematically founded linearization methods are proposed. These principles use relative entropy, or Kullback information, of two probability measures, and Donsker–Varadhan entropy of a Gaussian measure relatively to a Markov kernel. The method of ‘true linearization’ (Roberts and Spanos (1990)) is justified.

Brown and Proschan (1983) introduced the imperfect repair model, in which an item, upon failure, is replaced with a new one with probability α, and is minimally repaired with probability 1 − α. In this paper we equip the imperfect repair model with preventive maintenance, and we obtain stochastic maintenance comparisons for the numbers of failures under different policies via a point-process approach. We also obtain some results involving stochastic monotonicity properties of these models with respect to the unplanned complete repair probability α.

We consider critical Bellman-Harris processes which admit an immigration component only in the state 0. The asymptotic behaviour of the probability of extinction and of the first two moments is investigated and a limit theorem is also proved.