This paper studies the input-queued switch operating under the MaxWeight algorithm when the arrivals are according to a Markovian process. We exactly characterize the heavy-traffic scaled mean sum queue length in the heavy-traffic limit, and show that it is within a factor of less than 2 from a universal lower bound. Moreover, we obtain lower and upper bounds that are applicable in all traffic regimes and become tight in the heavy-traffic regime.

We obtain these results by generalizing the drift method recently developed for the case of independent and identically distributed arrivals to the case of Markovian arrivals. We illustrate this generalization by first obtaining the heavy-traffic mean queue length and its distribution in a single-server queue under Markovian arrivals and then applying it to the case of an input-queued switch.

The key idea is to exploit the geometric mixing of finite-state Markov chains, and to work with a time horizon that is chosen so that the error due to mixing depends on the heavy-traffic parameter.

We study 2-stage game-theoretic problem oriented 3-stage service policy computing, convolutional neural network (CNN) based algorithm design, and simulation for a blockchained buffering system with federated learning. More precisely, based on the game-theoretic problem consisting of both “win-lose” and “win-win” 2-stage competitions, we derive a 3-stage dynamical service policy via a saddle point to a zero-sum game problem and a Nash equilibrium point to a non-zero-sum game problem. This policy is concerning users-selection, dynamic pricing, and online rate resource allocation via stable digital currency for the system. The main focus is on the design and analysis of the joint 3-stage service policy for given queue/environment state dependent pricing and utility functions. The asymptotic optimality and fairness of this dynamic service policy is justified by diffusion modeling with approximation theory. A general CNN based policy computing algorithm flow chart along the line of the so-called big model framework is presented. Simulation case studies are conducted for the system with three users, where only two of the three users can be selected into the service by a zero-sum dual cost game competition policy at a time point. Then, the selected two users get into service and share the system rate service resource through a non-zero-sum dual cost game competition policy. Applications of our policy in the future blockchain based Internet (e.g., metaverse and web3.0) and supply chain finance are also briefly illustrated.

We study the asymptotic behaviour of the expectation of the maxima and minima of a random assignment process generated by a large matrix with multinomial entries. A variety of results is obtained for different sparsity regimes.

We consider an (R, Q) inventory model with two types of orders, normal orders and emergency orders, which are issued at different inventory levels. These orders are delivered after exponentially distributed lead times. In between deliveries, the inventory level decreases in a state-dependent way, according to a release rate function $\alpha({\cdot})$ . This function represents the fluid demand rate; it could be controlled by a system manager via price adaptations. We determine the mean number of downcrossings $\theta(x)$ of any level x in one regenerative cycle, and use it to obtain the steady-state density f (x) of the inventory level. We also derive the rates of occurrence of normal deliveries and of emergency deliveries, and the steady-state probability of having zero inventory.

Consider a finite or infinite collection of urns, each with capacity r, and balls randomly distributed among them. An overflow is the number of balls that are assigned to urns that already contain r balls. When $r=1$ , this is the number of balls landing in non-empty urns, which has been studied in the past. Our aim here is to use martingale methods to study the asymptotics of the overflow in the general situation, i.e. for arbitrary r. In particular, we provide sufficient conditions for both Poissonian and normal asymptotics.

We consider a server with large capacity delivering video files encoded in various resolutions. We assume that the system is under saturation in the sense that the total demand exceeds the server capacity C. In such a case, requests may be rejected. For the policies considered in this paper, instead of rejecting a video request, it is downgraded. When the occupancy of the server is above some value C0 < C, the server delivers the video at a minimal bit rate. The quantity C0 is the bit rate adaptation threshold. For these policies, request blocking is thus replaced with bit rate adaptation. Under the assumptions of Poisson request arrivals and exponential service times, we show that, by rescaling the system, a process associated with the occupancy of the server converges to some limiting process whose invariant distribution is computed explicitly. This allows us to derive an asymptotic expression of the key performance measure of such a policy, namely the equilibrium probability that a request is transmitted at requested bitrate. Numerical applications of these results are presented.

We establish a local martingale M associate with f(X,Y) under some restrictions on f, where Y is a process of bounded variation (on compact intervals) and either X is a jump diffusion (a special case being a Lévy process) or X is some general (càdlàg metric-space valued) Markov process. In the latter case, f is restricted to the form f(x,y)=∑k=1Kξk(x)ηk(y). This local martingale unifies both Dynkin's formula for Markov processes and the Lebesgue–Stieltjes integration (change of variable) formula for (right-continuous) functions of bounded variation. For the jump diffusion case, when further relatively easily verifiable conditions are assumed, then this local martingale becomes an L2-martingale. Convergence of the product of this Martingale with some deterministic function ( of time ) to 0 both in L2 and almost sure is also considered and sufficient conditions for functions for which this happens are identified.

Shot-noise processes are used in applied probability to model a variety of physical systems in, for example, teletraffic theory, insurance and risk theory, and in the engineering sciences. In this paper we prove a large deviation principle for the sample-paths of a general class of multidimensional state-dependent Poisson shot-noise processes. The result covers previously known large deviation results for one-dimensional state-independent shot-noise processes with light tails. We use the weak convergence approach to large deviations, which reduces the proof to establishing the appropriate convergence of certain controlled versions of the original processes together with relevant results on existence and uniqueness.

In this paper we use the Siegert formula to derive alternative expressions for the moments of the first passage time of the Ornstein-Uhlenbeck process through a constant threshold. The expression for the nth moment is recursively linked to the lower-order moments and consists of only n terms. These compact expressions can substantially facilitate (numerical) applications also for higher-order moments.

The stochastic sequential assignment problem assigns distinct workers to sequentially arriving tasks with stochastic parameters. In this paper the assignments are performed so as to minimize the threshold probability, which is the probability of the long-run reward per task failing to achieve a target value (threshold). As the number of tasks approaches infinity, the problem is studied for independent and identically distributed (i.i.d.) tasks with a known distribution function and also for tasks that are derived from r distinct unobservable distributions (governed by a Markov chain). Stationary optimal policies are presented, which simultaneously minimize the threshold probability and achieve the optimal long-run expected reward per task.

In ruin theory, the conjecture given in De Vylder and Goovaerts (2000) is an open problem about the comparison of the finite time ruin probability in a homogeneous risk model and the corresponding ruin probability evaluated in the associated model with equalized claim amounts. In this paper we consider a weaker version of the conjecture and show that the integrals of the ruin probabilities with respect to the initial risk reserve are uniformly comparable.

In this paper we generalize the martingale of Kella and Whitt to the setting of Lévy-type processes and show that the (local) martingales obtained are in fact square-integrable martingales which upon dividing by the time index converge to zero almost surely and in L2. The reflected Lévy-type process is considered as an example.

In this paper we consider an extension of the two-dimensional risk model introduced in Avram, Palmowski and Pistorius (2008a). To this end, we assume that there are two insurers. The first insurer is subject to claims arising from two independent compound Poisson processes. The second insurer, which can be viewed as a different line of business of the same insurer or as a reinsurer, covers a proportion of the claims arising from one of these two compound Poisson processes. We derive the Laplace transform of the time until ruin of at least one insurer when the claim sizes follow a general distribution. The surplus level of the first insurer when the second insurer is ruined first is discussed at the end in connection with some open problems.

In this paper we investigate the number and maximum severity of the ruin excursion of the insurance portfolio reserve process in the Cramér–Lundberg model with and without tax payments. We also provide a relation of the Cramér–Lundberg risk model with the G/G/∞ queue and use it to derive some explicit ruin probability formulae. Finally, the renewal risk model with tax is considered, and an asymptotic identity is derived that in some sense extends the tax identity of the Cramér– Lundberg risk model.

We consider a risk model with threshold strategy, where the insurance company pays off a certain percentage of the income as dividend whenever the current surplus is larger than a given threshold. We investigate the ruin time, ruin probability, and the total dividend, using methods and results from queueing theory.

We consider several versions of the job assignment problem for an M/M/m queue with servers of different speeds. When there are two classes of customers, primary and secondary, the number of secondary customers is infinite, and idling is not permitted, we develop an intuitive proof that the optimal policy that minimizes the mean waiting time has a threshold structure. That is, for each server, there is a server-dependent threshold such that a primary customer will be assigned to that server if and only if the queue length of primary customers meets or exceeds the threshold. Our key argument can be generalized to extend the structural result to models with impatient customers, discounted waiting time, batch arrivals and services, geometrically distributed service times, and a random environment. We show how to compute the optimal thresholds, and study the impact of heterogeneity in server speeds on mean waiting times. We also apply the same machinery to the classical slow-server problem without secondary customers, and obtain more general results for the two-server case and strengthen existing results for more than two servers.

We consider the level hitting times τy = inf{t ≥ 0 | Xt = y} and the running maximum process Mt = sup{Xs | 0 ≤ s ≤ t} of a growth-collapse process (Xt)t≥0, defined as a [0, ∞)-valued Markov process that grows linearly between random ‘collapse’ times at which downward jumps with state-dependent distributions occur. We show how the moments and the Laplace transform of τy can be determined in terms of the extended generator of Xt and give a power series expansion of the reciprocal of Ee−sτy. We prove asymptotic results for τy and Mt: for example, if m(y) = Eτy is of rapid variation then Mt / m-1(t) →w 1 as t → ∞, where m-1 is the inverse function of m, while if m(y) is of regular variation with index a ∈ (0, ∞) and Xt is ergodic, then Mt / m-1(t) converges weakly to a Fréchet distribution with exponent a. In several special cases we provide explicit formulae.

We consider a Poisson cluster model, motivated by insurance applications. At each claim arrival time, modeled by the point of a homogeneous Poisson process, we start a cluster process which represents the number or amount of payments triggered by the arrival of a claim in a portfolio. The cluster process is a Lévy or truncated compound Poisson process. Given the observations of the process over a finite interval, we consider the expected value of the number and amount of payments in a future time interval. We also give bounds for the error encountered in this prediction procedure.

We consider an M/G/1 queue in which an arriving customer does not enter the system whenever its virtual waiting time, i.e. the amount of work seen upon arrival, is larger than a certain random patience time. We determine the busy period distribution for various choices of the patience time distribution. The main cases under consideration are exponential patience and a discrete patience distribution.