Hostname: page-component-586b7cd67f-r5fsc Total loading time: 0 Render date: 2024-11-30T23:45:58.200Z Has data issue: false hasContentIssue false

A martingale approach to the slow server problem

Published online by Cambridge University Press:  14 July 2016

Richard H. Stockbridge*
Affiliation:
University of Kentucky
*
Postal address: Department of Statistics, University of Kentucky, Lexington, KY 40506–0027, USA.

Abstract

A Markov queueing system having heterogeneous servers under a long-run average criterion is analyzed. A direct proof of the optimality of a stationary, Markov policy is given using martingale methods. Simultaneously, the problem is reduced to a linear programming problem. Analysis of the LP for a system having finite queueing length shows the optimal policy is not always of threshold type.

Type
Short Communications
Copyright
Copyright © Applied Probability Trust 1991 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Ethier, S. N. and Kurtz, T. G. (1986) Markov Processes: Characterization and Convergence. Wiley, New York.Google Scholar
Larsen, R. L. (1981) Control of multiple exponential servers with application to computer systems, Ph.D dissertation, Dep. Comput. Sci., Univ. Maryland, College Park, Tech. Rep. TR-1041.Google Scholar
Lin, W. and Kumar, P. R. (1984) Optimal control of a queueing system with two heterogeneous servers. IEEE Trans. Autom. Control. 28, 696703.Google Scholar
Manne, A. S. (1960) Linear programming and sequential decisions. Management Sci. 6, 259267.Google Scholar
Rubinovitch, M. (1985) The slow server problem: a queue with stalling. J. Appl. Prob. 22, 295313.Google Scholar
Stockbridge, R. H. (1990a) Time-average control of martingale problems: Existence of stationary solutions. Ann. Prob. 18, 190205.Google Scholar
Stockbridge, R. H. (1990b) Time-average control of martingale problems: a linear programming formulation. Ann. Prob. 18, 206217.Google Scholar
Walrand, J. (1984) A note on ‘Optimal control of a queueing system with two heterogeneous servers’. Syst. Control Lett. 4, 131134.Google Scholar