Hostname: page-component-586b7cd67f-t8hqh Total loading time: 0 Render date: 2024-11-30T19:00:40.817Z Has data issue: false hasContentIssue false

Adaptive control of a production-inventory system

Published online by Cambridge University Press:  14 July 2016

Bharat T. Doshi*
Affiliation:
Bell Laboratories

Abstract

We study a production-inventory system in which input is deterministic, and its rate is the controlled parameter. The output is a compound Poisson process with exponential jump-size distribution. The parameters of the output process are unknown. The following adaptive policy is used: At each time t the unknown parameters are estimated by maximum likelihood method and the input rate which would be optimal if these were the true values of the parameter is used. The issues investigated are (1) the convergence of maximum likelihood estimates to the true value, and (2) the asymptotic properties of the cost under the adaptive policy.

Type
Research Papers
Copyright
Copyright © Applied Probability Trust 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

[1] Akritas, M. G. (1979) Asymptotic theory for estimating the parameters of a Levy process. Technical Report No. 11, MIT.Google Scholar
[2] Doshi, B. T. (1976) Continuous-time control of Markov processes on an arbitrary state space-average return criterion. Stoch. Proc. Appl. 4, 5577.CrossRefGoogle Scholar
[3] Doshi, B. T. (1976) Optimal dynamic selection of production rate in a production-inventory system. Technical Report, Rutgers University.Google Scholar
[4] Doshi, B. T. (1978) Optimal control of the service rate in an M/G/1 queueing system. Adv. Appl. Prob. 10, 682701.Google Scholar
[5] Doshi, B. T. and Shreve, S. (1980) Strong consistency of a modified maximum likelihood estimator for controlled Markov chains. J. Appl. Prob. 17, 726734.CrossRefGoogle Scholar
[6] Dufková, V. (1977) On controlled one-dimensional diffusion processes with unknown parameter. Adv. Appl. Prob. 9, 105124.CrossRefGoogle Scholar
[7] Feigin, P. D. (1976) Maximum likelihood estimation for continuous-time stochastic processes. Adv. Appl. Prob. 8, 712736.Google Scholar
[8] Mandl, P. (1974) Estimation and control in Markov chains. Adv. Appl. Prob. 6, 4060.Google Scholar
[9] Mandl, P. (1973) On the adaptive control of finite state Markov processes. Z. Wahrscheinlichkeitsth. 27, 263276.Google Scholar
[10] Mitchell, B. (1973) Optimal service-rate selection in an M/G/1 queue. SIAM J. Appl. Math. 24, 1935.Google Scholar