Hostname: page-component-586b7cd67f-t8hqh Total loading time: 0 Render date: 2024-11-27T23:12:48.026Z Has data issue: false hasContentIssue false
  • English
  • Français

Stochastic Sequences with a Regenerative Structure that May Depend Both on the Future and on the Past

Part of: Limit theorems Special processes Markov processes Stochastic processes

Published online by Cambridge University Press:  04 January 2016

Sergey Foss  and
Stan Zachary
Sergey Foss*
Affiliation:
Heriot-Watt University and Sobolev Institute of Mathematics
Stan Zachary*
Affiliation:
Heriot-Watt University
*
∗ Postal address: School of Mathematics and Computer Sciences and the Maxwell Institute for Mathematical Sciences, Heriot-Watt University, Edinburgh EH14 4AS, UK.
∗ Postal address: School of Mathematics and Computer Sciences and the Maxwell Institute for Mathematical Sciences, Heriot-Watt University, Edinburgh EH14 4AS, UK.
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

Many regenerative arguments in stochastic processes use random times which are akin to stopping times, but which are determined by the future as well as the past behaviour of the process of interest. Such arguments based on ‘conditioning on the future’ are usually developed in an ad-hoc way in the context of the application under consideration, thereby obscuring the underlying structure. In this paper we give a simple, unified, and more general treatment of such conditioning theory. We further give a number of novel applications to various particle system models, in particular to various flavours of contact processes and to infinite-bin models. We give a number of new results for existing and new models. We further make connections with the theory of Harris ergodicity.

Keywords

Regenerative processbreak pointdependence on the future and on the pastcontact processinfinite-bin modelHarris ergodicity

MSC classification

Primary: 60K05: Renewal theory 60K35: Interacting random processes; statistical mechanics type models; percolation theory 60K40: Other physical applications of random processes 60J05: Discrete-time Markov processes on general state spaces 60G40: Stopping times; optimal stopping problems; gambling theory 60F99: None of the above, but in this section
Type
General Applied Probability
Information
Advances in Applied Probability , Volume 45 , Issue 4 , December 2013 , pp. 1083 - 1110
Copyright
© Applied Probability Trust 

Footnotes

Research of both authors was partially supported by EPSRC grant EP/I017054/1.

References

Asmussen, S. (2003). Applied Probability and Queues. 2nd edn. Springer, New York.Google Scholar
Athreya, K. B. and Ney, P. A. (1978). A new approach to the limit theory of recurrent Markov chains. Trans. Amer. Math. Soc. 245, 493–501.Google Scholar
Benjamini, I. and Berestycki, N. (2010). Random paths with bounded local time. J. Europ. Math. Soc. 12, 819–854.Google Scholar
Benjamini, I. and Wilson, D. B. (2003). Excited random walk. Electron. Commun. Probab. 8, 86–92.Google Scholar
Bärard, J. and Ramärez, A. (2007). Central limit theorem for the excited random walk in dimension D≥ 2. Electron Commun. Prob. 12, 303–314.Google Scholar
Borovkov, A. A. (1998). Ergodicity and Stability of Stochastic Processes. John Wiley, Chichester.Google Scholar
Borovkov, A. A. and Foss, S. G. (1992). Stochastically recursive sequences and their generalizations. Siberian Adv. Math. 2, 16–81.Google Scholar
Chernysh, K and Ramasmami, S. (2013). Optimal deterministic algorithms and Markov evolution for the infinite bin model. Working paper.Google Scholar
Comets, F., Fernändez, R. and Ferrari, P. A. (2002). Processes with long memory: regenerative construction and perfect simulation. Ann. Appl. Prob. 12, 921–943.Google Scholar
Denisov, D., Foss, S. and Konstantopoulos, T. (2012). Limit theorems for a random directed slab graph. Ann. Appl. Prob. 22, 702–733.Google Scholar
De Santis, E. and Piccioni, M. (2012). Backward coalescence times for perfect simulation of chains with infinite memory. J. Appl. Prob. 49, 319–337.CrossRefGoogle Scholar
Durrett, R. and Schinazi, R. B. (2000). Boundary modified contact processes. J. Theoret. Prob. 13, 575–594.Google Scholar
Foss, S. and Konstantopoulos, T. (2003). Extended renovation theory and limit theorems for stochastic ordered graphs. Markov Process. Relat. Fields 9, 413–468.Google Scholar
Foss, S. and Konstantopoulos, T. (2004). An overview of some stochastic stability methods. J. Operat. Res. Soc. Japan 47, 275–303.Google Scholar
Foss, S., Martin, J. and Schmidt, P. (2013). Long-range last-passage percolation on the line. To appear in Ann. Appl. Prob. Google Scholar
Gallo, S. (2011). Chains with unbounded variable length memory: perfect simulation and a visible regeneration scheme. Adv. Appl. Prob. 43, 735–759.CrossRefGoogle Scholar
Galves, A. and Presutti, E. (1987). Edge fluctuations for the one-dimensional supercritical contact process. Ann. Prob. 15, 1131–1145.Google Scholar
Kifer, Y. (1986). Ergodic Theory of Random Transformations. Birkhäuser, Boston, MA.CrossRefGoogle Scholar
Kuczek, T. (1989). The central limit theorem for the right edge of supercritical oriented percolation. Ann. Prob. 17, 1322–1332.Google Scholar
Last, G., Mäerters, P. and Thorisson, H. (2013). Unbiased shifts of Brownian motion. Submitted. Available at http://arxiv.org/abs/1112.5373v1.Google Scholar
Menshikov, M., Popov, S., Ramirez, A. F. and Vachkovskaia, M. (2012). On a general many-dimensional excited random walk. Ann. Appl. Prob. 40, 2106–2130.Google Scholar
Meyn, S. P. and Tweedie, R. L. (1993). Markov Chains and Stochastic Stability. Springer, London.Google Scholar
Mountford, T. S. and Sweet, T. D. (2000). An extension of Kuczek's argument to nonnearest neighbor contact processes. J. Theoret. Prob. 13, 1061–1081.Google Scholar
Nummelin, E. (1978). A splitting technique for Harris recurrent Markov chains. Z. Wahrscheinlichkeitsth. 43, 309–318.Google Scholar
Raimond, O. and Schapira, B. (2012). Random walks with occasionally modified transition probabilities. Submitted. Available at http://arxiv.org/abs/0911.3886v2.Google Scholar
Stacey, A. M. (2003). Partial immunization processes. Ann. Appl. Prob. 13, 669–690.Google Scholar
Thorisson, H. (2000). Coupling, Stationarity, and Regeneration. Springer, New York.CrossRefGoogle Scholar
Tzioufas, A. (2011). On the growth of the one-dimensional reverse immunization contact processes. J. Appl. Prob. 48, 611–623.Google Scholar