Book contents
- Frontmatter
- Contents
- Preface
- Notation and Conventions
- 1 Introduction
- 2 Lyapunov Functions and Classification of Markov Chains
- 3 Down-Crossing Probabilities for Transient Markov Chain
- 4 Limit Theorems for Transient and Null Recurrent Markov Chains with Drift Proportional to 1/x
- 5 Limit Theorems for Transient Markov Chains with Drift Decreasing More Slowly Than 1/x
- 6 Asymptotics for Renewal Measure for Transient Markov Chain via Martingale Approach
- 7 Doob’s h-Transform: Transition from Recurrent to Transient Chain and Vice Versa
- 8 Tail Analysis for Recurrent Markov Chains with Drift Proportional to 1/x
- 9 Tail Analysis for Positive Recurrent Markov Chains with Drift Going to Zero More Slowly Than 1/x
- 10 Markov Chains with Asymptotically Non-Zero Drift in Cramér Case
- 11 Applications
- References
- Author Index
- Subject Index
7 - Doob’s h-Transform: Transition from Recurrent to Transient Chain and Vice Versa
Published online by Cambridge University Press: aN Invalid Date NaN
- Frontmatter
- Contents
- Preface
- Notation and Conventions
- 1 Introduction
- 2 Lyapunov Functions and Classification of Markov Chains
- 3 Down-Crossing Probabilities for Transient Markov Chain
- 4 Limit Theorems for Transient and Null Recurrent Markov Chains with Drift Proportional to 1/x
- 5 Limit Theorems for Transient Markov Chains with Drift Decreasing More Slowly Than 1/x
- 6 Asymptotics for Renewal Measure for Transient Markov Chain via Martingale Approach
- 7 Doob’s h-Transform: Transition from Recurrent to Transient Chain and Vice Versa
- 8 Tail Analysis for Recurrent Markov Chains with Drift Proportional to 1/x
- 9 Tail Analysis for Positive Recurrent Markov Chains with Drift Going to Zero More Slowly Than 1/x
- 10 Markov Chains with Asymptotically Non-Zero Drift in Cramér Case
- 11 Applications
- References
- Author Index
- Subject Index
Summary
Chapter 7 is the most conceptual part of the book. Our purpose here is to describe, without superfluous details, a change of measure strategy which allows us to transform a recurrent chain into a transient one, and vice versa. It is motivated by the exponential change of measure technique which goes back to Cramer. In the context of large deviations in collective risk theory, this technique allows us to transform a negatively drifted random walk into one with positive drift. Doob’s h-transform is the most natural substitute for an exponential change of measure in the context of Lamperti’s problem, that is, in the context of Markov chains with asymptotically zero drift.
Such transformations connect naturally previous chapters on asymptotic behaviour of transient chains with subsequent chapters, which are devoted to recurrent chains. A very important, in comparison with the classical Doob’s h-transform, the novelty consists in the fact that we use weight functions which are not necessarily harmonic, they are only asymptotically harmonic at infinity. The main challenge is to identify such functions under various drift scenarios.
Keywords
- Type
- Chapter
- Information
- Markov Chains with Asymptotically Zero DriftLamperti's Problem, pp. 221 - 235Publisher: Cambridge University PressPrint publication year: 2025