Book contents
- Frontmatter
- Dedication
- Contents
- Introduction
- 1 Markov Decision Problems
- 2 A Tauberian Theorem and Uniform ∈-Optimality in Hidden Markov Decision Problems
- 3 Strategic-Form Games: A Review
- 4 Stochastic Games: The Model
- 5 Two-Player Zero-Sum Discounted Games
- 6 Semi-Algebraic Sets and the Limit of the Discounted Value
- 7 B-Graphs and the Continuity of the Limit limλ→0 ʋλ(s;q,r)
- 8 Kakutani’s Fixed-Point Theorem and Multiplayer Discounted Stochastic Games
- 9 Uniform Equilibrium
- 10 The Vanishing Discount Factor Approach and Uniform Equilibrium in Absorbing Games
- 11 Ramsey’s Theorem and Two-Player Deterministic Stopping Games
- 12 Infinite Orbits and Quitting Games
- 13 Linear Complementarity Problems and Quitting Games
- References
- Index
5 - Two-Player Zero-Sum Discounted Games
Published online by Cambridge University Press: 05 May 2022
Book contents
- Frontmatter
- Dedication
- Contents
- Introduction
- 1 Markov Decision Problems
- 2 A Tauberian Theorem and Uniform ∈-Optimality in Hidden Markov Decision Problems
- 3 Strategic-Form Games: A Review
- 4 Stochastic Games: The Model
- 5 Two-Player Zero-Sum Discounted Games
- 6 Semi-Algebraic Sets and the Limit of the Discounted Value
- 7 B-Graphs and the Continuity of the Limit limλ→0 ʋλ(s;q,r)
- 8 Kakutani’s Fixed-Point Theorem and Multiplayer Discounted Stochastic Games
- 9 Uniform Equilibrium
- 10 The Vanishing Discount Factor Approach and Uniform Equilibrium in Absorbing Games
- 11 Ramsey’s Theorem and Two-Player Deterministic Stopping Games
- 12 Infinite Orbits and Quitting Games
- 13 Linear Complementarity Problems and Quitting Games
- References
- Index
Summary
In this chapter, we extend the notion of discounted payoff to the model of stochastic games, and we define the concept of discounted equilibrium. We then prove that every two-player zero-sum stochastic game admits a discounted value, and that each player has a stationary discounted optimal strategy. The proof uses the same tools we employed in Chapter~\ref{section:mdp} to prove that in Markov decision problems the decision maker has a stationary discounted optimal strategy.
We finally prove that the discounted value is continuous in the parameters of the game, namely the payoff function, the transition function, and the discount factor.
- Type
- Chapter
- Information
- A Course in Stochastic Game Theory , pp. 62 - 81Publisher: Cambridge University PressPrint publication year: 2022