We show that three- and four-stage Bott manifolds are classified up to diffeomorphism by their integral cohomology rings. In addition, any cohomology ring isomorphism between two three-stage Bott manifolds can be realized by a diffeomorphism between the Bott manifolds.