We consider conjugacy classes in a locally compact group G that support finite G-invariant measures. If G is a property (M) extension of an abelian group, in particular, if G is a metabelian group, then any such conjugacy class is relatively compact. As an application, centralisers of lattices in such groups have bounded conjugacy classes. We use the same techniques to obtain results in the case of totally disconnected, locally compact groups.