We prove optimal improvements of the Hardy inequality on the hyperbolic space. Here, optimal means that the resulting operator is critical in the sense of Devyver, Fraas, and Pinchover (2014), namely the associated inequality cannot be further improved. Such inequalities arise from more general, optimal ones valid for the operator $ P_{\lambda }:= -\Delta _{{\open H}^{N}} - \lambda $ where 0 ⩽ λ ⩽ λ1(ℍN) and λ1(ℍN) is the bottom of the L2 spectrum of $-\Delta _{{\open H}^{N}} $, a problem that had been studied in Berchio, Ganguly, and Grillo (2017) only for the operator $P_{\lambda _{1}({\open H}^{N})}$. A different, critical and new inequality on ℍN, locally of Hardy type is also shown. Such results have in fact greater generality since they are proved on general Cartan-Hadamard manifolds under curvature assumptions, possibly depending on the point. Existence/nonexistence of extremals for the related Hardy-Poincaré inequalities are also proved using concentration-compactness technique and a Liouville comparison theorem. As applications of our inequalities, we obtain an improved Rellich inequality and we derive a quantitative version of Heisenberg-Pauli-Weyl uncertainty principle for the operator $P_\lambda.$