This article introduces a novel methodology to model the hierarchical dependence structure of manifest variables (MVs). This is done by reconstructing their correlation matrix considering a hierarchy of latent factors which forms an ultrametric correlation matrix. The proposed ultrametric factor analysis model will be shown to obtain reliable, unidimensional, and unique hierarchical factors. This approach addresses the limitations of traditional factor analysis methods that often oversimplify the multidimensional and complex relationships among MVs. The article provides an in-depth mathematical description of the proposed model, as well as an algorithm for parameter estimation. An extensive simulation study with
$3,000$ generated samples validates the proposal across twelve different scenarios. Finally, we demonstrate the potential of the proposed model using a real data set that is a benchmark in psychological research.