Hostname: page-component-cd9895bd7-jn8rn Total loading time: 0 Render date: 2024-12-26T15:33:18.812Z Has data issue: false hasContentIssue false

On top or underneath: where does the general factor of psychopathology fit within a dimensional model of psychopathology?

Published online by Cambridge University Press:  23 April 2020

Philip Hyland*
Affiliation:
Department of Psychology, Maynooth University, Kildare, Ireland
Jamie Murphy
Affiliation:
School of Psychology, Ulster University, Derry, Northern Ireland
Mark Shevlin
Affiliation:
School of Psychology, Ulster University, Derry, Northern Ireland
Richard P. Bentall
Affiliation:
Department of Psychology, University of Sheffield, Sheffield, England
Thanos Karatzias
Affiliation:
Edinburgh Napier University, School of Health & Social Care, Edinburgh, Scotland NHS Lothian, Rivers Centre for Traumatic Stress, Edinburgh, Scotland
Grace W.K. Ho
Affiliation:
The Hong Kong Polytechnic University, School of Nursing, Hung Hom, Hong Kong
Daniel Boduszek
Affiliation:
School of Human and Health Sciences, University of Huddersfield, England SWPS University of Social Sciences and Humanities, Katowice, Poland
Eoin McElroy
Affiliation:
Department of Neuroscience, Psychology and Behaviour, University of Leicester, England
*
Author for correspondence: Philip Hyland, E-mail: [email protected]

Abstract

Background

Dimensional models of psychopathology are increasingly common and there is evidence for the existence of a general dimension of psychopathology (‘p’). The existing literature presents two ways to model p: as a bifactor or as a higher-order dimension. Bifactor models typically fit sample data better than higher-order models, and are often selected as better fitting alternatives but there are reasons to be cautious of such an approach to model selection. In this study the bifactor and higher-order models of p were compared in relation to associations with established risk variables for mental illness.

Methods

A trauma exposed community sample from the United Kingdom (N = 1051) completed self-report measures of 49 symptoms of psychopathology.

Results

A higher-order model with four first-order dimensions (Fear, Distress, Externalising and Thought Disorder) and a higher-order p dimension provided satisfactory model fit, and a bifactor representation provided superior model fit. Bifactor p and higher-order p were highly correlated (r = 0.97) indicating that both parametrisations produce near equivalent general dimensions of psychopathology. Latent variable models including predictor variables showed that the risk variables explained more variance in higher-order p than bifactor p. The higher-order model produced more interpretable associations for the first-order/specific dimensions compared to the bifactor model.

Conclusions

The higher-order representation of p, as described in the Hierarchical Taxonomy of Psychopathology, appears to be a more appropriate way to conceptualise the general dimension of psychopathology than the bifactor approach. The research and clinical implications of these discrepant ways of modelling p are discussed.

Type
Original Article
Copyright
Copyright © The Author(s), 2020. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Andrews, G., Goldberg, D. P., Krueger, R. F., Carpenter, W. T., Hyman, S. E., Sachdev, P., & Pine, D. S. (2009). Exploring the feasibility of a meta-structure for DSM-V and ICD-11: Could it improve utility and validity? Psychological Medicine, 39, 19932000. doi:10.1017/S0033291709990250.CrossRefGoogle ScholarPubMed
Bonifay, W., & Cai, L. (2017). On the complexity of item response theory models. Multivariate Behavioral Research, 52, 465484. http://dx.doi.org/10.1080/00273171.2017.1309262.Google ScholarPubMed
Bush, K., Kivlahan, D. R., McDonell, M. B., Fihn, S. D., & Bradley, K. A. (1998). The AUDIT alcohol consumption questions (AUDIT-C): An effective brief screening test for problem drinking. Ambulatory Care Quality Improvement Project (ACQUIP). Alcohol use disorders identification test. Achieves of Internal Medicine, 158, 17891795.CrossRefGoogle ScholarPubMed
Carragher, N., Teesson, M., Sunderland, M., Newton, N. C., Krueger, R. F., Conrod, P. J., … Slade, T. (2016). The structure of adolescent psychopathology: A symptom-level analysis. Psychological Medicine, 46, 981994. doi:10.1017/S0033291715002470.CrossRefGoogle ScholarPubMed
Caspi, A., Houts, R. M., Belsky, D. W., Goldman-Mellor, S. J., Harrington, H., Israel, S., … Moffitt, T. E. (2014). The p factor: One general psychopathology factor in the structure of psychiatric disorders? Clinical Psychological Science, 2, 119137. doi:10.1177/2167702613497473.CrossRefGoogle Scholar
Caspi, A., & Moffitt, T. (2018). All for one and one for all: Mental disorders in one dimension. The American Journal of Psychiatry, 175, 831844. https://doi.org/10.1176/appi.ajp.2018.17121383.CrossRefGoogle ScholarPubMed
Cloitre, M., Shevlin, M., Brewin, C. R., Bisson, J. I., Roberts, N. P., Maercker, A., … Hyland, P. (2018). The International Trauma Questionnaire (ITQ): Development of a self-report measure of ICD-11 PTSD and Complex PTSD. Acta Psychiatrica Scandinavica, 138, 536546. doi:10.1111/acps.12956.CrossRefGoogle ScholarPubMed
Constantinou, M. P., Goodyer, I. M., Eisler, I., Butler, S., Kraam, A., Scott, S., … Fonagy, P. (2019). Changes in general and specific psychopathology factors over a psychosocial intervention. Journal of the American Academy of Child and Adolescent Psychiatry, 58(8), 776786. 10.1016/j.jaac.2018.11.011CrossRefGoogle Scholar
Conway, C. C., Forbes, M. K., Forbush, K. T., Fried, E. I., Hallquist, M. N., Kotov, R., … Eaton, N. R. (2019b). A hierarchical taxonomy of psychopathology can transform mental health research. Perspectives on Psychological Science, 14, 419436. doi: 10.1177/1745691618810696.CrossRefGoogle Scholar
Conway, C. C., Latzman, R. D., & Krueger, R. F. (2019a). A meta-structural model of common clinical disorder and personality disorder symptoms. Journal of Personality Disorders, 34, 88106. doi: 10.1521/pedi_2019_33_383.CrossRefGoogle Scholar
Craver, C. S., Johnson, S. L., & Timpano, K. R. (2018). Toward a functional view of the p factor in psychopathology. Clinical Psychological Science, 5, 880889. doi:10.1177/2167702617710037.CrossRefGoogle Scholar
Dueber, D. M. (2017). Bifactor Indices Calculator: A Microsoft Excel-based tool to calculate various indices relevant to bifactor CFA models. Retrieved from https://dx.doi.org/10.13023/edp.tool.01.CrossRefGoogle Scholar
Felitti, V. J., Anda, R. F., Nordenberg, D., Williamson, D. F., Spitz, A. M., Edwards, V., … Marks, J. S. (1998). The relationship of adult health status to childhood abuse and household dysfunction. American Journal of Preventive Medicine, 14, 245258.CrossRefGoogle ScholarPubMed
Flora, D. B., & Curran, P. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9, 466491. doi:10.1037/1082-989X.9.4.466.CrossRefGoogle ScholarPubMed
Forbes, M. K., Kotov, R., Ruggero, C. J., Watson, D., Zimmerman, M., & Krueger, R. F. (2017). Delineating the joint hierarchical structure of clinical and personality disorders in an outpatient psychiatric sample. Comprehensive Psychiatry, 79, 1930. doi:10.1016/j.comppsych.2017.04.006.CrossRefGoogle Scholar
Goodkind, M., Eickhoff, S. B., Oathes, D. J., Jiang, Y., Chang, A., Jones-Hagata, L. B., … Etkin, A. (2015). Identification of a common neurobiological substrate for mental illness. JAMA Psychiatry, 72, 305315. doi:10.1001/jamapsychiatry.2014.2206.CrossRefGoogle ScholarPubMed
Greene, A. L., Eaton, N. R., Li, K., Forbes, M. K., Krueger, R. F., Markon, K. E., … Fried, E. I. (2019). Are fit indices used to test psychopathology structure biased? A simulation study. Journal of Abnormal Psychology, 128, 740764. doi:10.1037/abn0000434.CrossRefGoogle ScholarPubMed
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 155. doi:10.1080/10705519909540118.CrossRefGoogle Scholar
Hyland, P., Murphy, J., Shevlin, M., Carey, S., Vallieres, F., Murphy, D., & Elklit, A. (2018a). Correlates of a general psychopathology factor within a clinical sample of childhood sexual abuse survivors. Journal of Affective Disorders, 232, 109115. doi:10.1016/j.jad.2018.02.048.CrossRefGoogle Scholar
Hyland, P., Shevlin, M., Fyvie, C., & Karatzias, T. (2018b). Posttraumatic stress disorder (PTSD) and complex PTSD (CPTSD) in DSM-5 and ICD-11: Clinical and behavioural correlates. Journal of Traumatic Stress, 31, 174180. doi:10.1002/jts.22272.CrossRefGoogle Scholar
Kelleher, I., Harley, M., Murtagh, A., & Cannon, M. (2011). Are screening instruments valid for psychotic-like experiences? A validation study of screening questions for psychotic-like experiences using in-depth clinical interview. Schizophrenia Bulletin, 37, 362369.CrossRefGoogle ScholarPubMed
Kim, H., & Eaton, N. R. (2015). The hierarchical structure of common mental disorders: Connecting multiple levels of comorbidity, bifactor models, and predictive validity. Journal of Abnormal Psychology, 124, 10641078. doi:10.1037/abn0000113.CrossRefGoogle ScholarPubMed
Kotelnikova, Y., Weaver, C. A., & Clark, L. A. (2019). The joint structure of maladaptive personality traits and psychopathology. Journal of Research in Personality, 81, 6471. https://doi.org/10.1016/j.jrp.2019.05.007.CrossRefGoogle Scholar
Kotov, R., Chang, S. W., Fochtmann, L. J., Mojtabai, R., Carlson, G. A., Sedler, M. J., & Bromet, E. J. (2011). Schizophrenia in the internalizing-externalizing framework: A third dimension? Schizophrenia Bulletin, 37, 11681178. doi:10.1093/schbul/sbq024.CrossRefGoogle ScholarPubMed
Kotov, R., Krueger, R. F., Watson, D., Achenbach, T. M., Althoff, R. R., Bagby, R. M., … Zimmerman, M. (2017). The Hierarchical Taxonomy of Psychopathology (HiTOP): A dimensional alternative to traditional nosologies. Joural of Abnormal Psychology, 126, 454477. doi:10.1037/abn0000258.CrossRefGoogle ScholarPubMed
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16, 606613. doi:10.1046/j.1525-1497.2001.016009606.x.CrossRefGoogle ScholarPubMed
Krueger, R. F., Caspi, A., Moffitt, T. E., & Silva, P. A. (1998). The structure and stability of common mental disorders (DSM-III-R): A longitudinal-epidemiological study. Journal of Abnormal Psychology, 107, 216227.CrossRefGoogle ScholarPubMed
Laceulle, O. M., Vollebergh, W. A. M., & Ormel, J. (2015). The structure of psychopathology in adolescence. Clinical Psychological Science, 3, 850860.CrossRefGoogle Scholar
Lahey, B. B., Applegate, B., Hakes, J. K., Zald, D. H., Hariri, A. R., & Rathouz, P. J. (2012). Is there a general factor of prevalent psychopathology during adulthood? Journal of AbnormalPsychology, 121, 971977.Google Scholar
Lahey, B. B., Rathouz, P. J., Keenan, K., Stepp, S. D., Loeber, R., & Hipwell, A. E. (2015). Criterion validity of the general factor of psychopathology in a prospective study of girls. Journal of Child Psychology and Psychiatry, 56, 415422. doi:10.1111/jcpp.12300.CrossRefGoogle Scholar
Markon, K. E. (2019). Bifactor and hierarchical models: Specification, inference, and interpretation. Annual Review of Clinical Psychology, 15, 5169. doi:10.1146/annurev-clinpsy-050718-095522.CrossRefGoogle ScholarPubMed
Martel, M. M., Pan, P. M., Hoffmann, M. S., Gadelha, A., do Rosario, M. C., Mari, J. J., … Salum, G. A. (2017). A general sychopathology factor (p factor) in children: Structural model analysis and external validation through familial risk and child global executive function. Journal of Abnormal Psychology, 126, 137148. doi:10.1037/abn0000205.CrossRefGoogle ScholarPubMed
McElroy, E., Belsky, J., Carragher, N., Fearon, P., & Patalay, P. (2018). Developmental stability of general and specific factors of psychopathology from early childhood to adolescence: Dynamic mutualism or p-differentiation? Journal of Child Psychology and Psychiatry, 59, 667675. doi:10.1111/jcpp.12849.Google ScholarPubMed
Mc Manus, S., Meltzer, H., Brugha, T., Bebbington, P., & Jenkins, R. (2009). Adult Psychiatric Morbidity in England, 2007: Results of a Household Survey UK. The Health and Social Care Information Centre, Social Care Statistics; 2009. UK Data rchive Study Number 6379.Google Scholar
Meehl, P. E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology, 46, 806834. http://dx.doi.org/10.1037/0022-006X.46.4.806.CrossRefGoogle Scholar
Murray, A. L., Eisner, M., & Ribeaud, D. (2016). The development of the general factor of psychopathology ‘P Factor’ through childhood and adolescence. Journal of Abnormal Child Psychology, 44, 15731586. doi:10.1007/s10802-016-0132-1.CrossRefGoogle ScholarPubMed
Muthén, L. K., & Muthén, B. O. (2017). Mplus user's guide (8th ed.). Los Angeles: Muthén & Muthén.Google Scholar
Patalay, P., Fonagy, P., Deighton, J., Belsky, J., Vostanis, P., & Wolpert, M. (2015). A general psychopathology factor in early adolescence. British Journal of Psychiatry, 207, 1522. doi:10.1192/bjp.bp.114.149591.CrossRefGoogle ScholarPubMed
Raftery, A. E. (1995). Bayesian model selection in social research. Sociological Methodology, 5, 111163.CrossRefGoogle Scholar
Reininghaus, U., Böhnke, J. R., Hosang, G. M., Farmer, A., Burns, T., McGuffin, P., & Bentall, R. P. (2016). Evaluation of the validity and utility of a transdiagnostic psychosis dimension encompassing schizophrenia and bipolar disorder. British Journal of Psychiatry, 209, 107113. doi:10.1192/bjp.bp.115.167882.CrossRefGoogle ScholarPubMed
Reininghaus, U., Priebe, S., & Bentall, R. P. (2013). Testing the psychopathology of psychosis: Evidence for a general psychosis dimension. Schizophrenia Bulletin, 39, 884895. doi:10.1093/schbul/sbr182.CrossRefGoogle ScholarPubMed
Reise, S. P., Kim, D. S., Mansolf, M., & Widaman, K. F. (2016). Is the bifactor model a better model or is it just better at modeling implausible responses? Application of iteratively reweighted least squares to the Rosenberg Self-Esteem Scale. Multivariate Behavioral Research, 51, 818838. doi:10.1080/00273171.2016.1243461.Google ScholarPubMed
Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016). Applying bifactor statistical indices in the evaluation of psychological measures. Journal of Personality Assessment, 98, 223237. doi:10.1080/00223891.2015.1089249.CrossRefGoogle ScholarPubMed
Ruggero, C. J., Kotov, R., Hopwood, C. J., First, M., Clark, L. A., Skodol, A. E., & Zimmermann, J. (2019). Integrating the Hierarchical Taxonomy of Psychopathology (HiTOP) into clinical practice. Journal of Consulting and Clinical Psychology, 87(12), 10691084. 10.1037/ccp0000452CrossRefGoogle ScholarPubMed
Spitzer, R., Kroenke, K., & Williams, J. L. B. (2006). A brief measure for assessing generalized anxiety disorder—the GAD-7. Archives of Internal Medicine, 166, 10921097. doi:10.1001/archinte.166.10.1092.CrossRefGoogle ScholarPubMed
Tackett, J. L., Lahey, B. B., van Hulle, C., Waldman, I., Krueger, R. F., & Rathouz, P. J. (2013). Common genetic influences on negative emotionality and a general psychopathology factor in childhood and adolescence. Journal of Abnorm Psychology, 122, 11421153.CrossRefGoogle Scholar
Taylor, M. J., Martin, J., Lu, Y., Brikell, I., Lundström, S., Larsson, H., & Lichtenstein, P. (2019). Association of genetic risk factors for psychiatric disorders and traits of these disorders in a Swedish population twin sample. JAMA Psychiatry, 76, 280–289. doi:10.1001/jamapsychiatry.2018.3652.CrossRefGoogle Scholar
United Nations (2019). World Population Prospects 2019, viewed 27 November 2019. Retrieved from https://population.un.org/wpp/.Google Scholar
van Bork, R., Epskamp, S., Rhemtulla, M., Borsboom, D., & van der Maas, H. L. J. (2017). What is the p-factor of psychopathology? Some risks of general factor modelling. Theory & Psychology, 27, 759773. doi:10.1177/0959354317737185.CrossRefGoogle Scholar
Varese, F., Smeets, F., Drukker, M., Lieverse, R., Lataster, T., Viechtbauer, W., … Bentall, R. P. (2012). Childhood adversities increase the risk of psychosis: A meta-analysis of patient-control, prospective- and cross-sectional cohort studies. Schizophrenia Bulletin, 38, 661671. https://doi.org/10.1093/schbul/sbs050.CrossRefGoogle ScholarPubMed
Vassos, E., Pedersen, C. B., Murray, R. M., Collier, D. A., & Lewis, C. M. (2012). Meta-analysis of the association of urbanicity with schizophrenia. Schizophrenia Bulletin, 38, 11181123.CrossRefGoogle ScholarPubMed
Vollebergh, W. A., Iedema, J., Bijl, R. V., de Graaf, R., Smit, F., & Ormel, J. (2001). The structure and stability of common mental disorders: The NEMESIS study. Achieves of General Psychiatry, 58, 597603.CrossRefGoogle ScholarPubMed
Waldman, I. D., Poore, H. E., van Hulle, C., Rathouz, P. J., & Lahey, B. B. (2016). External validity of a hierarchical dimensional model of child and adolescent psychopathology: Tests using confirmatory factor analyses and multivariate behavior genetic analyses. Journal of Abnormal Psychology, 125, 10531066. doi:10.1037/abn0000183.CrossRefGoogle ScholarPubMed
Waszczuk, M., Kotov, R., Ruggero, C., Gamez, W., & Watson, D. (2017a). Hierarchical structure of emotional disorders: From individual symptoms to the spectrum. Journal of Abnorm Psychology, 126, 613634. doi:10.1037/abn0000264.CrossRefGoogle Scholar
Waszczuk, M. A., Zimmerman, M., Ruggero, C., Li, K., MacNamara, A., Weinberg, A., … Kotov, R. (2017b). What do clinicians treat: Diagnoses or symptoms? The incremental validity of a symptom-based, dimensional characterization of emotional disorders in predicting medication prescription patterns. Comprehensive Psychiatry, 79, 8088. doi:10.1016/j.comppsych.2017.04.004.CrossRefGoogle Scholar
Watts, A. L., Poore, H. E., & Waldman, I. D. (2019). Riskier tests of the validity of the bifactor model of psychopathology. Clinical Psychological Science, 7, 12851303. https://doi.org/10.1177/2167702619855035.CrossRefGoogle Scholar
Weathers, F. W., Litz, B. T., Keane, T. M., Palmieri, P. A., Marx, B. P., & Schnurr, P. P. (2013). The PTSD Checklist for DSM-5 (PCL-5). Scale available from the National Center for PTSD Retrieved from http://www.ptsd.va.gov.Google Scholar
Wright, A. G. C., & Simms, L. J. (2015). A metastructural model of mental disorders and pathological personality traits. Psychological Medicine, 45, 23092319. doi:10.1017/S0033291715000252.CrossRefGoogle ScholarPubMed
Supplementary material: File

Hyland et al. supplementary material

Table S1

Download Hyland et al. supplementary material(File)
File 17.3 KB