Hostname: page-component-586b7cd67f-rcrh6 Total loading time: 0 Render date: 2024-11-30T19:07:29.214Z Has data issue: false hasContentIssue false

Structure of psychopathology in adolescents and its association with high-risk personality traits

Published online by Cambridge University Press:  26 January 2023

Samantha J. Lynch*
Affiliation:
The Matilda Centre for Research in Mental Health and Substance Use, Faculty of Medicine and Health, The University of Sydney, Sydney, Australia
Matthew Sunderland
Affiliation:
The Matilda Centre for Research in Mental Health and Substance Use, Faculty of Medicine and Health, The University of Sydney, Sydney, Australia
Miriam K. Forbes
Affiliation:
Centre for Emotional Health, School of Psychological Sciences, Macquarie University, Sydney, Australia
Maree Teesson
Affiliation:
The Matilda Centre for Research in Mental Health and Substance Use, Faculty of Medicine and Health, The University of Sydney, Sydney, Australia
Nicola C. Newton
Affiliation:
The Matilda Centre for Research in Mental Health and Substance Use, Faculty of Medicine and Health, The University of Sydney, Sydney, Australia
Cath Chapman
Affiliation:
The Matilda Centre for Research in Mental Health and Substance Use, Faculty of Medicine and Health, The University of Sydney, Sydney, Australia
*
Corresponding author: Samantha Lynch, email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

The present study examined high-risk personality traits and associations with psychopathology across multiple levels of a hierarchical-dimensional model of psychopathology in a large adolescent, general population sample. Confirmatory factor analyses were run using data from two randomized controlled trials of Australian adolescents (N = 8,654, mean age = 13.01 years, 52% female). A higher-order model – comprised of general psychopathology, fear, distress, alcohol use/harms, and conduct/inattention dimensions – was selected based on model fit, reliability, and replicability. Indirect-effects models were estimated to examine the unique associations between high-risk personality traits (anxiety sensitivity, negative thinking, impulsivity, and sensation seeking) and general and specific dimensions and symptoms of psychopathology. All personality traits were positively associated with general psychopathology. After accounting for general psychopathology, anxiety sensitivity was positively associated with fear; negative thinking was positively associated with distress; impulsivity was positively associated with conduct/inattention; and sensation seeking was positively associated with alcohol use/harms and conduct/inattention, and negatively associated with fear. Several significant associations between personality traits and individual symptoms remained after accounting for general and specific psychopathology. These findings contribute to our understanding of the underlying structure of psychopathology among adolescents and have implications for the development of personality-based prevention and early intervention programs.

Type
Regular Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2023. Published by Cambridge University Press

Introduction

Personality is a well-established risk factor for psychopathology, with evidence for links with a variety of mental and substance use disorders (Kotov et al., 2010; Tackett, Reference Tackett2006; Watson et al., Reference Watson, Gamez and Simms2005, Reference Watson, Stanton, Khoo, Ellickson-Larew and Stasik-O’Brien2019; Widiger et al., Reference Widiger, Sellbom, Chmielewski, Clark, DeYoung, Kotov, Krueger, Lynam, Miller, Mullins-Sweatt, Samuel, South, Tackett, Thomas, Watson and Wright2019; den Akker et al., Reference den Akker, Prinzie, Deković, De Haan, Asscher and Widiger2013). However, there are high rates of comorbidity among disorders, making it difficult to identify reliable links between personality traits and mental disorders. Recent advances in the study of the underlying structure of psychopathology supports a data-driven, hierarchical-dimensional model of psychopathology which accounts for comorbidity among disorders and enables the study of relations with external variables at various levels of specificity. Yet, only a small number of studies have examined the associations between personality traits and psychopathology within this framework among adolescents to date (Lynch et al., Reference Lynch, Sunderland, Newton and Chapman2021). Further, past research has primarily focused on associations between normal-range trait domains (e.g., “the Big 5” or five factor model traits) and distinct disorders (Sellbom et al., Reference Sellbom, Carragher, Sunderland, Calear and Batterham2020). Examining established high-risk personality traits (e.g., lower-order facets of neuroticism or sub-dimensions of disinhibition) may be informative in terms of refining our understanding of the underlying structure of psychopathology and for advancing knowledge of personality-related risk for psychopathology. Focusing on these associations in a hierarchical-dimensional model of psychopathology, for example, may be particularly useful for clarifying the role personality may play in the development of general and specific forms of psychopathology, from individual symptoms up to broad transdiagnostic dimensions.

Hierarchical-dimensional models of psychopathology

Psychopathology has historically been conceptualized in terms of discrete diagnostic categories. However, categorical approaches to conceptualizing psychopathology tend to have poor reliability and low specificity, as evidenced by the high rates of comorbidity between disorders and heterogeneity within disorders (Kotov et al., Reference Kotov, Krueger, Watson, Achenbach, Althoff, Michael Bagby, Brown, Carpenter, Caspi, Anna Clark, Eaton, Forbes, Forbush, Goldberg, Hasin, Hyman, Ivanova, Lynam, Markon and Zimmerman2017; Ofrat & Krueger, Reference Ofrat and Krueger2012). In response to these issues, there has been a renaissance of empirical studies examining the underlying structure of psychopathology. This work has generated a wealth of evidence for conceptualizing psychopathology in a hierarchical-dimensional framework, such as the Hierarchical Taxonomy of Psychopathology (HiTOP; Kotov et al., Reference Kotov, Krueger, Watson, Achenbach, Althoff, Michael Bagby, Brown, Carpenter, Caspi, Anna Clark, Eaton, Forbes, Forbush, Goldberg, Hasin, Hyman, Ivanova, Lynam, Markon and Zimmerman2017, Reference Kotov, Krueger, Watson, Cicero, Conway, DeYoung, Eaton, Forbes, Hallquist, Latzman, Mullins-Sweatt, Ruggero, Simms, Waldman, Waszczuk and Wright2021). At the apex of hierarchical-dimensional models sits a general factor of psychopathology, which captures shared variance among mental and substance use disorders. Beneath the general factor sit more specific factors that reflect shared variance among closely related disorders, such as internalizing and externalizing dimensions. Internalizing captures comorbidity among, for example, phobias, eating, obsessive-compulsive, and mood and anxiety-related disorders, whereas externalizing reflects shared variance among, for example, substance use, conduct, antisocial and impulse related disorders. There is also evidence that these dimensions may be partitioned into even narrower dimensions (Krueger et al., Reference Krueger, Hobbs, Conway, Dick, Dretsch, Eaton, Forbes, Forbush, Keyes, Latzman, Michelini, Patrick, Sellbom, Slade, South, Sunderland, Tackett, Waldman and Waszczuk2021; Watson et al., Reference Watson, Levin-Aspenson, Waszczuk, Conway, Dalgleish, Dretsch, Eaton, Forbes, Forbush, Hobbs, Michelini, Nelson, Sellbom, Slade, South, Sunderland, Waldman, Witthöft and Wright2022). For example, internalizing includes sub-dimensions of fear and distress, and externalizing includes sub-dimensions of substance use and antisocial behavior.

Personality and psychopathology

Previous research has consistently shown that there are strong associations between certain personality traits and certain forms of psychopathology (Brandes & Tackett, Reference Brandes and Tackett2019; Haltigan et al., Reference Haltigan, Aitken, Skilling, Henderson, Hawke, Battaglia, Strauss, Szatmari and Andrade2018; Kotov et al., 2010; Widiger et al., Reference Widiger, Sellbom, Chmielewski, Clark, DeYoung, Kotov, Krueger, Lynam, Miller, Mullins-Sweatt, Samuel, South, Tackett, Thomas, Watson and Wright2019). For example, neuroticism has been established as an important risk factor for internalizing and general psychopathology dimensions (Brandes et al., Reference Brandes, Herzhoff, Smack and Tackett2019; Castellanos-Ryan et al., Reference Castellanos-Ryan, Briere, O’Leary-Barrett, Banaschewski, Bokde, Bromberg, Biichel, Flor, Frouin, Gallinat, Garavan, Martinot, Nees, Paus, Pausova, Rietschel, Smolka, Robbins and Whelan2016; Etkin et al., Reference Etkin, Ibáñez, Ortet and Mezquita2021; Kotov et al., 2010). Similarly, antagonism and impulsivity traits are both associated with externalizing and substance misuse problems (Castellanos-Ryan et al., Reference Castellanos-Ryan, Briere, O’Leary-Barrett, Banaschewski, Bokde, Bromberg, Biichel, Flor, Frouin, Gallinat, Garavan, Martinot, Nees, Paus, Pausova, Rietschel, Smolka, Robbins and Whelan2016; Etkin et al., Reference Etkin, De Caluwé, Ibáñez, Ortet and Mezquita2022; Kotov et al., 2010; Lynam & Miller, Reference Lynam and Miller2019). However, currently very little is known about associations at the subfactor (e.g., fear and distress) and symptom levels of hierarchical-dimensional models of psychopathology (Brandes & Tackett, Reference Brandes and Tackett2019; Kotov et al., 2010). Similarly, although personality can also be conceptualized hierarchically, most research thus far has focused on broad personality traits, rather than the underlying facets or aspects of these traits (Brandes & Tackett, Reference Brandes and Tackett2019; Tackett, Reference Tackett2006; Watts et al., Reference Watts, Poore, Lilienfeld and Waldman2019). Amid renewed calls for research on the integration of and differentiation between personality and psychopathology (Hopwood et al., Reference Hopwood, Wright and Bleidorn2022; Wright & Hopwood, Reference Wright and Hopwood2022), exploration of associations between narrower components of personality and subfactor and symptom levels of psychopathology could help clarify the structure of lower levels of a hierarchical model of psychopathology or point to shared or distinguishable elements of personality and psychopathology.

The four-factor model of vulnerability integrates and distills previous research linking neuroticism as well as inhibited and disinhibited personality traits to substance misuse and comorbid psychopathology via distinct cognitive and motivational pathways (Castellanos-Ryan et al., Reference Castellanos-Ryan, Briere, O’Leary-Barrett, Banaschewski, Bokde, Bromberg, Biichel, Flor, Frouin, Gallinat, Garavan, Martinot, Nees, Paus, Pausova, Rietschel, Smolka, Robbins and Whelan2016; Castellanos-Ryan & Conrod, Reference Castellanos-Ryan and Conrod2012). Although this model was initially conceptualized as a model of personality-based risk for substance use, there is considerable evidence that the traits are also associated with higher levels of and increased risk for other forms of psychopathology (Carragher et al., Reference Carragher, Teesson, Sunderland, Newton, Krueger, Conrod, Barrett, Champion, Nair and Slade2016; Castellanos-Ryan et al., Reference Castellanos-Ryan, Briere, O’Leary-Barrett, Banaschewski, Bokde, Bromberg, Biichel, Flor, Frouin, Gallinat, Garavan, Martinot, Nees, Paus, Pausova, Rietschel, Smolka, Robbins and Whelan2016). In contrast to comprehensive models of personality, such as the Big Five, the four-factor model of vulnerability is comprised of four particularly compelling personality-based risk factors for substance use problems, and psychopathology more broadly (Castellanos-Ryan & Conrod, Reference Castellanos-Ryan and Conrod2012). Inhibited/neurotic traits of negative thinking (tendency to experience hopelessness and low positive affect) and anxiety sensitivity (fear of anxiety-related physical sensations relating to beliefs that such sensation could lead to harmful consequences) are associated with mood and anxiety-related problems, as well as increased substance use problems (to manage or relieve symptoms of anxiety/depression). Disinhibition is partitioned into two sub-domains: impulsivity, which broadly reflects a failure to inhibit behaviors likely to result in negative consequences, and sensation seeking, which reflects a willingness to take risks for the sake of novel experiences. Individuals high in impulsivity have difficulties with emotion and behavioral regulation, tend to experience more conduct related problems and are at increased risk for substance misuse through enhancement, coping and conformity motives. Whereas individuals high in sensation seeking are more likely to develop substance use problems due to a heightened susceptibility to the rewarding properties of alcohol and other substances. Sensation seeking appears to be more directly related to substance misuse problems than other externalizing related problems (Castellanos-Ryan & Conrod, Reference Castellanos-Ryan and Conrod2011).

Prior research on the four-factor model of vulnerability and hierarchical-dimensional model of psychopathology have revealed theoretically aligned patterns of association with transdiagnostic dimensions (though there are some exceptions). For example, negative thinking and anxiety sensitivity appear to be prospectively and concurrently associated with greater internalizing and general psychopathology (Carragher et al., Reference Carragher, Teesson, Sunderland, Newton, Krueger, Conrod, Barrett, Champion, Nair and Slade2016; Castellanos-Ryan et al., Reference Castellanos-Ryan, Briere, O’Leary-Barrett, Banaschewski, Bokde, Bromberg, Biichel, Flor, Frouin, Gallinat, Garavan, Martinot, Nees, Paus, Pausova, Rietschel, Smolka, Robbins and Whelan2016), and either unrelated or inversely related to externalizing (although one study reported a positive association between negative thinking and externalizing, but internalizing symptoms were not included in the model (e.g., Castellanos-Ryan & Conrod, Reference Castellanos-Ryan and Conrod2011). Similarly, impulsivity and sensation seeking appear to be more closely related to externalizing related dimensions, with impulsivity more closely related to conduct/general externalizing and sensation seeking more closely aligned with substance misuse and related harms. One study also reported a negative association between sensation seeking and negative thinking (Carragher et al., Reference Carragher, Teesson, Sunderland, Newton, Krueger, Conrod, Barrett, Champion, Nair and Slade2016). Exploration of unique associations with sub-dimensions of internalizing and externalizing, or indeed individual symptoms, may help clarify some of the inconsistent findings from previous studies. To our knowledge, no studies have examined associations between these high-risk personality traits and lower levels of a hierarchical-dimensional model of psychopathology.

Methodological considerations

Despite strong empirical support for hierarchical-dimensional models of psychopathology, there are some outstanding conceptual and methodological issues. Critically, there is currently no clear consensus on which statistical model is most appropriate for studying the structure of psychopathology. Correlated factors, bifactor and higher-order models appear most frequently in the literature (Forbes, Greene, et al., Reference Forbes, Greene, Levin-Aspenson, Watts, Hallquist, Lahey, Markon, Patrick, Tackett, Waldman, Wright, Caspi, Ivanova, Kotov, Samuel, Eaton and Krueger2021; Lahey et al., Reference Lahey, Moore, Kaczkurkin and Zald2021). These models are closely related yet offer different interpretations of the underlying structure of psychopathology. For example, a higher-order model’s general factor reflects the shared variance among the lower-order specific factors, whereas a bifactor model’s general factor directly reflects shared variance among all indicators. Further, in correlated factors and higher-order models, the specific factors reflect shared variance among a set of observed variables, whereas in a bifactor model the specific factors are uncorrelated and reflect variance unique to the factor (after the shared variance among indicators is accounted for by the general factor). When these models are directly compared using traditional goodness-of-fit statistics, the bifactor model typically outperforms the others (e.g., Greene et al., Reference Greene, Eaton, Li, Forbes, Krueger, Markon, Waldman, Cicero, Conway, Docherty, Fried, Ivanova, Jonas, Latzman, Patrick, Reininghaus, Tackett, Wright and Kotov2019). However, there are increasing concerns about relying on goodness-of-fit statistics to adjudicate between models, as bifactor models tend to overfit data which can result in inflated goodness-of-fit statistics and consequently lead to the premature dismissal of other plausible structures (Bonifay et al., Reference Bonifay, Lane and Reise2017). As such, there have been calls to consider additional metrics for model reliability and replicability when studying the underlying structure of psychopathology (Forbes, Greene, et al., Reference Forbes, Greene, Levin-Aspenson, Watts, Hallquist, Lahey, Markon, Patrick, Tackett, Waldman, Wright, Caspi, Ivanova, Kotov, Samuel, Eaton and Krueger2021; Rodriguez et al., Reference Rodriguez, Reise and Haviland2016b). Although very few studies have reported on these additional metrics to date, two previous studies have found a higher-order model to outperform a bifactor model of psychopathology in young people (Lees et al., Reference Lees, Squeglia, McTeague, Forbes, Krueger, Sunderland, Baillie, Koch, Teesson and Mewton2020; Sunderland et al., Reference Sunderland, Forbes, Mewton, Baillie, Carragher, Lynch, Batterham, Calear, Chapman, Newton, Teesson and Slade2020).

Another important methodological issue that requires further attention is the unit of measurement used for observed variables. Much of the past research on hierarchical-dimensional models has been based on diagnostic level indicators (Forbes, Sunderland, et al., Reference Forbes, Sunderland, Rapee, Batterham, Calear, Carragher, Ruggero, Zimmerman, Baillie, Lynch, Mewton, Slade and Krueger2021). This may inadvertently constrain models to the framework of the prevailing diagnostic taxonomies. Symptom-level approaches are theorized to be better able to capture the underlying structure of psychopathology because they are not bound by the constraints of existing diagnostic categories. Further, symptom-level approaches may be more sensitive to detecting emerging forms of psychopathology (e.g., cases in which symptoms are present, but the individual does not meet full diagnostic criteria; Forbes, Sunderland, et al., Reference Forbes, Sunderland, Rapee, Batterham, Calear, Carragher, Ruggero, Zimmerman, Baillie, Lynch, Mewton, Slade and Krueger2021). Given that many mental disorders first emerge during adolescence (Costello et al., Reference Costello, Copeland and Angold2011; Kessler et al., Reference Kessler, Ormel, Petukhova, McLaughlin, Green, Russo, Stein, Zaslavsky, Aguilar-Gaxiola, Alonso, Andrade, Benjet, de Girolamo, de Graaf, Demyttenaere, Fayyad, Haro, Hu, Karam and Üstün2011), it is likely that symptom-level analyses may be more appropriate for studying psychopathology in adolescents. Another advantage of symptom-level analysis is that it enables the identification of important symptoms with unique links to risk or vulnerability factors. These symptoms may highlight potential etiological mechanisms and therefore could be salient intervention targets. In summary, symptom-level analyses are important both for advancing our understanding of the underlying causes of mental and substance use disorders and ultimately, for facilitating the identification of better intervention targets.

The present study

The aim of the present research was to conduct a more thorough exploration of the structure of psychopathology and associations with high-risk personality traits among adolescents than previously available. We aimed to examine a variety of hierarchical-dimensional structures of psychopathology using a symptom-level approach and evaluate the models using more rigorous methods of model evaluation and selection. Specifically, we assessed four alternative models of adolescent psychopathology: bifactor, higher-order, four-correlated factors and a one-factor unidimensional model. As we planned to evaluate the structural validity through additional metrics beyond traditional fit indices which not been commonly examined in previous research, we did not have any specific expectations about which model would perform the best.

Extending previous research, we also aimed to examine the direct and indirect effects of high-risk personality traits on psychopathology across three hierarchical levels: general psychopathology, specific factors, and symptoms. To our knowledge, this is the first study to examine symptom-level associations with high-risk personality traits among adolescents. As such, we did not have any specific expectations about associations between the high-risk personality traits and individual symptoms. We did, however, expect that all high-risk personality traits would be positively associated with general psychopathology; impulsivity and sensation seeking would be positively associated with externalizing related specific dimensions; and anxiety sensitivity and negative thinking would be associated with internalizing related specific dimensions.

Methods

Participants

The sample was derived from two large cluster randomized controlled trials investigating the effectiveness of eHealth prevention programs in Australia – the Climate and Preventure (CAP) and Climate Schools Combined (CSC) studies (Newton et al., Reference Newton, Teesson, Barrett, Slade and Conrod2012; Teesson et al., Reference Teesson, Newton, Slade, Chapman, Allsop, Hides, McBride, Mewton, Tonks, Birrell, Brownhill and Andrews2014). The present study examined baseline data from these cohorts. The CAP cohort comprises 2,268 students with a mean age of 12.96 years (SD = 0.46) recruited through 27 schools in 2012. Within the CAP cohort, 972 were female (42.89%) and 1,941 were born in Australia (86.84%). The CSC cohort comprises 6,386 students with a mean age of 13.03 years (SD = 0.61) from 71 schools in 2014. Within the CSC cohort, 3,502 were female (54.83%) and 5,147 were born in Australia (84.17%). The combined sample contained 8,654 students, 53 of which were missing on all variables and were excluded from analyses, resulting in a final sample size of 8,601 (mean age 13.01 years, SD = 0.57) from 98 schools, of which 4,474 were female (51.71%) and 7,088 were born in Australia (84.88%).

Measures

Psychopathology

Item-level responses from measures of psychopathology used in both CAP and CSC baseline assessments were used in the present study. Due to the low prevalence of substance use and psychopathology in this general population sample, all items were recoded into binary indicators to reduce the number of sparse cells and improve the stability of the models and overall precision of the estimates. Cut points were determined based on inspection of the distribution of responses (further details provided below). The measures used to assess psychopathology are described below and a summary of the items, proportions and counts is provided in Supplementary Table S1.

Strengths and Difficulties Questionnaire (SDQ). The SDQ is a brief, 25-item questionnaire that measures emotional and behavioral difficulties over the past 6 months and is comprised of four subscales: conduct problems, emotional symptoms, hyperactivity, peer problems and prosocial behavior (Goodman, Reference Goodman2001). Items were selected to load onto the fear, distress and conduct dimensions as informed by previous analyses (Carragher et al., Reference Carragher, Teesson, Sunderland, Newton, Krueger, Conrod, Barrett, Champion, Nair and Slade2016; Goodman et al., Reference Goodman, Lamping and Ploubidis2010). Reverse-scored items were removed due to poor performance and previously documented problems (Van De Looij-Jansen et al., Reference Van De Looij-Jansen, Goedhart, De Wilde and Treffers2011). Items from the SDQ were recoded into binary indicators with levels representing “not true” or “true” (i.e., “somewhat true” or “certainly true”).

Kessler Psychological Distress Scale (K6). The K6 is a 6-item screening tool for psychological distress due to symptoms of depression and anxiety over the past 4 weeks (Kessler et al., Reference Kessler, Andrews, Colpe, Hiripi, Mroczek, Normand, Walters and Zaslavsky2002, Reference Kessler, Barker, Colpe, Epstein, Gfroerer, Hiripi, Howes, Normand, Manderscheid, Walters and Zaslavsky2003), and has been found to be a valid and reliable measure of psychological distress among adolescents (Ferro, Reference Ferro2019; Mewton et al., Reference Mewton, Kessler, Slade, Hobbs, Brownhill, Birrell, Tonks, Teesson, Newton, Chapman, Allsop, Hides, McBride and Andrews2016). Two items were loaded onto the fear dimension, and the remaining four items loaded onto the distress dimension. Items were recoded as “none of the time” or “any time” (i.e., “a little of the time,” “some of the time,” “most of the time,” “all of the time”).

Rutgers Alcohol Problem Index. The Rutgers Alcohol Problem Index measures alcohol-related consequences experienced over the past 6 months and has been validated amongst high-school aged people as a measure of alcohol-related problems (Neal et al., Reference Neal, Corbin and Fromme2006; White & Labouvie, Reference White and Labouvie1989). A shortened 8-item version that had previously demonstrated adequate validity and reliability for assessing alcohol-related problems among young people was administered to the CAP cohort (Topper et al., Reference Topper, Castellanos-Ryan, Mackie and Conrod2011). As such, only these items have been used in the present study. Items were recoded as “did not experience in the last 6 months” and “experienced at least one time in the last 6 months.”

Patterns of Alcohol Use. Patterns of alcohol use over the past 6 months were assessed using three items adapted from the School Health and Alcohol Harm Reduction Project’s “Patterns of Alcohol Use” index (McBride et al., Reference McBride, Farringdon, Midford, Meuleners and Phillips2004). Specifically, there were three items measuring frequency of alcohol use in the past 6 months, quantity of alcohol consumed in the past 6 months and frequency of drinking above low risk levels in the past 6 months. Items were recoded into “none or less than monthly” and “once a month or more.”

High-risk personality traits

Substance Use Personality Risk Profile Scale (SURPS) is a 23-item measure of personality risk for substance misuse, comprised of four distinct subscales: hopelessness/negative thinking, anxiety sensitivity, sensation seeking and impulsivity (Woicik et al., Reference Woicik, Stewart, Pihl and Conrod2009). The SURPS asks participants to indicate the extent to which they agree with each item on a 4-point scale (1 = strongly disagree, 2 = disagree, 3 = agree, 4 = strongly agree). Total scores were calculated for each subscale and used in subsequent analyses. The SURPS has demonstrated good validity and reliability as a measure of personality-related risk for substance use and co-occurring psychopathology among young people across multiple cohorts (Castellanos-Ryan et al., Reference Castellanos-Ryan, O’Leary-Barrett, Sully and Conrod2013; Newton et al., Reference Newton, Barrett, Castellanos-Ryan, Kelly, Champion, Stapinski, Conrod, Slade, Nair and Teesson2016; Woicik et al., Reference Woicik, Stewart, Pihl and Conrod2009).

Analytic plan

Analyses in the present study were conducted in the following broad steps: 1) model estimation, 2) model evaluation via traditional goodness-of-fit and contemporary model reliability and replicability indices, 3) measurement invariance testing, and 4) finally the associations between personality traits and psychopathology dimensions were assessed via regression and indirect-effects models. Further details of each step are provided below.

First, we estimated four alternative structural models of psychopathology using confirmatory factor analysis: 1) a one-factor model with all items loading on a single latent variable representing general psychopathology; 2) a four-correlated factors model with four latent variables representing fear, distress, alcohol use/harms and conduct/inattention; 3) a bifactor model with all indicators loading onto a single latent variable representing general psychopathology as well as four orthogonal (i.e., uncorrelated) latent variables representing fear, distress, alcohol use/harms and conduct/inattention, and 4) a higher-order model comprising four lower-order factors representing fear, distress, alcohol use/harms and conduct/inattention and a higher-order general psychopathology latent variable that accounts for the correlations among the lower-order factors.

The structural models were based on prior symptom-level studies among adolescents, which have consistently found evidence for a general psychopathology factor, and at least two specific or correlated factors representing externalizing and internalizing symptoms (Afzali et al., Reference Afzali, Sunderland, Carragher and Conrod2017; Carragher et al., Reference Carragher, Teesson, Sunderland, Newton, Krueger, Conrod, Barrett, Champion, Nair and Slade2016; Haltigan et al., Reference Haltigan, Aitken, Skilling, Henderson, Hawke, Battaglia, Strauss, Szatmari and Andrade2018; Levin-Aspenson et al., Reference Levin-Aspenson, Khoo and Kotelnikova2019). Notably, one study found that internalizing bifurcated into fear and distress sub-dimensions (Levin-Aspenson et al., Reference Levin-Aspenson, Khoo and Kotelnikova2019), and another study found evidence for separate attention and externalizing factors (Haltigan et al., Reference Haltigan, Aitken, Skilling, Henderson, Hawke, Battaglia, Strauss, Szatmari and Andrade2018).

All models accounted for school-level clustering and were estimated in Mplus version 8.4 using robust weighted least squares and robust maximum likelihood estimation methods to generate a range of fit statistics.

Second, the structural validity of each model was evaluated with goodness-of-fit and latent variable reliability indices (Forbes, Greene, et al., Reference Forbes, Greene, Levin-Aspenson, Watts, Hallquist, Lahey, Markon, Patrick, Tackett, Waldman, Wright, Caspi, Ivanova, Kotov, Samuel, Eaton and Krueger2021; Rodriguez et al., Reference Rodriguez, Reise and Haviland2016a). Incremental fit indices, including root mean square error of approximation (RMSEA) comparative fit index (CFI, values >0.95) and Tucker–Lewis index (TLI) were used to assess model fit, where RMSEA values <0.6, and CFI and TLI values >0.95 indicate close fit (Brown, Reference Brown2014). Models were also compared using the information criteria, including the Akaike information criterion, Bayesian information criterion, and the sample size-adjusted Bayesian information criterion, for which lower values indicate superior fit (Raftery, Reference Raftery1995).

Given the tendency for goodness-of-fit statistics to be biased towards selecting bifactor models, additional reliability and replicability indices were calculated (Forbes, Greene, et al., Reference Forbes, Greene, Levin-Aspenson, Watts, Hallquist, Lahey, Markon, Patrick, Tackett, Waldman, Wright, Caspi, Ivanova, Kotov, Samuel, Eaton and Krueger2021; Rodriguez et al., Reference Rodriguez, Reise and Haviland2016a). Specifically, the H coefficient, which gives an indication of the construct replicability (H, ideally >0.8), omega (ideally >0.75), which represents the proportion of variance accounted for by a single latent variable, omega hierarchical (OmegaH, ideally >0.8), indicates the proportion of variance accounted for by the general factor, and omega hierarchal subscale (OmegaHS, ideally >0.75) which represents the variance accounted for by a specific factor after removing variance accounted for by the general factor. Additionally, we calculated the explained common variance which provides an indication of the importance of the general factor relative to the specific factors (Explained Common Variance, ideally >0.7), and the explained common variance of specific factors which gives an indication of the uniqueness of a specific factor (ECV_S = Explained Common Variance of specific factors, ideally >0.7). Unidimensionality was examined by calculating the percent of uncontaminated correlations (Percent of Uncontaminated Correlations, values >0.7 indicate unidimensionality) and absolute relative parameter bias (Absolute Relative Parameter Bias; 10–15% is acceptable). Percent of Uncontaminated Correlations indicates the proportion of unique correlations among indicators (i.e., parameter estimates) that can be explained by a general factor alone, thus high Percent of Uncontaminated Correlations indicates that the parameter estimates are relatively unbiased by multidimensionality and supports a unidimensional structure (Reise et al., Reference Reise, Scheines, Widaman and Haviland2013). Absolute Relative Parameter Bias compares the absolute difference between parameter estimates between a unidimensional model and a bifactor (or other multidimensional) model. For the higher-order model, these indices were calculated following a Schmid–Leiman transformation (SLT), which orthogonalizes the latent variables. Following a SLT, the lower-order factors in a higher-order model are like the specific factors in a bifactor model. Whereas the latent variables from a correlated factors model are like the lower-order factors prior to SLT and are useful for understanding their reliability as standalone constructs. Models found to have acceptable structural validity according to the goodness-of-fit, reliability and replicability indices progressed to the next step.

Third, to examine the robustness of the models selected in the previous step and ensure that it was appropriate to combine data from both samples, measurement invariance was tested across the CAP and CSC groups within a multigroup confirmatory factor analysis framework. Specifically, we tested invariance in the following sequence as recommended by Brown (Reference Brown2014): 0) test the model separately in each group 1) test invariance of the overall factor structure simultaneously (i.e., configural invariance); 2) test the invariance of the factor loadings (i.e., metric or weak factorial invariance); 3) test the invariance of item intercepts/thresholds (i.e., scalar or strong factorial invariance); and 4) test the invariance of item residual variances (i.e., residual or strict invariance). For higher-order models, we assessed invariance using the procedure described by Rudnev et al. (Reference Rudnev, Lytkina, Davidov, Schmidt and Zick2018), which assess invariance of the first-order factor alone, and the invariance of the first and higher-order factors simultaneously at each level of invariance.

As the chi-square difference test is too sensitive to be informative in the context of large sample sizes, invariance was evaluated by comparing changes in CFI and RMSEA (Brown, Reference Brown2014; Chen, Reference Chen2007; Kline, 2015). Factor structures with changes in CFI less than 0.01 and RMSEA less than 0.015 (from the previous model in the sequence) were considered to demonstrate invariance across groups. Structures demonstrating adequate invariance progressed to the next step. If there was evidence for non-invariance, which would suggest that factor structures or that the interpretation of the latent variables differed across the groups, then alternative tests of measurement invariance would be considered, such as partial measurement invariance, and we conducted additional post hoc analyses to determine whether there are cohort-specific associations between the personality traits and psychopathology dimensions.

Finally, associations with the personality traits were added to the model(s) found to have adequate structural validity. Regression analyses were conducted to obtain total effect estimates for the association between each trait and general psychopathology. Indirect-effects models were estimated to obtain total, direct, and indirect effect sizes at the specific factor and symptom levels. This approach enabled us to test associations between personality traits and psychopathology across three levels of the structural model, and to disentangle unique associations from those that are accounted for by broader dimensions of psychopathology (Conway et al., Reference Conway, Forbes and South2021).

Availability of data and analysis code

The Mplus output files for these analyses are publicly available and can be accessed online (https://osf.io/cq2rz/). Data may be shared with other researchers upon reasonable request.

Results

Structure of adolescent psychopathology

Goodness-of-fit indices are presented in Table 1 and standardized factor loadings for each of the latent variable models using weighted least square mean and variance adjusted are shown in Table 2. All models, except the one-factor model, were found to have acceptable fit according to traditional fit indices (i.e., CFI and TLI > 0.95). Based on the information criteria (Akaike information criterion, Bayesian information criterion, sample size-adjusted Bayesian information criterion), the bifactor model was the best fitting model, followed by the correlated factors and higher-order models. However, standardized factor loadings in the bifactor model were generally weak for the specific factors and some loadings were negative. In particular, standardized factor loadings on the fear, distress and conduct/inattention specific factors were weak, and the alcohol use/harms related indicators mostly loaded poorly onto the general factor. Further, a Heywood case (i.e., negative residual variance) was detected in the bifactor model on the fear factor (item “restless or fidgety”). Thus, the bifactor model was not considered for further analysis. Standardized factor loadings in the one-factor, four-correlated factors and higher-order models were all positive and reasonably strong (>0.4). In the higher-order model, standardized factor loadings indicate that the general psychopathology factor was more reflective of fear (b = 0.948) and distress (b = 0.876) dimensions followed by conduct/inattention (b = 0.744) and alcohol use/harms (b = 0.388) dimensions.

Table 1. Fit indices for different structural models of adolescent psychopathology (n = 8,589)

Note. χ 2 = Chi-square statistic; df = degree of freedom; CFI = comparative fit index; TLI = Tucker–Lewis index; RMSEA = root mean square error of approximation; CI = confidence interval; AIC = Akaike’s Information Criterion; BIC = Bayesian Information Criterion; SSABIC = sample size-adjusted BIC; WLSMV = weighted least square mean and variance adjusted. The bifactor could not be estimated using the default integration methods for MLR in Mplus. In order to compare the models, the MLR models were then estimated using the INTEGRATIONS = montecarlo(5000) command in Mplus.

Table 2. Standardized factor loadings on general and specific (fear, distress, alcohol use/harms, conduct/inattention) factors using WLSMV estimator and inter-factor correlations

Note. SD = items from Strengths and Difficulties Questionnaire; AH = Alcohol Harms, items from Rutgers Alcohol Problem Index (RAPI); K6 = Kessler 6 Plus scale (K6+); AUC = Alcohol use, AUDIT-C items; WLSMV = weighted least square mean and variance adjusted. Factor loadings and correlations with a p value ≤0.05 are shown in bold.

Model reliability indices are shown in Table 3. Overall, the general psychopathology factor showed good internal reliability (omega range 0.96–0.97) and construct reliability (H range 0.93–0.97) across the one-factor and higher-order models. The specific factors (fear, distress, alcohol use/harms and conduct/inattention), also showed good internal reliability (omegaS range 0.72–0.98) across the four-correlated factors and higher-order models. Construct reliability (H range 0.73–0.98) in the four-correlated factors model was good. However, in the higher-order model, only the alcohol use/harms specific factor had adequate reliability (i.e., H > 0.7).

Table 3. Reliability indices alternative models of adolescent psychopathology

Note. Results in bold indicate acceptable reliability. Indices for Higher-Order model cannot be calculated, indices presented are based on Schmid–Leiman transformed (SLT) model. ECV = Explained Common Variance, ARPB = Absolute Relative Parameter Bias, ECV_S = Explained Common Variance of specific factors, H = measure of construct replicability, Omega = internal reliability of general factor/s, OmegaS = internal reliability of specific factor/s, OmegaH = Omega Hierarchical, OmegaHS = Omega Hierarchical subscale, PUC = Percent of Uncontaminated Correlations, SLT = Schmid–Leiman transformation.

Omega hierarchical subscale (OmegaHS) indices were low for fear, distress, and conduct/inattention factors, indicating that the majority of variance in these factors may be attributable to the general factor. However, OmegaHS was high for the alcohol use/harms factor in the higher-order model, suggesting that the variance in this specific factor may not be attributable to the general factor.

Overall, the general factor appears to have good reliability across the one-factor and higher-order models and the specific factors appear to have poor reliability, except for the alcohol use/harms factor, across the bifactor and higher-order models. Although the correlated factors model demonstrated better fit and reliability, the lower-order factors of a higher-order model are comparable to the correlated factors model (i.e., the correlated factors model is similar to the lower-order level of the higher-order model). Thus, support for the reliability of the factors in the correlated factors model also suggests there is evidence for the lower-order factors of a higher-order model. Furthermore, the reliability indices for the lower-order factors are based on residualized factors (i.e., the Schmid–Leiman transformation is applied before the indices are calculated). As such, the lower-order factors following the SLT are very similar to the specific factors in a bifactor model whereas the correlated factors model gives a closer approximation to the lower-order factors (prior to the SLT) as standalone constructs. An advantage of the higher-order model is that it allows inclusion of both the narrower constructs and a general psychopathology factor. We therefore selected the higher-order model on the basis that there was evidence for the general factor having good reliability, along with the evidence for the reliability of the correlated/lower-order factors. However, model fit indices suggest that perhaps the higher-order general factor may not be required to account for the associations between factors over and above use of correlations. Therefore, additional external validity was assessed for the correlated factors model (See Supplementary Table S7). A diagram showing the higher-order model and standardized factor loadings is shown in Figure 1.

Figure 1. Higher-order structural model of adolescent psychopathology with standardized parameter estimates. Note. All estimates statistically significant (p ≤ 0.05). Standardized factor loadings for indicators of psychopathology are presented in Table 2.

Following inspection of factor loadings, model fit and reliability indices, additional models were examined including bifactor and higher-order models comprised of general internalizing and general externalizing factors (rather than a single general psychopathology factor). However, these models were found to have inadequate structural validity (see supplementary materials for further details).

The reliability of the higher-order model was further corroborated by measurement invariance tests, as shown in Table 4. The baseline model fit the data well in both the CAP and CSC cohorts. However, a high correlation (0.987) between two items (AH1, “Acted bad” and AH3, “Neglected responsibilities”) was found in the CAP cohort. One of the items was removed (AH1, “Acted bad”) from the model in subsequent analyses and this higher-order model demonstrated invariance across the CAP and CSC cohorts.

Table 4. Results of measurement invariances tests of a higher-order model of psychopathology

Note. * p < 0.001. χ2 Δ computed using Mplus DIFFTEST function; CFI Δ = difference in CFI from previous model; RMSEA Δ = difference in RMSEA from previous model. Initial baseline model in the CAP cohort revealed a correlation between AH1 & AH3 of 0.987. The AH1 item was removed from subsequent analyses, and the above table shows the results of measurement invariance tests with AH1 removed.

High-risk personality risk traits and associations with psychopathology dimensions and symptoms

The standardized total and direct effects are available in the supplementary material (Tables S3 to S6). Figure 2 shows the standardized direct effect estimates and 99% confidence intervals for each of the personality traits and general and specific factors of psychopathology. Anxiety sensitivity, negative thinking, impulsivity, and sensation seeking all had significant, positive total effects with general psychopathology. Differential patterns of association emerged with specific factors of psychopathology (Figure 2) and in symptom-level analyses (Figure 3).

Figure 2. Effect sizes and standard errors for standardized direct effect of each personality trait on first-order psychopathology factors (fear, distress, conduct/inattention, and alcohol use/harms) and total effect on general psychopathology. Note. Significant effects (p < 0.001) shown in black, non-significant (p > 0.001) effect shown in gray. Vertical gray solid lines show 0.0 effect size.

Figure 3. Effect sizes and standard errors for standardized direct effects of each personality profile on symptoms of psychopathology. Note. Significant effects (p < 0.001) shown in black, non-significant (p > 0.001) effect shown in gray. Black dotted lines mark boundaries between first-order factors, vertical gray solid lines show 0.0 effect size.

Anxiety Sensitivity: Anxiety sensitivity had a significant positive direct effect with fear and distress, with only 58 and 65% of the variance accounted for by for general psychopathology (Table S3). There was also a significant negative direct effect of anxiety sensitivity with alcohol use/harms, which represents a change in direction from the total effect (i.e., the direct effect reversed in sign compared to the total effect). This may be due to a suppressor effect, and it is likely that the association between alcohol use/harms and anxiety sensitivity was accounted for by general psychopathology (Watson et al., Reference Watson, Clark, Chmielewski and Kotov2013). The direct effect with conduct/inattention was not statistically significant, indicating general psychopathology also accounted for the association between anxiety sensitivity and conduct/inattention symptoms. Overall, these results indicate that the adolescents with greater levels of anxiety sensitivity had significantly higher fear and distress levels (but not alcohol use/harms or conduct/inattention) than adolescents with lower levels of anxiety sensitivity.

Symptom-level indirect-effects models revealed that 24 of 28 associations between symptoms and personality risk traits were accounted by higher-order factors (i.e., general psychopathology, and the specific dimension that the symptom is loaded on). For the remaining direct effects, between 53 and 79% of the variance a large proportion of variance accounted for by the higher-order factors. There were significant direct effects for anxiety sensitivity and “nervous in new situations” and “many fears” with small direct effects (b = 0.139 and 0.185, p < 0.001, respectively), over and above levels of fear and general psychopathology. Similarly, there was a significant and small direct effect for anxiety sensitivity with “worries,” over and above levels of distress and general psychopathology (b = 0.165, p < 0.001). Finally, the direct effect between “easily distracted” and anxiety sensitivity had a small effect size (b = 0.048, p < 0.001), over and above conduct/inattention and general psychopathology. All other symptom-level associations were either non-significant or the association was fully accounted for by the higher-order factors.

Negative thinking: Negative thinking, had a positive direct effect with distress, with only 50% of variance accounted for by general psychopathology (b = 0.268, p < 0.001; Table S4). There were negative direct effects of negative thinking with fear, conduct/inattention, and alcohol use/harms specific factors (b = 0.076, 0.067, 0.180, respectively, ps < .001), representing a reversal of their total effects, indicating that the association was accounted for by general psychopathology. Overall, this indicates that adolescents with greater levels of negative thinking had significantly higher distress levels (but not fear, alcohol use/harms or conduct/inattention) than adolescents with lower levels of negative thinking.

At the symptom level, the associations with 21 of 28 symptoms were accounted for by higher-order factors. Of the remaining symptoms, the effects were small and between 75 and 88% of the variance was accounted for by the higher-order factors. Notably, there were significant direct effects for negative thinking and “unhappy,” “depressed,” and “worthless” (b = 0.095, 0.063 and 0.063, ps < 0.001, respectively), over and above distress and general psychopathology. The remaining symptom-level associations were either non-significant or the association was fully accounted for by the higher-order factors.

Impulsivity: Impulsivity had a small, positive direct effect with conduct/inattention, with only 53% of variance accounted for by general psychopathology (b = 0.270, p < 0.001). There were negative direct effects with alcohol use/harms, distress, and fear, which represented a reversal of their total effects, indicating that the association was accounted for by general psychopathology (b = −0.088, −0.059, −0.150, p < 0.001). Overall, this indicates that adolescents with greater levels of impulsivity had significantly higher conduct/inattention levels (but not fear, distress, or alcohol use/harms) than adolescents with lower levels of impulsivity.

At the symptom level, the associations between impulsivity and 22 of 28 symptoms were accounted by the higher-order factors. The remaining direct effects were small, with a large proportion of variance accounted for by the higher-order factors (72 to 83%). Notably, there were significant, positive direct effects with the symptoms “fight a lot,” “easily distracted” and “lies or cheats,” over and above the conduct/inattention and general psychopathology factors (b = 0.101, 0.078, 0.105, p < 0.001, respectively). Direct effects with alcohol use/harms were either fully accounted for by general psychopathology or were not significant, suggesting that the effects of impulsivity with alcohol use/harms were accounted for by the higher-order factors.

Sensation seeking: Sensation seeking had small, positive direct effects with alcohol use/harms and conduct/inattention factors with only 10 and 13% of variance accounted for by general psychopathology, respectively (b = 0.182, 0.141, ps < 0.001, respectively, see Table S6). There were also small negative direct effects with distress and fear (b = −0.117, −0.170, ps < 0.001, respectively), and the association was mostly accounted for by general psychopathology (100 and 93%, respectively). Overall, this indicates that adolescents with greater levels of sensation seeking had significantly higher alcohol use/harms and conduct/inattention levels, and significantly lower levels of fear than adolescents with lower levels of impulsivity.

At the symptom level, the associations between sensation seeking and 26 of 28 indicators of psychopathology were accounted for by the higher-order factors. There was a small negative direct effect with “many fears” (b = −0.170, p < 0.001), and a small positive direct effect with “fight a lot” (b = 0.066, p < 0.001).

Discussion

The current study extends prior work on the underlying structure of psychopathology by using a symptom-level approach and more rigorous methods of assessing the structural validity, reliability, and replicability of different statistical models. Our results align with previous research on the structure of psychopathology in adolescents and extend this work by illuminating important patterns of association with four high-risk personality traits that have implications for the development of targeted prevention and early intervention programs and our understanding of the underlying structure of psychopathology.

High-risk personality traits and psychopathology

Overall, the results indicate that personality measures could be used to identify adolescents at risk of developing general psychopathology, as well as certain specific forms of psychopathology. Findings showed that all four personality traits were associated with general and specific dimensions of psychopathology in theoretically expected ways and consistent with previous research. Consistent with the four-factor model of vulnerability, our results broadly indicated that inhibited traits (i.e., negative thinking and anxiety sensitivity) were more closely related to internalizing forms of psychopathology (i.e., fear and distress), and disinhibited traits (i.e., impulsivity and sensation seeking) were associated with externalizing forms of psychopathology (i.e., alcohol use/harms and conduct/inattention (Castellanos-Ryan & Conrod, Reference Castellanos-Ryan and Conrod2012). These findings also align with prior research with young people indicating that neuroticism is positively associated with fear, distress and broad externalizing dimensions (Watts et al., Reference Watts, Poore, Lilienfeld and Waldman2019), and that different facets of neuroticism are differentially related to internalizing and externalizing dimensions (Brandes et al., Reference Brandes, Herzhoff, Smack and Tackett2019).

Given that associations between each of the four personality traits and substance use are well-established, we anticipated that there would be positive associations with the alcohol use/harm factor. However, we found that only sensation seeking was positively associated with alcohol use/harms above and beyond general psychopathology in our sample. Because most research has typically focused on a broad externalizing factor and sensation seeking (Carragher et al., Reference Carragher, Teesson, Sunderland, Newton, Krueger, Conrod, Barrett, Champion, Nair and Slade2016; Castellanos-Ryan et al., Reference Castellanos-Ryan, Briere, O’Leary-Barrett, Banaschewski, Bokde, Bromberg, Biichel, Flor, Frouin, Gallinat, Garavan, Martinot, Nees, Paus, Pausova, Rietschel, Smolka, Robbins and Whelan2016), our results are consistent with only one other study which reported on a bifactor model comprised of a general externalizing factor and a substance use and conduct specific factor. Castellanos-Ryan and Conrod (Reference Castellanos-Ryan and Conrod2011) found that sensation seeking was uniquely linked with substance use and that impulsivity was related to the specific conduct factor (along with general externalizing). This suggests that impulsivity may be related to broader externalizing (i.e., the overlap between substance use and conduct/antisocial problems) and may also have unique links to conduct/behavioral problems, whereas sensation seeking may be more specifically related to substance misuse.

Consistent with previous research, we found that anxiety sensitivity was related to the internalizing dimensions of fear and distress (Carragher et al., Reference Carragher, Teesson, Sunderland, Newton, Krueger, Conrod, Barrett, Champion, Nair and Slade2016; Castellanos-Ryan et al., Reference Castellanos-Ryan, Briere, O’Leary-Barrett, Banaschewski, Bokde, Bromberg, Biichel, Flor, Frouin, Gallinat, Garavan, Martinot, Nees, Paus, Pausova, Rietschel, Smolka, Robbins and Whelan2016). However, we also found that anxiety sensitivity was related to lower alcohol use/harms after accounting for general psychopathology. Although this finding was unexpected, literature on the association between anxiety and alcohol use provides important context for interpreting our results. A recent systematic review revealed inconsistent findings for the association between alcohol use and anxiety (Dyer et al., Reference Dyer, Easey, Heron, Hickman and Munafò2019), and general population research has shown that anxiety may not increase alcohol use until after age 14 (Birrell et al., Reference Birrell, Newton, Teesson, Tonks and Slade2015). This is consistent with longitudinal research that has found dynamic associations among anxiety symptoms and alcohol use in early adolescence (Pardee et al., Reference Pardee, Colder and Bowker2014). Specifically, young adolescents with higher initial levels of anxiety demonstrated more rapid increases in alcohol use, compared to peers with low or declining anxiety symptoms. In contrast, there was evidence to suggest that social anxiety specifically had protective effects in early adolescence before later increasing risk for substance misuse.

Within the present study, our finding that greater anxiety sensitivity was related to lower alcohol use/harms may mean that anxiety sensitivity does not have a meaningful unique association with alcohol use/harms, and that the association is better explained by general psychopathology. Alternatively, anxiety sensitivity may protect against alcohol-related harms in early adolescence or delay the onset/escalation of alcohol use until later in adolescence. For example, as the alcohol use/harms factor in the present study is more heavily defined by alcohol-related harms, it is possible that anxiety sensitivity is protective against experiencing alcohol-related harms within this age group. Indeed, at the symptom level we found that anxiety sensitivity, impulsivity and (to a lesser extent) sensation seeking generally had negative direct effects with alcohol use items (i.e., frequency, binge, and quantity), but positive direct effects with most of the alcohol harm items. Furthermore, given that in the present sample the prevalence of alcohol use and related harms was relatively low (which is expected given the mean age was 13 years), it is possible that anxiety sensitivity may delay the onset of alcohol use or slow the escalation of alcohol consumption until later in adolescence. For example, it is possible that once individuals with high anxiety sensitivity have experienced the stress dampening effects of alcohol, their association with alcohol may change such that anxiety sensitivity leads to greater alcohol use (Stapinski et al., Reference Stapinski, Rapee, Sannibale, Teesson, Haber and Baillie2015). Ultimately, longitudinal research is needed to further unpack the association between anxiety sensitivity, alcohol use, and psychopathology more broadly within the hierarchical-dimensional model of psychopathology.

As expected, negative thinking was associated with greater general psychopathology. Negative thinking was also directly related to distress, whereas associations with fear, alcohol use/harms and conduct/inattention were accounted for by general psychopathology. This suggests that negative thinking may be a broader risk factor for psychopathology and that interventions targeting negative thinking may result in reductions in a wide range of psychiatric symptoms. This is consistent with other research linking related traits, such as neuroticism, emotion regulation and dysregulation, to general psychopathology (Brandes et al., Reference Brandes, Herzhoff, Smack and Tackett2019; Haltigan et al., Reference Haltigan, Aitken, Skilling, Henderson, Hawke, Battaglia, Strauss, Szatmari and Andrade2018; Santens et al., Reference Santens, Claes, Dierckx and Dom2020). Indeed, it has even been suggested that general psychopathology reflects emotional/behavioral dysregulation broadly, and maps closely with trait neuroticism. Examination of the intersection between neurotic/inhibited traits and psychopathology over the adolescent period would be a valuable avenue for future research.

In the present study, the general psychopathology factor was more heavily defined by fear and distress dimensions, which complicates the conclusions that could be drawn from the associations between symptom dimensions and the personality traits. However, this is consistent with other studies of general psychopathology among adolescents which have shown that general psychopathology is typically defined by either thought disorder or internalizing dimensions, depending on the symptom domains included in the model (Gomez et al., Reference Gomez, Stavropoulos, Vance and Griffiths2019; Watts et al., Reference Watts, Lane, Bonifay, Steinley and Meyer2020). Current knowledge of the onset and temporal sequencing of internalizing and externalizing problems during adolescence suggest that it would be reasonable for a general psychopathology factor to be more reflective of internalizing problems in early adolescence, as seen in the present study, compared to later adolescence (Birrell et al., Reference Birrell, Newton, Teesson, Tonks and Slade2015; Slade et al., Reference Slade, McEvoy, Chapman, Grove and Teesson2015; Solmi et al., Reference Solmi, Radua, Olivola, Croce, Soardo, Salazar de Pablo, Il Shin, Kirkbride, Jones, Kim, Kim, Carvalho, Seeman, Correll and Fusar-Poli2021).

Clinical and classification implications

Our findings have important implications for research on the early detection and prevention of mental and substance use disorders. Adolescents characterized by a fear of anxiety-related sensations (anxiety sensitivity); a sense of hopelessness or low positive affect (negative thinking); difficulties regulating behavioral responses (impulsivity); and/or a desire for novel experiences (sensation seeking) may be at greater risk for developing a wide range of psychiatric problems. Individuals with higher levels of fear or distress may benefit most from receiving interventions targeting anxiety sensitivity and negative thinking; and adolescents with greater levels of alcohol misuse/harms or conduct/inattention problems may benefit from interventions targeting impulsivity and sensation seeking. Indeed, this assumption is corroborated by prior research demonstrating the effectiveness of a personality-targeted prevention program reducing substance use and co-occurring emotional problems by addressing these specific personality traits (Lammers et al., Reference Lammers, Goossens, Conrod, Engels, Wiers and Kleinjan2017; Newton et al., Reference Newton, Stapinski, Teesson, Slade, Champion, Barrett, Birrell, Kelly, Mather and Conrod2020; O’Leary-Barrett et al., Reference O’Leary-Barrett, Topper, Al-Khudhairy, Pihl, Castellanos-Ryan, Mackie and Conrod2013). However, further research is needed to determine whether these effects hold when examining substance use and mental health outcomes with a hierarchical-dimensional framework.

From a classification perspective, our findings support the utility of conceptualizing psychopathology in a hierarchical-dimensional framework and align with prior research on the structure of psychopathology among adolescents. We found evidence for a higher-order model of psychopathology comprised of a general psychopathology dimension, and four specific dimensions: fear, distress, alcohol use/harms and conduct/inattention. While most previous research has selected a bifactor model of psychopathology, when considering model reliability and replicability along with traditional fit indices we found that a higher-order model fit the data best. Although this differs from past research, it is consistent with other more recent studies on hierarchical-dimensional models of psychopathology that have considered additional metrics of model reliability and replicability, underscoring the importance of assessing these indices in future research (Lees et al., Reference Lees, Squeglia, McTeague, Forbes, Krueger, Sunderland, Baillie, Koch, Teesson and Mewton2020; Sunderland et al., Reference Sunderland, Forbes, Mewton, Baillie, Carragher, Lynch, Batterham, Calear, Chapman, Newton, Teesson and Slade2020). Further, the four specific factors are consistent with prior research indicating that internalizing may be comprised of fear and distress specific sub-dimensions and externalizing may be comprised of substance misuse and conduct/behavioral sub-dimensions factors (Blanco et al., Reference Blanco, Wall, He, Krueger, Olfson, Jin, Burstein and Merikangas2015; Levin-Aspenson et al., Reference Levin-Aspenson, Khoo and Kotelnikova2019; Platt et al., Reference Platt, Colich, McLaughlin, Gary and Keyes2017; Slade & Watson, Reference Slade and Watson2006). Further studies are needed, particularly longitudinal research, to confirm the validity and reliability of this underlying structure.

Limitations and future directions

There are some limitations that should be considered when interpreting our findings. Importantly, the present study is cross-sectional and cannot determine causality between personality and psychopathology and the generalizability of our findings are limited by the use of a non-representative community sample of Australian adolescents. Self-reported alcohol use/harms and conduct/inattention problems can be affected by self-report biases among, for example, children and young adults with attention-deficit/hyperactivity disorder and young adults following treatment (Hoza et al., Reference Hoza, Vaughn, Waschbusch, Murray-Close and McCabe2012; Nirenberg et al., Reference Nirenberg, Longabaugh, Baird and Mello2013; Sodano et al., Reference Sodano, Tamulonis, Fabiano, Caserta, Hulme, Hulme, Stephan and Tronci2021). Although the self-reported psychopathology outcomes did not have corroborating information, such as parent or teacher reports, data were collected using structured and validated instruments. Within this context, self-report methods have been shown to be a valid and reliable approach to measuring substance use and mental health outcomes in adolescents (Smith et al., Reference Smith, McCarthy and Goldman1995; Smith, Reference Smith2007; van der Ende et al., Reference van der Ende, Verhulst and Tiemeier2020). In addition, although our study incorporated a wide variety of mental health symptoms, there are some notable forms of psychopathology that were not included. We were unable include psychosis-related symptoms, for example, as these were only assessed in one the cohorts, and other common youth-onset disorders such as obsessive-compulsive disorder and eating pathology were not assessed. It is also worth noting that six of the seven items in the negative thinking subscale were worded positively (e.g., “I am happy,” “I am very enthusiastic about my future”) and then reverse-scored. As such, this subscale may be more reflective of low positive thinking, rather than a direct measure of negative thinking. This is akin to evidence that negative and positive affect are independent dimensions, rather than opposite poles of a single dimension (Curran et al., Reference Curran, Howard, Bainter, Lane and McGinley2014; Jovanović & Gavrilov-Jerković, Reference Jovanović and Gavrilov-Jerković2016; Watson & Tellegen, Reference Watson and Tellegen1985). Ultimately, as this study was a secondary analysis of data from two randomized controlled trial cohorts our data were limited to what was available. Additional evidence using more extensive and robust measures would be of value. Furthermore, longitudinal studies with greater coverage of psychiatric disorders may provide more comprehensive insight into the underlying structure of psychopathology and personality-based causal pathways.

Another potential limitation of this study concerns some of the observed differential patterns of association at the symptom level (i.e., symptom-level negative direct effects, but positive total/higher-order effects), which could reflect potential measurement error or model misspecification. For example, the “restless & fidgety” item from the K6 and the observed negative association with anxiety sensitivity and positive association with sensation seeking (positive direct effect) suggests this item could reasonably serve as an indicator of internalizing/distress or externalizing/conduct/inattention. As such, an individual’s interpretation of the question may influence whether “restless & fidgety” is an indicator of distress or conduct/inattention. Similarly, the unique positive association between anxiety sensitivity and “worries” (and negative association with negative thinking), may suggest that “worries” would be a more appropriate indicator for fear rather than distress. It is also possible that the symptom-level effects may reflect nuances in our sample. Thus, further longitudinal research is needed to confirm the reliability of these effects and clarify the placement of these potentially cross-cutting symptoms.

Conclusions

Although there is extensive evidence linking personality with psychopathology, much of the research has failed to take into account the empirical structure of psychopathology. Findings from the present study describe the complex links between four high-risk personality traits and their associations with a hierarchical-dimensional framework of psychopathology in a large sample of early adolescents. The results support the four-factor model of vulnerability as a useful tool for identifying adolescents at risk of experiencing psychopathology and provide useful information for the development and optimization of prevention and early intervention programs. Consistent with prior research, the present study indicates that a tendency toward low positive affectivity (negative thinking), a fear of anxiety-related sensations (anxiety sensitivity); difficulties regulating behavioral responses (impulsivity) and/or a desire for novel experiences (sensation seeking) may be associated with a greater risk for developing mental health problems. Although further longitudinal research is needed to better understand the complex interactions between personality and psychopathology, the present study highlights the importance of symptom-level analyses in delineating personality-related risk for psychopathology and the role personality may play in the development of individual symptoms through to broad dimensions of psychopathology. More broadly, the findings contribute to the ongoing the debate surrounding the structure and classification of adolescent psychopathology.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/S0954579422001262

Funding statement

SJL is supported by an Australian National Health and Medical Research Council (NHMRC) Centre of Research Excellence in Prevention and Early Intervention in Mental Illness and Substance Use (PREMISE; APP1134909) PhD Scholarship. NN is supported by an NHMRC Fellowship (APP1166377). MT is supported by an NHMRC Fellowship (APP1195284). NHMRC had no role in the study design, collection, analysis, or interpretation of the data, writing the manuscript, or the decision to submit the paper for publication.

The CAP study was led by researchers at the Matilda Centre at the University of Sydney, Australia, and the University of Montreal, Canada: Teesson, M., Newton, N., Slade., T, Conrod, P. The CAP study was funded by the National Health and Medical Research Council (NHMRC; APP1004744). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. We acknowledge the schools, students, teachers, and research assistants who were involved in this research. The research team also acknowledges the assistance of the New South Wales Department of Education and Communities (SERAP 2011201) for access to their schools for this research.

The CSC study was led by researchers at the Matilda Centre at the University of Sydney, The University of Queensland, Curtin University, Deakin University, and UNSW Sydney: Teesson, M., Andrews, G., Newton, N., Slade, T., Chapman, C., McBride, N., Allsop, S., Hides, Birrell, L., Mewton, L. The CSC study was funded by a National Health and Medical Research Council (NHMRC) project grant (APP1047291). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. We would like to acknowledge the schools, students, teachers and research assistants who were involved in this research. The research team also acknowledges the assistance of the New South Wales Department of Education and Communities (SERAP 2013054), the Western Australian Department of Education (D13/0475948), the Western Australian Catholic Education Office, the Brisbane Catholic Education Office, and Queensland Department of Education and Training for access to their schools for this research.

Conflicts of interest

None.

Footnotes

Nicola C. Newton and Cath Chapman should be considered joint senior author.

References

Afzali, M. H., Sunderland, M., Carragher, N., & Conrod, P. (2017). The structure of psychopathology in early adolescence: Study of a Canadian sample. The Canadian Journal of Psychiatry, 63(4), 223230. https://doi.org/10.1177/0706743717737032 CrossRefGoogle ScholarPubMed
Birrell, L., Newton, N. C., Teesson, M., Tonks, Z., & Slade, T. (2015). Anxiety disorders and first alcohol use in the general population. Findings from a nationally representative sample. Journal of Anxiety Disorders, 31, 108113. https://doi.org/10.1016/j.janxdis.2015.02.008 CrossRefGoogle ScholarPubMed
Blanco, C., Wall, M. M., He, J. P., Krueger, R. F., Olfson, M., Jin, C. J., Burstein, M., & Merikangas, K. R. (2015). The space of common psychiatric disorders in adolescents: Comorbidity structure and individual latent liabilities. Journal of the American Academy of Child and Adolescent Psychiatry, 54(1), 4552. https://doi.org/10.1016/j.jaac.2014.10.007 CrossRefGoogle ScholarPubMed
Bonifay, W., Lane, S. P., & Reise, S. P. (2017). Three concerns with applying a bifactor model as a structure of psychopathology. Clinical Psychological Science, 5(1), 184186. https://doi.org/10.1177/2167702616657069 CrossRefGoogle Scholar
Brandes, C. M., Herzhoff, K., Smack, A. J., & Tackett, J. L. (2019). The p factor and the n factor: Associations between the general factors of psychopathology and neuroticism in children. Clinical Psychological Science, 7(6), 12661284. https://doi.org/10.1177/2167702619859332 CrossRefGoogle Scholar
Brandes, C. M., & Tackett, J. L. (2019). Contextualizing neuroticism in the hierarchical taxonomy of psychopathology. Journal of Research in Personality, 81, 238245. https://doi.org/10.1016/j.jrp.2019.06.007 CrossRefGoogle Scholar
Brown, T. A. (2014). Confirmatory factor analysis for applied research (2nd edn). Guilford Publications.Google Scholar
Carragher, N., Teesson, M., Sunderland, M., Newton, N. C., Krueger, R. F., Conrod, P. J., Barrett, E. L., Champion, K. E., Nair, N. K., Slade, T. (2016). The structure of adolescent psychopathology: A symptom-level analysis. Psychological Medicine, 46(5), 981994. https://doi.org/10.1017/S0033291715002470 CrossRefGoogle ScholarPubMed
Castellanos-Ryan, N., Briere, F. N., O’Leary-Barrett, M., Banaschewski, T., Bokde, A., Bromberg, U., Biichel, C., Flor, H., Frouin, V., Gallinat, J., Garavan, H., Martinot, J. L., Nees, F., Paus, T., Pausova, Z., Rietschel, M., Smolka, M. N., Robbins, T. W., Whelan, R., & The IMAGEN Consortium (2016). The structure of psychopathology in adolescence and its common personality and cognitive correlates. Journal of Abnormal Psychology, 125(8), 10391052, https://doi.org/10.1037/abn0000193,CrossRefGoogle ScholarPubMed
Castellanos-Ryan, N., & Conrod, P. (2012). Personality and substance misuse: Evidence for a four-factor model of vulnerability. In Drug abuse and addiction in medical illness (pp. 4762). Springer New York, https://doi.org/10.1007/978-1-4614-3375-0_4 CrossRefGoogle Scholar
Castellanos-Ryan, N., & Conrod, P. J. (2011). Personality correlates of the common and unique variance across conduct disorder and substance misuse symptoms in adolescence. Journal of Abnormal Child Psychology, 39(4), 563576. https://doi.org/10.1007/s10802-010-9481-3 CrossRefGoogle ScholarPubMed
Castellanos-Ryan, N., O’Leary-Barrett, M., Sully, L., & Conrod, P. (2013). Sensitivity and specificity of a brief personality screening instrument in predicting future substance use, emotional, and behavioral problems: 18-month predictive validity of the substance use risk profile scale. Alcoholism: Clinical and Experimental Research, 37(1), 281290. https://doi.org/10.1111/j.1530-0277.2012.01931.x CrossRefGoogle ScholarPubMed
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14(3), 464504. https://doi.org/10.1080/10705510701301834 CrossRefGoogle Scholar
Conway, C. C., Forbes, M. K., & South, S. C. (2021). A Hierarchical Taxonomy of Psychopathology (HiTOP) primer for mental health researchers. Clinical Psychological Science, 10(2), 236258. https://doi.org/10.1177/21677026211017834.CrossRefGoogle ScholarPubMed
Costello, E. J., Copeland, W., & Angold, A. (2011). Trends in psychopathology across the adolescent years: What changes when children become adolescents, and when adolescents become adults? Journal of Child Psychology and Psychiatry and Allied Disciplines, 52(10), 10151025. https://doi.org/10.1111/j.1469-7610.2011.02446.x CrossRefGoogle ScholarPubMed
Curran, P. J., Howard, A. L., Bainter, S. A., Lane, S. T., & McGinley, J. S. (2014). The separation of between-person and within-person components of individual change over time: A latent curve model with structured residuals. Journal of Consulting and Clinical Psychology, 82(5), 879894. https://doi.org/10.1037/a0035297 CrossRefGoogle Scholar
den Akker, A. L. V., Prinzie, P., Deković, M., De Haan, A. D., Asscher, J. J., & Widiger, T. (2013). The development of personality extremity from childhood to adolescence: Relations to internalizing and externalizing problems. Journal of Personality and Social Psychology, 105(6), 10381048. https://doi.org/10.1037/a0034441 CrossRefGoogle Scholar
Dyer, M. L., Easey, K. E., Heron, J., Hickman, M., & Munafò, M. R. (2019). Associations of child and adolescent anxiety with later alcohol use and disorders: A systematic review and meta-analysis of prospective cohort studies. Addiction, 114(6), 968982. https://doi.org/10.1111/add.14575 CrossRefGoogle ScholarPubMed
Etkin, P., De Caluwé, E., Ibáñez, M. I., Ortet, G., & Mezquita, L. (2022). Personality development and its associations with the bifactor model of psychopathology in adolescence. Journal of Research in Personality, 97, 104205. https://doi.org/10.1016/j.jrp.2022.104205 CrossRefGoogle Scholar
Etkin, P., Ibáñez, M. I., Ortet, G., & Mezquita, L. (2021). Longitudinal associations between the five-factor model of personality and the bi-factor model of psychopathology: Continuity, pathoplasty and complication effects in adolescents. Journal of Psychopathology and Behavioral Assessment, 44(2), 405417. https://doi.org/10.1007/s10862-021-09903-1 CrossRefGoogle Scholar
Ferro, M. A. (2019). The psychometric properties of the Kessler psychological distress scale (K6) in an epidemiological sample of Canadian youth. The Canadian Journal of Psychiatry, 64(9), 647657. https://doi.org/10.1177/0706743718818414 CrossRefGoogle Scholar
Forbes, M. K., Greene, A. L., Levin-Aspenson, H. F., Watts, A. L., Hallquist, M., Lahey, B. B., Markon, K. E., Patrick, C. J., Tackett, J. L., Waldman, I. D., Wright, A. G. C., Caspi, A., Ivanova, M., Kotov, R., Samuel, D. B., Eaton, N. R., Krueger, R. F. (2021). Three recommendations based on a comparison of the reliability and validity of the predominant models used in research on the empirical structure of psychopathology. Journal of Abnormal Psychology, 130(3), 297317. https://doi.org/10.1037/abn0000533 CrossRefGoogle ScholarPubMed
Forbes, M. K., Sunderland, M., Rapee, R. M., Batterham, P. J., Calear, A. L., Carragher, N., Ruggero, C., Zimmerman, M., Baillie, A. J., Lynch, S. J., Mewton, L., Slade, T., Krueger, R. F. (2021). A detailed hierarchical model of psychopathology: From individual symptoms up to the general factor of psychopathology. Clinical Psychological Science, 9(2), 139168. https://doi.org/10.1177/2167702620954799 CrossRefGoogle ScholarPubMed
Gomez, R., Stavropoulos, V., Vance, A., & Griffiths, M. D. (2019). Re-evaluation of the latent structure of common childhood disorders: Is there a general psychopathology factor (P-factor)? International Journal of Mental Health and Addiction, 17(2), 258278. https://doi.org/10.1007/s11469-018-0017-3 CrossRefGoogle Scholar
Goodman, A., Lamping, D. L., & Ploubidis, G. B. (2010). When to use broader internalising and externalising subscales instead of the hypothesised five subscales on the strengths and difficulties questionnaire (SDQ): Data from british parents, teachers and children. Journal of Abnormal Child Psychology, 38(8), 11791191. https://doi.org/10.1007/s10802-010-9434-x CrossRefGoogle ScholarPubMed
Goodman, R. (2001). Psychometric properties of the strengths and difficulties questionnaire. Journal of the American Academy of Child and Adolescent Psychiatry, 40(11), 13371345. https://doi.org/10.1097/00004583-200111000-00015 CrossRefGoogle ScholarPubMed
Greene, A. L., Eaton, N. R., Li, K., Forbes, M. K., Krueger, R. F., Markon, K. E., Waldman, I. D., Cicero, D. C., Conway, C. C., Docherty, A. R., Fried, E. I., Ivanova, M. Y., Jonas, K. G., Latzman, R. D., Patrick, C. J., Reininghaus, U., Tackett, J. L., Wright, A. G. C., Kotov, R. (2019). Are fit indices used to test psychopathology structure biased? A simulation study. Journal of Abnormal Psychology, 128(7), 740764. https://doi.org/10.1037/abn0000434 CrossRefGoogle ScholarPubMed
Haltigan, J. D., Aitken, M., Skilling, T., Henderson, J., Hawke, L., Battaglia, M., Strauss, J., Szatmari, P., & Andrade, B. F. (2018). “P” and “DP:” examining symptom-level bifactor models of psychopathology and dysregulation in clinically referred children and adolescents. Journal of the American Academy of Child and Adolescent Psychiatry, 57(6), 384396. https://doi.org/10.1016/j.jaac.2018.03.010 CrossRefGoogle ScholarPubMed
Hopwood, C. J., Wright, A. G. C., & Bleidorn, W. (2022). Person-environment transactions differentiate personality and psychopathology. Nature Reviews Psychology, 1(1), 5563. https://doi.org/10.1038/s44159-021-00004-0 CrossRefGoogle Scholar
Hoza, B., Vaughn, A., Waschbusch, D. A., Murray-Close, D., & McCabe, G. (2012). Can children with ADHD be motivated to reduce bias in self-reports of competence? Journal of Consulting and Clinical Psychology, 80(2), 245254. https://doi.org/10.1037/a0027299 CrossRefGoogle ScholarPubMed
Jovanović, V., & Gavrilov-Jerković, V. (2016). The structure of adolescent affective well-being: The case of the PANAS among Serbian adolescents. Journal of Happiness Studies, 17(5), 20972117. https://doi.org/10.1007/s10902-015-9687-8 CrossRefGoogle Scholar
Kessler, R. C., Andrews, G., Colpe, L. J., Hiripi, E., Mroczek, D. K., Normand, S. L. T., Walters, E. E., & Zaslavsky, A. M. (2002). Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychological Medicine, 32(6), 959976. https://doi.org/10.1017/S0033291702006074 CrossRefGoogle ScholarPubMed
Kessler, Ronald C., Barker, P. R., Colpe, L. J., Epstein, J. F., Gfroerer, J. C., Hiripi, E., Howes, M. J., Normand, S.-L. T., Manderscheid, R. W., Walters, E. E., Zaslavsky, A. M. (2003). Screening for serious mental illness in the general population. Archives of General Psychiatry, 60(2), 184. https://doi.org/10.1001/archpsyc.60.2.184 CrossRefGoogle ScholarPubMed
Kessler, R. C., Ormel, J., Petukhova, M., McLaughlin, K. A., Green, J. G., Russo, L. J., Stein, D. J., Zaslavsky, A. M., Aguilar-Gaxiola, S., Alonso, J., Andrade, L., Benjet, C., de Girolamo, G., de Graaf, R., Demyttenaere, K., Fayyad, J., Haro, J. M., Hu, C. Y., Karam, A., …, & Üstün, T. B. (2011). Development of lifetime comorbidity in the world health organization world mental health surveys. Archives of General Psychiatry, 68(1), 90, https://doi.org/10.1001/archgenpsychiatry.2010.180,CrossRefGoogle ScholarPubMed
Kotov, R., Krueger, R. F., Watson, D., Achenbach, T. M., Althoff, R. R., Michael Bagby, R., Brown, T. A., Carpenter, W. T., Caspi, A., Anna Clark, L., Eaton, N. R., Forbes, M. K., Forbush, K. T., Goldberg, D., Hasin, D., Hyman, S. E., Ivanova, M. Y., Lynam, D. R., Markon, K., …, & Zimmerman, M. (2017). The Hierarchical Taxonomy of Psychopathology (HiTOP): A dimensional alternative to traditional nosologies. Association, 126(4), 454477, https://doi.org/10.1037/abn0000258,Google ScholarPubMed
Kotov, R., Krueger, R. F., Watson, D., Cicero, D. C., Conway, C. C., DeYoung, C. G., Eaton, N. R., Forbes, M. K., Hallquist, M. N., Latzman, R. D., Mullins-Sweatt, S. N., Ruggero, C. J., Simms, L. J., Waldman, I. D., Waszczuk, M. A., Wright, A. G. C. (2021). The Hierarchical Taxonomy of Psychopathology (HiTOP): A quantitative nosology based on consensus of evidence. Annual Review of Clinical Psychology, 17(1), 83108. https://doi.org/10.1146/annurev-clinpsy-081219-093304 CrossRefGoogle ScholarPubMed
Krueger, R. F., Hobbs, K. A., Conway, C. C., Dick, D. M., Dretsch, M. N., Eaton, N. R., Forbes, M. K., Forbush, K. T., Keyes, K. M., Latzman, R. D., Michelini, G., Patrick, C. J., Sellbom, M., Slade, T., South, S. C., Sunderland, M., Tackett, J., Waldman, I., Waszczuk, M. A.et al. (2021). Validity and utility of hierarchical taxonomy of psychopathology (HiTOP): II. Externalizing superspectrum. World Psychiatry, 20(2), 171193. https://doi.org/10.1002/wps.20844 CrossRefGoogle ScholarPubMed
Lahey, B. B., Moore, T. M., Kaczkurkin, A. N., & Zald, D. H. (2021). Hierarchical models of psychopathology: Empirical support, implications, and remaining issues. World Psychiatry, 20(1), 5763. https://doi.org/10.1002/wps.20824 CrossRefGoogle ScholarPubMed
Lammers, J., Goossens, F., Conrod, P., Engels, R., Wiers, R. W., & Kleinjan, M. (2017). Effectiveness of a selective alcohol prevention program targeting personality risk factors: Results of interaction analyses. Addictive Behaviors, 71, 8288. https://doi.org/10.1016/j.addbeh.2017.02.030 CrossRefGoogle ScholarPubMed
Lees, B., Squeglia, L. M., McTeague, L. M., Forbes, M. K., Krueger, R. F., Sunderland, M., Baillie, A. J., Koch, F., Teesson, M., Mewton, L. (2020). Altered neurocognitive functional connectivity and activation patterns underlie psychopathology in preadolescence. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging, 9(4), 112. https://doi.org/10.1016/j.bpsc.2020.09.007 Google Scholar
Levin-Aspenson, H. F., Khoo, S., & Kotelnikova, Y. (2019). Hierarchical taxonomy of psychopathology across development: Associations with personality. Journal of Research in Personality, 81, 7278. https://doi.org/10.1016/j.jrp.2019.05.006 CrossRefGoogle Scholar
Lynam, D. R., & Miller, J. D. (2019). The basic trait of Antagonism: An unfortunately underappreciated construct. Journal of Research in Personality, 81, 118126. https://doi.org/10.1016/j.jrp.2019.05.012 CrossRefGoogle Scholar
Lynch, S. J., Sunderland, M., Newton, N. C., & Chapman, C. (2021). A systematic review of transdiagnostic risk and protective factors for general and specific psychopathology in young people. Clinical Psychology Review, 87, 102036. https://doi.org/10.1016/j.cpr.2021.102036 CrossRefGoogle ScholarPubMed
McBride, N., Farringdon, F., Midford, R., Meuleners, L., & Phillips, M. (2004). Harm minimization in school drug education: Final results of the School Health and Alcohol Harm Reduction Project (SHAHRP). Addiction, 99(3), 278291. https://doi.org/10.1111/j.1360-0443.2003.00620.x CrossRefGoogle ScholarPubMed
Mewton, L., Kessler, R. C., Slade, T., Hobbs, M. J., Brownhill, L., Birrell, L., Tonks, Z., Teesson, M., Newton, N., Chapman, C., Allsop, S., Hides, L., McBride, N., Andrews, G. (2016). The psychometric properties of the Kessler Psychological Distress Scale (K6) in a general population sample of adolescents. Psychological Assessment, 28(10), 12321242. https://doi.org/10.1037/pas0000239 CrossRefGoogle Scholar
Neal, D. J., Corbin, W. R., & Fromme, K. (2006). Measurement of alcohol-related consequences among high school and college students: Application of item response models to the Rutgers Alcohol Problem Index. Psychological Assessment, 18(4), 402414. https://doi.org/10.1037/1040-3590.18.4.402 CrossRefGoogle Scholar
Newton, N. C., Barrett, E. L., Castellanos-Ryan, N., Kelly, E., Champion, K. E., Stapinski, L., Conrod, P. J., Slade, T., Nair, N., Teesson, M. (2016). The validity of the Substance Use Risk Profile Scale (SURPS) among Australian adolescents. Addictive Behaviors, 53, 2330. https://doi.org/10.1016/j.addbeh.2015.09.015 CrossRefGoogle ScholarPubMed
Newton, N. C., Stapinski, L., Teesson, M., Slade, T., Champion, K. E., Barrett, E. L., Birrell, L., Kelly, E., Mather, M., Conrod, P. J. (2020). Evaluating the differential effectiveness of social influence and personality-targeted alcohol prevention on mental health outcomes among high-risk youth: A novel cluster randomised controlled factorial design trial. Australian & New Zealand Journal of Psychiatry, 54(3), 259271. https://doi.org/10.1177/0004867419877948 CrossRefGoogle ScholarPubMed
Newton, N. C., Teesson, M., Barrett, E. L., Slade, T., & Conrod, P. J. (2012). The CAP study, evaluation of integrated universal and selective prevention strategies for youth alcohol misuse: Study protocol of a cluster randomized controlled trial. BMC Psychiatry, 12(1), 118. https://doi.org/10.1186/1471-244X-12-118 CrossRefGoogle ScholarPubMed
Nirenberg, T., Longabaugh, R., Baird, J., & Mello, M. J. (2013). Treatment may influence self-report and jeopardize our understanding of outcome. Journal of Studies on Alcohol and Drugs, 74(5), 770776. https://doi.org/10.15288/jsad.2013.74.770 CrossRefGoogle ScholarPubMed
O’Leary-Barrett, M., Topper, L., Al-Khudhairy, N., Pihl, R. O., Castellanos-Ryan, N., Mackie, C. J., & Conrod, P. J. (2013). Two-year impact of personality-targeted, teacher-delivered interventions on youth internalizing and externalizing problems: A cluster-randomized trial. Journal of the American Academy of Child & Adolescent Psychiatry, 52(9), 911920. https://doi.org/10.1016/j.jaac.2013.05.020 CrossRefGoogle ScholarPubMed
Ofrat, S., & Krueger, R. F. (2012). How research on the meta-structure of psychopathology aids in understanding biological correlates of mood and anxiety disorders. Biology of Mood & Anxiety Disorders, 2(1), 13. https://doi.org/10.1186/2045-5380-2-13 CrossRefGoogle ScholarPubMed
Pardee, C. S., Colder, C. R., & Bowker, J. C. (2014). Dynamic associations among alcohol use and anxiety symptoms in early adolescence. Psychology of Addictive Behaviors, 28(4), 12461252. https://doi.org/10.1037/a0038372 CrossRefGoogle ScholarPubMed
Platt, J. M., Colich, N. L., McLaughlin, K. A., Gary, D., & Keyes, K. M. (2017). Transdiagnostic psychiatric disorder risk associated with early age of menarche: A latent modeling approach. Comprehensive Psychiatry, 79, 7079. https://doi.org/10.1016/j.comppsych.2017.06.010 CrossRefGoogle ScholarPubMed
Raftery, A. E. (1995). Bayesian model selection in social research. Sociological Methodology, 25, 111. https://doi.org/10.2307/271063 CrossRefGoogle Scholar
Reise, S. P., Scheines, R., Widaman, K. F., & Haviland, M. G. (2013). Multidimensionality and structural coefficient bias in structural equation modeling: A bifactor perspective. Educational and Psychological Measurement, 73(1), 526. https://doi.org/10.1177/0013164412449831 CrossRefGoogle Scholar
Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016a). Applying bifactor statistical indices in the evaluation of psychological measures. Journal of Personality Assessment, 98(3), 223237. https://doi.org/10.1080/00223891.2015.1089249 CrossRefGoogle ScholarPubMed
Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016b). Evaluating bifactor models: Calculating and interpreting statistical indices. Psychological Methods, 21(2), 137150. https://doi.org/10.1037/met0000045 CrossRefGoogle ScholarPubMed
Rudnev, M., Lytkina, E., Davidov, E., Schmidt, P., & Zick, A. (2018). Testing measurement invariance for a second-order factor. a cross-national test of the Alienation scale | rudnev | methods, data analyses. Methods, Data, Analyses, 12(1), 4776. https://doi.org/https://doi.org/10.12758/mda.2017.11 Google Scholar
Santens, E., Claes, L., Dierckx, E., & Dom, G. (2020). Effortful control - A transdiagnostic dimension underlying internalizing and externalizing psychopathology. Neuropsychobiology, 79(4-5), 255269. https://doi.org/10.1159/000506134 CrossRefGoogle ScholarPubMed
Sellbom, M., Carragher, N., Sunderland, M., Calear, A. L., & Batterham, P. J. (2020). The role of maladaptive personality domains across multiple levels of the HiTOP structure. Personality and Mental Health, 14(1), 3050. https://doi.org/10.1002/pmh.1461 CrossRefGoogle ScholarPubMed
Slade, T., McEvoy, P. M., Chapman, C., Grove, R., & Teesson, M. (2015). Onset and temporal sequencing of lifetime anxiety, mood and substance use disorders in the general population. Epidemiology and Psychiatric Sciences, 24(1), 4553. https://doi.org/10.1017/S2045796013000577 CrossRefGoogle ScholarPubMed
Slade, Tim, & Watson, D. (2006). The structure of common DSM-IV and ICD-10 mental disorders in the Australian general population. Psychological Medicine, 36(11), 15931600. https://doi.org/10.1017/S0033291706008452 CrossRefGoogle ScholarPubMed
Smith, G. T., McCarthy, D. M., & Goldman, M. S. (1995). Self-reported drinking and alcohol-related problems among early adolescents: Dimensionality and validity over 24 months. Journal of Studies on Alcohol, 56(4), 383394. https://doi.org/10.15288/jsa.1995.56.383 CrossRefGoogle ScholarPubMed
Smith, S. R. (2007). Making sense of multiple informants in child and adolescent psychopathology: A guide for clinicians. Journal of Psychoeducational Assessment, 25(2), 139149. https://doi.org/10.1177/0734282906296233 CrossRefGoogle Scholar
Sodano, S. M., Tamulonis, J. P., Fabiano, G. A., Caserta, A. M., Hulme, K. F., Hulme, K. L., Stephan, G. R., & Tronci, F. (2021). Interpersonal problems of young adults with and without attention-deficit/hyperactivity disorder. Journal of Attention Disorders, 25(4), 562571. https://doi.org/10.1177/1087054718821728 CrossRefGoogle ScholarPubMed
Solmi, M., Radua, J., Olivola, M., Croce, E., Soardo, L., Salazar de Pablo, G., Il Shin, J., Kirkbride, J. B., Jones, P., Kim, J. H., Kim, J. Y., Carvalho, A. F., Seeman, M. V., Correll, C. U., Fusar-Poli, P. (2021). Age at onset of mental disorders worldwide: Large-scale meta-analysis of 192 epidemiological studies. Molecular Psychiatry, 27(1), 281295. https://doi.org/10.1038/s41380-021-01161-7 CrossRefGoogle ScholarPubMed
Stapinski, L. A., Rapee, R. M., Sannibale, C., Teesson, M., Haber, P. S., & Baillie, A. J. (2015). The clinical and theoretical basis for integrated cognitive behavioral treatment of comorbid social anxiety and alcohol use disorders. Cognitive and Behavioral Practice, 22(4), 504521. https://doi.org/10.1016/j.cbpra.2014.05.004 CrossRefGoogle Scholar
Sunderland, M., Forbes, M. K., Mewton, L., Baillie, A., Carragher, N., Lynch, S. J., Batterham, P. J., Calear, A. L., Chapman, C., Newton, N. C., Teesson, M., Slade, T. (2020). The structure of psychopathology and association with poor sleep, self-harm, suicidality, risky sexual behavior, and low self-esteem in a population sample of adolescents. Development and Psychopathology, 1-12(4), 12081219. https://doi.org/10.1017/S0954579420000437 Google Scholar
Tackett, J. L. (2006). Evaluating models of the personality-psychopathology relationship in children and adolescents. Clinical Psychology Review, 26(5), 584599. https://doi.org/10.1016/j.cpr.2006.04.003 CrossRefGoogle ScholarPubMed
Teesson, M., Newton, N. C., Slade, T., Chapman, C., Allsop, S., Hides, L., McBride, N., Mewton, L., Tonks, Z., Birrell, L., Brownhill, L., Andrews, G. (2014). The CLIMATE schools combined study: A cluster randomised controlled trial of a universal Internet-based prevention program for youth substance misuse, depression and anxiety. BMC Psychiatry, 14(1), 32. https://doi.org/10.1186/1471-244X-14-32 CrossRefGoogle ScholarPubMed
Topper, L. R., Castellanos-Ryan, N., Mackie, C., & Conrod, P. J. (2011). Adolescent bullying victimisation and alcohol-related problem behaviour mediated by coping drinking motives over a 12 month period. Addictive Behaviors, 36(1-2), 613. https://doi.org/10.1016/j.addbeh.2010.08.016 CrossRefGoogle ScholarPubMed
Van De Looij-Jansen, P. M., Goedhart, A. W., De Wilde, E. J., & Treffers, P. D. A. (2011). Confirmatory factor analysis and factorial invariance analysis of the adolescent self-report Strengths and Difficulties Questionnaire: How important are method effects and minor factors? British Journal of Clinical Psychology, 50(2), 127144. https://doi.org/10.1348/014466510X498174 CrossRefGoogle ScholarPubMed
van der Ende, J., Verhulst, F. C., & Tiemeier, H. (2020). Multitrait-multimethod analyses of change of internalizing and externalizing problems in adolescence: Predicting internalizing and externalizing DSM disorders in adulthood. Journal of Abnormal Psychology, 129(4), 343354. https://doi.org/10.1037/abn0000510 CrossRefGoogle ScholarPubMed
Watson, D., Clark, L. A., Chmielewski, M., & Kotov, R. (2013). The value of suppressor effects in explicating the construct validity of symptom measures. Psychological Assessment, 25(3), 929941. https://doi.org/10.1037/A0032781 CrossRefGoogle ScholarPubMed
Watson, D., Gamez, W., & Simms, L. J. (2005). Basic dimensions of temperament and their relation to anxiety and depression: A symptom-based perspective. Journal of Research in Personality, C(), 4666. https://doi.org/10.1016/j.jrp.2004.09.006 CrossRefGoogle Scholar
Watson, D., Levin-Aspenson, H. F., Waszczuk, M. A., Conway, C. C., Dalgleish, T., Dretsch, M. N., Eaton, N. R., Forbes, M. K., Forbush, K. T., Hobbs, K. A., Michelini, G., Nelson, B. D., Sellbom, M., Slade, T., South, S. C., Sunderland, M., Waldman, I., Witthöft, M., Wright, A. G. C.et al. (2022). Validity and utility of Hierarchical Taxonomy of Psychopathology (HiTOP): III. Emotional dysfunction superspectrum. World Psychiatry, 21(1), 2654. https://doi.org/10.1002/wps.20943 CrossRefGoogle ScholarPubMed
Watson, D., Stanton, K., Khoo, S., Ellickson-Larew, S., & Stasik-O’Brien, S. M. (2019). Extraversion and psychopathology: A multilevel hierarchical review. Journal of Research in Personality, 81, 110. https://doi.org/10.1016/J.JRP.2019.04.009 CrossRefGoogle Scholar
Watson, D., & Tellegen, A. (1985). Toward a consensual structure of mood. Psychological Bulletin, 98(2), 219235. https://doi.org/10.1037/0033-2909.98.2.219 CrossRefGoogle Scholar
Watts, A. L., Lane, S. P., Bonifay, W., Steinley, D., & Meyer, F. A. C. (2020). Building theories on top of, and not independent of, statistical models: The case of the p-factor. Psychological Inquiry, 31, 310320, https://doi.org/10.31234/osf.io/3vsey,CrossRefGoogle Scholar
Watts, Ashley L., Poore, H. E., Lilienfeld, S. O., & Waldman, I. D. (2019). Clarifying the associations between Big Five personality domains and higher-order psychopathology dimensions in youth. Journal of Research in Personality, 82, 103844. https://doi.org/10.1016/j.jrp.2019.07.002 CrossRefGoogle Scholar
White, H. R., & Labouvie, E. W. (1989). Towards the assessment of adolescent problem drinking. Journal of Studies on Alcohol, 50(1), 3037. https://doi.org/10.15288/jsa.1989.50.30 CrossRefGoogle ScholarPubMed
Widiger, T. A., Sellbom, M., Chmielewski, M., Clark, L. A., DeYoung, C. G., Kotov, R., Krueger, R. F., Lynam, D. R., Miller, J. D., Mullins-Sweatt, S., Samuel, D. B., South, S. C., Tackett, J. L., Thomas, K. M., Watson, D., Wright, A. G. C. (2019). Personality in a hierarchical model of psychopathology. Clinical Psychological Science, 7(1), 7792. https://doi.org/10.1177/2167702618797105 CrossRefGoogle Scholar
Woicik, P.a, Stewart, S. H., Pihl, R. O., & Conrod, P. J. (2009). The substance use risk profile scale: A scale measuring traits linked to reinforcement-specific substance use profiles. Addictive Behaviors, 34(12), 10421055. https://doi.org/10.1016/j.addbeh.2009.07.001 CrossRefGoogle Scholar
Wright, A. G. C., & Hopwood, C. J. (2022). Integrating and distinguishing personality and psychopathology. Journal of Personality, 90(1), 519. https://doi.org/10.1111/jopy.12671 CrossRefGoogle ScholarPubMed
Figure 0

Table 1. Fit indices for different structural models of adolescent psychopathology (n = 8,589)

Figure 1

Table 2. Standardized factor loadings on general and specific (fear, distress, alcohol use/harms, conduct/inattention) factors using WLSMV estimator and inter-factor correlations

Figure 2

Table 3. Reliability indices alternative models of adolescent psychopathology

Figure 3

Figure 1. Higher-order structural model of adolescent psychopathology with standardized parameter estimates. Note. All estimates statistically significant (p ≤ 0.05). Standardized factor loadings for indicators of psychopathology are presented in Table 2.

Figure 4

Table 4. Results of measurement invariances tests of a higher-order model of psychopathology

Figure 5

Figure 2. Effect sizes and standard errors for standardized direct effect of each personality trait on first-order psychopathology factors (fear, distress, conduct/inattention, and alcohol use/harms) and total effect on general psychopathology. Note. Significant effects (p < 0.001) shown in black, non-significant (p > 0.001) effect shown in gray. Vertical gray solid lines show 0.0 effect size.

Figure 6

Figure 3. Effect sizes and standard errors for standardized direct effects of each personality profile on symptoms of psychopathology. Note. Significant effects (p < 0.001) shown in black, non-significant (p > 0.001) effect shown in gray. Black dotted lines mark boundaries between first-order factors, vertical gray solid lines show 0.0 effect size.

Supplementary material: File

Lynch et al. supplementary material

Lynch et al. supplementary material

Download Lynch et al. supplementary material(File)
File 550.6 KB