Hostname: page-component-cd9895bd7-jn8rn Total loading time: 0 Render date: 2024-12-24T03:36:56.189Z Has data issue: false hasContentIssue false

An exploratory study of psychosis risk factors in individuals who are referred but do not meet criteria for an early intervention in psychosis service

Published online by Cambridge University Press:  05 January 2024

Sean Naughton*
Affiliation:
Dublin and East Treatment and Early Care Team (DETECT) Early Intervention in Psychosis Service, Dublin, Ireland; and School of Medicine, University College Dublin, Ireland
Aoife Brady
Affiliation:
Dublin and East Treatment and Early Care Team (DETECT) Early Intervention in Psychosis Service, Dublin, Ireland
Eoin Geary
Affiliation:
Dublin and East Treatment and Early Care Team (DETECT) Early Intervention in Psychosis Service, Dublin, Ireland
Eimear Counihan
Affiliation:
Dublin and East Treatment and Early Care Team (DETECT) Early Intervention in Psychosis Service, Dublin, Ireland
Mary Clarke
Affiliation:
Dublin and East Treatment and Early Care Team (DETECT) Early Intervention in Psychosis Service, Dublin, Ireland; and School of Medicine, University College Dublin, Ireland
*
Correspondence: Sean Naughton. Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Background

The ‘at-risk mental state’ (ARMS) for psychosis has been critiqued for its limited prognostic ability and identification of a limited proportion of those who will develop a first episode of psychosis (FEP). Broadening the search for high-risk groups is key to improving population-level ascertainment of psychosis risk.

Aims

To explore risk enrichment in diagnostic, demographic and socio-functional domains among individuals referred to an early intervention in psychosis (EIP) service not meeting ARMS or FEP criteria.

Method

A retrospective file review of 16 years of referrals to a tertiary EIP service in Ireland was undertaken. Diagnostic outcomes from standardised assessments (Structured Clinical Interview for DSM), demographic (age, gender, family history, nationality) and socio-occupational (relationship status, living status, working status) variables were compiled for those not meeting criteria. These were compared with individuals diagnosed with an FEP in the same period.

Results

From 2005 to 2021 inclusive, of 2025 index assessments, 27.6% (n = 558) did not meet either FEP or ARMS criteria, which is notably higher than the 5.4% (n = 110) meeting ARMS criteria. This group had high psychiatric morbidity, with 65.4% meeting criteria for at least one DSM Axis I disorder. Depressive, anxiety and substance use disorders predominated. Their functional markers were poor, and comparable to the FEP cohort.

Conclusions

This group is enriched for psychosis risk factors. They are a larger group than those meeting ARMS criteria, a finding that may reflect EIP service configuration. They may be an important focus for further study in the search for at-risk populations beyond the current ARMS model.

Type
Paper
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
Copyright © The Author(s), 2024. Published by Cambridge University Press on behalf of the Royal College of Psychiatrists

The limitations of positive symptom spectrum ‘at-risk mental state’ models

Early intervention in psychosis (EIP) services have become well-embedded in mental health services over the past two decades, with a focus on the early detection and treatment of first-episode psychosis (FEP).Reference McGorry1 The paradigm further developed to primary and secondary prevention, identifying individuals with an at-risk mental state (ARMS) of developing psychosis. These criteria focus primarily on the detection of sub-disorder threshold positive psychotic symptoms.Reference Yung, McGorry, McFarlane, Jackson, Patton and Rakkar2 This ARMS model has a modest predictive value for psychosis in selected samples,Reference Fusar-Poli, Cappucciati, Rutigliano, Schultze-Lutter, Bonoldi and Borgwardt3 and recent critiques have highlighted this limited predictive ability, the uncertain mutability of transitions rates to psychosis at this stage, and the identification of only a narrow group of individuals at risk of a psychotic disorder.Reference Moritz, Gawęda, Heinz and Gallinat4,Reference Ajnakina, David and Murray5

Despite calls to broaden the ARMS paradigm,Reference Cotter, Healy, Staines, Mongan and Cannon6 this has not resulted in any revision of current criteria. In contrast, other predictive models of medical risk have developed around a system of iterative enhancements. The QRISK model for cardiovascular disease risk has had annual updates since 2007, adding and reweighting risk factors on the basis of population data. Currently in its third major revision, this development has resulted in increased ascertainment of cardiovascular events.Reference Hippisley-Cox, Coupland and Brindle7 These systems are designed for the identification of high-risk groups within the general population, and are therefore built around known risk factors for the condition rather that identifying individuals with subthreshold symptoms of the target pathology.

Although several enhanced prediction models are under evaluation, the majority are derivative of ARMS criteria, combining biological and clinical markers in this group.Reference Coutts, Koutsouleris and McGuire8 Although this may increase the specificity of prediction, the sensitivity will remain challenged. The attenuated positive symptoms that characterise the ARMS state may not be a universal, or even common, entry point to psychosis. In locations where ARMS services are well established, only a minority with incident psychosis have initially had this diagnosis.Reference Burke, Thompson, Mifsud, Yung, Nelson and McGorry9,Reference Ajnakina, Morgan, Gayer-Anderson, Oduola, Bourque and Bramley10 Population-based studies put ARMS sensitivity for later psychosis as low as 15%.Reference Sullivan, Kounali, Cannon, David, Fletcher and Holmans11 This has led to calls for a broader starting point to defining high-risk groups.Reference Seyedsalehi and Lennox12

The search for at risk-groups beyond the current ARMS model

Because of the relatively low incidence of psychotic disorders in the general population, defining high-risk groups remains essential for any workable prediction model.Reference Van Os and Delespaul13 Recent work to identify such groups have had success utilising ‘clinical pathway risks’. Attendance at child and adolescent mental health services and presentation to an emergency department following self-harm as an adolescent, which do not incorporate any specific test for psychosis spectrum symptoms, have demonstrated predictive accuracy for psychosis superior to many ARMS samples.Reference Lång, Ramsay, Yates, Veijola, Gyllenberg and Clarke14,Reference Bolhuis, Lång, Gyllenberg, Kääriälä, Veijola and Gissler15 This may be reflective of a common set of risk factors for psychosis shared by individuals referred for assessment or treatment of any significant psychiatric symptoms. Indeed, individuals referred for assessment of psychosis and psychosis risk are already selectively filtered through a range of consecutive referral processes,Reference Van Os and Delespaul13 resulting in a group substantially enriched for known psychosis risk factors, many of which are not components of the current ARMS model.Reference Fusar-Poli, Rutigliano, Stahl, Schmidt, Ramella-Cravaro and Hitesh16 This sample enrichment likely accounts for a large proportion of the ARMS post-test risk.Reference Fusar-Poli and Schultze-Lutter17

Such risk factors include symptomatic and functional markers that are established antecedents of psychotic disorders. Substantial non-psychotic psychiatric morbidity is known to precede the development of psychosis, with anxiety and depressive disorders the plurality.Reference Yung and McGorry18,Reference Häfner19 At a general population level, mood disorders have a higher population attributable fraction for psychosis than ARMS status.Reference Guloksuz, Pries, Ten Have, de Graaf, van Dorsselaer and Klingenberg20 Socio-occupational functional impairments are also antecedent markers of psychosis, manifesting in both the premorbid and prodromal phases.Reference Häfner, Nowotny, Löffler, an der Heiden and Maurer21,Reference Larsen, McGlashan, Johannessen and Vibe-Hansen22 Such markers generally appear earlier than positive symptoms,Reference Cannon, Caspi, Moffitt, Harrington, Taylor and Murray23 offering the potential for intervention within a developmental window of sensitivity.Reference Kelleher24

Rationale for the current study

The current study is an exploratory study of risk factors in individuals referred to a tertiary EIP service because of a concern from a referring clinician about psychosis risk, but without symptoms sufficient for either ARMS or FEP status. Although this is little studied group, the limited research to date indicates they constitute a significant proportion of EIP service referrals, at 41–59%.Reference O'Donoghue, O'Connor, Thompson and McGorry25Reference Lindhardt, Lindhardt, Haahr, Hastrup, Simonsen and Nordgaard27 They have been reported as having high general psychiatric morbidityReference O'Donoghue, Lyne, Renwick, Madigan, Kinsella and Clarke28 and substantial occupational impairment.Reference Lindhardt, Lindhardt, Haahr, Hastrup, Simonsen and Nordgaard27

We hypothesise that these individuals are enriched for known psychosis risk factors, even in the absence of positive spectrum symptoms sufficient for ARMS or FEP status, and thus may constitute an important group for further study. This study compiled information on demographic, non-psychotic psychiatric morbidity and socio-occupational variables. As a reference for risk enrichment and functioning within this cohort, they are compared with individuals diagnosed with an FEP during the same time period.

Method

Study setting

The Dublin and East Treatment and Early Care Team (DETECT) is a tertiary EIP service in Ireland. The service commenced operation in 2005, with initial funding from the St. John of God Hospitaller Services Group, and later the publicly funded Health Service Executive. It is configured as a hub and spoke model.

This public service provides universal access within a geographically defined catchment area in the East Coast Region. The catchment area is defined by community healthcare organisation six (CHO6), with a population of over 400 000. It includes a mixture of urban and rural areas and varying levels of socioeconomic deprivation. CHO6 is served by three adult mental health services: Cluain Mhuire, Dublin South East and East Wicklow. It also includes an independent sector organisation St. John of God Hospital, which provides care on a funded basis. Referrals to DETECT are accepted only from these secondary care sources, and primary care or self-referral is not possible. Referrals are accepted for those aged 18–65 years, in-patients or out-patients, where there are concerns that an individual's presenting symptoms are suggestive of an early-stage psychotic illness.

DETECT provides a comprehensive assessment for all referrals and access to specialist interventions for individuals experiencing an FEP. Those who do not meet the threshold for a psychosis spectrum disorder but do meet criteria for a psychosis risk syndrome are offered reassessment with a standardised instrument at 6 months, to investigate the course of symptoms, or earlier if there are clinical concerns. For those experiencing psychosis, but not in their first episode (‘psychosis, not FEP’), or who do not meet criteria for any of the categories (‘not meeting criteria’), specialist interventions or review are not offered, but a comprehensive diagnostic report is provided to the referring clinical team. Re-referral of those ‘not meeting criteria’ are encouraged if there is any change in their symptoms.

Assessment and case criteria

Individuals referred to DETECT, who are agreeable to assessment, participate in a comprehensive structured diagnostic interview. From the inception of the service all assessments have included the Structured Clinical Interview for DSM (SCID). Modules A to G are utilised, assessing for mood disorders, psychotic disorders, anxiety disorders, substance use disorders, obsessive–compulsive and related disorders, and their differentials. Outcomes are recorded for all diagnoses met, with the primary disorder assigned as the disorder that is the subject of the referral symptoms. The Structured Interview for Psychosis-Risk Syndromes (SIPS) is administered where there is a clinical concern of a psychosis-risk syndrome (ARMS). All assessments are carried out by experienced clinicians of the EIP service trained in the administration of structured diagnostic assessments.

The case criteria for the service include those experiencing a psychotic illness of any aetiology, including substance-induced psychosis and affective illnesses with secondary psychotic features. There is no exclusion criterion relating to antipsychotic administration. Individuals experiencing psychotic symptoms for more than 2 years do not meet case criteria, but in this study they have been allocated to a separate cohort ‘psychosis, not first episode’ and are not included in the definition of ‘not meeting criteria’. The case criteria have not altered since service inception.

Data collection

A registry of referrals has been maintained since the service was established. An electronic report is compiled at each assessment, including the outcome of the SCID assessment, and demographic and functional details. The registry was searched for all referrals from the beginning of the service in 2005 to the end of 2021, a 16-year timespan. The diagnostic outcome and relevant details of those who completed an assessment were compiled.

Socio-occupational functional markers included relationship status, living status and current working status. These attributes were collected in a standardised report template, and grouped into categories for the study. Current working status, incorporating either engagement in paid employment or education, was recorded as working or in education, short-term unemployment (≤12 months), long-term unemployment (>12 months) or unable to work (retired, disabled or legally unable to work).

Membership of each cohort was defined by status at initial assessment. Re-referrals to the service were identified and assessments compiled to determine diagnostic change. Assessment of conversion to psychosis was determined only by repeat assessment in DETECT, which depended on an individual being re-referred to the service. Clinical files outside of the EIP service were not examined to determine if conversion to psychosis may have occurred in the absence of a re-referral to the service.

Study outcomes

The first aim of this study is a descriptive analysis of risk factors, in diagnostic, demographic and functional domains, among individuals referred to, but not meeting criteria for, an EIP service. The second aim is a comparative analysis of demographic and socio-occupational variables with a cohort meeting criteria for an FEP during the same interval.

Data analysis

Assessment outcomes were grouped by cohort and presented as counts and proportions. Variations in the proportion of each cohort over the study period are present as annual totals and trends. Diagnostic outcomes for the ‘not meeting criteria’ group are presented as totals for each DSM diagnosis and also grouped by category.

Cohorts were compared with t-tests for continuous variables, chi-squared tests for binary independent variables and binary logistic regression for multicategory independent variables, and reported as odds ratios. The comparative analysis of functional variables was adjusted for demographic factors (gender, age and nationality) in a binary logistic regression, and reported as adjusted odds ratios. Data were analysed with SPSS software version 28 for Windows.

Ethical statement and approval

The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008. This study employed a retrospective file review methodology, and as such individual written consent from participants was not required, consistent with the Irish Data Protection Act 2018 (Section 36(2)) (Health Research) (Amendment) Regulations 2021. All procedures involving human patients, including compliance with the conditions of the 2021 Regulations, were reviewed by the St. John of God Hospitaller Research Ethics Committee and approved under ID797.

Results

Outcome of all service referrals and trends

From the commencement of the service in 2005 to the end of the study period at the end of 2021, there were 2597 referrals received (Fig. 1). Of those, 10.0% (n = 262) did not engage with or complete the assessment. A further 7.2% (n = 189) were re-referrals, which included both index cases and non-cases. A small number of referrals did not proceed to assessment, either because the patient was not within the EIP service catchment area (n = 12) or the referral was subsequently withdrawn (n = 3). There were four individuals under 18 years of age. A small proportion of individuals (1.3%, n = 35) were recorded only by their initials in the registry, with no other identifying information, so their initial assessments could not be located. Finally, for 2.5% (n = 67) of referrals with complete details, a corresponding initial assessment could not be located. This yielded 2025 index referrals who completed a full assessment.

Fig. 1 Flow chart of total service referrals.

Of all index referrals over the study timeframe, 60.9% (n = 1233) met criteria for an FEP. A further 6.1% (n = 124) were experiencing a psychotic disorder, but not in their first episode, and 5.4% (n = 110) met ARMS criteria. This yielded approximately a quarter (27.6%, n = 558) of all referrals who did not meet criteria for either ARMS or FEP status, and had never experienced previous psychotic symptoms.

The proportion of those ‘not meeting criteria’ varied over the course of the study period, despite the absolute size of other cohorts remaining relatively constant (Fig. 2). This cohort trended to almost match FEPs as a proportion of the overall referral caseload in the first 4 years of operation of the service, thereafter declining steadily.

Fig. 2 Trend of annual referral count by cohort. ARMS, at-risk mental state; FEP, first-episode psychosis.

Diagnostic profile of those ‘not meeting criteria’

The majority (65.4%, n = 366) of individuals in the ‘not meeting criteria’ cohort did meet criteria for at least one DSM Axis I disorder (Table 1). The most common diagnostic groups as primary diagnoses were depressive disorders (22.8%, n = 127) followed by anxiety disorders (18.1%, n = 101). Substance use disorders were also common as primary diagnoses (14.7%, n = 82), with alcohol use disorder representing over half of this group (53.7%, n = 44). Finally, bipolar affective disorder accounted for 4.5% (n = 25) of the cohort, with type 1 bipolar disorder the predominant diagnosis (72.0%, n = 18). Substance-induced affective disorders were uncommon (2.9%, n = 25), and a small number of other disorders, including eating disorders, organic disorders and physiological effects of substance use, accounted for the remaining 2.5% (n = 14).

Table 1 Primary diagnoses and all diagnostic categories

Multimorbidity was prevalent, with 36.4% of those ‘not meeting criteria’ with any Axis I diagnosis having a secondary Axis I diagnosis (n = 133), and a further 10.4% also having a tertiary diagnosis (n = 38). The cumulative frequency of all Axis I diagnoses met as either primary, secondary or tertiary diagnosis are displayed in Table 1. Substance use disorders were common as a secondary or tertiary diagnosis, and approximately a quarter of the sample (22.5%, n = 164) met criteria for a substance use disorder when all diagnoses were considered. Apart from substance use disorders, anxiety and depressive disorders continued to be the predominant illness categories when all diagnoses were considered (anxiety disorders: 22.2%, n = 162; depressive disorders: 20.4%, n = 149).

Diagnostic change in the ‘non-case’ cohort

Of the ‘not meeting criteria’ cohort, 7.3% (n = 41) were referred for re-assessment on the basis that there was a new or evolving concern about their symptoms. At re-assessment, 44% (n = 18) met criteria for case status. Of the 19 individuals who continued to not meet criteria following re-assessment, four were re-referred for a third assessment. Three of these individuals were found to be experiencing a psychotic disorder. This resulted in 3.8% (n = 21) of the ‘not meeting criteria’ cohort who were known to develop psychosis and be referred to the service. The median time to first re-referral was 25 months (interquartile range (IQR): 33.5) and to second re-referral was 33 months (IQR: 50.25). Aggregated median duration from index to final reassessment was 27 months (IQR: 37).

Demographic and socio-occupational attributes of the ‘not meeting criteria’ cohort

The demographic characteristics of both cohorts are listed in Table 2. Compared with the FEP group, the ‘not meeting criteria’ cohort was younger (mean age 29.8 v. 33.9 years), with a greater proportion of males (65.1% v. 57.4%) and those of Irish nationality (89.7% v. 82.5%). They had a broadly similar proportion of individuals with a family history of psychosis compared with the FEP group (12.0% v. 13.2%). There was a difference in the proportion of cases referred between secondary mental health services, with Dublin South East referring fewer than Dublin South (Cluain Mhuire) (odds ratio 0.64, 95% CI 0.49–0.84), which was broadly in line with the remaining services. Individuals ‘not meeting criteria’ were less likely to be either voluntary in-patients (odds ratio 0.31, 95% CI 0.24–0.39) or involuntary in-patients (odds ratio 0.10, 95% CI 0.06–0.15).

Table 2 Case and non-case characteristics, univariate and multivariate analysis

FEP, first-episode psychosis; MHS, mental health service; SJOG, St. John of God; NFA, no fixed abode.

Social and occupational functioning was examined across three variables. The ‘not meeting criteria’ group were more likely not to be in a relationship, but not at a level of significance when adjusted for demographic factors (adjusted odds ratio 1.02, 95% CI 0.70–1.48). They had a similar distribution of living arrangements, with the majority of both cohorts continuing to live with their families of origin. A substantial proportion of both cohorts were not working at the time of assessment, with a significant finding of a higher proportion of long-term unemployment (≤12 months) in the ‘not meeting criteria’ cohort, which endured in the adjusted model (adjusted odds ratio 2.83, 95% CI 2.83–4.85).

Discussion

Main findings

This paper is one of the few to report on the cohort of individuals referred to an EIP service, but not meeting criteria for either an ARMS or FEP. Our results demonstrate that this group constitute a large proportion of the total referrals to an EIP service, substantially larger than those meeting ARMS criteria.

The ‘not meeting criteria’ cohort was highly enriched for non-psychotic Axis I disorders, with approximately 65% meeting criteria for a least one disorder, with mood, anxiety and substance use disorders predominating. This finding is consistent with a previous study in this service over a more limited timeframe.Reference O'Donoghue, Lyne, Renwick, Madigan, Kinsella and Clarke28 A further third (36.4%) had at least a secondary diagnosis. A population-based study exploring longitudinal risk demonstrated that prior psychopathology accounted for 85.5% of the outcome of developing clinical psychosis. Mood disorders have the highest population attributable fraction, which was the most common diagnostic group in our cohort. Although the relative risk for psychosis with an ARMS is high, because of its lower prevalence in the general population compared with more common mood, anxiety and substance use disorders, its population attributable fraction is far lower.Reference Guloksuz, Pries, Ten Have, de Graaf, van Dorsselaer and Klingenberg20 Non-psychotic pathology has also been reported as high in ARMS groups,Reference Albert, Tomassi, Maina and Tosato29,Reference Fusar-Poli, Nelson, Valmaggia, Yung and McGuire30 which may contribute substantially to the conversion risk in this group.Reference Hasmi, Pries, Ten Have, de Graaf, van Dorsselaer and Bak31 Our findings demonstrate that highly enriched Axis I morbidity and multimorbidity is a finding that is not specific to ARMS groups among EIP referrals.

The socio-occupational functioning of the ‘not meeting criteria’ cohort was examined across three variables. Although a greater proportion were not in a relationship, this association dissipated when controlled for demographic factors, likely reflecting their younger age. They were broadly similar to the FEP cohort across other metrics, with the exception of a greater proportion in long-term unemployment (adjusted odds ratio 2.83, 95% CI 1.65–4.85). The broad similarity to an FEP cohort, a group with established socio-occupational impairments,Reference Green, Kern, Braff and Mintz32 is a reflection of the functional morbidity in this group. Impaired social and role functioning have predictive capacity for psychosis, both within ARMSReference Cornblatt, Carrión, Addington, Seidman, Walker and Cannon33 and general populationReference Cannon, Caspi, Moffitt, Harrington, Taylor and Murray23 samples. The significance of functional impairment as a risk marker is not only its capacity to define at-risk individuals, but also its presence as the earliest herald symptoms in the pre-illness phase of individuals with psychosis.Reference Cannon, Jones, Huttunen, Tanskanen, Huttunen and Rabe-Hesketh34 Risk stratification at this point offers the potential for intervention at the earliest possible stage.

Despite the fact that our FEP cohort had a majority of males, our ‘not meeting criteria’ cohort had a greater proportion again (odds ratio 1.12, 95% CI 1.03–1.71). Although classically, schizophrenia-like psychosis was thought to have a higher incidence in men, this relationship moderates when incidence is considered over the lifespan and psychotic syndromes considered are broadened. However, an age×gender interaction has been demonstrated, reflecting that before 45 years of age, overall risk rates are elevated among men.Reference Kirkbride, Errazuriz, Croudace, Morgan, Jackson and Boydell35 This renders our finding of the ‘not meeting criteria’ group as predominately both male and younger as significant. Clinical and functional outcomes in psychosis are also worse in men.Reference Barajas, Ochoa, Obiols and Lalucat-Jo36

Ethnicity is a well-established risk factor for psychosis, with differential risk between groups.Reference Kirkbride, Errazuriz, Croudace, Morgan, Jackson and Boydell35 Our catchment area has previously been reported as having a marginally higher than average migrant population,Reference O'Donoghue, Lyne, Renwick, Lane, Madigan and Staines37 in line with that reported for this FEP cohort. When all ‘non-Irish’ nationalities were collapsed into a single category, the ‘not meeting criteria’ group had a lower proportion of non-Irish nationalities (odds ratio 0.85, 95% CI 0.77–0.91), indicating that this variable is unlikely to be a source of elevated risk. A family history of a psychotic disorder is a further well-established risk factor.Reference Chou, Kuo, Huang, Grainge, Valdes and See38 There was a similar proportion of both cohorts with a first- or second-degree relative with a psychotic disorder, indicating that this risk factor is equivalent between cohorts.

Finally, our study found that of those initially not meeting criteria, 41 were re-referred to the service, with 21 subsequently meeting criteria for psychosis (3.8% of all those ‘not meeting criteria’). This figure should be interpreted with caution and it is not synonymous with a conversion to psychosis rate in the sample. It is likely to be an underestimate of the true conversion rate of this cohort. Reasons for non-detection by our service of individuals who developed psychosis subsequent to assessment include being lost to care (e.g. disengaging with services or moving out of the catchment area) or treating secondary care teams not re-referring to the service (e.g. if an individual was re-referred by primary care, but the secondary care team deemed them to no longer be in their FEP). The variable duration from assessment to the end of the study period may also have been an inadequate interval for recently enrolled individuals to develop psychosis. One of the few studies to report on conversion to psychosis rates among an entire cohort of EIP service presenters found that over a median follow-up period of 7.3 years, the conversion to psychosis rate was comparable between ARMS (17.3%) and non-psychotic help-seekers (14.6%). Non-psychotic help-seekers with a previous admission had a higher rates of psychosis post-assessment than the ARMS group.Reference Conrad, Lewin, Sly, Schall, Halpin and Hunter39 The reported service differed from ours in several important ways, accepting referrals for adolescents aged 12–25 years and employing a pre-screening interview. To establish a definitive figure for psychosis risk in our cohort, a retrospective cohort study with longitudinal follow-up should be undertaken.

Our age criteria of 18–65 years mirrors the configuration of secondary mental health services in Ireland, and is aligned with adult service age criteria. This differs from some EIP services that focus on an adolescent and young adult population, often in the 14- to 35-year age range. In the context of the lower prevalence of psychotic disorders in the <18 year age group, the issues we raise previously, of both the limited predictive ability and capacity of current ARMS models, have been highlighted as particularly relevant in this group.Reference Lång, Yates, Leacy, Clarke, McNicholas and Cannon40 As we anticipate that those ‘not meeting criteria’ would constitute a larger proportion of referrals within adolescent EIP service referrals, it would be instructive to repeat our study methodology in such a service.

EIP services have several functions distinct from identifying psychosis risk, including delivering phase-specific, specialist interventions for at-threshold psychotic disorders. In this regard, the high volume of individuals identified by clinical teams as experiencing an FEP and appropriately referred for EIP interventions, remains an important and essential contribution of the service.

In a similar vein, where risk prediction is implemented, it should be for the purpose of delivering evidence-based, risk-modifying interventions. The development of risk prediction models is driven by broad acknowledgement that psychosis has developmental and symptomatic antecedents,Reference Insel41 and that intervening early may engender the best clinical outcomes. Such enquires are catalysed by outcomes for psychotic disorders, which have largely plateaued in recent decades.Reference Clarke, McDonough, Doyle and Waddington42 There is emerging evidence that screening in children and adolescents, when based on a combination of symptomatic and functional markers (distinct from either in isolation), has acceptable predictive power for later psychopathology, and that there are some promising risk-modifying interventions within this interval.Reference Healy and Cannon43 In the adult population, the evidence is less clear. Currently there are no definitive data supporting any risk-modifying intervention in adults,Reference Fusar-Poli, Davies, Solmi, Brondino, De Micheli and Kotlicka-Antczak44 nor do antipsychotics appear to have a role in modifying transition rates in ARMS samples.Reference Zhang, Xu, Tang, Wei, Hu and Hu45 Such studies may be challenged by the same issues discussed previously of high heterogenicity within high-risk samples, uncontrolled risk enrichment and uncertain representativeness of current ARMS cohorts for incident FEP cases.

At such a juncture, clinical concerns about prediction beget ethical ones. Models that induct individuals into a surveillance pathway, where a majority (as currently) will be ‘false positives’, raise important issues about stigmatisation and iatrogenic harm.Reference Ajnakina, David and Murray5 Risk prediction models are currently not accurate enough for clinical use, and the risk of adverse effects for those who screen false positive should not be underestimated. These questions are not peripheral to, but inextricably linked with, the performance of such models, as there are careful balances to be made between potential benefit and harm. Continuing research efforts need to address each aspect of risk prediction not in isolation, but in tandem, including discriminative ability, calibration and, ultimately, clinical utility.Reference Seyedsalehi and Lennox12

Study strengths

This study includes complete referral data from a long-established EIP service, embedded in a public mental health service that provides universal access to the catchment area population. This allowed the examination of case trends over a broad timeframe, resulting in a large sample size.

Our service provides a standardised diagnostic assessment, using a recognised instrument (SCID), to all individuals referred. This allows for the reporting of those meeting standardised criteria for many psychotic and non-psychotic disorders. Standardised assessment templates with data on functional domains facilitated a transdiagnostic comparison between cohorts.

Finally, since the inception of the service, an electronic archive of assessment documents has been maintained, resulting in a high data retrieval rate.

Study limitations

As EIP services vary in case criteria and service configuration, caution should be exercised in generalising findings across health service models. Our service functions as a tertiary referral service and does not accept direct referrals from primary care or self-referrals. In services where this is the case, it might be expected to increase the proportion of those ‘not meeting criteria’, with a likely dilutional effect on risk factor enrichment.

Although our study provided a comprehensive description of DSM Axis I disorders, we do not assess for other conditions with standardised assessment instruments, including Axis II disorders (including personality disorders) or neurodevelopmental disorders (including attention-deficit hyperactivity disorder or autism spectrum disorder). It is possible that some of the individuals who did not meet criteria for an Axis I disorder would meet criteria for one of these disorders, and for those who did meet criteria for a disorder, it may further describe their comorbidities.

Finally, as above, an accurate figure for conversion to psychosis should be established for this group, with longitudinal follow-up. Although a portion of those developing psychosis will have been re-referred, several factors affecting service engagement limit the utility of this figure.

Implications and future research

In conclusion, to our knowledge, this is largest study to report on demographic, diagnostic and functional variables of individuals referred to, but not meeting criteria for, an EIP service. We demonstrated that this cohort is enriched for many risk factors for psychosis. Enhanced models of psychosis risk derived from current ARMS criteria may succeed in enhancing predictive capacity within selected groups, but will not address the ‘prevention paradox’ of only a limited portion of individuals entering psychosis via this route. This study is a response to calls to reconsider the current ARMS model as a starting point for defining at-risk groups, to build models that will be useful at the population level. Those referred to EIP service, but who do not meet current criteria, may be an important group for further study in this expanded search.

Data availability

The data that support the findings of this study are available from the corresponding author, S.N., upon reasonable request.

Acknowledgements

The authors would like to thank Felicity Fanning for her assistance in accessing the registry of referrals and file archives.

Author contributions

S.N. and M.C. contributed to study conception and design. S.N. and A.B. processed the data and implemented the analysis. S.N., A.B., E.G., E.C. and M.C. contributed to the interpretation of results. S.N. drafted the manuscript. S.N., A.B., E.G., E.C. and M.C. provided critical feedback. S.N., A.B., E.G., E.C. and M.C. reviewed, revised and approved the article.

Funding

This research received no specific grant from any funding agency, commercial or non-for-profit sector.

Declaration of interest

None.

References

McGorry, PD. Early intervention in psychosis: obvious, effective, overdue. J Nerv Ment Dis 2015; 203(5): 310–8.CrossRefGoogle ScholarPubMed
Yung, AR, McGorry, PD, McFarlane, CA, Jackson, HJ, Patton, GC, Rakkar, A. Monitoring and care of young people at incipient risk of psychosis. Schizophr Bull 1996; 22(2): 283303.CrossRefGoogle ScholarPubMed
Fusar-Poli, P, Cappucciati, M, Rutigliano, G, Schultze-Lutter, F, Bonoldi, I, Borgwardt, S, et al. At risk or not at risk? A meta-analysis of the prognostic accuracy of psychometric interviews for psychosis prediction. World Psychiatry 2015; 14(3): 322–32.CrossRefGoogle ScholarPubMed
Moritz, S, Gawęda, Ł, Heinz, A, Gallinat, J. Four reasons why early detection centers for psychosis should be renamed and their treatment targets reconsidered: we should not catastrophize a future we can neither reliably predict nor change. Psychol Med 2019; 49(13): 2134–40.CrossRefGoogle Scholar
Ajnakina, O, David, AS, Murray, RM. ‘At risk mental state’ clinics for psychosis – an idea whose time has come – and gone!' Psychol Med 2019; 49(4): 529–34.CrossRefGoogle ScholarPubMed
Cotter, D, Healy, C, Staines, L, Mongan, D, Cannon, M. Broadening the parameters of clinical high risk for psychosis. Am J Psychiatry 2022; 179(9): 593–5.CrossRefGoogle ScholarPubMed
Hippisley-Cox, J, Coupland, C, Brindle, P. Development and validation of QRISK3 risk prediction algorithms to estimate future risk of cardiovascular disease: prospective cohort study. BMJ 2017; 357: j2099.CrossRefGoogle ScholarPubMed
Coutts, F, Koutsouleris, N, McGuire, P. Psychotic disorders as a framework for precision psychiatry. Nat Rev Neurol 2023; 19(4): 221–34.Google ScholarPubMed
Burke, T, Thompson, A, Mifsud, N, Yung, AR, Nelson, B, McGorry, P, et al. Proportion and characteristics of young people in a first-episode psychosis clinic who first attended an at-risk mental state service or other specialist youth mental health service. Schizophr Res 2022; 241: 94101.CrossRefGoogle ScholarPubMed
Ajnakina, O, Morgan, C, Gayer-Anderson, C, Oduola, S, Bourque, F, Bramley, S, et al. Only a small proportion of patients with first episode psychosis come via prodromal services: a retrospective survey of a large UK mental health programme. BMC Psychiatry 2017; 17(1): 308.CrossRefGoogle Scholar
Sullivan, SA, Kounali, D, Cannon, M, David, AS, Fletcher, PC, Holmans, P, et al. A population-based cohort study examining the incidence and impact of psychotic experiences from childhood to adulthood, and prediction of psychotic disorder. Am J Psychiatry 2020; 177(4): 308–17.CrossRefGoogle ScholarPubMed
Seyedsalehi, A, Lennox, B. Predictive tools in psychosis: what is ‘good enough’? Nat Rev Neurol 2023; 19(4): 191–2.Google ScholarPubMed
Van Os, J, Delespaul, P. Toward a world consensus on prevention of schizophrenia. Dialogues Clin Neurosci 2005; 7(1): 5367.CrossRefGoogle Scholar
Lång, U, Ramsay, H, Yates, K, Veijola, J, Gyllenberg, D, Clarke, MC, et al. Potential for prediction of psychosis and bipolar disorder in child and adolescent mental health services: a longitudinal register study of all people born in Finland in 1987. World Psychiatry 2022; 21(3): 436–43.CrossRefGoogle ScholarPubMed
Bolhuis, K, Lång, U, Gyllenberg, D, Kääriälä, A, Veijola, J, Gissler, M, et al. Hospital presentation for self-harm in youth as a risk marker for later psychotic and bipolar disorders: a cohort study of 59 476 Finns. Schizophr Bull 2021; 47(6): 1685–94.CrossRefGoogle ScholarPubMed
Fusar-Poli, P, Rutigliano, G, Stahl, D, Schmidt, A, Ramella-Cravaro, V, Hitesh, S, et al. Deconstructing pretest risk enrichment to optimize prediction of psychosis in individuals at clinical high risk. JAMA Psychiatry 2016; 73(12): 1260–7.CrossRefGoogle ScholarPubMed
Fusar-Poli, P, Schultze-Lutter, F. Predicting the onset of psychosis in patients at clinical high risk: practical guide to probabilistic prognostic reasoning. Evid Based Ment Health 2016; 19(1): 10–5.CrossRefGoogle ScholarPubMed
Yung, AR, McGorry, PD. The initial prodrome in psychosis: descriptive and qualitative aspects. Austr N Z J Psychiatry 1996; 30(5): 587–99.CrossRefGoogle ScholarPubMed
Häfner, H. Risk and Protective Factors in Schizophrenia. Steinkopff-Verlag, 2002.CrossRefGoogle Scholar
Guloksuz, S, Pries, LK, Ten Have, M, de Graaf, R, van Dorsselaer, S, Klingenberg, B, et al. Association of preceding psychosis risk states and non-psychotic mental disorders with incidence of clinical psychosis in the general population: a prospective study in the NEMESIS-2 cohort. World Psychiatry 2020; 19(2): 199205.CrossRefGoogle ScholarPubMed
Häfner, H, Nowotny, B. Löffler, W, an der Heiden, W, Maurer, K. When and how does schizophrenia produce social deficits? Eur Arch Psychiatry Clin Neurosci 1995; 246(1): 1728.CrossRefGoogle ScholarPubMed
Larsen, TK, McGlashan, TH, Johannessen, JO, Vibe-Hansen, L. First-episode schizophrenia: II. Premorbid patterns by gender. Schizophr Bull 1996; 22(2): 257–69.CrossRefGoogle ScholarPubMed
Cannon, M, Caspi, A, Moffitt, TE, Harrington, H, Taylor, A, Murray, RM, et al. Evidence for early-childhood, pan-developmental impairment specific to schizophreniform disorder: results from a longitudinal birth cohort. Arch Gen Psychiatry 2002; 59(5): 449–56.CrossRefGoogle ScholarPubMed
Kelleher, I. Psychosis prediction 2.0: why child and adolescent mental health services should be a key focus for schizophrenia and bipolar disorder prevention research. Br J Psychiatry 2023; 222(5): 185–7.CrossRefGoogle ScholarPubMed
O'Donoghue, B, O'Connor, K, Thompson, A, McGorry, P. The need for early intervention for psychosis to persist throughout the COVID-19 pandemic and beyond. Irish J Psychol Med 2021; 38(3): 214–9.CrossRefGoogle ScholarPubMed
Jordan, G, Kinkaid, M, Iyer, SN, Joober, R, Goldberg, K, Malla, A, et al. Baby or bathwater? Referrals of ‘non-cases’ in a targeted early identification intervention for psychosis. Soc Psychiatry Psychiatr Epidemiol 2018; 53(7): 757–61.CrossRefGoogle ScholarPubMed
Lindhardt, L, Lindhardt, M, Haahr, UH, Hastrup, LH, Simonsen, E, Nordgaard, J. Help-seekers in an early detection of psychosis service: the non-cases. Front Psychiatry 2021; 12: 778785.CrossRefGoogle Scholar
O'Donoghue, B, Lyne, J, Renwick, L, Madigan, K, Kinsella, A, Clarke, M, et al. A descriptive study of ‘non-cases’ and referral rates to an early intervention for psychosis service. Early Interv Psychiatry 2012; 6(3): 276–82.CrossRefGoogle Scholar
Albert, U, Tomassi, S, Maina, G, Tosato, S. Prevalence of non-psychotic disorders in ultra-high risk individuals and transition to psychosis: a systematic review. Psychiatry Res 2018; 270: 112.CrossRefGoogle ScholarPubMed
Fusar-Poli, P, Nelson, B, Valmaggia, L, Yung, AR, McGuire, PK. Comorbid depressive and anxiety disorders in 509 individuals with an at-risk mental state: impact on psychopathology and transition to psychosis. Schizophr Bull 2014; 40(1): 120–31.CrossRefGoogle ScholarPubMed
Hasmi, L, Pries, LK, Ten Have, M, de Graaf, R, van Dorsselaer, S, Bak, M, et al. What makes the psychosis ‘clinical high risk’ state risky: psychosis itself or the co-presence of a non-psychotic disorder? Epidemiol Psychiatr Sci 2021; 30: e53.CrossRefGoogle ScholarPubMed
Green, MF, Kern, RS, Braff, DL, Mintz, J. Neurocognitive deficits and functional outcome in schizophrenia: are we measuring the ‘right stuff’? Schizophr Bull 2000; 26(1): 119–36.CrossRefGoogle ScholarPubMed
Cornblatt, BA, Carrión, RE, Addington, J, Seidman, L, Walker, EF, Cannon, TD, et al. Risk factors for psychosis: impaired social and role functioning. Schizophr Bull 2012; 38(6): 1247–57.CrossRefGoogle ScholarPubMed
Cannon, M, Jones, P, Huttunen, MO, Tanskanen, A, Huttunen, T, Rabe-Hesketh, S, et al. School performance in Finnish children and later development of schizophrenia: a population-based longitudinal study. Arch Gen Psychiatry 1999; 56(5): 457–63.CrossRefGoogle ScholarPubMed
Kirkbride, JB, Errazuriz, A, Croudace, TJ, Morgan, C, Jackson, D, Boydell, J, et al. Incidence of schizophrenia and other psychoses in England, 1950–2009: a systematic review and meta-analyses. PLoS One 2012; 7(3): e31660.CrossRefGoogle ScholarPubMed
Barajas, A, Ochoa, S, Obiols, JE, Lalucat-Jo, L. Gender differences in individuals at high-risk of psychosis: a comprehensive literature review. Sci World J 2015; 2015: 430735.CrossRefGoogle ScholarPubMed
O'Donoghue, B, Lyne, JP, Renwick, L, Lane, A, Madigan, K, Staines, A, et al. Neighbourhood characteristics and the incidence of first-episode psychosis and duration of untreated psychosis. Psychol Med 2016; 46(7): 1367–78.CrossRefGoogle ScholarPubMed
Chou, IJ, Kuo, CF, Huang, YS, Grainge, MJ, Valdes, AM, See, LC, et al. Familial aggregation and heritability of schizophrenia and co-aggregation of psychiatric illnesses in affected families. Schizophr Bull 2017; 43(5): 1070–8.CrossRefGoogle ScholarPubMed
Conrad, AM, Lewin, TJ, Sly, KA, Schall, U, Halpin, SA, Hunter, M, et al. Utility of risk-status for predicting psychosis and related outcomes: evaluation of a 10-year cohort of presenters to a specialised early psychosis community mental health service. Psychiatry Res 2017; 247: 336–44.CrossRefGoogle ScholarPubMed
Lång, U, Yates, K, Leacy, FP, Clarke, MC, McNicholas, F, Cannon, M, et al. Systematic review and meta-analysis: psychosis risk in children and adolescents with an at-risk mental state. J Am Acad Child Adolesc Psychiatry 2022; 61(5): 615–25.CrossRefGoogle ScholarPubMed
Insel, TR. Rethinking schizophrenia. Nature 2010; 468(7321): 187–93.CrossRefGoogle ScholarPubMed
Clarke, M, McDonough, CM, Doyle, R, Waddington, JL. Are we really impacting duration of untreated psychosis and does It matter?: longitudinal perspectives on early intervention from the Irish public health services. Psychiatr Clin North Am 2016; 39(2): 175–86.CrossRefGoogle ScholarPubMed
Healy, C, Cannon, M. We need to talk about prevention. Ame J Psychiatry 2020; 177(4): 285–7.CrossRefGoogle ScholarPubMed
Fusar-Poli, P, Davies, C, Solmi, M, Brondino, N, De Micheli, A, Kotlicka-Antczak, M, et al. Preventive treatments for psychosis: umbrella review (just the evidence). Front Psychiatry 2019; 10: 764.CrossRefGoogle ScholarPubMed
Zhang, T, Xu, L, Tang, X, Wei, Y, Hu, Q, Hu, Y, et al. Real-world effectiveness of antipsychotic treatment in psychosis prevention in a 3-year cohort of 517 individuals at clinical high risk from the SHARP (Shanghai at risk for psychosis). Aust N Z J Psychiatry 2020; 54(7): 696706.CrossRefGoogle Scholar
Figure 0

Fig. 1 Flow chart of total service referrals.

Figure 1

Fig. 2 Trend of annual referral count by cohort. ARMS, at-risk mental state; FEP, first-episode psychosis.

Figure 2

Table 1 Primary diagnoses and all diagnostic categories

Figure 3

Table 2 Case and non-case characteristics, univariate and multivariate analysis

Submit a response

eLetters

No eLetters have been published for this article.