Introduction
The coronavirus disease 2019 (COVID-19) pandemic has resulted in a globally experienced set of interrelated stressful life events. These stressors are likely to take a toll on mental health in both the general population and those infected with severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) (Holmes et al., Reference Holmes, O'Connor, Perry, Tracey, Wessely, Arseneault and Bullmore2020). Stressful life events are known to heighten the risk for onset or worsening of depression, anxiety and stress-related conditions [i.e. acute/post-traumatic stress disorders (PTSD) (Daviu, Bruchas, Moghaddam, Sandi, & Beyeler, Reference Daviu, Bruchas, Moghaddam, Sandi and Beyeler2019; Hammen, Reference Hammen2005; Kilpatrick et al., Reference Kilpatrick, Resnick, Milanak, Miller, Keyes and Friedman2013)]. At the same time, measures put in place to mitigate the spread of the virus diminish access to sources of support, such as social contact and routine health care (Danese & Smith, Reference Danese and Smith2020; Pierce et al., Reference Pierce, Hope, Ford, Hatch, Hotopf, John and Abel2020a), likely further contributing to the mental health burden. Establishing which groups are most adversely affected by the COVID-19 pandemic is a key research priority (Holmes et al., Reference Holmes, O'Connor, Perry, Tracey, Wessely, Arseneault and Bullmore2020).
Reports from longitudinal studies including pre-pandemic measures of mental health vary considerably. A UK-representative general population sample of ~53 000 adults (Pierce et al., Reference Pierce, Hope, Ford, Hatch, Hotopf, John and Abel2020a) found elevated levels of mental distress in April 2020, compared to trends observed in 2018–2019 (12-item General Health Questionnaire). A UK birth cohort of young adults (Avon Longitudinal Study of Parents and Children; mean age 27 years, N = 2973) found increased anxiety, but not depression in April/May 2020, compared to 2018 (Kwong et al., Reference Kwong, Pearson, Adams, Northstone, Tilling, Smith and Timpson2020). A case-control sample in the Netherlands (N = 1517) of individuals with depression, anxiety or obsessive-compulsive disorder (OCD) found increased depression but not anxiety symptoms in April/May 2020, compared to assessments conducted between 2006 and 2016 (Pan et al., Reference Pan, Kok, Eikelenboom, Horsfall, Jörg, Luteijn and Penninx2020). At the same time, other studies have found no observable changes in mental wellbeing, including a Dutch general population sample measuring change in anxiety and depression symptoms from November 2019 to March 2020 [N = 3983 (van der Velden, Contino, Das, van Loon, & Bosmans, Reference van der Velden, Contino, Das, van Loon and Bosmans2020)] and a US nationally representative sample examining change in psychological distress from February 2019 to May 2020 [N = 1870 (Breslau et al., Reference Breslau, Finucane, Locker, Baird, Roth and Collins2021)].
In terms of individual-level risk factors, longitudinal studies have demonstrated heightened vulnerability to worsening mental health during the pandemic among young people (Pierce et al., Reference Pierce, Hope, Ford, Hatch, Hotopf, John and Abel2020a), females (Kwong et al., Reference Kwong, Pearson, Adams, Northstone, Tilling, Smith and Timpson2020; Pierce et al., Reference Pierce, Hope, Ford, Hatch, Hotopf, John and Abel2020a) and individuals living in socio-economic adversity (Kwong et al., Reference Kwong, Pearson, Adams, Northstone, Tilling, Smith and Timpson2020). Several smaller studies (n < 500) have demonstrated worsening symptoms in groups of young people observed in the USA, Italy, India, Switzerland and China (Elmer, Mepham, & Stadtfeld, Reference Elmer, Mepham and Stadtfeld2020; Hawes, Szenczy, Klein, Hajcak, & Nelson, Reference Hawes, Szenczy, Klein, Hajcak and Nelson2021; Li, Cao, Leung, & Mak, Reference Li, Cao, Leung and Mak2020; Meda et al., Reference Meda, Pardini, Slongo, Bodini, Zordan, Rigobello and Novara2021; Saraswathi et al., Reference Saraswathi, Saikarthik, Senthil Kumar, Madhan Srinivasan, Ardhanaari and Gunapriya2020). One study on older adults in the UK aged 55 years or over (n = 3281) showed an increase in reporting of mild depression and anxiety symptoms, but no change in the frequency of reporting of moderate symptoms (Creese et al., Reference Creese, Khan, Henley, O'Dwyer, Corbett, Vasconcelos Da Silva and Ballard2020). Looking at longer-term changes in mental health (April–October 2020) in a population representative sample of UK adults, worsening trajectories of mental health were more frequent among individuals from minority ethnic groups, those living in deprived neighbourhoods, those infected with SARS-CoV-2, or those experiencing financial difficulties (Pierce et al., Reference Pierce, McManus, Hope, Hotopf, Ford, Hatch and Abel2021).
Prior mental health diagnoses may be an additional risk factor for worsening mental health during the pandemic. One birth cohort sample demonstrated that a history of major depressive disorder (MDD), generalised anxiety disorder (GAD) or eating disorders were associated with worsening depression and anxiety symptoms during the pandemic (Kwong et al., Reference Kwong, Pearson, Adams, Northstone, Tilling, Smith and Timpson2020). Trajectories of worsening mental health were shown to be more frequent among individuals with prior mental or physical health diagnoses (Pierce et al., Reference Pierce, McManus, Hope, Hotopf, Ford, Hatch and Abel2021). However, a case-control study of individuals with anxiety, depression or OCD showed a different pattern of effects. Greater increases in prospectively assessed mental health symptoms were observed among individuals without pre-existing mental health diagnoses, compared to those with (Pan et al., Reference Pan, Kok, Eikelenboom, Horsfall, Jörg, Luteijn and Penninx2020). Furthermore, in those with the most chronic and severe mental health diagnoses, slight decreases in symptom severity were observed (Pan et al., Reference Pan, Kok, Eikelenboom, Horsfall, Jörg, Luteijn and Penninx2020). In contrast, this study also showed that individuals with prior mental health diagnoses reported a greater perceived impact of the pandemic on their mental wellbeing, compared to those without (Pan et al., Reference Pan, Kok, Eikelenboom, Horsfall, Jörg, Luteijn and Penninx2020).
Perceived changes in mental health in the absence of prospectively measured symptom change may be related to memory biases widely observed in depression and anxiety (Mathews & MacLeod, Reference Mathews and MacLeod2005). Longitudinal epidemiological studies comparing prospective and retrospective diagnostic reporting suggest that approximately half of individuals reporting depressive or anxiety disorder diagnoses prospectively no longer report these diagnoses when asked to recall them at a later date (Moffitt et al., Reference Moffitt, Caspi, Taylor, Kokaua, Milne, Polanczyk and Poulton2010). In addition, 12-month recall accuracy of depression symptoms during a clinical trial ranged from 55% to 95%, depending on the symptom (Dunlop et al., Reference Dunlop, Granros, Lechner, Mletzko-Crowe, Nemeroff, Mayberg and Craighead2019). It is therefore plausible that poor recall of prior symptoms contributes to the perception of worsening mental health, even if prospective measures of symptoms show no change.
Conversely, higher levels of depression symptoms have been shown to be associated with recall of more frequent/stronger past negative mood on the PANAS-X (Wenze, Gunthert, & German, Reference Wenze, Gunthert and German2012) and higher current depression or anxiety symptoms were associated with overestimation of past symptom severity (Safer & Keuler, Reference Safer and Keuler2002). Further examination of the relationship between perceived changes in distress, retrospective estimates and prospective measurements of symptom severity, are critical to understanding vulnerabilities to worsening mental health during a pandemic.
The first aim of the current study was to examine changes in depression, anxiety and PTSD symptoms from before (September 2018–February 2020) to during (April–May 2020) the COVID-19 pandemic. To examine discrepancies across measurement approaches we investigated symptom change in three ways: (1) prospectively measured symptom change; (2) retrospectively estimated symptom change and (3) perceived changes in symptoms. Our second aim was to examine whether pre-existing mental health diagnoses and demographic factors (gender, age, ethnicity, employment status) were associated with greater change in symptoms of MDD, GAD and PTSD from before to during the pandemic.
Methods
Data were examined from two longitudinal online studies: (1) the COVID-19 Psychiatry and Neurological Genetics study (COPING) and (2) the Repeated Assessment of Mental Health in Pandemics (RAMP; https://rampstudy.co.uk) study. COPING and RAMP administered identical questionnaires aiming to investigate symptoms of mental health conditions, neurological and respiratory health longitudinally throughout the COVID-19 pandemic (see https://osf.io/7p2ek/ for full details of questionnaires administered).
In analyses presented below, the COPING study is divided into two cohorts, ‘GLAD’ and ‘NBR’ and are compared alongside the RAMP cohort. The COPING study division was based on whether participants were existing members of the Genetic Links to Anxiety and Depression study, who had completed prospective pre-pandemic mental health assessments (GLAD cohort), or whether they were members of other NIHR BioResource studies (NBR cohort; see below). All samples were combined for regression analyses to maximise power to explore differential risk across smaller demographic groups (particularly ethnic minority groups and groups of individuals with rarer psychiatric diagnoses).
Participants
Recruitment for COPING and RAMP was conducted on a rolling basis, beginning in April 2020. COPING participants were recruited from existing re-contactable cohorts hosted by the NIHR BioResource, the vast majority of whom (>95%) were contacted in May 2020. Participants were free to sign-up to the study at any point after receiving a study invitation, with the majority of RAMP participants completing baseline assessments in April–May 2020, and the majority of GLAD and NBR participants completing baseline assessments in May 2020.
GLAD and EDGI participants were originally recruited via social and traditional media campaigns, as well as through NHS organisations (Davies et al., Reference Davies, Kalsi, Armour, Jones, McIntosh, Smith and Breen2019). IBD and general population cohorts were recruited via advertisements in blood donation centres and UK hospitals (NIHR BioResource, 2021). RAMP study participants (n = 8651) were recruited via social media advertising. Groups were combined for analyses (as described in the ‘Statistical analyses’ section), to maximise statistical power to detect effects related to individual difference characteristics.
Eligibility criteria for both studies were aged 16+ years and resident in the UK. GLAD eligibility criteria required either self-report of a previous depressive or anxiety disorder diagnosis, or meeting current DSM-5 criteria for depression or anxiety (Davies et al., Reference Davies, Kalsi, Armour, Jones, McIntosh, Smith and Breen2019). Ethical approval was granted by: (i) NHS Health Research Authority, South West – Central Bristol Research Ethics Committee (20/SW/0078; COPING), and (ii) Psychiatry, Nursing and Midwifery Research Ethics Committee at King's College London (HR-19/20-18157; RAMP). Information sheets, consent forms and questionnaires were reviewed by the Feasibility and Acceptability Support Team for Researchers and the Service User Advisory Group.
Measures
All questionnaire data were acquired using Qualtrics survey software (Qualtrics, Provo, UT). Participants provided consent via an online form prior to completing surveys. Demographic factors assessed were: gender, age, ethnicity and employment status (see Table 1). Lifetime mental health diagnoses were assessed using a checklist of psychiatric diagnoses (see online Supplementary materials Table S1). Diagnostic history for GLAD/EDGI participants was assessed upon sign-up to the GLAD/EDGI cohorts. For all other participants, this measure was completed at COPING or RAMP baseline assessments.
Table 1. Demographic details of participants across cohorts
Percentages denote the proportion of individuals within a given category for each cohort (GLAD, NBR or RAMP) or in the combined sample (overall).
Note: GLAD and NBR combined form the COPING study.
a Pre-pandemic mental health data available.
b NBR is comprised of three sub-cohorts: the Eating Disorders Genetic Initiative (EDGI; n = 65); (ii) the Irritable Bowel Disease cohort (IBD; n = 3313) and (iii) general population cohorts (n = 9718).
c Note that in individual cohort analyses, these factors do not meet a priori power calculation criteria.
d Where available.
Depression symptoms were measured using the Patient Health Questionnaire – 9 items (PHQ-9). Each item is a diagnostic symptom of MDD and is rated on a 0 (not at all) to 3 (nearly every day) scale (score range 0–27). The PHQ-9 has a test–retest reliability of 0.84, a cut-off score of ⩾10 has 88% sensitivity and 88% specificity for major depression (Kroenke, Spitzer, & Williams, Reference Kroenke, Spitzer and Williams2001), and reliable change is estimated as 7 points (Griffiths & Griffiths, Reference Griffiths and Griffiths2015).
Anxiety symptoms were measured using the Generalised Anxiety Disorder scale – 7 items (GAD-7). Each item is rated on a 0 (not at all) to 3 (nearly every day) scale (score range 0–21). The GAD-7 has a test–retest reliability of 0.83, a cut-off score of ⩾10 has 89% sensitivity and 82% specificity for GAD (Spitzer, Kroenke, Williams, & Löwe, Reference Spitzer, Kroenke, Williams and Löwe2006), and reliable change is estimated as 5 points (Griffiths & Griffiths, Reference Griffiths and Griffiths2015).
PTSD symptoms were measured using the abbreviated PTSD Checklist – 6 items (PCL-6). Each item is rated on a 1 (not at all) to 5 (extremely) scale (score range 6–30). A cut-off score of ⩾14 has 80% sensitivity and 76% specificity of 76% for PTSD (Lang & Stein, Reference Lang and Stein2005), and reliable change is estimated to be 4 points (Lang et al., Reference Lang, Wilkins, Roy-Byrne, Golinelli, Chavira, Sherbourne and Stein2012). In the current study, the third item of the PCL-6 (‘Avoiding activities or situations because they reminded you of a stressful experience from the past’) was adapted for current (during the pandemic) symptom assessment by adding ‘this does not include activities or situations that are currently restricted or advised against’.
Global rating of change: After completing current symptom measures (PHQ-9 and GAD-7 only), participants provided a global rating of change, assessing perceived changes in symptoms (‘How different are these feelings to how you felt before the pandemic?’), on a 5-point scale [‘much worse’, to ‘much better’ (Robinson et al., Reference Robinson, Khan, Fusco, Malpass, Lewis and Dowrick2017)].
Retrospective ratings: Indication of symptom change on global ratings of change was followed up with retrospective assessment of PHQ-9 and GAD-7 to estimate pre-pandemic symptoms (prompt: ‘thinking about how you usually felt before the pandemic…’). Retrospective scores were imputed from current scores for participants rating ‘no difference’ in symptoms.
Assessment timepoints
Pre-pandemic symptoms (prospective)
GLAD cohort participants completed pre-pandemic measures of MDD, GAD and PTSD at time of enrolment into the GLAD study (September 2018–February 2020).
Current symptoms during the pandemic
Participants completed PHQ-9, GAD-7 and PCL-6 scales at the point of enrolment into COPING or RAMP during the pandemic (April–September 2020).
Pre-pandemic symptoms (retrospective)
Immediately following current symptom assessment, participants completed the global rating of change. Then, they completed retrospective estimates of pre-pandemic PHQ-9 and GAD-7 to assess recalled symptoms ‘before the pandemic’.
Statistical analyses
Data on the PHQ-9, GAD-7 and PCL-6 were excluded if one or more items on each scale were not completed (missingness: 0.22% PHQ-9; 0.17% GAD-7; 0.41% PCL-6). There were no exclusions made based on mental health diagnostic history or demographic factors (see online Supplementary materials for power calculation).
Change in symptoms
We first examined perceived change in symptoms by exploring descriptive statistics for the global ratings of change measure in depression and anxiety symptoms. Next, Welch t tests were used to assess differences in depression, anxiety and PTSD symptom scores, as follows. Taking a prospective approach within the GLAD sample comparing symptoms before and during the pandemic assessing: (i) mean symptom scores, and (ii) binary threshold scores (proportions meeting clinically significant thresholds). Taking a retrospective approach, we compared pre-pandemic symptom scores recalled during the pandemic with current symptom scores. Finally, to examine the association between prospective and retrospective measures of depression and anxiety symptoms, correlation analyses were conducted (GLAD sample only).
Individual differences in symptom change
Linear regression analyses included diagnostic (mental health diagnostic history) and demographic factors as explanatory variables, entered simultaneously into multivariable regression models. The first set of analyses were restricted to the GLAD sample and examined change in depression, anxiety and PTSD symptoms by controlling for prospectively measured pre-pandemic symptoms. The second set of analyses were conducted in the combined sample (and each sample individually) and examined change in depression and anxiety symptoms by controlling for retrospectively estimated pre-pandemic symptoms. Diagnostic history variables were binary coded (present/absent), and demographic variables were coded categorically (see online Supplementary materials). Associations with current depression, anxiety and PTSD symptoms were tested in separate models.
Results
Demographics are presented in Table 1. Frequencies of prior mental health diagnoses were 98.8% in GLAD, 29.4% in NBR and 58.1% in RAMP.
Aim 1: describing change in symptoms
Perceived change in symptoms (all samples)
Overall, 55.9% reported worsening depression symptoms (15.9% much worse, 40.0% a little worse) and 54.0% reported worsening anxiety symptoms (16.7% much worse, 37.3% a little worse). In the GLAD sample, frequencies of reported worsening were 62.8% and 62.0%, for depression and anxiety symptoms, whereas, in NBR, these frequencies were 39.9% and 36.5% and, in RAMP, 70.4% and 68.9% (Table 2).
Table 2. Reported changes in symptoms of depression (PHQ-9) and anxiety (GAD-7) by sample (GLAD, NBR, RAMP)
Prospectively measured symptom change (GLAD only)
Comparing prospectively measured pre-pandemic symptoms to current symptoms, there was a small decrease in depression symptoms [t(12 110) = −8.15, p < 0.001, d = −0.07], a small decrease in anxiety symptoms [t(12 125) = −6.67, p < 0.001, d = −0.06] and a small increase in PTSD symptoms [t(11 990) = −4.30, p < 0.001, d = 0.04]. Although statistically significant, the observed changes were small in magnitude and standard deviations were large, indicating a high degree of variance. Comparing proportions of individuals meeting standardised cutoffs on each scale (⩾10 PHQ-9; ⩾10 GAD-7; ⩾14 PCL-6), there was a similar pattern of effects. Proportions of individuals meeting thresholds for ‘moderate depression’ reduced from 54.5% pre-pandemic to 51.8% [χ2(1, N = 12 098) = 17.25, p ⩽ 0.001] during the pandemic, for ‘moderate generalised anxiety disorder’ reduced from 40.6% to 38.9% [χ2(1, N = 12 121) = 7.83, p = 0.005]; and for ‘probable PTSD’ increased from 56.4% to 57.9% [χ2(1, N = 12 062) = 5.21, p = 0.02].
Retrospectively estimated symptom change (all samples)
Comparing retrospectively estimated pre-pandemic symptoms to current symptoms demonstrated significant increases in depression symptoms [t(34 198) = 95.86, p < 0.001, d = 0.52] and anxiety symptoms [t(34 323) = 86.31, p < 0.001, d = 0.47; see online Supplementary Table S2 for breakdown across samples].
Correlation analyses (GLAD only)
The correlations between pre-pandemic measures and retrospective estimates of PHQ-9 and GAD-7 were r = 0.59 [p < 0.001, 95% confidence interval (CI) 0.55–0.63] and r = 0.51 (p < 0.001, 95% CI 0.47–0.56), respectively. Thus, the shared variance (r 2) was relatively low at 34.81% for PHQ-9 and 26.01% for GAD-7. Direct comparison of means demonstrated significantly lower scores for retrospective estimates, compared to prospective measures of both PHQ-9 [t(12 066) = 61.17, p < 0.001] and GAD-7 [t(12 110) = 57.16, p < 0.001].
Aim 2: associations with change in symptoms
Prospectively measured symptom change (GLAD only)
Regression analyses examined individual differences associated with change in depression, anxiety and PTSD symptoms from before to during the pandemic (Table 3). In each model, levels of pre-pandemic symptoms were positively associated with levels of current symptoms, so analyses report findings after accounting for pre-pandemic symptoms. Higher levels of current depression symptoms were associated with prior diagnosis of: (i) depression and anxiety, (ii) depression only, (iii) eating disorders, (iv) obsessive-compulsive and related disorders (OCRDs), (v) PTSD, (vi) autism spectrum disorder (ASD) and (vii) personality disorders. Higher levels of current anxiety symptoms were associated with prior diagnosis of: (i) depression and anxiety, (ii) eating disorders, (iii) OCRDs, (iv) PTSD, (v) ASD and (vi) personality disorders. Higher levels of current PTSD symptoms were associated with prior diagnosis of: (i) eating disorders, (ii) OCRDs, (iii) PTSD and (iv) personality disorders (Fig. 1).
Fig. 1. Plots detailing the effects of prior mental health diagnosis, gender, age, ethnicity and employment status on current depression, anxiety and PTSD symptoms during the pandemic, controlling for prospectively measured pre-pandemic symptom levels. Points indicate effect size estimates, error bars represent 95% CIs. Lower scores indicate a lower burden of symptoms. Note that change in symptoms was examined by including prospective prepandemic symptom measures in the model (association of prepandemic with current measures is shown in the first three data points in this figure, labelled ‘PHQ total prepandemic’, ‘PCL total prepandemic’, ‘GAD prepandemic’).
Table 3. Individual differences in prospective (GLAD sample) symptom change
R 2 values for each model were: PHQ-9 = 0.02; GAD-7 = 0.00; PCL-6 = 0.01.
a Pre-pandemic symptoms varied across models – PHQ-9 scores were entered for depression model, GAD-7 scores were entered for anxiety model and PCL-6 scores were entered for PTSD model.
b Sample sizes for these effects did not meet a priori power criteria (based on combined sample) so effects should be interpreted with caution.
Compared to male gender, female gender was associated with higher levels of current anxiety and PTSD, but not depression symptoms. Compared to the 26–35 year old reference group: (i) 16–25 year olds reported higher current levels of depression, anxiety and PTSD symptoms; (ii) 36–45 year olds reported lower levels of PTSD symptoms; (iii) 46–75 year olds reported lower depression, anxiety and PTSD symptoms and (iv) 76+ years olds were not significantly different. Compared to White ethnicity, there were no significant effects of minority ethnic group status. Compared to being employed, being a student was associated with higher current levels of depression symptoms and being unemployed was associated with higher current levels of depression, anxiety and PTSD symptoms (Fig. 1, Table 3).
Retrospectively estimated symptom change (all samples)
Samples were combined to maximise power to explore differences in symptoms based on diagnostic and demographic factors (Table 4). Patterns of effects were largely consistent with the prospective model. There were three additional associations with prior mental health diagnoses: (i) prior anxiety disorder only with higher depression and anxiety symptoms; (ii) prior bipolar disorder only with higher depression symptoms and (iii) combined psychotic and bipolar disorder diagnosis with higher anxiety symptoms. Additionally, there were significant effects of female gender, non-binary/self-defined gender and student status on depression symptoms and key worker status on anxiety symptoms.
Table 4. Individual differences in and retrospective (all samples) symptom change
R 2 values for each model were: PHQ-9 = 0.28; GAD-7 = 0.25.
a Pre-pandemic symptoms varied across models – PHQ-9 scores were entered for depression model, GAD-7 scores were entered for anxiety model.
Results of regression analyses for individual samples (GLAD, NBR, RAMP) are presented in online Supplementary Tables S3 and S4. Overall, the direction of effects was similar across all models although some effects reached statistical significance in some samples, but not in others.
Discussion
In a large UK study (N = 34 465), approximately 55% of individuals reported experiencing worsening of depression and anxiety symptoms from before to during the COVID-19 pandemic. Estimates of change in symptom severity, based on retrospective recall of pre-pandemic symptoms, indicated significant worsening of depression and anxiety symptoms from before to during the pandemic (depression d = 0.52, anxiety d = 0.49; PTSD symptoms were not assessed). However, in a subgroup (N = 12 718, GLAD study) who had completed prospective pre-pandemic mental health measures there were small decreases in anxiety (d = −0.06) and depression (d = −0.07) symptoms and a small increase (d = 0.04) in PTSD symptoms (although the size of these effects were not clinically relevant).
Even in this subgroup though, 63% reported a perceived worsening of symptoms. Exploring this effect in individuals who completed both retrospective and prospective symptom measures showed that symptoms were significantly lower in retrospective estimates of pre-pandemic symptoms than in prospective measures of pre-pandemic symptoms. This suggests that inaccurate recall of past symptom severity may contribute to the experience of perceived symptom worsening from before to during the pandemic, even in the absence of prospectively measured symptom change.
Other longitudinal studies to date have shown mixed findings regarding the mental health impact of the COVID-19 pandemic. Some studies demonstrated elevated distress, anxiety or depression (Kwong et al., Reference Kwong, Pearson, Adams, Northstone, Tilling, Smith and Timpson2020; Pan et al., Reference Pan, Kok, Eikelenboom, Horsfall, Jörg, Luteijn and Penninx2020; Pierce et al., Reference Pierce, Hope, Ford, Hatch, Hotopf, John and Abel2020a), while others showed no changes in symptoms (Breslau et al., Reference Breslau, Finucane, Locker, Baird, Roth and Collins2021; van der Velden et al., Reference van der Velden, Contino, Das, van Loon and Bosmans2020). Our findings do not show evidence of worsening symptoms of depression, anxiety or PTSD when measured prospectively, although results from retrospective measures indicate that a large proportion of individuals experienced a perceived worsening in their mental wellbeing, nonetheless.
Examining individual difference factors associated with risk for worsening symptoms (assessed using both prospective and retrospective measures of symptom change), we observed significant effects of lifetime diagnosis of a number of mental health conditions, female gender, young age (16–25 years) and being a student or being unemployed.
Discrepancies across methods of estimating symptom change
Despite high levels of reported worsening of mental health from both global ratings of change and estimates based on retrospective recall, prospective measures indicated minor improvements in depression and anxiety symptoms from before to during the pandemic. Prospective measures of change in the GLAD sample indicated small (<0.5 points per scale) decreases in depression and anxiety symptoms, and a small (0.2 point) increase in PTSD symptoms. While statistically significant, these small changes in symptoms are not considered to be clinically meaningful, as reliable change is estimated to be around 7 points on the PHQ-9, 5 points on the GAD-7 (Griffiths & Griffiths, Reference Griffiths and Griffiths2015) and 4 points on the PCL-6 (Lang et al., Reference Lang, Wilkins, Roy-Byrne, Golinelli, Chavira, Sherbourne and Stein2012).
Findings from prospective measures of change are consistent with another COVID-19 mental health study showing no significant change in depression or anxiety symptoms among individuals with prior diagnosis of depression, anxiety or OCD (Pan et al., Reference Pan, Kok, Eikelenboom, Horsfall, Jörg, Luteijn and Penninx2020). As discussed below, various prior mental health diagnoses do appear to contribute to risk for worsening symptoms. However, small overall changes in symptoms suggest that there are as many individuals showing a decrease in symptoms as there are showing an increase from before to during the pandemic. It is plausible that for many, the stay-at-home lifestyle of the pandemic reduced daily sources of stress, such as social pressures or workplace challenges. A small overall decrease in symptoms of depression and anxiety may also be indicative of regression to the mean (Barnett, van der Pols, & Dobson, Reference Barnett, van der Pols and Dobson2005) but the small increases in PTSD symptoms we observe are inconsistent with this explanation. Increase in PTSD symptoms may occur via exposure to new traumatic stressors during the pandemic (e.g. life-threatening illness such as acute COVID-19 infection, domestic/other abuse), exacerbation of existing PTSD symptoms, or may reflect broader non-trauma-related changes in mental distress. Further investigation of longitudinal PTSD symptom change in relation to experienced stressors would be important to distinguish these explanations.
The discrepancy between high levels of reported symptom worsening on global change ratings, and marginal decreases in symptom severity based on prospectively measured depression and anxiety symptom change may be explained in part by recall errors. Our findings showed that mean retrospective estimates of pre-pandemic symptom severity were significantly lower than prospective measurements of pre-pandemic symptom severity (3.11 points lower on the PHQ-9; 2.64 points lower on the GAD-7), suggesting a tendency to under-estimate past symptom severity. This tendency could plausibly contribute to an experienced ‘worsening’ in mental health, even in the absence of overall symptom change. It should be noted that while these effects were shown in both depression and anxiety symptom measures, we did not include retrospective assessments of PTSD symptoms.
Prior research examining discrepancies in prospective and retrospective reporting of mental health have shown mixed results, with individuals tending to under-report past diagnoses (Moffitt et al., Reference Moffitt, Caspi, Taylor, Kokaua, Milne, Polanczyk and Poulton2010), but those with higher symptom levels tending to over-report recent negative mood states (Wenze et al., Reference Wenze, Gunthert and German2012). Other work examining discrepancies in symptom change v. global ratings of change over the course of a psychological intervention has also highlighted a lack of recall of past symptom endorsement [using the PHQ-9 to measure depression symptoms (Robinson et al., Reference Robinson, Khan, Fusco, Malpass, Lewis and Dowrick2017)].
In addition to recall bias, there are other potential explanations for discrepancies in measurement observed here, as well as potential individual differences in the extent of recall bias that might be explored in future work. First, although prospective measures assessed ‘past 2 week’ symptoms, retrospective measures assessed ‘how you usually felt before the pandemic’. This likely introduced error in the timeframes being compared, as well as potential over-generalisation in retrospective reporting. Second, retrospective estimates were completed after the global change rating, which may have introduced a confirmation bias. Third, it is also possible that ratings of subjective changes in mental health capture current experiences of stress, which have previously been shown to predict longer-term changes in symptomatology (Hammen, Reference Hammen2005).
Prior work comparing PHQ-9 scores and global ratings of change suggested that global ratings may be a more ‘holistic’ assessment of mental wellbeing (Robinson et al., Reference Robinson, Khan, Fusco, Malpass, Lewis and Dowrick2017). Analysis of follow-up timepoints will be critical to determine longer-term changes in mental health during the COVID-19 pandemic. Finally, a number of individual difference factors have been identified that may contribute to the extent or nature of recall biases, including depression symptom severity, personality factors (e.g. neuroticism) emotion regulation strategy use and appraisal tendencies (Levine, Lench, & Safer, Reference Levine, Lench and Safer2009; Schwartz, Powell, & Rapkin, Reference Schwartz, Powell and Rapkin2017). Understanding the role of these individual differences in the extent of discrepancies across measures may help to inform the types of cognitive processes contributing to effects observed.
Risk factors: prior mental health diagnosis
Regression analyses controlling for prospectively measured pre-pandemic symptoms demonstrated that a range of pre-existing mental health diagnoses were associated with risk for worsening depression, anxiety and PTSD symptoms. These included eating disorders, OCRDs, PTSD and personality disorders. Additionally, comorbid prior depression and anxiety diagnoses and ASD diagnosis were associated with worsening depression and anxiety symptoms. Despite differing estimates of pre-pandemic symptom levels using prospective v. retrospective measurements, regression models controlling for retrospective estimates identified a largely similar pattern of effects. Additional significant effects, with larger effect sizes, were observed in retrospective models for ‘depression only’ and ‘anxiety only’ diagnoses and bipolar disorder (depression symptoms only), potentially due to increased power to detect these effects in a larger sample.
Risk factors: demographic variables
We confirm prior observations demonstrating greater risk for worsening mental health among female and younger participants (Fancourt, Steptoe, & Bu, Reference Fancourt, Steptoe and Bu2021; Kwong et al., Reference Kwong, Pearson, Adams, Northstone, Tilling, Smith and Timpson2020; Pierce et al., Reference Pierce, McManus, Hope, Hotopf, Ford, Hatch and Abel2021) as well as in students and individuals who were unemployed. Female gender was associated with higher levels of anxiety and PTSD symptoms, but not depression symptoms. Younger age and being unemployed were both associated with higher levels of depression, anxiety and PTSD symptoms, while being a student was associated with higher levels of depression symptoms only. We observed no statistically significant effects of ethnicity, although it should be noted that these analyses were powered only to detect differences with a moderate effect size. Smaller effects may be present that were not observable in the present study, and examination of these should be a priority for future work. Combined factors of younger age and student/unemployment status may have put young people at particular risk of worsening mental health during the pandemic.
Implications
Our results have two important implications. First, our findings highlight the elevated risk of worsening mental health during the COVID-19 pandemic among young people, those with prior mental health diagnoses and those who are unemployed. These groups of individuals should be prioritised for long-term mental health support during the continuing COVID-19 crisis, and beyond. Secondly, our findings highlight a known discrepancy between prospectively monitored v. perceived changes in symptoms of depression and anxiety (Robinson et al., Reference Robinson, Khan, Fusco, Malpass, Lewis and Dowrick2017). Our results indicate that part of this discrepancy is related to inaccurate recall, underestimating the severity of past symptoms. Recent recommendations for evaluating the efficacy of psychological interventions highlight the need to incorporate patients' perspectives on their symptoms, as failing to do so may overlook important aspects of patient experience that may be critical for understanding treatment effects (Hobbs et al., Reference Hobbs, Lewis, Dowrick, Kounali, Peters and Lewis2021). Inclusion of patient-focused measures, such as global change ratings, in longitudinal observational research can additionally provide insight into how discrepancies in symptoms v. experiences change over time, and how they may contribute to important health behaviours, such as treatment-seeking.
Limitations
Primary limitations of this work are that convenience sampling resulted in a cohort over-represented in females and individuals of White ethnicity (Pierce et al., Reference Pierce, McManus, Jessop, John, Hotopf, Ford and Abel2020b) and that studies were conducted online only, relying on self-report measures of diagnostic history. Secondly, analyses examining prospectively measured changes in symptoms were available only in individuals with prior diagnosis of depression or anxiety (GLAD sample). The absence of an unaffected control group in these analyses may underestimate effect sizes because the presence of one diagnosis is compared not against ‘no diagnosis’, but against individuals who do not have the diagnosis of interest. However, such comparisons do provide a stringent examination of the differential risk of a range of mental health diagnoses among groups of individuals who have prior experience of mental distress. Thirdly, in GLAD it is possible to derive metrics of chronicity and current severity at the time of pre-pandemic assessments [using online questionnaires and a measure derived from the Composite International Diagnostic Interview; CIDI (Davies et al., Reference Davies, Kalsi, Armour, Jones, McIntosh, Smith and Breen2019)]. However, analyses here focused on self-reported checklists of lifetime diagnoses that were available for all samples. Analyses presented therefore do not differentiate between participants whose diagnoses were current v. those who may have had a past diagnosis, but whose symptoms subsequently remitted. Reporting of past diagnoses was also likely to be impacted by recall errors that bias towards under-reporting. Although certainly a limitation, this would likely reduce the power to detect differences based on diagnostic status with more individuals being misallocated to the ‘no diagnosis’ group and would more likely result in false-negative than false-positive effects. Fourthly, the PCL-6 measure of PTSD symptoms does not include assessment of PTSD qualifying events. As such, this measure is not necessarily sensitive only to PTSD-related distress, and might reflect a broader range of common mental health symptoms. Additionally, regression models presented here allowed a broad exploration of sociodemographic factors associated with changes in depression, anxiety or PTSD symptoms. Future analyses might account for covariances between outcome measures, in order to gain a more detailed understanding of the unique associations between individual factors and specific symptom clusters. Finally, while the focus here on sociodemographic risk factors is informative for identifying groups at greatest risk, examination of modifiable cognitive or behavioural risk factors, such as emotion regulation, intolerance of uncertainty or loneliness, is essential to inform development or modification of psychological treatments to support those individuals at risk.
Conclusion
In a large UK study combining three samples, we demonstrate that over half reported a perceived worsening of their mental health from before to during the COVID-19 pandemic. However, among a subsample of participants with prior depression or anxiety and pre-pandemic symptom measures, there was no evidence of clinically meaningful symptom change at the overall group level. Examining individual risk factors, prior mental health diagnosis, young age and unemployment was associated with worsening symptoms of depression, anxiety and PTSD from before to during the COVID-19 pandemic. In addition, female gender was associated with worsening symptoms of anxiety and PTSD, but not depression, and being a student was associated with worsening symptoms of depression, but not anxiety or PTSD. These groups of individuals are likely to be in particular need of support to prevent worsening of mental health during the ongoing COVID-19 crisis.
Supplementary material
The supplementary material for this article can be found at https://doi.org/10.1017/S0033291722002501.
Data
Deidentified data included in analyses presented here are available from study authors on request. Analysis code will be made available at publication from: https://github.com/RAMP-COPING/PANCHANGE_analysis.
Acknowledgements
We thank NIHR BioResource volunteers for their participation, and gratefully acknowledge NIHR BioResource centres, NHS Trusts and staff for their contribution. We acknowledge the National Institute for Health Research, NHS Blood and Transplant and Health Data Research UK as part of the Digital Innovation Hub Programme. This work was supported by the National Institute of Health Research (NIHR) BioResource Centre Maudsley and is part-funded by the National Institute for Health Research (NIHR) Biomedical Research Centre at South London and Maudsley NHS Foundation Trust and King's College London. Patient and public involvement groups and services were provided by the NIHR KCL-Maudsley Biomedical Research Centre. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health and Social Care.
Author contributions
KSY, KLP, S Bristow, C Hübel, MH, TCE and GB devised the study concept and all authors were consulted on measurement inclusion. KSY, KLP, C Hübel, MRD, KNT and GB wrote the analysis plan. Data were curated and analysed by KLP, C Hübel, MRD, KNT, LH, AJP, YL and HCR. Figures were produced by KLP and S Bright. KSY wrote the first draft of the manuscript and all authors contributed to editing and commenting on the final version.
Financial support
The RAMP study is supported in part by the King's Together Multi and Interdisciplinary Research Scheme (Rapid COVID-19 call, Round 1; Round 2). KSY is supported by MQ; Transforming Mental Health (MQF20/24). CH acknowledges funding from Lundbeckfonden (R276-2018-4581). TE and GB are part funded by a programme grant from the UK Medical Research Council (MR/V012878/1). AAC is an NIHR Senior Investigator and AAC and GB part supported through EU Joint Programme – Neurodegenerative Disease Research (JPND) projects through the following funding organisations under the aegis of JPND - www.jpnd.eu (United Kingdom, Medical Research Council) (MR/L501529/1; MR/R024804/1). PFC is a Wellcome Trust Principal Research Fellow (212219/Z/18/Z) who receives support from the Medical Research Council Mitochondrial Biology Unit (MC_UU_00015/9).
Conflict of interest
The authors declare no competing interests.
Open access
