Hostname: page-component-586b7cd67f-tf8b9 Total loading time: 0 Render date: 2024-11-23T22:43:17.490Z Has data issue: false hasContentIssue false

The Fake IQ Test: a novel measure of self-reflection in major depressive disorder

Published online by Cambridge University Press:  08 June 2023

Lindsey Marwood
Affiliation:
Centre for Affective Disorders, Department of Psychological Medicine, Institute of Psychiatry, Psychology and Neuroscience, King's College London, UK
Jess Kerr-Gaffney*
Affiliation:
Centre for Affective Disorders, Department of Psychological Medicine, Institute of Psychiatry, Psychology and Neuroscience, King's College London, UK
Toby Wise
Affiliation:
Department of Neuroimaging, Institute of Psychiatry, Psychology and Neuroscience, King's College London, UK
Rebecca Strawbridge
Affiliation:
Centre for Affective Disorders, Department of Psychological Medicine, Institute of Psychiatry, Psychology and Neuroscience, King's College London, UK
Adam M. Perkins
Affiliation:
Centre for Affective Disorders, Department of Psychological Medicine, Institute of Psychiatry, Psychology and Neuroscience, King's College London, UK
Anthony J. Cleare
Affiliation:
Centre for Affective Disorders, Department of Psychological Medicine, Institute of Psychiatry, Psychology and Neuroscience, King's College London, UK; and National Affective Disorders Service, South London and Maudsley NHS Foundation Trust, London, UK
*
Correspondence: Jess Kerr-Gaffney. Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Background

Excessive negative self-referential processing plays an important role in the development and maintenance of major depressive disorder (MDD). Current measures of self-reflection are limited to self-report questionnaires and invoking imagined states, which may not be suitable for all populations.

Aims

The current study aimed to pilot a new measure of self-reflection, the Fake IQ Test (FIQT).

Method

Participants with MDD and unaffected controls completed a behavioural (experiment 1, n = 50) and functional magnetic resonance imaging version (experiment 2, n = 35) of the FIQT.

Results

Behaviourally, those with MDD showed elevated negative self-comparison with others, higher self-dissatisfaction and lower perceived success on the task, compared with controls; however, FIQT scores were not related to existing self-report measures of self-reflection. In the functional magnetic resonance imaging version, greater activation in self-reflection versus control conditions was found bilaterally in the inferior frontal cortex, insula, dorsolateral prefrontal cortex, motor cortex and dorsal anterior cingulate cortex. No differences in neural activation were found between participants with MDD and controls, nor were there any associations between neural activity, FIQT scores or self-report measures of self-reflection.

Conclusions

Our results suggest the FIQT is sensitive to affective psychopathology, but a lack of association with other measures of self-reflection may indicate that the task is measuring a different construct. Alternatively, the FIQT may measure aspects of self-reflection inaccessible to current questionnaires. Future work should explore relationships with alternative measures of self-reflection likely to be involved in perception of task performance, such as perfectionism.

Type
Paper
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
Copyright © The Author(s), 2023. Published by Cambridge University Press on behalf of the Royal College of Psychiatrists

Self-reflection and depression

Self-reflection refers to the ability to think about one's own thoughts, feelings and actions. It can be seen as a dimensional construct, encompassing both positive forms (e.g. self-reassurance and compassion) and negative or maladaptive forms (e.g. excessive rumination and worry).Reference Watkins1 Maladaptive forms of self-reflection play a major role in the development and course of mood and anxiety disorders.2 Prospective studies have demonstrated that rumination predicts the duration and severity of depressive symptoms, as well as the onset of new depressive episodes.Reference Nolen-Hoeksema3,Reference Wilkinson, Croudace and Goodyer4 Further, reductions in self-criticism during cognitive therapy predict treatment response in those with major depressive disorder (MDD).Reference Rector, Bagby, Segal, Joffe and Levitt5 Development of objective measures of self-reflection may help to provide a better understanding of the development and maintenance of disordered thinking in MDD.

Self-reflective cognitions are conventionally assessed by self-report questionnaires. However, these rely on semantic autobiographical memory, and may be particularly inaccurate and insensitive to change in clinical populations with decreased insight.Reference Orfei, Robinson, Bria, Caltagirone and Spalletta6 Other studies have used neuroimaging paradigms, whereby participants engage in imaginative states of self-referential thought; for example, by imagining scenarios of personal failures and mistakes or hopes and aspirations.Reference Johnson, Nolen-Hoeksema, Mitchell and Levin7,Reference Longe, Maratos, Gilbert, Evans, Volker and Rockliff8 However, these paradigms rely on the assumption that internally imagined states are equivalent to those produced by external stimuli. Although there is some evidence of overlap between real and imagined states, the validity of this design has been brought into question.Reference Klein and Gangi9 Further, there are likely to be individual differences in one's ability to realistically imagine certain states, especially in certain patient groups with limited insight or alexithymia.Reference Grant, Franklin and Langford10,Reference Taylor, Bagby and Widiger11

A potential solution to these limitations is to use a more objective task, where participants engage in a genuine situation involving self-reflection. Nuttin and GreenwaldReference Nuttin and Greenwald12 created such a test, whereby participants were asked to judge pairs of shapes on various visual properties (e.g. which shape is bigger). The task was portrayed as an intelligence task, but was really an implicit measure of self-reflection; the task was in fact impossible, and shapes were equal on the queried visual property. In the original experiment, participants were split into ‘pessimists’ and ‘optimists’, and in a second experiment, ‘depressives’ and ‘manics’; in both cases, the former group was more likely to overestimate failures.Reference Nuttin and Greenwald12 The findings demonstrate that individuals perceive successes and failures in the context of a pre-established personality trait-like conception of the self, independent of actual task performance.

The Fake IQ Test

The Fake IQ Test (FIQT) was created as an adapted version of Nuttin's self-reflection paradigm. The FIQT has three major advantages over existing measures of self-reflection. First, it removes the need for participants to imagine themselves in an evaluative context, because it is an evaluative context. Second, because all participants perform the same, their perceptions of their performance reflect trait-like individual differences in the positive or negative valence of their self-reflection, rather than differences in other attributes. Third, because self-reflection is elicited by an external event, responses should be less influenced by variations in life history. Thus, the FIQT test could provide a useful alternative to existing measures of self-reflection. Further, validation in participants with MDD could provide a better understanding of the neural correlates of pathological self-reflection.

Aims

To test the psychiatric validity of the FIQT, two experiments were conducted in participants with MDD and unaffected controls. The first aimed to pilot the computerised version of the FIQT to assess self-reflection in participants with MDD and controls, and explore construct validity through correlations with previously validated self-report measures of self-reflection. We hypothesised that participants with MDD would show higher levels of negative self-reflection on the FIQT compared with controls. It was also hypothesised that negative self-reflection on the FIQT would positively correlate with self-reported rumination, self-criticism and state worry, and negatively correlate with self-reassurance. The second experiment aimed to pilot the functional magnetic resonance imaging (fMRI) version of the FIQT, to examine neural activation during self-reflection in those with MDD compared with controls. We hypothesised increased activation in the medial prefrontal cortex (PFC), posterior cingulate cortex (PCC) and insula (reflecting self-reflectionReference D'Argembeau, Collette, Van der Linden, Laureys, Del Fiore and Degueldre13Reference Moran, Macrae, Heatherton, Wyland and Kelley16), as well as the dorsolateral PFC and dorsal anterior cingulate cortex (ACC) (reflecting error processingReference Longe, Maratos, Gilbert, Evans, Volker and Rockliff8,Reference Garavan, Ross, Kaufman and Stein17,Reference Gehring and Knight18 ) in self-reflection versus control trials. We also hypothesised that this increased activation would be greater in participants with MDD compared with controls. An additional aim was to examine whether neural activity was related to scores on FIQT subscales and existing self-report measures of self-reflection. We hypothesised that elevated medial PFC, PCC, dorsal ACC, insula and dorsolateral PFC activation would be positively correlated with FIQT subscale scores and self-reported self-criticism, rumination and state worry, and negatively correlated with self-reassurance scores.

Method

Experiment 1

Participants

Participants aged 18–65 years were recruited via waiting lists for South London psychological therapy services and online advertisements. Participants had not yet started psychological therapy at the time of testing. Participants were required to meet the DSM-IV criteria for a current major depressive episode, determined via the Mini-International Neuropsychiatric Interview (MINI),Reference Sheehan, Lecrubier, Sheehan, Amorim, Janavs and Weiller19 and a score ≥14 on the 17-item Hamilton Rating Scale for Rating Scale (HRSD-17).Reference Hamilton20 A diagnosis of bipolar disorder or current psychosis (assessed with the MINI), or borderline personality disorder (determined via the Structured Clinical Interview for DSM-IV Axis II disordersReference First, Gibbon, Spitzer, Williams and Benjamin21), were exclusionary.

Age- and gender-matched controls were assessed to exclude personal and familial (first-degree relative) psychiatric history. Exclusion criteria for all participants included neurological disorders, intellectual disabilities, visual problems that were not correctable, illicit substance use in the preceding 2 months, current (within 12 months of study entry) alcohol or other substance misuse (determined via the MINI), and unstable or severe medical conditions.

Ethics

This paper describes work submitted as part of the first author's PhD thesisReference Marwood22 and material has been included with permission. The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008. All procedures involving human patients were approved by London-Bromley Research Ethics Committee (reference: 13/LO/1897). All participants provided informed written consent and received financial compensation for taking part.

Materials

The FIQT

Participants read a brief statement before beginning the task, which informed them that the task was an examination of their visual perception, purposefully designed to be challenging and test their analytical ability. The construct supposedly being measured is fictitious but was described to sound plausible to the lay person, thus increasing individuals’ expectations that the task is linked to intellectual ability and performance, on which they would be judged. Participants were instructed to make quick and accurate judgements about predefined properties of pairs of geometric shapes displayed side by side on the computer screen. This visual perception performance on the task was not measured as all problems were impossible in that the two geometric shapes were equivalent in terms of the criteria the participant had to judge them on; for example, length, surface area or volume (see Fig. 1). Participants had 5.5 s to respond to each pair of images. After a set of ten images, participants were asked to rate their performance on three dimensions, using visual analogue scales: accuracy (‘How many of the last 10 trials do you think you got correct?’), comparison with others (‘Do you think your performance was better or worse than average?’) and satisfaction (‘Overall, do you feel satisfied with your performance?’). Scores on these questions were reversed (so that higher scores reflected more negative self-reflection), giving three subscale scores of ‘incorrect’, ‘comparison’ and ‘dissatisfaction’, respectively.

Fig. 1 Example stimuli from the Fake IQ Test.

After completion of the FIQT, two further questions were asked: ‘Is how you performed on this task important to you?’ (rated from 0 ‘not at all’ to 10 ‘very important’) and ‘How did you feel during the task?’ These were asked to ensure potential differences in task performance were not a result of differences in motivation or guessing the ‘fake’ nature of the task.

Questionnaires

Three questionnaires were administered. The Rumination Response Scale (RRS)Reference Nolen-Hoeksema and Morrow23 is a 22-item self-report measure of rumination, self-reflection and brooding. Higher scores indicate more ruminative symptoms. The Forms of Self Criticising/Attacking and Self-Reassuring Scale (FSCSR)Reference Gilbert, Clarke, Hempel, Miles and Irons24 is a 22-item self-report questionnaire exploring tendencies to be self-critical or self-reassuring to personal setbacks and failures. We used the two subscale scores of self-criticism and self-reassurance. The Penn State Worry Questionnaire (PSWQ)Reference Meyer, Miller, Metzger and Borkovec25 is a 16-item self-report questionnaire measuring trait worry. Higher scores indicate a higher tendency for worry.

Analysis

Differences in demographic and clinical variables and behavioural performance on the FIQT were assessed with independent samples t-tests. Associations between FIQT subscales, self-report measures of self-reflection (RRS, FSCSR and PSWQ) and depression severity (HRSD-17) were assessed with Pearson's correlations, using false discovery rate (FDR) correction.Reference Benjamini and Hochberg26

Experiment 2

Participants

A subset of participants who took part in experiment 1 also took part in experiment 2, with additional exclusion criteria: psychotropic medication use in the 8 weeks before inclusion, pregnancy, left-handedness or other contraindications for scanning.

Materials

In the fMRI version of the FIQT, participants saw a screen after each pair of images, saying either ‘wait’ or ‘satisfied’ for 5 s (see Fig. 2). On the ‘satisfied’ trials, participants were instructed to reflect on their perceived performance on that trial (self-reflection trial). On the ‘wait’ trials, the participants were instructed to not think about their performance, but rather rest, relax and try to free their mind from the task (control trial). A white cross was then shown for a variable interstimulus interval of 2–6 s. ‘Wait’ and ‘satisfied’ trials were presented in a randomised order. Again, blocks of trials were followed by a performance rating. There were four blocks for each FIQT subscale performance rating.

Fig. 2 Stimulus timings for the functional magnetic resonance imaging version of the Fake IQ Test.

Participants completed the RRS, FSCSR and PSWQ as in experiment 1.

Analysis

Differences in demographic and clinical variables and behavioural performance on the FIQT were assessed with independent samples t-tests. To examine whether performance changed over time, multiple linear regression analyses were run to test whether block and group significantly predicted FIQT subscale scores.

fMRI acquisition and pre-processing

Functional images were acquired on a 3-Tesla GE MR750 scanner with a 12-channel radiofrequency head coil. The fMRI sequence comprised T2*-weighted gradient echo planar image sessions of 338 whole-brain volume acquisitions: flip angle 75°, repetition time 2000 ms, echo time 30 ms, field of view 24 × 24 cm, slice thickness 3 mm, inter-slice gap 0.3 mm (total of 41 slices) and matrix size 64 × 64 voxels with an isotropic 3 mm × 3 mm in-plane resolution. Cardiac and respiratory signals were also recorded during the scan, and were processed with a custom script implementing the AFNI program's Retrospective Image Correction tool (RETROICOR) algorithm.Reference Glover, Li and Ress27,Reference Cox28

Data pre-processing was conducted with custom Nipype scripts (http://nipy.org/nipype/), using tools from Statistical Parametric Mapping, version 12 for Windows (SPM12, UCL, London, UK; see http://www.fil.ion.ucl.ac.uk/spm/) and custom code. Functional images were realigned, slice-time corrected and co-registered to a high-resolution T1 image. T1 images were segmented and normalised, and functional images were normalised into Montreal Neurological Institute (MNI) space with deformation fields. Data were then smoothed with a 6 mm full-width half-maximum Gaussian kernel. To limit the effect of motion artefacts, participants with substantial translation of more than one voxel (3 mm) were removed from further analysis. Additionally, volumes with high levels of motion (based on realignment parameters and signal intensity changes from volume to volume) were identified with ArtifactDetect (see https://nipype.readthedocs.io/en/latest/api/generated/nipype.algorithms.rapidart.html), and removed from analysis.

First- and second-level analysis

First-level models were formed on each participant's data to generate mean images for each participant that included regressors for each trial type (‘wait’ (control condition), ‘satisfied’ (self-reflection condition) and baseline fixation), along with six motion parameters that were generated during realignment, and cardiac and respiratory regressors. Motion-scrubbing regressors were included to exclude volumes with high motion.

The contrast of interest for our main effects analyses compared ‘wait’ and ‘satisfied’ trials (controlling for fixation, which was modelled as an implicit baseline condition). Group differences between these conditions were tested with one-sample t-tests in SPM12, with head motion (total distance travelled), age and gender as covariates.

Regions of interest (ROIs) were derived from Neurosynth maps (see neurosynth.org) for the term ‘self-referential’, thresholded at z > 10 to identify regions most likely to be associated with self-reflective thought. This map was combined with the Automated Anatomical Labelling (AAL version 1 for Windows; see https://www.gin.cnrs.fr/en/tools/aal/) atlasReference Tzourio-Mazoyer, Landeau, Papathanassiou, Crivello, Etard and Delcroix29 to create the ROIs and additionally eliminate non-default mode network (DMN) regions from these maps. Regions within default mode systems, especially the medial PFC and PCC, were selected because these regions are considered imperative to the generation of self-referential thoughts.Reference Perkins, Arnone, Smallwood and Mobbs30 The ROI analyses were conducted by using separate masks for each ROI that were combined and treated as a single ‘small volume’ for the purposes of multiple comparison correction. For these bidirectional ROIs, the significance level for the F-contrasts were set to P < 0.05 FDR-corrected. As this was the first use of the FIQT, exploratory whole-brain analyses were also performed, with a cluster-defining threshold of P < 0.001 and a cluster-wise threshold of P < 0.05 FDR-corrected for multiple comparisons.

Regressions were conducted to explore relationships between neural activation (‘satisfied’ compared with ‘wait’ conditions) and self-report measures of self-reflection. These included the FIQT's subscale scores, self-criticism (FSCSR, self-criticism subscale), self-reassurance (FSCSR, self-reassurance subscale), rumination (RRS) and worry (PSWQ) questionnaire scores. These regressions were conducted at both a whole-brain level and on a mask of the main effect of the task (i.e. running correlations only in the areas that were significantly activated in the task) to explore correlations between behavioural scores and neural activity. This limited our analyses of relationships with questionnaires to relevant regions and ensured that the analyses were unbiased, because of the orthogonal nature of the primary activation analyses and those targeting relationships with questionnaires.

Results

Experiment 1

Thirty participants with MDD and 20 controls took part in experiment 1. Demographic and clinical information as well as FIQT and self-report questionnaire scores are displayed in Table 1. As expected, participants with MDD estimated that they made more mistakes (P = 0.011, Cohen's d = 0.81), perceived their performance as worse compared with others (P = 0.005, Cohen's d = 0.90) and were more dissatisfied with their performance (P = 0.048, Cohen's d = 0.61). The groups did not differ in post-task ratings of importance of performing well on the task.

Table 1 Experiment 1: mean (s.d.) sample characteristics, Fake IQ Test and self-report self-reflection scores

MDD, major depressive disorder; HRSD-17, 17-item Hamilton Rating Scale for Depression; FIQT, Fake IQ Test; FSCSRS, Forms of Self-Criticising and Self-Reassuring Scale; RRS, Ruminative Response Scale; PSWQ, Penn State Worry Questionnaire.

Significant positive correlations were observed between all subscales of the FIQT in both groups (Table 2). However, no significant correlations were found between the FIQT subscales and self-reported self-reflection or depression severity measures in either group. Finally, no participants reported fully guessing the ‘fake’ nature of the task.

Table 2 Experiment 1: correlations between all self-reflection assessments and depression severity, by group (major depressive disorder in lower half of matrix, controls in upper half)

FIQT, Fake IQ Test; FSCSRS, Forms of Self-Criticising and Self-Reassuring Scale; HRSD-17, 17-item Hamilton Rating Scale for Depression; RRS, Ruminative Response Scale; PSWQ, Penn State Worry Questionnaire.

*P < 0.05, ***P < 0.001.

Experiment 2

Eighteen participants with MDD and 20 controls took part in experiment 2. However, three participants (two with MDD and one control) were excluded from analyses because of excessive head motion. Demographic and clinical information for included participants are shown in Table 3. Participants with MDD scored significantly higher than controls on all subscales of the FIQT apart from dissatisfaction, where there was a trend for participants with MDD to score higher than controls.

Table 3 Experiment 2: mean (s.d.) sample characteristics and behavioural performance on the Fake IQ Test

HRSD-17, 17-item Hamilton Rating Scale for Depression; FSCSRS, Forms of Self-Criticising and Self-Reassuring Scale; RRS, Ruminative Response Scale; PSWQ, Penn State Worry Questionnaire; FIQT, Fake IQ Test.

a. n = 15 because of data collection errors for one participant.

Regression analyses indicated that group significantly predicted FIQT incorrect (β = 12.55, P < 0.001), comparison (β = 11.01, P < 0.001) and dissatisfaction scores (β = 10.38, P = 0.001); however, trial block did not (incorrect: β = 0.52, P = 0.672; comparison: β = 1.84, P = 0.098; satisfied: β = 1.39, P = 0.323).

Task main effects for the whole-brain analysis are displayed in Table 4 and Fig. 3. There was increased activation in the self-reflection versus control condition bilaterally in the inferior cortex extending to the dorsal ACC and insula, as well as the left dorsolateral PFC, and motor area activation. There were no significant areas of decreased activation with self-reflection. There were no significant differences between groups in the whole-brain analysis.

Fig. 3 Brain activation during the Fake IQ Test (satisfied > control conditions).

Table 4 Experiment 2: brain activation during the Fake IQ Test (main effect of task)

N = 35 (16 participants with depression, 19 controls), whole-brain analysis. All results presented met criteria for significance; a cluster-defining significance of P < 0.001 and a cluster-wise threshold of P < 0.05 FDR-corrected. MNI, Montreal Neurological Institute.

No significant effects of task or group were found in our ROI analysis. The regression analyses did not show any significant relationships between brain activity (at the whole-brain level or the main effect of task) and self-report measures of self-reflection or behavioural subscales of the FIQT.

Discussion

In accordance with our hypothesis, participants with MDD showed higher levels of negative forms of self-reflection on all subscales of the FIQT in experiment 1. Although group differences in scores on the dissatisfaction subscale became non-significant in experiment 2, this is likely because of the smaller sample size and consequent reduction in statistical power. Interestingly, we did not find any significant associations between FIQT subscales and self-reported self-reflection or depression severity in either group. In experiment 2, increased activation was found in the insula, dorsal ACC and dorsolateral PFC in self-reflection versus control trials of the FIQT; however, no differences in activation were found in those with MDD compared with controls. Further, no significant effects of task or group were found in our ROI analysis, and brain activity did not correlate with FIQT subscales or self-report measures of self-reflection.

Our findings showing increased negative self-comparison with others, increased dissatisfaction and lower perceived success on the FIQT are consistent with previous research showing high levels of self-criticism, low self-esteem and heightened perception of failure in those with MDD.Reference Nuttin and Greenwald12,Reference Blatt31 Participants with MDD and controls gave similar post-task ratings of task importance, suggesting group differences were not a result of controls caring less about performance, but are reflective of differences in self-perception of performance. These findings suggest that the FIQT may be sensitive to behavioural differences in self-reflection in MDD, providing a novel, objective measure of negative self-appraisal.

Given the lack of relationships between FIQT subscales and self-report measures of self-reflection, the FIQT may be tapping into aspects of self-reflection inaccessible to current questionnaires. The FIQT relies less on insight and does not require recall of memories with potentially high emotional content, unlike the questionnaire methods used in this study. Further, the non-verbal nature of the task may partly explain the lack of association with self-report measures. However, these characteristics may make the FIQT more widely accessible to groups with special requirements (for example, young children or individuals with autism). On the other hand, the lack of construct validity here may indicate the FIQT measures a different construct entirely. Future research should carefully consider the psychological correlates of the FIQT. For example, previous work has suggested that self-criticism may mediate the relationship between maladaptive perfectionism and psychological distress.Reference James, Verplanken and Rimes32 Future work could evaluate whether the FIQT more closely reflects perfectionistic aspects of self-reflection.

Although those with MDD had higher scores on the FIQT compared with controls, we did not find any association between depressive symptoms and FIQT subscale scores. Further, no significant associations were found between FIQT subscale scores and neural activation, preventing us from interpreting whether regions of increased activation during self-reflection trials versus control trials related to negative forms of self-reflection. Given that negative self-reflection is considered a core element of depression, our findings may indicate that the FIQT measures a neurocognitive process or type of self-reflection not linked to severity of mood. MDD is typically characterised by negative ruminative thoughts about the self (e.g. ‘I am worthless/inadequate/to blame’), whereas the type of self-reflection elicited in the FIQT is relatively emotionally neutral. Thus, the lack of association with depressive symptoms may be because of these qualitative differences in self-reflective content. Future studies could explore qualitative differences in thoughts surrounding the FIQT, which may reveal important differences across disorders.

Increased activation in the insula, dorsal ACC and dorsolateral PFC was found in self-reflection versus control trials of the FIQT. These results are consistent with previous research implicating these areas in self-reflection and error processing.Reference Longe, Maratos, Gilbert, Evans, Volker and Rockliff8,Reference Modinos, Ormel and Aleman15,Reference Garavan, Ross, Kaufman and Stein17,Reference Gehring and Knight18 Additionally, significantly elevated activation in the self-reflection condition was found in the posterior inferior parietal lobe. This region is part of the DMN and is associated with attending to visual, spatial stimuli.Reference Zhang and Li33 The observed activation in inferior, occipital and parietal cortices, along with the dorsal ACC and insula, could reflect the increased emotional salience of the self-reflection trials. These regions form part of the ‘salience network’, which is associated with the processing of salient, internally generated emotional thoughts.Reference Uddin34 The insula mediates the detection of motivationally salient and emotional stimuli,Reference Paulus and Stein35 and the salience network has been found to have reciprocal connections and causally influence activity in the DMN.Reference Uddin34 We also found elevated motor activation during self-reflection, likely reflecting participants imagining the shapes and engaging in motor imagery.Reference Miller, Schalk, Fetz, den Nijs, Ojemann and Rao36

Currently, psychiatric assessment and diagnosis is based on self-report and observation of patient behaviours, without parallel measurement of underlying biological mechanisms. However, clinical presentation varies widely within psychiatric diagnoses, suggesting that there are multiple underlying causes and illness processes. Recent neuroimaging studies have suggested that neurophysiological-based subtypes of disorders may be better able to predict treatment response and symptoms than traditional classification systems, although further replication of these findings are requiredReference Insel, Cuthbert, Garvey, Heinssen, Pine and Quinn37,Reference Drysdale, Grosenick, Downar, Dunlop, Mansouri and Meng38 As self-reflection is considered a spectrum, with both high and low levels found in a range of psychopathologies, then a better understanding of the neural correlates of specific aspects of self-reflection may inform us about the development and maintenance of disordered thinking and allow for more personalised treatments.

Limitations

The control condition of the FIQT, where participants were instructed to relax, could still elicit self-reflection. This would be supported by findings that the DMN is active in resting-state studies, where participants often report being engaged in self-reflective thought.Reference Raichle39 This may explain why, contrary to our expectations, there were no differences in activation between the control and self-reflective conditions in the medial PFC and PCC, areas that have been previously identified as active during self-reflection.Reference D'Argembeau, Collette, Van der Linden, Laureys, Del Fiore and Degueldre13,Reference Macrae, Moran, Heatherton, Banfield and Kelley14,Reference Moran, Macrae, Heatherton, Wyland and Kelley16 This could additionally explain why our ROI analyses did not reveal any significant task effects, because of our focus on DMN regions in selection of these regions. Despite evidence of differences between resting-state and task-based self-reflective neural activation, many self-reflection studies do use similar control conditions to the FIQT and have found DMN activation.Reference Whitfield-Gabrieli, Moran, Nieto-Castañón, Triantafyllou, Saxe and Gabrieli40 Relatedly, our lack of group differences in neural activation may have been because of differences in participants’ abilities to shift their attention between control and self-reflective trials. For example, participants with MDD may have been less able to relax and free their mind of negative thoughts during the control condition, confounding group differences. The relatively short trial duration may have exacerbated this issue.

Our lack of significant group differences in experiment 2 may indicate that the FIQT is not sensitive to the neural correlates of psychopathology. However, further exploration of the task is warranted, given that other studies have found differences in neural activation in depression during negative self-reflection,Reference Johnson, Nolen-Hoeksema, Mitchell and Levin7,Reference Marchetti, Koster, Sonuga-Barke and De Raedt41 and self-reflective tasks have been shown to be sensitive to both pharmacologicalReference Kilts, Kelsey, Knight, Ely, Bowman and Gross42 and psychological therapeutic response.Reference Yoshimura, Okamoto, Onoda, Matsunaga, Okada and Kunisato43 Compared with tasks used previously, the FIQT has the added benefit of not relying on insight or imagined states of self-reflection. However, the task could be adapted to test different control conditions; for example, by including a distractor (e.g. hand-tapping or neutral thought cues) to minimise self-reflective cognitions.

Scores on each of the FIQT subscales were highly correlated. This may indicate that the different questions were measuring the same construct. Finally, the relatively small sample sizes in both experiments are also a limitation, particularly for the development of a new measurement tool. This may have also prevented detection of significant differences.

In conclusion, our study presents behavioural and fMRI pilot testing of a novel, objective measure of self-reflection, the FIQT. Our results suggest the FIQT is sensitive to affective psychopathology with elevated negative self-comparison with others, higher self-dissatisfaction and lower perceived success in participants with MDD relative to controls. Importantly, the ‘fake’ nature of the task did not appear to have been perceived by participants in post-task questioning and evaluation of responses over time. Because of a lack of significant correlations between FIQT subscales and self-reported self-criticism, rumination and worry, we did not find evidence of construct validity. It is therefore possible that the FIQT does not measure self-reflection or may assess aspects of self-reflection not captured by current measures. Neural main effects showing elevated activation in the insula, dorsal ACC, dorsolateral PFC and posterior inferior parietal lobe provide further support for the FIQT as an assessment of self-reflection. We therefore propose the FIQT as an alternative to traditional self-report measures of self-reflection, with potential application to multiple patient groups. Further work should explore the task's relationship to alternative measures of self-reflection likely to be involved in perception of task performance, such as self-blame or perfectionism.

Data availability

The data that support the findings of this study are available from the corresponding author, J.K.-G., upon reasonable request.

Acknowledgements

We thank the staff of the Centre for Neuroimaging Sciences at King's College London for their support in the conduct of the study. We thank all of the participants of this study for taking part in this research.

Author contributions

L.M., A.J.C. and A.M.P. conceived of the study. L.M. and R.S. contributed to the investigation. L.M. and T.W. conducted the analysis. L.M. and J.K.-G. wrote the manuscript. A.J.C. and A.M.P. provided supervision and resources. All authors edited the manuscript and approved of the final draft.

Funding

The study was funded by a Medical Research Council/ Institute of Psychiatry, Psychology and Neuroscience Excellence PhD studentship to L.M., supervised by A.J.C. and A.M.P., and departmental funds generated by A.J.C. A.J.C., R.S. and A.M.P. are supported by the NIHR Biomedical Research Centre at the South London and Maudsley National Health Service Foundation Trust and King's College London. This report represents independent research funded by the NIHR Biomedical Research Centre and South London and Maudsley NHS Foundation Trust and King's College London. The views expressed are those of the authors and not necessarily those of the NHS, NIHR or Department of Health and Social Care.

Declaration of interest

L.M. is currently an employee at COMPASS Pathways; this work is unrelated to COMPASS Pathways. R.S. reports honoraria for speaking from Lundbeck and Janssen. R.S. is a member of the BJPsych Open Editorial Board, but did not take part in the peer review or decision-making process of this paper. A.J.C. has received honoraria for speaking from Lundbeck; honoraria for consulting from Allergan, Livanova, Janssen and Lundbeck; and sponsorship for attending an academic conference from Janssen. All other authors have no conflicts of interest to declare.

Footnotes

Joint last authors.

References

Watkins, ER. Constructive and unconstructive repetitive thought. Psychol Bull 2008; 134(2): 163206.CrossRefGoogle ScholarPubMed
American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (5th edn). American Psychiatric Publishing, 2013.Google Scholar
Nolen-Hoeksema, S. The role of rumination in depressive disorders and mixed anxiety/depressive symptoms. J Abnorm Psychol 2000; 109(3): 504–11.CrossRefGoogle ScholarPubMed
Wilkinson, PO, Croudace, TJ, Goodyer, IM. Rumination, anxiety, depressive symptoms and subsequent depression in adolescents at risk for psychopathology: a longitudinal cohort study. BMC Psychiatry 2013; 13: 250.CrossRefGoogle ScholarPubMed
Rector, NA, Bagby, RM, Segal, ZV, Joffe, RT, Levitt, A. Self-criticism and dependency in depressed patients treated with cognitive therapy or pharmacotherapy. Cognit Ther Res 2000; 24(5): 571–84.CrossRefGoogle Scholar
Orfei, MD, Robinson, RG, Bria, P, Caltagirone, C, Spalletta, G. Unawareness of illness in neuropsychiatric disorders: phenomenological certainty versus etiopathogenic vagueness. Neurosci 2008; 14(2): 203–22.Google ScholarPubMed
Johnson, MK, Nolen-Hoeksema, S, Mitchell, KJ, Levin, Y. Medial cortex activity, self-reflection and depression. Soc Cogn Affect Neurosci 2009; 4(4): 313–27.CrossRefGoogle ScholarPubMed
Longe, O, Maratos, FA, Gilbert, P, Evans, G, Volker, F, Rockliff, H, et al. Having a word with yourself: neural correlates of self-criticism and self-reassurance. Neuroimage 2010; 49(2): 1849–56.CrossRefGoogle ScholarPubMed
Klein, SB, Gangi, CE. The multiplicity of self: neuropsychological evidence and its implications for the self as a construct in psychological research. Ann N Y Acad Sci 2010; 1191: 115.CrossRefGoogle ScholarPubMed
Grant, AM, Franklin, J, Langford, P. The self-reflection and insight scale: a new measure of private self-consciousness. Soc Behav Pers 2002; 30(8): 821–36.CrossRefGoogle Scholar
Taylor, GJ, Bagby, RM. The alexithymia personality dimension. In The Oxford Handbook of Personality Disorders (ed Widiger, TA): 647–73. Oxford University Press, 2012.Google Scholar
Nuttin, J, Greenwald, AG. Reward and Punishment in Human Learning: Elements of a Behavior Theory. Academic Press, 1968.Google Scholar
D'Argembeau, A, Collette, F, Van der Linden, M, Laureys, S, Del Fiore, G, Degueldre, C, et al. Self-referential reflective activity and its relationship with rest: a PET study. Neuroimage 2005; 25(2): 616–24.CrossRefGoogle Scholar
Macrae, CN, Moran, JM, Heatherton, TF, Banfield, JF, Kelley, WM. Medial prefrontal activity predicts memory for self. Cereb Cortex 2004; 14(6): 647–54.CrossRefGoogle ScholarPubMed
Modinos, G, Ormel, J, Aleman, A. Activation of anterior insula during self-reflection. PLoS One 2009; 4(2): e4618.CrossRefGoogle ScholarPubMed
Moran, JM, Macrae, CN, Heatherton, TF, Wyland, CL, Kelley, WM. Neuroanatomical evidence for distinct cognitive and affective components of self. J Cogn Neurosci 2006; 18(9): 1586–94.CrossRefGoogle ScholarPubMed
Garavan, H, Ross, T, Kaufman, J, Stein, E. A midline dissociation between error-processing and response-conflict monitoring. Neuroimage 2003; 20(2): 1132–9.CrossRefGoogle ScholarPubMed
Gehring, WJ, Knight, RT. Prefrontal–cingulate interactions in action monitoring. Nat Neurosci 2000; 3(5): 516–20.CrossRefGoogle ScholarPubMed
Sheehan, DV, Lecrubier, Y, Sheehan, KH, Amorim, P, Janavs, J, Weiller, E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry 1998; 59(suppl 20): 2233.Google ScholarPubMed
Hamilton, M. A rating scale for depression. J Neurol Neurosurg Psychiatry 1960; 23(1): 5662.CrossRefGoogle ScholarPubMed
First, MB, Gibbon, M, Spitzer, RL, Williams, JBW, Benjamin, LS. Structured Clinical Interview for DSM-IV Axis II Personality Disorders (SCID-II). American Psychiatric Association, 1997.Google Scholar
Marwood, L. Novel functional imaging methods in depression and anxiety. DPhil doctoral thesis. King's College London, 2017.Google Scholar
Nolen-Hoeksema, S, Morrow, J. A prospective study of depression and posttraumatic stress symptoms after a natural disaster: the 1989 Loma Prieta earthquake. J Pers Soc Psychol 1991; 61(1): 115–21.CrossRefGoogle ScholarPubMed
Gilbert, P, Clarke, M, Hempel, S, Miles, JNV, Irons, C. Criticizing and reassuring oneself: an exploration of forms, styles and reasons in female students. Br J Clin Psychol 2004; 43(1): 3150.CrossRefGoogle ScholarPubMed
Meyer, TJ, Miller, ML, Metzger, RL, Borkovec, TD. Development and validation of the Penn State Worry Questionnaire. Behav Res Ther 1990; 28(6): 487–95.CrossRefGoogle ScholarPubMed
Benjamini, Y, Hochberg, Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. R Stat Soc 1995; 57(1): 289300.Google Scholar
Glover, GH, Li, TQ, Ress, D. Image-based method for retrospective correction of physiological motion effects in fMRI: RETROICOR. Magn Reson Med 2000; 44(1): 162–7.3.0.CO;2-E>CrossRefGoogle ScholarPubMed
Cox, RW. AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Comput Biomed Res 1996; 29(3): 162–73.CrossRefGoogle ScholarPubMed
Tzourio-Mazoyer, N, Landeau, B, Papathanassiou, D, Crivello, F, Etard, O, Delcroix, N, et al. Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage 2002; 15(1): 273–89.CrossRefGoogle ScholarPubMed
Perkins, AM, Arnone, D, Smallwood, J, Mobbs, D. Thinking too much: self-generated thought as the engine of neuroticism. Trends Cogn Sci 2015; 19(9): 492–8.CrossRefGoogle ScholarPubMed
Blatt, SJ. Experiences of Depression: Theoretical, Clinical, and Research Perspectives. American Psychiatric Publishing , 2004.CrossRefGoogle Scholar
James, K, Verplanken, B, Rimes, KA. Self-criticism as a mediator in the relationship between unhealthy perfectionism and distress. Pers Individ Dif 2015; 79: 123–8.CrossRefGoogle Scholar
Zhang, S, Li, C-SR. Functional clustering of the human inferior parietal lobule by whole-brain connectivity mapping of resting-state functional magnetic resonance imaging signals. Brain Connect 2014; 4(1): 5369.Google ScholarPubMed
Uddin, LQ. Salience processing and insular cortical function and dysfunction. Nat Rev Neurosci 2015; 16(1): 5561.CrossRefGoogle ScholarPubMed
Paulus, MP, Stein, MB. Interoception in anxiety and depression. Brain Struct Funct 2010; 214(5–6): 451–63.CrossRefGoogle ScholarPubMed
Miller, KJ, Schalk, G, Fetz, EE, den Nijs, M, Ojemann, JG, Rao, RPN. Cortical activity during motor execution, motor imagery, and imagery-based online feedback. Proc Natl Acad Sci 2010; 107(9): 4430–5.CrossRefGoogle ScholarPubMed
Insel, T, Cuthbert, B, Garvey, M, Heinssen, R, Pine, D, Quinn, K, et al. Research domain criteria (RDoC): toward a new classification framework for research on mental disorders. Am J Psychiatry 2010; 167(7): 748–51.CrossRefGoogle Scholar
Drysdale, AT, Grosenick, L, Downar, J, Dunlop, K, Mansouri, F, Meng, Y, et al. Resting-state connectivity biomarkers define neurophysiological subtypes of depression. Nat Med 2017; 23(1): 2838.CrossRefGoogle ScholarPubMed
Raichle, ME. The brain's default mode network. Annu Rev Neurosci 2015; 38: 433–47.CrossRefGoogle ScholarPubMed
Whitfield-Gabrieli, S, Moran, JM, Nieto-Castañón, A, Triantafyllou, C, Saxe, R, Gabrieli, JDE. Associations and dissociations between default and self-reference networks in the human brain. Neuroimage 2011; 55(1): 225–32.CrossRefGoogle ScholarPubMed
Marchetti, I, Koster, EHW, Sonuga-Barke, EJ, De Raedt, R. The default mode network and recurrent depression: a neurobiological model of cognitive risk factors. Neuropsychol Rev 2012; 22(3): 229–51.CrossRefGoogle ScholarPubMed
Kilts, CD, Kelsey, JE, Knight, B, Ely, TD, Bowman, FD, Gross, RE, et al. The neural correlates of social anxiety disorder and response to pharmacotherapy. Neuropsychopharmacology 2006; 31(10): 2243–53.CrossRefGoogle ScholarPubMed
Yoshimura, S, Okamoto, Y, Onoda, K, Matsunaga, M, Okada, G, Kunisato, Y, et al. Cognitive behavioral therapy for depression changes medial prefrontal and ventral anterior cingulate cortex activity associated with self-referential processing. Soc Cogn Affect Neurosci 2014; 9(4): 487–93.CrossRefGoogle ScholarPubMed
Figure 0

Fig. 1 Example stimuli from the Fake IQ Test.

Figure 1

Fig. 2 Stimulus timings for the functional magnetic resonance imaging version of the Fake IQ Test.

Figure 2

Table 1 Experiment 1: mean (s.d.) sample characteristics, Fake IQ Test and self-report self-reflection scores

Figure 3

Table 2 Experiment 1: correlations between all self-reflection assessments and depression severity, by group (major depressive disorder in lower half of matrix, controls in upper half)

Figure 4

Table 3 Experiment 2: mean (s.d.) sample characteristics and behavioural performance on the Fake IQ Test

Figure 5

Fig. 3 Brain activation during the Fake IQ Test (satisfied > control conditions).

Figure 6

Table 4 Experiment 2: brain activation during the Fake IQ Test (main effect of task)

Submit a response

eLetters

No eLetters have been published for this article.