Introduction
Cognitive functioning is affected in many brain disorders (Robbins, Reference Robbins2011). The observed impairment can be profound, as in Alzheimer's disease or Parkinson's disease (PD), or relatively mild, as in depression (Brown & Marsden, Reference Brown and Marsden1990; Caviness et al., Reference Caviness, Driver-Dunckley, Connor, Sabbagh, Hentz, Noble and Adler2007; Douglas et al., Reference Douglas, Gallagher, Robinson, Carter, McIntosh, Frampton and Porter2018; Petersen et al., Reference Petersen, Doody, Kurz, Mohs, Morris, Rabins and Winblad2001). Other brain disorders, such as multiple sclerosis (MS), schizophrenia or traumatic brain injury (TBI) can co-occur with more varying levels of cognitive performance, with either mild or severe cognitive dysfunction (Chiaravalloti & DeLuca, Reference Chiaravalloti and DeLuca2008; Heinrichs & Zakzanis, Reference Heinrichs and Zakzanis1998; Sun, Tan, & Yu, Reference Sun, Tan and Yu2014; Walker & Tesco, Reference Walker and Tesco2013). Impairments may affect multiple cognitive domains, including information processing, working memory, executive functioning and attention (Caviness et al., Reference Caviness, Driver-Dunckley, Connor, Sabbagh, Hentz, Noble and Adler2007; Higuchi et al., Reference Higuchi, Sumiyoshi, Seo, Suga, Takahashi, Nishiyama and Suzuki2017; Maloni, Reference Maloni2018). These disturbances can profoundly impact daily functioning and quality of life (Papakostas et al., Reference Papakostas, Petersen, Mahal, Mischoulon, Nierenberg and Fava2004; Schrag, Jahanshahi, & Quinn, Reference Schrag, Jahanshahi and Quinn2000). Cognition determines, to a considerable extent, one's social and professional success and the ability to live independently (Audet, Hebert, Dubois, Rochette, & Mercier, Reference Audet, Hebert, Dubois, Rochette and Mercier2007; Benedict & Zivadinov, Reference Benedict and Zivadinov2006; Green, Kern, Braff, & Mintz, Reference Green, Kern, Braff and Mintz2000). Moreover, for people in their working age, current society demands high adaptability, resistance to stress and continuous learning, which is impeded by cognitive dysfunction. This refrains many patients, even those with minor cognitive impairments, from holding employments at the level they were trained for. As amelioration of cognitive abilities could lead to improvements in daily life functioning, many studies have tried to improve cognitive functioning using various techniques (Bell & Bryson, Reference Bell and Bryson2001; Perneczky et al., Reference Perneczky, Pohl, Sorg, Hartmann, Komossa, Alexopoulos and Kurz2006; Shin, Carter, Masterman, Fairbanks, & Cummings, Reference Shin, Carter, Masterman, Fairbanks and Cummings2005).
Current treatment options include rehabilitation, cognitive remediation, physical exercise, cognitive enhancing medication, and various brain stimulation techniques (Cicerone et al., Reference Cicerone, Dahlberg, Malec, Langenbahn, Felicetti, Kneipp and Catanese2005; Leroi, McDonald, Pantula, & Harbishettar, Reference Leroi, McDonald, Pantula and Harbishettar2012; Wallace, Ballard, Pouzet, Riedel, & Wettstein, Reference Wallace, Ballard, Pouzet, Riedel and Wettstein2011), yet treatment effects vary and effect sizes (ES) are generally low. Non-invasive brain stimulation (NIBS) entails the modulation of brain excitability and activity (Ziemann et al., Reference Ziemann, Paulus, Nitsche, Pascual-Leone, Byblow, Berardelli and Rothwell2008) and consists of different methods, such as transcranial magnetic stimulation (TMS) and transcranial direct current stimulation (tDCS). TMS and tDCS have been used most commonly in an attempt to improve cognition in people with brain disorders. It is generally considered that anodal tDCS (AtDCS) increases the function of the underlying areas of the cortex, whereas cathodal tDCS has a suppressive effect (Nitsche & Paulus, Reference Nitsche and Paulus2011). TMS can either lead to an increase or decrease in cortical excitability depending on the stimulation frequency, varying from 1 to 50 Hertz. High tolerability with few side-effects is considered an important advantage over medication and, in the case of tDCS, has a potential to be applied at home (Aleman, Sommer, & Kahn, Reference Aleman, Sommer and Kahn2007, Reference Aleman, Enriquez-Geppert, Knegtering and Dlabac-de Lange2018; Chervyakov, Chernyavsky, Sinitsyn, & Piradov, Reference Chervyakov, Chernyavsky, Sinitsyn and Piradov2015; Lage, Wiles, Shergill, & Tracy, Reference Lage, Wiles, Shergill and Tracy2016; Rossi et al., Reference Rossi, Hallett, Rossini, Pascual-Leone, Avanzini, Bestmann and Ziemann2009; Slotema, Aleman, Daskalakis, & Sommer, Reference Slotema, Aleman, Daskalakis and Sommer2012). Furthermore, contrasting cognitive remediation or practice and drill, NIBS demands little effort from patients, which is an important advantage for those who also suffer from fatigue, apathy, or diminished motivation.
Until now, the efficacy of NIBS is unclear and some have questioned whether these techniques have any effect on the brain at all (Vöröslakos et al., Reference Vöröslakos, Takeuchi, Brinyiczki, Zombori, Oliva, Fernández-Ruiz and Berényi2018). Skepticism is increased by lack of clear theories and evidence on working mechanisms of both interventions, which hampers smart applications (Chase, Boudewyn, Carter, & Phillips, Reference Chase, Boudewyn, Carter and Phillips2020; Singh, Erwin-Grabner, Goya-Maldonado, & Antal, Reference Singh, Erwin-Grabner, Goya-Maldonado and Antal2019) Nevertheless, many studies have applied NIBS techniques in an attempt to improve cognitive function in different diagnostic groups. Although some studies showed promising findings, the results of studies on the effect of NIBS on cognition remain inconsistent and the field would benefit from an overarching systematic overview of findings so far.
Cognition is a broad concept and different cognitive functions are subserved by different cerebral and cerebellar circuits, which may be more or less susceptible to stimulation techniques. As both TMS and tDCS are thought to affect mainly the outer layers of the brain, cognitive circuits that rely on midbrain and other deep structures such as the cingulate gyrus and the hippocampus may be expected to be insensitive to NIBS. In addition, since NIBS is usually applied to the cerebral cortex, cognitive functions that rely highly on subcortical or cerebellar circuits may not be expected to be responsive either. As the dorsolateral prefrontal cortex (DLPFC) is laterally located and often close to the area of stimulation, working memory may be a cognitive function expected to benefit from NIBS (Brunoni & Vanderhasselt, Reference Brunoni and Vanderhasselt2014; Miniussi & Rossini, Reference Miniussi and Rossini2011; Pope & Chris Miall, Reference Pope and Chris Miall2014; Tracy et al., Reference Tracy, Shergill, David, Fonagy, Zaman, Downar and Bhui2015). Thus, the results of TMS and tDCS may become less heterogeneous when analyzed within the specific cognitive domains (attention/vigilance, working memory, executive functioning, processing speed, verbal fluency, verbal learning, and social cognition).
The aim of the current review and meta-analysis is therefore to quantitatively investigate the procognitive effect of NIBS (i.e. TMS and tDCS) in a domain-specific way, across different brain disorders in which cognitive dysfunction is a common problem. We evaluate all randomized controlled trials (RCTs) assessing the effect of the two most commonly applied types of NIBS (i.e. TMS and tDCS) for cognitive dysfunction in schizophrenia, depression, dementia, PD, MS, stroke, and TBI.
Methods
Search strategy
Following the Preferred Reporting for Systematic Reviews and Meta-analysis (PRISMA) Statement (Moher, Liberati, Tetzlaff, & Altman, Reference Moher, Liberati, Tetzlaff and Altman2009), a systematic search was performed in PubMed (Medline), EMBASE, Web of Science, and Cochrane Database of Systematic Reviews, using the following search terms: [‘cognition’ OR ‘cognitive functioning’] AND [‘transcranial magnetic stimulation’, ‘pulsed electromagnetic field therapy’, ‘low field magnetic stimulation’, ‘transcranial electrical stimulation’ OR ‘transcranial direct current stimulation’] AND [‘randomized controlled trial’, ‘RCT’ OR ‘randomized controlled study’], for each brain disorder (schizophrenia, depression, dementia, PD, MS, stroke, and TBI; exact terms described in online Supplementary Methods). No year or language limits were applied. Review articles and meta-analyses were examined for cross-references. The search cutoff date was 1 May 2019.
Study inclusion
(1) RCTs investigating the effects of TMS or tDCS treatment on cognition measured with a neuropsychological test (battery);
(2) Studying patients affected by one of our conditions of interest;
(3) Single/double-blind studies comparing the treatment to a patient control group receiving sham stimulation. In case of combined interventions, the control group received the same non-brain stimulation component of the intervention (e.g. brain stimulation + medication v. sham + medication). Studies applying stimulation on a control stimulation site instead of sham were also included;
(4) Studies reporting sufficient information to compute common ES statistics [i.e. mean and standard deviations (s.d.), exact F-, p-, t, or z-values] or corresponding authors provided these data upon request;
(5) If multiple publications were retrieved describing the same cohort, the sample with the largest overall sample size and/or original data was included;
(6) Studies were published in an international peer-reviewed journal.
Measures
For each identified study, we included pre- and post-assessments of cognitive functioning for the active v. sham condition. To facilitate cross-comparisons, cognitive outcomes were categorized into neurocognitive domains (Lage et al., Reference Lage, Wiles, Shergill and Tracy2016). We selected seven cognitive domains based on the two cognitive batteries commonly used in studies evaluating cognitive performance in psychiatric and neurological patient populations: the MATRICS (Measurement and Treatment Research to Improve Cognition in Schizophrenia; Green et al., Reference Green, Nuechterlein, Gold, Barch, Cohen, Essock and Marder2004) and the Movement Disorder Society Task Force (Litvan et al., Reference Litvan, Goldman, Tröster, Schmand, Weintraub, Petersen and Emre2012): attention/vigilance, working memory, executive functioning, processing speed, verbal learning, verbal fluency, and social cognition. When a study applied multiple cognitive tests to assess the same cognitive domain, we included the primary outcome measure as defined by authors. When the primary outcome was not defined, we selected the test most relevant to the defined cognitive domain. If studies reported multiple outcomes for a single cognitive test (e.g. reaction time and number of errors), the outcome most relevant to the cognitive domain was included for analysis.
Statistical analyses
We separately evaluated the effects of TMS and tDCS across the seven brain disorders, including all relevant study samples for the seven cognitive domains. Study samples were grouped according to brain disorder. We evaluated whether the effect varied per specific brain disorder and performed subanalyses when k ⩾ 3.
Calculations
All analyses were performed using Comprehensive Meta-Analysis Version 2.0 (Borenstein, Hedges, Higgins, & Rothstein, Reference Borenstein, Hedges, Higgins and Rothstein2009). Details are provided in online Supplementary Methods. In short, Hedges' g was used to quantify ES for changes in cognitive performance, where a positive ES represented a superior effect of brain stimulation v. sham. Studies with multiple treatment groups (e.g. different stimulation intensity) and one sham group were entered as individual study samples (k). Single-dose (i.e. challenge) studies were included, sensitivity analyses were run with and without these challenge studies.
ES of p < 0.05 (two-tailed) were considered statistically significant, 0.2 reflecting a small, 0.5 a medium, and ⩾0.8 a large effect (Cohen, Reference Cohen1988). To investigate whether studies could be combined to share a common population ES, the Q-value and I 2-statistic were evaluated. I 2-values of 25, 50, and 75% are considered as low, moderate, and high heterogeneity, respectively (Cohen, Reference Cohen1988; Higgins, Thompson, Deeks, & Altman, Reference Higgins, Thompson, Deeks and Altman2003). Outlier studies were evaluated when heterogeneity was significant (p < 0.05), defined as standardized residual Z-scores of ES exceeding ±1.96 (p < 0.05, two-tailed).
For (trend-)significant results, potential publication bias was investigated by means of a visual inspection of the funnel plot and Egger's test (p < 0.1, two-tailed) (Egger, Smith, Schneider, & Minder, Reference Egger, Smith, Schneider and Minder1997). Rosenthal's fail-safe number (NR) was calculated, estimating the number of unpublished studies with non-significant results needed to bring an observed result to non-significance (NR ⩾ 5k + 10 to rule out a file drawer problem) (Rosenthal, Reference Rosenthal1979).
Sensitivity analyses were performed for (trend-)significant results, correcting for inflated control groups, single-dose studies, and moderator effects of the number of treatment sessions, mean age, and gender (online Supplementary Methods).
Results
The literature search following PRISMA guidelines is depicted in Fig. 1. Demographic information on the included studies is provided in Table 1 for TMS and Table 2 for tDCS. The total number of included studies was 82, reporting on 93 study samples (k), evaluating a grand total of 2784 patients. Table 3 depicts the mean demographical group characteristics for the 43 TMS studies and 39 tDCS studies. Forest plots of the significant results are depicted in Fig. 2, forest plots of the remaining cognitive domains are depicted in online Supplementary Figs S1–S10.
Fig. 1. PRISMA flow diagram of the performed literature search. PRISMA, Preferred Reporting Items for Systematic Reviews and Meta-Analyses, dementia, depression, SZ (schizophrenia), MS (multiple sclerosis), PD (Parkinson's diseases), stroke and TBI (traumatic brain injury).
Fig. 2. Forest plots of the effect of tDCS and TMS on working memory and tDCS on attention/vigilance. Results are summarized for all studies, sorted by brain disorder. (a) Forest plot of the effect of tDCS on attention/vigilance, outlier excluded. (b) Forest plot of the effect of TMS on working memory. (c) Forest plot of the effect of tDCS on working memory. BACS, Brief Assessment of Cognition in Schizophrenia; CDR, Cognitive Drug Research Computerized Assessment System; PAL, Paired Associate Learning; RBANS, Repeatable Battery for the Assessment of Neuropsychological Status; SWM, Spatial Working Memory; WMS, Wechsler Memory Scale; WM, Working Memory.
Table 1. Characteristics of the included studies for Transcranial Magnetic Stimulation (TMS)
Hz, Hertz; DLPFC, dorsolateral prefrontal cortex; IFG, inferior frontal gyrus; MFG, middle frontal gyrus; PMC, premotor cortex; TPC, temporo-parietal cortex; VLPFC; ventrolateral prefrontal cortex; a, anterior; m, medial; p, posterior; d, dorsal; HF, high frequency; LF, low frequency; iTBS, intermitted theta burst stimulation; cTBS, continuous theta burst stimulation; c + iTBS, continuous and intermittent theta burst stimulation; AAO, age at onset; y, years; mo, months; da, days; A/V, attention/vigilance; EF, executive functioning; PS, processing speed; VF, verbal fluency; VL, verbal learning; WM, working memory.
Year of publication (Year), study design (Design), stimulation type and/or site, number of participants per group (n), age (mean ± standard deviation), proportion of females (%F), duration of illness (mean ± standard deviation if available), stimulation frequency (Hz), number (nr.) of sessions and cognitive domains(s) are specified for each study.
Table 2. Characteristics of the included studies for transcranial direct current stimulation (tDCS)
mA, miliÀmpère; A, anodal; C, cathodal; CT, cognitive therapy; CCT, cognitive control therapy; AC, auditory cortex; CBC; cerebellar cortex; Cz, central midline; DLPFC, dorsolateral prefrontal cortex; IFG, inferior frontal gyrus; lat. O, lateral aspect of the orbit; OcC, occipital cortex; PC, parietal cortex; PMC, premotor cortex; SO, supraorbital area; TC, temporal cortex; TL, temporal lobe; TP, temporo-parietal; TPJ, temporo-parietal junction; VLPFC, ventrolateral prefrontal cortex; a, anterior; m, medial; p, posterior; min, minutes; AAO, age at onset; y, years; mo, months; da, days; A/V, attention/vigilance; EF, executive functioning; PS, processing speed; SC, social cognition; VF, verbal fluency; VL, verbal learning; WM, working memory.
Year of publication (Year), study design (Design), stimulation type and/or site, number of participants per group (n), age (mean ± standard deviation), proportion of females (%F), duration of illness (mean ± standard deviation if available), stimulation intensity (mA), number (nr.) of sessions and cognitive domains(s) are specified for each study.
a Within-group cross-over.
Table 3. Mean group characteristics for the included TMS and tDCS studies
Attention/vigilance
TMS: Combining 21 study samples (n = 680), TMS did not differ from sham in the effect on attention/vigilance, studies were homogeneous (ES = 0.10, p = 0.210; Table 4). ES did not differ between the four different brain disorders included (online Supplementary Table S1).
Table 4. Effects of Transcranial Magnetic Stimulation (TMS) and transcranial Direct Current Stimulation (tDCS) across brain disorders for the seven cognitive domains
k, number of study samples; n, number of studies; df, degrees of freedom; I2, heterogeneity; NR, Rosenthal's Fail-safe number.
Note: Bold values indicate significant test-statistic (p < 0.05).
tDCS: tDCS (k = 29; n = 980) was superior to sham in improving performance on attention/vigilance tasks (ES = 0.27, p = 0.006; Table 4; Fig. 2a). The number of null-studies needed to render this effect non-significant (NR) was 93, with no evidence for publication bias (online Supplementary Fig. S11). However, heterogeneity was moderate and the I2 of 52.08 indicated that 48.92% of the dispersion reflects the difference in the true ES while the remaining 52.08% can be attributed to random sampling error (Table 4). One outlier study was identified (Z-score>1.96; Orlov et al., Reference Orlov, Tracy, Joyce, Patel, Rodzinka-Pasko, Dolan and Shergill2017). This pilot study combined two sessions on day 1 and day 14, with four sessions of cognitive therapy in-between. After exclusion, ES remained significant and heterogeneity decreased (ES = 0.20, p = 0.020; Table 4; Fig. 2b). However, the funnel plot indicated potential publication bias (p = 0.047, online Supplementary Fig. S11). The effect of tDCS did not differ across disorders (online Supplementary Table S1). Regarding the sensitivity analyses, four studies compared multiple interventions to the same control group, yet the mean weighted ES did not change significantly after splitting these shared placebo groups to prevent inflated ES (ES = 0.20, p = 0.022). However, when excluding challenge/single-dose studies, the effect of tDCS on attention/vigilance was no longer significant (ES = 0.12, p = 0.140). Meta-regressions did not reveal significant moderation effects for the number of treatment sessions, age, or gender (online Supplementary Table S2).
Working memory
TMS: TMS (k = 25; n = 873) showed a small yet significant effect, with low heterogeneity (ES = 0.17, p = 0.015; Table 4; Fig. 2b). ES did not differ between brain disorders (online Supplementary Table S1) and publication bias was low (online Supplementary Fig. S12). This effect of TMS on working memory did not change after correcting control group sample sizes of the five studies that compared multiple interventions (ES = 0.16, p = 0.032) or after excluding one single-dose study (ES = 0.15, p = 0.049). Notably, age was a positive moderator, as study samples with a higher mean age showed more improvement in working memory after TMS in a linear fashion as depicted in Fig. 3 (slope coefficient = 0.020, p = 0.005). The number of treatment sessions and gender did not moderate ES (online Supplementary Table S2).
Fig. 3. Meta-regression of the effect of TMS on working memory. Study-samples depicted by circles proportional to their sample size. The x-axis represents the mean age of the study-samples in years, y-axis depicts the effect size (Hedges' g).
tDCS: A small significant effect on working memory was detected for tDCS, studies were homogeneous (k = 28; n = 939; ES = 0.17, p = 0.021; Table 4; Fig. 2c) and there was no evidence for publication bias (online Supplementary Fig. S13). This effect did not differ across different brain disorders (online Supplementary Table S1). ES remained significant when adjusting control group sample sizes for the three studies with multiple intervention groups (ES = 0.15, p = 0.038) and when excluding five single-dose studies (ES = 0.17, p = 0.038). No significant moderators were identified (online Supplementary Table S2).
Executive functioning
TMS: Overall, TMS (k = 40; n = 1145) was not superior to sham in improving executive functioning, with low heterogeneity (ES = 0.07, p = 0.243; Table 4), ES did not differ between disorders (online Supplementary Table S1).
tDCS: tDCS (k = 19, n = 662) did not differ from sham, with moderate heterogeneity (ES = 0.04, p = 0.726; Table 4). ES did not differ across disorders (online Supplementary Table S1). Mattioli, Bellomi, Stampatori, Capra, and Miniussi (Reference Mattioli, Bellomi, Stampatori, Capra and Miniussi2016) and the DLPFC-condition of Chalah, Créange, Lefaucheur, and Ayache (Reference Chalah, Créange, Lefaucheur and Ayache2017) were both identified as outliers. Mattioli et al. (Reference Mattioli, Bellomi, Stampatori, Capra and Miniussi2016) was a positive outlier (Z-score >1.96) and the only study using total errors of the Wisconsin's Card Sorting Test as an outcome measure. In line with the positive effect that was found for right PPC stimulation in the same study (Table 1), Chalah et al. (Reference Chalah, Créange, Lefaucheur and Ayache2017) relate their strong negative effect (Z-score <1.96) to the phenomenon of cerebral lateralization in MS. After exclusion, heterogeneity decreased and ES remained non-significant (ES = 0.00, p = 0.992; Table 4).
Processing speed
TMS: No superior effect was found for TMS (k = 30; n = 941) v. sham, with low heterogeneity (ES = −0.01, p = 0.900; Table 4), without any differences across the included disorders (online Supplementary Table S1).
tDCS: No difference was found in the effect of tDCS (k = 24; n = 794) v. sham (ES = 0.24, p = 0.099, Table 4), ES did not vary between disorders (online Supplementary Table S1). Heterogeneity was moderate to high (Table 4), three outlier studies were identified. Segrave et al. (Reference Segrave, Arnold, Hoy and Fitzgerald2014) reported remarkable strong improvements after sham compared to tDCS (N-back RT, Z-score <−1.96). Diverging from other included studies, both Moreno et al. (Reference Moreno, Vanderhasselt, Carvalho, Moffa, Lotufo, Benseñor and Brunoni2015) (Z-score >1.96) and Biundo et al. (Reference Biundo, Weis, Fiorenzato, Gentile, Giglio, Schifano and Antonini2015) (Z-score >1.96) used the RBANS written coding task. After exclusion, heterogeneity decreased and ES remained non-significant (ES = −0.02, p = 0.784; Table 4). Notably, the effect of tDCS then varied between different brain disorders [Q(4) = 12.62; p = 0.013; online Supplementary Table S1] yet subgroup analyses showed that tDCS was not superior for depression (k = 8; n = 389; ES = −0.00, 95% CI −0.20 to 0.20, p = 0.997), schizophrenia (k = 7; n = 194; ES = −0.02, 95% CI −0.29 to 0.26, p = 0.894), and stroke (k = 3; n = 71; ES = 0.10, 95% CI −0.35 to 0.55, p = 0.654). The number of studies on PD (k = 2) and MS (k = 1) was insufficient to perform subgroup analyses.
Verbal fluency
TMS: No superior effect was found for TMS (k = 21; n = 747) on verbal fluency, with low heterogeneity (ES = −0.05, p = 0.538; Table 4) and no differences across disorders (online Supplementary Table S1).
tDCS: No significant difference was found between tDCS (k = 9; n = 399) v. sham, heterogeneity was low (ES = 0.14, p = 0.193; Table 4), ES did not vary across disorders (online Supplementary Table S1).
Verbal learning
TMS: Overall, TMS (k = 21; n = 690) showed no positive effect v. sham but heterogeneity was high (ES = 0.08, p = 0.635; Table 4). Significant differences in effect between disorders were detected (p = 0.029; online Supplementary Table S1), subgroup analyses showed an effect for stroke [k = 3; n = 64; ES = 0.677, Q(2) = 7.01, p = 0.005]. After excluding one outlier study (Z-score >1.96) (Sun, Lu, Zhang, Wen, & Sun, Reference Sun, Lu, Zhang, Wen and Sun2015), heterogeneity decreased and overall ES remained non-significant (Table 4). Notably, the difference in the effect of TMS on verbal learning between disorders was then no longer observed (online Supplementary Table S1).
tDCS: tDCS did not differ from sham (k = 18; n = 550), included studies were homogeneous (ES = 0.05, p = 0.609; Table 4) and ES did not differ across disorders (online Supplementary Table S1).
Social cognition
TMS: As we retrieved only one study investigating the effect of TMS on social cognition (Wölwer et al., Reference Wölwer, Lowe, Brinkmeyer, Streit, Habakuck, Agelink and Cordes2014), no meta-analysis could be conducted.
tDCS: tDCS (k = 7; n = 171) showed a trend-significant effect on social cognition, with low heterogeneity (ES = 0.27, p = 0.070; Table 4). The funnel plot and Egger's regression test indicated potential publication bias (p = 0.09; online Supplementary Fig. S13), yet the power of this test is limited due to the small number of studies included (Egger et al., Reference Egger, Smith, Schneider and Minder1997). The difference in ES between disorders was trend-significant (online Supplementary Table S1). The studies on schizophrenia showed a non-significant effect (k = 5; n = 132; ES = 0.17, p = 0.326), although the two studies on depression were positive they could not be combined in meta-analysis.
Discussion
We investigated the procognitive effects of TMS and tDCS in 83 randomized, double- or single-blind sham-controlled studies in schizophrenia, depression, dementia, MS, PD, stroke, and TBI. Using a domain-specific approach, we found a positive effect of both TMS (ES = 0.17) and tDCS (ES = 0.17) as compared to sham on working memory. The finding that both NIBS techniques elicit a similar effect in the same domain may suggest that the circuitry underlying working memory is readily accessible for activation using NIBS. In addition, this is the first meta-analysis reporting improvements in attention/vigilance in tDCS as compared to placebo stimulation (ES = 0.19), while the ES of 0.10 for TMS was not significant. This suggests that tDCS may be superior to TMS in improving attention/vigilance, although firm conclusions can only be drawn by making direct comparisons within one study randomizing participants across conditions. Other cognitive domains did not benefit from either TMS or tDCS as compared to sham.
Our findings largely corroborate with two quantitative reviews that have specifically evaluated the effects of NIBS on working memory, both including a lower number of studies (Brunoni & Vanderhasselt, Reference Brunoni and Vanderhasselt2014; Hill, Fitzgerald, & Hoy, Reference Hill, Fitzgerald and Hoy2016; Martin, McClintock, Forster, & Loo, Reference Martin, McClintock, Forster and Loo2016). Hill et al. (Reference Hill, Fitzgerald and Hoy2016) (16 AtDCS studies; 182 neuropsychiatric patients and 170 controls) showed that AtDCS significantly improved online accuracy in patients (ES = 0.77) and offline reaction time in healthy individuals (ES = 0.16) as compared to sham, although no overall effect was found for accuracy or reaction time. Brunoni and Vanderhasselt (Reference Brunoni and Vanderhasselt2014) (12 TMS and tDCS RCTs, 805 psychiatric patients and healthy controls) identified medium effects of NIBS, on accuracy (ES correct responses = 0.25; ES error rates = 0.29) and reaction time (ES = −0.22), yet meta-regressions revealed that accuracy only improved in participants receiving TMS and not tDCS. Both of the abovementioned reviews did not evaluate differences across disorders. Moreover, Hill et al. (Reference Hill, Fitzgerald and Hoy2016) only selected studies that applied the N-back, Sternberg, or digit-span task, while Brunoni and Vanderhasselt (Reference Brunoni and Vanderhasselt2014) included NIBS studies specifically targeting the DLPFC and implementing the N-back task. A third review by Martin et al. (Reference Martin, McClintock, Forster and Loo2016) evaluating multiple cognitive domains reported a significant ES of 0.51 (95% CI 0.18–0.83) after pooling three rTMS studies for working memory in secondary analyses.
Interestingly, we found a significant moderator effect of age for TMS on working memory, indicating that the potential procognitive effect of TMS is larger at a higher age. A possible explanation for this finding could be that the skull thickness decreases over age, making it easier to stimulate the cortex underneath due to a shorter distance of the cortex from the coil. However, this finding is not supported by conventional theories emphasizing that the distance between the cortex and the coil increases with age due to brain atrophy, negatively affecting TMS efficacy (McConnell et al., Reference Mcconnell, Nahas, Shastri, Lorberbaum, Kozel, Bohning and George2001). Also, there might be more potential for cognitive improvement in an older population as younger patients may show ceiling effects in cognitive functioning (Lillie, Urban, Lynch, Weaver, & Stitzel, Reference Lillie, Urban, Lynch, Weaver and Stitzel2016; Schulte-Geers et al., Reference Schulte-Geers, Obert, Schilling, Harth, Traupe, Gizewski and Verhoff2011). Although we found no differences in effect between disorders, the effect of age might be an indirect reflection of subtle differences in treatment effect between disorders. Where dementia and PD usually strike at a high age, schizophrenia and MS overall affect a relatively young population. Furthermore, the diseases with late age of onset generally have more detrimental effects on cognition. More research is needed to gain more insight into the potential associations between TMS efficacy and age and potential ceiling effects to explain this unexpected effect.
One of the possible mechanisms behind the positive effects of NIBS on working memory and of tDCS on attention/vigilance may include an increase in dopamine release. Recently, Fonteneau et al. (Reference Fonteneau, Redoute, Haesebaert, Le Bars, Costes, Suaud-Chagny and Brunelin2018) have demonstrated that a single session of bifrontal tDCS induced dopamine release in the ventral striatum in healthy individuals (n = 32). Striatal dopamine function not only links to neural efficiency of the (dorsolateral) striatum but also of the prefrontal cortex and associated higher-order cognitive functioning, including attention switching and working memory updating (Cools, Reference Cools2011; Landau, Lal, O'Neil, Baker, & Jagust, Reference Landau, Lal, O'Neil, Baker and Jagust2009; Stelzel, Basten, Montag, Reuter, & Fiebach, Reference Stelzel, Basten, Montag, Reuter and Fiebach2010). For the five other cognitive domains investigated in the present meta-analysis, we did not find any procognitive effects of either TMS or tDCS. It is possible that these domains rely more on subcortical, cerebellar, medial, and fusiform areas, being not directly accessible using NIBS techniques (Demirtas-Tatlidede, Vahabzadeh-Hagh, & Pascual-Leone, Reference Demirtas-Tatlidede, Vahabzadeh-Hagh and Pascual-Leone2013; Kim, Hong, Kim, & Yoon, Reference Kim, Hong, Kim and Yoon2019). It is also possible that a longer duration of stimulation or a higher stimulation frequency or intensity is required to influence these domains. Alternatively, a combination of cognitive training and NIBS may be needed to gain improvement. Although not included in the present meta-analysis, a positive effect of NIBS on global cognitive function and verbal fluency was recently demonstrated in a quantitative review on patients with mild cognitive impairment (Xu et al., Reference Xu, Qiu, Zhu, Liu, Wu, Tao and Chen2019) in addition to a small positive effect on executive function (11 RCTs, 367 patients).
Overall, we found no evidence for the effect of either TMS or tDCS to differ across brain disorders. Although TMS showed a positive effect on verbal learning for stroke only (k = 3) and tDCS on processing speed for MS (k = 1) and PD (k = 2) only, no definite conclusions could be drawn regarding the nature of these differences due to the limited number of studies that could be included for the relevant brain disorders. The existence of common shared pathophysiologic substrates regarding decreased plasticity across brain disorders has been proposed to underlie cognitive decline in different brain disorders, which may suggest that patients with different brain disorders could benefit from the same procognitive interventions (Demirtas-Tatlidede et al., Reference Demirtas-Tatlidede, Vahabzadeh-Hagh and Pascual-Leone2013; Kim et al., Reference Kim, Hong, Kim and Yoon2019), which has indeed been shown to be the case for exercise (Dauwan et al., Reference Dauwan, Begemann, Slot, Lee, Scheltens and Sommer2019; Herold, Törpel, Schega, & Müller, Reference Herold, Törpel, Schega and Müller2019).
Strengths and limitations
An important strength of this study is the inclusion of seven different cognitive domains that were analyzed separately, uncovering the differences in effects across different domains. In our opinion, this approach is relevant, as cognition is subserved by different cerebral and cerebellar circuits. Different circuits in the brain are responsible for the proper functioning of different domains, which follows that the effect of NIBS may be inconsistent across domains. This inconsistency has been reported in prior studies (Lindenmayer et al., Reference Lindenmayer, Kulsa, Sultana, Kaur, Yang, Ljuri and Khan2019; Loo et al., Reference Loo, Sachdev, Martin, Pigot, Alonzo, Malhi and Mitchell2010; Manenti et al., Reference Manenti, Cotelli, Cobelli, Gobbi, Brambilla, Rusich and Cotelli2018). Splitting up cognition into relevant separate domains elucidates effects that might be hidden when looking at global cognition.
Also, this meta-analysis provides an answer to the need for a comparison between the two most commonly used types of NIBS. The relevance of such a comparison is supported by the existing debate about which of the two is the most effective and suitable for clinical use (Brunoni & Vanderhasselt, Reference Brunoni and Vanderhasselt2014; Inukai et al., Reference Inukai, Saito, Sasaki, Tsuiki, Miyaguchi, Kojima and Onishi2016). Our meta-analysis reveals that both seem to have a profound effect on a specific and corresponding cognitive domain, namely working memory. Although tDCS also impacted attention/vigilance, the effects of both types are nonetheless absent in the other domains. While tDCS and TMS are different types of stimulation with different working mechanisms, our findings indicate that they might trigger comparable effects on cognition.
Our literature search revealed that many studies on the effect of NIBS did not primarily study its effect on cognition, but included cognitive tests as a secondary outcome of interest. Instead, prior studies have primarily focused on utilizing neuropsychological tests as a means to observe the deterioration of cognitive abilities. As a consequence, the included tests may lack sensitivity to detect cognitive improvement, and only a few studies could be included for certain analyses which affected the power of those analyses (e.g. tDCS studies for stroke and PD; tDCS and TMS studies for TBI).
Although we aimed to avoid major differences in methodology as far as possible by careful inspection of the included studies, heterogeneity is inevitably present. The precise nature of this heterogeneity can be due to numerous factors varying across participants, data sets, studies, and brain disorders. Technical factors include the type of coil, sham technique, coil positioning, and stimulation protocol (Tables 1 and 2) (Imburgio & Orr, Reference Imburgio and Orr2018; Lage et al., Reference Lage, Wiles, Shergill and Tracy2016; Woods et al., Reference Woods, Antal, Bikson, Boggio, Brunoni, Celnik and Nitsche2016). For example, as reflected in our retrieved studies (Tables 1 and 2) the DLPFC is one of the key anatomical regions that is most frequently targeted to improve cognition. However, we also found other (adjacent) regions to be stimulated across the included studies (e.g. Eliasova, Anderkova, Marecek, & Rektorova, Reference Eliasova, Anderkova, Marecek and Rektorova2014; Guse et al., Reference Guse, Falkai, Gruber, Whalley, Gibson, Hasan and Wobrock2013). Provided that the included studies had chosen an appropriate stimulation site based on the available literature, all stimulation sites were included in our meta-analysis.
Notably, a broad range of the cognitive tests were administered throughout the included studies. To avoid that the definition of cognitive domains would be arbitrary, we based our seven domains on the guidelines of the two most commonly used cognitive test batteries (Green et al., Reference Green, Nuechterlein, Gold, Barch, Cohen, Essock and Marder2004; Litvan et al., Reference Litvan, Goldman, Tröster, Schmand, Weintraub, Petersen and Emre2012). Despite this, practice effects, ceiling and/or floor effects, and test battery sensitivity may still have contributed to heterogeneity within cognitive domains. In theory, practice effects should not play a role in randomized controlled designs, being present in both active and sham treatment groups, but with small sample sizes such effects may not cancel out. We do note that positive effects as quantified by cognitive tests may not always transfer to cognitive functioning in daily life. On the other hand, meaningful changes in cognitive functioning may not always be fully quantifiable with the cognitive tasks used. Also, post-treatment cognitive testing took place right after brain stimulation and therefore the potential long-term effect of NIBS on cognition remains understudied (Cirillo et al., Reference Cirillo, Di Pino, Capone, Ranieri, Florio, Todisco and Di Lazzaro2017; Gersner, Kravetz, Feil, Pell, & Zangen, Reference Gersner, Kravetz, Feil, Pell and Zangen2011).
Conclusions
Overall, we found a small yet significant effect of both TMS and tDCS on working memory in patients with brain disorders as compared to sham treatment, tDCS also showed a superior effect on attention/vigilance. Results were not significant for the remaining cognitive domains. Findings were similar across the different brain disorders for both techniques, indicating that TMS and tDCS can only affect specific neural circuits if applied on frontal and temporal regions and hence can be applied to improve specific cognitive domains (i.e. working memory and attention/vigilance).
Supplementary material
The supplementary material for this article can be found at https://doi.org/10.1017/S0033291720003670.
Acknowledgements
The authors thank Edith van Liemburg, Fleur Verhaag, and Lieke Jorna for their assistance in retrieving relevant articles and those authors that replied to our e-mail requests for additional data or further clarification of their results. This work was supported by the Dutch Brain Foundation (Hersenstichting, number PZ 2017.01.2, 2017), received by Professor Dr Sommer and Dr Begemann.
Financial support
This work was supported by the Dutch Brain Foundation (Hersenstichting, number PZ 2017.01.2, 2017), received by Professor Dr Sommer and Dr Begemann.
Conflict of interest
The authors report no potential conflicts of interest.
Ethical standards
The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008.
Open access
