Hostname: page-component-cd9895bd7-jkksz Total loading time: 0 Render date: 2024-12-26T17:13:45.693Z Has data issue: false hasContentIssue false

Augmentation strategies for clozapine resistance: a systematic review and meta-analysis

Published online by Cambridge University Press:  16 November 2022

Sandeep Grover*
Affiliation:
Department of Psychiatry, Post Graduate Institute of Medical Education and Research, Chandigarh, India
Siddharth Sarkar
Affiliation:
Department of Psychiatry, All India Institute of Medical Sciences, New Delhi, India
Swapnajeet Sahoo
Affiliation:
Department of Psychiatry, Post Graduate Institute of Medical Education and Research, Chandigarh, India
*
Author for correspondence: Sandeep Grover, Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Background:

Several augmentation strategies have been used to improve symptomatology in patients not adequately responding to clozapine. Several randomised controlled trials (RCTs) have evaluated the efficacy of different strategies to augment clozapine. This systematic review and meta-analysis reviewed the available RCTs that have evaluated the clinical efficacy of various pharmacological agents, non-pharmacological strategies (occupational therapy, cognitive behaviour therapy), and somatic treatment [electroconvulsive therapy (ECT), repetitive transcranial magnetic stimulation, etc.)] as augmenting agents to clozapine.

Methods:

Data were extracted using standard procedures, and risk of bias was evaluated. Effect sizes were computed for the individual studies.

Results:

Forty-five clinical trials were evaluated. The pooled effect size for various antipsychotic medications was 0.103 (95% CI: 0.288–0.493, p < 0.001); when the effect size was evaluated for specific antipsychotics for which more than one trial was available, the effect size for risperidone was −0.27 and that for aripiprazole was 0.57. The effect size for lamotrigine was 0.145, and that for topiramate was 0.392. The effect size for ECT was 0.743 (CI: 0.094–1.392). Risk of bias was low (mean Jadad score – 3.93). Largest effect sizes were seen for mirtazapine (effect size of 5.265). Most of the studies can be considered underpowered and limited by small sample sizes.

Conclusions:

To conclude, based on the findings of the present systematic review and meta-analysis, it can be said that compared to other treatment strategies, clozapine non-responsive patients respond maximum to mirtazapine followed by ECT.

Type
Review Article
Copyright
© The Author(s), 2022. Published by Cambridge University Press on behalf of Scandinavian College of Neuropsychopharmacology

Summation

  • The available evidence suggests that electroconvulsive therapy is one of the most efficacious treatment strategies, in terms of augmentation of clozapine in patients with schizophrenia.

  • In terms of augmentation with antipsychotics, available evidence suggests aripiprazole be superior to other antipsychotic agents.

  • Evidence for augmentation with other agents is limited.

Considerations

  • There are limited numbers of studies that have evaluated the efficacy of various treatment strategies in patients with schizophrenia responding poorly to clozapine.

  • Most of the studies were considered underpowered and limited by small sample sizes.

  • There is a need to expand the data by designing better quality studies.

Introduction

About 30% of patients with schizophrenia fulfil the criteria of treatment-resistant schizophrenia (TRS) (i.e., fail to respond to two adequate trials of antipsychotics) (Souza et al., Reference Souza, Kayo, Neto, Elkis and Buckley2010; Porcelli et al., Reference Porcelli, Balzarro and Serretti2012). For patients with TRS, clozapine is considered the mainstay of treatment (Šagud, Reference Šagud2015; Leung et al., Reference Leung, Gadelrab, Ntephe, McGuire and Demjaha2019). Evaluation of data of patients with TRS suggests that 30–70% of patients fail to respond to clozapine (Taylor et al., Reference Taylor, Shapland, Laverick, Bond and Munro2000; De Berardis et al., Reference De Berardis, Fornaro, Anastasia, Vellante, Valchera, Cavuto, Perna, Di Nicola, Serafini, Carano, Pompili, Orsolini, Tomasetti, Di Emidio, Martinotti, Di Giannantonio and Kim2019; Roerig, Reference Roerig2019; Kudva & Gupta, Reference Kudva and Gupta2016). This sub-group of patients are termed ‘clozapine non-responders’ or ‘clozapine-resistant’ (Souza et al., Reference Souza, Kayo, Neto, Elkis and Buckley2010; Barber et al., Reference Barber, Olotu, Corsi and Cipriani2017) or having ‘ultra-resistant’ schizophrenia (Porcelli et al., Reference Porcelli, Balzarro and Serretti2012; Elkis and Meltzer, Reference Elkis and Meltzer2007). These patients are challenging to manage and often lead to frustration among the clinicians. Although the available treatment guidelines suggest multiple treatment options for this sub-group of patients, the evidence for various suggested options is meagre.

The treatment strategies which have been evaluated for this group of patients include augmentation of clozapine with a second antipsychotic medication, mood stabiliser, antidepressant, other groups of medications such as memantine and glycine, electroconvulsive therapy (ECT), repetitive transcranial magnetic stimulation (rTMS), transcranial direct current stimulation (tDCS), Occupational therapy, and cognitive behaviour therapy (CBT) (Grover & Sahoo, Reference Grover and Sahoo2019). A few reviews have also evaluated the data for the use of these treatments in clozapine non-responders (Barber et al., Reference Barber, Olotu, Corsi and Cipriani2017; Buchanan et al., Reference Buchanan, Kreyenbuhl, Kelly, Noel, Boggs, Fischer, Himelhoch, Fang, Peterson, Aquino and Keller2010; Wang et al., Reference Wang, Zheng, Li, Wang, Cai, Yang, Ungvari, Xiang and Correll2018; Barbui et al., Reference Barbui, Signoretti, Mulè, Boso and Cipriani2009; Wagner et al., Reference Wagner, Löhrs, Siskind, Honer, Falkai and Hasan2019). There are specific studies on intervention modalities like antiepileptic drugs and second-generation antipsychotics (Zheng et al., Reference Zheng, Xiang, Yang, Xiang and de Leon2017; Bartoli et al., Reference Bartoli, Crocamo, Di Brita, Esposito, Tabacchi, Verrengia, Clerici and Carrà2019). The most recent meta-analysis on the topic was published in 2019 (Wagner et al., Reference Wagner, Löhrs, Siskind, Honer, Falkai and Hasan2019). In a recent literature review, authors reported the identification of 21 reviews and meta-analyses, which have evaluated the evidence for clozapine augmentation or combination strategies. This review showed that the maximum number of trials included in any meta-analysis was 46 in numbers (Siskind et al., Reference Siskind, Lee, Ravindran, Zhang, Ma, Motamarri and Kisely2018). One of the meta-reviews reviewed the data from 21 reviews and meta-analyses by using the Scottish Intercollegiate Guidelines Network (SIGN) criteria to grade the available evidence to the four different levels and concluded that none of the treatment strategies met the grade A criteria (Wagner et al., Reference Wagner, Löhrs, Siskind, Honer, Falkai and Hasan2019; Harbour & Miller, Reference Harbour and Miller2001). However, the combination of clozapine with first- or second-generation antipsychotics, augmentation of clozapine with ECT for persistent positive symptoms, and use of clozapine with certain antidepressants (fluoxetine, duloxetine, citalopram) for persistent negative symptoms were reported to have grade B level evidence (Wagner et al., Reference Wagner, Löhrs, Siskind, Honer, Falkai and Hasan2019; Harbour & Miller, Reference Harbour and Miller2001). The evidence for augmentation of clozapine with lithium and anticonvulsants, glutamatergic agents, rTMS, tDCS, or CBT met grades C–D criteria only. Many of the previous meta-analyses and reviews have not addressed the risk of bias adequately, and all of these have not included studies evaluating the efficacy of non-pharmacological measures like CBT and occupational therapy in the meta-analysis. It is important that evidence-based approach for different augmentation strategies, the quality of evidence for each specific strategy needs to be analysed thoroughly, and the risk of bias needs to be documented separately. In this background, this systematic review and meta-analysis aimed to assess the evidence for augmentation of clozapine with various strategies and to assess the risk of bias in randomised controlled trials (RCTs) in patients not showing adequate response to clozapine.

Methods

Search strategy

For the identification of relevant literature, electronic searches were done using Google Scholar, PubMed and Science Direct, and Scopus databases. The keywords included clozapine, augment*, resistan*, non-respon*, schizophrenia, psychosis, clozapine resistant, and clozapine refractory in various permutations and combinations. Initially, the word ‘clozapine’ was combined with each of these terms (e.g., augment*), and then the terms were substituted one after the other, with clozapine remaining as a search term. In the later searches, permutations and combinations of more than two words were used. The searches were carried out in April 2022. Additional literature was identified from the cross-references and through hand searches.

Selection of studies

Placebo-controlled RCTs published in English-language peer-reviewed journals that evaluated the efficacy/effectiveness of interventions in patients with clozapine resistance were included. The studies which did not present separate data for intervention were excluded. Similarly, studies for which effect sizes could not be computed with the available data were also excluded.

Data extraction

Abstracts of the identified studies were sifted through and the full texts of the papers were obtained. The extracted data were coded independently by two investigators (SS and SS). Information pertaining to study characteristics, demographic characteristics, and clinical details was extracted. Discrepancies between the investigators were resolved after a mutual discussion, involving the third author (SG) and a re-evaluation of the published paper.

Risk of bias

The Jadad scale (Jadad et al., Reference Jadad, Moore, Carroll, Jenkinson, Reynolds, Gavaghan and McQuay1996), which has good validity and reliability (Clark et al., Reference Clark, Wells, Huët, McAlister, Salmi, Fergusson and Laupacis1999), is a five-point scale for assessing the quality of RCTs and was used to quantify the risk of bias. The rating is done based on reporting of randomisation, blinding, and reporting of withdrawals and drop-outs.

Statistical analysis

Effect sizes and 95% confidence intervals (CI) for the efficacy of the intervention were determined. If any study reported more than one outcome measure, then the primary outcome measure or the measure considered to be most clinically relevant was used to calculate effect size. If any study did not explicitly mention a primary efficacy variable, then the proportion of patient’s improved or the improvement in the positive psychotic symptoms was taken for computation of effect sizes. Hedges g test, which gives a robust measure for both categorical and continuous data, was used to calculate effect sizes. The logit method was used for determining the effect size and confidence intervals for the dichotomous variables.

The obtained effect sizes were entered into OpenMetaAnalyst software for the computation of standardised mean differences. Random effects models were used due to the heterogeneity of studies. The standardised mean differences and effect sizes were computed for each of the following categories of interventions: antipsychotics, antidepressants, mood stabilisers and anticonvulsants, memantine, amino acids and alternate treatments, ECT, rTMS, and other interventions. For assessing the heterogeneity, I2 test was used. Forest plots were constructed to represent the studies graphically.

Results

Initial search of the literature showed 6271 studies. Abstracts of all these studies were screened for eligibility and 60 abstracts were considered to be relevant. We excluded the articles which reported findings of the meta-analysis, open-label studies, retrospective studies, review articles, treatment guidelines, on-going clinical trials/ study protocols, non-placebo-controlled comparative studies, articles published in languages other than English, case series, case reports, and those articles for which full texts were not available. An attempt was made to assess the full text of all these studies. Unfortunately, we could not access the full texts of six of the articles involving valproate augmentation. Of the remaining 54 studies, 9 could not be included, as the data were insufficient to calculate the effect sizes. After excluding all these studies, we were left with 45 placebo-controlled RCTs included in the meta-analysis.

Antipsychotics

The antipsychotics that have been commonly evaluated as the augmenting agent to clozapine include risperidone, aripiprazole, haloperidol, sulpiride, and ziprasidone, with the maximum number of studies on risperidone (Table 1 and Supplementary Figure 1). The sample sizes across different studies ranged from 6 to 207, and the duration of trials ranged from 8 weeks to 24 weeks. The most commonly used primary outcome measure in these trials was Brief Psychiatric Rating Scale (BPRS) or Positive and Negative Syndrome Scale (PANSS). When the meta-analysis of these trials was carried out, it was seen that overall antipsychotics were not more effective than placebo (standardized mean difference = 0.103, 95% CI −0.288 to 0.493, p < 0.001, I2 = 85%). This was mainly due to negative findings from one of the studies on risperidone. The pooled effect size for the five risperidone trials was −0.274 (95% CI −1.261 to 0.714, I2 = 91%). Similarly, the pooled effect size for the three aripiprazole trials was 0.574 (95% CI from 0.112 to 1.037, I2 = 67%).

Table 1. Trials of antipsychotic augmentation of clozapine

BPRS: Brief Psychiatric Rating Scale; PANSS: Positive and Negative Syndrome Scale; Ris: Risperidone; Ami: Amisulpride; Sul: Sulpiride; Pim: Pimozide; Ser: Sertindole; Arip: Aripiprazole; H: Haloperidol; Zip: Ziprasidone; M: Males; F: Females.

Mood stabilisers

In terms of mood stabilisers, studies have evaluated lamotrigine, topiramate, and valproate as the augmenting agents in the descending order of frequency (Table 2 and Supplement Figure 2). Outcome measures used in these studies were PANSS and clinician-rated improvement status. The sample sizes in these studies have ranged from 4 to 80, and the duration of trials varied from 10 to 24 weeks. Overall, when compared to placebo, the mood stabilisers and anticonvulsants were found to be more effective (standardized mean difference = 0.265, 95% CI 0.016–0.515, p = 0.194, I2 = 28%). The pooled effect size for lamotrigine was 0.145 (95% CI −0.154 to 0.445, I2 = 0%), and that for topiramate was 0.392 (95% CI −0.045 to 0.830, I2 = 56%).

Table 2. Trials of mood stabiliser and anticonvulsant augmentation of clozapine

PANSS: Positive and Negative Syndrome Scale; PANSS-P: Positive symptom subscale of PANSS; T: Topiramate; Lamo: Lamotrigine.

Antidepressants

In terms of antidepressants, only three RCTs have evaluated antidepressants for augmentation of clozapine (Supplement Table 1, Supplement Figure 3). While one study with mirtazapine and another with duloxetine showed significant improvement in BPRS and PANSS scores, respectively, another study evaluated fluoxetine and did not find a significant change in BPRS positive symptoms score. Overall, antidepressants were found to be conclusively better than placebo (standardized mean difference = 2.062, 95% CI 0.187–3.938, p < 0.001, I2 = 92.1%). However, it must be remembered that the analysis was limited to only three studies. Among the antidepressant, largest effect size was seen for mirtazapine.

Other agents

Few studies have evaluated memantine, amino acids, and alternate treatments for the augmentation of clozapine (Table 3 and Supplementary Figure 4). Memantine and glycine were evaluated in two trials, while D-cycloserine, D-serine, sarcosine, ampakine CX516, and ginkgo biloba were evaluated by one study each. The sample sizes for these studies ranged from 16 to 52, and the duration of the trials ranged from 4 weeks to 13 weeks. PANSS, BPRS, and Scale for Assessment of Negative Symptoms (SANS) were used to evaluate the outcome. These interventions were not seen to be conclusively effective (standardized mean difference = 0.378, 95% CI −0.027 to 0.784, p = 0.006, I2 = 57%). The two studies of memantine had a pooled effect size of 0.948 (95% CI −1.689 to 3.584, I2 = 94%), while the three studies of glycine had an effect size of 0.118 (95% CI −0.399 to 0.635, I2 = 0%).

Table 3. Trials of memantine, amino acids, and alternate treatments for augmentation of clozapine

BPRS: Brief Psychiatric Rating Scale; PANSS: Positive and Negative Syndrome Scale; PANSS-P: Positive symptom subscale of PANSS; SANS: Scale for the assessment of negative symptoms; Mem: Memantine; Sar: Sarcosine; Ser: D-Serine; Gly: Glycine, G: Gingko Biloba; Mod: Modafinil; Mino: Minocycline; M: Males; F: Females.

Somatic and psychosocial treatments

Some RCTs have evaluated ECT, rTMS, occupational therapy, and CBT (Table 4 and Supplementary Figure 5). The duration of these interventions has ranged from 10 days (for rTMS) to 6 months (for occupational therapy). Two studies used BPRS, two used PANSS, and the occupational therapy trial used the Scale for Interactive Observation in Occupational Therapy as the outcome measure. Among these RCTs, trials evaluating ECT, one out of two studies of rTMS, and trials of occupation therapy and CBT showed that these active interventions were more effective than the control conditions. Overall, these interventions were seen to be effective (standardized mean difference = 0.781, 95% CI 0.401–1.161, p = 0.581, I2 = 0%).

Table 4. Trials of other interventions for augmentation of clozapine

OT: occupational therapy; CBT: cognitive behaviour therapy; BPRS: Brief Psychiatric Rating Scale; PANSS: Positive and Negative Syndrome Scale; EOITO: Scale for Interactive Observation in Occupational Therapy; BF: Befriending; M: Males; F: Females; TAU: treatment as usual.

The various specific interventions are presented in Supplementary Figure 6 which shows the sub-group analysis which suggests that sulpiride, ziprasidone, mirtazapine, D-cycloserine, ampakine X516, ECT, occupation therapy, and CBT are effective (the confidence intervals did not span zero) augmentation strategies in patients not responding to clozapine.

Exploratory analyses were conducted to see whether there was an effect of the study duration, sample size, or outcome measure on the efficacy. The sample size (tau = 0.212, p = 0.041) had some relationship with the effect size (i.e. larger studies tended to have smaller effect size, implying the possibility of file drawer effect). The type of outcome measure (coded into BPRS, PANSS, and others) did not relate to the effect sizes.

Funnel plot of all included studies

The Egger test of asymmetry of all the studies suggested no significant evidence of publication bias (B = 0.569, p = 0.209) (Supplementary Figure 7). The visual inspection of the studies does suggest the possibility of publication bias.

Risk of bias

When the risk of bias was evaluated by using Jadad score, the scores ranged from 1 to 5 with a median of 4 (mean of 3.93, mode 5) (Supplementary Table 2). Only six studies had Jadad score of less than 3 and none had a score of 0. The maximum number of studies had used intention to treat analysis, while 15 studies (n = 15) had not relied on such statistical procedures or had not mentioned using statistical methods to estimate intention to treat (Muscatello et al., Reference Muscatello, Bruno, Pandolfo, Micò, Bellinghieri, Scimeca, Cacciola, Campolo, Settineri and Zoccali2011a; Mossaheb et al., Reference Mossaheb, Sacher, Wiesegger, Klein, Spindelegger, Asenbaum, Dudczak and Kasper2006; Zoccali et al., Reference Zoccali, Muscatello, Bruno, Cambria, Micò, Spina and Meduri2007; Vayısoğlu et al., Reference Vayısoğlu, Anıl Yağcıoğlu, Yağcıoğlu, Karahan, Karcı, Gürel and Yazıcı2013; Muscatello et al., Reference Muscatello, Bruno, Pandolfo, Micò, Scimeca, Di Nardo, Santoro, Spina and Zoccali2011b; Behdani et al., Reference Behdani, Hebrani, Rezaei Ardani and Rafee2011; Tiihonen et al., Reference Tiihonen, Halonen, Wahlbeck, Repo-Tiihonen, Hyvärinen, Eronen, Putkonen, Takala, Mehtonen, Puck, Oksanen, Koskelainen, Joffe, Aer, Hallikainen, Ryynänen and Tupala2005; Buchanan et al., Reference Buchanan, Kirkpatrick, Bryant, Ball and Breier1996; Zoccali et al., Reference Zoccali, Muscatello, Cedro, Neri, La Torre, Spina, Di Rosa and Meduri2004; Veerman et al., Reference Veerman, Schulte, Smith and de Haan2016; Potkin et al., Reference Potkin, Jin, Bunney, Costa and Gulasekaram1999; Evins et al., Reference Evins, Fitzgerald, Wine, Rosselli and Goff2000; Diaz et al., Reference Diaz, Bhaskara, Dursun and Deakin2005; Goff et al., Reference Goff, Leahy, Berman, Posever, Herz, Leon, Johnson and Lynch2001; Dean et al., Reference Dean, Mancuso, Bush, Copolov, Do, Cuénod, Conus, Rossell, Castle and Berk2015).When the association of the year of publication and risk of bias (measured with Jadad scale) were evaluated, a statistically significant correlation (Kendall tau correlation of 0.312, P = 0.008) was seen.

Discussion

Clozapine resistance poses a major clinical challenge to clinicians. Clinicians are always on the lookout for choosing an agent that can improve the clinical outcome of the patient. This systematic review and meta-analysis suggest that there are limited numbers of RCTs that have evaluated various agents among patients with clozapine resistance. It is evident from the data that most of these studies are of small sample size, with the largest study sample being of 487. Further, the limitation of the existing literature, which must be considered while interpreting the results of this systematic review and the meta-analysis, includes inconsistency in defining clozapine resistance. The definitions have varied significantly across different studies. Hence, findings of the present meta-analysis must be construed in this background.

One of the recent meta-analyses on the same topic included 46 RCTs, with searches in both Chinese and non-Chinese databases. In contrast, the present meta-analysis was limited to studies published in English only. However, when one compares the studies included in the current meta-analysis with this meta-analysis, there is only an overlap of 26 studies. We did not include 15 studies published in the Chinese language and we did not include another study, as it did not provide information separately for clozapine (Berk, Reference Berk2014). Accordingly, the present meta-analysis provides broader details on the studies published in the English language.

When one evaluates the effect size of interventions, it is evident that the effect size for various antipsychotic medications was 0.103; however, when the effect size was evaluated for specific antipsychotics for which more than one trial was available, the effect size for risperidone was −0.274 (negative effect size primarily due to one study) (Yağcioğlu et al., Reference Yağcioğlu, Kivircik Akdede, Turgut, Tümüklü, Yazici, Alptekin, Ertuğrul, Jayathilake, Göğüş, Tunca and Meltzer2005) and that for aripiprazole was 0.574. The effect size for mood stabilisers was 0.265, with that for lamotrigine being 0.145, and that for topiramate being 0.392 (with either being not significantly better than placebo). The effect size for glycine was 0.118 and the effect size for ECT was 0.743. In general, it is suggested that effect size of 0.2 is considered to be small, 0.5 is considered to be medium, and 0.8 is considered to be large. Accordingly, it can be said that among the various interventions, the effect size is highest for mirtazapine, followed by D-cycloserine. However, it is important to note that these were based on single small sample size study. Accordingly, the findings must be interpreted in this background. The previous meta-analysis suggests that lamotrigine may be of some benefit among patients with clozapine resistance for positive symptoms and general psychopathology symptoms, but not for negative symptoms (Zheng et al., Reference Zheng, Xiang, Yang, Xiang and de Leon2017; Tiihonen et al., Reference Tiihonen, Wahlbeck and Kiviniemi2009). Present meta-analysis provides further credence to these findings. The high effect size for ECT suggests that it should be preferred in patients not responding to clozapine if there are no contraindications for ECT. However, it is important to note that this is also based on a single study, but the sample size of this study was larger than that for mirtazapine and D-cycloserine. If we attempt to evaluate the efficacy of various agents as per the SIGN criteria, findings of the present study support the conclusion of the recent review of all the available systematic reviews and meta-analysis, which suggest that ECT has evidence of grade B (Wagner et al., Reference Wagner, Löhrs, Siskind, Honer, Falkai and Hasan2019). However, our meta-analysis contradicts the assertion that the level of evidence for anticonvulsants, that is, lamotrigine, is that of grade C or D (Wagner et al., Reference Wagner, Löhrs, Siskind, Honer, Falkai and Hasan2019).

Present meta-analysis shows that the addition of a second antipsychotic may not be useful in clozapine non-responders, though certain antidepressants may help. Some of the previous meta-analyses, (Barber et al., Reference Barber, Olotu, Corsi and Cipriani2017) which have also limited themselves to RCTs, suggest that in contrast to placebo, addition of second antipsychotic medication in patient with inadequate response to clozapine does not lead to significant improvement in positive symptoms, as suggested by small effect sizes in the present study, which were non-significant too. Further, the evidence from the available meta-analyses also offers a high degree of heterogeneity with minimal or no publication bias. Present meta-analysis and systematic review support the existing literature.

Several novel antipsychotics and other approaches are likely to be used in clozapine-resistant schizophrenia in the future. rTMS has been evaluated, and possibly other neuromodulation techniques may find considered for evaluation of clozapine-resistant cases. The adjunctive therapies may include approaches to reduce distress due to psychotic symptoms. In fact, the largest study for clozapine augmentation was on CBT. Assessment of outcomes has generally been done using PANSS and BPRS scales. Uniform application of these instruments and reporting their findings is likely to help maintain comparability across studies.

Findings of the present meta-analysis are limited by the existing literature. We could not include some RCTs, especially those involving valproate, due to non-availability and some other studies due to lack of data to calculate effect sizes. We have used the Jadad criteria for the assessment of the risk of bias, while other methods like Cochrane recommendations have become more popular now. The Egger’s test may not have picked up publication bias due to low sample sizes. Additionally, we did not evaluate the inter-rater agreement during the search process.

To conclude, based on the findings of the present systematic review and meta-analysis, it can be said that ECT or antipsychotics maybe preferred over other treatment strategies, and if this is not feasible, then lamotrigine must be considered much before the use of other agents.

Fig. 1. Prisma flow diagram.

Supplementary material

To view supplementary material for this article, please visit https://doi.org/10.1017/neu.2022.30

Acknowledgements

None.

Author contributions

SG, SS, and SS contributed to the conception and design of, or acquisition of data or analysis and interpretation of data, drafting the article and revising it critically and provided final approval of the version to be published.

Financial support

None.

Conflict of interest

None.

References

Afshar, H, Roohafza, H, Mousavi, G, Golchin, S, Toghianifar, N, Sadeghi, M and Talaei, M (2009) Topiramate add-on treatment in schizophrenia: a randomised, double-blind, placebo-controlled clinical trial. Journal of Psychopharmacology (Oxford, England) 23(2), 157162.CrossRefGoogle ScholarPubMed
Barber, S, Olotu, U, Corsi, M and Cipriani, A (2017) Clozapine combined with different antipsychotic drugs for treatment-resistant schizophrenia. The Cochrane Database of Systematic Reviews 3(3), CD006324.Google ScholarPubMed
Barbui, C, Signoretti, A, Mulè, S, Boso, M and Cipriani, A (2009) Does the addition of a second antipsychotic drug improve clozapine treatment? Schizophrenia Bulletin 35(2), 458468.CrossRefGoogle ScholarPubMed
Barnes, TR, Leeson, VC, Paton, C, Marston, L, Davies, L, Whittaker, W, Osborn, D, Kumar, R, Keown, P, Zafar, R, Iqbal, K, Singh, V, Fridrich, P, Fitzgerald, Z, Bagalkote, H, Haddad, PM, Husni, M and Amos, T (2017) Amisulpride augmentation in clozapine-unresponsive schizophrenia (AMICUS): a double-blind, placebo-controlled, randomised trial of clinical effectiveness and cost-effectiveness. Health Technology Assessment (Winchester, England) 21(49), 156.CrossRefGoogle ScholarPubMed
Barretto, EMP, Kayo, M, Avrichir, BS, Sa, AR, Camargo, MGM, Napolitano, IC, Nery, FG, Pinto, JA, Bannwart, S, Scemes, S, Di Sarno, E and Elkis, H (2009) A preliminary controlled trial of cognitive behavioral therapy in clozapine-resistant schizophrenia. The Journal of Nervous and Mental Disease 197(11), 865868.CrossRefGoogle ScholarPubMed
Bartoli, F, Crocamo, C, Di Brita, C, Esposito, G, Tabacchi, TI, Verrengia, E, Clerici, M and Carrà, G (2019) Adjunctive second-generation antipsychotics for specific symptom domains of schizophrenia resistant to clozapine: a meta-analysis. Journal of Psychiatric Research 108, 2433.CrossRefGoogle ScholarPubMed
Behdani, F, Hebrani, P, Rezaei Ardani, A and Rafee, E (2011) Effect of topiramate augmentation in chronic schizophrenia: a placebo-controlled trial. Archives of Iranian Medicine 14(4), 270275.Google ScholarPubMed
Berk, M (2014) Navigating therapeutic waters with a faulty diagnostic compass. Australian and New Zealand Journal of Psychiatry 48(12), 10751076.CrossRefGoogle ScholarPubMed
Buchain, PC, Vizzotto, ADB, Henna Neto, J and Elkis, H (2003) Randomized controlled trial of occupational therapy in patients with treatment-resistant schizophrenia. Revista Brasileira De Psiquiatria (Sao Paulo, Brazil: 1999) 25(1), 2630.CrossRefGoogle ScholarPubMed
Buchanan, RW, Kirkpatrick, B, Bryant, N, Ball, P and Breier, A (1996) Fluoxetine augmentation of clozapine treatment in patients with schizophrenia. The American Journal of Psychiatry 153(12), 16251627.Google ScholarPubMed
Buchanan, RW, Kreyenbuhl, J, Kelly, DL, Noel, JM, Boggs, DL, Fischer, BA, Himelhoch, S, Fang, B, Peterson, E, Aquino, PR, Keller, W and Schizophrenia Patient Outcomes Research Team (PORT) (2010) The 2009 schizophrenia PORT psychopharmacological treatment recommendations and summary statements. Schizophrenia Bulletin 36(1), 7193.CrossRefGoogle ScholarPubMed
Chang, JS, Ahn, YM, Park, HJ, Lee, KY, Kim, SH, Kang, UG and Kim, YS (2008) Aripiprazole augmentation in clozapine-treated patients with refractory schizophrenia: an 8-week, randomized, double-blind, placebo-controlled trial. The Journal of Clinical Psychiatry 69(5), 720731.CrossRefGoogle ScholarPubMed
Clark, HD, Wells, GA, Huët, C, McAlister, FA, Salmi, LR, Fergusson, D and Laupacis, A (1999) Assessing the quality of randomized trials: reliability of the Jadad scale. Controlled Clinical Trials 20(5), 448452.CrossRefGoogle ScholarPubMed
De Berardis, D, Fornaro, M, Anastasia, A, Vellante, F, Valchera, A, Cavuto, M, Perna, G, Di Nicola, M, Serafini, G, Carano, A, Pompili, M, Orsolini, L, Tomasetti, C, Di Emidio, G, Martinotti, G and Di Giannantonio, M (2019) When clozapine fails: augmentation strategies in the management of clozapine-resistant schizophrenia. In Kim, Y-K (ed), Treatment Resistance in Psychiatry: Risk Factors, Biology, and Management. Singapore: Springer, pp. 349367. doi: 10.1007/978-981-10-4358-1_23.CrossRefGoogle Scholar
de Jesus, DR, Gil, A, Barbosa, L, Lobato, MI, Magalhães, PVS, Favalli, GPS, Marcolin, MA, Daskalakis, ZJ and Belmonte-de-Abreu, PS (2011) A pilot double-blind sham-controlled trial of repetitive transcranial magnetic stimulation for patients with refractory schizophrenia treated with clozapine. Psychiatry Research 188(2), 203207.CrossRefGoogle ScholarPubMed
de Lucena, D, Fernandes, BS, Berk, M, Dodd, S, Medeiros, DW, Pedrini, M, Kunz, M, Gomes, FA, Giglio, LF, Lobato, MI, Belmonte-de-Abreu, PS and Gama, CS (2009) Improvement of negative and positive symptoms in treatment-refractory schizophrenia: a double-blind, randomized, placebo-controlled trial with memantine as add-on therapy to clozapine. The Journal of Clinical Psychiatry 70(10), 14161423.CrossRefGoogle ScholarPubMed
Dean, OM, Mancuso, SG, Bush, AI, Copolov, D, Do, KQ, Cuénod, M, Conus, P, Rossell, SL, Castle, DJ and Berk, M (2015) Benefits of adjunctive N-acetylcysteine in a sub-group of clozapine-treated individuals diagnosed with schizophrenia. Psychiatry Research 230(3), 982983.CrossRefGoogle Scholar
Diaz, P, Bhaskara, S, Dursun, SM and Deakin, B (2005) Double-blind, placebo-controlled, crossover trial of clozapine plus glycine in refractory schizophrenia negative results. Journal of Clinical Psychopharmacology 25(3), 277278.CrossRefGoogle ScholarPubMed
Doruk, A, Uzun, O and Ozşahin, A (2008) A placebo-controlled study of extract of ginkgo biloba added to clozapine in patients with treatment-resistant schizophrenia. International Clinical Psychopharmacology 23(4), 223227.CrossRefGoogle ScholarPubMed
Elkis, H and Meltzer, HY (2007) Refractory schizophrenia. Brazilian Journal of Psychiatry 29(suppl 2), S41S47.CrossRefGoogle ScholarPubMed
Evins, AE, Fitzgerald, SM, Wine, L, Rosselli, R and Goff, DC (2000) Placebo-controlled trial of glycine added to clozapine in schizophrenia. The American Journal of Psychiatry 157(5), 826828.CrossRefGoogle ScholarPubMed
Fleischhacker, WW, Heikkinen, ME, Olié, J-P, Landsberg, W, Dewaele, P, McQuade, RD, Loze, J-Y, Hennicken, D and Kerselaers, W (2010) Effects of adjunctive treatment with aripiprazole on body weight and clinical efficacy in schizophrenia patients treated with clozapine: a randomized, double-blind, placebo-controlled trial. The International Journal of Neuropsychopharmacology 13(8), 11151125.CrossRefGoogle ScholarPubMed
Freudenreich, O, Henderson, DC, Macklin, EA, Evins, AE, Fan, X, Cather, C, Walsh, JP and Goff, DC (2009) Modafinil for clozapine-treated schizophrenia patients: a double-blind, placebo-controlled pilot trial. The Journal of Clinical Psychiatry 70(12), 16741680.CrossRefGoogle ScholarPubMed
Freudenreich, O, Henderson, DC, Walsh, JP, Culhane, MA and Goff, DC (2007) Risperidone augmentation for schizophrenia partially responsive to clozapine: a double-blind, placebo-controlled trial. Schizophrenia Research 92(1), 9094.CrossRefGoogle ScholarPubMed
Friedman, JI, Lindenmayer, J-P, Alcantara, F, Bowler, S, Parak, M, White, L, Iskander, A, Parrella, M, Adler, DN, Tsopelas, ND, Tsai, W-Y, Novakovick, V, Harvey, PD and Davis, KL (2011) Pimozide augmentation of clozapine inpatients with schizophrenia and schizoaffective disorder unresponsive to clozapine monotherapy. Neuropsychopharmacology 36(6), 12891295.CrossRefGoogle ScholarPubMed
Goff, DC, Henderson, DC, Evins, AE and Amico, E (1999) A placebo-controlled crossover trial of D-cycloserine added to clozapine in patients with schizophrenia. Biological Psychiatry 45(4), 512514.CrossRefGoogle ScholarPubMed
Goff, DC, Keefe, R, Citrome, L, Davy, K, Krystal, JH, Large, C, Thompson, TR, Volavka, J and Webster, EL (2007) Lamotrigine as add-on therapy in schizophrenia: results of 2 placebo-controlled trials. Journal of Clinical Psychopharmacology 27(6), 582589.CrossRefGoogle ScholarPubMed
Goff, DC, Leahy, L, Berman, I, Posever, T, Herz, L, Leon, AC, Johnson, SA and Lynch, G (2001) A placebo-controlled pilot study of the ampakine CX516 added to clozapine in schizophrenia. Journal of Clinical Psychopharmacology 21(5), 484487.CrossRefGoogle ScholarPubMed
Grover, S and Sahoo, S (2019) Treatment of clozapine nonresponders. Current Treatment Options in Psychiatry 6(1), 3263. doi: 10.1007/s40501-019-0166-4.CrossRefGoogle Scholar
Harbour, R and Miller, J (2001) A new system for grading recommendations in evidence based guidelines. BMJ: British Medical Journal 323(7308), 334336.CrossRefGoogle ScholarPubMed
Honer, WG, Thornton, AE, Chen, EYH, Chan, RCK, Wong, JOY, Bergmann, A, Falkai, P, Pomarol-Clotet, E, McKenna, PJ, Stip, E, Williams, R, MacEwan, GW, Wasan, K, Procyshyn, R and Clozapine and Risperidone Enhancement (CARE) Study Group (2006) Clozapine alone versus clozapine and risperidone with refractory schizophrenia. The New England Journal of Medicine 354(5), 472482.CrossRefGoogle ScholarPubMed
Jadad, AR, Moore, RA, Carroll, D, Jenkinson, C, Reynolds, DJ, Gavaghan, DJ and McQuay, HJ (1996) Assessing the quality of reports of randomized clinical trials: is blinding necessary? Controlled Clinical Trials 17(1), 112.CrossRefGoogle ScholarPubMed
Josiassen, RC, Joseph, A, Kohegyi, E, Stokes, S, Dadvand, M, Paing, WW and Shaughnessy, RA (2005) Clozapine augmented with risperidone in the treatment of schizophrenia: a randomized, double-blind, placebo-controlled trial. The American Journal of Psychiatry 162(1), 130136.CrossRefGoogle ScholarPubMed
Kelly, DL, Sullivan, KM, McEvoy, JP, McMahon, RP, Wehring, HJ, Gold, JM, Liu, F, Warfel, D, Vyas, G, Richardson, CM, Fischer, BA, Keller, WR, Koola, MM, Feldman, SM, Russ, JC, Keefe, RSE, Osing, J, Hubzin, L, August, S, Walker, TM and Buchanan, RW (2015) Adjunctive minocycline in clozapine treated schizophrenia patients with persistent symptoms. Journal of Clinical Psychopharmacology 35(4), 374381.CrossRefGoogle ScholarPubMed
Kremer, I, Vass, A, Gorelik, I, Bar, G, Blanaru, M, Javitt, DC and Heresco-Levy, U (2004) Placebo-controlled trial of lamotrigine added to conventional and atypical antipsychotics in schizophrenia. Biological Psychiatry 56(6), 441446.CrossRefGoogle ScholarPubMed
Kudva, GK and Gupta, DK (2016) Strategies in clozapine-resistant schizophrenia: a literature review. Journal of Mental Health and Human Behaviour 21(1), 6.CrossRefGoogle Scholar
Lane, H-Y, Huang, C-L, Wu, P-L, Liu, Y-C, Chang, Y-C, Lin, P-Y, Chen, P-W and Tsai, G (2006) Glycine transporter I inhibitor, N-methylglycine (sarcosine), added to clozapine for the treatment of schizophrenia. Biological Psychiatry 60(6), 645649.CrossRefGoogle ScholarPubMed
Leung, CC-Y, Gadelrab, R, Ntephe, CU, McGuire, PK and Demjaha, A (2019) Clinical course, neurobiology and therapeutic approaches to treatment resistant schizophrenia. Toward an integrated view. Frontiers in Psychiatry 10, 601.CrossRefGoogle ScholarPubMed
Morrison, AP, Pyle, M, Gumley, A, Schwannauer, M, Turkington, D, MacLennan, G, Norrie, J, Hudson, J, Bowe, SE, French, P, Byrne, R, Syrett, S, Dudley, R, McLeod, HJ, Griffiths, H, Barnes, TR E, Davies, L, Kingdon, D, Aydinlar, S, Courtley, J, Douglas-Bailey, M, Graves, E, Holden, N, Hutton, J, Hutton, P, Irving, S, Jackson, C, Lebert, T, Mander, H, McCartney, L, Munro-Clark, T, Murphy, EK, Spanswick, M, Steele, A, Tip, L and Tully, S (2018) Cognitive behavioural therapy in clozapine-resistant schizophrenia (FOCUS): an assessor-blinded, randomised controlled trial. The Lancet Psychiatry 5(8), 633643.CrossRefGoogle ScholarPubMed
Mossaheb, N, Sacher, J, Wiesegger, G, Klein, N, Spindelegger, CJ, Asenbaum, S, Dudczak, R and Kasper, S (2006) Haloperidol in combination with clozapine in treatment-refractory patients with schizophrenia. European Neuropsychopharmacology 16, S416.CrossRefGoogle Scholar
Muscatello, MRA, Bruno, A, Pandolfo, G, Micò, U, Bellinghieri, P, Scimeca, G, Cacciola, M, Campolo, D, Settineri, S and Zoccali, R (2011a) Topiramate augmentation of clozapine in schizophrenia: a double-blind, placebo-controlled study. Journal of Psychopharmacology 25(5), 667674. doi: 10.1177/0269881110372548.CrossRefGoogle ScholarPubMed
Muscatello, MRA, Bruno, A, Pandolfo, G, Micò, U, Scimeca, G, Di Nardo, F, Santoro, V, Spina, E and Zoccali, RA (2011b) Effect of aripiprazole augmentation of clozapine in schizophrenia: a double-blind, placebo-controlled study. Schizophrenia Research 127(1-3), 9399.CrossRefGoogle ScholarPubMed
Muscatello, MRA, Pandolfo, G, Micò, U, Lamberti Castronuovo, E, Abenavoli, E, Scimeca, G, Spina, E, Zoccali, R and Bruno, A (2014) Augmentation of clozapine with ziprasidone in refractory schizophrenia: a double-blind, placebo-controlled study. Journal of Clinical Psychopharmacology 34(1), 129133.CrossRefGoogle ScholarPubMed
Nielsen, J, Emborg, C, Gydesen, S, Dybbro, J, Aagaard, J, Haderup, K, Glyngdal, P, Fabricius, S, Thode, D, Lublin, H, Andersen, T, Damkier, P and Taylor, D (2012) Augmenting clozapine with sertindole: a double-blind, randomized, placebo-controlled study. Journal of Clinical Psychopharmacology 32(2), 173178.CrossRefGoogle ScholarPubMed
Petrides, G, Malur, C, Braga, RJ, Bailine, SH, Schooler, NR, Malhotra, AK, Kane, JM, Sanghani, S, Goldberg, TE, John, M and Mendelowitz, A (2015) Electroconvulsive therapy augmentation in clozapine-resistant schizophrenia: a prospective, randomized study. The American Journal of Psychiatry 172(1), 5258.CrossRefGoogle ScholarPubMed
Porcelli, S, Balzarro, B and Serretti, A (2012) Clozapine resistance: augmentation strategies. European Neuropsychopharmacology: The Journal of the European College of Neuropsychopharmacology 22(3), 165182.CrossRefGoogle ScholarPubMed
Potkin, SG, Jin, Y, Bunney, BG, Costa, J and Gulasekaram, B (1999) Effect of clozapine and adjunctive high-dose glycine in treatment-resistant schizophrenia. The American Journal of Psychiatry 156(1), 145147.CrossRefGoogle ScholarPubMed
Roerig, JL (2019) Clozapine augmentation strategies. The Mental Health Clinician 9(6), 336348.CrossRefGoogle ScholarPubMed
Rosa, MO, Gattaz, WF, Rosa, MA, Rumi, DO, Tavares, H, Myczkowski, M, Sartorelli, MC, Rigonatti, SP, Elkis, H, Cabral, SB, Teixeira, MJ and Marcolin, MA (2007) Effects of repetitive transcranial magnetic stimulation on auditory hallucinations refractory to clozapine. The Journal of Clinical Psychiatry 68(10), 15281532.CrossRefGoogle ScholarPubMed
Šagud, M (2015) Treatment-resistant schizophrenia: challenges and implications for clinical practice. Psychiatria Danubina 27(3), 319326.Google ScholarPubMed
Shiloh, R, Zemishlany, Z, Aizenberg, D, Radwan, M, Schwartz, B, Dorfman-Etrog, P, Modai, I, Khaikin, M and Weizman, A (1997) Sulpiride augmentation in people with schizophrenia partially responsive to clozapine. a double-blind, placebo-controlled study. The British Journal of Psychiatry: The Journal of Mental Science 171(6), 569573.CrossRefGoogle ScholarPubMed
Siskind, DJ, Lee, M, Ravindran, A, Zhang, Q, Ma, E, Motamarri, B and Kisely, S (2018) Augmentation strategies for clozapine refractory schizophrenia: a systematic review and meta-analysis. The Australian and New Zealand Journal of Psychiatry 52(8), 751767.CrossRefGoogle ScholarPubMed
Souza, JS, Kayo, M, Neto, JH, Elkis, H and Buckley, PF (2010) New therapeutic strategies for resistance to clozapine and treatment-resistant schizophrenia. Therapy-Resistant Schizophrenia 26, 152164.CrossRefGoogle Scholar
Taylor, D, Shapland, L, Laverick, G, Bond, J and Munro, J (2000) Clozapine – a survey of patient perceptions. Psychiatric Bulletin 24(12), 450452.CrossRefGoogle Scholar
Tiihonen, J, Hallikainen, T, Ryynänen, O-P, Repo-Tiihonen, E, Kotilainen, I, Eronen, M, Toivonen, P, Wahlbeck, K and Putkonen, A (2003) Lamotrigine in treatment-resistant schizophrenia: a randomized placebo-controlled crossover trial. Biological Psychiatry 54(11), 12411248.CrossRefGoogle ScholarPubMed
Tiihonen, J, Halonen, P, Wahlbeck, K, Repo-Tiihonen, E, Hyvärinen, S, Eronen, M, Putkonen, H, Takala, P, Mehtonen, O-P, Puck, M, Oksanen, J, Koskelainen, P, Joffe, G, Aer, J, Hallikainen, T, Ryynänen, O-P and Tupala, E (2005) Topiramate add-on in treatment-resistant schizophrenia: a randomized, double-blind, placebo-controlled, crossover trial. The Journal of Clinical Psychiatry 66(8), 10121015.CrossRefGoogle ScholarPubMed
Tiihonen, J, Wahlbeck, K and Kiviniemi, V (2009) The efficacy of lamotrigine in clozapine-resistant schizophrenia: a systematic review and meta-analysis. Schizophrenia Research 109(1-3), 1014.CrossRefGoogle ScholarPubMed
Tsai, GE, Yang, P, Chung, LC, Tsai, IC, Tsai, CW and Coyle, JT (1999) D-serine added to clozapine for the treatment of schizophrenia. The American Journal of Psychiatry 156(11), 18221825.CrossRefGoogle ScholarPubMed
Vayısoğlu, S, Anıl Yağcıoğlu, AE, Yağcıoğlu, S, Karahan, S, Karcı, O, Gürel, SC and Yazıcı, MK (2013) Lamotrigine augmentation in patients with schizophrenia who show partial response to clozapine treatment. Schizophrenia Research 143(1), 207214.CrossRefGoogle ScholarPubMed
Veerman, SRT, Schulte, PFJ, Smith, JD and de Haan, L (2016) Memantine augmentation in clozapine-refractory schizophrenia: a randomized, double-blind, placebo-controlled crossover study. Psychological Medicine 46(9), 19091921.CrossRefGoogle ScholarPubMed
Wagner, E, Löhrs, L, Siskind, D, Honer, WG, Falkai, P and Hasan, A (2019) Clozapine augmentation strategies - a systematic meta-review of available evidence. Treatment options for clozapine resistance. Journal of Psychopharmacology (Oxford, England) 33(4), 423435.CrossRefGoogle ScholarPubMed
Wang, G, Zheng, W, Li, X-B, Wang, S-B, Cai, D-B, Yang, X-H, Ungvari, GS, Xiang, Y-T and Correll, CU (2018) ECT augmentation of clozapine for clozapine-resistant schizophrenia: a meta-analysis of randomized controlled trials. Journal of Psychiatric Research 105, 2332.CrossRefGoogle ScholarPubMed
Weiner, E, Conley, RR, Ball, MP, Feldman, S, Gold, JM, Kelly, DL, Wonodi, I, McMahon, RP and Buchanan, RW (2010) Adjunctive risperidone for partially responsive people with schizophrenia treated with clozapine. Neuropsychopharmacology 35(11), 22742283.CrossRefGoogle ScholarPubMed
Yağcioğlu, AEA, Kivircik Akdede, BB, Turgut, TI, Tümüklü, M, Yazici, MK, Alptekin, K, Ertuğrul, A, Jayathilake, K, Göğüş, A, Tunca, Z and Meltzer, HY (2005) A double-blind controlled study of adjunctive treatment with risperidone in schizophrenic patients partially responsive to clozapine: efficacy and safety. The Journal of Clinical Psychiatry 66(1), 6372.CrossRefGoogle Scholar
Zheng, W, Xiang, Y-T, Yang, X-H, Xiang, Y-Q and de Leon, J (2017) Clozapine augmentation with antiepileptic drugs for treatment-resistant schizophrenia: a meta-analysis of randomized controlled trials. The Journal of Clinical Psychiatry 78(5), e498e505.CrossRefGoogle ScholarPubMed
Zoccali, R, Muscatello, MR, Bruno, A, Cambria, R, Micò, U, Spina, E and Meduri, M (2007) The effect of lamotrigine augmentation of clozapine in a sample of treatment-resistant schizophrenic patients: a double-blind, placebo-controlled study. Schizophrenia Research 93(1-3), 109116.CrossRefGoogle Scholar
Zoccali, R, Muscatello, MR, Cedro, C, Neri, P, La Torre, D, Spina, E, Di Rosa, AE and Meduri, M (2004) The effect of mirtazapine augmentation of clozapine in the treatment of negative symptoms of schizophrenia: a double-blind, placebo-controlled study. International Clinical Psychopharmacology 19(2), 7176.CrossRefGoogle ScholarPubMed
Figure 0

Table 1. Trials of antipsychotic augmentation of clozapine

Figure 1

Table 2. Trials of mood stabiliser and anticonvulsant augmentation of clozapine

Figure 2

Table 3. Trials of memantine, amino acids, and alternate treatments for augmentation of clozapine

Figure 3

Table 4. Trials of other interventions for augmentation of clozapine

Figure 4

Fig. 1. Prisma flow diagram.

Supplementary material: File

Grover et al. supplementary material

Tables S1-S2 and Figures S1-S7

Download Grover et al. supplementary material(File)
File 315.5 KB