Hostname: page-component-586b7cd67f-dsjbd Total loading time: 0 Render date: 2024-11-30T15:47:06.576Z Has data issue: false hasContentIssue false

Digital interventions for common mental disorders in low- and middle-income countries: A systematic review and meta-analysis

Published online by Cambridge University Press:  15 September 2023

Eirini Karyotaki*
Affiliation:
Department of Clinical, Neuro-, and Developmental Psychology, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands WHO Collaborating Centre for Research and Dissemination of Psychological Interventions, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
Clara Miguel
Affiliation:
Department of Clinical, Neuro-, and Developmental Psychology, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands WHO Collaborating Centre for Research and Dissemination of Psychological Interventions, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
Olga M. Panagiotopoulou
Affiliation:
Department of Clinical, Neuro-, and Developmental Psychology, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands WHO Collaborating Centre for Research and Dissemination of Psychological Interventions, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
Mathias Harrer
Affiliation:
Psychology & Digital Mental Health Care, Department of Health Sciences, Technical University Munich, Munich, Germany Department of Clinical Psychology & Psychotherapy, Friedrich-Alexander-University Erlangen-Nuremberg, Erlangen, Germany
Nadine Seward
Affiliation:
Center for Global Mental Health and Primary Care Research, Health Service and Population Research, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
Marit Sijbrandij
Affiliation:
Department of Clinical, Neuro-, and Developmental Psychology, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands WHO Collaborating Centre for Research and Dissemination of Psychological Interventions, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
Ricardo Araya
Affiliation:
Center for Global Mental Health and Primary Care Research, Health Service and Population Research, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
Vikram Patel
Affiliation:
Department of Global Health and Social Medicine, Harvard Medical School, Boston, MA, USA Department of Global Health and Population, Harvard T.H. Chan School of Public Health, Harvard University, Boston, MA, USA
Pim Cuijpers
Affiliation:
Department of Clinical, Neuro-, and Developmental Psychology, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands WHO Collaborating Centre for Research and Dissemination of Psychological Interventions, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
*
Corresponding author: Eirini Karyotaki; Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Background

In low-resource settings, e-mental health may substantially increase access to evidence-based interventions for common mental disorders. We conducted a systematic literature search to identify randomised trials examining the effects of digital interventions with or without therapeutic guidance compared to control conditions in individuals with anxiety and/or depression symptoms in low- and middle-income countries (LMICs).

Methods

The main outcome was the reduction in symptoms at the post-test. Secondary outcomes included improvements in quality of life and longer-term effects (≥20 weeks post-randomisation). The effect size Hedges’ g was calculated using the random effects model.

Results

A total of 21 studies (23 comparisons) with 5.296 participants were included. Digital interventions were more effective than controls in reducing symptoms of common mental disorders at the post-test (g = −0.89, 95% confidence interval [CI] −1.26 to −0.52, p < 0.001; NNT = 2.91). These significant effects were confirmed when examining depressive (g = −0.77, 95% CI −1.11; −0.44) and anxiety symptoms separately (g = −1.02, 95% CI −1.53 to −0.52) and across all other sensitivity analyses. Digital interventions also resulted in a small but significant effect in improving quality of life (g = 0.32, 95% CI 0.19 to 0.45) at the post-test. Over the longer term, the effects were smaller but remained significant for all examined outcomes. Heterogeneity was moderate to high in all analyses. Subgroup and meta-regression analyses did not result in significant outcomes in any of the examined variables (e.g., guided vs. unguided interventions).

Conclusions

Digital interventions, with or without guidance, may effectively bridge the gap between treatment supply and demand in LMICs. Nevertheless, more studies are needed to draw firm conclusions regarding the magnitude of the effects of digital interventions.

Type
Review
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2023. Published by Cambridge University Press

Impact statement

The burden of common mental disorders, such as depression and anxiety, is devastating worldwide and especially high in low- and middle-income countries (LMICs), where mental health care resources are scarce. Scalable low-intensity psychological interventions may provide significant benefits in addressing the unmet mental health needs of individuals in LMICs. Over the last decades, digital interventions have shown promising effects in reducing symptoms of common mental disorders in high-income countries, and it has been suggested that such interventions may be beneficial for LMICs as well. Although the research in this field is relatively recent, the number of trials focussing on the effects of digital interventions in LMICs is booming, calling for an aggregated synthesis of the existing findings. Our systematic review and meta-analysis aimed to provide the latest evidence on the efficacy of digital interventions in reducing symptoms of anxiety and depression and improving the quality of life among individuals in LMICs. Digital interventions were significantly better in reducing symptoms of depression anxiety compared to control conditions at post-treatment and over the longer term. Significant improvements were also found in the quality-of-life outcomes. We also demonstrated that the effectiveness of digital interventions did not differ concerning several subgroup analyses like intervention format, delivery platform, age groups and adaptation to the local situation. Although more research is needed to draw firm conclusions regarding the examined subgroup analyses, these findings are encouraging for the upscaling of digital interventions in LMICs especially considering that these interventions could be delivered without therapeutic guidance and still lead to significant outcomes. Overall, our findings testify to the generalisability of the effectiveness of digital psychological interventions for depression and anxiety beyond high-income countries. This innovative delivery strategy for psychological treatment should be scaled up to supplement existing healthcare resources.

Introduction

Common mental disorders, like depression and anxiety, affect hundreds of millions of people (Steel et al., Reference Steel, Marnane, Iranpour, Chey, Jackson, Patel and Silove2014) and are associated with disability, morbidity and even premature mortality (Reddy, Reference Reddy2010). The global burden of these disorders is devastating globally and particularly high in low- and middle-income countries (LMICs; Herrman et al., Reference Herrman, Patel, Kieling, Berk, Buchweitz, Cuijpers, Furukawa, Kessler, Kohrt and Maj2022; WHO, 2022). Although psychotherapy, pharmacotherapy, and their combination can effectively manage the symptoms of depression and anxiety (Cuijpers et al., Reference Cuijpers, Noma, Karyotaki, Vinkers, Cipriani and Furukawa2020), their availability in LMICs is limited due to scarce healthcare resources. Insufficient access to evidence-based treatment results in chronicity and poorer disease prognosis, causing avoidable suffering. Therefore, research efforts in global mental health have focussed on improving access to psychological interventions in low-resource settings (Patel et al., Reference Patel, Saxena, Lund, Thornicroft, Baingana, Bolton, Chisholm, Collins, Cooper and Eaton2018).

Using digital interventions, evidence-based treatments may be more widely accessible at lower costs. Besides cost reduction, such interventions can overcome many other treatment barriers since they do not exclusively rely on face-to-face sessions and mental health specialists (Andersson et al., Reference Andersson, Carlbring, Titov and Lindefors2019). Available options include digital interventions with/without therapeutic guidance. These interventions can be delivered in various ways, for example, using web platforms, mobile apps and chatbots. In recent years, the growing interest in alternative intervention delivery modes, particularly in high-income countries (HICs), has led to a research boom on digital interventions for depression and anxiety. These interventions have shown promising short- and long-term results in HICs (Karyotaki et al., Reference Karyotaki, Efthimiou, Miguel, Bermpohl, Furukawa and Cuijpers2021; Pauley et al., Reference Pauley, Cuijpers, Papola, Miguel and Karyotaki2021), prompting questions about their potential for filtering down to LMICs and their efficacy within those contexts.

Considering the rapidly increasing penetration rate of digital technologies in LMICs, digital interventions may be an effective approach to fill the gap between treatment supply and demand (Fairburn and Patel, Reference Fairburn and Patel2017; Karyotaki et al., Reference Karyotaki, Riper, Twisk, Hoogendoorn, Kleiboer, Mira, Mackinnon, Meyer, Botella, Littlewood, Andersson, Christensen, Klein, Schröder, Bretón-López, Scheider, Griffiths, Farrer, Huibers, Phillips, Gilbody, Moritz, Berger, Pop, Spek and Cuijpers2017; Naslund et al., Reference Naslund, Aschbrenner, Araya, Marsch, Unützer, Patel and Bartels2017). However, there still exists a digital divide, particularly among the lowest socioeconomic status groups and vulnerable populations. Barriers, including access to the internet/a personal smartphone, power outages and low literacy, also present challenges in implementing digital interventions in LMICs. These factors highlight the critical need to provide an overview of the available research evidence, specifically from lower-income settings. Such an overview will enable a comprehensive examination of the effectiveness of digital interventions in these contexts, shedding light on their potential impact and identifying the gaps in our current knowledge.

Thus far, the evidence of the effectiveness of digital interventions primarily comes from Western HICs, and little is known about the effects of such therapeutic approaches in LMICs. Only one narrative review has summarised preliminary evidence on using digital technology to treat and prevent mental disorders in LMICs (Naslund et al., Reference Naslund, Aschbrenner, Araya, Marsch, Unützer, Patel and Bartels2017). Given the recent booming of clinical trials in this field, it is imperative to synthesise at a meta-analytic level their effects in LMICs. Thus, we aim to provide the current state of the art of digital interventions in LMICs by examining their overall effects in reducing symptoms of depression and/or anxiety as compared to control conditions at the post-test. Secondary analyses included quality of life and longer-term outcomes.

Methods

The present systematic review and meta-analysis was reported in accordance with the PRISMA statement (Page et al., Reference Page, McKenzie, Bossuyt, Boutron, Hoffmann, Mulrow, Shamseer, Tetzlaff, Akl and Brennan2021).

Search strategy

For this study, we ran a systematic literature search using free and index terms indicative of depression, anxiety and digital interventions in PubMed, PsycINFO and Embase from database inception through 25 February 2022 (the full search strings for PubMed can be found in the Supplementary Material). Next to these targeted searches, we performed an additional search in an existing broader living meta-analytic database on psychological treatments of depression (Cuijpers et al., Reference Cuijpers, Noma, Karyotaki, Vinkers, Cipriani and Furukawa2020; doi:10.17605/OSF.IO/825C6), of which supplemental materials and information are available on the website of the project (www.metapsy.org). To develop this living database, we continuously search four major bibliographical databases (i.e., PubMed, PsycINFO, Embase and the Cochrane Library) by combining index and free terms indicative of depression and psychotherapies with filters for randomised controlled trials. These searches are conducted every 4 months, and the current meta-analysis includes references up to 1 January 2022. Furthermore, we checked the references of earlier meta-analyses on psychological treatments for depression and anxiety. Two independent researchers screened all records, and all papers that could meet inclusion criteria were retrieved as full text. The two independent researchers also decided to include or exclude a study in the database, and disagreements were resolved through discussion.

Selection of studies

In the current meta-analysis, we included randomised trials conducted in LMICs where a digital intervention for people with anxiety and/or depression was compared to a control condition. To determine whether a country was considered an LMIC, we used the World Bank classification data for the year in which the trial was published. Digital interventions were defined as psychological interventions delivered via the internet through a web platform or a mobile application. Given that digital interventions are novel in LMICs, we included all delivery formats in the present meta-analysis (i.e., guided, self-guided and blended) to give a broad overview of what exists in this context. Depression and anxiety were determined as meeting diagnostic criteria for a depressive or anxiety disorder or scoring above a validated cut-off on a self-report measure. Control conditions had to be inactive, such as waitlist, care as usual, or attention placebo. No age-related exclusion criteria were applied since we wanted to examine the effects of these interventions across the lifespan. Nevertheless, results were also reported separately for adults and adolescents to examine potential differences between these two groups.

Data extraction and risk of bias assessment

We extracted general characteristics of the participants (i.e., type of disorder, the diagnostic method at inclusion, recruitment method, the proportion of women and mean age), characteristics of the treatment (i.e., type of digital intervention, the guidance received along the intervention, number of sessions or modules and cultural adaptation) and characteristics of the studies (i.e., type of control group, the country where the trial was conducted, income level of the country and year of publication).

Included studies were assessed using the Cochrane Risk of Bias Tool 2 (Sterne et al., Reference Sterne, Savović, Page, Elbers, Blencowe, Boutron, Cates, Cheng, Corbett and Eldridge2019). This tool evaluates possible sources of bias in five domains: 1) biases arising from the randomisation process, 2) deviations from the intended interventions, 3) missing outcome data, 4) biases in the measurement of the outcome and 5) selective reporting of the result. Each previous domain was rated as (a) low risk, (b) some concerns or (c) high risk of bias. Based on the scores of the domains, each trial received an overall risk of bias score of low risk (when all domains were scored as low risk), some concerns (when at least one domain is rated as some concerns, but none of the domains has a high-risk score), and high risk (when at least one domain is scored as high risk).

Outcome measures

We assessed the effectiveness of digital interventions on common mental health symptoms (i.e., depression and anxiety) and quality of life outcomes. For each comparison between a digital intervention and a control condition, the effect size (Hedges’ g) indicating the difference between the two groups at the post-test was calculated to adjust for small sample sizes (Hedges and Olkin, Reference Hedges and Olkin2014). Effect sizes were calculated by subtracting the intervention group’s mean score from the control group’s mean score and dividing the result by the pooled standard deviation. Additionally, we calculated effect sizes at long-term follow-ups (≥20 weeks since randomisation). When a trial reported data at multiple follow-up points, we took the longest follow-up from the trial.

Meta-analyses

We examined the effects of digital interventions by running the main meta-analysis on common mental health symptoms, which combined depression and anxiety measures. We also ran analyses to determine the effects on the two outcomes separately. In addition, we performed a meta-analysis on quality-of-life outcomes. To account for dependency between effect sizes (e.g., when multiple instruments were used to measure the same outcome), we pooled all outcomes within a comparison before calculating the overall effect. To pool effect sizes within the studies, we assumed an intra-study correlation coefficient of ρ = 0.5. This method of effect size pooling was used as the primary analysis method.

Additionally, we conducted sensitivity analyses using other methods for pooling by running: 1) a generic inverse-variance model and assuming all effect sizes as independent, 2) excluding outliers (effect sizes whose 95% confidence interval [CI] does not overlap with the CI of the pooled effect) and calculating the overall effect when only the smallest and highest effect size within a study is considered. Examining and addressing outliers is essential to ensure the validity of the meta-analytic model’s assumptions and to examine sources of heterogeneity. Outlying studies with extremely large effect sizes or a small number of highly influential studies can distort the pooled effect estimate. To assess the potential impact of outliers, metapsyTools incorporates two sensitivity analyses. The first approach employs a basic outlier removal strategy, known as the non-overlapping confidence intervals method, while the second utilises an influence analysis using the leave-one-out method, as outlined by Viechtbauer and Cheung (Reference Viechtbauer and Cheung2010). These sensitivity analyses serve the purpose of checking the robustness of the model by examining the rationale for excluding potential outliers and influential cases. Such rigorous examination of outliers contributes to maintaining the integrity and reliability of the meta-analytic findings. Moreover, we examined publication bias through Egger’s test of the intercept (Egger et al., Reference Egger, Smith, Schneider and Minder1997) and Duval and Tweedie’s trim and fill procedure (Duval and Tweedie, Reference Duval and Tweedie2000).

A random-effects model was used in all the analyses, using the restricted maximum likelihood method. For models not fitted using RVE, we applied the Knapp–Hartung method to obtain robust confidence intervals and significance tests of the overall effect (IntHout et al., Reference IntHout, Ioannidis and Borm2014). We examined the heterogeneity of effect sizes by calculating the I 2-statistic and its 95% CI. This statistic indicates the presence of heterogeneity in percentages, with 25% as low, 50% as moderate and 75% as high heterogeneity (Higgins et al., Reference Higgins, Thompson, Deeks and Altman2003). For the three-level models, we calculated a multilevel extension of I 2, which describes the amount of total variability attributable to heterogeneity within studies (level 2) and heterogeneity between studies (level 3) (Cheung, Reference Cheung2014; Harrer et al., Reference Harrer, Cuijpers, Furukawa and Ebert2021). Further, we calculated prediction intervals (PIs), which indicate the range in which the true effect size of 95% of all populations will fall (Borenstein et al., Reference Borenstein, Higgins, Hedges and Rothstein2017).

In our main meta-analysis of common mental health symptoms, we conducted a series of subgroup analyses that examined differences in effect sizes based on the type of technology used, type of intervention, format, income level of the country, age group, cultural adaptation of the intervention, method of recruitment, diagnosis of the included sample, type of diagnosis ascertainment at inclusion, and target group, and type of control condition. All subgroup analyses were conducted using a mixed-effects model. We pooled only subgroups with five or more studies.

All the analyses were conducted in RStudio 4.2.0 using the ‘metapsyTools’ package, which imports functionalities of the ‘meta’ (Balduzzi et al., Reference Balduzzi, Rücker and Schwarzer2019), ‘metafor’ (Viechtbauer, Reference Viechtbauer2010), and ‘dmetar’ (Harrer et al., Reference Harrer, Cuijpers, Furukawa and Ebert2021) packages.

Results

Selection and inclusion of studies

A total of 17,204 records were identified through the targeted searches. After removing duplicates, 9,419 titles and abstracts were screened, of which 948 papers were retrieved for full-text selection. Next, 53 full texts on digital interventions were examined from the living Metapsy database and three more studies were identified through reference tracking. All full texts were screened against our current eligibility criteria resulting in 21 RCTs for inclusion in the present meta-analysis (Figure 1; Mogoaşe et al., Reference Mogoaşe, Brăilean and David2013; Tulbure et al., Reference Tulbure, Szentagotai, David, Ștefan, Månsson, David and Andersson2015; Yeung et al., Reference Yeung, Wang, Feng, Zhang, Cooper, Hong, Wang, Griffiths, Bennett, Bennett, Alpert and Fava2017; Arjadi et al., Reference Arjadi, Nauta, Scholte, Hollon, Chowdhary, Suryani, Uiterwaal and Bockting2018; Ciuca et al., Reference Ciuca, Berger, Crişan and Miclea2018; Karbasi and Haratian, Reference Karbasi and Haratian2018; Yeung et al., Reference Yeung, Wang, Feng, Zhang, Cooper, Hong, Wang, Griffiths, Bennett and Bennett2018; Moeini et al., Reference Moeini, Bashirian, Soltanian, Ghaleiha and Taheri2019; Jannati et al., Reference Jannati, Mazhari, Ahmadian and Mirzaee2020; Salamanca-Sanabria et al., Reference Salamanca-Sanabria, Richards, Timulak, Connell, Perilla, Parra-Villa and Castro-Camacho2020; Wang et al., Reference Wang, Zhao, Mu, Rodriguez, Qian and Berger2020; Araya et al., Reference Araya, Menezes, Claro, Brandt, Daley, Quayle, Diez-Canseco, Peters, Cruz, Toyama, Aschar, Hidalgo-Padilla, Martins, Cavero, Rocha, Scotton, de Almeida Lopes, Begale, Mohr and Miranda2021; Ghosh et al., Reference Ghosh, Cherian, Wagle, Sharma, Kannan, Bajpai and Gupta2023; Heim et al., Reference Heim, Ramia, Hana, Burchert, Carswell, Cornelisz, Cuijpers, Chammay, Noun and van Klaveren2021; Latif et al., Reference Latif, Awan, Gul, Husain, Husain, Sayyed, Magsi, Naz, Aylem, Phiri, Irfan, Ayub and Naeem2021; Newman et al., Reference Newman, Kanuri, Rackoff, Jacobson, Bell and Taylor2021; Sun et al., Reference Sun, Li, Wang, Chen, Bazzano and Cao2021; Cuijpers et al., Reference Cuijpers, Heim, Ramia, Burchert, Carswell, Cornelisz, Knaevelsrud, Noun, van Klaveren and Hof2022; Zhao et al., Reference Zhao, Wampold, Ren, Zhang and Jiang2022).

Figure 1. Flow chart of the studies selection process.

Characteristics of included studies

The characteristics of the included studies are presented in Table 1. A total of 5,296 participants (2,701 in the interventions and 2,595 in the control groups) were included in 21 trials consisting of 23 comparisons. Fifteen trials focussed primarily on depressive symptoms, five on anxiety and one on depression and/or anxiety. Most of the studies employed cut-off scores on a self-report scale, while six performed a diagnostic interview to include participants. Further, most of the 23 comparisons examined a web-based (n = 17) cognitive behavioural therapy (n = 13) and had some form of guidance (n = 15). Across the 21 included studies, the most prevalent control condition was the waiting list (n = 12), and the most prevalent target group was adults in general (n = 9). Post-treatment outcomes were assessed in a period ranging from 1 week to 4 months, while the respective time of assessment for follow-up outcomes ranged from 5 to 9 months post-randomisation. The included trials were conducted in 10 lower- and upper-middle countries (i.e., Brazil, China, Colombia, India, Indonesia, Iran, Lebanon, Pakistan, Peru and Romania) according to the World Bank classification at the time when the studies were published.

Table 1. Studies characteristics

Abbreviations: 3rd, third wave cognitive behavioural therapy; AS, anxiety severity; BAT, behavioural activation therapy; BDI-II, Beck Depression Inventory-II; CAU, care-as-usual control group; CBT, cognitive behavioural therapy; CES-D, Center for Epidemiologic Studies Depression Scale; DASS-D, Depression Anxiety Stress Scales Short Form-Depression Subscale; DS, depression severity; EPDS, Edinburgh Postnatal Depression Scale; EQ5D-3L, European Quality of Life 5 Dimensions 3 Level Version; GAD-7, Generalised Anxiety Disorder 7; GAD-Q-IV, Generalised Anxiety Disorder Questionnaire for DSM-IV; gCBT, guided cognitive behavioural therapy; HADS, Hospital Anxiety and Depression Scale; LSAS-SR, Liebowitz Social Anxiety Scale-Self Report; m, month; NR, not reported; NS, non-specified; PDSS-SR, Panic Disorder Severity Scale – Self Report; PHQ-9, Patient Health Questionnaire-9; QOL, quality of life; SAD, social anxiety disorder; SCARED, Screen for Child Anxiety Related Emotional Disorders; sgCBT, self-guided cognitive behavioural therapy; SIAS, Social Interaction and Anxiety Scale; Sign, significant; SPIN, Social Phobia Inventory; SPS, Social Phobia Scale; SPSQ, Social Phobia Screening Questionnaire; w, week; WHO-5, The World Health Organisation – Five Well-Being Index; WHO-QOL-BREF, World Health Organisation Quality-of-Life Scale (abbreviated version); WHOQOL-HIV BREF, World Health Organisation Quality-of-Life Scale for people living with HIV (human immunodeficiency virus); WL, waiting list control group.

Risk of bias assessment

Overall, the risk of bias ranged from some concerns to high risk across all included studies. There were some concerns for most of the studies related to bias arising from the randomisation process and selection of the reported results, primarily due to the lack of information regarding the randomisation/allocation process and pre-registrations of outcome measures. Most of the studies were at low risk, related to deviations from the intended interventions and bias in the measurement of the outcome. However, bias was prevalent in many of the included studies due to missing outcome data. Since the overall judgement of the studies was either some concerns or high risk, we could not perform a sensitivity analysis including only low risk of bias studies. Figure 2a presents the overall risk of bias across studies, and Figure 2b shows the risk of bias assessment per study.

Figure 2. (a) Overall risk of bias across studies; (b) Risk of bias per each study.

Effects of digital interventions on symptoms of common mental disorders

Table 2 presents the effects of digital interventions compared to controls. At the post-treatment, digital interventions had a large effect in reducing symptoms of common mental disorders (g = −0.89, 95% CI −1.26 to −0.52, p < 0.001; NNT = 2.91; Figure 3). Heterogeneity was high and significant (I 2 = 87.75%; 95% CI 82.93 to 91.21; PI = −2.5 to 0.72). There was an indication of publication bias (Egger’s test p = 0.002), resulting in a much smaller but significant adjusted effect of g = −0.49. All sensitivity analyses yielded similar effects with high heterogeneity and wide confidence intervals. However, when outliers were excluded, the effect dropped to g = −0.67 (95% CI −0.82 to −0.51), and the heterogeneity was reduced to moderate I 2 = 68.26 (95% CI 48.28 to 80.53; PI −1.23 to −0.11). We found no evidence of a difference between all examined subgroup analyses (p > 0.05) except for the type of therapy, with cognitive behaviour therapy showing significantly larger effects (g = −1.37) than other types of psychotherapies (g = −0.53) (p = 0.007). The results of subgroup analyses are presented in Table 3.

Table 2. Effects of digital interventions on common mental disorders in LMICs

Figure 3. Forest plot of the main outcome.

Table 3. Subgroup analyses of digital interventions on symptoms of common mental disorders in LMICs at post-treatment

Abbreviations: CIs, confidence intervals; g, Hedges’ g; n comp, number of comparisons in the analysis; NNT, number needed to treat.

Further, we conducted separate analyses on depression and anxiety outcomes. Regarding depressive symptoms, digital interventions resulted in an overall effect of g = −0.77 (95% CI −1.11 to −0.44; p < 0.001; NNT = 3.34). Heterogeneity was high (I 2 = 85.32, 95% CI 78.62 to 89.92; PI = −2.13 to 0.59). When two outliers were removed, the effect dropped to g = −0.57, and heterogeneity was moderate I 2 = 66.62 (95% CI 45.27 to 79.65; PI = −1.08; −0.07). There was an indication of publication bias (Egger’s test p = 0.02), and Trim and fill resulted in an effect size of g = −0.47 after adjusting for six missing studies. A bit larger effect was found when examining the effects of digital interventions on anxiety symptoms at the post-test. Digital interventions resulted in a large effect of g = −1.02 (95% CI −1.53 to −0.52; p < 0.001; NNT = 2.58) in reducing anxiety symptoms. Heterogeneity was high (I 2 = 83.90, 95% CI 74.39 to 89.88; PI = −2.71 to 0.66) but dropped to moderate when excluding two outliers (g = −0.74, 95% CI −0.96; −0.51; I 2 = 67.47, 95% CI 40.46 to 82.23). The overall effect on anxiety symptoms dropped to g = −0.62 after adjusting for four missing studies, while the Egger’s test was significant (p = 0.01). Similar outcomes were found in sensitivity analyses in which all outcome measures were treated separately, and the study with the largest/smaller effect size was excluded. Table 2 presents all results of sensitivity analyses.

Secondary outcomes (i.e., quality of life and longer-term effects)

At the post-test, digital interventions had a small effect on improving quality of life (g = 0.32, 95% CI 0.19; 0.45, p < 0.001; NNT = 8.12) based on seven studies reporting on this outcome. Heterogeneity was moderate I 2 = 44.09 (95% CI 0 to 76.48; PI = 0.04 to 0.61). No outliers were identified. The effect slightly changed to g = 0.28 after adjusting for two missing studies in the Trim and Fill procedure. However, Egger’s test was non-significant (p = 0.19).

Eight studies reported long-term outcomes ≥20 weeks post-randomisation). Overall, digital interventions had a small effect compared to controls in reducing symptoms of common mental disorders over the longer term (g = −0.31, 95% CI −0.49 to −0.12; p = 0.006; NNT = 8.39). Heterogeneity was moderate I 2 = 69.23 (95% CI 35.78 to 85.26; PI = −0.77; 0.16). There were no outliers or indications of publication bias. Similar small but significant effects were found when examining depression (g = −0.30) and anxiety symptoms separately (g = −0.45) and across all other sensitivity analyses. Finally, digital interventions had a small effect in improving quality of life over the longer term (g = 0.35, 95% CI 0.12 to 0.58; NNT = 7.40) with moderate heterogeneity of I 2 = 76.46 (95% CI 47.3 to 89.49; PI −0.23 to 0.94). No outliers or indications of publication bias were identified. Table 2 presents all results of the secondary analyses.

Discussion

In this systematic review, we examined the effects of digital interventions with or without guidance compared to control conditions in individuals with symptoms of common mental disorders in LMICs. At post-test, we found that digital interventions resulted in moderate to large effects on depression and/or anxiety symptoms, while there was a small but significant effect on quality of life. Over the longer term, the favourable effects of digital interventions were still significant, albeit smaller in magnitude. Heterogeneity was moderate to high across all comparisons, and there were indications of publication bias, suggesting that the present findings, although promising, should still be interpreted cautiously. Finally, we found no evidence of a difference between most of the examined subgroup analyses, including the intervention format, delivery platform, age groups and adaptation to the local situation. However, CBT programmes appeared to be more effective than other types of therapy.

A previous meta-analysis on this topic focussed only on clinical diagnosis and pooled together outcomes of several mental disorders, including post-traumatic stress disorder and psychosis (Fu et al., Reference Fu, Burger, Arjadi and Bockting2020). This is the first meta-analysis that pools together outcomes of trials on digital interventions in LMICs for anxiety and depression across various severities and regardless of a clinical diagnosis. The present effect sizes for depression (g = −0.77) and anxiety (g = −1.02) are slightly higher compared to those observed in meta-analyses of e-mental health trials that were mainly conducted in HICs, which range from g = −0.52 (Moshe et al., Reference Moshe, Terhorst, Philippi, Domhardt, Cuijpers, Cristea, Pulkki-Råback, Baumeister and Sander2021) to g = −0.80 (Pauley et al., Reference Pauley, Cuijpers, Papola, Miguel and Karyotaki2021) for depressive and anxiety symptoms, respectively. Such differences have been previously identified in the literature on psychotherapy trials (Cuijpers et al., Reference Cuijpers, Karyotaki, Reijnders, Purgato and Barbui2018) and raise important considerations. Although the precise reasons for these observations are not yet fully understood, it is possible that the limited availability of resources in LMICs may impact the adequacy of control conditions, potentially leading to larger observed effects. Moreover, the quality of existing trials in LMICs can influence the outcomes (Cuijpers et al., Reference Cuijpers, Karyotaki, Reijnders, Purgato and Barbui2018). Nonetheless, further investigation and rigorous research are essential to provide clearer insights into the effectiveness of psychological interventions in LMICs compared to HICs.

The finding that CBT programmes appeared more effective than other internet-based psychotherapy types in LMICs can be attributed to several factors. CBT’s evidence-based and structured approach aligns well with online delivery, making it easier to adapt and implement in settings with less experience in diverse psychotherapy types. Additionally, the structured and time-limited nature of CBT makes it well-suited for internet-based delivery, particularly in resource-constrained settings where brief interventions are more feasible. However, it is important to recognise that CBT has dominated the internet-based interventions field, both in HICs and LMICs and thus, further research is needed to evaluate novel strategies and explore potential differences among therapeutic approaches. Moreover, this finding is based on subgroup analyses; thus, it do not imply causality since other variables may cause the differential outcomes between CBT and non-CBT interventions.

We did not find indications that the effects of digital interventions differ across several subgroup analyses, suggesting that these interventions may be effective despite the delivery format or whether they are culturally adapted or not. These results are in line with previous literature findings showing that guided and unguided interventions do not differ significantly in reducing symptoms of depression or anxiety (Moshe et al., Reference Moshe, Terhorst, Philippi, Domhardt, Cuijpers, Cristea, Pulkki-Råback, Baumeister and Sander2021; Pauley et al., Reference Pauley, Cuijpers, Papola, Miguel and Karyotaki2021). However, it should be noted that individual patient differences might lead to differential treatment effects. For instance, it has been found that guided interventions are more effective for individuals with more severe depressive symptoms compared to unguided interventions (Karyotaki, Efthimiou et al., Reference Karyotaki, Efthimiou, Miguel, Bermpohl, Furukawa and Cuijpers2021). Therefore, we cannot rule out the possibility that in LMICs, the provision of therapeutic guidance might lead to greater effects for some patient subgroups. Further, the current findings follow previous meta-analytic research indicating that the effects of psychological interventions do not differ significantly depending on cultural adaptation to the local context (Cuijpers et al., Reference Cuijpers, Karyotaki, Reijnders, Purgato and Barbui2018). It should be noted, though, that the method of cultural adaptation was minimally reported across the included studies, suggesting that the actual extent of cultural adaptation might have an effect on digital interventions’ efficacy, as reported before (Shehadeh et al., Reference Shehadeh, Heim, Chowdhary, Maercker and Albanese2016).

To the best of our knowledge, no previous meta-analysis has examined the effects of digital interventions on quality of life. We found a small but significant effect (g = 0.32) in improving the quality of life at the post-test, which was sustained over the longer term. This finding is in line with previous meta-analyses on psychotherapies that have found almost identical effects on quality of life (g = 0.33) (Kolovos et al., Reference Kolovos, Kleiboer and Cuijpers2016). Still, we should acknowledge that quality of life was examined only by seven studies, and future research should further explore quality-of-life outcomes.

Several limitations should be acknowledged. First, there was substantial heterogeneity across all analyses that remained unexplained in subgroup and meta-regression analyses. Such heterogeneity, however, is very common in meta-analyses focussing on psychological interventions in LMICs (Cuijpers et al., Reference Cuijpers, Karyotaki, Reijnders, Purgato and Barbui2018; Karyotaki et al., Reference Karyotaki, Araya, Kessler, Waqas, Bhana, Rahman, Matsuzaka, Miguel, Lund and Garman2022). The significant heterogeneity observed in meta-analyses of studies conducted in LMICs may arise from a range of factors. Diverse cultural, social and economic contexts can lead to variations in study populations and healthcare infrastructure, while differences in cultural beliefs and practices may influence treatment outcomes. Moreover, variations in intervention protocols, cultural and delivery modes could contribute to the observed heterogeneity. Although excluding outliers in the current analysis led to a reduction in heterogeneity to a moderate level, no apparent differences were found in the identified outlier studies compared to the rest of the studies, leaving the specific reasons for the remaining heterogeneity uncertain.

Second, there was an indication of publication bias; thereby, the present outcomes should be interpreted cautiously. Nevertheless, the vast majority of analyses resulted in a smaller but significant effect after adjusting for publication bias, suggesting that the magnitude of digital interventions’ true effect would probably be in the moderate range. Third, the overall risk of bias ranged from some concerns to high risk across all included studies, meaning that high-quality studies are needed to draw robust conclusions regarding the effects of digital interventions in LMICs. Fourth, although we did not find any significant differences between the countries’ income classifications, we only identified studies from lower-middle or upper-middle countries. Therefore, more studies are needed to explore the effects of digital interventions in low-income countries. Fourth, although we found no significant differences between the countries’ income classifications, we only identified studies from lower-middle or upper-middle countries. Notably, we did not identify any study meeting our eligibility criteria from Africa, a continent with a substantial and rapidly growing population. In many low-income countries, this lack of eligible RCTs may be attributed to systematic and structural challenges, such as limited access to electricity, mobile phones, and the internet, which hinder the development and research of digital interventions in low-income countries. Additionally, global and economic factors may impact research funding, infrastructure and collaboration opportunities, contributing to this disparity. To address this gap, researchers and policymakers should proactively tackle these challenges and prioritise evaluating digital interventions in low-income countries, especially in Africa, considering its rapidly growing population and potential to benefit from these therapeutic approaches.

Finally, we should acknowledge that our subgroup analysis results should be interpreted cautiously for several reasons. Firstly, it is important to note that finding a subgroup difference does not necessarily imply a direct causal relationship between the variable and the observed effect difference. Study characteristics may be confounded by various factors, such as differences in patient recruitment or varying levels of bias, which could impact the outcomes. Furthermore, the statistical power of subgroup analyses to detect differences relies on having an adequate sample size, and this power is limited when there are few studies or numerous subgroups (or both). Therefore, it is crucial to remember that the absence of evidence is not evidence of absence. It is possible that subgroups still exhibit different effects, but the lack of statistical power might have hindered their detection.

Despite the limitations, the present outcomes offer great possibilities for improving the access and availability of evidence-based psychological care through digital means in LMICs. We found that both guided and unguided interventions effectively reduce symptoms of depression and anxiety, suggesting that unguided interventions are also a good and probably cost-effective choice if there are limited resources for providing guidance. Next, digital interventions appear effective regardless of the target or age group, meaning they can be widely provided to cover the needs of people with symptoms of common mental disorders in LMICs. Nonetheless, based on the current findings, CBT interventions should be preferred as they lead to larger effects. Overall, the present findings testify to the generalisability of the effectiveness of digital interventions for depression and anxiety in LMICs. These innovative interventions should be scaled up to reduce the impact of common mental disorders and hopefully contribute to bridging the gap between treatment supply and demand in low-resourced countries.

Abbreviations: CIs, confidence intervals; g, Hedges’ g; k, number of comparisons in the analysis; NNT, number needed to treat; PI, prediction interval.

Open peer review

To view the open peer review materials for this article, please visit http://doi.org/10.1017/gmh.2023.50.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/gmh.2023.50.

Data availability statement

Data are available upon request to the corresponding author, E.K. ().

Author contribution

E.K. and C.M. drafted the manuscript. E.K., C.M. and M.H. performed the analysis. All the authors provided input into the study design and helped with manuscript writing. C.M. and O.P. contributed to the data extraction and helped with data synthesis and administration. R.A., V.P. and P.C. supervised the overall conduct of the study. All the authors read and approved the final manuscript.

Financial support

E.K. is supported by Nederlandse Organisatie voor Wetenschappelijk Onderzoek Veni (Grant No. VI.Veni.201G.053).

Competing interest

The authors declare no competing interests exist.

References

Andersson, G, Carlbring, P, Titov, N and Lindefors, N (2019) Internet interventions for adults with anxiety and mood disorders: A narrative umbrella review of recent meta-analyses. Canadian Journal of Psychiatry 64(7), 465470.CrossRefGoogle ScholarPubMed
Araya, R, Menezes, PR, Claro, HG, Brandt, LR, Daley, KL, Quayle, J, Diez-Canseco, F, Peters, TJ, Cruz, DV, Toyama, M, Aschar, S, Hidalgo-Padilla, L, Martins, H, Cavero, V, Rocha, T, Scotton, G, de Almeida Lopes, IF, Begale, M, Mohr, DC and Miranda, JJ (2021) Effect of a digital intervention on depressive symptoms in patients with comorbid hypertension or diabetes in Brazil and Peru: Two randomized clinical trials. JAMA 325(18), 18521862.CrossRefGoogle ScholarPubMed
Arjadi, R, Nauta, MH, Scholte, WF, Hollon, SD, Chowdhary, N, Suryani, AO, Uiterwaal, C and Bockting, CLH (2018) Internet-based behavioural activation with lay counsellor support versus online minimal psychoeducation without support for treatment of depression: A randomised controlled trial in Indonesia. Lancet Psychiatry 5(9), 707716.CrossRefGoogle ScholarPubMed
Balduzzi, S, Rücker, G and Schwarzer, G (2019) How to perform a meta-analysis with R: A practical tutorial. Evidence-Based Mental Health 22(4), 153160.CrossRefGoogle Scholar
Borenstein, M, Higgins, JP, Hedges, LV and Rothstein, HR (2017) Basics of meta-analysis: I2 is not an absolute measure of heterogeneity. Research Synthesis Methods 8(1), 518.CrossRefGoogle Scholar
Cheung, MW-L (2014) Modeling dependent effect sizes with three-level meta-analyses: A structural equation modeling approach. Psychological Methods 19(2), 211.CrossRefGoogle ScholarPubMed
Ciuca, AM, Berger, T, Crişan, LG and Miclea, M (2018) Internet-based treatment for panic disorder: A three-arm randomized controlled trial comparing guided (via real-time video sessions) with unguided self-help treatment and a waitlist control. PAXPD study results. Journal of Anxiety Disorders 56, 4355.CrossRefGoogle Scholar
Cuijpers, P, Heim, E, Ramia, JA, Burchert, S, Carswell, K, Cornelisz, I, Knaevelsrud, C, Noun, P, van Klaveren, C and Hof, E (2022) Effects of a WHO-guided digital health intervention for depression in Syrian refugees in Lebanon: A randomized controlled trial. PLoS Medicine 19(6), e1004025.CrossRefGoogle ScholarPubMed
Cuijpers, P, Karyotaki, E, Reijnders, M, Purgato, M and Barbui, C (2018) Psychotherapies for depression in low- and middle-income countries: A meta-analysis. World Psychiatry 17(1), 90101.CrossRefGoogle ScholarPubMed
Cuijpers, P, Noma, H, Karyotaki, E, Vinkers, CH, Cipriani, A and Furukawa, TA (2020) A network meta-analysis of the effects of psychotherapies, pharmacotherapies and their combination in the treatment of adult depression. World Psychiatry 19(1), 92107.CrossRefGoogle ScholarPubMed
Duval, S and Tweedie, R (2000) Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics 56(2), 455463.CrossRefGoogle ScholarPubMed
Egger, M, Smith, GD, Schneider, M and Minder, C (1997) Bias in meta-analysis detected by a simple, graphical test. BMJ 315(7109), 629634.CrossRefGoogle ScholarPubMed
Fairburn, CG and Patel, V (2017) The impact of digital technology on psychological treatments and their dissemination. Behaviour Research and Therapy 88, 1925.CrossRefGoogle ScholarPubMed
Fu, Z, Burger, H, Arjadi, R and Bockting, CL (2020) Effectiveness of digital psychological interventions for mental health problems in low-income and middle-income countries: A systematic review and meta-analysis. The Lancet Psychiatry 7(10), 851864.CrossRefGoogle ScholarPubMed
Ghosh, A, Cherian, RJ, Wagle, S, Sharma, P, Kannan, KR, Bajpai, A, Gupta, N (2023) An unguided, computerized cognitive behavioral therapy intervention (TreadWill) in a lower middle-income country: Pragmatic randomized controlled trial. Journal of Medical Internet Research 25, e41005.CrossRefGoogle Scholar
Harrer, M, Cuijpers, P, Furukawa, TA and Ebert, DD (2021) Doing Meta-Analysis with R: A Hands-On Guide. Boca Raton, FL and London: Chapman & Hall/CRC Press.CrossRefGoogle Scholar
Hedges, LV and Olkin, I (2014) Statistical Methods for Meta-Analysis. London: Academic Press.Google Scholar
Heim, E, Ramia, JA, Hana, RA, Burchert, S, Carswell, K, Cornelisz, I, Cuijpers, P, Chammay, RE, Noun, P and van Klaveren, C (2021) Step-by-step: Feasibility randomised controlled trial of a mobile-based intervention for depression among populations affected by adversity in Lebanon. Internet Interventions 24, 100380.CrossRefGoogle ScholarPubMed
Herrman, H, Patel, V, Kieling, C, Berk, M, Buchweitz, C, Cuijpers, P, Furukawa, TA, Kessler, RC, Kohrt, BA and Maj, M (2022) Time for united action on depression: A Lancet–World Psychiatric Association Commission. Lancet 399(10328), 9571022.CrossRefGoogle ScholarPubMed
Higgins, JP, Thompson, SG, Deeks, JJ and Altman, DG (2003) Measuring inconsistency in meta-analyses. BMJ 327(7414), 557560.CrossRefGoogle ScholarPubMed
IntHout, J, Ioannidis, JP and Borm, GF (2014) The Hartung–Knapp–Sidik–Jonkman method for random effects meta-analysis is straightforward and considerably outperforms the standard DerSimonian–Laird method. BMC Medical Research Methodology 14, 112.CrossRefGoogle ScholarPubMed
Jannati, N, Mazhari, S, Ahmadian, L and Mirzaee, M (2020) Effectiveness of an app-based cognitive behavioral therapy program for postpartum depression in primary care: A randomized controlled trial. International Journal of Medical Informatics 141, 104145.CrossRefGoogle ScholarPubMed
Karbasi, A and Haratian, A (2018) The efficacy of internet-based cognitive behavioral therapy on the anxiety disorders among adolescent girls. Advanced Biomedical Research 7, 13.Google ScholarPubMed
Karyotaki, E, Araya, R, Kessler, RC, Waqas, A, Bhana, A, Rahman, A, Matsuzaka, CT, Miguel, C, Lund, C and Garman, EC (2022) Association of task-shared psychological interventions with depression outcomes in low-and middle-income countries: A systematic review and individual patient data meta-analysis. JAMA Psychiatry 79(5), 430443.CrossRefGoogle ScholarPubMed
Karyotaki, E, Efthimiou, O, Miguel, C, Bermpohl, FM, Furukawa, TA, Cuijpers, P and IPDMA-DE Collaboration (2021) Internet-based cognitive behavioral rherapy for depression: A systematic review and individual patient data network meta-analysis. JAMA Psychiatry 78(4), 361371.CrossRefGoogle ScholarPubMed
Karyotaki, E, Riper, H, Twisk, J, Hoogendoorn, A, Kleiboer, A, Mira, A, Mackinnon, A, Meyer, B, Botella, C, Littlewood, E, Andersson, G, Christensen, H, Klein, JP, Schröder, J, Bretón-López, J, Scheider, J, Griffiths, K, Farrer, L, Huibers, MJ, Phillips, R, Gilbody, S, Moritz, S, Berger, T, Pop, V, Spek, V and Cuijpers, P (2017) Efficacy of self-guided internet-based cognitive behavioral therapy in the treatment of depressive symptoms: A meta-analysis of individual participant data. JAMA Psychiatry 74(4), 351359.CrossRefGoogle ScholarPubMed
Kolovos, S, Kleiboer, A and Cuijpers, P (2016) Effect of psychotherapy for depression on quality of life: Meta-analysis. British Journal of Psychiatry 209(6), 460468.CrossRefGoogle ScholarPubMed
Latif, M, Awan, F, Gul, M, Husain, MO, Husain, MI, Sayyed, K, Magsi, T, Naz, S, Aylem, O, Phiri, P, Irfan, M, Ayub, M and Naeem, F (2021) Preliminary evaluation of a culturally adapted CBT-based online programme for depression and anxiety from a lower middle-income country. Cognitive Behaviour Therapist 14, e36.CrossRefGoogle Scholar
Moeini, B, Bashirian, S, Soltanian, AR, Ghaleiha, A and Taheri, M (2019) Examining the effectiveness of a web-based intervention for depressive symptoms in female adolescents: Applying social cognitive theory. Journal of Research in Health Sciences 19(3), e00454e00454.Google ScholarPubMed
Mogoaşe, C, Brăilean, A and David, D (2013) Can concreteness training alone reduce depressive symptoms? A randomized pilot study using an internet-delivered protocol. Cognitive Therapy and Research 37, 704712.CrossRefGoogle Scholar
Moshe, I, Terhorst, Y, Philippi, P, Domhardt, M, Cuijpers, P, Cristea, I, Pulkki-Råback, L, Baumeister, H and Sander, LB (2021) Digital interventions for the treatment of depression: A meta-analytic review. Psychological Bulletin 147(8), 749.CrossRefGoogle ScholarPubMed
Naslund, JA, Aschbrenner, KA, Araya, R, Marsch, LA, Unützer, J, Patel, V and Bartels, SJ (2017) Digital technology for treating and preventing mental disorders in low-income and middle-income countries: A narrative review of the literature. Lancet Psychiatry 4(6), 486500.CrossRefGoogle ScholarPubMed
Newman, MG, Kanuri, N, Rackoff, GN, Jacobson, NC, Bell, MJ and Taylor, CB (2021) A randomized controlled feasibility trial of internet-delivered guided self-help for generalized anxiety disorder (GAD) among university students in India. Psychotherapy 58(4), 591601.CrossRefGoogle ScholarPubMed
Page, MJ, McKenzie, JE, Bossuyt, PM, Boutron, I, Hoffmann, TC, Mulrow, CD, Shamseer, L, Tetzlaff, JM, Akl, EA and Brennan, SE (2021) The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. International Journal of Surgery 88, 105906.CrossRefGoogle ScholarPubMed
Patel, V, Saxena, S, Lund, C, Thornicroft, G, Baingana, F, Bolton, P, Chisholm, D, Collins, PY, Cooper, JL and Eaton, J (2018) The Lancet Commission on global mental health and sustainable development. Lancet 392(10157), 15531598.CrossRefGoogle ScholarPubMed
Pauley, D, Cuijpers, P, Papola, D, Miguel, C and Karyotaki, E (2021) Two decades of digital interventions for anxiety disorders: A systematic review and meta-analysis of treatment effectiveness. Psychological Medicine 53, 567579.Google ScholarPubMed
Reddy, MS (2010) Depression: The disorder and the burden. Indian Journal of Psychological Medicine 32(1), 12.CrossRefGoogle ScholarPubMed
Salamanca-Sanabria, A, Richards, D, Timulak, L, Connell, S, Perilla, MM, Parra-Villa, Y and Castro-Camacho, L (2020) A culturally adapted cognitive behavioral internet-delivered intervention for depressive symptoms: Randomized controlled trial. JMIR Mental Health 7(1), e13392.CrossRefGoogle ScholarPubMed
Shehadeh, MH, Heim, E, Chowdhary, N, Maercker, A and Albanese, E (2016) Cultural adaptation of minimally guided interventions for common mental disorders: A systematic review and meta-analysis. JMIR Mental Health 3(3), e5776.Google Scholar
Steel, Z, Marnane, C, Iranpour, C, Chey, T, Jackson, JW, Patel, V and Silove, D (2014) The global prevalence of common mental disorders: A systematic review and meta-analysis 1980–2013. International Journal of Epidemiology 43(2), 476493.CrossRefGoogle ScholarPubMed
Sterne, JA, Savović, J, Page, MJ, Elbers, RG, Blencowe, NS, Boutron, I, Cates, CJ, Cheng, H-Y, Corbett, MS and Eldridge, SM (2019) RoB 2: A revised tool for assessing risk of bias in randomised trials. BMJ 366, l4898.CrossRefGoogle ScholarPubMed
Sun, Y, Li, Y, Wang, J, Chen, Q, Bazzano, AN and Cao, F (2021) Effectiveness of smartphone-based mindfulness training on maternal perinatal depression: Randomized controlled trial. Journal of Medical Internet Research 23(1), e23410.CrossRefGoogle ScholarPubMed
Tulbure, BT, Szentagotai, A, David, O, Ștefan, S, Månsson, KN, David, D and Andersson, G (2015) Internet-delivered cognitive-behavioral therapy for social anxiety disorder in Romania: A randomized controlled trial. PLoS One 10(5), e0123997.CrossRefGoogle ScholarPubMed
Viechtbauer, W (2010) Conducting meta-analyses in R with the metafor package. Journal of Statistical Software 36(3), 148.CrossRefGoogle Scholar
Viechtbauer, W and Cheung, MWL (2010) Outlier and influence diagnostics for meta-analysis. Research Synthesis Methods 1(2), 112125.CrossRefGoogle ScholarPubMed
Wang, H, Zhao, Q, Mu, W, Rodriguez, M, Qian, M and Berger, T (2020) The effect of shame on patients with social anxiety disorder in internet-based cognitive behavioral therapy: Randomized controlled trial. JMIR Mental Health 7(7), e15797.CrossRefGoogle ScholarPubMed
WHO (2022) World Mental Health Report: Transforming Mental Health for All. Geneva: World Health Organisation.Google Scholar
Yeung, A, Wang, F, Feng, F, Zhang, J, Cooper, A, Hong, L, Wang, W, Griffiths, K, Bennett, K and Bennett, A (2018) Outcomes of an online computerized cognitive behavioral treatment program for treating Chinese patients with depression: A pilot study. Asian Journal of Psychiatry 38, 102107.CrossRefGoogle ScholarPubMed
Yeung, A, Wang, F, Feng, F, Zhang, J, Cooper, A, Hong, L, Wang, W, Griffiths, K, Bennett, K, Bennett, A, Alpert, J and Fava, M (2017) Outcomes of an online computerized cognitive behavioral treatment program for treating chinese patients with depression: A pilot study. Asian Journal of Psychiatry 38, 102107.CrossRefGoogle ScholarPubMed
Zhao, C, Wampold, BE, Ren, Z, Zhang, L and Jiang, G (2022) The efficacy and optimal matching of an Internet-based acceptance and commitment therapy intervention for depressive symptoms among university students: A randomized controlled trial in China. Journal of Clinical Psychology. 78(7), 13541375.CrossRefGoogle Scholar
Figure 0

Figure 1. Flow chart of the studies selection process.

Figure 1

Table 1. Studies characteristics

Figure 2

Figure 2. (a) Overall risk of bias across studies; (b) Risk of bias per each study.

Figure 3

Table 2. Effects of digital interventions on common mental disorders in LMICs

Figure 4

Figure 3. Forest plot of the main outcome.

Figure 5

Table 3. Subgroup analyses of digital interventions on symptoms of common mental disorders in LMICs at post-treatment

Supplementary material: File

Karyotaki et al. supplementary material
Download undefined(File)
File 15.4 KB

Author comment: Digital interventions for common mental disorders in low- and middle-income countries: A systematic review and meta-analysis — R0/PR1

Comments

To the editor of the Global Mental Health,

Dear Editor,

I am enclosing a submission to the Global Mental Health entitled ‘Digital Interventions for Common Mental Disorders in Low- and Middle-Income Countries: A Systematic Review and Meta-Analysis.

As you are undoubtedly aware, the provision of psychological interventions for common mental disorders is limited in Low- and Middle-Income Countries (LMICs) due to scarce healthcare resources. Digital interventions present a promising approach to addressing the enormous mental health gap in low-resourced settings. During the last few years, an increasing number of trials have been conducted examining the effects of digital interventions for individuals with depression and anxiety in LMICs. We conducted a systematic review and meta-analyses to examine the effects of these trials and provide the latest evidence in this field.

In sum, we found that digital interventions are effective in reducing symptoms of depression and anxiety as well as improving quality of life over the short and the longer term. Most of the examined subgroup analyses (e.g., guided vs unguided digital interventions) did not reveal any significant differences. These results are very encouraging for the upscaling of digital interventions in LMICs. The manuscript is original, not previously published, and not under consideration elsewhere. All authors have declared a possible conflict of interest and have approved the attached version of the manuscript.

On behalf of the authors,

Sincerely,

Eirini Karyotaki, PhD.

Associate Professor of Clinical Psychology

Department of Clinical, Neuro- and Developmental Psychology, VU University Amsterdam

Van der Boechorststraat 7, 1081 BT Amsterdam, the Netherlands

Review: Digital interventions for common mental disorders in low- and middle-income countries: A systematic review and meta-analysis — R0/PR2

Conflict of interest statement

Reviewer declares none.

Comments

This is a robust and well written paper that I enjoyed reviewing. Some comments and questions:

Introduction

• Contextualize the research more in terms of what has happened in HIC with CMDs and digital – clarify the digital boom is in HICs and what is filtering to LMICs?

• More background on the different contexts of HICs and LMIC e.g. smartphone penetration in LMIC may be growing but there is still a digital divide in lowest socioeconomic status groups/vulnerable groups, other contextual issues e.g. access to data – can also reflect on this in the discussion

• Can you include more up to date references on the burden of CMDs in LMICs?

Methods

• Was any guidance on reporting systematic reviews used e.g. PRISMA?

• The methods section would be strengthened by addition of some references for methods – e.g. for reasoning for using Hedges g as opposed to another measure (group size differences?); reference for intra-study correlation coefficient of ρ = 0.5.

• Outline in the methods justification and reference for removing outliers from analysis

• What was done for missing outcome data – references for approach and justification

• Can you discuss the decision to include all age groups in the meta analysis – why was this deemed appropriate given that the intervention content may be quite different eg for adolescents?

• Clarify what the reader is to take from the subgroup analyses with respect to power to detect differences in subgroup analysis.

Results

• Results are well presented

Discussion

• Can you discuss more on the finding that CBT programmes appeared to be more effective than other types of therapy – ideas on why? What do we know from HIC and how could this relate to LMIC

• You state that psychological interventions are more effective in LMICs – what is the reasoning and support for this? Discuss in relation to the view that some Western style approaches may actually be less appropriate and cultural adaptation may be minimal? What should the reader take away as to why psychological interventions could be more effective in LMICs?

• Limitations- heterogeneity of studies, can you say more about this – why is it common or expected in these types of meta analysis and what does this say about this meta analysis overall? Can you give more information on outliers – which studies, from which countries, any similarities between studies that were outliers? Is there anything to be taken away from looking at these outliers?

Review: Digital interventions for common mental disorders in low- and middle-income countries: A systematic review and meta-analysis — R0/PR3

Conflict of interest statement

Not sure if this really counts as a competing interest or declaration but in the interest of full transparency I am developing a behavioral health intervention to screen and link adolescents in Uganda with care (K01-NIMH122319: PI Kreniske).

Comments

Thank you for the opportunity to review this timely and important study that details how “digital interventions, with or without guidance, may effectively bridge the gap between treatment supply and demand in LMICs.” In addition, I agree with the conclusion that more research is needed to “draw firm conclusions regarding the magnitude of the effects of digital interventions.”

My major comment is in response to Question 1 posed by Cambridge in the review form: “For global reviews, how well does the review cover global content in the inclusion of research, presentation of results, and/or in the discussion and implications? And how could this be improved/expanded?”

As the study title states this is a review of digital interventions in low and middle-income countries. However, the authors note in the limitations few low-income countries were included. Some discussion of why so little research on digital interventions has been conducted in low-income countries is needed, as are the implications of this lack of research and directions for future study. I commend the authors on the inclusion of studies from LMICs including Brazil, China, Colombia, India, Indonesia, Iran, Lebanon, Pakistan, Peru, and Romania. Yet, there is not one study, nor is there even mention of the continent of Africa in this review. Authors should consider the implications of omitting a continent with one of the fastest growing populations that is currently home to more than a quarter of the world’s population. Attention should be paid to systematic and structural issues that make digital interventions in Africa challenging and thus under-researched and under-developed. For example, the cost of and inequitable access to electricity and mobile phones and the Internet (as our team Kreniske et al., 2021 JMIR; and other perhaps see G Porter and colleagues?). What are other global and economic factors that might contribute to this disparity? In short, what does it mean when digital interventions are not being evaluated in Africa?

Also, I would add in fact there are mental health digital interventions in Africa, but they have not yet been published or the randomized trials are not complete, including full disclosure my own small study. As well as a larger study, for instance, see Wainberg ML, et al., Technology and implementation science to forge the future of evidence-based psychotherapies: the PRIDE scale-up study. Evid Based Ment Health. 2021 Feb;24(1):19-24. doi: 10.1136/ebmental-2020-300199. Epub 2020 Nov 11. PMID: 33177149; PMCID: PMC8025148. A related team has published on a digital intervention to improve alcohol treatment (O’Grady et al., 2022), although alcohol use may be outside the scope of this manuscript. In addition, I am aware of partners such as StrongMinds in Uganda and Zambia who were in the process of publishing their work describing the provision of telehealth mental health care. Again, I am not sure these would qualify for the current review as the StrongMinds reports may not be RCTs. However, this in itself exposes concerns about how we as scientists assess, analyze and prioritize interventions for funding and scale-up. I do think RCTs are important but perhaps something to note or speak to in the manuscript as it relates low-income countries and the state of the evidence for digital interventions for mental health and Africa at the current moment and why the research in Africa is not at the same stage of development as other LMIC regions? Can this issue be addressed?

The following quote also highlights a major issue related to the omission of any African studies:

“Nevertheless, it should be noted that the method of cultural adaptation was minimally reported across the included studies, suggesting that the actual extend of cultural adaptation might have an effect on digital interventions’ efficacy as reported before (Shehadeh, Heim et al. 2016).” Africa is of course very diverse, even within country, but the lack of RCTs and culturally appropriate intervention evaluations is clearly related to the other issues raised in my review.

Minor: Authors use the word “nevertheless” 6 times. Consider removing or alternate phrase?

Recommendation: Digital interventions for common mental disorders in low- and middle-income countries: A systematic review and meta-analysis — R0/PR4

Comments

No accompanying comment.

Decision: Digital interventions for common mental disorders in low- and middle-income countries: A systematic review and meta-analysis — R0/PR5

Comments

No accompanying comment.

Author comment: Digital interventions for common mental disorders in low- and middle-income countries: A systematic review and meta-analysis — R1/PR6

Comments

Dear editor,

We thank the reviewers for their valuable comments and suggestions. We have prepared a rebuttal with our responses to the reviewers' comments and submitted the revised version of our manuscript for your consideration.

Sincerely,

On behalf of the co-authors,

Eirini Karyotaki

Review: Digital interventions for common mental disorders in low- and middle-income countries: A systematic review and meta-analysis — R1/PR7

Conflict of interest statement

Reviewer declares none.

Comments

Thank you for the detailed and thoughtful responses to the comments

Review: Digital interventions for common mental disorders in low- and middle-income countries: A systematic review and meta-analysis — R1/PR8

Conflict of interest statement

Reviewer declares none.

Comments

Thank you, I have no further comments.

Recommendation: Digital interventions for common mental disorders in low- and middle-income countries: A systematic review and meta-analysis — R1/PR9

Comments

No accompanying comment.

Decision: Digital interventions for common mental disorders in low- and middle-income countries: A systematic review and meta-analysis — R1/PR10

Comments

No accompanying comment.