Hostname: page-component-cd9895bd7-hc48f Total loading time: 0 Render date: 2024-12-27T19:31:33.846Z Has data issue: false hasContentIssue false

Impact of guidance on intervention adherence in computerised interventions for mental health problems: a meta-analysis

Published online by Cambridge University Press:  22 November 2021

Peter Musiat*
Affiliation:
College of Education, Psychology and Social Work, Flinders University, Bedford Park, South Australia, Australia
Catherine Johnson
Affiliation:
College of Education, Psychology and Social Work, Flinders University, Bedford Park, South Australia, Australia
Melissa Atkinson
Affiliation:
Department of Psychology, University of Bath, Bath, England
Simon Wilksch
Affiliation:
College of Education, Psychology and Social Work, Flinders University, Bedford Park, South Australia, Australia
Tracey Wade
Affiliation:
College of Education, Psychology and Social Work, Flinders University, Bedford Park, South Australia, Australia
*
Author for correspondence: Peter Musiat, E-mail: [email protected]

Abstract

Web-based interventions are increasingly used for the prevention, treatment and aftercare of mental disorders. A crucial factor to the efficacy of such online programmes is adherence to the intervention content and procedure. It has been frequently suggested that adherence in web-based interventions is low and little is known about which factors influence adherence. To increase intervention uptake and completion, studies increasingly include interventions with some form of guidance. Guided interventions have been shown to have higher efficacy, however, evidence for the impact on adherence is limited and mixed. This meta-analysis explored the impact of human guidance on intervention completion in web-based mental health interventions. A total of 22 studies were included with interventions primarily targeting symptoms of depression and anxiety disorders. Results showed that guidance significantly increases the average amount of intervention completion [g = 0.29, 95% confidence interval (CI) 0.18–0.40] and the proportion of intervention completers [log odds ratio (OR) = 0.50, 95% CI 0.34–0.66] with small effects. On average, full completion rates were 12% higher in guided intervention groups. This meta-analysis demonstrated that guidance in web-based mental health interventions does increase adherence, but more research is required to better understand the specific mechanisms between guidance, adherence and outcomes.

Type
Review Article
Copyright
Copyright © The Author(s), 2021. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Aardoom, J. J., Dingemans, A. E., Spinhoven, P., & Van Furth, E. F. (2013). Treating eating disorders over the internet: A systematic review and future research directions. International Journal of Eating Disorders, 46(6), 539552. doi: 10.1002/eat.22135CrossRefGoogle ScholarPubMed
Aardoom, J. J., Dingemans, A. E., Spinhoven, P., van Ginkel, J. R., de Rooij, M., & van Furth, E. F. (2016). Web-based fully automated self-help with different levels of therapist support for individuals with eating disorder symptoms: A randomized controlled trial. Journal of Medical Internet Research, 18(6), e159. doi: 10.2196/jmir.5709CrossRefGoogle ScholarPubMed
Alfonsson, S., Olsson, E., & Hursti, T. (2015). The effects of therapist support and treatment presentation on the clinical outcomes of an internet-based applied relaxation program. Internet Interventions, 2(3), 289296. doi: 10.1016/j.invent.2015.07.005CrossRefGoogle Scholar
Andersson, G., & Cuijpers, P. (2009). Internet-based and other computerized psychological treatments for adult depression: A meta-analysis. Cognitive Behaviour Therapy, 38(4), 196205. doi: 10.1080/16506070903318960CrossRefGoogle ScholarPubMed
Andrews, G., Cuijpers, P., Craske, M. G., McEvoy, P., & Titov, N. (2010). Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: A meta-analysis. PLoS ONE, 5(10), e13196. doi: 10.1371/journal.pone.0013196CrossRefGoogle ScholarPubMed
Baumeister, H., Reichler, L., Munzinger, M., & Lin, J. (2014). The impact of guidance on internet-based mental health interventions – a systematic review. Internet Interventions, 1(4), 205215. doi: 10.1016/j.invent.2014.08.003CrossRefGoogle Scholar
Beatty, L., & Binnion, C. (2016). A systematic review of predictors of, and reasons for, adherence to online psychological interventions. International Journal of Behavioral Medicine, 23(6), 776794. doi: 10.1007/s12529-016-9556-9CrossRefGoogle ScholarPubMed
Beintner, I., Vollert, B., Zarski, A. C., Bolinski, F., Musiat, P., Gorlich, D., … Jacobi, C. (2019). Adherence reporting in randomized controlled trials examining manualized multisession online interventions: Systematic review of practices and proposal for reporting standards. Journal of Medical Internet Research, 21(8), e14181. doi: 10.2196/14181CrossRefGoogle ScholarPubMed
Bennett, S. D., Cuijpers, P., Ebert, D. D., McKenzie Smith, M., Coughtrey, A. E., Heyman, I., … Shafran, R. (2019). Practitioner review: Unguided and guided self-help interventions for common mental health disorders in children and adolescents: A systematic review and meta-analysis. Journal of Child Psychology and Psychiatry and Allied Disciplines, 60(8), 828847. doi: 10.1111/jcpp.13010CrossRefGoogle ScholarPubMed
*Berger, T., Caspar, F., Richardson, R., Kneubuhler, B., Sutter, D., & Andersson, G. (2011b). Internet-based treatment of social phobia: A randomized controlled trial comparing unguided with two types of guided self-help. Behaviour Research and Therapy, 49(3), 158169. doi: 10.1016/j.brat.2010.12.007CrossRefGoogle ScholarPubMed
*Berger, T., Hammerli, K., Gubser, N., Andersson, G., & Caspar, F. (2011a). Internet-based treatment of depression: A randomized controlled trial comparing guided with unguided self-help. Cognitive Behaviour Therapy, 40(4), 251266. doi: 10.1080/16506073.2011.616531CrossRefGoogle ScholarPubMed
*Campos, D., Bretón-López, J., Botella, C., Mira, A., Castilla, D., Mor, S., … Quero, S. (2019). Efficacy of an internet-based exposure treatment for flying phobia (NO-FEAR Airlines) with and without therapist guidance: A randomized controlled trial. BMC Psychiatry, 19(1), 116. doi: 10.1186/s12888-019-2060-4CrossRefGoogle ScholarPubMed
Castro, A., López-del-Hoyo, Y., Peake, C., Mayoral, F., Botella, C., García-Campayo, J., … Gili, M. (2018). Adherence predictors in an Internet-based Intervention program for depression. Cognitive Behaviour Therapy, 47(3), 246261. doi: 10.1080/16506073.2017.1366546CrossRefGoogle Scholar
Chen, H., Rodriguez, M. A., Qian, M., Kishimoto, T., Lin, M., & Berger, T. (2020). Predictors of treatment outcomes and adherence in internet-based cognitive behavioral therapy for social anxiety in China. Behavioural and Cognitive Psychotherapy, 48(3), 291303. doi: 10.1017/S1352465819000730CrossRefGoogle ScholarPubMed
Christensen, H., Griffiths, K. M., & Farrer, L. (2009). Adherence in internet interventions for anxiety and depression: Systematic review. Journal of Medical Internet Research, 11(2), e13. doi: 10.2196/jmir.1194CrossRefGoogle Scholar
Christensen, H., & Mackinnon, A. (2006). The law of attrition revisited. Journal of Medical Internet Research, 8(3), e20; author reply e21. doi: 10.2196/jmir.8.3.e20CrossRefGoogle ScholarPubMed
Cochran, W. G. (1954). The combination of estimates from different experiments. Biometrics, 10(1), 101129. doi: 10.2307/3001666CrossRefGoogle Scholar
*Dear, B. F., Fogliati, V. J., Fogliati, R., Johnson, B., Boyle, O., Karin, E., … Titov, N. (2018). Treating anxiety and depression in young adults: A randomised controlled trial comparing clinician-guided versus self-guided internet-delivered cognitive behavioural therapy. Australian and New Zealand Journal of Psychiatry, 52(7), 668679. doi: 10.1177/0004867417738055CrossRefGoogle ScholarPubMed
*Dear, B. F., Staples, L. G., Terides, M. D., Fogliati, V. J., Sheehan, J., Johnston, L., … Titov, N. (2016). Transdiagnostic versus disorder-specific and clinician-guided versus self-guided internet-delivered treatment for social anxiety disorder and comorbid disorders: A randomized controlled trial. Journal of Anxiety Disorders, 42, 3044. doi: 10.1016/j.janxdis.2016.05.004CrossRefGoogle ScholarPubMed
*Dear, B. F., Staples, L. G., Terides, M. D., Karin, E., Zou, J., Johnston, L., … Titov, N. (2015). Transdiagnostic versus disorder-specific and clinician-guided versus self-guided internet-delivered treatment for generalized anxiety disorder and comorbid disorders: A randomized controlled trial. Journal of Anxiety Disorders, 36, 6377. doi: 10.1016/j.janxdis.2015.09.003CrossRefGoogle ScholarPubMed
Domhardt, M., Gesslein, H., von Rezori, R. E., & Baumeister, H. (2019). Internet- and mobile-based interventions for anxiety disorders: A meta-analytic review of intervention components. Depression and Anxiety, 36(3), 213224. doi: 10.1002/da.22860CrossRefGoogle ScholarPubMed
Donkin, L., Christensen, H., Naismith, S. L., Neal, B., Hickie, I. B., & Glozier, N. (2011). A systematic review of the impact of adherence on the effectiveness of e-therapies. Journal of Medical Internet Research, 13(3), e52. doi: 10.2196/jmir.1772CrossRefGoogle ScholarPubMed
Duval, S., & Tweedie, R. (2000). Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56(2), 455463. doi: 10.1111/j.0006-341x.2000.00455.xCrossRefGoogle ScholarPubMed
Ebert, D. D., Buntrock, C., Lehr, D., Smit, F., Riper, H., Baumeister, H., … Berking, M. (2018). Effectiveness of web- and mobile-based treatment of subthreshold depression with adherence-focused guidance: A single-blind randomized controlled trial. Behavior Therapy, 49(1), 7183. doi: 10.1016/j.beth.2017.05.004CrossRefGoogle ScholarPubMed
Eysenbach, G. (2005). The law of attrition. Journal of Medical Internet Research, 7(1), e11. doi: 10.2196/jmir.7.1.e11CrossRefGoogle ScholarPubMed
*Farrer, L., Christensen, H., Griffiths, K. M., & Mackinnon, A. (2011). Internet-based CBT for depression with and without telephone tracking in a national helpline: Randomised controlled trial. PloS One, 6(11), e28099. doi: 10.1371/journal.pone.0028099CrossRefGoogle Scholar
Farvolden, P., Denisoff, E., Selby, P., Bagby, R. M., & Rudy, L. (2005). Usage and longitudinal effectiveness of a web-based self-help cognitive behavioral therapy program for panic disorder. Journal of Medical Internet Research, 7(1), e7. doi: 10.2196/jmir.7.1.e7CrossRefGoogle ScholarPubMed
*Fogliati, V. J., Dear, B. F., Staples, L. G., Terides, M. D., Sheehan, J., Johnston, L., … Titov, N. (2016). Disorder-specific versus transdiagnostic and clinician-guided versus self-guided internet-delivered treatment for panic disorder and comorbid disorders: A randomized controlled trial. Journal of Anxiety Disorders, 39, 88102. doi: 10.1016/j.janxdis.2016.03.005CrossRefGoogle ScholarPubMed
*Gershkovich, M., Herbert, J. D., Forman, E. M., Schumacher, L. M., & Fischer, L. E. (2017). Internet-delivered acceptance-based cognitive-behavioral intervention for social anxiety disorder with and without therapist support: A randomized trial. Behavior modification, 41(5), 583608. doi: 10.1177/0145445517694457CrossRefGoogle ScholarPubMed
*Gilbody, S., Brabyn, S., Lovell, K., Kessler, D., Devlin, T., & Smith, L., … collaborative, R. (2017). Telephone-supported computerised cognitive-behavioural therapy: REEACT-2 large-scale pragmatic randomised controlled trial. British Journal of Psychiatry, 210(5), 362367. doi: 10.1192/bjp.bp.116.192435CrossRefGoogle ScholarPubMed
Harbord, R. M., Egger, M., & Sterne, J. A. (2006). A modified test for small-study effects in meta-analyses of controlled trials with binary endpoints. Statistics in Medicine, 25(20), 34433457. doi: 10.1002/sim.2380CrossRefGoogle ScholarPubMed
Hedges, L. V. (1981). Distribution theory for Glass's estimator of effect size and related estimators. Journal of Educational Statistics, 6(2), 107128. doi: 10.3102/10769986006002107CrossRefGoogle Scholar
*Hedman, E., Axelsson, E., Andersson, E., Lekander, M., & Ljotsson, B. (2016). Exposure-based cognitive–behavioural therapy via the internet and as bibliotherapy for somatic symptom disorder and illness anxiety disorder: Randomised controlled trial. The British Journal of Psychiatry, 209(5), 407413. doi: 10.1192/bjp.bp.116.181396CrossRefGoogle ScholarPubMed
Higgins, J. P., Savović, J., Page, M. J., Elbers, R. G., & Sterne, J. A. (2019). Assessing risk of bias in a randomized trial. In Cochrane handbook for systematic reviews of interventions (pp. 205228). Chichester, England ; Hoboken, NJ: Wiley-Blackwell.CrossRefGoogle Scholar
Higgins, J. P., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003). Measuring inconsistency in meta-analyses. BMJ, 327(7414), 557560. doi: 10.1136/bmj.327.7414.557CrossRefGoogle ScholarPubMed
*Ho, F. Y., Chung, K. F., Yeung, W. F., Ng, T. H., & Cheng, S. K. (2014). Weekly brief phone support in self-help cognitive behavioral therapy for insomnia disorder: Relevance to adherence and efficacy. Behaviour Research and Therapy, 63, 147156. doi: 10.1016/j.brat.2014.10.002CrossRefGoogle ScholarPubMed
*Ivanova, E., Lindner, P., Ly, K. H., Dahlin, M., Vernmark, K., Andersson, G., … Carlbring, P. (2016). Guided and unguided acceptance and commitment therapy for social anxiety disorder and/or panic disorder provided via the internet and a smartphone application: A randomized controlled trial. Journal of Anxiety Disorders, 44, 2735. doi: 10.1016/j.janxdis.2016.09.012CrossRefGoogle ScholarPubMed
Kelders, S. M., Bohlmeijer, E. T., Pots, W. T., & van Gemert-Pijnen, J. E. (2015). Comparing human and automated support for depression: Fractional factorial randomized controlled trial. Behaviour Research and Therapy, 72, 7280. doi: 10.1016/j.brat.2015.06.014CrossRefGoogle ScholarPubMed
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012). Persuasive system design does matter: A systematic review of adherence to web-based interventions. Journal of Medical Internet research, 14(6), e152. doi: 10.2196/jmir.2104.CrossRefGoogle Scholar
Killaspy, H., Banerjee, S., King, M., & Lloyd, M. (2000). Prospective controlled study of psychiatric out-patient non-attendance. Characteristics and outcome. British Journal of Psychiatry, 176(2), 160165. doi: 10.1192/bjp.176.2.160CrossRefGoogle ScholarPubMed
*Kleiboer, A., Donker, T., Seekles, W., van Straten, A., Riper, H., & Cuijpers, P. (2015). A randomized controlled trial on the role of support in internet-based problem-solving therapy for depression and anxiety. Behaviour Research and Therapy, 72, 6371. doi: 10.1016/j.brat.2015.06.013CrossRefGoogle ScholarPubMed
Kobak, K. A., Greist, R., Jacobi, D. M., Levy-Mack, H., & Greist, J. H. (2015). Computer-assisted cognitive behavior therapy for obsessive-compulsive disorder: A randomized trial on the impact of lay vs. Professional coaching. Annals of General Psychiatry, 14(1), 10. doi: 10.1186/s12991-015-0048-0CrossRefGoogle ScholarPubMed
*Lancee, J., van den Bout, J., Sorbi, M. J., & van Straten, A. (2013). Motivational support provided via email improves the effectiveness of internet-delivered self-help treatment for insomnia: A randomized trial. Behaviour Research and Therapy, 51(12), 797805. doi: 10.1016/j.brat.2013.09.004CrossRefGoogle ScholarPubMed
Lillevoll, K. R., Vangberg, H. C., Griffiths, K. M., Waterloo, K., & Eisemann, M. R. (2014). Uptake and adherence of a self-directed internet-based mental health intervention with tailored e-mail reminders in senior high schools in Norway. BMC Psychiatry, 14(1), 14. doi: 10.1186/1471-244X-14-14CrossRefGoogle ScholarPubMed
Michie, S., Yardley, L., West, R., Patrick, K., & Greaves, F. (2017). Developing and evaluating digital interventions to promote behavior change in health and health care: Recommendations resulting from an international workshop. Journal of Medical Internet Research, 19(6), e232. doi: 10.2196/jmir.7126CrossRefGoogle ScholarPubMed
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group, . (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Medicine, 6(7), e1000097. doi: 10.1371/journal.pmed.1000097CrossRefGoogle ScholarPubMed
*Montero-Marin, J., Araya, R., Perez-Yus, M. C., Mayoral, F., Gili, M., Botella, C., … Garcia-Campayo, J. (2016). An internet-based intervention for depression in primary care in Spain: A randomized controlled trial. Journal of Medical Internet Research, 18(8), e231. doi: 10.2196/jmir.5695CrossRefGoogle ScholarPubMed
Musiat, P., & Tarrier, N. (2014). Collateral outcomes in e-mental health: A systematic review of the evidence for added benefits of computerized cognitive behavior therapy interventions for mental health. Psychological Medicine, 44(15), 31373150. doi: 10.1017/S0033291714000245CrossRefGoogle Scholar
Nyaga, V. N., Arbyn, M., & Aerts, M. (2014). Metaprop: A stata command to perform meta-analysis of binomial data. Archives of Public Health = Archives Belges De Sante Publique, 72(1), 39. doi: 10.1186/2049-3258-72-39CrossRefGoogle ScholarPubMed
Olthuis, J. V., Watt, M. C., Bailey, K., Hayden, J. A., & Stewart, S. H. (2016). Therapist-supported internet cognitive behavioural therapy for anxiety disorders in adults. Cochrane Database of Systematic Reviews, 3(3), CD011565. doi: 10.1002/14651858.CD011565.pub2Google ScholarPubMed
Pauley, D., Cuijpers, P., Papola, D., Miguel, C., & Karyotaki, E. (2021). Two decades of digital interventions for anxiety disorders: A systematic review and meta-analysis of treatment effectiveness. Psychological Medicine. Online ahead of print. doi: 10.1017/S0033291721001999CrossRefGoogle ScholarPubMed
Pennant, M. E., Loucas, C. E., Whittington, C., Creswell, C., Fonagy, P., Fuggle, P., … Expert Advisory, G. (2015). Computerised therapies for anxiety and depression in children and young people: A systematic review and meta-analysis. Behaviour Research and Therapy, 67, 118. doi: 10.1016/j.brat.2015.01.009CrossRefGoogle Scholar
Peters, J. L., Sutton, A. J., Jones, D. R., Abrams, K. R., & Rushton, L. (2006). Comparison of two methods to detect publication bias in meta-analysis. JAMA, 295(6), 676680. doi: 10.1001/jama.295.6.676CrossRefGoogle ScholarPubMed
*Proudfoot, J., Parker, G., Manicavasagar, V., Hadzi-Pavlovic, D., Whitton, A., Nicholas, J., … Burckhardt, R. (2012). Effects of adjunctive peer support on perceptions of illness control and understanding in an online psychoeducation program for bipolar disorder: A randomised controlled trial. Journal of Affective Disorders, 142(1–3), 98105. doi: 10.1016/j.jad.2012.04.007CrossRefGoogle Scholar
*Puolakanaho, A., Lappalainen, R., Lappalainen, P., Muotka, J. S., Hirvonen, R., Eklund, K. M., … Kiuru, N. (2019). Reducing stress and enhancing academic buoyancy among adolescents using a brief web-based program based on acceptance and commitment therapy: A randomized controlled trial. Journal of Youth and Adolescence, 48(2), 287305. doi: 10.1007/s10964-018-0973-8.CrossRefGoogle ScholarPubMed
Robinson, E., Titov, N., Andrews, G., McIntyre, K., Schwencke, G., & Solley, K. (2010). Internet treatment for generalized anxiety disorder: A randomized controlled trial comparing clinician vs. technician assistance. PLoS One, 5(6), e10942. doi: 10.1371/journal.pone.0010942CrossRefGoogle ScholarPubMed
Rogers, V. L., Griffin, M. Q., Wykle, M. L., & Fitzpatrick, J. J. (2009). Internet versus face-to-face therapy: Emotional self-disclosure issues for young adults. Issues in Mental Health Nursing, 30(10), 596602. doi: 10.1080/01612840903003520CrossRefGoogle ScholarPubMed
Schwarzer, G., Antes, G., & Schumacher, M. (2002). Inflation of type I error rate in two statistical tests for the detection of publication bias in meta-analyses with binary outcomes. Statistics in Medicine, 21(17), 24652477. doi: 10.1002/sim.1224CrossRefGoogle ScholarPubMed
Shim, M., Mahaffey, B., Bleidistel, M., & Gonzalez, A. (2017). A scoping review of human-support factors in the context of internet-based psychological interventions (IPIs) for depression and anxiety disorders. Clinical Psychology Review, 57, 129140. doi: 10.1016/j.cpr.2017.09.003CrossRefGoogle ScholarPubMed
Simpson, H. B., Marcus, S. M., Zuckoff, A., Franklin, M., & Foa, E. B. (2012). Patient adherence to cognitive-behavioral therapy predicts long-term outcome in obsessive-compulsive disorder. The Journal of Clinical Psychiatry, 73(9), 12651266. doi: 10.4088/JCP.12l07879CrossRefGoogle ScholarPubMed
StataCorp, LLC. (2019). Stata Statistical Software. Release 16.[software]. College Station, TX. In: Stata Press. Available at: https://www.stata.com/.Google Scholar
Sterne, J. A. C., Savovic, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., … Higgins, J. P. T. (2019). RoB 2: A revised tool for assessing risk of bias in randomised trials. BMJ, 366, l4898. doi: 10.1136/bmj.l4898CrossRefGoogle ScholarPubMed
Swift, J. K., & Greenberg, R. P. (2012). Premature discontinuation in adult psychotherapy: A meta-analysis. Journal of Consulting and Clinical Psychology, 80(4), 547559. doi: 10.1037/a0028226CrossRefGoogle ScholarPubMed
Titov, N., Andrews, G., Davies, M., McIntyre, K., Robinson, E., & Solley, K. (2010). Internet treatment for depression: A randomized controlled trial comparing clinician vs. technician assistance. PloS One, 5(6), e10939. doi: 10.1371/journal.pone.0010939CrossRefGoogle ScholarPubMed
*Titov, N., Andrews, G., Choi, I., Schwencke, G., & Johnston, L. (2009). Randomized controlled trial of web-based treatment of social phobia without clinician guidance. Australian & New Zealand Journal of Psychiatry, 43(10), 913919. doi: 10.1080/00048670903179160CrossRefGoogle Scholar
*Titov, N., Andrews, G., Choi, I., Schwencke, G., & Mahoney, A. (2008). Shyness 3: Randomized controlled trial of guided versus unguided internet-based CBT for social phobia. Australian and New Zealand Journal of Psychiatry, 42(12), 10301040. doi: 10.1080/00048670802512107CrossRefGoogle ScholarPubMed
*Titov, N., Dear, B. F., Staples, L. G., Terides, M. D., Karin, E., Sheehan, J., … McEvoy, P. M. (2015). Disorder-specific versus transdiagnostic and clinician-guided versus self-guided treatment for major depressive disorder and comorbid anxiety disorders: A randomized controlled trial. Journal of Anxiety Disorders, 35, 88102. doi: 10.1016/j.janxdis.2015.08.002CrossRefGoogle ScholarPubMed
*Titov, N., Fogliati, V. J., Staples, L. G., Gandy, M., Johnston, L., Wootton, B., … Dear, B. F. (2016). Treating anxiety and depression in older adults: Randomised controlled trial comparing guided v. self-guided internet-delivered cognitive-behavioural therapy. BJPsych Open, 2(1), 5058. doi: 10.1192/bjpo.bp.115.002139CrossRefGoogle ScholarPubMed
Webb, C. A., Derubeis, R. J., & Barber, J. P. (2010). Therapist adherence/competence and treatment outcome: A meta-analytic review. Journal of Consulting and Clinical Psychology, 78(2), 200211. doi: 10.1037/a0018912CrossRefGoogle ScholarPubMed
Westerhof, G. J., Lamers, S. M. A., Postel, M. G., & Bohlmeijer, E. T. (2019). Online therapy for depressive symptoms: An evaluation of counselor-led and peer-supported life review therapy. The Gerontologist, 59(1), 135146. doi: 10.1093/geront/gnx140CrossRefGoogle ScholarPubMed
Wind, T. R., Rijkeboer, M., Andersson, G., & Riper, H. (2020). The COVID-19 pandemic: The ‘black swan’ for mental health care and a turning point for e-health. Internet Interventions, 20, 100317. doi: 10.1016/j.invent.2020.100317CrossRefGoogle Scholar
Supplementary material: File

Musiat et al. supplementary material

Musiat et al. supplementary material

Download Musiat et al. supplementary material(File)
File 21.1 KB