Hostname: page-component-78c5997874-8bhkd Total loading time: 0 Render date: 2024-11-17T20:18:45.441Z Has data issue: false hasContentIssue false

Exploring potential mental health spillover effects among caregivers and partners of youth in Sierra Leone: A qualitative study

Published online by Cambridge University Press:  18 July 2023

Alethea Desrosiers*
Affiliation:
Department of Psychiatry and Human Behavior, Brown University, Providence, RI, USA
Carolyn Schafer
Affiliation:
Institute for Public Health and Medicine, Northwestern University, Evanston, IL, USA
Laura Bond
Affiliation:
Boston College School of Social Work, Chestnut Hill, MA, USA
Adeyinka Akinsulure-Smith
Affiliation:
Department of Psychology, City College of New York, NY, USA
Miriam Hinton
Affiliation:
Caritas Sierra Leone, Freetown, Sierra Leone
Alpha Vandi
Affiliation:
Caritas Sierra Leone, Freetown, Sierra Leone
Theresa S. Betancourt
Affiliation:
Boston College School of Social Work, Chestnut Hill, MA, USA
*
Corresponding author: Alethea Desrosiers; Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Given the large mental health treatment gap in low- and middle-income countries (LMICs), particularly in post-conflict settings like Sierra Leone, and the limited healthcare infrastructure, understanding the wider benefits of evidence-based mental health interventions within households is critical. This study explored potential mental health spillover effects – the phenomenon of beneficial effects among nonparticipants – among cohabitating caregivers and partners of youth who participated in an evidence-based mental health intervention in Sierra Leone. We recruited a sub-sample of cohabitating caregivers and partners (N = 20) of youth intervention participants; caregivers had enrolled in a larger study investigating indirect benefits of the evidence-based intervention in Sierra Leone (MH117359). Qualitative interviews were conducted at two time points to explore the following: (a) potential mental health spillover effects and (b) through which mechanisms spillover may have occurred. Two trained coders reviewed transcripts and analyzed qualitative data, assisted by MaxQDA. Qualitative findings suggested that spillover effects likely occurred and supported three potential mechanisms: decreased caregiving burden, behavior changes among Youth Readiness Intervention participants and improved interpersonal relationships. Mental health spillover effects may occur following youth intervention participation in a post-conflict LMIC. Investing in evidence-based services may offer indirect benefits that extend beyond those directly receiving services.

Topics structure

Type
Research Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2023. Published by Cambridge University Press

Impact statement

The mental health treatment gap continues to be a major problem in low- and middle-income countries (LMICs), and individuals who need mental health services struggle to access formal supports. Investigating how participation in mental health services could have a wider societal benefit through indirect pathways (e.g., household spillover effects) could help strengthen the case among government stakeholders to invest in mental health infrastructure and strengthen policies supporting mental health service provision. Spillover effects are the phenomenon of beneficial effects of an intervention experienced by nonparticipants. This article presents a deeper dive into how participation in a mental health intervention might have much wider benefits for society beyond the benefits for individual participants. We conducted interviews with caregivers of youth (aged 18–30) in Sierra Leone who participated in an evidence-based intervention, the Youth Readiness Intervention, to explore whether improvements in youth behavior and functioning helped to alleviate a sense of caregiver burden. Prior research on spillover effects has primarily focused on health effects rather than mental health. Providing evidence for the phenomenon of mental health spillover effects in a rural region of Sierra Leone could help influence decisions among policy makers to increase investments in mental health services in LMICs and other low-resource settings globally.

Exploring potential mental health spillover effects among caregivers and Partners of Youth in Sierra Leone: A qualitative study

Mental health disorders are one of the largest contributors to the global burden of disease among youth and adults (GBD 2019 Mental Disorders Collaborators, 2022). This burden is compounded in low- and middle-income countries (LMICs) and other low-resource settings due to the widening mental health treatment gap (Mathers and Loncar, Reference Mathers and Loncar2006; World Health Organization, 2008). While there are evidence-based mental health interventions that have demonstrated feasibility and effectiveness in LMICs (Barry et al., Reference Barry, Clarke, Jenkins and Patel2013; Betancourt et al., Reference Betancourt, McBain, Newnham, Akinsulure-Smith, Brennan, Weisz and Weisz2014; Fazel et al., Reference Fazel, Patel, Thomas and Tol2014), human and financial resource constraints can severely impede their reach and sustainability. For example, in Sierra Leone, a small country in West Africa that has endured numerous hardships (i.e., civil war, the Ebola epidemic, and political instability), the mental health treatment gap is estimated at 98% (Alemu et al., Reference Alemu, Funk, Gakaruh, Bash-Taqi, Bruni, Sinclair, Kobie, Muana, Samai and Eaton2012). Significant limitations in the nation’s health infrastructure have made it difficult to effectively address the unmet mental health needs of the population (Alemu et al., Reference Alemu, Funk, Gakaruh, Bash-Taqi, Bruni, Sinclair, Kobie, Muana, Samai and Eaton2012; Yoder et al., Reference Yoder, Tol, Reis and de Jong2016; Hopwood et al., Reference Hopwood, Sevalie, Herman, Harris, Collet, Bah and Beynon2021). In Sierra Leone, these limitations are further compounded by negative beliefs associated with poor mental health and the stigma regarding mental illness (Akinsulure-Smith and Conteh, Reference Akinsulure-Smith and Conteh2018). Gaining a better understanding of “whether” and “how” evidence-based mental health interventions might offer wider societal benefits and reach a larger segment of the population could help address resource constraints in LMICs and spur stakeholder investments in scaling out mental health interventions.

Accounting for spillover effects of evidence-based interventions across households and communities is one potential strategy to factor in wider societal benefits of mental health interventions. Spillover is the phenomenon of beneficial intervention effects to nonparticipants (Brouwer et al., Reference Brouwer, Tilford and Van Exel2009; Al-Janabi et al., Reference Al-Janabi, van Exel, Brouwer and Coast2016). Evidence-based mental health interventions delivered to youth may indirectly improve the mental health of other household members (Bobinac et al., Reference Bobinac, van Exel, Rutten and Brouwer2010; Bobinac et al., Reference Bobinac, van Exel, Rutten and Brouwer2011; Price et al., Reference Price, Roesch, Walsh and Landsverk2015). Research on spillover effects of mental health interventions is sparse (McBain et al., Reference McBain, Salhi, Hann, Kellie, Kamara, Salomon, Kim and Betancourt2015; Al-Janabi et al., Reference Al-Janabi, van Exel, Brouwer and Coast2016), particularly in low-resource settings, where maximizing benefit and minimizing cost are essential (Lancet Global Mental Health Group et al., Reference Chisholm, Flisher, Lund, Patel, Saxena, Thornicroft and Tomlinson2007; Chisholm et al., Reference Chisholm, Burman-Roy, Fekadu, Kathree, Kizza, Luitel, Petersen, Shidhaye, De Silva and Lund2016). With the high costs associated with improving the health of people with mental health problems in LMICs (Kieling et al., Reference Kieling, Baker-Henningham, Belfer, Conti, Ertem, Omigbodun, Rohde, Srinath, Ulkuer and Rahman2011; Pedersen et al., Reference Pedersen, Smallegange, Coetzee, Hartog, Turner, Jordans and Brown2019), measuring household spillover effects of mental health interventions could influence mental health policy decision-making and government investments in mental health service provision.

Studies on mental health spillover effects in high-income countries have found that family members living with individuals experiencing mental health problems report significantly poorer quality of life and health status, as well as poorer mental health (Henry and Cullinan, Reference Henry and Cullinan2021; Lee et al., Reference Lee, Kim and Devine2022). Considering that mental and/or behavioral issues in one family member can exacerbate the health and well-being of other household members, implementing/increasing access to evidence-based interventions to promote mental health and functioning among youth exhibiting mental health problems could “spillover” into the household and benefit primary caregivers and/or partners.

Preliminary quantitative data from one prior study in Sierra Leone indicate that caregivers of Sierra Leonean youth aged 15–24 who participated in an evidence-based mental health intervention – the Youth Readiness Intervention (YRI) – delivered within school settings (Betancourt et al., Reference Betancourt, McBain, Newnham, Akinsulure-Smith, Brennan, Weisz and Weisz2014) experienced reduced emotional distress and burden of care compared with caregivers of youth in the control condition (McBain et al., Reference McBain, Salhi, Hann, Kellie, Kamara, Salomon, Kim and Betancourt2015). Investigating household spillover effects of the YRI are highly relevant because the intervention has demonstrated effectiveness in improving emotion regulation skills, prosocial functioning and functional impairment among youth who received the intervention in school settings compared with control youth (Betancourt et al., Reference Betancourt, McBain, Newnham, Akinsulure-Smith, Brennan, Weisz and Weisz2014). Additionally, in a hybrid-implementation effectiveness trial of the YRI integrated within entrepreneurship training for high-risk Sierra Leonean youth aged 18–30, those who participated in the YRI reported significant improvements in depression and anxiety symptoms compared with control youth (Freeman et al., under review, see Betancourt et al., Reference Betancourt, Hansen, Farrar, Borg, Callands, Desrosiers, Antonaccio, Williams, Bangura and Brennan2021 for study protocol).

Based on our review of the literature, there are no other studies specifically on the spillover effects of mental health interventions in LMICs. While this prior study provides some initial support for the occurrence of mental health spillover effects within households in Sierra Leone, the specific mechanisms or pathways through which spillover effects occur remain unclear. Such health benefits might occur because improvements in the mental and/or behavioral health of one youth might improve overall household dynamics or because improved behavior of one youth might alleviate guilt or stress experienced by caregivers. Alternatively, youth who participate in an evidence-based mental health intervention might also teach skills that they learn to other household members, after which caregivers could potentially improve their own mental health by practicing these skills.

While both qualitative and quantitative approaches can be effectively used to assess the spillover effects of behavioral interventions, qualitative approaches may illuminate many of the unanticipated mechanisms of such effects (Galizzi and Whitmarsh, Reference Galizzi and Whitmarsh2019). Thus, a qualitative approach may be particularly useful in emerging research areas where there is a dearth of pre-existing theory or literature and where a better understanding of potential underlying pathways or mechanisms is needed.

Current study

This study used a qualitative approach to explore potential mechanisms of mental health spillover effects among primary caregivers of at-risk youth who participated in the YRI delivered within employment programming across rural regions of Sierra Leone. Caregivers of youth participants included partners/spouses, parents, aunts, uncles, and siblings, and all caregivers were interviewed at baseline and follow-up time points. Youth ranged in age from 18 to 30 and demonstrated poor emotion regulation and daily functioning (U19 MH109989). We explored the following questions based on the self-reported perceptions of primary caregivers: (a) whether mental health spillover effects occurred within households of youth who participated in the YRI; (b) potential contributing factors or mechanisms through which mental health spillover effects occurred; and (c) potential sustainment of spillover effects over time.

Methods

This qualitative study sample includes 20 cohabitating caregivers of youth who participated in the YRI, which was delivered within the context of entrepreneurship training from August through September 2019 (U19 MH109989). All youth who participated in the YRI exhibited difficulties with emotion regulation and daily functioning, as measured by elevated scores on the Difficulties in Emotion Regulation Scale (Gratz and Roemer, Reference Gratz and Roemer2004) and the World Health Organization Disability Assessment Schedule (WHO, 2014). The YRI is a culturally developed, 12-session evidence-based mental health intervention that incorporates core components of cognitive behavioral and interpersonal therapies to improve emotion regulation, problem-solving and interpersonal skills among youth experiencing compounded adversity (see Betancourt et al., Reference Betancourt, McBain, Newnham, Akinsulure-Smith, Brennan, Weisz and Weisz2014 for more detail). The YRI is delivered to groups of 10–12 same-gendered youth and can be feasibly delivered by lay health workers with quality. The YRI was integrated within an employment promotion program (EPP) created by Deutsche Gesellschaft für Internationale Zusammenarbeit, a German development agency that has worked with Sierra Leonean youth since 1963 (Betancourt et al., Reference Betancourt, Hansen, Farrar, Borg, Callands, Desrosiers, Antonaccio, Williams, Bangura and Brennan2021). In the EPP, youth were provided with entrepreneurship and employment skills training and given a stipend to offset costs associated with business start-up. Findings from this larger study are currently under review and indicate youth who participated in the YRI + EPP reported significant improvements in depression and anxiety compared with control youth at post-intervention (Freeman et al., under review). All study procedures were approved by the respective Institutional Review Boards.

Sampling and recruitment

We recruited youth who had participated in the hybrid-implementation effectiveness trial of the YRI delivered within the EPP (Youth FORWARD/U19 MH109989) to serve as “index participants” (N = 165 YRI + EPP participants; N = 165 control participants) for a closely linked study investigating the indirect benefits of the YRI among peers and cohabitating caregivers (R01 MH117359). Youth “index participants” were recruited across three rural districts in Sierra Leone; Koinadugu, Kailahun and Kono. After providing informed consent, youth “index participants” completed a short survey in which they identified their primary cohabitating caregiver and provided contact information for this individual. Primary cohabitating caregivers were defined as the person whom youth felt emotionally closest to and was primarily responsible for looking after their well-being (Desrosiers et al., Reference Desrosiers, Kumar, Dayal, Alex, Akram and Betancourt2020), and thus family members could be nominated or other household members, such as a spouse or romantic partner. Nominated caregivers (N = 284) were then recruited and enrolled in the larger study investigating the indirect benefits of the YRI among peers and caregivers (R01 MH117359). To select the sub-sample of caregivers for participation in qualitative interviews in the current study, we used a multivariate sampling matrix in which caregivers were stratified based on age, gender and district of residence (N = 20).

Eligibility

Inclusion criteria for caregivers were that they should (a) identify as a primary adult caregiver (aged 18 or older) of a Youth FORWARD study participant; and (b) reside in the household of a Youth FORWARD participant. Exclusion criteria were (a) not residing in the household of a YRI participant; (b) severe, active suicidality or psychosis as assessed via the MINI-SCID; and (c) serious cognitive impairments that might inhibit one’s ability to comprehend informed consent and participate in the interview. Caregivers who reported active suicidality or symptoms of psychosis were referred for immediate mental health services and followed up by the study social worker. There were no risk of harm cases reported for this sub-sample of caregivers.

Data collection

Qualitative interviews with caregivers were conducted by trained research assistants using a semi-structured interview guide at two different time points. Interviews were conducted in Krio, the predominant local language, or in the local dialect that caregivers felt most comfortable speaking in if they were not fluent in Krio. Interviews focused on exploring (a) whether mental health spillover effects had occurred following youth participation in the YRI; (b) potential mechanisms through which spillover effects may have occurred (i.e., reduced sense of caregiving burden and improved household dynamics); and (c) potential sustainment of spillover effects over time. The semi-structured guide included questions such as the following:

  1. 1) How did having (participant’s name) in the program affect how you felt?

  2. 2) Have you noticed any changes in how you feel since (participant’s name) completed the YRI program? If so, what changes have you noticed? Why do you think you feel differently?

  3. 3) What, if any, change did you observe from (participant’s name) participation in the YRI?

  4. 4) How did having (participant’s name) in the program affect the household relationships between everyone who lives here? Have you noticed changes in the household? If so, what is different? How was it before?

All interviews were audio-recorded. The first interview was completed at the post-YRI assessment timepoint (all youth participants had completed the YRI), between September 2019 and January 2020. A follow-up interview was completed between December 2020 and January 2021. The purpose of the two time points was to explore whether any changes had occurred over time in terms of reported spillover effects. In addition, follow-up interviews allowed the research team to assess if reported changes after the YRI had been sustained over time. Interviews ranged from 30 to 60 min in duration, and caregivers were compensated for their time via a household gift (cooking oil, soap, rice etc.) worth SLL 30,000.

Data analysis

Forty interview transcripts were first transcribed in Sierra Leonean Krio (or Mende) and translated to English with all identifying information removed. Translations were cross-checked by another native Sierra Leonean Krio speaker. A combination of grounded theory along with thematic content analysis was used for data analysis (Strauss, Reference Strauss1987; Anderson, Reference Anderson2007). In this approach, themes were derived from the data itself but guided by the research questions. Before beginning the data analysis process, two research team members read each transcript in depth and used an “open coding” method to write memos and notes on the themes and patterns emerging from the data. Next, team members discussed the themes and placed them into categories according to the research questions. Categories were encompassed in a three-level codebook, guided by the Boyatzis’ approach (Boyatzis, Reference Boyatzis1998), in which there are levels of codes, definitions and examples for each code, and inclusion and exclusion criteria for each code. The codebook was developed through an iterative process that required team members to develop and test several versions of the codebook on a subset of transcripts until the codebook was finalized. Once the codebook was finalized, inter-coder reliability was tested between the two coders on a subset of transcripts (n = 3) (MacPhail et al., Reference MacPhail, Khoza, Abler and Ranganathan2016; O’Connor and Joffe, Reference O’Connor and Joffe2020). After satisfactory inter-coder reliability was reached, team members finished coding transcripts separately. All coding was completed in MaxQDA (VERBI Software, 2021). Throughout the coding process, before and after establishing inter-coder reliability, team members met weekly to discuss transcript memos and any difficulties with thematic content analysis in sections of transcripts. After coding was completed, team members used axial coding to identify key relationships between and within themes.

Results

Nominated caregivers of YRI participants were related to participants in a variety of ways, including mothers (N = 6), fathers, (N = 2) spouses/intimate partners (N = 7), aunts/uncles (N = 3), an older friend (N = 1) or a sibling (N = 1). Ages of YRI participants ranged from 18 to 30, and ages of caregivers ranged from 24 to 58. Individuals were sampled from Kailahun, Kono and Koinadugu districts of Sierra Leone, and each YRI participant lived in the same district as their nominated caregiver. The average household size was seven members per household. Most caregivers and YRI participants identified farming as their primary income-generating activity, though other income-generating activities included petty trading and mining. Very few caregivers or YRI participants had finished senior secondary school, and many reported no formal education at all. All identified caregivers participated in both the post-YRI and the follow-up interviews. See Table 1 for full demographic details of primary cohabitating caregiver (e.g., mother, father, spouse, sibling, aunt, and uncle) and youth participant dyads in the study.

Table 1. Demographic data for caregivers and youth participants

Abbreviation: YRI, Youth Readiness Intervention.

Results of qualitative analysis suggested that mental health spillover effects likely occurred among YRI participants’ caregivers, based on their self-reported perceptions. Results also supported three potential mechanisms through which spillover effects occurred: reduced burden of care, behavior changes in YRI participants and improved interpersonal relationships. Figure 1 represents a model of the spillover effects experienced by caregivers.

Figure 1. Mechanisms contributing to mental health spillover effects among caregivers.

Mental health spillover effects

Improved sense of caregiver well-being

Based on the caregiver reports, a reduced sense of burden, changes in YRI participant behavior and improved interpersonal relationships contributed to improvements in caregivers’ emotional well-being over time. Caregivers frequently used the term “happiness” to describe their improved sense of well-being. When asked about their interaction with YRI participants before the intervention, most caregivers, regardless of the type of caregiving relationship, discussed feeling stressed due to difficulties with youth behavior and mood. For example, “A parent would not want to hear people saying every day, ‘Look your child has caused trouble, your child has done that’, a parent does not want that” (father of YRI participant). Similarly, an intimate partner stated, “You know that, whenever there is quarrel you will not feel good…My heart was pounding and when I sit, I was thinking about it. That was how it happened to me” (husband of YRI participant).

When caregivers described changes in the YRI participant’s behaviors, they described the changes in their emotional well-being and happiness as directly linked to these changes in youth behavior:

So, my happiness is because of his concentration now, he has partaken in this program. And I’m praying that they concentrate, let his heart be in it and let him do it better than (before)

(father of YRI participant).

As she has participated in the program… Now I am feeling good, and as I sit, I smile about it. Now we sit and have fun together. When people are seeing us together, they are saying husband and wife are having fun and there is time for everything

(husband of YRI participant).

Mechanisms of spillover effects

Reduced burden of care

Caregivers spoke about the YRI participants in relation to their caregiving burden before and after youth participation in the YRI. During follow-up interviews, caregivers provided similar examples of reduced burden of care and stated that these effects had continued between interview timepoints. Caregivers described how the YRI participant’s behavior had caused a sense of burden prior to their participation in the YRI and EPP, which was largely related to poor engagement in school and work: “He was a man I sent to school, he didn’t go, I sent him to the Arabic school, he didn’t go” (father of YRI participant) and “Previously, when I would tell him, like, ‘(Index Participant) you should go to the farm’, he would ask, ‘Who?’ and he would not go” (mother of YRI participant). After YRI participation, caregivers described a sense of “happiness” and an alleviated sense of burden because the youth increased their engagement in household responsibilities (i.e., caring for other members of the household) and attending school and work. One caregiver, YRI participant’s uncle, described this at timepoint 1:

It has really made me feel good, because I’m no longer doing what I used to do in my house – waking up the children, to tell them what next… I think I’m now resting; she is the one that has taken up such responsibility.

Eight months later in the follow-up interview, this uncle stated,

She is helping me at the house…. She understands me now, she knows when I am broke and so she will step in and prepare food. Before the YRI, no – you would not even see her close to the kitchen. She didn’t like cooking or laundry, but now she does. These are the changes I have experienced with her.

Behavior changes from YRI participants

When asked about youth behaviors before and after participating in the YRI, caregivers gravitated toward speaking about the youth participant’s mood, drinking and smoking habits, disobedience, and engagement in education. Caregivers provided examples of perceived improvements in each of these behaviors, which were sustained at follow-up. Many caregivers described the youth participant before the YRI as temperamental and quick to quarrel, “She used to be very hot tempered” (mother of YRI participant) and “…she was not a kind person, she does not care about people… and she will also become angry when you bring up issues to her” (aunt of YRI participant). Caregivers of male YRI participants spoke about youth drinking alcohol and smoking marijuana. These behaviors were often described with a negative connotation and attributed to the YRI participants’ overall lack of engagement;

Well at the time he was drinking, he would go and misbehave with his colleagues and bring the problem to me. Or when he smokes, he would go and misbehave with his colleagues and then bring that problem to me

(brother of YRI participant).

Caregivers described YRI participants as uncooperative and disrespectful before attending the YRI. One caregiver, a YRI participant’s mother, stated, “Previously… he was not listening to my advice, and wouldn’t do anything I do him to do for me. He had no respect for me, and was confrontational…but he has now changed.” YRI participants were described as behaving better and being more respectful at both timepoints. This caregiver also referenced the sustained behavior changes observed among youth and stated in the follow-up interview, “As I explained during the last time you came, (YRI participant) has changed from the way he used to behave. He still heeds my advice.

Caregivers mentioned a lack of engagement in the household among youth and said that they were often “going out” of the house before participating in the YRI. This was also described as the YRI participant being “wayward” during the post-YRI interview: “…at first she was wayward and that was the lifestyle. Roaming about. I see now she is not roaming about anymore. When she comes back, she stays at home” (mother of YRI participant). At follow-up, the same caregiver stated, “since she went to the training, she has not been roaming about anymore.

Caregivers expressed concern over the YRI participants’ lack of involvement in formal and informal educational opportunities prior to YRI participation and discussed how youth were more engaged in school after completing the YRI (at both post-YRI and follow-up timepoints). For example, one caregiver stated, “When I sent him to school, he did not go further with it, he has no skill” (father of YRI participant). Similarly, a YRI participant’s mother stated, “…Before it was not easy to take her book and study, but now I do see her reading her book sometimes at night.

Improved household dynamics/interpersonal relationships

All caregivers described improvements in their relationships with YRI participants. Caregivers provided examples of increases in comradery, more effective communication with less quarreling and mutual encouragement during both interview timepoints. Additionally, caregivers explained positive changes in how YRI participants related with other adults and siblings in the household, decreased conflict or behavioral issues within the greater community and shifts in peer relationships that were perceived as positive.

Six caregivers described situations in which YRI participants demonstrated improved interpersonal functioning that contributed to increased experiences of positive emotions and a sense of well-being among caregivers. For example, one husband of a participant explained his relationship with his wife post-YRI, “Now she encourages me, and it (is) very difficult for us to get into (a) quarrel.” Eight months later, he described their relationship again as follows: “she has stopped quarreling and she talks nicely to me. Her friends have also started spending more time with her. I visit their husbands and we all laugh and play together.

Another caregiver provided an example of his niece offering emotional support after her time in the YRI:

She would even come to me and ask, “Uncle, what happened, is it any problem at your work?” But I would tell her no, and she would say, “It’s because I see that you are sad…” and she would joke with me so that I would feel happy

(uncle of YRI participant).

Six caregivers mentioned scenarios in which YRI participants demonstrated more thoughtfulness and respect in their relationships with caregivers, which contributed to reduced hostility and increased positive emotions. For example, one YRI participant’s wife described her relationship with her husband after his participation in the YRI:

He and I were not united until this program came and he started attending… on the other occasion, we nearly quarreled as he was about to go for the program. They started the training…when he came from there, he started talking to me nicely; the other time, he even apologized to me.” She continues to say “At first, we (didn’t) relate well, but now, we sit together and chat, play and laugh. He no longer beats me. Have you seen?”

(wife of YRI participant).

Nine caregivers provided examples of their households becoming more peaceful and less stressful as YRI participants began helping other household adults with household chores, or speaking more respectfully. Caregivers used the phrase “cordial” and “peaceful” to describe the household environment as a result of the YRI participant’s behavior. One caregiver described how the YRI participant improved his relationships with household members:

When (he) came from the program… I have said it, not only me and my children have seen the changes in him, everyone at home has seen it, even his tenants. He takes care of my relatives, there is no problem between them though it was not like that. Before he participated in this training, my relatives were afraid of him and he was not speaking with them but now… the girl who was standing here is my younger sister. Now they play and laugh (uncle of YRI participant, age 41). In the follow-up interview, he told the interviewer, “Since the last time you came here, I still notice the same changes.”

Finally, caregivers offered examples of positive changes between YRI participants and others in the community or in their peer groups. Six caregivers reflected on comments from community members regarding the YRI participants’ behavior in the community. For example, one YRI participant’s mother stated that neighbors had complained about the YRI participant prior to their participation in the intervention, but now they no longer complained. Another caregiver recalled how the YRI participant had been unreliable at their workplace and how they used to hear gossip around town about this person’s behavior, but “now all of that has changed” after the YRI (wife of YRI participant).

Regarding peer relationships, many caregivers expressed gratitude and relief that youth were no longer hanging around with peers perceived as bad influences, which contributed to caregivers experiencing less stress. For example, one caregiver stated, “when we say, don’t go (with bad friends), he won’t go there; he now heeds our advice. I am really happy about that” (mother of YRI participant).

Discussion

This study used a qualitative approach to better understand potential mechanisms of mental health spillover effects among cohabitating partners and caregivers of youth who participated in an evidence-based mental health intervention in rural regions of Sierra Leone. Findings show that caregivers and partners experienced an improved sense of general well-being related to improvements that they observed in youth behavior and functioning following YRI participation. Although results should be interpreted with caution given the small sample size, findings from the eight-month follow-up interviews suggest that mental health spillover effects appeared to be sustained over time. The current study fills gaps in prior quantitative studies investigating mental health spillover effects by identifying several specific mechanisms through which the reported mental health spillover effects occurred among cohabitating caregivers and partners.

Caregivers attributed their reduced sense of strain and burden to behavioral changes in the youth participant, reduced burden of care and improved relationships with YRI participants. These findings are consistent with prior quantitative research indicating that caregivers of youth participating in the YRI in Sierra Leone reported significant reductions in the sense of caregiving burden post-intervention compared with caregivers of control youth (McBain et al., Reference McBain, Salhi, Hann, Kellie, Kamara, Salomon, Kim and Betancourt2015). Qualitative findings deepen prior research by highlighting improvements in youth behavior as a potential mechanism through which caregivers and partners experience a reduced sense of caregiving burden, and reduced sense of burden as a potential mechanism driving overall improvements in caregiver/partner well-being.

Caregivers typically associated reduced burden of care with tangible changes in the ways that YRI participants assisted with household chores or income-generating activities. Other studies in LMICs which examine the connection of mental health with economic and instrumental support in the home are broadly consistent with these findings (Naidoo et al., Reference Naidoo, Nyembezi, Thomas, Lachman and Kagee2019; Knapp and Wong, Reference Knapp and Wong2020; Zimmerman et al., Reference Zimmerman, Garman, Avendano-Pabon, Araya, Evans-Lacko, McDaid, Park, Hessel, Diaz, Matijasevich, Ziebold, Bauer, Paula and Lund2021).

As caregivers and partners reported improvements in relationships with YRI participants, they also discussed positive changes in overall household dynamics as a function of YRI participation. Family and household dynamics are generally associated with improved mental health outcomes for caregivers (Puffer et al., Reference Puffer, Healy, Green, Giusto, Kaiser, Patel and Ayuku2020). Improved household dynamics are notable given that the average household size was seven people. In the rural regions of Sierra Leone where this study was conducted, houses are typically small and crowded, with 55% of households consisting of one or two rooms and most including young children (Macarthy et al., Reference Macarthy, Kanneh and Turay2017). Given that caregivers and partners did not explicitly report that youth participants shared skills or techniques that they learned from the YRI with family members, findings suggest that improving the functioning of one household member struggling with emotional/behavioral difficulties or mental health problems may have a much wider benefit via spillover effects. Future research should better explore the wider benefits of evidence-based mental health interventions for other household members occurring via spillover as well as through which mechanisms these occur. Because Sierra Leone is a collectivist culture (Hofstede, Reference Hofstede2020), where the concept of family often extends far beyond the nuclear family, including non-biological relations, the potential to leverage the phenomenon of mental health spillover effects to expand the reach of evidence-based mental health interventions across a wider segment of society may be greater there, as well as in other collectivist cultures throughout the world.

Extant data demonstrates that mental health and behavior-change outcomes post-interventions in LMICs can be sustained over the long term (Nadkarni et al., Reference Nadkarni, Weiss, Weobong, McDaid, Singla, Park, Bhat, Katti, McCambridge, Murthy, King, Wilson, Kirkwood, Fairburn, Velleman and Patel2017; Weobong et al., Reference Weobong, Weiss, McDaid, Singla, Hollon, Nadkarni, Park, Bhat, Katti, Anand, Dimidjian, Araya, King, Vijayakumar, Wilson, Velleman, Kirkwood, Fairburn and Patel2017; Pilling et al., Reference Pilling, Fonagy, Allison, Barnett, Campbell, Constantinou, Gardner, Lorenzini, Matthews, Ryan, Sacchetti, Truscott, Ventura, Watchorn, Whittington and Kendall2020). Future research is needed to better unpack the mechanisms that might facilitate and support the sustainment of mental health benefits over time, including those occurring indirectly through spillover effects, which can in turn extend the reach of evidence-based interventions to a larger proportion of the population.

Limitations

This study has several limitations to note. First, the relatively small sample size of participants who resided in a very rural region of Sierra Leone limits the generalizability of study finds to other populations in LMICs or other resource-constrained settings, such as those residing in more urban areas, those with higher levels of education or household income, or those with greater access to technology and network connectivity. Finally, it is important to acknowledge that the YRI was delivered as a component of an entrepreneurship program. Our qualitative interviewers were trained to focus the interviews specifically on YRI participation. The interview guide contained a preamble that clearly described that the focus of the interview was to understand the spillover effects of the YRI and not the employment programming. If caregivers shared observations that appeared to reflect participation in the employment programming (EPP) component, interviewers asked the caregiver to clarify which program they were referring to. Data analysts coded any references to the EPP so that data linked to these codes could be excluded from the current study. Despite these efforts, it is possible that some caregivers were unable to distinguish which program component facilitated the observed changes in YRI participants’ behavior and therefore some results may be related to EPP participation and not be solely attributed to YRI participation. Future analyses on mental health spillover effects in LMICs would benefit from including additional household members in qualitative data collection and also from better exploring the potential influence of cultural factors on the phenomenon of mental health spillover effects. For example, stigma regarding mental illness in Sierra Leone (Akinsulure-Smith and Conteh, Reference Akinsulure-Smith and Conteh2018) could impact the extent to which caregivers may openly discuss their feelings of anxiety, stress or depression related to caregiving burdens.

Despite these limitations, our study also includes several strengths, such as our longitudinal study design with two data collection points and our retention rate (19/20 interviews completed at follow-up). The longitudinal study design allowed us to understand caregiver beliefs and attitudes after the intervention was delivered, when changes in YRI participants may have been most noticeable, as well as how mental health spillover effects might be diminished or sustained over time. Further, nominated caregivers represented a variety of relationship types, ranging from spouse/partner, to mother to sibling, thus expanding the conceptualization of who might experience mental health spillover effects in a low-resource, rural region of Sierra Leone.

Conclusions

Based on self-reports of primary cohabitating caregivers of youth who participated in an evidence-based mental health intervention, (a) caregivers experienced mental health spillover effects following youth participation in the evidence-based mental health intervention linked with employment programming; and (b) mental health spillover effects appeared to be sustained over time. In a setting like Sierra Leone where mental health issues are highly stigmatized, attending to and utilizing such spillover effects can provide bonus mental health support without the associated stigma. The mechanisms of spillover effects occurring in the YRI and similar evidence-based mental health interventions may help address the challenge of delivering innovative interventions with sufficient breadth and depth to benefit large populations or large geographic areas in LMICs and other low-resource settings. Evidence for mental health spillover effects among caregivers and partners may spur further research quantifying the indirect benefits of mental health interventions among household members and across wider social networks, including factoring mental health spillover effects into future cost-effectiveness analysis. This information could serve to influence policymakers’ decisions to increase investments in mental health services and the infrastructure to support them in LMICs.

Open peer review

To view the open peer review materials for this article, please visit http://doi.org/10.1017/gmh.2023.36.

Data availability statement

The datasets used and analyzed in the current study can be made available upon reasonable request to the Principal Investigator.

Author contribution

All authors made substantial contributions to (a) the conception or design of the work; and/or (b) acquisition of the data; and/or (c) analysis and interpretation of the data for the manuscript. All authors contributed to drafting and/or revising the manuscript critically for important intellectual content. All authors provided final approval of the version to be published and agree to be accountable for all aspects of the work.

Financial support

This study was funded by the National Institute of Mental Health (Grant No. R01 MH117359).

Competing interest

The authors declare that they have no competing interest.

Ethics standard

This study received ethical approval from the Boston College Institutional Review Board and the Sierra Leone Ethics and Scientific Review Committee.

References

Akinsulure-Smith, AM and Conteh, JA (2018) The emergence of counseling in Sierra Leone. Journal of Counseling & Development 96(3), 327334.CrossRefGoogle Scholar
Alemu, W, Funk, M, Gakaruh, T, Bash-Taqi, D, Bruni, A, Sinclair, J, Kobie, A, Muana, A, Samai, M and Eaton, J (2012) WHO Profile on Mental Health in Development (WHO proMIND): Sierra Leone. Geneva: World Health Organization. Available at https://extranet.who.int/mindbank/item/1232 (accessed 28 November 2022).Google Scholar
Al-Janabi, H, van Exel, J, Brouwer, W and Coast, J (2016) A framework for including family health spillovers in economic evaluation. Medical Decision Making: An International Journal of the Society for Medical Decision Making 36(2), 176186.CrossRefGoogle ScholarPubMed
Anderson, R (2007) Thematic content analysis (TCA): Descriptive presentation of qualitative data, 1–4. Available at http://rosemarieanderson.com/wp-content/uploads/2014/08/ThematicContentAnalysis.pdf.Google Scholar
Barry, MM, Clarke, AM, Jenkins, R and Patel, V (2013) A systematic review of the effectiveness of mental health promotion interventions for young people in low- and middle- income countries. BMC Public Health 13, 835.CrossRefGoogle ScholarPubMed
Betancourt, TS, Hansen, N, Farrar, J, Borg, RC, Callands, T, Desrosiers, A, Antonaccio, CM, Williams, MJ, Bangura, J and Brennan, RT (2021) Youth functioning and organizational success for West African Regional Development (Youth FORWARD): Study protocol. Psychiatric Services (Washington, DC) 72(5), 563570.CrossRefGoogle ScholarPubMed
Betancourt, TS, McBain, R, Newnham, EA, Akinsulure-Smith, AM, Brennan, RT, Weisz, JR and Weisz, JR (2014) A behavioral intervention for war-affected youth in Sierra Leone: A randomized controlled trial. Journal of the American Academy of Child and Adolescent Psychiatry 53(12), 12881297.CrossRefGoogle ScholarPubMed
Bobinac, A, van Exel, NJ, Rutten, FF and Brouwer, WB (2010) Caring for and caring about: Disentangling the caregiver effect and the family effect. Journal of Health Economics 29(4), 549556.CrossRefGoogle ScholarPubMed
Bobinac, A, van Exel, NJ, Rutten, FF and Brouwer, WB (2011) Health effects in significant others: Separating family and care-giving effects. Medical Decision Making: An International Journal of the Society for Medical Decision Making 31(2), 292298.CrossRefGoogle ScholarPubMed
Boyatzis, RE (1998) Transforming Qualitative Information: Thematic Analysis and Code Development. Thousand Oaks, CA: Sage Publications, Inc.Google Scholar
Brouwer, WBF, Tilford, M, Van Exel, NJA (2009) Incorporating Caregiver and Family Effects in Economic Evaluations in Child Health. Oxford: Oxford Press.CrossRefGoogle Scholar
Chisholm, D, Burman-Roy, S, Fekadu, A, Kathree, T, Kizza, D, Luitel, NP, Petersen, I, Shidhaye, R, De Silva, M and Lund, C (2016) Estimating the cost of implementing district mental healthcare plans in five low- and middle-income countries: The PRIME study. The British Journal of Psychiatry: The Journal of Mental Science 208(Suppl 56), s71s78.CrossRefGoogle ScholarPubMed
Desrosiers, A, Kumar, P, Dayal, A, Alex, L, Akram, A and Betancourt, T (2020) Diffusion and spillover effects of an evidence-based mental health intervention among peers and caregivers of high-risk youth in Sierra Leone: Study protocol. BMC Psychiatry 20(1), 85.CrossRefGoogle ScholarPubMed
Fazel, M, Patel, V, Thomas, S and Tol, W (2014) Mental health interventions in schools in low-income and middle-income countries. Lancet Psychiatry 1(5), 388398.CrossRefGoogle ScholarPubMed
Galizzi, MM and Whitmarsh, L (2019) How to measure behavioral spillovers: A methodological review and checklist. Frontiers in Psychology 10, 342.CrossRefGoogle ScholarPubMed
GBD 2019 Mental Disorders Collaborators (2022) . Global, regional, and national burden of 12 mental disorders in 204 countries and territories, 1990–2019: A systematic analysis for the global burden of disease study 2019. The Lancet Psychiatry 9(2), 137150.CrossRefGoogle Scholar
Gratz, K and Roemer, L (2004) Multidimensional assessment of emotion regulation and dysregulation: Development, factor structure, and initial validation of the difficulties in emotion regulation scale. Journal of Psychopathology and Behavioral Assessment 26(1), 4154. https://doi.org/10.1023/B:JOBA.0000007455.08539.94CrossRefGoogle Scholar
Henry, E and Cullinan, J (2021) Mental health spillovers from serious family illness: Doubly robust estimation using EQ-5D-5L population normative data. Social Science & Medicine 279, 113996.CrossRefGoogle ScholarPubMed
Hofstede, G (2020) Country comparison: Sierra Leone. Available at https://www.hofstede-insights.com/country-comparison/sierra-leone/ (accessed 9 March 2020).Google Scholar
Hopwood, H, Sevalie, S, Herman, MO, Harris, D, Collet, K, Bah, AJ and Beynon, F (2021) The burden of mental disorder in Sierra Leone: A retrospective observational evaluation of programmatic data from the roll out of decentralised nurse-led mental health units. International Journal of Mental Health Systems 15, 31. https://doi.org/ 10.1186/s13033-021-00455-1CrossRefGoogle ScholarPubMed
Kieling, C, Baker-Henningham, H, Belfer, M, Conti, G, Ertem, I, Omigbodun, O, Rohde, LA, Srinath, S, Ulkuer, N and Rahman, A (2011) Child and adolescent mental health worldwide: Evidence for action. Lancet (London, England) 378(9801), 15151525.CrossRefGoogle ScholarPubMed
Knapp, M and Wong, G (2020) Economics and mental health: The current scenario. World Psychiatry: Official Journal of the World Psychiatric Association (WPA) 19(1), 314.CrossRefGoogle ScholarPubMed
Lancet Global Mental Health Group, Chisholm, D, Flisher, AJ, Lund, C, Patel, V, Saxena, S, Thornicroft, G and Tomlinson, M (2007) Scale up services for mental disorders: A call for action. Lancet (London, England) 370(9594), 12411252.Google Scholar
Lee, D, Kim, Y and Devine, B (2022) Spillover effects of mental health disorders on family members’ health-related quality of life: Evidence from a US sample. Medical Decision Making: An International Journal of the Society for Medical Decision Making 42(1), 8093.CrossRefGoogle ScholarPubMed
Macarthy, JM, Kanneh, L and Turay, J (2017) Sierra Leone 2015 Population and Housing Census: Thematic Report on Housing Conditions. Statistics Sierra Leone.Google Scholar
MacPhail, C, Khoza, N, Abler, L and Ranganathan, M (2016) Process guidelines for establishing intercoder reliability in qualitative studies. Qualitative Research 16(2), 198212.CrossRefGoogle Scholar
Mathers, CD and Loncar, D (2006) Projections of global mortality and burden of disease from 2002 to 2030. PLoS Medicine 3(11), e442.CrossRefGoogle ScholarPubMed
McBain, RK, Salhi, C, Hann, K, Kellie, J, Kamara, A, Salomon, JA, Kim, JJ and Betancourt, TS (2015) Improving outcomes for caregivers through treatment of young people affected by war: A randomized controlled trial in Sierra Leone. Bulletin of the World Health Organization 93(12), 834841.CrossRefGoogle Scholar
Nadkarni, A, Weiss, HA, Weobong, B, McDaid, D, Singla, DR, Park, AL, Bhat, B, Katti, B, McCambridge, J, Murthy, P, King, M, Wilson, GT, Kirkwood, B, Fairburn, CG, Velleman, R and Patel, V (2017) Sustained effectiveness and cost-effectiveness of counselling for alcohol problems, a brief psychological treatment for harmful drinking in men, delivered by lay counsellors in primary care: 12-month follow-up of a randomised controlled trial. PLoS Medicine 14(9), e1002386.CrossRefGoogle ScholarPubMed
Naidoo, P, Nyembezi, A, Thomas, E, Lachman, A and Kagee, A (2019) Perceived barriers and facilitators for healthy behaviours among parents of adolescents receiving mental health care in a public hospital in Cape Town, South Africa: A qualitative study. Journal of Child and Adolescent Mental Health 31(1), 3950.CrossRefGoogle Scholar
O’Connor, C and Joffe, H (2020) Intercoder reliability in qualitative research: Debates and practical guidelines. International Journal of Qualitative Methods 19, 1609406919899220.CrossRefGoogle Scholar
Pedersen, GA, Smallegange, E, Coetzee, A, Hartog, K, Turner, J, Jordans, MJ and Brown, FL (2019) A systematic review of the evidence for family and parenting interventions in low-and middle-income countries: Child and youth mental health outcomes. Journal of Child and Family Studies 28(8), 20362055.CrossRefGoogle Scholar
Pilling, S, Fonagy, P, Allison, E, Barnett, P, Campbell, C, Constantinou, M, Gardner, T, Lorenzini, N, Matthews, H, Ryan, A, Sacchetti, S, Truscott, A, Ventura, T, Watchorn, K, Whittington, C and Kendall, T (2020) Long-term outcomes of psychological interventions on children and young people’s mental health: A systematic review and meta-analysis. PLoS One 15(11), e0236525.CrossRefGoogle Scholar
Price, JM, Roesch, S, Walsh, NE and Landsverk, J (2015) Effects of the KEEP Foster parent intervention on child and sibling behavior problems and parental stress during a randomized implementation trial. Prevention Science: The Official Journal of the Society for Prevention Research 16(5), 685695.CrossRefGoogle ScholarPubMed
Puffer, ES, Healy, EF, Green, EP, Giusto, AM, Kaiser, BN, Patel, P and Ayuku, D (2020) Family functioning and mental health changes following a family therapy intervention in Kenya: A pilot trial. Journal of Child and Family Studies 29(12), 34933508.CrossRefGoogle Scholar
Strauss, AL (1987) Qualitative Analysis for Social Scientists. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
VERBI Software (2021) MAXQDA 2022 (Computer Software). Berlin: VERBI Software. Available at https://www.maxqda.com.Google Scholar
Weobong, B, Weiss, HA, McDaid, D, Singla, DR, Hollon, SD, Nadkarni, A, Park, AL, Bhat, B, Katti, B, Anand, A, Dimidjian, S, Araya, R, King, M, Vijayakumar, L, Wilson, GT, Velleman, R, Kirkwood, BR, Fairburn, CG and Patel, V (2017) Sustained effectiveness and cost-effectiveness of the healthy activity programme, a brief psychological treatment for depression delivered by lay counsellors in primary care: 12-month follow-up of a randomised controlled trial. PLoS Medicine 14(9), e1002385.CrossRefGoogle ScholarPubMed
World Health Organization (2008) The Global Burden of Disease: 2004 Update. Geneva: World Health Organization. Available at https://apps.who.int/iris/handle/10665/43942 (accessed 5 November 2022).Google Scholar
World Health Organization (2014) WHO Disability Assessment Schedule 2.0 WHODAS 2.0: Scoring. Available at https://www.who.int/standards/classifications/international-classification-of-functioning-disability-and-health/who-disability-assessment-schedule.Google Scholar
Yoder, HN, Tol, WA, Reis, R and de Jong, JT (2016) Child mental health in Sierra Leone: A survey and exploratory qualitative study. International Journal of Mental Health Systems 10(1), 113.CrossRefGoogle ScholarPubMed
Zimmerman, A, Garman, E, Avendano-Pabon, M, Araya, R, Evans-Lacko, S, McDaid, D, Park, AL, Hessel, P, Diaz, Y, Matijasevich, A, Ziebold, C, Bauer, A, Paula, CS and Lund, C (2021) The impact of cash transfers on mental health in children and young people in low-income and middle-income countries: A systematic review and meta- analysis. BMJ Global Health 6(4), e004661.CrossRefGoogle Scholar
Figure 0

Table 1. Demographic data for caregivers and youth participants

Figure 1

Figure 1. Mechanisms contributing to mental health spillover effects among caregivers.

Author comment: Exploring potential mental health spillover effects among caregivers and partners of youth in Sierra Leone: A qualitative study — R0/PR1

Comments

January 10, 2023

Dear Editorial Board,

I would like to submit the attached manuscript, entitled “Exploring Potential Mental Health Spillover Effects among Caregivers and Partners of Youth in Sierra Leone: A Qualitative Study”, for consideration in Global Mental Health.

This manuscript reports findings from a qualitative study exploring the phenomenon of mental health spillover effects among primary cohabitating caregivers of high-risk youth who participated in an evidence-based mental health intervention in Sierra Leone. Findings have implications for policy makers and other key stakeholders in terms of investment in evidence-based mental health services in LMICs that may offer wider societal benefits that extend beyond those directly receiving services. This study has received Institutional Review Board approval.

The content of this manuscript has not been published or submitted for publication elsewhere in the same form in any language beyond this submission to Global Mental Health. All authors have approved the manuscript for submission, there are no competing interests, conflicts of interest, or issues relating to journal policies.

I will be serving as the corresponding author for this manuscript, and I will inform the coauthors about the status of the manuscript, including editorial decisions and content of revisions. Thank you for considering this manuscript for publication in Global Mental Health. We look forward to hearing from you.

Kind Regards,

Alethea Desrosiers, Ph.D.

Assistant Professor

Brown University

Warren Alpert Medical School

Providence, RI 02906

[email protected]

Review: Exploring potential mental health spillover effects among caregivers and partners of youth in Sierra Leone: A qualitative study — R0/PR2

Conflict of interest statement

Reviewer declares none.

Comments

This paper reports on a small interview study conducted in conjunction with a larger study about which we learn little; both studies, it is implied, look at mental health spillover effects from mental health interventions with youth. More information is needed to fully understand what has been done. The questions touched on in the abstract appear to be ones that would best be answered with a quantitative approach. It is not clear what the mental health component of the intervention received by young people was, and whether it was found to be effective, other than in these 20 interviews. The review refers to ‘evidence-based intervention’ but that evidence doesn’t seem to be explained. The intervention seems to be related to employment. What where the findings of the main study? What were the findings of the quantitative analysis of spillover effects? Were benefits found to participants and caregivers in the larger study? Once this is established, the authors should then consider what a qualitative approach can add to what has been investigated in the quantitative work.

The authors have interview data from 20 caregivers in Sierra Leone, which could potentially provide valuable insights. What is more there is a longitudinal aspect to the study design with participants being followed up a second time. It would be good to see that longitudinal aspect reflected in the research questions and incorporated more into the analysis. Were the youth also followed up? Is this reported anywhere? What were the findings for the youth involved?

The information on how the sample was arrived at is limited and raises many questions. How did youth come to be involved in the original study? Although it’s not commented on it seems you had 100% follow up rate. Is that correct? Or were only those with 2 interviews chosen post hoc to form the sample? There is also no mention of anyone not benefitting from the interview – were only participants who benefitted from the intervention included?

The themes are no doubt important, but could all perhaps be attributed to the passing of time and growing maturity of the young people. The qualitative data might provide more opportunity to unpick this question, if the quantitative study did not have a control group – it would be good to see this reported. To understand what is going on here, the reader needs to know more about the programs involved.

The discussion section again starts off sounding like a quantitative study, all participants experienced spillover effects, all were sustained at 8 months etc. The discussion could explain better what this study adds over the 2015 study.

The discussion suggests the findings could support the addition of a booster session for the young people, but I did not see anything presented that backs this up, especially since we do not know anything about any mental health problems the young people had or the benefits of the programme to them. Likewise, there are big claims in relation to the specific importance of spillover effects to Sierra Leone because they have a ‘collectivist culture’ compared to other LMICs. This would have been very interesting to investigate and if the authors have data to investigate this, it would be great to include this in the paper – at present nothing in the results presented appears to relate to collectivism and there is not even a reference offered to support the suggestion the country is more collectivist than others.

Reference is made to quant findings from other studies, but why not from the study of which this was part? The fact that the limitations refer to difficulties tracking and finding people rather indicates we are not told the full story of how the sample with 100% follow-up was arrived at.

What does the sentence re ‘redirect interviews back to the YRI’ mean? Are we to understand that some may not have received the program at all? What is the relevance of the YRI? There does not seem any material presented which attempts to relate benefits to specific YRI components. Given this, ‘Some results may not be solely attributed to YRI’ participation' seems like an understatement.

The authors refer to the non-generalisability of findings due to the specific location in rural Sierra Leone and yet the findings themselves seem very generic and could apply anywhere around the world one would think. It would be fascinating to have heard something about the specific cultural context and how this affected ‘spillover effects’. The authors evidently feel this to be the case, but have not yet explored these interesting issues in this paper.

Review: Exploring potential mental health spillover effects among caregivers and partners of youth in Sierra Leone: A qualitative study — R0/PR3

Conflict of interest statement

Reviewer declares none.

Comments

This paper explores the spillover effect of an intervention in rural Sierra Leone specifically focused on the cohabitating caregivers of those who received the intervention. This is an important issue as the field explores the potential of reaching families and communities. The results are also interesting and informative.

The primary area for improvement of this paper is in its need for more clarity from the beginning about the research question, scope, and sample.

Abstract

The abstract is a bit unclear in terms of who the intervention participants are. It can be interpreted that one caregiver participated – and that the spillover is related to the other caregiver (cohabitating). I realized this was not the case after reading the Current Study section.

Two other minor suggestions to consider: (1) The first statement focuses on “wider societal benefits,” which is true, but this study focuses on the value of within-household spillover, which is important in and of itself. At first, I expected the study to talk about more community-level spillover given this opening. (2) If it is possible within the space, having a brief mention of the mechanisms through which participants described their change would then include the unique aspect of this study in looking at the process of spillover. The opening of the Discussion provides a sentence that may be useful to adapt for the Abstract.

Introduction

1. Authors should provide a citation that clearly supports the 98% treatment gap.

2. Related to the confusion in the abstract, it would be helpful to make the Current Study section clearer in terms of who participated directly in the intervention and who participated in this follow up study. For example, the idea of “partners” is not included but it is not clear whose partners (older youth vs. partners of the caregivers of the youth who participated). One idea for consideration is perhaps to avoid using “cohabitating” since that is often to refer to adult-adult relationships.

3. Authors should consider including a hypothesis—or, if framed as exploratory, some possible ideas for mechanisms through which spillover could occur. This would solidify the rationale for the research question and help the reader understand the types of associations you are examining.

Methods:

4. Minor: Typo on page 6 (spend verses sense).

5. The sample remained unclear even after the Methods. It was in Results that it became clear that some of the youth had partners/spouses who were participating. One reason this was somewhat surprising was also that “caregiving burden” had been mentioned several times. If that is “caregiving” because of living with someone struggling with mental health problems (rather than general caregiving in terms of parent-type roles), that should also be defined earlier. (Defining “youth” earlier in terms of extending to age 30 may also be helpful in providing the reader with key background on the sample.)

6. The description of the interview, including sample questions, includes a description of other goals besides examining mental health spillover (ie, also mentions household dynamics and youth behavior), without identifying these are potential mechanisms (which becomes clear later in Results and Discussion). It would be helpful to know which questions/topics were used in the current analysis and why. For example, were questions about changes in the youth asked in order to explore whether these influenced caregiver mental health? Or perhaps these were the qualitative questions asked for many purposes, and then this spillover emerged in an unexpected way? It is also curious that there were not more direct questions about spillover in terms of whether the intervention youth participant talked about the intervention content at home.

7. Data Analysis: Authors state that the intervention’s theory of change influenced the analysis, and it would be helpful to know more about that. Often the theory of change has the endpoint of the outcomes at the participant-level; was this then extended in a way that related to spillover, or was the theory of change used for the part of the qualitative study just looking at youth outcomes? (This goes back to the questions in the comment just above about which questions and data fed into the specific analysis/results for the research question addressed in this analysis vs. in the qualitative component of the study overall.)

8. Data Analysis: It would be helpful to know how inter-coder reliability was addressed. It states that several versions were tested on a subset of transcripts, but it is unclear what that would mean and whether it would adequately support the decisions that coders could then code separately in a way that was consistent.

Results

9. Minor: It is stated that household sizes vary widely. Having data on the range here would be relevant since the overall topic is spillover/reach. In Discussion, I believe a mean of 7 is mentioned, which could be stated here.

10. Overall, the use of the pseudonyms (especially multiple in one quote) seems unnecessary. Authors should consider instead focusing on participant and “caregiver” characteristics/relationships. This is especially important given that youths’ spouses are included, meaning that “caregiving” would mean something quite different. For example, it would be helpful to say things like, “The husband of a 25-year-old participant said…” (no names needed since there’s no narrative presented about specific people).

11. Major: It is unclear how the second theme of the behavior change among the youth themselves is related to mental health spillover effects on caregivers. Caregivers are of course glad to observe these improvements, but are reporting on the youth rather than the mental health benefits they experience due to this improvement. Later, it becomes clear in the Discussion that this is seen as a mechanism, but within Results, it reads just as qualitative results supporting intervention effects on the youth as reported by caregivers.

12. The same is true to some extent with the Interpersonal Relationships theme, though it is more clear how the caregivers are enjoying these changes as recipients of these new interpersonal behaviors. It is unclear whether this would be “mental health” spillover effects, though, as participants are not describing how these changes make them feel.

13. In contrast, the Caregiver Wellbeing is directly related to the stated research question of mental health spillover, and what is expected based on the framing of this manuscript. One way to partially address the confusion about aims/scope might be to present the mental health benefits first (ie, caregivers increased happiness) and then present the other themes (improved behavior, better relationships) as contributors (mechanisms) to this improved wellbeing of caregivers—and to frame the paper to identify the mental health spillover and the factors that contribute to that.

Discussion

14. The first two sentences are very clear and could be useful to inform framing the aims, as well as providing a brief statement of mechanisms-related findings in the Abstract.

15. The point about participants not describing that the youth passed along lessons/skills learned in the intervention is important and gets a bit buried within the Discussion. It would be helpful in the Introduction to know whether the researchers expected that to be one pathway in spillover (e.g., youth teach coping skills to their parents/spouses), as that would be a very rationale expectation and the typical understanding of what “spillover” means. It is quite an interesting finding that this did not emerge—that the mental health benefits came about indirectly as related to the improvements in the direct participant.

16. One limitation to mention, related to the above, is that the interviews do not seem to have covered questions directly related to whether the youth participants did try to teach things that they learned—or whether the caregivers had at least discussed what the youth learned. If these questions had been asked, perhaps some of those expected spillover pathways might have been seen.

Recommendation: Exploring potential mental health spillover effects among caregivers and partners of youth in Sierra Leone: A qualitative study — R0/PR4

Comments

No accompanying comment.

Decision: Exploring potential mental health spillover effects among caregivers and partners of youth in Sierra Leone: A qualitative study — R0/PR5

Comments

No accompanying comment.

Author comment: Exploring potential mental health spillover effects among caregivers and partners of youth in Sierra Leone: A qualitative study — R1/PR6

Comments

No accompanying comment.

Review: Exploring potential mental health spillover effects among caregivers and partners of youth in Sierra Leone: A qualitative study — R1/PR7

Conflict of interest statement

Reviewer declares none.

Comments

The authors have addressed the reviewers' concerns and the paper is improved. In my view it is suitable for publication. The authors may like to consider further moderating some language.

In the abstract I am not sure it is quite correct to say the study explores ‘ whether’ spillover effects had occurred. You could say whether they were perceived to have occurred? Or if more appropriate to what was actually done, maybe whether there ‘appeared to have been’ any spillover effects'?

Equally, rather than whether effects are sustained over time, you may have been exploring whether ‘perceived’ changes appear to be maintained over time.

Perhaps authors do not need to assert, now more strongly, which programme was the cause of any perceived improvements. They can’t perhaps really know, and just because the other programme did not contain specific mental health components, does not mean it could not have contributed to improved mental health.

Recommendation: Exploring potential mental health spillover effects among caregivers and partners of youth in Sierra Leone: A qualitative study — R1/PR8

Comments

Please would you address the additional comments by the reviewer before the manuscript can be accepted. In addition, please would you review your explanation of inter-rater reliability. The second reviewer had asked about inter-coder reliability. Please explain what you did and provide a reference supporting your approach.

Decision: Exploring potential mental health spillover effects among caregivers and partners of youth in Sierra Leone: A qualitative study — R1/PR9

Comments

No accompanying comment.

Author comment: Exploring potential mental health spillover effects among caregivers and partners of youth in Sierra Leone: A qualitative study — R2/PR10

Comments

June 14, 2023

Dear Dr. Petersen and the Referees,

Thank you very much for the invitation to revise and resubmit our manuscript, entitled “Exploring Potential Mental Health Spillover Effects among Caregivers and Partners of Youth in Sierra Leone: A Qualitative Study”, for consideration in Global Mental Health. We appreciate the comments from the referee(s) and have responded in detail below. Revisions to the manuscript in response to referee comments appear in track changes. Please do not hesitate to contact me if there are any questions or concerns.

I will be serving as the corresponding author for this manuscript, and I will inform the coauthors about the status of the manuscript, including editorial decisions and content of revisions. We look forward to hearing from you.

Kind Regards,

Alethea Desrosiers, Ph.D.

Assistant Professor

Brown University

Warren Alpert Medical School

Providence, RI 02906

[email protected]

Comments:

1. Please would you review your explanation of inter-rater reliability. The second reviewer had asked about inter-coder reliability. Please explain what you did and provide a reference supporting your approach.

We thank the reviewers for bringing this to our attention. After further review, we realized that we used the term inter-rater reliability incorrectly, which is commonly conflated with inter-coder agreement (O’Conner & Joffe, 2020). We tested inter-coder agreement, not inter-rater reliability, during qualitative analysis. We have corrected this in our manuscript. We have added references to our manuscript that support the approach that we took regarding inter-coder reliability (MacPhail et al., 2016; O’Conner & Joffe, 2020). The references we have sited also describe the steps for developing a codebook and meeting regularly as a team to discuss themes and how codes are being applied to represent themes.

2. In the abstract, I am not sure it is quite correct to say the study explores ‘ whether’ spillover effects had occurred. You could say whether they were perceived to have occurred? Or if more appropriate to what was actually done, maybe whether there ‘appeared to have been’ any spillover effects'?

As per the reviewer’s suggestion, we have adjusted our phrasing in the abstract to be less assertive. We have changed the phrase: ‘whether spillover effects had occurred’ to read:

“Qualitative interviews were conducted at two time points to explore: (a) potential mental health spillover effects and (b) through which mechanisms spillover may have occurred.”

This is more consistent with our phrasing of exploring potential mental health spillover effects earlier in the abstract.

3. Equally, rather than whether effects are sustained over time, you may have been exploring whether ‘perceived’ changes appear to be maintained over time.

We have adjusted our language regarding effects over time as per the reviewer’s suggestion. We added the following phrase to make it clear that exploration of our research questions was based on the self-reported perceptions of caregivers. We added the following phrase prior to the statements about ‘whether effects were sustained over time’ in the introduction

“We explored the following questions based on the self-reported perceptions of primary caregivers”.

We also changed the phrasing in the first paragraph of the conclusion regarding sustainment of mental health spillover effects over time to read:

“…appeared to be sustained over time”.

We believe that these modifications make it clearer that findings are based on perceptions of caregivers and their self-reported experiences.

4. Perhaps authors do not need to assert, now more strongly, which program was the cause of any perceived improvements. They can’t perhaps really know, and just because the other program did not contain specific mental health components, does not mean it could not have contributed to improved mental health.

In the limitations section, we note the possibility that effects could have occurred due to participation in the employment promotion program. We agree that we cannot know for certain that the other program did not contribute to mental health improvements.

“…it is possible that some caregivers were unable to distinguish which program component facilitated the observed changes in YRI participants’ behavior and therefore some results may be related to EPP participation and not be solely attributed to YRI participation.”

We also modified our language in the conclusion section to note that the evidence-based mental health intervention was linked with employment programming.

Recommendation: Exploring potential mental health spillover effects among caregivers and partners of youth in Sierra Leone: A qualitative study — R2/PR11

Comments

No accompanying comment.

Decision: Exploring potential mental health spillover effects among caregivers and partners of youth in Sierra Leone: A qualitative study — R2/PR12

Comments

No accompanying comment.