Hostname: page-component-586b7cd67f-t7fkt Total loading time: 0 Render date: 2024-11-23T19:56:59.216Z Has data issue: false hasContentIssue false

Using theory of change to plan for the implementation of a psychological intervention addressing alcohol use disorder and psychological distress in Uganda

Published online by Cambridge University Press:  08 January 2024

Catharina van der Boor*
Affiliation:
Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK
Lena S. Andersen
Affiliation:
Section of Global Health, Department of Public Health, University of Copenhagen, Copenhagen, Denmark
Alessandro Massazza
Affiliation:
Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK
Wietse A. Tol
Affiliation:
Section of Global Health, Department of Public Health, University of Copenhagen, Copenhagen, Denmark Athena Research Institute, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
Dalili Taban
Affiliation:
HealthRight International, Kampala, Uganda
Bayard Roberts
Affiliation:
Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK
Joshua Ssebunnya
Affiliation:
Mental Health Focus Area, MRC/UVRI & LSHTM Uganda Research Unit/MRC Investigator, Entebbe, Uganda
Eugene Kinyanda
Affiliation:
Mental Health Focus Area, MRC/UVRI & LSHTM Uganda Research Unit/MRC Investigator, Entebbe, Uganda
Carl May
Affiliation:
Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK
Abhijit Nadkarni
Affiliation:
Department of Population Health, London School of Hygiene and Tropical Medicine, London, UK Addictions and Related Research Group, Sangath, Goa, India
Daniela Fuhr
Affiliation:
Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK Department of Prevention and Evaluation, Leibniz Institute for Prevention Research and Epidemiology, Bremen, Germany Health Sciences, University of Bremen, Bremen, Germany
*
Corresponding author: Catharina van der Boor; Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

In conflict-affected settings, prevalence of alcohol use disorders (AUDs) can be high. However, limited practical information exists on AUD management in low-income settings. Using a theory of change (ToC) approach, we aimed to identify pathways influencing the implementation and maintenance of a new transdiagnostic psychological intervention (“CHANGE”), targeting both psychological distress and AUDs in humanitarian settings. Three half-day workshops in Uganda engaged 41 stakeholders to develop a ToC map. ToC is a participatory program theory approach aiming to create a visual representation of how and why an intervention leads to specific outcomes. Additionally, five semi-structured interviews were conducted to explore experiences of stakeholders that participated in the ToC workshops. Two necessary pathways influencing the implementation and maintenance of CHANGE were identified: policy impact, and mental health service delivery. Barriers identified included policy gaps, limited recognition of social determinants and the need for integrated follow-up care. Interviewed participants valued ToC’s participatory approach and expressed concerns about its adaptability in continuously changing contexts (e.g., humanitarian settings). Our study underscores ToC’s value in delineating context-specific outcomes and identifies areas requiring further attention. It emphasizes the importance of early planning and stakeholder engagement for sustainable implementation of psychological interventions in humanitarian settings.

Topics structure

Type
Research Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2024. Published by Cambridge University Press

Impact statement

By using theory of change (ToC), we use a participatory approach to understand different pathways that can shape the implementation and maintenance of a new psychological intervention named “CHANGE” in a humanitarian setting in Uganda. The CHANGE intervention is designed to address both psychological distress and alcohol use disorders in conflict affected populations. The findings of this study reveal that there are two pathways that are important for the implementation of CHANGE in this context: policy impact, and mental health service delivery. We reflect on the utility of using a ToC methodology in this context and identify areas that require further attention.

Background

Over the last 10 years, the number of forcibly displaced populations resulting from armed conflict, persecution and/or violence has grown by more than 50% (UNHCR, 2021). In 2021 alone, 23 countries faced high or medium intensity conflicts (World Bank, 2022), which have far-reaching social, economic and health impacts (Milián et al., Reference Milián, Royo Aspa, Urgell García, Urrutia Arestizábal, Villellas Ariño and Villellas Ariño2022; World Bank, 2022).

Armed conflict can impact mental health both directly, for example, by exposing people to traumatic events, and indirectly, for example, by worsening known social determinants of mental health (i.e., impoverishment, poor access to healthcare, loss of social networks) (Lo et al., Reference Lo, Patel, Shultz, Ezard and Roberts2017a). In these contexts, alcohol use disorders (AUDs) may provide unhealthy ways to cope with chronic stressors, other psychological consequences of conflict exposure, and can further compound risk factors (Weaver and Roberts, Reference Weaver and Roberts2010; Ezard, Reference Ezard2012; Lo et al., Reference Lo, Patel, Shultz, Ezard and Roberts2017a).

Literature on AUDs demonstrates an increased risk for mental health disorders (Grant et al., Reference Grant, Stinson, Dawson and Kaplan2004; Lo et al., Reference Lo, Patel, Shultz, Ezard and Roberts2017a), noncommunicable diseases (Hammer et al., Reference Hammer, Parent and Spiker2018; Nadkarni et al., Reference Nadkarni, Bhatia, Shaik and Madan2023a), gender-based violence (Shiva et al., Reference Shiva, Shukla and Chandra2021) and wider social and economic risks (Hammer et al., Reference Hammer, Parent and Spiker2018). People with AUDs often experience barriers to treatment which can reduce health seeking behavior and underutilization of services (Probst et al., Reference Probst, Manthey, Martinez and Rehm2015; Mellinger et al., Reference Mellinger, Scott Winder, DeJonckheere and Blow2018; McCrady et al., Reference McCrady, Epstein and Fokas2020).

Addressing AUDs in humanitarian settings is included in international humanitarian response guidelines (IASC, 2007; Sphere, Reference Sphere2018). However, there remains limited evidence to guide the management of AUDs among conflict-affected people in low-income settings (Roberts and Ezard, Reference Roberts and Ezard2015; Kane and Greene, Reference Kane and Greene2018; Fuhr et al., Reference Fuhr, Bogdanov, Tol, Nadkarni and Roberts2021). The CHANGE consortium aims to address this evidence gap, through the development and implementation of a new psychological intervention (“CHANGE”) addressing both AUDs and psychological distress among conflict-affected men (https://www.lshtm.ac.uk /change; Fuhr et al., Reference Fuhr, Bogdanov, Tol, Nadkarni and Roberts2021). The CHANGE intervention is informed by Problem Management Plus (PM+) (Dawson et al., Reference Dawson, Bryant, Harper and van Ommeren2015). PM+ is a transdiagnostic (i.e., noncondition specific) intervention developed by the WHO, that improves symptoms of depression, anxiety and psychological distress (Schäfer et al., Reference Schäfer, Thomas, Lindner and Lieb2023). A transdiagnostic approach can be useful as most people present with comorbidity, while simultaneously making it more feasible to deliver in resource-poor settings (Dawson et al., Reference Dawson, Bryant, Harper and van Ommeren2015). PM+ includes strategies based on cognitive behavioral therapy, including problem solving, stress management, behavioral activation and access to social support. Global evidence has demonstrated the efficacy of PM+ at reducing psychological distress in low and middle-income settings (Schäfer et al., Reference Schäfer, Thomas, Lindner and Lieb2023). However, PM+ does not include strategies for AUDs which is a major but neglected issue among conflict-affected populations (Roberts et al., Reference Roberts, Felix Ocaka, Browne, Oyok and Sondorp2011; Kane and Greene, Reference Kane and Greene2018). The CHANGE intervention seeks to address this gap, by including strategies into PM+ that can target AUDs (such as personal feedback, goal setting and planning change, cognitive behavioral skills such as drink refusal, and relapse management). CHANGE is delivered by lay health workers and is composed of six individual face-to-face sessions (Fuhr et al., Reference Fuhr, Bogdanov, Tol, Nadkarni and Roberts2021; Nadkarni et al., Reference Nadkarni, Massazza, Guda and Fuhr2023b). The effectiveness of CHANGE is currently being evaluated through a randomized controlled trial with South Sudanese refugee men in Rhino camp settlement, northern Uganda.

When developing complex interventions, it is recommended to investigate how context may influence intervention outcomes and implementation (Craig et al., Reference Craig, Dieppe, Macintyre, Michie, Nazareth and Petticrew2008; De Silva et al., Reference De Silva, Breuer, Lee and Patel2014).

Theory of change (ToC) is a participatory planning process focused on how a project can achieve long-term outcomes through a logical sequence of intermediate outcomes (Vogel, Reference Vogel2012). It enables systematic identification of knowledge gaps in context and can provide a comprehensive set of indicators to evaluate the stages of causal pathways through which complex interventions may achieve impact (De Silva et al., Reference De Silva, Breuer, Lee and Patel2014). It is visually represented in a ToC map, which shows the ways in which an intervention is anticipated to produce its effects within the constraints of the specific environment in which it is put into practice (De Silva et al., Reference De Silva, Breuer, Lee and Patel2014).

The aim of this study was to use ToC to summarize pathways to the implementation and maintenance of the CHANGE intervention for refugees in the context of a refugee settlement in northern Uganda. It was also developed to investigate barriers and facilitators toward implementation and explore strategies that may overcome certain barriers. The specific objectives of this study were to (a) explore context-specific intermediate and long-term outcomes necessary for sustainable implementation of CHANGE, including policy and health service considerations; (b) identify barriers and facilitators underlying each outcome and (c) reflect on the conduct of the ToC process through stakeholder interviews. To the best of our knowledge, this article is the first to report on the use of ToC to shed light on pathways for a public health intervention for AUDs among refugees.

Methods

Study setting

Data collection occurred between June 2021 and February 2022 in Kampala, Arua and Rhino camp settlement in Uganda. An estimated 136,900 refugees currently live in Rhino camp settlement in impoverished conditions (UNHCR, 2019c). Arua is the largest urban area near the settlement, where many humanitarian agencies operating in the settlement have their offices. Kampala, Arua and Rhino camp settlement were chosen to have a varied sample of experienced stakeholders working with refugees.

Uganda’s Ministry of Health has included mental health care into its general health provision, outlined in the national Health Sector Integrated Refugee Response Plan (Uganda Ministry of Health, 2019). However, there is only one mention of the need to prevent and control noncommunicable diseases including substance use disorder, with no further detail or guidelines on how this can be achieved. Those living in the settlement have the right to access free healthcare through 13 primary care posts distributed across the settlement (UNHCR, 2019a, 2019b). However, according to a needs and resource assessment conducted in Rhino camp in 2016, accessibility to general healthcare was limited, and there were very limited mental health and psychosocial support services (MHPSS) available (Adaku et al., Reference Adaku, Okello, Lowry, Kane, Alderman, Musisi and Tol2016). As such, despite efforts, there are still gaps in responding to the MHPSS needs of refugee communities, including poorly equipped health centers, and shortages of healthcare workers and medication (Baingana and Patrick, Reference Baingana and Patrick2011; Rokhideh, Reference Rokhideh2017; Kane and Greene, Reference Kane and Greene2018). The United Nations High Commissioner for Refugees (UNHCR) has highlighted the need for scalable community-led interventions to bridge the needs gap (Kaltenbacher, Reference Kaltenbacher2019).

Participatory theory of change workshops

Theory of change

Three half-day face-to-face workshops gathered information for the development of a ToC map. ToC is often developed using a backward mapping process, starting with the long-term outcomes and then mapping the required process of change. Achieving long-term outcomes depends on meeting a series of intermediate outcomes. Rationales justify these intermediate outcomes, and explain how specific interventions (activities) will contribute to their achievement. Assumptions (i.e., barriers/facilitators) required for the ToC are also recorded. Ultimately, ToC allows for multiple causal pathways, interventions and feedback loops to achieve specific outcomes, while also acknowledging the role of context for implementation (Vogel, Reference Vogel2012; Breuer et al., Reference Breuer, Lee, Mary and Lund2015).

Participants and recruitment

Stakeholders involved with refugee services and/or with MHPSS programming with South Sudanese refugees in Uganda were recruited. The final sample included national stakeholders working for the government (N = 3), national and international NGO workers (N = 14) and other community health and social care workers (N = 24). Workshop 1 was conducted in Kampala (N = 15), workshop 2 in Arua (N = 13) and workshop 3 in Rhino camp settlement (N = 12) (see Table 1 for an overview). All participants provided informed consent.

Table 1. Description of ToC participants

Procedure of workshops

The ToC study was carried out during the formative research phase, that is, prior to the feasibility and effectiveness trials of the CHANGE intervention. In Kampala, the ToC workshop was facilitated by a Ugandan clinical psychologist and researcher with experience of ToC. In Arua and the Rhino camp settlement, they were facilitated by the CHANGE project coordinator, who had received previous training. Workshops were in English and audio recorded. At the start of the workshops, participants were given an overview of the main components of ToC, and discussions were then held around each of these main components. Post-it notes were used to iteratively develop the ToC map. Participants of the workshops led the discussions and were guided by two facilitators. Once the three workshops had taken place, researchers LSA and DF compared the different components that had emerged in each of the three workshops and drafted one final ToC map that reflected the views of the three groups. Audio recordings were used to check missing information and details when necessary. After creating the draft map, 16 participants provided written feedback on the draft map via email, which was reviewed and included in the final ToC map.

Semi-structured interviews

The workshops were followed by individual semi-structured interviews with a subset (n = 5) of stakeholders who participated in the ToC workshops. The interview aim was to explore the experience of workshop participation, and views on the strengths and limitations of ToC. Participants were purposefully sampled based on time and availability.

Procedures for interviews

Semi-structured interviews took place via zoom with researcher AM. The topic guide covered the following domains: defining ToC in their own words, perceived purpose of ToC, role of facilitator, participant interactions, differing views and strengths and limitations (see additional files). Following the first interview, the topic guide was edited and remained unchanged for the rest of the data collection. Interviews lasted between 30 min and 1 h. All interviews were in English, audio recorded and transcribed verbatim.

Thematic analysis was used (Braun and Clarke, Reference Braun and Clarke2022). As the data were transcribed, recurring themes were noted that informed the preliminary coding framework. A largely inductive coding approach was used by identifying codes that were most frequently represented in the dataset. The preliminary coding framework was discussed among the core members of the team and then finalized. All data were coded and analyzed in NVivo 12.

Results

ToC for the CHANGE intervention

Figure 1 presents the ToC map. Two distinct causal pathways were identified that could facilitate implementation of the CHANGE intervention at different levels of the health system: (a) Policy pathway, and (b) Mental health service delivery pathway. Eight interventions (interventions 1–8) and 12 assumptions (assumptions A–L) were identified by stakeholders (Figure 1).

Figure 1. Theory of change map.

Pathways to improved health and wellbeing

The two pathways (Policy impact, and Mental health service delivery) that lead to the overall impact, that is, improved health and wellbeing, are associated with four long-term outcomes: (a) a reduction in AUDs and associated mental health disorders in refugee communities; (b) improved social and economic productivity; (c) improved family stability and functioning and (d) reduction in perpetration of gender-based violence resulting from AUDs (Figure 1). The two pathways are described below.

Policy impact pathway

The first pathway to support the maintenance of the CHANGE intervention is policy-focused. Assuming the intervention’s effectiveness, there is a need for policies to be in place that continue to prioritize and promote the mental health and wellbeing of refugee populations. To achieve this, political leaders must demonstrate a commitment to prioritizing mental health care (assumption I). Supportive environments can aid help seeking, and promote mental health, among others. An early intermediate outcome of such supportive policies is the availability of political leadership that is sensitized to the need to address AUDs in refugee populations both at a national and local level, which can facilitate the development and implementation of a mental health plan targeting AUDs in refugee populations.

Workshop discussions extensively covered the reciprocal relationship between AUDs and social determinants of health (e.g., employment). Stakeholders recognized that treating AUDs alone would not suffice to improve mental health and wellbeing. Political leaders must recognize this reciprocal relationship (assumption J). Stakeholders noted the negative impact of high unemployment levels within refugee populations in Uganda and highlighted the need for clients with AUDs to be supported to earn an income. Three key interventions were proposed (a) establishing associations to promote income generating activities, that is, training households in small business set up and/or providing small cash grants (intervention 6); (b) introducing cash-for-work programs, that is, building infrastructure, garbage collection (intervention 7) and (c) recognizing farming as a viable business for refugees (intervention 8). These depend on the assumption that those who recover from mental health disorders and/or AUDs, and receive vocational or skill-based trainings, can then actively participate in various programs and activities (assumption H).

Moreover, attention is required for the relationship between AUDs and social determinants within both national mental health and refugee response plans. This involved recognizing crucial social determinants, like unemployment or housing status, that can increase the risk of AUDs. This, in turn, demands the allocation of resources and funding. Resources should be channeled toward enhancing the mental health plan to include strategies addressing substance misuse (assumption K), contingent on political will and priorities. Funding should also be directed toward the development and maintenance of interventions, including the three key interventions outlined above, and task-sharing interventions like CHANGE, that can address specific community challenges such as mental health disorders and AUDs (assumption L).

Mental health service delivery

The second pathway relates to mental health service delivery, including the identification of individuals with AUDs and the delivery of targeted community-based interventions. An early intermediate outcome of this service delivery is growing awareness within the community regarding AUDs which can promote support and sensitize community members toward the harmful effects of alcohol.

To bolster this awareness and sensitization surrounding AUDs and available treatments, involving Refugee Welfare Councils and incorporating messaging on AUDs within community-based religious settings (intervention 1) may be essential. Furthermore, this awareness may facilitate the identification of refugees who would benefit from support. It was further speculated that the identification of individuals with AUDs and support in accessing care hinges on a peaceful and stable environment (assumption A). Additionally, it was emphasized that community health workers need training in screening and identification of people with AUDs, and in the selection of appropriate referral pathways (intervention 2). This assumes the existence of suitable and identifiable referral pathways (assumption C), and that refugees with AUDs are willing to seek help (intervention 1). The ability to seek help may also be contingent on the absence of infectious disease outbreaks in the community (assumption B).

Those who seek help and are screened and identified as having severe alcohol dependence and/or are at risk of suicide should be referred for specialized treatment, where available. Those with less severe AUDs can receive interventions from lay workers in community settings. Community workers with a healthcare background (i.e., social workers and counselors) should be trained to administer these interventions (i.e., CHANGE). While training local workers may improve case management within the health system (intervention 3), it is dependent on the availability of human resources (assumption E).

Once the CHANGE intervention has been completed, refugees can receive follow-up care in the community. This may include vocational skills training (intervention 4) and establishing support groups to foster social support and aid ongoing recovery and/or symptom reduction (intervention 5). There was recognition that for follow-up care to be successful, individuals’ support networks (e.g., family members and others) must also contribute to the process by encouraging engagement (assumption F). Additionally, there needs to be availability of human and non-human resources to provide vocational trainings, and other discussed programs and activities (assumption G).

Experiences with ToC

Five workshop participants were interviewed, of which four were male and one was female. Three worked for an international NGO, one was a clinical officer in Rhino camp settlement, and one was a psychiatric nurse in the Arua regional hospital. Various themes were discussed, which are summarized below under three headings: (a) ToC definition and implementation, (b) advantages and disadvantages of ToC and (c) areas of future improvement.

ToC definition and implementation

When asked to provide a definition for ToC, and what it was about, participants provided heterogeneous responses (see Table 2). A common focus was on the determination of a causal pathway whereby the ToC worked as a way of mapping outcomes necessary for a certain impact to take place, “what needs to be done in order to achieve that impact.” One participant described ToCs as a way of giving direction, and another as that of ensuring that the intervention “flows logically.” The ToC notion of “backward mapping” (i.e., starting from impact and going backward to the earliest outcome that must be realized) was perceived as particularly useful for this.

A theory of change, is, I would call it, a process of… evolving, a process of developing an idea from, the end to the beginning, […] let me give an example, here, you are going, you have a journey to make and this journey from UK to Uganda, […] it’s like you reverse, […] what steps do I need to take before I board in Uganda, what activities should I do before I arrive in Uganda, what objective do I have to achieve, so like you are going in reverse in a theory of change (Hospital psychiatric nurse, Arua).

Table 2. Definitions of ToC construct according to different participants

Respondents highlighted the value of having different types of knowledge and experiences represented. For example, some mentioned the importance of avoiding mixing participants with very different types of status (e.g., mixing refugees with policy makers) out of fear that some may feel inhibited from speaking out. Not everyone agreed with this, and one participant highlighted how it would be important to always have the direct end-users (e.g., refugees with AUDs) to ground the perspective of the group.

We wanted the people to speak their mind, objectively, free, without fear of being underlook, you can imagine bringing a refugee all the way from the settlement and sitting in Kampala, in a five star hotel and being with the ministry people definitely he will underlook at his or her opinion in that setting, so we decided to ensure that have an environment which is fair to each of the stakeholder (Project coordinator at NGO, Arua).

The inclusion of the right participants and expertise was perceived as essential to reflect the reality on the ground.

I think one of the, one of the strengths is that, the, the ToC map that was produced is an outcome of critical reflection of people who are, who have been involved in the field who have sort of know the needs of the refugees in terms of mental health and psychosocial support, I feel that the ToC reflects what the real needs are and what can be done to address those needs (Community services officer at international NGO, Arua).

Two participants described that while the ultimate outcome of the ToC in the three workshops in Uganda was similar, that is, improved wellbeing for refugees, the pathways through which this outcome was reached differed across groups depending on the type of expertise and knowledge people brought.

The ToC notes for Rhino [refugee leaders as participants] you find that people, they talk more of interventions, individual interventions but it seems to have that gap of knowledge where to begin and where to get services, but if you look at Arua and Kampala [more policy makers and service providers involved] they look at putting the policies in place (Project coordinator at NGO, Arua).

The interaction between participants was described as overwhelmingly positive “the relationship was marvelous, people were friendly to each other, they were willing to learn.” Where opinions differed, consensus was reached through discussion.

Advantages and disadvantages of ToC

The ToC as a method was perceived to have multiple advantages. Clear advantages included empowerment, the visual and participatory nature of the workshops and a sense of ownership.

The room was filled with excitement, “oh these guys want us to develop our own intervention, this is so amazing!”, and they had great remarks at the end of that, “if all interventions which many partners want to address problems in the community are done the way we did then”, they say “they will have a lasting solution to their problems” (Project coordinator at NGO, Arua).

The main issue discussed was the ToC terminology, often perceived as confusing with participants reporting struggling to effectively differentiate between constructs (e.g., assumptions, interventions). Understanding the different components was described as “tedious” and time consuming, and potentially problematic if constructs were not well understood.

The one in Rhino camp, was also based on experience of the refugees but I think it was a little bit challenging for them because some of these concepts appeared to be hard, [facilitator] help them to you know explain some of these things because it was the first time someone was coming across words like impacts or intermediate outcomes, objectives, outcomes, so… […] based on the low level of education of the refugees, of course mentioning impact that will be a very strange word to them and then they will ask “what do you mean by impact”? (Community services officer at NGO, Arua).

Participants also questioned the flexibility of ToC maps in volatile situations such as settings affected by armed conflict.

In an event where the situation on the ground changes, I mean the context in which the intervention was designed changes, I am trying to see whether, if the interventions do not achieve the intended purpose which was ideally planned, I don’t know how that can fit in it, whether it has room for adjustments… (Project coordinator at NGO, Arua).

Areas of future improvement

Participants mentioned it may have been helpful to have wider representation of certain stakeholders (e.g., primary healthcare workers, refugees with AUDs). To address the ambiguity around the ToC terminology, some participants suggested having appropriate simplifications, explanations of constructs and background materials before the meeting (e.g., material on the study and ToCs).

I think… one thing that, ehm, could be done differently to improve future ToCs is, […] describing in advance the ToC to the workshop participants so that they come into the workshop with an idea of how it will look (Hospital psychiatric nurse, Arua).

Discussion

To the best of our knowledge, this article is the first to report on the use of ToC to support the planning of the sustainable implementation of a public health intervention to address AUDs among refugees. The findings in the current article highlight the utility of ToC to define and map context-specific outcomes across different implementation pathways and identify areas that require attention. Two necessary pathways were identified that will influence the implementation and maintenance of CHANGE in Uganda: a policy impact pathway and a mental health service delivery pathway. Both highlight the need for early planning and engagement of key stakeholders to set the stage for implementation. The results of this study will help inform our subsequent work that focuses on examining the scalability of the CHANGE intervention through the health system and other humanitarian sectors.

Policy impact pathway

The findings highlight steps required for the sustainable implementation of programs like CHANGE. First, within the policy impact pathway, it is necessary to establish government health policies that consider AUDs among refugees and acknowledge the role of social determinants (i.e., livelihoods, housing) on the development and persistence of AUDs. While Uganda’s national alcohol control policy (Government of Uganda, 2019) recognizes the harmful impacts of alcohol, it falls short in acknowledging the role of social determinants on AUD development. Addressing these policy gaps is imperative for the long-term implementation and integration of interventions like CHANGE into community healthcare.

Second, the bidirectional relationship between specific dimensions of poverty and common mental health disorders and AUDs needs addressing. Research consistently demonstrates elevated risks for developing common mental health disorders and AUDs among individuals with limited access to material resources (Marmot et al., Reference Marmot, Friel, Bell, Houweling and Taylor2008; De Silva et al., Reference De Silva, Samarasinghe and Hanwella2011; Nadkarni et al., Reference Nadkarni, Dabholkar, McCambridge and Patel2013; Allen et al., Reference Allen, Balfour, Bell and Marmot2014; Lo et al., Reference Lo, Preeti, Shultz and Roberts2017b; Kibicho and Campbell, Reference Kibicho and Campbell2019). A previous study in Uganda with refugees showed high prevalence of post-traumatic stress, major depressive, generalized anxiety and substance use disorders, all linked to unmet basic needs (Bapolisi et al., Reference Bapolisi, Song, Kesande, Rukundo and Ashaba2020). Conversely, interventions addressing social determinants, for example, income-generating programs, can act as protective factors against initial AUD development (Amosu et al., Reference Amosu, Onifade and Adamson2016; Aaraj et al., Reference Aaraj, Haddad, Khalife, Fawaz and Van Hout2021; Naseh et al., Reference Naseh, Wagner, Abtahi, Potocky and Zahedi2021), while potentially preventing relapse posttreatment. Failing to recognize the impact of social determinants on mental health and AUDs will impede efforts in prevention, recovery and symptom reduction, especially in resource-poor settings. For CHANGE, collaboration with other sectors addressing social determinants of health is necessary.

Third, relevant policies and national mental health plans need to be funded, implemented and closely monitored in the community. This includes integrating mental health services into community and primary healthcare settings to bridge existing treatment gaps (Jordans et al., Reference Jordans, Luitel, Kohrt and Lund2019). Uganda’s Ministry of Health has included mental health into general healthcare provisions, as outlined in the Uganda’s Health Sector Integrated Refugee Response Plan of 2019 and the UNHCR’ Public Health Strategic Plan for Uganda (Government of Uganda and UNHCR, 2022). The Refugee Response Plan states as a key priority the reinforcement of MHPSS services and infrastructure. However, limited progress has been made on this front leaving a big gap between the number of people who need this support and those who receive it. In 2019, it was reported that only 29% of refugees identified as needing MHPSS received it (Government of Uganda and UNHCR, 2022). The current primary healthcare facilities available to refugees are overstretched and underfunded, and data are missing on the number of health facilities in settlements that have a mental health focal point (Government of Uganda and UNHCR, 2022). Task-shifting mental health treatment delivery to non-specialist providers, as recommended by the World Health Organization (WHO 2007), could enhance access to care, particularly through interventions by lay healthcare workers within the community. The 2019 national alcohol policy, issued by the Ministry of Health, also underscores the need for a coordinated approach to reduce harmful alcohol use (Ministry of Health, 2019); however, the existing policy gap in addressing the social determinants of alcohol use, especially for vulnerable populations like refugees, persists.

Mental health service delivery

Stakeholders emphasized the critical role of mental health service delivery in implementing and maintaining CHANGE. However, participants currently perceive there to be high levels of mental health stigma, which acts as a barrier to mental health care delivery. As such, delivering mental health care is dependent on community sensitization efforts of mental health and AUDs, enabling individuals to recognize the need for support, be informed about available resources, and reduce stigma. Nalwadda and colleagues previously assessed AUD prevalence among men in rural Uganda, along with levels of internalized stigma and attitudes toward seeking help (Nalwadda et al., Reference Nalwadda, Rathod, Nakku, Lund, Prince and Kigozi2018). Nearly half of those with AUDs reported that alcohol had “ruined their lives,” yet none of the affected men had received treatment, and 55.5% believed AUDs to be untreatable. In another study on stakeholder perspectives in Uganda, mental health stigma was identified as a widespread issue, rooted in negative local beliefs. These included notions that people with mental health disorders are possessed by spirits, facing consequences for their actions, or that detoxification has serious side effects including intellectual disabilities (Ssebunnya et al., Reference Ssebunnya, Kigozi, Lund, Kizza and Okello2009). Such beliefs hinder the willingness and ability to seek help, potentially worsening existing mental health disorders, including AUDs, and perpetuating poverty cycles.

The current findings indicate that there is a perceived lack of awareness among stakeholders around tackling AUD in Rhino camp settlement. A prior study highlighted similar findings and that reducing stigma toward people with AUDs may facilitate the successful implementation of AUD interventions in conflict-affected populations (Greene et al., Reference Greene, Kane, Khoshnood, Ventevogel and Tol2018). Participants in the current study proposed community-level resources to enhance awareness for AUDs, and available services to facilitate help-seeking. Several interventions, including educational initiatives, awareness campaigns and stigma reduction programs may prove helpful. This could include training community-based health workers in task-sharing interventions to support access to care. Importantly, support should extend beyond treatment completion, necessitating community-based follow-up care to aid reintegration and sustained wellbeing. Workshop participants highlighted the need for integrating psychosocial interventions into existing clinic-based treatment programs and creating opportunities for follow-up care to aid recovery and symptom reduction in the community.

Workshop participants called for the prioritization of further research on the impact of social determinants on mental health and AUDs in Rhino camp settlement. This knowledge can then be used to devise strategies to promote mental health and recovery within this context. For CHANGE, these findings highlight the importance of working with local community leaders to understand how these determinants may impact on AUD interventions and work together to promote the potential long-term benefits if the CHANGE intervention is proven to be effective. The benefits of using ToC workshops to develop a logical plan for scaling up mental health programs, contextualizing the programs and getting stakeholder buy-in has previously been highlighted in other resource-poor settings (Breuer et al., Reference Breuer, De Silva, Fekadu and Lund2014; Fuhr et al., Reference Fuhr, Acarturk, Sijbrandij and Roberts2020; Babatunde et al., Reference Babatunde, van Rensburg, Bhana and Petersen2022). For the current project, the ToC map will need to be reviewed and adapted as further findings emerge on the implementation and scalability of CHANGE.

Experiences of ToC

Beyond the ToC map, the current study explored participants’ reflections on taking part in the workshops, through individual interviews. Participants recognized the benefits of the participatory nature of the workshops, specifically the sense of ownership over ideas. Participants did voice concerns over the flexibility of the final ToC map, as its validity may be challenged in settings where drastic changes can occur, such as humanitarian and/or conflict settings. One study (Breuer et al., Reference Breuer, De Silva, Fekadu and Lund2014) previously described how to adapt the ToC methodology in order to ensure that it remains a useful method to use in shifting conditions (i.e., conflict-affected contexts). They suggested exploring “living ToCs” which can facilitate responsive programming throughout a program’s life cycle. Living ToCs can include conducting regular program evaluations that allow for robust conclusions to be made on the impact of the program, which can then be fed back into the ToC and consequently lead to the adjustment of programing and desired outcomes.

Strengths and limitations

The current research has facilitated the understanding of how the CHANGE intervention can impact change within Uganda’s humanitarian context using a participatory approach. The decisions on how to implement and maintain the intervention need to be driven by local knowledge on operational dynamics, divergent interests, inconsistent funding and the need for safe access to those who can benefit from the intervention (Puri et al., Reference Puri, Aladysheva, Iversen, Ghorpade and Brück2015).

These workshops have enabled us to articulate clear outcomes and have helped draw lessons from the stakeholders’ experience of working within the health sector both at a national and local level. The current article is the first article to use ToC for an AUD and mental health intervention in Uganda (and indeed with forcibly displaced persons globally).

This research had several limitations. First, the ToC map is based on the implementation of the CHANGE intervention in humanitarian settings in Uganda; however, the effectiveness of the CHANGE intervention still needs to be assessed. Second, stakeholders with lived experience (i.e., refugees) were only included in the ToC workshops when they held positions of responsibility within the settlement, meaning some insights regarding the on-the ground realities of the most vulnerable in the settlement may have been missed. Participants of the ToC highlighted challenges surrounding the ambiguity of ToC terminology. This challenge with ToC methodology has previously been highlighted (Stein and Valters, Reference Stein and Valters2012) and suggests potential issues on how specific terms are understood. The ambiguity may change the way in which ToC is approached, and how the map is designed. Suggestions were made by participants in the current study to improve this by providing better simplifications of the constructs, and for these to be made available prior to the ToC workshops. Finally, while the individual interviews helped reflect on the use of ToC workshops in this context, having only five respondents was a further limitation to the findings.

Conclusion

This study uses ToC to identify pathways influencing the implementation and maintenance of interventions addressing psychological distress and AUDs in a Ugandan humanitarian setting. Two pivotal pathways emerged: policy impact and mental health service delivery. The pathways, outcomes, interventions and assumptions outlined herein hold practical relevance for policy, research and practice. The participatory approach, involving multiple workshops and qualitative interviews, enhanced stakeholder ownership and commitment. It is important to note that the resulting ToC map is adaptable, pending assessment of intervention effectiveness, cost-effectiveness and reach. This study pioneers the use of ToC in planning sustainable interventions for AUDs among forcibly displaced persons in Uganda.

Open peer review

To view the open peer review materials for this article, please visit http://doi.org/10.1017/gmh.2023.93.

Data availability statement

Participants of this study did not agree for their data to be shared publicly, therefore supporting data are not available.

Acknowledgments

The authors express their gratitude to the participants who took part in this research study.

Author contribution

D.F. conceived and led the study as principal investigator. W.A.T. and E.K., as site-specific principal investigators, contributed to conception, study design and research activity. L.S.A. and A.M. led the ToC and qualitative analyses and played a significant role in article writing. D.T., the project coordinator, contributed to the research activity and provided written input. B.R., C.M. and A.N. as co-investigators made substantial contributions to the conceptualization, study design and writing. J.S. led the ToC workshops and provided written input. C.B., the research fellow, contributed to analysis, interpretation of findings and led the writing.

Financial support

This study has been funded by the National Institute for Health Research (NIHR) (using the UK’s Official Development Assistance [ODA] Funding) and Wellcome (grant reference number 219468/Z/19/Z) under the NIHR-Wellcome Partnership for Global Health Research (Ref: HSRP496). The views expressed are those of the authors and not necessarily those of Wellcome, the NIHR or the Department of Health and Social Care.

Competing interest

The authors declare that they have no competing interests.

Ethics statement

This study has received ethical approval from the London School of Hygiene and Tropical Medicine Ethics Committee (Ref: 22729) and MildMay Uganda Research Ethics Committee (Ref: 0212-2020). All participants have provided written consent to participate, and for the publication of anonymized results in scientific journals.

References

Aaraj, E, Haddad, P, Khalife, S, Fawaz, M and Van Hout, MC (2021) Understanding and Responding to Substance Use and Abuse in the Palestinian Refugee Camps in Lebanon Prior to and During COVID-19 Times | SpringerLink. Available at https://link.springer.com/article/10.1007/s11469-021-00714-9 (accessed 11 May 2023).CrossRefGoogle Scholar
Adaku, A, Okello, J, Lowry, B, Kane, JC, Alderman, S, Musisi, S and Tol, WA (2016) Mental health and psychosocial support for south Sudanese refugees in northern Uganda: A needs and resource assessment. Conflict and Health 10(1), 110. http://doi.org/10.1186/s13031-016-0085-6.CrossRefGoogle ScholarPubMed
Allen, J, Balfour, R, Bell, R and Marmot, M (2014) Social determinants of mental health. International Review of Psychiatry 26(4), 392407.CrossRefGoogle ScholarPubMed
Amosu, SM, Onifade, PO and Adamson, TA (2016) Psychoactive substance use and general mental health among refugees in a Nigerian camp. Journal of Substance Use 21(3), 230. https://www.tandfonline.com/doi/abs/10.3109/14659891.2013.820800.CrossRefGoogle Scholar
Babatunde, GB, van Rensburg, AJ, Bhana, A and Petersen, I (2022) Identifying multilevel and multisectoral strategies to develop a theory of change for improving child and adolescent mental health services in a case-study district in South Africa. Child and Adolescent Psychiatry and Mental Health 16(1), 45. http://doi.org/10.1186/s13034-022-00484-9.CrossRefGoogle Scholar
Baingana, F and Patrick, OM (2011) Scaling up of Mental Health and Trauma Support among War Affected Communities in northern Uganda: Lessons learned. Available at https://psychotraumanet.org/sites/default/files/documents/int_195.pdf.CrossRefGoogle Scholar
Bapolisi, AM, Song, SJ, Kesande, C, Rukundo, GZ and Ashaba, S (2020) Post-traumatic stress disorder, psychiatric comorbidities and associated factors among refugees in Nakivale camp in southwestern Uganda. BMC Psychiatry 20(1), 110.CrossRefGoogle ScholarPubMed
Braun, V and Clarke, V (2022) Conceptual and design thinking for thematic analysis. Qualitative Psychology 9(1), 3.CrossRefGoogle Scholar
Breuer, E, De Silva, MJ, Fekadu, A, … Lund, C (2014) Using workshops to develop theories of change in five low and middle income countries: Lessons from the programme for improving mental health care (PRIME). International Journal of Mental Health Systems 8(1), 15. http://doi.org/10.1186/1752-4458-8-15.CrossRefGoogle ScholarPubMed
Breuer, E, Lee, L, Mary, DS and Lund, C (2015) Using Theory of Change to Design and Evaluate Public Health Interventions: A Systematic Review. Available at https://link.springer.com/article/10.1186/s13012-016-0422-6 (accessed 18 November 2022).CrossRefGoogle Scholar
Craig, P, Dieppe, P, Macintyre, S, Michie, S, Nazareth, I and Petticrew, M (2008) Developing and evaluating complex interventions: The new Medical Research Council guidance. BMJ 337, a1655. http://doi.org/10.1136/bmj.a1655.CrossRefGoogle ScholarPubMed
Dawson, KS, Bryant, RA, Harper, M, … van Ommeren, M (2015) Problem management plus (PM+): A WHO transdiagnostic psychological intervention for common mental health problems. World Psychiatry 14(3), 354357. http://doi.org/10.1002/wps.20255.CrossRefGoogle Scholar
De Silva, MJ, Breuer, E, Lee, L, … Patel, V (2014) Theory of change: A theory-driven approach to enhance the Medical Research Council’s framework for complex interventions. Trials 15(1), 267. http://doi.org/10.1186/1745-6215-15-267.CrossRefGoogle Scholar
De Silva, , Samarasinghe, D and Hanwella, R (2011) Association between concurrent alcohol and tobacco use and poverty. Drug and Alcohol Review 30(1), 6973.CrossRefGoogle ScholarPubMed
Ezard, N (2012) Substance use among populations displaced by conflict: A literature review. Disasters 36(3), 533557. http://doi.org/10.1111/j.1467-7717.2011.01261.x.CrossRefGoogle ScholarPubMed
Fuhr, DC, Acarturk, C, Sijbrandij, M, … Roberts, B (2020) Planning the scale up of brief psychological interventions using theory of change. BMC Health Services Research 20(1), 801. http://doi.org/10.1186/s12913-020-05677-6.CrossRefGoogle ScholarPubMed
Fuhr, DC, Bogdanov, S, Tol, WA, Nadkarni, A and Roberts, B (2021) Problem management plus and alcohol (PM+a): A new intervention to address alcohol misuse and psychological distress among conflict-affected populations. Intervention 19(1), 141. http://doi.org/10.4103/INTV.INTV_27_20.CrossRefGoogle Scholar
Government of Uganda (2019) National Alcohol Control Policy. Available at https://www.health.go.ug/cause/national-alcohol-control-policy/.Google Scholar
Government of Uganda and UNHCR (2022) Uganda: 2022–2025 Refugee Response Plan. Available at https://reporting.unhcr.org/uganda-2022-2025-refugee-response-plan (accessed 28 November 2023).Google Scholar
Grant, BF, Stinson, FS, Dawson, DA, … Kaplan, K (2004) Prevalence and co-occurrence of substance use disorders and independentmood and anxiety disorders: Results from the national epidemiologic survey on alcohol and relatedconditions. Archives of General Psychiatry 61(8), 807816.CrossRefGoogle Scholar
Greene, MC, Kane, JC, Khoshnood, K, Ventevogel, P and Tol, WA (2018) Challenges and opportunities for implementation of substance misuse interventions in conflict-affected populations. Harm Reduction Journal 15(1), 110.CrossRefGoogle ScholarPubMed
Hammer, JH, Parent, MC and Spiker, DA (2018) Global status report on alcohol and health 2018. Global Status Report on Alcohol 65(1), 7485.Google Scholar
IASC, I-AS (2007) IASC Guidelines on Mental Health and Psychosocial Support in Emergency Settings. Geneva, Switzerland: IASC 2006. Available at https://cir.nii.ac.jp/crid/1572261550682945792.Google Scholar
Jordans, MJD, Luitel, NP, Kohrt, BA, … Lund, C (2019) Community-, facility-, and individual-level outcomes of a district mental healthcare plan in a low-resource setting in Nepal: A population-based evaluation. PLoS Medicine 16(2), e1002748. http://doi.org/10.1371/journal.pmed.1002748.CrossRefGoogle Scholar
Kaltenbacher, S (2019) UNHCR Uganda: Mental Health and Psychosocial Support Strategy (2019–2021) – Uganda. Available at https://reliefweb.int/report/uganda/unhcr-uganda-mental-health-and-psychosocial-support-strategy-2019-2021 (accessed 11 May 2023).Google Scholar
Kane, J and Greene, C (2018) Addressing Alcohol and Substance Use Disorders among Refugees: A Desk Review of Intervention Approaches. Available at https://www.unhcr.org/protection/health/5c064a8d4/addressing-alcohol-substance-use-disorders-among-refugees-desk-review-intervention.html (accessed 1 November 2022).Google Scholar
Kane, JC and Greene, MC (2018) Addressing Alcohol and Substance Use Disorders among Refugees: A Desk Review of Intervention Approaches. Geneva: United Nations High Commissioner for Refugees.Google Scholar
Kibicho, J and Campbell, JK (2019) Community perspectives of second-generation alcohol misuse and HIV risk in rural Kenya: A gendered syndemic lens. Global Public Health 14(12), 17331743.CrossRefGoogle Scholar
Lo, J, Patel, P, Shultz, JM, Ezard, N and Roberts, B (2017a) A systematic review on harmful alcohol use among civilian populations affected by armed conflict in low-and middle-income countries. Substance Use & Misuse 52(11), 14941510.CrossRefGoogle ScholarPubMed
Lo, J, Preeti, P, Shultz, J and Roberts, B (2017b) A systematic review on harmful alcohol use among civilian populations affected by armed conflict in low- and middle-income countries: Substance Use & Misuse 52(11), 1494. https://www.tandfonline.com/doi/abs/10.1080/10826084.2017.1289411.CrossRefGoogle ScholarPubMed
Marmot, M, Friel, S, Bell, R, Houweling, TA and Taylor, S (2008) Closing the gap in a generation: Health equity through action on the social determinants of health. The Lancet 372(9650), 16611669.CrossRefGoogle Scholar
McCrady, BS, Epstein, EE and Fokas, KF (2020) Treatment interventions for women with alcohol use disorder. Alcohol Research: Current Reviews 40(2), 08. http://doi.org/10.35946/arcr.v40.2.08.Google ScholarPubMed
Mellinger, JL, Scott Winder, G, DeJonckheere, M, … Blow, FC (2018) Misconceptions, preferences and barriers to alcohol use disorder treatment in alcohol-related cirrhosis. Journal of Substance Abuse Treatment 91, 2027. http://doi.org/10.1016/j.jsat.2018.05.003.CrossRefGoogle ScholarPubMed
Milián, IN, Royo Aspa, JM, Urgell García, J, Urrutia Arestizábal, P, Villellas Ariño, A and Villellas Ariño, M (2022) Alert! Report on Conflicts, Human Rights and Peacebuilding – Escola de Cultura de Pau. Available at https://escolapau.uab.cat/en/publications/alert-report-on-conflicts-human-rights-and-peacebuilding-2/.Google Scholar
Ministry of Health (2019) National Alcohol Control Policy - Ministry of Health | Government of Uganda. Available at https://www.health.go.ug/cause/national-alcohol-control-policy/ (accessed 25 July 2023).Google Scholar
Nadkarni, A, Bhatia, U, Shaik, I, … Madan, V (2023a) Comorbidity of alcohol use disorders and non-communicable diseases in low-and middle-income countries. Journal of Substance Use, 19.CrossRefGoogle Scholar
Nadkarni, A, Dabholkar, H, McCambridge, J, … Patel, V (2013) The explanatory models and coping strategies for alcohol use disorders: An exploratory qualitative study from India. Asian Journal of Psychiatry 6(6), 521527.CrossRefGoogle ScholarPubMed
Nadkarni, A, Massazza, A, Guda, R, … Fuhr, D (2023b) Common strategies in empirically supported psychological interventions for alcohol use disorders: A meta-review. Drug and Alcohol Review 42(1), 94104. http://doi.org/10.1111/dar.13550.CrossRefGoogle ScholarPubMed
Nalwadda, O, Rathod, SD, Nakku, J, Lund, C, Prince, M and Kigozi, F (2018) Alcohol use in a rural district in Uganda: Findings from community-based and facility-based cross-sectional studies. International Journal of Mental Health Systems 12, 110.CrossRefGoogle Scholar
Naseh, M, Wagner, EF, Abtahi, Z, Potocky, M and Zahedi, L (2021) Prevalence of and risk factors for substance use among afghan refugees in Iran: An exploratory study. Journal of Ethnicity in Substance Abuse 20(1), 3459. http://doi.org/10.1080/15332640.2019.1571976.CrossRefGoogle ScholarPubMed
Probst, C, Manthey, J, Martinez, A and Rehm, J (2015) Alcohol use disorder severity and reported reasons not to seek treatment: A cross-sectional study in European primary care practices. Substance Abuse Treatment, Prevention, and Policy 10(1), 32. http://doi.org/10.1186/s13011-015-0028-z.CrossRefGoogle Scholar
Puri, J, Aladysheva, A, Iversen, V, Ghorpade, Y and Brück, T (2015) What methods may be used in impact evaluations of humanitarian assistance?CrossRefGoogle Scholar
Roberts, B and Ezard, N (2015) Why are we not doing more for alcohol use disorder among conflict-affected populations? Addiction (Abingdon, England) 110(6), 889890. http://doi.org/10.1111/add.12869.CrossRefGoogle ScholarPubMed
Roberts, B, Felix Ocaka, K, Browne, J, Oyok, T and Sondorp, E (2011) Alcohol disorder amongst forcibly displaced persons in northern Uganda. Addictive Behaviors 36(8), 870873. http://doi.org/10.1016/j.addbeh.2011.03.006.CrossRefGoogle ScholarPubMed
Rokhideh, M (2017) Peacebuilding and psychosocial intervention: The critical need to address everyday post conflict experiences in northern Uganda. Intervention 15, 1. http://doi.org/10.1097/WTF.0000000000000161.CrossRefGoogle Scholar
Schäfer, SK, Thomas, LM, Lindner, S and Lieb, K (2023) World Health Organization’s low-intensity psychosocial interventions: A systematic review and meta-analysis of the effects of problem management plus and step-by-step. World Psychiatry: Official Journal of the World Psychiatric Association (WPA) 22(3), 449462. http://doi.org/10.1002/wps.21129.CrossRefGoogle ScholarPubMed
Shiva, L, Shukla, L and Chandra, PS (2021) Alcohol use and gender-based violence. Current Addiction Reports 8, 7180.CrossRefGoogle Scholar
Sphere, (Ed.) (2018) The Sphere Handbook: Humanitarian Charter and Minimum Standards in Humanitarian Response, 4th Edn. Geneva, Switzerland: Sphere Association.CrossRefGoogle Scholar
Ssebunnya, J, Kigozi, F, Lund, C, Kizza, D and Okello, E (2009) Stakeholder perceptions of mental health stigma and poverty in Uganda. BMC International Health and Human Rights 9(1), 19.CrossRefGoogle ScholarPubMed
Stein, D and Valters, C (2012) Understanding theory of change in international development.Google Scholar
Uganda Ministry of Health (2019) Health Sector Integrated Refugee Response Plan 2019–2024. Available at https://globalcompactrefugees.org/sites/default/files/2019-12/Uganda-%20Health%20sector%20integrated%20refugee%20response%20plan%2C%202019-2024_0.pdf (accessed 11 May 2023).Google Scholar
UNHCR (2019a) Imvepi Settlement HLP Factsheet 2019. Available at https://data.unhcr.org/en/documents/details/71910 (accessed 2 May 2023).Google Scholar
UNHCR (2019b) Rhino Camp Settlement HLP Factsheet 2019. Available at https://data.unhcr.org/en/documents/details/71926 (accessed 2 May 2023).Google Scholar
UNHCR (2019c) UNHCR Regional Update - South Sudan Situation May 2019. Available at https://data.unhcr.org/en/documents/details/70085 (accessed 11 May 2023).Google Scholar
UNHCR (2021) Global Trends Report 2021. Available at https://www.unhcr.org/media/40152 (accessed 5 May 2023).Google Scholar
Vogel, I (2012) Review of the Use of ‘Theory of Change’ in International Development, 86.Google Scholar
Weaver, H and Roberts, B (2010) Drinking and displacement: A systematic review of the influence of forced displacement on harmful alcohol use. Substance Use & Misuse 45(13), 23402355. http://doi.org/10.3109/10826081003793920.CrossRefGoogle ScholarPubMed
World Bank (2022) Remarks by World Bank Group President David Malpass at Fragility Forum 2022: Development and Peace in Uncertain Times. Available at https://www.worldbank.org/en/news/speech/2022/03/07/remarks-by-world-bank-group-president-david-malpass-at-fragility-forum-2022-development-and-peace-in-uncertain-times (accessed 18 November 2022).Google Scholar
Figure 0

Table 1. Description of ToC participants

Figure 1

Figure 1. Theory of change map.

Figure 2

Table 2. Definitions of ToC construct according to different participants

Author comment: Using theory of change to plan for the implementation of a psychological intervention addressing alcohol use disorder and psychological distress in Uganda — R0/PR1

Comments

Dear Prof. Chibanda and Prof. Bass,

We wish to submit an original article titled ‘Using Theory of Change to Plan for the Implementation of a Psychological Intervention Addressing Alcohol Use Disorder and Psychological Distress in Uganda’. We confirm that this work is original and has not been published elsewhere, nor is it currently under consideration for publication elsewhere.

When developing complex interventions, it is recommended to investigate how context may influence intervention outcomes and implementation. In our paper we use a Theory of Change to identify pathways that influence the implementation and maintenance of a new transdiagnostic intervention (‘CHANGE’) aimed at addressing psychological distress and alcohol misuse in Uganda. We describe three workshops we conducted in Uganda to develop a Theory of Change map for psychological interventions in this context, and carried out semi structured interviews that were done with stakeholders to explore their experiences of participating in these workshops. Through the workshops, we were able to identify two pivotal pathways in the final Theory of Change map – a policy impact pathway and a mental health service delivery pathway. We consider the pathways, outcomes, interventions, and assumptions identified in this paper to be valuable for policy, research, and practice in the field of global mental health. As such, we believe that this is in line with the scope of this journal and would be very grateful for your consideration of this manuscript.

Yours sincerely,

Dr. Catharina Van der Boor

Review: Using theory of change to plan for the implementation of a psychological intervention addressing alcohol use disorder and psychological distress in Uganda — R0/PR2

Conflict of interest statement

Reviewer declares none.

Comments

The paper was interesting to read and describes a useful process which can inform others involved in adapting, testing and implementing complex interventions. Congrats to the authors on conducting and reporting this process.

Overall points

At first the paper seems to address psychological distress as well as AUDs, but as I read further, there were fewer and fewer mentions of the psychological distress component. Further, PM+ does not include alcohol use, except as an unhelpful coping strategy. What evidence-based intervention components were included to target alcohol use? Can you comment on this?

Also, much of the literature on brief interventions for alcohol use focuses on indicated prevention. Do you use diagnostic criteria to assess eligibility for the intervention? Or do you use a screening tool such as the ASSIST?

Has the ToC map been used to guide implementation? Is it being used for monitoring (are indicators being used)? Has it been adapted since the start of the project?

Minor points

1. Terminology: Different terms are used to refer to mental health conditions: mental disorders, mental health disorders. It would be a good idea to stick to one.

2. Line 53: “Kane” not capitalized in citation.

3. Line 274: “five start hotel” – this looks like a typo?

4. Line 392: in-text citation appears in 2 different formats

Impact statement

1. Lines 2-3: does the current study shed “light on the pressing issue of alcohol use disorders”, or the steps that stakeholders decided would lead them to the desired impact? The scope of the study seems to be overstated.

Background

1. The first paragraph is quite long; it would be good to break it up somewhat.

2. The topic sentence of the paragraph starting in line 66 does not seem to link well to the paragraph ideas. I’m assuming the paragraph is trying to say that ToC takes context into account. It sounds like the intervention has already been developed. What is the main reason for using ToC for this project? It would be good to highlight the known usefulness of ToC for this purpose. The De Silva paper mentions a range of uses but I suggest that you contextualise for your project; this would be easier for the reader to follow.

3. Line 76-77: “The aim of this study was to use ToC to summarize pathways that influence the planning for the implementation and maintenance of CHANGE for refugees in Uganda.” The words “that influence the planning” seem to be superfluous and are confusing. Do you mean to say that: “The aim of this study was to use ToC to summarize pathways to the implementation and maintenance of CHANGE for refugees in Uganda”?

4. Could you mention briefly why and how PM+ was chosen and adapted for CHANGE in Uganda? Has PM+ been tested in Uganda?

5. Can you also mention the intervention components for PM+ (eg problem solving and behavioural activation) and the alcohol use component?

Methodology

Setting

1. Line 96: I suggest rephrasing since “substance misuse” is not a non-communicable disease, but a health risk behaviour associated with various NCDs, including substance use disorders.

2. The rationale for the inclusion of Arua and the Rhino settlement is clear. For Kampala, is this because cases may be referred to Kampala, and senior Ministry of Health officials are based in Kampala?

3. It would be good to describe the current health services available in the Rhino settlement and any other psychosocial-related resources.

Participants

1. Can you clarify some of the titles used for participants? (block leader, women representative, refugee leader etc) It would be good to know if these people were refugees living in the camp or not. The limitations section suggests that refuges were not involved?

2. How were the subset of participants chosen for the semi-structured interviews?

Results

1. Much of the discussion focused on AUDs and not psychological distress. What was the reason for this? Psychological distress did not feature at all.

2. Lines 186-188: could you give ideas of the types of activities suggested for interventions 6 and 7?

Discussion & conclusion

1. Policy impact: the need for action and complementary policies across the government departments could have been discussed (regarding social determinants). Has there been any initiatives for health involving various departments? The COVID-19 pandemic spurred such action in many countries. (Ministries of Health began working with other ministries.) Is alcohol/substance use seen as a health issue or is the main role player here another government department?

2. Paragraph starting line 380: what relevant national mental health policies and plans are there in Uganda? It would be good to highlight local plans, knowledge and mechanisms in place to do this and also where the gaps lie (very broadly). You could also comment on the presence/absence of adequate substance use policy.

3. Lines 402 and 403: the study did not conduct a community survey. These lines seem to overstate the scope of the study.

4. Lines 389-415: These paragraphs could do with some restructuring. The discussion brings stigma in and then diverts to other statements around awareness and back to stigma. Lack of knowledge can be seen as part of stigma but the argument is a bit difficult to follow.

5. Interventions and stigma reduction interventions are mentioned but no sources are cited. Please review.

6. Lines 416-418: shift the focus of these lines to the recommendations by workshop participants that social determinants of mental health need to be prioritized. This statement in its current form seems to go beyond the scope of the study findings.

7. The rest of the paragraph can also be revised. The participants appreciated the collaborative effort which highlights the utility of ToC for mapping implementation. Yes, there is potential for sustainability and scale up if the process is repeated or the ToC is reviewed, but you don’t yet have any findings here since this is planning for implementation of a study. You can cite ToC success in health system strengthening and scale up phases elsewhere (see the work of Inge Petersen and colleagues – not just in PRIME).

8. You state that the process “enhanced stakeholder ownership and commitment” I would include the word “perceived” since surely this remains to be seen as the project unfolds?

Review: Using theory of change to plan for the implementation of a psychological intervention addressing alcohol use disorder and psychological distress in Uganda — R0/PR3

Conflict of interest statement

Lena Andersen is a friend. We are working on grant application together. I have worked with Joshua Ssebunnya previously.

Comments

Using Theory of Change to Plan for the Implementation of a Psychological Intervention Addressing Alcohol Use Disorder and Psychological Distress in Uganda

14 November 2023

Thank you for the opportunity to review this paper. This paper reports on a participatory Theory of Change development process for AUD in conflict affected settings in Uganda. It reports the results of the Theory of Change (i.e. the map and describes the components) but also reflects on the process. They also report on five semi structured interviews with participants of the workshops.

Overall, this is a nice paper. I congratulate the authors on the nuance they have achieved in the results section by weaving together the assumptions and outcomes. I also commend the authors for including interviews of participants. The findings have resonated with my own experience running ToC workshops on the complexity of the ToC jargon.

I suggest some minor revisions

- Theory of Change purists will call Theory of Change an “approach” rather than a method because it relies on multiple methods for evaluation. I would also differentiate throughout that you used participatory Theory of Change workshops (rather than using a “Theory of Change” as there is no one universal approach to developing Theories of Change). ToC does not have to be participatory (although I think it should be!)

- In light of the above, in the methods could you be more specific about how your developed the ToC (rather than the ideal ToC components). I have found a table is often helpful for this. I am assuming that your ToC development did not only happen in the workshops but that there were multiple iterations after the workshops as well. It would be good to understand how this was done and how the information gained in the workshop was developed into a ToC. Some of this is covered in “procedure” so it may be worth consolidating this section with the “ToC workshops” section. Also, how were the audio recordings used. Were they transcribed or only used to check missing information?

- Prevalence is technically not a “rate” as there is no time component (unlike incidence which has a time component)

- The inclusion of stakeholder interviews is a really welcome addition to the ToC literature (very little is known about the experiences of stakeholders), however, a larger sample size would have produced more robust results.

- Pg 4,line 53 – Kane needs a capital letter

- Overall, I would have liked to understand how evidence was used to inform/modify/support the ToC map. At the moment, it’s really just the rationale.

ToC map

- Overall the ToC map is perhaps a little more like a process map than a theory of change. For example, it would be important to think about what changes as a result of the CHANGE intervention rather than just reporting that it had been offered.

- The outcome “Community is made …” could be reworded as “community is aware and….”

- The outcome “unemployment is addressed” could be rephrased as “Clients with alcohol problems are supported to find work/earn income”

- The interventions should be before the outcomes they produce, e.g. intervention 1 should come before the first outcome

Review: Using theory of change to plan for the implementation of a psychological intervention addressing alcohol use disorder and psychological distress in Uganda — R0/PR4

Conflict of interest statement

Reviewer declares none.

Comments

GENERAL COMMENTS

This paper describes the process and outcome of using a Theory of Change (TOC) to identify pathways influencing implementation and maintenance of the CHANGE intervention (an expanded version of PM+, which includes AUD management). In addition to sharing the primary outcome, a TOC map with two pathways - policy impact and mental health service delivery, the authors reflect on the utility of the TOC methodology and analyze findings from stakeholder interviews.

Theories of change are often developed for interventions or programs to guide the evaluation process. The concept of using a TOC to think about implementation and maintenance pathways prior to the full testing of an intervention is in line with “best practices” in scaling up as it seeks the early involvement and buy in of stakeholders in program design and helps to anticipate opportunities and barriers to implementation.

The TOC map does a good job of describing the contextual conditions necessary for sustained implementation and impact of the CHANGE intervention. One of the key strengths of the map is its visual simplicity. Often Theory of Change maps are overcomplicated, and their underlying messages become lost. This map strikes a good balance. Likewise, I appreciate the inclusion of the rational boxes/explanations, as it serves to ground the map in an existing evidence base.

SPECIFIC COMMENTS

I suggest the following minor modifications and clarifications:

1. The hyperlink to the CHANGE project is useful, but it would be helpful to include additional information about the intervention in the body of the article, including when the intervention is being implemented and tested, and by whom, as well as how this TOC intersects with the intervention evaluation work. Essentially, I would have appreciated understanding where the creation of this TOC fits within the larger picture of intervention development, testing, implementation etc. Perhaps a call out box, if the publisher permits it.

2. Please number or label the pink/orange boxes in the intermediate outcomes section. This will make discussing, reviewing and commenting on them much easier.

3. Please clarify which of the pink/orange boxes lie within the scope of the CHANGE intervention and which are outside of it (e.g. by circling or delineating the relevant boxes). For example, I’m not clear if assessment of clients with AUD is something that happens as part of the CHANGE intervention, or if CHANGE only refers to the enhanced PM+ treatment delivery in the next box.

4. Related to the comment above, it’s not clear what (or whom) the ceiling of accountability line refers to? Is everything to the right of the line assumed to be directly influenced by the CHANGE intervention? Or does this line simply differentiate the outcomes that will be monitored from those that will not? If so, who will be doing the monitoring?

5. Is the horizontal blue box at the bottom of the TOC an outcome or an assumption? If it’s an assumption, why is it not listed with the others on page 34?

6. It would be helpful if the authors outline their vision for using this TOC map moving forward (e.g. how will it be used within the life of the intervention, who might this be shared with, will it be treated as a living document etc).

7. Theories of Change for interventions are typically accompanied by indicators of the expected outcomes, which are then tracked over time as part of the evaluation process. I appreciate that this TOC is intended to provide a map of potential pathways to implementation and/or sustainability of the CHANGE intervention and thus such indicators may not be appropriate. However, I feel that the practical utility of this map lies in its potential as a tool for assessing the real-world viability of these pathways and identifying gaps/opportunities that could compromise/enhance the implementation and sustainability of the CHANGE intervention. Both program implementors and prospective funders interested in investing in the sustained implementation of the CHANGE intervention will want to understand the extent to which the contextual conditions required to support implementation currently exist or need to be created, and who could be engaged to do so. In other words, what are the chances of each “supporting” intervention and assumption actually being met? To this end, I encourage the authors to add detail to both the intervention and assumption boxes on page 34 that provides further information about the current implementation conditions (or at least how these will be assessed in future). For example:

Intervention: Train community health workers to screen for and identify AUDs in the refugee community and to select appropriate referral pathways (based on levels of severity and other associated problems).

Descriptive information: Do any such training programs already exist? What guidelines could be used? Are there currently any referral pathways? What are they and to where? Who is involved?

Intervention: Provide refugees in recovery from AUDs with vocational skills training

Descriptive Information: Do any vocational training programs currently exist in Rhino? Which agencies provide them/ could provide them (INGO, government)? Who needs to be engaged to make this happen?

Assumption: Mental health services are accessible to refugees.

Descriptive information: What accessible mental health services currently exist? Who provides them? Who uses them?

Assumption: Health care workers including social workers, community health care workers, and counsellors are available to provide services locally.

Descriptive information: How many of these workers are currently present in the camp or surrounding area? Who employs them (government, INGO)? What type of training have they received?

Assumption: Mental health plan supports the implementation of CHANGE.

Descriptive information: Is a mental health plan in place, at what level of gov? What opportunities exist to modify it in support of CHANGE? Who are the gatekeepers/key influencers?

8. The interviews about the Theory of Change process are an important addition to the paper, and capture both commonly held critiques about the process such as its complexity, inclusion issues (who should be involved in the process) and utility in a changing context. The final section does a good job of discussing the limitations of this process, but it could be beneficial if the authors reflect on why they did not engage a potential service user as part of the TOC process.

Recommendation: Using theory of change to plan for the implementation of a psychological intervention addressing alcohol use disorder and psychological distress in Uganda — R0/PR5

Comments

No accompanying comment.

Decision: Using theory of change to plan for the implementation of a psychological intervention addressing alcohol use disorder and psychological distress in Uganda — R0/PR6

Comments

No accompanying comment.

Author comment: Using theory of change to plan for the implementation of a psychological intervention addressing alcohol use disorder and psychological distress in Uganda — R1/PR7

Comments

Dear editor,

We kindly thank you and the reviewers for the helpful comments on the manuscript. We have addressed each of the comments provided.

Best wishes,

Catharina Van der Boor

Review: Using theory of change to plan for the implementation of a psychological intervention addressing alcohol use disorder and psychological distress in Uganda — R1/PR8

Conflict of interest statement

No competing interests

Comments

The revised manuscript does a good job of addressing reviewer comments and queries. The additional details regarding TOC process, origins of CHANGE intervention, mental health policy and access conditions in Uganda, and the proposed usage of the TOC within the context of intervention development are particularly helpful. The manuscript is a beneficial contribution to the existing literature.

Please note two suggested minor edits to the final text:

Line 18 – change 5 to “five”

Line 150 – delete the additional space between “the” and “draft”

Review: Using theory of change to plan for the implementation of a psychological intervention addressing alcohol use disorder and psychological distress in Uganda — R1/PR9

Conflict of interest statement

Reviewer declares none.

Comments

Thank you for addressing the points in detail and responding to my comments. One further comment: the sampling method for the interviews appears to be convenience sampling as the participants were not selected based on any particular characteristic, but rather on their availability. Congrats on your paper and valuable addition to the literature!

Recommendation: Using theory of change to plan for the implementation of a psychological intervention addressing alcohol use disorder and psychological distress in Uganda — R1/PR10

Comments

No accompanying comment.

Decision: Using theory of change to plan for the implementation of a psychological intervention addressing alcohol use disorder and psychological distress in Uganda — R1/PR11

Comments

No accompanying comment.