Hostname: page-component-586b7cd67f-dsjbd Total loading time: 0 Render date: 2024-11-28T19:47:58.109Z Has data issue: false hasContentIssue false

Mental health training for secondary school teachers in Haiti: a mixed methods, prospective, formative research study of feasibility, acceptability, and effectiveness in knowledge acquisition

Published online by Cambridge University Press:  06 March 2017

E. Eustache*
Affiliation:
Zanmi Lasante, Mental Health and Psychosocial Services, Mirebalais, Haiti
M. E. Gerbasi
Affiliation:
Department of Global Health and Social Medicine, Harvard Medical School, Boston, MA, USA
M. C. Smith Fawzi
Affiliation:
Department of Global Health and Social Medicine, Harvard Medical School, Boston, MA, USA
J. R. Fils-Aimé
Affiliation:
Zanmi Lasante, Mental Health and Psychosocial Services, Mirebalais, Haiti
J. Severe
Affiliation:
Department of Global Health and Social Medicine, Harvard Medical School, Boston, MA, USA Department of Psychiatry, Baystate Medical Center, Tufts University School of Medicine, Springfield, MA, USA
G. J. Raviola
Affiliation:
Department of Global Health and Social Medicine, Harvard Medical School, Boston, MA, USA Partners In Health, Boston, MA, USA Department of Psychiatry, Boston Children's Hospital, Boston, MA, USA
R. Legha
Affiliation:
Department of Psychiatry, University of California Los Angeles, Los Angeles, CA, USA
S. Darghouth
Affiliation:
Department of Psychiatry, Massachusetts General Hospital, Boston, MA, USA
D. J. Grelotti
Affiliation:
Department of Psychiatry, University of California San Diego, La Jolla, CA, USA
T. Thérosmé
Affiliation:
Zanmi Lasante, Mental Health and Psychosocial Services, Mirebalais, Haiti
E. L. Pierre
Affiliation:
Zanmi Lasante, Mental Health and Psychosocial Services, Mirebalais, Haiti
E. Affricot
Affiliation:
Zanmi Lasante, Mental Health and Psychosocial Services, Mirebalais, Haiti
Y. Alcindor
Affiliation:
Zanmi Lasante, Mental Health and Psychosocial Services, Mirebalais, Haiti
M. B. Stack
Affiliation:
Department of Global Health and Social Medicine, Harvard Medical School, Boston, MA, USA
A. E. Becker
Affiliation:
Department of Global Health and Social Medicine, Harvard Medical School, Boston, MA, USA Department of Psychiatry, Massachusetts General Hospital, Boston, MA, USA
*
*Address for correspondence: Pere E. Eustache, Santo A Croix des Bouquets, Haiti, W.I. (Email: [email protected])
Rights & Permissions [Opens in a new window]

Abstract

Background

Engagement and training of educators in student mental health holds promise for promoting access to care as a task sharing strategy but has not been well-studied in low-income regions.

Methods

We used a prospective and convergent mixed methods design to evaluate a customized school mental health 2½ day training for teachers in rural Haiti (n = 22) as the initial component of formative research developing a school-based intervention to promote student mental health. Training prepared teachers to respond to student mental health needs by providing psychoeducational and practical support to facilitate access to care. We examined level of participation and evaluated feasibility, acceptability, and perceived effectiveness by calculating mean scores on self-report Likert-style items eliciting participant experience. We examined effectiveness of the training on improving mental health knowledge and attitudes by comparing mean scores on an assessment administered pre- and post-training. Finally, we examined self-report written open-ended responses and focus group discussion (FGD) interview data bearing on perceived feasibility, acceptability, and effectiveness to contextualize participant ratings of training and to identify recommendations for enhancing the utility of mental health training locally for educators.

Results

Mean scores of knowledge and attitudes significantly improved between the pre-test and post-tests; e.g., knowledge improved from 58% correct at baseline to 68% correct on the second post-test (p = 0.039). Mean ratings of the training were favorable across all categories and FGD data demonstrated widespread participant endorsement of training acceptability and effectiveness; participants recommended extending the duration and number of training sessions.

Conclusions

Findings support feasibility, acceptability, and a limited scope of effectiveness of brief mental health training for secondary school teachers in Haiti. Further development of approaches to engage teachers in promoting school mental health through training is warranted.

Type
Original Research Paper
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © The Author(s) 2017

Introduction

Mental disorders are among the largest contributors to the global burden of disability (Becker & Kleinman, Reference Becker and Kleinman2013). Mental disorders are also prevalent in youth, and yet the majority of youth with mental illness in low resource settings do not receive care for this condition (Kieling et al. Reference Kieling, Baker-Henningham, Belfer, Conti, Ertem and Omigbodun2011; Patton et al. Reference Patton, Coffey, Cappa, Currie, Riley and Gore2012). Timely intervention for youth with mental disorders has potentially high return in the prevention of adverse health and social sequelae associated with untreated mental illness (Kieling et al. Reference Kieling, Baker-Henningham, Belfer, Conti, Ertem and Omigbodun2011). Expanding access to community-based mental health care and to mental health services for children and adolescents has thus been identified as among the highest of global mental health priorities (Collins et al. Reference Collins, Patel, Joestl, March, Insel and Daar2011). Strategies to promote access include service models that extend surveillance, outreach, and delivery into community settings and leverage scarce specialty resources through intersectoral collaboration and task sharing (Kakuma et al. Reference Kakuma, Minas, van Ginneken, Dal Poz, Desiraju and Morris2011).

Task sharing is the reallocation of certain health care related duties from specialized health professionals to health workers and others who have requisite skills but a lower level of training or expertise (Kakuma et al. Reference Kakuma, Minas, van Ginneken, Dal Poz, Desiraju and Morris2011; Padmanathan & De Silva, Reference Padmanathan and De Silva2013). Task sharing has demonstrated effectiveness for mental health care (Patel et al. Reference Patel, Weiss, Chowdhary, Naik, Pednekar and Chatterjee2011; van Ginneken et al. Reference van Ginneken, Tharyan, Lewin, Rao, Meera, Pian, Chandrashekar and Patel2013) and its optimization for mental health case finding and care delivery has emerged as one of the field's top research priorities (Baingana et al. Reference Baingana, Al'Absi, Becker and Pringle2015). However, knowledge gaps persist regarding its feasibility and acceptability (Padmanathan & De Silva, Reference Padmanathan and De Silva2013). In addition, relatively few studies have examined an extension of the task sharing paradigm to teachers to reduce the burden of mental illness in youth living in low-resource regions (Kakuma et al. Reference Kakuma, Minas, van Ginneken, Dal Poz, Desiraju and Morris2011).

Notwithstanding a dearth of school-based studies of mental health interventions in low- and middle-income countries (LMICs) (Fazel et al. Reference Fazel, Hoagwood, Stephan and Ford2014a , Reference Fazel, Patel, Thomas and Tol b ), there are compelling reasons to develop school platforms for community-based mental health promotion. First, school-based health surveillance and preventive interventions are well established for other health conditions (Mnookin Reference Mnookin2016). Second, youth with mental health needs are at high risk for non-detection in regions where there is low mental health literacy and where health system access may be constrained by affordability of transportation and opportunity cost for parents. Next, educators have a unique and strategic opportunity to detect behavioral changes in students that could be the first presenting signs of mental illness. For example, teachers have both a proximal and a potentially invaluable longitudinal perspective on changes in social interactions and academic performance that could be the bellwether of an incipient depression or other treatable mental disorder. Finally, teachers have an education and skill set that can be the foundation for recognizing and responding to youth with a mental illness, behavioral problem, or major social stressor that is adversely impacting their functioning at school or their optimal development (Kieling et al. Reference Kieling, Baker-Henningham, Belfer, Conti, Ertem and Omigbodun2011).

Haiti is a low-income country where mental and substance use disorders represent an estimated 23% of years lived with disability (YLDs; Vos et al. Reference Vos, Barber, Bell, Bertozzi-Villa, Biryukov and Bollinger2015). A major earthquake centered near Port-au-Prince in 2010 resulted in catastrophic casualties and damage, adding to the chronic social adversities Haitian youth already face and straining its health care system, which had already been inadequate to meet mental health needs. Recognizing these unmet needs Zanmi Lasante (ZL), a non-governmental organization (NGO) affiliated with Partners In Health (a US-based NGO), launched a plan to expand availability of quality mental health care in its catchment area in Haiti's Central Plateau (Raviola et al. Reference Raviola, Eustache, Oswald and Belkin2012, Reference Raviola, Severe, Therosme, Oswald, Belkin and Eustache2013). In addition to enhancing and developing hospital and clinic-based care through psychologist, physician, and nurse training, this plan also expanded community-based mental health services through the training and deployment of a cadre of Community Health Workers (CHWs). Locally referred to as accompagnateurs, these CHWs received training in mental health care, specifically through the development of skills to identify people suffering from neuropsychiatric disorders, including depression, psychotic illness and epilepsy, and to provide basic support in the community.

In 2012, development of a complementary school-based platform for community-based mental health promotion was begun through formative research on an intervention entitled the ‘Teachers as Accompagnateurs Pilot Study’ (TAPS). The overarching goal of TAPS was to configure the locally familiar accompagnateur role (Farmer et al. Reference Farmer, Léandre, Mukherjee, Claude, Nevil and Smith-Fawzi2001) for teachers within a task-sharing framework, in which they could provide psychoeducation and enrich the psychosocial support network for students as part of a bridge to care between schools and the clinic. Key components of TAPS included delivery of training to secondary school teachers, school-based screening for mental health needs, and facilitation of teacher–student meetings for psychoeducation and other practical support, including navigation to mental health care (see Eustache et al. Reference Eustache, Becker and Ekip2014).

The present study evaluates the teacher-training component of TAPS within a framework of formative research aimed at refining its further development (see Gittelsohn et al. Reference Gittelsohn, Steckler, Johnson, Pratt, Griser and Pickrel2006; Beidas et al. Reference Beidas, Koerner, Weingardt and Kendall2011). Training was delivered to teachers in advance of the school-based mental health student screening to prepare them for their role as accompagnateurs in meeting with students. In this role, teachers were to respond to student mental health needs with psychoeducational and practical support, including by facilitating access to care when appropriate. Because the future utility of their accompagnateur role was predicated, in part, on their knowledge of manifestations and impact of mental illness in youth as well as locally available treatment options, this training was developed to augment teachers’ professional expertise with specific knowledge and skills relevant to school mental health in Haiti. This study aimed to evaluate the feasibility and acceptability of this scope of training content and format of delivery to teachers as well as its effectiveness in improving knowledge and attitudes relevant to school mental health.

Methods

We used a prospective and convergent mixed methods design to assess feasibility, acceptability, and effectiveness on short-term relevant knowledge gain of a brief mental health training for secondary school teachers in Haiti's Central Plateau. The delivery and evaluation of this mental health training was a component of formative research on a school-based pilot mental health intervention, TAPS, described elsewhere (Eustache et al. Reference Eustache, Becker and Ekip2014). This study protocol was approved by the Harvard Medical School Office for Research Subject Protection and the ZL Ethics Committee. Written informed consent was obtained for each study participant. Study findings reported here are based on data collected in 2013.

Study sample

Teacher study participants were selected purposively by nomination by their respective school principals at each of four participating schools. Schools were selected both for convenience and purposively for location within the ZL catchment area in Haiti's Central Plateau and to comprise both public and independent schools. The participation rate was 91.7% with 22 (18 male, four female, mean age = 40.1, s.d. = 7.16) enrolled of 24 eligible teachers nominated. It should be noted that the majority of teachers in the school system are male.

Procedures

Study procedures aligned with aims of the broader pilot study intervention by providing teachers with information and principles relevant to school mental health, in order to prepare them for their study-specific role in the ensuing pilot intervention (Eustache et al. Reference Eustache, Becker and Ekip2014). This role, as ‘teacher-accompagnateur,’ was to provide students with guidance and support that could facilitate their access to local mental health services. Study procedures were developed following consultation with Haitian educators, recruited independently of the teacher participants described in the present study, via focus group discussions (FGDs) about perceived mental health needs and engagement of educators in a school-based intervention. Participants were provided with meals and lodging during the training, but did not receive financial compensation for participation.

Content and delivery of the training curriculum

Study participants attended and completed a single training session lasting 2½ days that included didactic presentations, interactive discussions, and role-plays. The teaching was primarily led by study investigators who were also mental health clinicians at ZL and conducted in Haitian Creole and French. This training was delivered just prior to the start of the academic year.

The training curriculum was adapted from existing training resources for community health workers at ZL and augmented with content developed by study investigators to enhance its relevance to school mental health. The curriculum was organized around a framework of ‘the four Rs’ – recognize (rekonèt), respond (reponn), refer (refere), and [build] resilience ([bati] rezilyans) – intended to provide a foundation of mental health knowledge relevant to teachers’ routine role as educators and also to their study role as teacher-accompagnateur. Specific topics included: child and adolescent development; signs and symptoms of major mental disorders in adolescents and adults; an overview of effective treatments for mental disorders; recognizing a psychiatric emergency; approaches to responding to students with mental health needs; local mental health resources available to students for referral; stress management; Haitian mental health law; and promoting resilience through support of adaptive coping strategies. This curriculum was summarized and distributed in a 118-page manual written in Haitian Creole (available upon request); an English language version of the table of contents is displayed in the appendix. Corresponding slide sets were developed, also in Haitian Creole, to facilitate learning and discussion during presentations.

Assessment of feasibility, acceptability, and effectiveness in promoting knowledge gains

Quantitative assessments

As a proxy for feasibility of training, we examined level of teacher participation by calculating rates of study participation, completion of training, and response to assessments. In addition, we developed two kinds of written quantitative assessments to examine training feasibility and acceptability, as well as its effectiveness in improving relevant knowledge and attitudes. These assessments were translated from English into Haitian Creole, back-translated, and adjusted for syntax and accuracy after comparison with the original version.

Mental health knowledge and attitude assessment

We used an unstandardized written assessment as our primary measure of mental health knowledge and attitudes at baseline and at two post-training time points. We developed the assessment for this study in order to align item content with training curriculum content and optimize its relevance to the local social context. Participants responded to the same assessment of mental health knowledge and attitudes at baseline (Time 0), immediately post-training (Time 1), and approximately 6–9 weeks following training (Time 2). Fund of relevant mental health knowledge assessment comprised 48 multiple choice items. Attitudes toward mental illness and its treatment comprised 40 additional Likert-style items on a five-point scale, ranging from ‘Strongly disagree’ to ‘Strongly agree.’ Internal consistency reliability for this latter measure was acceptable (Kline, Reference Kline1999) across administrations: Cronbach's α at Time 0 = 0.69; Time 1 = 0.84; Time 2 = 0.81.

Participant feedback about the content, delivery, and utility of training

We assessed perceived feasibility and acceptability of the training immediately after the first post-test with eight Likert-style items, on a five-point scale, ranging from ‘Strongly disagree’ to ‘Strongly agree.’ Feasibility was operationalized as perceived level of difficulty of the training and acceptability was operationalized as user satisfaction (three and five questions, respectively, displayed in Fig. 1; see Padmanathan & De Silva, Reference Padmanathan and De Silva2013).

Fig. 1. Post-training (Time 1) feasibility and acceptability. Response options were Likert-style and ranged from 1 (Strongly disagree) to 5 (Strongly agree).

Qualitative assessments

Written self-report open responses

Immediately following the training, participants responded to nine open-ended questions regarding their experience of training, with specific items asking about user satisfaction with the training delivery and relevance of content, level of difficulty, and recommendations for improvement (Table 1). Of these, two questions elicited feedback specific to duration and periodicity of training. Responses were translated into English for coding and analysis.

Table 1. Teacher perceptions of feasibility, acceptability, and effectiveness conveyed in post-training written open-ended responses

a Data presented in table exclude two questions specific to duration and periodicity.

b Responses from these two questions were combined for tally and illustrative excerpts.

FGD interviews

After completion of the subsequent school-based intervention phase (corresponding to Time 2, at 6–9 weeks following training) – we conducted two FGD interviews with a convenience sub-sample of teacher study participants (n = 12) to debrief them on their experience in participating in the study and elicit their ideas for optimizing this school-based intervention promoting student mental health. For example, interviews included the following prompts: ‘Please share your perspective on how well this program met objectives to train teachers to support student mental health?’; ‘Please share your perspective on the challenges teachers faced in participating in TAPS’; and ‘Based on your experience, what ideas do you have to make this program more effective for teachers in the future?’ FGDs were facilitated by two study investigators in Haitian Creole and were audio-recorded. Interviews were transcribed and translated into English for analysis. A second bilingual investigator verified the accuracy of the transcription and translation.

Data management and analyses

Self-report data were entered into an Excel file and verified. For written open-response items, missing responses were coded and tallied as ‘no response.’ For other written self-report data, missing and double entered responses were identified and addressed as follows. Knowledge assessment responses were scored dichotomously as correct or incorrect: missing and double-entered responses were coded as incorrect. Participants missing more than 10% of attitude test responses at any one of the time points were excluded from analysis of that measure. For participants missing fewer than 10% of attitude responses, the mean of all answered items was calculated. This procedure resulted in an analysis sample of n = 22 for knowledge assessment and n = 15 for assessment of attitudes. Missing data for all other measures were addressed item-wise, with sample sizes shown in Fig. 1.

Statistical analysis

We assessed mental health knowledge at baseline (Time 0), immediately post-training (Time 1), and 6–9 weeks post-training (Time 2) by calculating a score based on the percent correctly answered at each assessment. Likewise, we assessed mental health attitudes at Time 0, Time 1, and Time 2 by calculating mean scores of that component of the assessment at each time point. We evaluated effectiveness of the training in improving mental health related knowledge and attitudes with repeated measures analysis of variance (ANOVA) and follow-up paired sample t tests. Prior to performing these analyses, we tested for normality in mental health knowledge and attitudes at each time point, with Shapiro–Wilk tests. As the distributions of mental health knowledge and attitudes did not significantly differ from normal (all p values >0.05), parametric tests were used.

We assessed teachers’ perceived feasibility and acceptability of the training by calculating mean scores for each Likert-style question from the participant feedback evaluation at Time 1. Quantitative analyses were conducted in SPSS 23 (IBM Corp, 2015).

Qualitative data analysis

We evaluated participants’ written open-ended responses by first generating a list of themes in response to each question; these themes were either structured a priori in alignment with study aims or identified inductively from the responses so as to inform an understanding of teacher experience and recommendations relevant to mental health training. Two independent raters then assigned codes linking responses to these thematic categories. These coding assignments were compared to identify discrepancies, which were then resolved by discussion and refinement of thematic categories with a third coder. A final set of themes was generated; this set comprised both themes specific to particular questions, as well as themes that related to one or more questions. Coding was finalized by consensus among the coders. We then generated summary data regarding the frequency of theme endorsement in each category and selected illustrative responses for presentation. However, responses to the two items regarding duration and periodicity of training were tallied separately and later combined with relevant responses across categories in descriptive summary data.

Whereas the scope of the FGDs was broad and covered the entire TAPS pilot intervention in addition to training, for the present study, two study investigators reviewed the FGD transcripts independently to identify broad themes relating to the goals of evaluating the training. The readers then independently coded responses corresponding to these themes, next compared coding for discrepancies, and subsequently reconciled these discrepancies by consensus and within the context of the overall transcripts. We tallied the number of respondents making comments within each of the coding categories and selected excerpts that further contextualize quantitative data for presentation.

Results

Feasibility and acceptability

Feasibility of recruitment of teacher participants in a single-session mental health training is supported by high rates of participation, completion of training, and response to the assessment. The participation rate was 91.7% among eligible teachers nominated. Moreover, 100% of enrolled participants completed the training and responded to pre- and post-test assessment measures at all three timepoints.

In addition, mean scores of participant responses to Likert-style questions about the level of difficulty of the material support that respondents perceived the training as feasible to learn and apply in a classroom setting (Fig. 1). Responses to additional Likert-style questions regarding satisfaction with training likewise support that participants perceived the training as acceptable. Mean scores reflect somewhat to strong agreement with statements that the training was well taught, worth their time, and that they would recommend it to colleagues; all responding participants indicated strong agreement with their willingness to return for future training. Figure 1 displays specific values and their distribution.

Effectiveness of training in improving mental health knowledge and attitudes

Repeated measures ANOVA showed a significant change in both measures of knowledge and attitudes across the three test administrations (p < 0.001 and p = 0.011, respectively). Figure 2 displays additional relevant statistical values. Follow-up paired simple effects t-tests of pre- and post-test scores indicate that teacher knowledge and attitudes about mental disorders improved significantly after training, with effect sizes that can be interpreted as large or medium in magnitude, respectively (p < 0.001, Cohen's d = 1.32; and p = 0.039, Cohen's d = 0.60; Cohen, Reference Cohen1988). Knowledge increased by 18.8% of the pre-test score, positive attitudes toward mental health increased by 6.4% from the baseline attitude score, and these improvements were retained through the conclusion of the ensuing school-based TAPS intervention (Eustache et al. Reference Eustache, Becker and Ekip2014). Time 2 scores were significantly higher than pre-test scores, with large effect sizes for both (p < 0.001, Cohen's d = 1.28; and p = 0.002, Cohen's d = 1.00 for knowledge and attitudes respectively; Cohen, Reference Cohen1988). Finally, there was no significant decline in knowledge (p = 0.42, Cohen's d = 0.14) or attitudes (p = 0.64, Cohen's d = 0.12) between measures recorded at post-tests at Time 1 and Time 2.

Fig. 2. A comparison of mental health knowledge (n = 22) and attitudes (n = 15) at baseline (Time 0), immediately post-training (Time 1), and 6–9 weeks post-training (Time 2).

Perceived feasibility, acceptability, and effectiveness in post-training feedback

Teacher participant responses to narrative-style open-ended prompts strongly support that teachers perceived this training to be feasible, acceptable, and effective in improving their knowledge of mental health (see Table 1). Of particular importance to the goals of the training, each of the teachers noted its value and relevance for their professional responsibilities, including their work with individual students and in classroom management. Although not the purpose of the training, nearly one-quarter commented that the training would be also valuable outside of their professional responsibilities (n = 5, 22.7%). The strong endorsement of the perceived value of the program is perhaps most clearly evidenced in the nearly unanimous (20 of 22 participants; 90.9%) recommendation, across the open-ended responses, that mental health training be continued and/or expanded in some way.

Notwithstanding the enthusiasm for the training and affirmative feedback, teacher responses also indicate important areas for improving teacher experience and the potential impact of the training. For example, nine respondents (40.9%) indicated tiredness or fatigue across at least one of their open-ended responses. Approximately half of teacher participants (n = 10, 47.6%) indicated a preference for periodic training, whereas approximately one-quarter of participants (n = 6, 28.6%) preferred a single session format. The majority of teacher participants indicated support for increasing the duration of the teacher training, as 14 (63.6%) indicated they would prefer a longer training as compared with only five (22.7%) indicating that the current length was appropriate. Notably, none of the respondents indicated a preference for a shorter training. Importantly, approximately one-third of the respondents (n = 7) recommended financial or other support for teacher participation in the future. Finally, four participants (18.2%) noted inappropriate manners from the facilitators or fellow participants (see Table 1), indicating opportunities to improve the experience by greater attunement to local sensitivities.

FGD debrief of participant experience relevant to the mental health training

Focus group discussion data collected after the implementation phase of the study also strongly support acceptability and perceived effectiveness of the training in promoting a better understanding of mental health among teacher participants following the opportunity to apply it in the school setting during the study. We identified and coded transcripts for statements illustrating three relevant themes: (1) affirmation of acceptability (e.g. comments that training was important, needed, or relevant); (2) affirmation of effectiveness (e.g. tangible benefits perceived to be linked to training); and (3) recommendations for improving the feasibility and/or utility of future iterations of training. We did not identify any statements recommending discontinuation or diminution of the scope of training.

It is noteworthy that every FGD respondent (n = 12 of 12) made at least one statement endorsing the perceived value of the training and 9 of 12 made a comment endorsing its acceptability. Perceived benefits included appreciation for skills in improved classroom management, building rapport with students, and conceiving of a non-punitive approach to certain unacceptable behaviors that they could now understand as related to emotional disturbance. Each of the FGD participants also made recommendations relevant to improving the feasibility and/or utility of training. Suggestions included providing concomitant training for school principals and extending the content taught and extending the training to other school teachers in Haiti. They also recommended that recognition and/or financial support for future teacher participation in training would be valuable. Selected excerpts from comments illustrating both positive experience with and regard for the training as well as recommendations for improving future iterations are displayed in Table 2.

Table 2. Teacher participant experience and recommendations regarding acceptability, feasibility, and effectiveness of training

a Some excerpts encompass text beyond the coded theme to provide context; some excerpts encompass more than one theme.

Discussion

Study findings support the feasibility and acceptability of a brief, introductory single session, multi-day training on mental health for secondary school teachers in Haiti at small scale. Findings also support that training resulted in improved mental health knowledge and attitudes over the duration of the study. Specifically, high rates of participation, training completion, and response to pre- and post-test assessments support feasibility of recruiting and engaging secondary school teachers in Haiti in mental health training. Moreover, interval changes in pre- and post-training assessments demonstrate that teachers’ mental health knowledge and attitudes significantly improved after training and that these gains were retained at Time 2, following the school-based intervention when participants had an opportunity to act as teacher-accompagnateurs (Fig. 2). The effect sizes relating to the improvements from baseline (Time 0) to the final post-test (at Time 2) were large (Cohen, Reference Cohen1988). The improved performance is consistent with our expectation that the content focused on recognizing, responding to, and referring students with mental health needs as well as building resilience for mental health would comprise an appropriate scope for education professionals, while also introducing new information relevant to school mental health.

Additionally, teacher participant feedback about the training was highly positive. Quantitative proxy measures of feasibility and acceptability yielded mean scores uniformly in the favorable range. These positive ratings were complemented and corroborated by qualitative data both at the completion of training and also after an opportunity to implement it in the school-based pilot intervention (TAPS). That the vast majority of respondents recommended continuation and/or expansion of the training, and also that none recommended abridging or discontinuing the training, reflects their positive regard for its value. Next, these FGD findings provide a contextualized understanding of how teacher participants valued their training and its relevance to their work.

Successful delivery of mental health training to teachers in Haiti not only provides a potentially novel and important resource for their professional development, but also can set the stage for their promotion of youth mental health in several key ways. Beyond the rather modest aim of the training to support teachers in helping students navigate mental health services, our pilot data suggest other fruitful positive impacts of engaging teachers in mental health awareness and promotion. Our respondents gave examples of how they perceived this brief mental health training had a positive impact on their capacity to support individual students, manage the classroom, and identify school disciplinary practices that could be improved to better respond to student needs. Although other task-sharing models for mental health delivery, including those involving teachers, have largely focused on equipping non-health professionals to implement a specific psychosocial intervention or teach a mental-health based or enriched health curriculum, this study describes an additional avenue for partnering with teachers in promoting youth mental health, which is based on the locally established model of accompagnateur.

The unmet treatment needs associated with mental illness impose vast health, economic, social, and human costs globally (Becker & Kleinman, Reference Becker and Kleinman2013). Closing the treatment gap by expanding access to quality mental health services is a cardinal challenge for health systems in LMICs (Baingana et al. Reference Baingana, Al'Absi, Becker and Pringle2015). Although task sharing with community health workers is among leveraging strategies to meet workforce shortfalls in mental health care (Becker & Kleinman, Reference Becker and Kleinman2013), there are comparatively few studies addressing task sharing with teachers. In addition, few data are available to illuminate how the prospective health task-sharing workforce perceives the feasibility and acceptability of this role (Padmanathan & De Silva, Reference Padmanathan and De Silva2013). Among numerous challenges identified, lack of competencies and training and increasing workload (Padmanathan & De Silva, Reference Padmanathan and De Silva2013) are especially salient considerations for the utility and sustainability of mental health task sharing with teachers. Even though another post-earthquake initiative to provide Haitian teachers with mental health training was reportedly well-received (St. Louis, Reference St. Louis2014), school-based health interventions integrating teacher contributions arguably add to an already considerable teacher work burden (Rajaraman et al. Reference Rajaraman, Travasso, Chatterjee, Bhat, Andrew, Parab and Patel2012; Fazel et al. Reference Fazel, Patel, Thomas and Tol2014b ).

Whereas study findings support the feasibility, acceptability, and potential benefits of this approach to delivering training on mental health to a highly select group of secondary school teachers in Central Haiti, they also point to opportunities to optimize this training approach further. Notably, participant recommendations for additional logistical support (to underwrite their time for training), engagement of school leadership in supporting teachers’ application of skills in the classroom, and extension of the training beyond a single session are consistent with empirical evidence for practices that can improve effectiveness of training (Fixsen et al. Reference Fixsen, Naoom, Blase, Friednman and Wallace2005). Training programs have been shown to significantly increase teacher knowledge over baseline in previous school-based mental health interventions (Owens et al. Reference Owens, Richerson, Beilstein, Crane, Murphy and Vancouver2005; Jorm et al. Reference Jorm, Kitchener, Sawyer, Scales and Cvetkovski2010). Training is recognized as an efficient means of introducing knowledge, background, and skills requisite to implementation; however, transfer and successful implementation of new skills is optimally achieved by both training and coaching (Fixsen et al. Reference Fixsen, Naoom, Blase, Friednman and Wallace2005). In FGD interviews, teachers indicated that the opportunity to deploy some of the skills in the context of the ensuing study was useful. Although guidance was offered on demand during the subsequent TAPS intervention, the incorporation of supervision into future iterations of this training would likely enhance the competencies in the application of this knowledge to classroom settings. In addition, although school administrators’ support for the project was sought at the onset of TAPS, their additional engagement throughout teachers’ deployment of skills learned in training would likely promote the implementation of these skills (see Fixsen et al. Reference Fixsen, Naoom, Blase, Friednman and Wallace2005).

Strengths of the study include its prospective and convergent mixed methods design, including quantitative assessment of changes in knowledge and attitudes regarding mental health and qualitative assessment of perceived benefits and weaknesses of the procedures and impacts of training. There were also several limitations of this pilot study. The study sample was small and purposively selected for teachers nominated by their respective principals; thus study participants may have had greater interest in school mental health than their counterparts and generalizability of findings to other teachers and settings may be limited. That being said, study findings also point to the future potential value of extending the reach of this type of training to a broader base and on a larger scale. Because we tailored knowledge and attitude assessments to the specific needs of this formative research, our assessment of improved knowledge and attitudes was conducted with an unstandardized measure and has unknown construct and predictive validity. Use of standardized measures in future development of evaluation of this training will be useful in benchmarking knowledge improvement against other training approaches (Beidas & Kendall, Reference Beidas and Kendall2010). In addition, a large number of missing responses on our attitudes measure resulted in exclusion of seven participants from the corresponding analyses of change over time. Future evaluations should seek to elicit responses from all participants, especially since this may have introduced bias. Moreover, social desirability may play a role in our qualitative and quantitative results. However, it is worth noting that teachers reported both constructive criticism as well as positive feedback, suggesting that social desirability would not be the only factor driving their responses. Evaluation of effectiveness of the training was limited to short-term acquisition of mental health knowledge and attitudes. Although we reported teachers’ perceptions of how they applied the knowledge acquired from training, we did not evaluate behavioral measures of participants’ application of knowledge and skills covered during the training, and our findings do not illuminate the impact of this training on actual classroom practice. Indeed, acquisition of knowledge is necessary, but not sufficient, to ensure teachers would demonstrate competency as teacher-accompagnateurs (see Fixsen et al. Reference Fixsen, Naoom, Blase, Friednman and Wallace2005; Lyon et al. Reference Lyon, Stirman, Kerns and Bruns2011). Future development of mental health training should therefore incorporate supervision and coaching as trainees practice applying new knowledge and skills in this school-based setting as a formalized element of the training process.

Conclusion

The health burdens of mental illness in LMICs among children and adolescents are high and youth are especially vulnerable to social structural barriers to care. A timely investment in mental health in adolescents and transitional age youth may mitigate adverse social consequences of mental illness as youth transition from school into the workforce or higher education. Yet, engagement of educators through task sharing that can facilitate youth access to clinical services has not been adequately explored in the scientific literature. We found support for the feasibility and acceptability of a pilot brief mental health-training program for teachers in Haitian secondary schools. We also found that training was effective in improving short-term gains in relevant knowledge and attitudes, a prerequisite for its application in practice. Notably, teacher participants perceived associated benefits outside of the initial scope of the program that extended to potentially positive impacts on classroom management and interest in promoting school policies that support student well-being. Notwithstanding the limited generalizability from a select group of possibly highly motivated teachers, both quantitative and qualitative study data support that mental health training would likely be well received if developed further and extended to other secondary school teachers in Haiti. We found that teachers were enthusiastic, active, and successful participants with respect to understanding mental health and its relevance to their students and to their role as educators. We underscore our finding that teacher participation in future training could be better supported by financial resources to underwrite the associated opportunity and other costs incurred by attending a training (e.g. a per diem for participation would be appropriate in Haiti) as well as by broader engagement of school leadership.

Acknowledgements

Research reported in this publication was supported by the National Institute of Mental Health of the National Institutes of Health under award number R21MH093298 (Co-PIs, Becker and Eustache). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. We are grateful to the leadership of Zanmi Lasante as well as at the four schools who so generously accommodated the planning and implementation of the mental health training and its accompanying school-based pilot study. We thank Kate Boyd, Shin Daimyo, Georges Alexis, Elysee Noesil, Ernst Origene, Handy Petit-Homme, and other colleagues at Partners In Health as well as Claire Pernar at HMS for their support of the planning, management, and implementation of the study and trainings. We express here our profound gratitude to the teacher study participants for their time and generous feedback, and from whom we learned so much.

Contributors

All authors contributed to study design, data collection, and/or data analysis as well as to editing and finalizing the report.

Declaration of Interest

None.

Ethical Standards

The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008.

Appendix

Introduction to Mental Health: A Resource for Teachers

Table of Contents

References

Baingana, F, Al'Absi, M, Becker, AE, Pringle, B (2015). Global research challenges and opportunities for mental health and substance-use disorders. Nature 527, S172S177.Google Scholar
Becker, AE, Kleinman, A (2013). Mental health and the global agenda. The New England Journal of Medicine 369, 6673.Google Scholar
Beidas, RS, Kendall, PC (2010). Training therapists in evidence-based practice: a critical review of studies from a systems-contextual perspective. Clinical Psychology 17, 130.Google ScholarPubMed
Beidas, RS, Koerner, K, Weingardt, KR, Kendall, PC (2011). Training research: practical recommendations for maximum impact. Administration and Policy in Mental Health 38, 223237.CrossRefGoogle ScholarPubMed
Cohen, J (1988). Statistical power analysis for the behavioral sciences, 2nd edn. Lawrence Erlbaum Associates: Hillsdale, NJ.Google Scholar
Collins, PY, Patel, V, Joestl, SS, March, D, Insel, TR, Daar, AS (2011). Grand challenges in global mental health. Nature 475, 2730.Google Scholar
Eustache, E, Becker, AE, Ekip, Wozo (2014). Developing Research Capacity for Mental Health Interventions for Youth in Haiti. Poster presented at Frontiers in Neuroscience for Global Health/Tenth Anniversary of Brain Disorders in the Developing World: Research across the Lifespan, Bethesda, Maryland.Google Scholar
Farmer, P, Léandre, F, Mukherjee, JS, Claude, MS, Nevil, P, Smith-Fawzi, MC, et al. (2001). Community-based approaches to HIV treatment in resource-poor settings. Lancet 358, 404409.CrossRefGoogle ScholarPubMed
Fazel, M, Hoagwood, K, Stephan, S, Ford, T (2014 a). Mental health interventions in schools in high-income countries. Lancet Psychiatry 1, 377387.Google Scholar
Fazel, M, Patel, V, Thomas, S, Tol, W (2014 b). Mental health interventions in schools in low-income and middle-income countries. Lancet Psychiatry 1, 388398.Google Scholar
Fixsen, DL, Naoom, SF, Blase, KA, Friednman, RM, Wallace, F (2005). Implementation Research: A Synthesis of the Literature. University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network: Tampa, FL. (FMHI Publication #231) #231: 1119.Google Scholar
Gittelsohn, J, Steckler, A, Johnson, CC, Pratt, C, Griser, M, Pickrel, J, et al. (2006). Formative research in school and community-based health programs and studies: ‘State of the art’ and the TAAG approach. Health Education and Behavior 33, 2539.CrossRefGoogle ScholarPubMed
IBM Corp (2015). SPSS Statistics for Windows. IBM Corp.: Armonk, NY.Google Scholar
Jorm, AF, Kitchener, BA, Sawyer, MG, Scales, H, Cvetkovski, S (2010). Mental health first aid training for high school teachers: a cluster randomized trial. BMC Psychiatry 10, 51.CrossRefGoogle ScholarPubMed
Kakuma, R, Minas, H, van Ginneken, N, Dal Poz, MR, Desiraju, K, Morris, JE, et al. (2011). Human resources for mental health care: current situation and strategies for action. Lancet 378, 16541663.CrossRefGoogle ScholarPubMed
Kieling, C, Baker-Henningham, H, Belfer, M, Conti, G, Ertem, I, Omigbodun, O, et al. (2011). Child and adolescent mental health worldwide: evidence for action. Lancet 378, 15151525.CrossRefGoogle ScholarPubMed
Kline, P (1999). A Handbook of Psychological Testing, 2nd edn. Routledge: London.Google Scholar
Lyon, AR, Stirman, SW, Kerns, SE, Bruns, EJ (2011). Developing the mental health workforce: review and application of training approaches from multiple disciplines. Administration and Policy in Mental Health and Mental Health Services Research 38, 238253.CrossRefGoogle ScholarPubMed
Mnookin, S (2016). Out of the Shadows: Making Mental Health a Global Development Priority. World Bank Group and World Health Organization: Washington, DC. (http://documents.worldbank.org/curated/en/270131468187759113/Out-of-the-shadows-making-mental-health-a-global-development-priority).Google Scholar
Owens, JS, Richerson, L, Beilstein, E, Crane, A, Murphy, CE, Vancouver, JB (2005). School-based mental health programming for children with inattentive and disruptive behavior problems: first-year treatment outcome. Journal of Attention Disorders 9, 261274.CrossRefGoogle ScholarPubMed
Padmanathan, P, De Silva, MJ (2013). The acceptability and feasibility of task-sharing for mental healthcare in low and middle income countries: a systematic review. Social Science & Medicine 97, 8286.CrossRefGoogle ScholarPubMed
Patel, V, Weiss, HA, Chowdhary, N, Naik, S, Pednekar, S, Chatterjee, S, et al. (2011). Lay health worker led intervention for depressive and anxiety disorders in India: impact on clinical and disability outcomes over 12 months. The British Journal of Psychiatry 199, 459466.Google Scholar
Patton, GC, Coffey, C, Cappa, C, Currie, D, Riley, L, Gore, F, et al. (2012). Health of the world's adolescents: a synthesis of internationally comparable data. Lancet 379, 16651675.Google Scholar
Rajaraman, D, Travasso, S, Chatterjee, A, Bhat, B, Andrew, G, Parab, S, Patel, V (2012). The acceptability, feasibility and impact of a lay health counsellor delivered health promoting schools programme in India: a case study evaluation. BMC Health Services Research 12, 127.Google Scholar
Raviola, G, Eustache, E, Oswald, C, Belkin, GS (2012). Mental health response in Haiti in the aftermath of the 2010 earthquake: a case study for building long-term solutions. Harvard Review of Psychiatry 20, 6877.CrossRefGoogle ScholarPubMed
Raviola, G, Severe, J, Therosme, T, Oswald, C, Belkin, G, Eustache, E (2013). The 2010 Haiti earthquake response. Psychiatric Clinics of North America 36, 431–50.Google Scholar
St. Louis, G (2014). Building mental health capacity in Haiti: the teachers mental health training program. Psychiatry International. March. (http://www.apa.org/international/pi/2014/03/haiti.aspx).Google Scholar
van Ginneken, N, Tharyan, P, Lewin, S, Rao, GN, Meera, SM, Pian, J, Chandrashekar, S, Patel, V (2013). Non-specialist health worker interventions for the care of mental, neurological and substance-abuse disorders in low- and middle-income countries. Cochrane Database of Systematic Reviews 11, CD009149.Google Scholar
Vos, T, Barber, RM, Bell, B, Bertozzi-Villa, A, Biryukov, S, Bollinger, I, et al. (2015). Global, regional, and national incidence, prevalence, and years lived with disability for 301 acute and chronic diseases and injuries in 188 countries, 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet 386, 743800.CrossRefGoogle Scholar
Figure 0

Fig. 1. Post-training (Time 1) feasibility and acceptability. Response options were Likert-style and ranged from 1 (Strongly disagree) to 5 (Strongly agree).

Figure 1

Table 1. Teacher perceptions of feasibility, acceptability, and effectiveness conveyed in post-training written open-ended responses

Figure 2

Fig. 2. A comparison of mental health knowledge (n = 22) and attitudes (n = 15) at baseline (Time 0), immediately post-training (Time 1), and 6–9 weeks post-training (Time 2).

Figure 3

Table 2. Teacher participant experience and recommendations regarding acceptability, feasibility, and effectiveness of training