Environments and lifestyles have undergone visible changes in recent decades. Indeed, these changes have been implicated in the epidemic of physical inactivity and unhealthy eating habits that contribute to obesity and chronic disease risk( Reference Condon 1 – Reference Macdonald, Kontulainen and Petit 4 ). Specific dietary culprits are consumption of non-nutritious energy-dense foods and beverages, increased portion sizes, low fruit and vegetable intake, eating away from home and consuming convenience/fast food at home. Overall these factors contribute to increased energy intake( 3 ). The health consequences of these changes are substantive and beginning in childhood have been associated with decreases in quality of life( Reference Wu, Ohinmaa and Veugelers 5 ), increases in overweight/obesity( Reference Shields 6 ) and increased chronic disease risk( Reference Plotnikoff, Karunamuni and Spence 7 – Reference Harding, Maynard and Cruickshank 10 ). Thus, it seems imperative to address these modifiable dietary factors during childhood as one means to counter these disturbing public health trends.
Schools are popular settings for healthy eating (HE) interventions as children from across social strata spend considerable time in school and consume at least one meal or snack there( Reference Wechsler, Devereaux and Davis 11 , 12 ). Further, schools traditionally provide nutrition education to students( Reference Carter and Swinburn 13 ). Finally, schools represent natural ‘settings’ where interventions can be targeted across multiple levels, from the student to the global school environment( 12 , Reference de Sa and Lock 14 ).
School-based HE interventions, especially those that incorporate environmental strategies, have had modest positive impacts on knowledge and eating behaviours( Reference de Sa and Lock 14 – Reference French and Stables 18 ). Thus they are a recommended component of public health action for young people( Reference Wechsler, Devereaux and Davis 11 ). To take meaningful action we need to better understand how effective preventive health interventions can be scaled up, implemented and sustained to achieve desired outcomes( Reference Glasgow 19 – Reference Rohrbach, Grana and Sussman 24 ). Key aspects of diffusion of innovations (innovation characteristics)( Reference Owen, Glanz and Sallis 25 – Reference Oldenburg and Parcel 28 ), social cognitive (adopter/teacher)( Reference Owen, Glanz and Sallis 25 , Reference Buller 27 , Reference Oldenburg and Parcel 28 ), social marketing( Reference Hoelscher, Kelder and Murray 29 ) and organizational theory (organization/school)( Reference Owen, Glanz and Sallis 25 – Reference Reed, Warburton and Macdonald 32 ) have been key to successful implementation over the short (efficacy trials) or long term (maintenance/sustainability trials). Planning for the state-wide scale-up of the Child and Adolescent Trial for Cardiovascular Health (CATCH) in Texas( Reference Hoelscher, Kelder and Murray 29 ) identified the importance of factors such as networks, cost, training, ongoing support, targeted approaches and the importance of both supporting and examining implementation after adoption. However, we know relatively little about factors that influence implementation of school HE interventions after scale-up in real-world settings; this deficit must be overcome to enhance the effectiveness of target interventions( Reference Kumanyika 33 – Reference Lytle, Ward and Nader 37 ).
Currently being implemented in British Columbia (BC), Canada, Action Schools! BC (AS! BC) is a comprehensive school health-based model that engages elementary-school stakeholders and supports their capacity to create individualized action plans to enhance HE and physical activity (PA) opportunities for children. The model targets six key ‘zones’ for action: (i) the environment (including policies); (ii) the classroom; (iii) physical education; (iv) extra-curricular; (v) school spirit; and (vi) family and community( Reference Naylor, Macdonald and Warburton 31 ). The PA and HE components of the overall model were developed, evaluated and scaled up using a phased approach (starting with PA). The PA model was designed and evaluated during the first phase and after demonstrating efficacy( Reference Macdonald, Kontulainen and Petit 4 , Reference Naylor, Macdonald and Warburton 31 , Reference Reed, Warburton and Macdonald 32 , Reference Macdonald, Kontulainen and Khan 38 ) was scaled up in the 2004–05 school year. Then, after the feasibility and efficacy of the HE component were demonstrated (2006–07)( Reference Day, Strange and McKay 39 ), it was integrated into the AS! BC model and scaled up in the autumn of 2007 (Phase II).
Scale-up was planned and implemented by a central management team and technical support unit that shoulders an array of duties including: working with stakeholders; marketing the initiative; registering schools and teachers; preparing and supporting regional trainers (n 75) and two Master trainers; providing resources (HE ‘bin’ of equipment, materials and curriculum resources) and training for teachers and the school community; and providing direct email, telephone and web-based technical support to teachers and school administrators. An overview of the AS! BC HE intervention package, which has been described previously( Reference Day, Strange and McKay 39 ), is summarized in Table 1.
Provincial scale-up of AS! BC HE presented us with the unique opportunity to assess implementation and the factors that influenced it after scale-up. Specifically, our study set out to: (i) identify the contextual factors that influenced implementation; (ii) describe implementation and its relationship with the provision of HE lessons in the classroom; and (iii) assess how the characteristics of the innovation, schools and teachers were hierarchically associated with implementation after scale-up.
Experimental methods
Procedures
The study was conducted according to the guidelines laid down in the Declaration of Helsinki and all procedures involving human subjects/patients were approved by both the Clinical Research Ethics Board at the University of British Columbia and the Human Research Ethics Board at the University of Victoria. Recruitment was conducted in the 2007–08 school year. We adopted the same recruitment protocols and data collection procedures that were used in the AS! BC PA implementation study( Reference Mâsse, McKay and Valente 40 ). Briefly, principals received a letter/email inviting them to participate. Volunteer schools supported recruitment by identifying a person who would act as the contact and study coordinator. These coordinators then distributed teacher invitations and collected the contact information of any volunteers. On data collection day the coordinator received and distributed a sealed package with a unique code and a web address link to an online questionnaire (Class Climate V5·1; Scantron Corporation) to each participant. We also funded a substitute teacher so that participants had time to complete the survey and provided honorariums. Focus groups were conducted during the school lunch period and lunch was provided.
Research design and theoretical framework
We used mixed methods to explore implementation after scale-up. We used a qualitative approach( Reference Ryan, Coughlan and Cronin 41 ) to explore contextual factors and as previously described by Mâsse et al., we used concepts from Rogers’ Diffusion of Innovations, Social Cognitive and Organizational Change theories( Reference Rimer, Glanz and Rasband 42 – Reference Steckler, Goodman and Kegler 45 ) to guide the quantitative examination of implementation and the hierarchy of theoretically derived influences on it( Reference Mâsse, McKay and Valente 40 ). We analysed data from the qualitative and quantitative methods independently and integrated data during the interpretation stage( Reference Hanson, Creswell and Clark 46 ).
Sample
We obtained school district approval from thirty-five out of fifty-nine BC school districts (59 % response rate; excluding three school districts that piloted the survey). For the qualitative evaluation of contextual factors that influenced implementation, we purposively selected seven schools that were implementing AS! BC HE in the first year of scale-up and represented a broad range of school types and geographic locations. Sixty-two staff across seven schools participated in focus groups. For the quantitative evaluation of implementation that examined the hierarchy of factors influencing implementation, we conducted a cross-sectional multistage survey of school principals and teachers of grades 4 to 7 in BC (2008–09 school year). All schools that received training to deliver AS! BC HE, during the 2007–08 school year, were eligible to participate. Exclusion criteria included pilot, Independent, Francophone and First Nations schools. Of the eighty-eight eligible schools, thirty-nine agreed to participate (44 % response rate). Within participating schools, 36/39 principals (92 % response rate) and 168/238 grade 4 to 7 teachers (70 % response rate) completed the survey.
Instruments
Implementation context
We explored implementation qualitatively using semi-structured focus group interview questions that addressed different aspects of the AS! BC HE model: (i) its influence within the school and community; (ii) the response of teachers and administrators in the school; (iii) implementation challenges; and (iv) facilitators and changes necessary to sustainability.
Implementation
We assessed ‘current use of the AS! BC HE model’ using a seven-item measure modelled after the Steckler et al. current use questions (‘yes’/‘no’)( Reference Steckler, Goodman and McLeroy 47 ). For the quantitative analyses, items were dichotomized to determine whether teachers were current users or not of the model. Non-users represented those who said they never used the model, were contemplating or preparing to use the model, or reported they had used the model in the previous school year but were not current users. In contrast, users represented those who indicated using the model in the current school year no matter what frequency and duration of use. Validity of this dichotomous index was assessed by correlating it with a measure that assessed whether the teachers were using specific AS! BC HE materials and resources (Pearson correlation =0·50).
We assessed implementation as ‘classroom delivery of HE lessons/activities’, by asking (i) how many times in the past week teachers had incorporated HE lessons or activities into their class routine (0–7) and (ii) whether they had used or displayed (in the past or recently) instructional resources and materials, tracked consumption, prepared and/or tasted fruit and vegetables or went on a field trip (yes/no). In each of these categories AS! BC HE users were asked about specific AS! BC promoted resources while non-users answered generic questions.
Implementation factors; characteristics of schools, teachers and innovation
We assessed ‘organizational climate’ with one item that asked principals whether HE was a priority for their school (5-point response ranging from ‘strongly disagree’ to ’strongly agree’).
We assessed ‘organizational capacity’ with four items that asked school principals whether: (i) teachers had enough time to implement AS! BC; (ii) their schools had resources for the implementation of AS! BC; (iii) their schools had funds to support the implementation of AS! BC; and (iv) they themselved were committed to provide the resources to the implementation of AS! BC (5-point response ranging from ‘strongly disagree’ to ‘strongly agree’). Results from the factor analysis demonstrated that this scale measured one main dimension explaining 57·3 % of the total variance with a Cronbach’s α of 0·80.
We assessed ‘level of institutionalization’ with nine items that were modelled after Goodman et al.’s( Reference Goodman, McLeroy and Steckler 48 ) measure. The scale assessed whether the school had implemented guidelines and practices to ensure the uptake and implementation of AS! BC (i.e. made AS! BC part of school culture, established guidelines/policies, adapted the concepts to fit the schools and allocated resources to ensure uptake; ‘yes’/‘no’ or ‘yes, established clearly’, ‘yes, somewhat established’ and ‘no’). A weighted average was computed to account for the differences in response format. Results from the factor analysis demonstrated that this scale measured one main dimension explaining 35·7 % of the total variance with a Cronbach’s α of 0·83.
We assessed ‘environmental influences’ by measuring whether the school was in compliance with recent nutritional guidelines mandated by the Province level (equivalent of State level). Specifically, this item assessed the extent to which the schools had eliminated access to and availability of less healthful foods and beverages at school (vending machines, cafeteria and/or school store), for fundraising activities, at special school events or in the classroom (‘yes, fully implemented’, ‘in the process of implementing’ and ‘no’). This index was dichotomized into yes/no for the analysis.
We assessed teacher ‘self-efficacy’ with seven items that were modelled after the Brenowitz and Tuttle scale( Reference Brenowitz and Tuttle 49 ). The scale measured whether teachers: (i) understood the concepts of AS! BC; and (ii) had confidence in their skills, their ability to devote time and their ability to motivate and engage students in HE activities (5-point response ranging from ‘strongly agree’ to ‘strongly disagree’). Results from the factor analysis demonstrated that this scale measured one main dimension explaining 51·2 % of the total variance with a Cronbach’s α of 0·88.
We assessed ‘behavioural capacity’ of the teacher with two items. One item measured if the teacher received AS! BC training for HE (‘yes’/’no’). One item measured whether the teachers were users of the AS! BC PA component.
We asssessed ‘innovation attributes’ using an eleven-item scale modelled after Rogers’ adoption questions( Reference Steckler, Goodman and McLeroy 47 ) using a 5-point response format ranging from ‘strongly agree’ to ‘strongly disagree’. We assessed whether teachers’ perceived AS! BC HE to be: (i) advantageous compared with other initiatives; (ii) complex to use; (iii) compatable with their teaching philosophy; (iv) easy to try in their classroom; and (v) if it created positive outcomes. Results from the factor analysis demonstrated that this scale measured one main dimension explaining 47·8 % of the total variance with a Cronbach’s α of 0·91.
Covariates
We assessed the following variables as covariates: gender and teaching experience of teachers, urbanicity, size of school and percentage of the population around the school with post-secondary education. We obtained school-level covariates by linking the school postal code with information from the Ministry of Education and the 2006 Canadian Census.
Statistical analyses
Qualitative data
Upon completion of each focus group, we transcribed each audio recording verbatim and imported them into the software NVivo 2·0 for analysis. This allowed us to create a framework for organizing and theming data. Data were initially grouped into NVivo nodes based on the focus group questions. We conducted basic content analysis to examine the data for meaning. Text was grouped into preliminary categories, re-examined for recurring themes and relationships, and reduced into key themes and sub-themes( Reference Corbin and Strauss 50 ).
Quantitative data
We used the statistical software package Stata version 13·1 to generate descriptive characteristics of participants. We developed a mixed-effects logistic regression analysis to determine if implementation of HE activities was significantly associated with current use of AS! BC HE (described in the ‘Instruments’ section as a dichotomous indicator which assessed whether teachers were current users or not). We developed a multilevel mixed-effect logistic regression model to identify factors that influenced AS! BC HE implementation. To account for the nested structure of the data we developed a two-level effect model with schools and school districts entered as separate levels while attributes of the innovation, characteristics of the teachers (self-efficacy, training received and users of AS! BC) and characteristics of the schools (organizational climate, organizational capacity, level of institutionalization and environmental influences), teachers’ covariates (gender and teaching experience) and school covariates (school size, percentage of the population with post secondary education and urbanicity) were entered as fixed effects. Our results report reqression coefficients, 95 % confidence intervals and odds ratios which are estimated by exponentiating the estimated coefficient. We first examined univariate associations and then proceeded with a multivariable analysis where all variables were entered at once regardless of whether they were univariately significant. We opted to include all variables given the conceptual framework we tested( Reference Mâsse, McKay and Valente 40 ). We applied multiple imputation to accommodate for missing values among the independent variables, using twenty replicates and the iterative Markov chain Monte Carlo (MCMC) procedure.
Results
Qualitative exploration of contextual factors that influenced implementation
Focus group participants reported successfully implementing AS! BC HE in the first year after dissemination. At the school level four themes emerged regarding the benefits of implementing AS! BC HE: (i) enhanced community partnerships; (ii) links to more HE resources; (iii) creation of a HE culture in the school; and (iv) links to environmental initiatives within the school. At the student level teachers and administrators highlighted the positive impact on children’s attitudes and behaviours. In the words of one teacher: ‘It is getting children back to eating healthy foods, and if they see their teacher and their classmates doing it, sometimes, they’ll be more open to try new things’.
Participants identified (i) having a school ‘leader/champion’, (ii) support from the AS! BC central team and (iii) access to resources and funding as the top three implementation facilitators. Participants from some schools also indicated that community and school engagement supported their ability to successfully implement activities.
Conversely, implementation was not without challenges. Teachers and administrators cited ‘lack of time’ as the most common barrier. For instance, one teacher stated: ‘To find the time... that was the biggest obstacle’. Other challenges noted were lack of resources, leadership and momentum. Related to resource limitation one teacher’s quote highlighted how the cost of the Action Bin was problematic: ‘I think the cost of the kits, we get one per grade level (free)... so if you have three classrooms at a grade level and we only have one kit and you have to buy one and they are 200 each, I think that is a challenge, somehow the cost has to be more reasonable’.
Lack of leadership caused by high staff turnover was another common theme. If staff champions or leaders of implementation moved away from the school there was often no one to spearhead the programme, ‘...there was no one to fill his position and I didn’t know anything about it’. Finally, while the school staff found the programme exciting at first, it was difficult to sustain positive momentum going throughout the school year; as expressed by one participant: ‘it was great to implement, people were excited, but then as you go in the year, it gets forgotten because there are other things’.
When asked about sustainability participants highlighted the need to educate and connect the parents: ‘I really believe that we need to continue to focus on educating the parents because that is where the lunches are coming from’. Official integration of the AS! BC HE activities within the curriculum rather than implementation as an ‘…extra’ was another theme. Similarly a participant suggested expansion of the AS! BC HE activities and highlighted the importance of keeping the HE model relevant, fresh and responsive to teachers’ needs: ‘I think the program is phenomenal in its infancy, but what I would like to see is more education… I would not like to do the same program year after year. I would like it stepped up to the next level. Like how to read food labels…’.
Quantitative analysis of implementation
Sample characteristics
We describe participating schools, principals and teachers in Table 2. Schools had an enrolment of 294 students on average and were mostly from census metropolitan areas where 32 % of the population had post-secondary education. Most principals and teachers were female (76 % and 71 %, respectively) and Caucasian (91 % and 85 %, respectively); administrative or teaching experience varied widely.
Implementation
On average 42 % of teachers were using AS! BC HE in their classroom with 39 % providing classroom HE activities weekly and 28 % providing these activities on a monthly basis. Among those who were using the model, 96 % of teachers used the Classroom Action HE books and manuals, 83 % used promotional resources, 75 % utilized instructional resources and 53 % kept weekly logs. AS! BC provided equipment to schools to facilitate HE activities; >50 % of teachers used measuring cups (54 %) and cutting boards (51 %) while others used colanders (47 %) and peelers (40 %). Interestingly, some teachers who did not formally adopt the AS! BC HE model used AS! BC instructional and promotion resources (43 %), equipment (10 %) and activities (11 %). Teachers who adopted the model were more likely to report having used HE related resources, activities and equipment (Table 3). Teachers’ classroom tracking of HE activities was not significantly associated with use of AS! BC; 39 % of those who adopted the model, compared with 36 % of those who did not, reported tracking their classroom activities.
* Due to the small number of responses (n 4) we have not displayed the data.
Use of AS! BC HE was strongly associated with the number of times teachers reported providing HE lessons or activities in the classroom in the last week (P < 0·001). Teachers who implemented the HE model were 6·25 (OR) times more likely to provide a HE lesson or activity compared with those who did not use the model. Forty-five per cent of those who adopted the HE model provided at least one HE activity per week compared with 16 % of those who did not adopt the model.
Implementation factors
Organizational climate was conducive to implementation of the innovation. Among principals surveyed, 81 % strongly agreed or agreed that HE was a top priority at their school; 86 % reported that priority of HE had increased compared with three years previous. Approximately 51 % of principals attributed this to both adopting and implementing AS! BC HE and the Provincial Guidelines for Food and Beverage Sales in the Schools. Almost 75 % of principals reported that activities addressing the school environment (policy and physical environment changes) increased; 58 % reported that family and community and 50 % that school-wide activities also increased.
Among teachers, a significantly higher percentage of those who adopted AS! BC HE (27 %) noted that the overall initiative (AS! BC PA and HE) was a top priority in their school compared with only 12 % of those who did not adopt the model (χ 2(2)=13·34, P=0·001). When asked whether HE was a priority at their schools, 89 % and 85 %, respectively, believed that this priority had increased over the last three years. More than 50 % of teachers at AS! BC HE registered schools received training to deliver the model; 73 % of them had previously adopted AS! BC PA. Teachers demonstrated moderately high self-efficacy (3·5/5) and relatively high positive perceptions of the attributes of the innovation (Table 4).
AS! BC PA, Action Schools! BC Physical Activity.
Univariable analyses are shown in Table 5. Two covariates were positively associated with use and appear to relate to each other. Larger schools were less likely to be users and schools in the least urbanized areas were more likely to be users than all other census conglomerations combined. Interestingly, use was more likely if school principals felt strongly that the climate of their school was not supportive of HE or conversely less likely if principals strongly agreed or agreed that their climate for HE was positive. Teachers who had high self-efficacy were more likely to be users as were those who used AS! BC PA, received HE training and had more positive perceptions regarding the attributes of the innovation.
AS! BC PA, Action Schools! BC Physical Activity.
* Referent group.
† Incremental change of 10 %.
‡ Comparing 25th and 75th percentile scores.
The multivariable analysis displayed in Table 6 showed that the covariate (larger school size) identified in the univariable analysis did not remain significantly associated with implementation but that schools in neighbourhoods characterized by higher levels of post-secondary education were less likely to be users. Similarly only the multivariate analysis showed use was lower in schools where the principals strongly agreed or agreed that that the climate was supportive of HE. Higher teacher self-efficacy, having AS! BC HE training and using AS! BC PA were significant factors in the univariable analysis and remained so in the multivariate model, while positive perceptions of the innovation were no longer significant.
AS! BC PA, Action Schools! BC Physical Activity.
* Referent group.
† Incremental change of 10 %.
‡ Comparing 25th and 75th percentile scores.
Discussion
We were provided the unique opportunity to assess factors that influenced implementation following a provincial scale-up (equivalent of state level) of an evidence-based, comprehensive, whole-school HE model (AS! BC HE). The public health importance of evaluating the factors that influence successful implementation of effective prevention and health promotion programmes for children and youth has been very elegantly addressed in a systematic review by Durlak and DuPre( Reference Durlak and DuPre 21 ), who examined 542 interventions that focused across a wide range of topics (including physical health and academic performance). In that review, higher levels of implementation led to outcomes with mean effect sizes two to three times higher compared with studies where implementation was poor. Importantly, they found that perfect or near-perfect implementation of any intervention was unrealistic. Positive results were achieved at about 60 % of desired implementation levels, with very few studies achieving more than 80 %( Reference Durlak and DuPre 21 ). In our study implementation was also not perfect. In the first year after scale-up just under half of teachers in registered schools identified themselves as users of the model. However, more than 60 % of those were using the model (materials and activities) weekly or monthly. Importantly, teachers who implemented the AS! BC model were more likely to deliver HE lessons or activities in the classroom and this is an important determinant of student-level outcomes( Reference Durlak and DuPre 21 ).
Barriers to implementation included lack of time (the most common barrier), lack of leadership (loss due to staff turnover) and loss of momentum. Facilitators were support from a technical unit (including training) and access to resources (materials and funding: all resources were provided free for the school through provincial funding). These operational factors have been identified consistently in the school health literature( Reference Naylor, Macdonald and Warburton 31 , Reference Wiecha, El Ayadi and Fuemmeler 34 , Reference Gittelsohn, Merkle and Story 35 , Reference Dollahite, Hosig and Adeletti White 51 – Reference Singh, Chinapaw and Brug 56 ). Durlak and DuPre characterized leadership, access to resources (funding), time and loss of momentum due to competing demands in their broader implementation framework as delivery system factors( Reference Durlak and DuPre 21 ).
Training is recognized as a key issue identified in the efficacy, effectiveness, institutionalization/maintenance and dissemination literature( Reference Hoelscher, Kelder and Murray 29 , Reference Wiecha, El Ayadi and Fuemmeler 34 , Reference Lytle, Ward and Nader 37 , Reference Kelder, Mitchell and McKenzie 52 , Reference Osganian, Parcel and Stone 53 , Reference Hoelscher, Feldman and Johnson 57 ). This issue was not identified in our qualitative data most likely because a mechanism was in place for schools to access ongoing AS! BC training and we were talking to school staff who had received the training. However, participants suggested further training as a way to maintain momentum.
Our approach was embedded in diffusion of innovations, social cognitive and organizational change theories and assessed factors associated with these theories. Interestingly, training emerged as a significant teacher-level factor in our quantitative analyses. Two other teacher-level characteristics that influenced implementation, experience implementing a similar model (AS! BC PA) and self-efficacy, also theoretically relate to training. Our findings uphold the tenets of social cognitive theory and speak to the importance of investing in teachers as key delivery agents for health promotion in elementary schools. If a teacher was trained to deliver HE activities, had previous experience and training to deliver a similar health promotion activity (AS! BC PA) and/or believed s/he was able to do so, s/he was more likely to implement the innovation. These findings also reflect the importance of the training and support system that has been identified as a critical implementation factor in a broader review of implementation conducted by Durlak and DuPre( Reference Durlak and DuPre 21 ).
At the school level, school climate was the only significant factor but it emerged as a weak negative influence on implementation. This finding challenged our belief that a positive school climate for HE would positively influence adoption and implementation after scale-up. While counterintuitive at first, it may be that in schools where principals noted that HE was not a priority (which is how we operationalized school climate), they were more likely to adopt AS! BC HE as it would help them to address this need at their school. Furthermore, this finding would align with Riis et al. who noted that recent changes in school policies were more likely to occur in states were levels of obesity were higher( Reference Riis, Grason and Strobino 58 ). This seems to align with our finding as HE was noted to be of high importance and this recognition probably encouraged schools where HE had not been a top priority to take action.
Based on the importance of the basic tenets of Diffusion of Innovations theory in the related literature, we anticipated that attributes of the innovation would also emerge as important. In fact, the univariable analysis supported this assumption while the multivariable did not. It may be that perceptions of the innovation were most influential at the early stage of adoption/registration. As teachers were confronted with implementation issues they may have become more influenced by factors such as training, experience and individual efficacy. Our cross-sectional study was not able to discern the specific answer to this question. However, longer-term prospective studies would shed more light on key factors related to implementation over time.
The broader school or community context influenced implementation. Teachers were more likely to implement the model if schools were in communities where residents had lower levels of education. Teachers in these communities may have perceived a greater need to deliver health-related programmes.
Although we did not initially set out to test an overarching implementation framework, our results highlight critical elements that have been identified in many( Reference Durlak and DuPre 21 , Reference Damschroder, Aron and Keith 59 ). Specifically, they highlighted the importance of community, delivery system (school level) and support system factors to implementation. Future research should integrate these frameworks in addition to existing theory to enhance our comprehensive understanding of implementation after scale-up.
Our findings must be interpreted in light of some limitations. First, we assessed implementation of HE lessons and activities broadly and of the AS! BC lessons/activities specifically, using self-report measures. To mitigate the limitations of our self-report instruments, we pilot tested and evaluated their psychometric properties in the larger sample. Second, as data are cross-sectional we are unable to differentiate factors that may influence implementation over time. Third, the sample size was limited given that we focused on schools that registered in AS! BC HE during the first year of scale-up and finally the school-level response rate was low, introducing the potential of a positive bias. However, when we compared the characteristics of the schools that participated in the study with the larger population of schools in the province, school size, percentage of the population with post-secondary education and geographic locations of schools were similar.
Finally, we would be remiss not to comment on the sociopolitical context for action as it is recognized as one community-level factor that influences implementation( Reference Durlak and DuPre 21 ). We introduced AS! BC into schools in BC during a time when the sociopolitical context was highly supportive. In 2006, BC won the bid to host the 2010 Winter Olympic Games. Government invested substantively in initiatives such as the scale-up of AS! BC to create the ‘healthiest jurisdication to ever host the Olympic Games’( Reference Naylor, Macdonald and Reed 30 ) and leave a legacy of health in the Province. In addition to supporting AS! BC, the BC Ministry of Education mandated guidelines for the sale of food and beverages in the school in 2008–09. Further, there was public support for action to encourage HE based on substantive media coverage related to the ‘childhood obesity epidemic’( Reference Naylor, Macdonald and Reed 30 ). Taken together these represent a powerful confluence of factors that would potentially impact school climate and enhance schools’ readiness to make changes in their HE environment.
Conclusion
Our study extends the relatively meagre body of literature that has addressed implementation after scale-up of school-based health promotion programmes. Our findings reinforce that teacher training and support are important investments as they contribute to successful programme implementation. Further, resources must be provided, and school-level leadership nurtured, as they are also critical to sustained implementation after scale-up. Thus, public health and education decision makers should enact communication strategies that enhance the relevance of health promotion efforts to education stakeholders and support training and technical support for teachers and schools to ensure effective scale-up of health-related programmes. Finally, adopting an evidence-based approach to guide scale-up of effective school-based HE and PA interventions enhances the likelihood of a positive return on the investment in the health and well-being of our children.
Acknowledgements
Acknowledgements: The authors would like to thank Bryna Kopelow and Jennifer Fenton, the Action Schools! BC Support Team for their passion, commitment and leadership in all aspects of development, delivery and scaling up of the AS! BC model; and for survey development and to identify the sampling frame for this study. Finally, the authors owe a huge debt of gratitude to school administrators and teachers who contributed their valuable time to support this study. Financial support: This work was funded by the BC Ministry of Health and supported partially through the Canadian Institutes of Health Research (funding reference number GIR-86122) with joint funding from the Institute of Nutrition, Metabolism & Diabetes and the Institute of Population & Public Health. L.C.M. received salary support from the Michael Smith Foundation for Health Research (Senior Scholar), the Child and Family Research Institute and the Sunny Hill Foundation. The funders (BC Ministry of Health; Canadian Institutes of Health Research; Institute of Nutrition, Metabolism & Diabetes; Institute of Population & Public Health; Michael Smith Foundation for Health Research; Child and Family Research Institute; Sunny Hill Foundation) had no role in the design, analysis or writing of this article. Conflict of interest: None. Authorship: P.-J.N. and L.C.M. contributed equally. P.-J.N. was lead author. P.-J.N., L.C.M. and H.A.M. conceived and obtained funding to support the study. L.C.M., H.A.M. and M.V. edited the manuscript. M.V. and L.C.M. were primarily responsible for implementation of data collection. L.C.M. conducted the main analyses, prepared the tables and figures for the manuscript with support from M.V. All authors read and approved the manuscript. Ethics of human subject participation: This study was conducted according to the guidelines laid down in the Declaration of Helsinki and all procedures involving human subjects/patients were approved by both the Clinical Research Ethics Board at the University of British Columbia and the Human Research Ethics Board at the University of Victoria.