Hostname: page-component-586b7cd67f-dlnhk Total loading time: 0 Render date: 2024-11-23T19:29:51.943Z Has data issue: true hasContentIssue false

Scaling up healthy eating in early childhood education and care: evaluation of the Appetite to Play capacity-building intervention

Published online by Cambridge University Press:  16 September 2024

E Jean Buckler
Affiliation:
School of Exercise Science, Physical and Health Education, Faculty of Education, University of Victoria, Victoria, BC V8W 2Y2, Canada
Kasra Hassani
Affiliation:
Child Health BC, Provincial Health Services Authority, Vancouver, BC V6J 4YC, Canada
Jennifer McConnell-Nzunga
Affiliation:
School of Exercise Science, Physical and Health Education, Faculty of Education, University of Victoria, Victoria, BC V8W 2Y2, Canada Child Health BC, Provincial Health Services Authority, Vancouver, BC V6J 4YC, Canada
Sana Fakih
Affiliation:
Child Health BC, Provincial Health Services Authority, Vancouver, BC V6J 4YC, Canada
Jennifer Scarr
Affiliation:
Child Health BC, Provincial Health Services Authority, Vancouver, BC V6J 4YC, Canada
Louise C Mâsse
Affiliation:
School of Population and Public Health, Faculty of Medicine, University of British Columbia, Vancouver, BC V6T 1Z3, Canada British Columbia Children’s Hospital Research Institute, 4480 Oak St., Vancouver, BC V6H 3N1, Canada
Patti-Jean Naylor*
Affiliation:
School of Exercise Science, Physical and Health Education, Faculty of Education, University of Victoria, Victoria, BC V8W 2Y2, Canada
*
*Corresponding author: Email [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Objective:

The purpose of this study was to examine the dissemination of the healthy eating component of Appetite to Play at scale using the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework.

Design:

The Appetite to Play capacity-building intervention is a set of evidence-informed implementation strategies aimed at enhancing the adoption of recommended practices for promoting healthy eating and active play in early years settings. The evaluation was pragmatic, employing both quantitative (surveys) and qualitative (interviews) data collection.

Setting:

The Appetite to Play intervention was delivered through in-person community-based workshops, virtual workshops, asynchronous e-learning and online resources.

Participants:

We received completed surveys from 1670 in-person workshop participants (96 % female), and twenty-three (all female) survey respondents also participated in a telephone interview. Approximately two-thirds of all participant groups were certified early childhood educators.

Results:

Results indicated that Appetite to Play had high reach (25 867 individual website visits, 195 workshops delivered), effectiveness (significant increases in care provider’s knowledge, confidence (P < 0·05) and high post-intervention intention to implement), adoption (11 % of educators in BC trained) and implementation (good alignment with implementation strategies and current practices), with a significant maintenance plan to support the intervention’s future success.

Conclusions:

An evidence-based capacity-building intervention with an emphasis on training and provision of practical online resources can improve early years providers’ knowledge, confidence and intention to implement recommended practices that promote healthy eating. Further research is needed to determine the impact on child-level outcomes and how parents can be supported in contributing to positive food environments.

Type
Research Paper
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2024. Published by Cambridge University Press on behalf of The Nutrition Society

Early childhood, particularly the preschool years (3–5 years), is an important time for the development of healthy eating behaviours. Healthy eating behaviours play a key role in health throughout the lifespan, with a healthy diet associated with reduced risks of all-cause mortality(Reference Cooke1,Reference Ford, Bergmann and Boeing2) . Food preferences in young children are greatly influenced by familiarity with foods, indicating that the food environment plays a key role in eating behaviours(Reference Cooke1). With an increasing number of Canadian children attending early childhood education and care (ECEC) settings, the ECEC environment is receiving recognition as an important influence on childhood eating behaviours. There is evidence to suggest that ECEC, along with the home environment, influences the eating behaviours of young children(Reference Tysoe and Wilson3) and unfortunately that foods served in ECEC are of insufficient nutritional quality(Reference Erinosho, Ball and Hanson4).

Strategies to improve the food environment in ECEC have had some positive results(Reference Matwiejczyk, Mehta and Scott5,Reference Mikkelsen, Husby and Skov6) . For example, small, but significant increases in fruits and vegetables consumed were documented in Healthy Start-Départ Santé, a recent Canadian intervention in childcare centres(Reference Leis, Ward and Vatanparast7). Results from a systematic and an umbrella review indicate that multi-level, capacity-building interventions are more likely to be successful at improving food environments and behaviours(Reference Matwiejczyk, Mehta and Scott5,Reference Mikkelsen, Husby and Skov6) . This is also supported by evidence from the implementation science literature(Reference Leeman, Birken and Powell8) One example of a capacity-building strategy is training and Matwiejczyk and colleagues’ umbrella review highlighted that several systematic reviews they analysed called for the training of early years practitioners(Reference Matwiejczyk, Mehta and Scott5).

In the health promotion field, capacity building is a practice where skills, knowledge, structure and systems are developed at multiple levels to support change in practices and at the individual and organisational level(Reference Smith, Tang and Nutbeam9). Capacity building has been referred to by implementation scientists as an implementation strategy category, including implementation strategies such as the provision of training, technical assistance and tools or resources to support implementation by delivery system providers(Reference Leeman, Birken and Powell8). Capacity-building interventions are typically delivered by support system providers (e.g. public health nutritionists or technical support units) that serve delivery system providers (e.g. early years childcare providers or school teachers)(Reference Crisp, Swerissen and Duckett10). Capacity-building outcomes are typically at the delivery system level and include self-efficacy and motivation to implement as well as measures of implementation(Reference Leeman, Birken and Powell8). However, health interventions typically take place on a small scale, with minimal plans for scale-up or population-level implementation(Reference Ogilvie, Adams and Bauman11). In implementation science, capacity-building strategies like training and the provision of tools and resources that are used for the scale-up of specific evidence-based interventions are also defined as scale-up strategies(Reference Leeman, Birken and Powell8).

In British Columbia, Canada, a capacity-building intervention (Appetite to Play) was developed to build the knowledge, confidence and intentions of early years care providers to incorporate recommended practices for promoting healthy eating behaviours, as well as physical activity and physical literacy in childcare settings. Appetite to Play can best be described as a bundle of implementation strategies to support adoption and implementation of those evidence-based recommended practices(Reference Crisp, Swerissen and Duckett10,Reference Fixsen, Blase and Naoom12Reference Mogharreban and Nahikian-Nelms18) . Appetite to Play was developed for scale-up at the population level using empirical evidence from other jurisdictions and partner input, including researchers and practitioners. This is in contrast to traditionally researcher-driven pathways where formative and pilot testing work is followed by efficacy testing and then larger randomised controlled trials in real world conditions to test effectiveness or effectiveness at scale(Reference Ogilvie, Adams and Bauman11,Reference Indig, Lee and Grunseit19) . The capacity-building intervention was developed in response to updates to government-level policies released in 2016 and enforced in 2017, to support ECEC professionals in implementing new active play policies and enhancing their implementation of previously established healthy eating policies. Thus, we developed the evaluation strategies to document the effectiveness of this real-world trial. Appetite to Play can be categorised as a practice-based evidence pathway, which Ogilvie and colleagues indicate should be integrated into research evidence(Reference Ogilvie, Adams and Bauman11). Indig and colleagues would categorise Appetite to Play as a Type IV scale-up as the intervention was disseminated at scale without further pilot and efficacy trials(Reference Indig, Lee and Grunseit19). Results of the capacity-building intervention physical activity and physical literacy components were previously reported on(Reference Hassani, Buckler and McConnell-Nzunga20).

Methods

Appetite to Play was developed in line with evidence-based recommendations and strategies from the early years and implementation science and public health capacity-building literature(Reference Crisp, Swerissen and Duckett10,Reference Fixsen, Blase and Naoom12Reference Mogharreban and Nahikian-Nelms18) . Content was delivered via in person or online training workshops, a website based toolkit of resources, technical support, a community of practice and marketing and communication tools; details of these intervention components were outlined in a previous publication(Reference Hassani, Buckler and McConnell-Nzunga20). These capacity-building activities were aligned with relevant literature(Reference Olstad, Prowse and Raine15,Reference Leeman, Calancie and Hartman16) including Wandersman and colleagues’ Getting to Outcomes Framework(Reference Wandersman, Chien and Katz13), Powell and colleagues Expert Recommendations for Implementing Change(Reference Powell, Waltz and Chinman21) and Protcor and colleagues Specifying and Reporting of Implementation Strategies(Reference Proctor, Powell and McMillen22). Table 1 provides detail on the specification of the implementation strategies comprising the Appetite to Play bundle aligned with Expert Recommendations for Reporting Change(Reference Powell, Waltz and Chinman21) and Specifications and Reporting of Implementation Strategies, and the content of the training and resources is described following.

Table 1 Healthy eating capacity-building implementation strategy components of Appetite to Play aligned with expert recommendations for implementing change (ERIC)(Reference Vidgen and Gallegos17) and specifying and reporting of implementation strategies(Reference Proctor, Powell and McMillen22)

Table partially adapted and reproduced with permission from: Hassani K, Buckler EJ, McConnell-Nzunga J, Fakih S, Scarr J, Mâsse LC, Naylor PJ. Implementing Appetite to Play at scale in British Columbia: Evaluation of a Capacity-Building Intervention to Promote Physical Activity in the Early Years. International Journal of Environmental Research and Public Health. 2020 Jan;17(4):1132(Reference Crisp, Swerissen and Duckett10).

* Description enhanced to adhere to guidelines for specifying and reporting of implementation strategies. (Proctor, E.K., et al. (2013).

In person and virtual (synchronous) online training workshops that took place in 2017–2019 provided both healthy eating and physical activity content, with approximately half of the time focusing on each content area. Asynchronous e-learning modules focusing only on healthy eating were delivered and the website, which served as a toolkit of online and printable resources had healthy eating focused sections (recipes, menu planning, activities and recommended practices). Training was a core implementation strategy and the content of it and the toolkit focused on supporting nine recommended practices for food and feeding in ECEC: (1) offer a variety of foods from Canada’s Food Guide for meals and snacks; (2) make water available throughout the day; (3) support infant feeding; (4) support children to become good eaters; (5) offer safe food and beverages; (6) create a physical space that supports healthy eating; (7) educate staff to model and promote positive habits; (8) communicate regularly with families and share information about food and healthy eating and (9) develop policies for food and feeding(23). These recommended practices were developed based on empirical evidence and through consultation with an advisory group(Reference Satter, Barnard and Morisset14,Reference Vidgen and Gallegos17,Reference Mogharreban and Nahikian-Nelms18,24,25) . All three training modalities delivered similar content, with identical content delivered via the in person and virtual workshops, and a more focused discussion of healthy eating and food literacy in the e-learning modules.

As previously outlined in our physical activity paper(Reference Hassani, Buckler and McConnell-Nzunga20), Appetite to Play, the capacity-building intervention, was developed for dissemination at scale in consultation and engagement with early years partners throughout the dissemination region. Through this process, the capacity-building intervention was built to meet the needs of early years providers and partner expertise and experience informed the dissemination plan. Child Health BC led the development and dissemination, and acted as Appetite to Play Central Support, implemented in partnership with three other non-profit organisations: the YMCA of Greater Vancouver, Childhood Obesity Foundation and Sport for Life, as well as researchers at the University of Victoria and University of British Columbia. Over time, the British Columbia Recreation and Parks Association became another key delivery partner. An advisory group of fourteen individuals, with membership from relevant provincial and municipal government employees, community nutritionists, physical activity, sport and ECEC professionals, was set up by Child Health BC. The advisory group met approximately 2 times/year over 4 years to advise on the development of both the resource, dissemination strategy, implementation (course correction) and sustainability framework.

Details of the dissemination at scale and implementation strategy have been outlined in a previous publication focused on the physical activity component(Reference Hassani, Buckler and McConnell-Nzunga20). Training was a core strategy so we briefly overview this, with specific details about the healthy eating content training. Appetite to Play employed a ‘train the trainer’ model to deliver the intervention throughout the region of interest(Reference Naylor and Temple26,Reference Ray, Wilson and Wandersman27) . Healthy eating content was developed by registered dietitian nutrition consultants with relevant content expertise in the topics. Two lead trainers, one expert in physical activity and one in nutrition, delivered both the healthy eating and physical activity content, and these experts trained regional trainers from widely dispersed geographic regions (n 88) to deliver the workshop. Regional trainers were required to possess a diploma or degree in a relevant field (e.g. early childhood education, nutrition, kinesiology, recreation and education). Ongoing support, in the form of two refresher training sessions, additional support with a lead trainer upon request, follow-up support if a negative review was received regarding a regional trainer and a newsletter and cross-site sharing, was provided to regional trainers. Finally, a regular newsletter and cross-site sharing were put in place to support regional trainers.

Evaluation design and framework

The evaluation of Appetite to Play represents a real world trial, where interventions are assessed in a natural context to increase uptake and applicability at an earlier stage of the research process(Reference Ogilvie, Adams and Bauman11). A concurrent triangulation of the quantitative and qualitative data was integrated during the interpretation phase(Reference Creswell28). Evaluation of Appetite to Play used a knowledge exchange model, where practitioners and policy makers weighed in on the decision making process, and it was developed along with the implementation strategy(Reference Ogilvie, Adams and Bauman11). This process was informed by the implementation evaluation literature(Reference Steckler29) and the RE-AIM framework(Reference Glasgow, Vogt and Boles30). RE-AIM was designed to evaluate community-based interventions and provides evaluation of outcomes at the staff level, which was undertaken in Appetite to Play(Reference Glasgow, Vogt and Boles30). We included satisfaction and context in our evaluation and defined maintenance as ‘potential maintenance and sustainability’. Sample size was not calculated a priori, as the goal was to disseminate at scale, reaching a large population. Implementation goals were to carry out 200 in-person workshops, connect with 3000 early years’ providers during the first 18 months and reach 1000 early years providers through the e-learning modules.

Data collection

Participants were recruited from three groups: individuals who completed an in-person training workshop, a live-virtual workshop or a self-paced e-learning module on healthy eating. Pre- and post face-to-face workshop survey data were collected using paper-based questionnaires linked via a unique participant code. Pre and post live-online and e-learning workshops were collected anonymously through Research Electronic Data Capture (REDCap, Nashville, TN, USA). REDCap is a secure, web-based software platform for building and collecting online survey data for research studies(Reference Harris, Taylor and Minor31,Reference Harris, Taylor and Thielke32) . Demographic information (e.g. age, experience, role and previous training) about participants was collected via surveys. Knowledge, confidence and intention to promote, specifically related to key workshop content and messages, were measured using a 5-point Likert scale, for example ‘Circle the statement that best describes your KNOWLEDGE about the following areas: healthy beverage choices; supporting breastfeeding; communicating about food and healthy eating with families’ and ‘Circle the statement that best describes your level of CONFIDENCE in your ability to: support children to become good eaters; offer a variety of foods at meals and snacks from Canada’s Food Guide’. These questions were developed to specifically evaluate this training programme and were based on efficacy items from the behaviour change literature and previous training programmes(Reference Naylor and Temple26,Reference Rhodes and Rebar33,Reference Rhodes, Spence and Berry34) .

Website analytics data were collected using Matomo freeware (Matomo, London, UK) to determine reach of the website resources.

Qualitative data came from two sources: open-ended questions on post-workshop surveys and interviews with a subset of the workshop participants. Post-workshop survey questions were (1) What do you think will make it easy for you to implement the recommended practices around healthy eating for children in your programme? (2) What do you think will make it hard for you to implement the recommended practices around healthy eating for children in your program? These responses were entered into a spreadsheet verbatim. We conducted twenty-three semi-structured telephone interviews with participants who had completed the Appetite to Play workshop and indicated on their consent form they were willing to complete an interview. We attempted to contact all 106 individuals who indicated interest and most of these participants were not reached (e.g. unreturned voicemails and emails) and a small group (n 4) of participants indicated they were no longer interested or unavailable. There were no apparent differences in gender, job title or location between those who were interviewed and those we were unable to contact. We asked participants questions around implementation of healthy eating recommended practices, if and how the Appetite to Play capacity-building strategies supported implementation, and what barriers and facilitators existed for supporting healthy eating in the early years.

Additional qualitative data, namely interviews with partner advisory group members and lead and regional trainers, were conducted, and data were published in a previous publication(Reference Hassani, Buckler and McConnell-Nzunga20).

Paper questionnaires were paired, and scanned and data were digitised using Remark Office OMR (Gravic, Inc., Malvern, PA, USA). Electronic questionnaires were inputted into REDCap and ready for analysis immediately. Data analysis used a mixed-methods approach(Reference Creswell28), where conclusions were drawn from both qualitative and quantitative data when available.

Quantitative data analysis

We used IBM SPSS Statistics 27 (IBM) for statistical analysis. Descriptive statistics were calculated to describe participant characteristics and satisfaction with training. Knowledge and confidence questions were computed into four variables (pre- and post-confidence and pre-and post-knowledge) after we calculated for internal consistency using Cronbach’s alpha and found it to be sufficient (α > 0·91 for all constructs). To evaluate training outcomes, we used paired t tests to compare change in participant knowledge and confidence prior to and following the training. We ran ANOVAs to compare differences in training modality in terms of content, satisfaction, delivery and usefulness. All statistical assumptions for test were met.

The ‘intention to promote’ construct was built on responses to two Likert-scale statements on determination and motivation, namely: ‘I am determined to promote healthy eating for children in my care over the next 2 weeks’ and ‘I am motivated to promote healthy eating for children in my care over the next 2 weeks’. We ran an ANOVA between the intention to promote constructs from each of the three workshops to determine if there were differences in intention based on delivery modality.

Qualitative data analysis

For open-ended questions from surveys, we used frequency counts in R to generate a preliminary data analysis. Words used less than ten times and stop words were excluded from analysis(35,36) . We employed this approach for the two open-ended questions on the survey responses, as there were thousands of individual responses to these two qualitative questions. This provided a preliminary filter for finding the key ideas in the many responses. Responses were read and reread by a member of the research team, and meaningful categories were generated by combining the frequently stated words, with knowledge of responses.

We used Nvivo 11 (QSR International, Burlington, MA, USA) to code and sort qualitative data. Interviews were transcribed by a professional transcriber, and then one research team member coded interviews and used content analysis to find patterns in the data(Reference Forman, Damschroder, Jacoby and Siminoff37). Additional members of the research team acted as critical reviewers by reviewing themes and related quotes as presented by the coding author, a strategy to enhance trustworthiness in the data through promoting critical reflection and deeper interpretation of findings(Reference Smith and Sparkes38,Reference Smith and McGannon39) . We triangulated this with quantitative data to interpret the findings of both qualitative and quantitative data.

Results

Some of the broader reach information from this study were previously published(Reference Hassani, Buckler and McConnell-Nzunga20) because of the integration of both physical activity and healthy eating in the workshops. These are summarised here with the relevant RE-AIM framework steps to action underlined alongside the relevant results.

We evaluated reach of the Appetite to Play intervention through three outcomes: website reach, training reach and adoption and participant demographics. As reported previously,(Reference Indig, Lee and Grunseit19, p.7) website visits were tracked from September 2017 to March 2019, during which the website received 25 867 individual visits (96 804 page views). Web visitors were comprised of BC residents (10 %) and often were returning visitors (38 %). Visitors spent an average of 3 min, 56 s on the website and completed 4·5 actions (e.g. page clicks and downloads) per visit, and returning visitors spent 5 min, 13 s on site, and completed 5·1 actions, indicating that returning visitors engaged more deeply with the website. Website visitors primarily accessed the site via desktop computers.

Effectiveness of the intervention was quantified by improvements in participant knowledge and confidence about healthy eating and food literacy topics, which improved significantly from pre- to post-workshop (P < 0·001; see Table 2). Pre- to post-workshop changes in outcomes were not significantly different between workshop modality. Cronbach’s alpha for all knowledge, confidence and intention items pre- and post-workshop, in all training modalities was high (range 0·80–0·96).

Table 2 Differences between knowledge and confidence in healthy eating pre and post training for different training modalities

Paired t tests were used to compare differences.

1 being the lowest and 5 the highest on the scale, converted from responses to 5-item Likert scale questions.

Adoption of Appetite to Play was high. Of the eighty-eight regional trainers in the geographic region of BC, 56 (64 %) were active and delivered at least one in-person workshop (mean delivery 2·8 workshops (sd 2·6); range 1–11). The regional trainers delivered a total of 195 in-person workshops, training a total of 2328 participants. Of those 2328 participants, 1670 participants (71·7 %) provided consent to participate in the research evaluation and completed pre- and post-workshop surveys. The workshops took place in seventy-two municipalities; however, some individuals travelled to workshops expanding the reach to at least 97 BC municipalities, out of 162 total(40). A total of ten live online workshops were held. The online workshops trained a total of 164 participants from forty-two municipalities, within and beyond BC. Of the 164 participants, 155 (94·5 %) provided consent and completed the surveys. Finally, 249 separate participants completed the Food Literacy e-learning module, of which 159 (63·9 %) provided consent and completed the surveys. In summary, a total of 2741 participants were trained about healthy eating and food literacy of which 1733 reported they were early childhood educators, over 95 % of those trained were resident of BC. This represents approximately 11 % of the early childhood educators in BC, based on Census data(Reference Uppal and Savage41). The remaining participants worked in a variety of ECEC support roles, such as ECEC licensing officers, public health professionals (e.g. dietitians, nurses) and in programmes for children that did not provide childcare, including recreation program delivery. Table 3 summarises participant characteristics. In total, twenty-three participants who completed the training were interviewed.

Table 3 Summary demographics of participants of the healthy eating workshops and e-learning module and qualitative interviews

sd, standard deviation.

* 80 % of participants who indicated they were not early childhood educators also indicated that they had worked a minimum of 1 year in early years settings, but participants did not consistently report their current role in early years settings.

Participants were satisfied with healthy eating content and delivery of the in-person, live online and e-learning modules and indicated the content would be useful (see Table 4). Participants indicated that the content was on average somewhat new, or slightly less than somewhat new (see Table 4). As shown in Table 4, satisfaction ratings did not differ by mode of delivery. Table 4 also show participants’ intentions to promote healthy eating following the workshop to be high and to not significantly differ across training modalities.

Table 4 Overall satisfaction of participants with the healthy eating workshops and E-learning module and intention to use the content of the workshops

* Numbers on Likert scale from 1 to 5, with 1 being the lowest and 5 the highest on the scale. ANOVA were used to ascertain group differences.

Qualitative results

Qualitative results provided detailed information on the implementation and context of Appetite to Play. Four major categories were identified from the in-person workshop participant open survey responses to questions about potential facilitators (i.e. What will make it easy). These were educator behaviours (role modeling and encouragement), providing activities and opportunities to try out food, resources (such as Appetite to Play) and focusing on fruit and vegetables. Four major categories of responses also emerged from the question about barriers. These were parental support (most ECEC centres in BC do not provide food), child-specific challenges such as picky eating and/or allergies, small food budgets (for those that did provide food) and a lack of resources. Sample quotes are displayed by category in Table 5.

Table 5 Key categories and sample quotes from in person workshop participant cited barriers and facilitators to implementing healthy eating protocols

We found similar trends in the qualitative interview data, with early years’ providers who did not provide food explaining that this presented additional challenges, particularly as parents were not always open to education or feedback around lunchbox contents, as demonstrated in the following quote. ‘I mean I have the children open their lunch boxes you know and peel and all that stuff, but sometimes I go hmm, [you] shouldn’t be really eating this. … So I have to be always careful and weigh my words to the parents, you know oh you know, today I saw her or him, looking at this person’s lunch, you know maybe next time if you don’t mind, can you send maybe this. So, it’s lots of beating around the bush.’ (Participant 12).

Early years’ providers extended this conversation and highlighted that food security and the housing situations of families also presented a barrier for families in providing specific food choices. Early years’ providers noted they approached the subject with caution. For example, ‘We don’t want to say bad v. good, we realize that finances can be an issue with some families, and I certainly have a few families in the center that, that is the case, and that it’s a simple matter of they can’t afford healthy choices a lot of the times…. So I think that part of it has been tricky.’ (Participant 1). As well, participants highlighted that some of the resources were not completely appropriate for families with very low-incomes, as highlighted here: ‘the section on Eating Well on a Limited Income, someone described this section as tips for the well off, rather than for folks for whom food security is an issue. You know cook at home more often really doesn’t work if you’re living in a Single Room Occupancy … or minimize food waste. Well hm, you know shopping the perimeter, making a grocery list if your food’s only coming from the food bank. … this section was meant to be about eating well on a limited income, and so I can understand some of the criticisms about this section.’ (Participant 21).

For participants who worked at places that provided food, time and planning were seen as key factors in success. One participant indicated that they had staff who could devote time to focus on food preparation and planning. She said, ‘you know we’re pretty confident in our kitchen and confident in our nutrition. We have a staff member here who’s a nutritionist’ (Participant 3). For another participant, the time needed to create healthy meals and snacks was a challenge. ‘I would say more on the healthy eating, cause we do eat generally super healthy, not always as good as we could. And I find sometimes I’ll take the easier route, just because of time factors. So probably the prep and planning, I find a little more difficult … on the snacks and healthy eating’ (Participant 18).

In general, participants expressed that they liked the Appetite to Play program, and that it aligned with their centre philosophies on healthy eating, which aligned with survey responses. One participant said, ‘I think it was good just to get a refresher, because a lot of the time, especially for preparing snacks, our managers are actually the ones who put out the schedule of what’s prepared for snack. And it was definitely interesting to see the Canada Food Guide, and see the recommendations for healthy eating, so now when I see snacks being prepared, I can think oh this is what my manager was thinking, with different food groups being put on for snack’ (Participant 17). Participants also felt that while Appetite to Play was not mostly new information for them, it was an excellent refresher. One participant said, ‘a good reminder for our ECE team that yes I think when most of the parents are like okay you have to finish your whole plate, but knowing the child’s own signals and the child knows that when he’s full, when he’s not. It was a good reminder for the ECE especially, because they were on the same kind of frame, and then them passing on that message to families’. (Participant 15).

In terms of potential maintenance and sustainability, a shift to online delivery of workshops and expansion into e-learning modules was assessed. As outlined in Tables 4 and 2, very minimal differences were seen across the three modalities, indicating high potential for long-term maintenance and sustainability through enhanced cost efficiencies.

Discussion

The early years represent an important time in the development of healthy eating behaviours. Use of ECEC (both formal and informal) during these years is increasing and children spend substantial time in ECEC(Reference Friendly, Feltham and Mohamed42,Reference Sinha43) . Thus, early years providers are a key health intermediary to support the development of these healthy eating behaviours amongst young children. With a growing call to disseminate and evaluate interventions in real-world settings at the population level,(Reference Ogilvie, Adams and Bauman11) we took the opportunity to evaluate the implementation and impact of Appetite to Play on the healthy eating knowledge, confidence and practices of the early years providers that were trained. Our mixed methods, RE-AIM informed evaluation suggests that this goal was achieved.

Reach and adoption were high with workshops delivered in person to over half of all BC municipalities. Previous physical activity training data in BC demonstrated slightly lower program delivery, with forty-three workshops delivered in 9 months(Reference Naylor and Temple26). When recruitment is targeted, uptake may be higher. For example, a regionally targeted intervention in the Hunter Region of New South Wales, Australia, 91 % of ECEC centres agreed to participate in a healthy eating intervention, with 251 centres participating(Reference Bell, Davies and Finch44).

The healthy eating implementation strategies known as Appetite to Play (categorised using Proctor(Reference Proctor, Powell and McMillen22) as a capacity building in the form of a variety of training (virtual and in-person and e-module training) and resources plus the dissemination of evidence-based information encompassed within the Appetite to Play web-based toolkit appear to be effective. Confidence, knowledge, and intention to promote healthy eating all increased significantly from pre- to post-training across all three training modalities. In comparison, Ward and colleagues(Reference Ward, Bélanger and Leis45) found increases in self-reported early years providers’ healthy eating practices following online training but not in person training. Devine and colleagues(Reference Devine, Wallace and Lo46) also found increases in provider knowledge following their online training.

In terms of implementation, participants were highly satisfied with workshop content, delivery and usefulness. There was one difference across training modalities, with significant differences seen in usefulness of training modality, with the e-learning modules significantly different than in-person workshops; however, we are unsure if this difference is meaningful due to the relatively low differences in means across groups (4·3–4·0/5·0). Further examination across modalities is needed. Several implementation issues arose when barriers to implementation were discussed. For instance, participants regularly reported a lack of resources (both practical and time resources) and a lack of budget as barriers to implementing healthy eating in early years settings. The implementation of the recommended practices outlined in Appetite to Play also presented challenges for early years providers, as most ECEC settings in BC do not provide food; therefore, early years providers must contend with supporting parents in providing healthy food choices to their children, rather than making changes to a menu of foods they serve the children. Previous research also indicates that parents can be perceived as barriers to implementing healthy eating in ECEC settings(Reference Lebron, Ofori and Sardinas47). Qualitative data also indicated that child specific challenges, including individual food pickiness and/or preferences and allergies, were barriers to implementing the Appetite to Play recommended practices. Conversely, early years providers viewed themselves as role models in supporting implementation of the practices, in both their own food choices, as well as the activities and games they could share with the children they work with.

As outlined in our previous publication,(Reference Hassani, Buckler and McConnell-Nzunga20) a significant maintenance plan was developed for Appetite to Play based on recommendations from the pilot and this data collection. At the time of submission of this manuscript (2023), 4 years after the cessation of data collection, the suite of Appetite to Play resources continues to grow and redevelop based on changes in the literature. Appetite to Play continues to be hosted and managed by Child Health BC at https://appetitetoplay.com/.

Limitations and strengths

Like all studies, this one should be viewed in light of its limitations. This study was limited by the lack of a control group. Data were collected at the level of the training participant, and there are no center or child-level data to confirm the extent to which the ideas and activities taught in the training programmes were implemented or how they may have impacted child dietary habits. No direct fidelity checks of the workshops were completed. Questions to evaluate knowledge and confidence were developed pragmatically based on typically used Likert scales and questions addressing knowledge and confidence but were specifically related to training workshop content and therefore were not validated. Likert scale responses may also be subject to social desirability bias. Some caution should be used when viewing satisfaction data, as these data represent the dual content of the workshop (physical activity as well as healthy eating).

This study also had significant strengths. Design of the intervention prioritised the needs of partners and current evidence thus enhancing potential adoption. Our sample size was large, with over 1600 participants. The intervention evaluation relied on quantitative and qualitative data and data were triangulated when overlap existed between the two information sources. Lastly, the data collection and evaluation employed well-accepted approaches from both the implementation evaluation and RE-AIM literature(Reference Ogilvie, Adams and Bauman11,Reference Ray, Wilson and Wandersman27,Reference Steckler29,Reference Reis, Salvo and Ogilvie48) .

Conclusion

This paper provides support that an evidence-based capacity-building intervention with a focus on training and resources can improve knowledge, confidence and intention to promote healthy eating among early years providers. These provider-level changes are promising and a step towards improving the healthy-eating environment in ECEC settings. While it is likely that the changes observed in early years providers would have an impact on centre- and child-level outcomes, further research is warranted to confirm this, particularly as not all early years providers are in a managerial role and/or responsible for policy making(Reference McConnell-Nzunga, Mâsse and Buckler49). Providers felt empowered to both use new resources and activities provided through the capacity-building intervention and to act as role models. A lack of resources and budget at the delivery system level (ECEC) to support healthy eating were reported as barriers to implementation, coupled with managing parent food provision and individual child needs around food. Most ECEC settings in the jurisdiction served by Appetite to Play do not provide food service for children, and there is no publicly funded universal food service program. Capacity-building efforts that target both parents and early years providers appear important in contexts where most food eaten in ECEC is provided by parents.

Acknowledgements

We would like to acknowledge the contribution of all of the partner agencies (Child Health BC, Sport for Life, YMCA and Childhood Obesity Foundation), decision-makers and staff; without this the initiative and evaluation would have been impossible. We would also like to acknowledge the lead trainers and regional trainers for their role in both the scale-up and evaluation. Finally, we would like to acknowledge all of the early years providers and partners that agreed to participate in the evaluation; their feedback was invaluable.

Financial support

The Appetite to Play initiative was developed and implemented under the leadership of Child Health BC in collaboration with public health, early years and education partners and with key partners, YMCA of Greater Vancouver, Childhood Obesity Foundation and Sport for Life Society. It is now also delivered in partnership with the BC Recreation and Parks Association. The initiative and evaluation was funded through BC’s Physical Activity Strategy, Active People Active Places, in partnership with the BC Alliance for Healthy Living. The evaluation was further supported by grants from the Social Sciences and Humanities Research Council Grant 435-2017-1140, Sport Canada Research Initiative and by a Canadian Institutes of Health Research Impact Fellowship (JMN, post-doctoral recipient). LMC receives salary support from the BC Children’s Hospital Research Institute.

Conflict of interest

There are no conflicts of interest.

Authorship

Project P.J.N., L.C.M., S.F. and J.S. designed the research. P.J.N., L.C.M., S.F. and J.S. obtained funding for the project. S.F. and J.S. were responsible for project administration and resources. E.J.B., K.H. and J.M-N. were responsible for data collection. E.J.B., K.H. and J.M-N. conducted the analyses under the supervision of P.J.N. and L.C.M. E.J.B. wrote the paper and had primary responsibility for the final content. All authors contributed to editing the manuscript. All authors have read and agree to the published version of the manuscript.

Ethics of human subject participation

This study was conducted according to the guidelines laid down in the Declaration of Helsinki, and all procedures involving research study participants were approved by University of British Columbia (H18-01434) and University of Victoria (H18-00666) Research Ethics Boards. Written informed consent was obtained from all participants.

References

Cooke, L (2007) The importance of exposure for healthy eating in childhood: a review. J Hum Nutr Diet 20, 294301.Google Scholar
Ford, ES, Bergmann, MM, Boeing, H et al. (2012) Healthy lifestyle behaviors and all-cause mortality among adults in the United States. Prev Med 55, 2327.Google Scholar
Tysoe, J & Wilson, C (2010) Influences of the family and childcare food environments on preschoolers’ healthy eating. Australas J Early Childhood 35, 105110.Google Scholar
Erinosho, TO, Ball, SC, Hanson, PP et al. (2013) Assessing foods offered to children at child-care centers using the Healthy Eating Index-2005. J Acad Nutr Diet 113, 10841089.Google Scholar
Matwiejczyk, L, Mehta, K, Scott, J et al. (2018) Characteristics of effective interventions promoting healthy eating for pre-schoolers in childcare settings: an umbrella review. Nutrients 10, 293.Google Scholar
Mikkelsen, MV, Husby, S, Skov, LR et al. (2014) A systematic review of types of healthy eating interventions in preschools. Nutr J 13, 56.Google Scholar
Leis, A, Ward, S, Vatanparast, H et al. (2020) Effectiveness of the Healthy Start-Départ Santé approach on physical activity, healthy eating and fundamental movement skills of preschoolers attending childcare centres: a randomized controlled trial. BMC Public Health 20, 523.Google Scholar
Leeman, J, Birken, SA, Powell, BJ et al. (2017) Beyond ‘implementation strategies’: classifying the full range of strategies used in implementation science and practice. Implement Sci 12, 125.Google Scholar
Smith, BJ, Tang, KC & Nutbeam, D (2006) WHO Health Promotion Glossary: new terms. Health Promot Int 21, 340345.Google Scholar
Crisp, BR, Swerissen, H & Duckett, SJ (2000) Four approaches to capacity building in health: consequences for measurement and accountability. Health Promot Int 15, 99107.Google Scholar
Ogilvie, D, Adams, J, Bauman, A et al. (2020) Using natural experimental studies to guide public health action: turning the evidence-based medicine paradigm on its head. J Epidemiol Community Health 74, 203.Google Scholar
Fixsen, DL, Blase, KA, Naoom, SF et al. (2009) Core implementation components. Res Soc Work Pract 19, 531540.Google Scholar
Wandersman, A, Chien, VH & Katz, J (2012) Toward an evidence-based system for innovation support for implementing innovations with quality: tools, training, technical assistance, and quality assurance/quality improvement. Am J Community Psychol 50, 445459.Google Scholar
Satter, E (1999) The feeding relationship. In Failure to Thrive and Pediatric Undernutrition: A Transdisciplinary Approach, pp. 121149 [Barnard, IK & Morisset, VA, editors]. Baltimore, MD: Paul H. Brookes Publishing Co.Google Scholar
Olstad, DL, Prowse, RJL, Raine, KD et al. (2020) Baseline results from the Eat, Play, Live trial: a randomized controlled trial within a natural experiment examining the role of nutrition policy and capacity building in improving food environments in recreation and sport facilities. Food Policy 92, 101870.Google Scholar
Leeman, J, Calancie, L, Hartman, MA et al. (2015) What strategies are used to build practitioners’ capacity to implement community-based interventions and are they effective?: A systematic review. Implement Sci 10, 80.Google Scholar
Vidgen, HA & Gallegos, D (2014) Defining food literacy and its components. Appetite 76, 5059.Google Scholar
Mogharreban, C & Nahikian-Nelms, M (1996) Autonomy at mealtime: building healthy food preferences and eating behaviors in young children. Early Childhood Educ J 24, 2932.Google Scholar
Indig, D, Lee, K, Grunseit, A et al. (2017) Pathways for scaling up public health interventions. BMC Public Health 18, 68.Google Scholar
Hassani, K, Buckler, EJ, McConnell-Nzunga, J et al. (2020) Implementing Appetite to Play at scale in British Columbia: evaluation of a capacity-building intervention to promote physical activity in the early years. Int J Environ Res Public Health 17, 1132.Google Scholar
Powell, BJ, Waltz, TJ, Chinman, MJ et al. (2015) A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci 10, 21.Google Scholar
Proctor, EK, Powell, BJ & McMillen, JC (2013) Implementation strategies: recommendations for specifying and reporting. Implement Sci 8, 139.Google Scholar
Appetite to Play (2023) Introduction to Healthy Eating Recommended Practices. Appetite to Play. https://appetitetoplay.com/healthy-eating/recommended-practices/introduction-healthy-eating-recommended-practices (accessed August 2024).Google Scholar
Government of Canada (2020) Canada’s Food Guide. https://food-guide.canada.ca/en/healthy-food-choices/ (accessed August 2024).Google Scholar
Health Canada (2007) Canada’s Food Guide. https://publications.gc.ca/collections/Collection/H164-38-1-2007E.pdf (accessed August 2024).Google Scholar
Naylor, P-J & Temple, VA (2013) Enhancing the capacity to facilitate physical activity in home-based child care settings. Health Promotion Pract 14, 3037.Google Scholar
Ray, ML, Wilson, MM, Wandersman, A et al. (2012) Using a training-of-trainers approach and proactive technical assistance to bring evidence based programs to scale: an operationalization of the interactive systems framework’s support system. Am J Community Psychol 50, 415427.Google Scholar
Creswell, J (2014) A Concise Introduction to Mixed Methods Research. Thousand Oaks, CA: SAGE Publications.Google Scholar
Steckler, A (2002) Process Evaluation for Public Health Interventions and Research. San Francisco, CA: Jossey-Bass.Google Scholar
Glasgow, RE, Vogt, TM & Boles, SM (1999) Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health 89, 13221327.Google Scholar
Harris, PA, Taylor, R, Minor, BL et al. (2019) The REDCap consortium: building an international community of software platform partners. J Biomed Inf 95, 103208.Google Scholar
Harris, PA, Taylor, R, Thielke, R et al. (2009) Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inf 42, 377381.Google Scholar
Rhodes, RE & Rebar, AL (2017) Conceptualizing and defining the intention construct for future physical activity research. Exerc Sport Sci Rev 45, 209216.Google Scholar
Rhodes, RE, Spence, JC, Berry, T et al. (2019) Parental support of the Canadian 24-hour movement guidelines for children and youth: prevalence and correlates. BMC Public Health 19, 1385.Google Scholar
R Core Development Team (2010) R: A Language and Environment for Statistical Computing. Vienna, Australia: R Foundation for Statistical Computing.Google Scholar
RStudio Team (2015) R Studio: Integrated Development for R. Boston, MA: R Studio, Inc.Google Scholar
Forman, J & Damschroder, L (2007) Qualitative content analysis. In Empirical Methods for Bioethics: A Primer, vol. 11, pp. 3962 [Jacoby, L & Siminoff, LA, editors]. Bingley: Emerald Group Publishing Limited.Google Scholar
Smith, B & Sparkes, A (editors) (2016) Interviews: Qualitative Interviewing in the Sport and Exercise Sciences. Routledge Handbook of Qualitative Research in Sport and Exercise. New York, NY: Routledge. pp. 103123.Google Scholar
Smith, B & McGannon, KR (2018) Developing rigor in qualitative research: problems and opportunities within sport and exercise psychology. Int Rev Sport Exerc Psychol 11, 101121.Google Scholar
Government of British Columbia (2023) Municipalities in BC. https://www2.gov.bc.ca/gov/content/governments/local-governments/facts-framework/systems/municipalities (accessed August 2024).Google Scholar
Uppal, S & Savage, K. (2021) Child Care Workers in Canada. Insights on Canadian Society: Statistics Canada. https://www150.statcan.gc.ca/n1/pub/75-006-x/2021001/article/00005-eng.htm (accessed August 2024).Google Scholar
Friendly, M, Feltham, L, Mohamed, S et al. (2020) Early Childhood Education and Care in Canada 2019. Toronto, ON: Childcare Resource and Research Unit.Google Scholar
Sinha, M (2014) Spotlight on Canadians: Results from the General Social Survey - Child Care in Canada 2014. Ottawa, ON: Statistics Canada.Google Scholar
Bell, AC, Davies, L, Finch, M et al. (2015) An implementation intervention to encourage healthy eating in centre-based child-care services: impact of the Good for Kids Good for Life programme. Public Health Nutr 18, 16101619. 2014/01/09 ed. Cambridge University Press.Google Scholar
Ward, S, Bélanger, M & Leis, A (2020) Comparison between the Healthy Start-Départ Santé online and in-person training of childcare educators to improve healthy eating and physical activity practices and knowledge of physical activity and fundamental movement skills: a controlled trial. Prev Med Rep 20, 101264.Google Scholar
Devine, A, Wallace, R, Lo, J et al. (2019) Online programs build confidence and improve healthy eating messages in Early Years services. Australas J Early Childhood 44, 139152.Google Scholar
Lebron, CN, Ofori, A, Sardinas, K et al. (2020) Barriers and facilitators to obesity prevention dissemination and implementation efforts in the childcare centre setting from the provider perspective. Child: Care, Health Dev 46, 352359.Google Scholar
Reis, RS, Salvo, D, Ogilvie, D et al. (2016) Scaling up physical activity interventions worldwide: stepping up to larger and smarter approaches to get people moving. Lancet 388, 13371348.Google Scholar
McConnell-Nzunga, J, Mâsse, LC, Buckler, EJ et al. (2020) Prevalence and relationships among physical activity policy, environment, and practices in licensed childcare centers from a manager and staff perspective. Int J Environ Res Public Health 17, 1064.Google Scholar
Figure 0

Table 1 Healthy eating capacity-building implementation strategy components of Appetite to Play aligned with expert recommendations for implementing change (ERIC)(17) and specifying and reporting of implementation strategies(22)

Figure 1

Table 2 Differences between knowledge and confidence in healthy eating pre and post training for different training modalities

Figure 2

Table 3 Summary demographics of participants of the healthy eating workshops and e-learning module and qualitative interviews

Figure 3

Table 4 Overall satisfaction of participants with the healthy eating workshops and E-learning module and intention to use the content of the workshops

Figure 4

Table 5 Key categories and sample quotes from in person workshop participant cited barriers and facilitators to implementing healthy eating protocols