Hostname: page-component-586b7cd67f-t7fkt Total loading time: 0 Render date: 2024-11-26T08:59:10.591Z Has data issue: false hasContentIssue false

Objective assessment of compliance with a state-wide school food-service policy via menu audits

Published online by Cambridge University Press:  22 February 2019

Gael Myers*
Affiliation:
School of Psychology, Curtin University, GPO Box U1987, Perth, WA 6845, Australia Cancer Council Western Australia, Subiaco, Western Australia, Australia
Megan Sauzier
Affiliation:
Western Australian School Canteen Association (Inc.), East Perth, Western Australia, Australia
Amanda Ferguson
Affiliation:
Western Australian School Canteen Association (Inc.), East Perth, Western Australia, Australia
Simone Pettigrew
Affiliation:
School of Psychology, Curtin University, GPO Box U1987, Perth, WA 6845, Australia
*
*Corresponding author: Email [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Objective

The Healthy Food and Drink Policy was implemented in Western Australian government schools in 2007. The aim of the present study was to assess the compliance of Western Australian school canteen menus with the policy a decade after its introduction.

Design

The traffic-light system that underpins the Healthy Food and Drink Policy categorises foods and drinks into three groups: ‘green’ healthy items, ‘amber’ items that should be selected carefully and ‘red’ items that lack nutritional value. Canteen menus were collected online and each menu item was coded as a green, amber or red choice.

Setting

Western Australia.

Participants

Online canteen menus from 136 primary and secondary government schools.

Results

The majority of audited school menus met policy requirements to include ≥60 % green items (84 %) and ≤40 % amber items (90 %), but only 52 % completely excluded red items. Overall, approximately half (48 %) of school canteen menus met all three traffic-light targets. On average, 70 % of the menu items were green, 28 % were amber and 2 % were red. Primary-school canteen menus were more likely than those from secondary schools to meet the requirements of the policy.

Conclusions

While the sampled Western Australian government school canteen menus were highly compliant with most of the requirements of the Healthy Food and Drink Policy, many offered red foods and/or drinks. Providing all schools with further education about identifying red items and offering additional services to secondary schools may help improve compliance rates.

Type
Research paper
Copyright
© The Authors 2019 

The importance of the school environment as a setting for promoting healthy eating behaviours during childhood is well recognised( Reference da Silveira, Taddei and Guerra 1 Reference Wang and Stewart 3 ). The school canteen in particular is a key intervention site as the provision of nutritious foods and drinks directly supports children’s learning and development( 4 ) and offers schools the opportunity to model the nutrition advice taught as part of the curriculum( Reference Cleland, Worsley and Crawford 5 ). Schools can thus use the canteen to help deliver consistent messages to students about recommended eating practices to promote the adoption of lifelong healthy eating behaviours.

In recognition of the important role of school canteens in promoting healthy eating( Reference Budd and Volpe 6 Reference Cullen, Watson and Zakeri 9 ), international agencies such as the World Cancer Research Fund International( Reference Hawkes, Jewell and Allen 10 ) and the WHO( 11 ) have encouraged countries to implement nutrition policies that specify the foods and beverages that can and cannot be served in schools. In Australia, all states and territories have implemented region-specific school food-service policies. The first of these was developed in New South Wales (NSW) in 2005, while the most recent was implemented in Tasmania in 2014( Reference Wu, Berg and Neeson 12 ). The policies are mandatory for all government schools in each jurisdiction except Tasmania( Reference Stylianou and Walker 13 ). Policies in most regions use the traffic-light system that categorises foods and drinks into three groups: green, amber and red. ‘Green’ items are those that are based on the five core food groups (i.e. fruit, vegetables, grains, meat and vegetarian alternatives, dairy) and are recommended as everyday choices( 4 , 14 , 15 ). ‘Amber’ foods have some nutritional value, however they also contain moderate amounts of energy, total fat, saturated fat, sugar and/or sodium( 14 , 15 ). ‘Red’ items lack nutritional value and contribute excessive amounts of energy, total fat, saturated fat, sugar and/or sodium( 14 , 15 ). Specific nutrient cut-offs for each food and beverage category are used to determine the traffic-light categorisation of different items. The nutrient criteria underpinning the traffic-light system vary across the different jurisdictions of Australia, however they all share similarities and are consistent with the Australian Dietary Guidelines( 4 ).

Previous research suggests that the rate of adherence to canteen nutrition guidelines in Australia is generally poor( Reference Wu, Berg and Neeson 12 , Reference Woods, Bressan and Langelaan 16 ). A national audit of government school canteen menus collected in 2012 found that fewer than 35 % of menus complied with traffic-light criteria in all Australian states and territories except Western Australia (WA), where the figure was substantially higher at 62 %( Reference Woods, Bressan and Langelaan 16 ). Of note is that the study compared the proportion of menu items in each traffic-light category against state/territory-based criteria, which are more stringent in WA than in other regions (e.g. WA school canteens are required to offer ≥60 % green items while in other regions schools must have >50 % green items). The study also found that the mean proportion of green items on canteen menus was ≤50 % in all regions except the Northern Territory, Queensland and WA( Reference Woods, Bressan and Langelaan 16 ). In most states and territories, a substantial proportion of school canteen menus included confectionery (e.g. 47 % of schools in the Australian Capital Territory and 38 % in Tasmania)( Reference Yoong, Nathan and Wyse 17 ).

Other research has found similar results, including three studies conducted in NSW in 2010( Reference Hills, Nathan and Robinson 18 ), 2012/13( Reference Yoong, Nathan and Wyse 17 ) and 2014( Reference Nathan, Yoong and Sutherland 19 ) that observed that only 10 %( Reference Yoong, Nathan and Wyse 17 ) to 22 %( Reference Hills, Nathan and Robinson 18 ) of school canteen menus excluded red items and only 29 %( Reference Yoong, Nathan and Wyse 17 ) to 30 %( Reference Nathan, Yoong and Sutherland 19 ) of menus included ≥50 % green items. These studies also found that NSW school canteen menus offered on average 35 %( Reference Hills, Nathan and Robinson 18 ) to 40 %( Reference Yoong, Nathan and Wyse 17 ) green items and 6 %( Reference Hills, Nathan and Robinson 18 ) to 8 %( Reference Yoong, Nathan and Wyse 17 ) red items. An audit of Victorian schools in 2008/09 (the Victorian school food-service policy was introduced in 2006) found that canteen menus included an average of 20 % green items and 29 % red items, no canteen menu had ≥50 % green items, and only one school canteen menu (1 %) avoided the use of red items( Reference de Silva-Sanigorski, Breheny and Jones 20 ). Of the canteen menus included in the Victorian study, 20 % were colour-coded and 36 % of these items were coded correctly( Reference de Silva-Sanigorski, Breheny and Jones 20 ). Both government and non-government schools were included in the studies conducted in NSW and Victoria discussed above; as canteen policies are not mandatory in non-government schools in these states, the study results are likely to underestimate compliance in government schools.

The mandatory WA Healthy Food and Drink Policy (the ‘HFD policy’ hereafter) was implemented in government schools in 2007 by the Department of Education WA( 15 ). A similar policy was mandated in WA Catholic schools in 2008( 21 ). Previous evaluation surveys conducted with school stakeholders in WA in 2008 and 2016 have suggested that WA schools are largely compliant with the HFD policy( Reference Pettigrew, Donovan and Jalleh 22 , Reference Pettigrew, Talati and Sauzier 23 ). In 2008, 89 % of respondents reported that their school achieved total or near-total compliance with the policy, while in 2016 this figure was 81 %( Reference Pettigrew, Talati and Sauzier 23 ). These evaluations relied on self-reported measures of compliance and research has shown that there can be a substantial gap between self-reported compliance rates and compliance assessed using more objective measures( Reference Nathan, Wolfenden and Morgan 24 , Reference Reilly, Nathan and Wolfenden 25 ). For example, using self-reported measures, very high compliance (>80 %) with state-based canteen policies has been shown in Queensland( Reference Dick, Lee and Bright 26 ) and NSW( 27 ), while actual compliance appeared to be much lower (<30 %) when independently reviewed via menu audits( Reference Woods, Bressan and Langelaan 16 ).

The aim of the present study was to audit a sample of WA primary and secondary government school canteen online menus to provide an objective estimate of canteen menu compliance with the HFD policy to compare against the results of previous self-reported outcomes( Reference Pettigrew, Donovan and Jalleh 22 , Reference Pettigrew, Talati and Sauzier 23 ) and the 2012 national canteen menu audit study( Reference Woods, Bressan and Langelaan 16 ). The present study provides a current estimate of canteen menu compliance in government schools in WA and provides detail on a number of additional compliance components compared with previous studies (points ii and iii below). Compliance was assessed in terms of: (i) the proportion of green, amber and red menu items; (ii) the extent and accuracy of menu colour-coding; and (iii) restrictions on the sale of amber savoury commercial items to ≤2 days per week. The presence or absence of desirable food and beverage items (plain water, plain milk, fruit and raw vegetables) was also recorded.

Methods

Setting and participants

A list of all WA schools (n 1118) was obtained online in July 2017 from the Department of Education WA( 28 ). The list included information on school type (e.g. primary, secondary, combined primary/secondary), geographical location and whether schools were classified as government, Catholic or independent schools. Catholic and independent schools were excluded from the present study as the HFD policy has been implemented differently in Catholic schools and is not mandated in independent schools (308 Catholic and independent schools excluded). Remote community schools and schools catering for students with special educational needs (e.g. education support schools, agricultural schools and distance education schools) were also excluded as few operate canteens (125 schools excluded). This produced a list of 685 schools that were eligible to be included in the study.

Minimum thresholds were set according to the proportions of each school subtype that would be expected in a random sample of 100 menus based on the characteristics of the list of eligible schools. The thresholds for geographical location were sixty-three metropolitan schools and thirty-seven regional schools. The thresholds for school type were seventy-six primary schools, fifteen secondary schools and nine combined primary/secondary schools. A random sample was drawn using these thresholds from the list of eligible schools. Not all schools had a menu available online and there were differences in the availability of online menus by school subgroup (primary schools and schools in the metropolitan area were more likely to have a menu available online, although these trends were not statistically significant). In total, 275 schools were randomly selected before all minimum thresholds were met, of which 145 (53 %) had menus available online. Nine of these schools were excluded as their menus contained insufficient information for the analysis (e.g. did not include drinks or recess items), resulting in a final sample of 136 menus/schools (representing 17 % of government schools in WA).

Canteen menus were collected online in September 2017 via schools’ websites and Facebook pages administered by staff or the Parents and Citizens (P&C) Committee. The assumption was made that if the menu appeared online it was currently being used by the school canteen. Google searches were undertaken using the name of each school in combination with the keywords ‘canteen’, ‘cafe’, ‘Facebook P&C’ and ‘Facebook canteen’. A manual search was also conducted of each available school website if no canteen menu was found using the previous search strategy. Where necessary, photographs posted on school and P&C Committee Facebook pages in 2017 were examined to identify any images of canteen menus. Where a menu was available on both Facebook and the school website, the most up-to-date menu was included in the data set (the majority of canteen menus accessed included a date of release).

Healthy Food and Drink Policy requirements

To comply with the HFD policy, schools must ensure that only green and amber foods are provided in any school activities where the principal is directly responsible, including food provision in the canteen. The categorisation of foods and drinks into traffic-light categories is based on the nutrient criteria developed by the Federation of Canteens in Schools Inc., a national body that includes representatives from various state and territory canteen associations and governments( 29 ). The HFD policy specifies that canteen menus must offer ≥60 % green items, ≤40 % amber items and no red items. Canteens are also required to restrict the availability of amber savoury commercial products (e.g. chicken nuggets or pastries that meet amber nutrient criteria) to ≤2 days each week. Canteens are encouraged to colour-code their menu to allow parents and students to make informed decisions about their food choices. Schools are also given information about including desirable food and beverage items (plain water, plain milk, fruit and raw vegetables) during mandatory traffic-light training delivered by the Western Australian School Canteen Association (Inc.) (WASCA) and through various resources for canteens available via the WASCA website( 30 ). Finally, government school principals must self-report on HFD policy compliance to the Department of Education WA annually.

Data coding

The menus were coded by two qualified nutritionists from WASCA who have substantial experience in canteen menu assessment. A brief menu audit process was applied that involved analysing items as listed on the menu only, with no additional information collected from canteen staff or other school representatives. Reilly et al.( Reference Reilly, Nathan and Wolfenden 25 ) found that the brief menu audit approach was more accurate than a comprehensive menu audit that involved seeking clarifying information from canteen managers, while taking less than a quarter of the time to perform. Furthermore, brief menu audits have been shown to have a high level of agreement with the gold standard measure of canteen observations( Reference Reilly, Nathan and Wolfenden 25 ).

Each item on the menu was coded as a green, amber or red choice according to the HFD policy traffic-light system as it stood in June 2017. Every food and drink option appearing on the menu was counted as a single item, including when an item was available only on some canteen operation days. Where multiple variations of an item were listed, such as different sandwich fillings, each was counted as an individual item. Due to the brief nature of the audit, several assumptions were made when categorising foods. These included that: (i) freshly prepared items met nutrient criteria; (ii) commercial food items (e.g. sausage roll or sushi) met the minimum nutrient criteria needed to be classified as amber or green choices( 31 ); and (iii) menu items used reduced-fat dairy, lean meats and reduced-salt ingredients where available.

Information on the number of days that each canteen operated was gathered from menus to permit assessment of the frequency with which amber savoury commercial products were offered for sale. Menus were recorded as being compliant with the HFD policy relating to the sale of these items (i.e. amber commercial products were available on ≤2 days per week), being non-compliant or not able to be assessed (due to not including information on the number of canteen operating days). Information on the presence of particular food and beverage items that have been nominated as especially desirable by WASCA, the WA Department of Health and the Department of Education WA was also collected as part of the study (plain water, plain milk, fruit and raw vegetables). If salad sandwiches, salad bowls/plates and/or vegetable sticks were offered for sale, the menu was recorded as incorporating raw vegetables. Each menu was categorised as either colour-coded or not, and data relating to the accuracy of colour-coding were captured.

Statistical methods

The percentage of items in each traffic-light category was calculated by dividing the number of green, amber or red items on the menu by the total number of menu items. Menus were classified as compliant with specific traffic-light requirements if they offered ≥60 % green items, ≤40 % amber items or excluded red items, respectively. Compliance with all three criteria was also determined. The accuracy of colour-coding was assessed by dividing the number of items classified correctly by the total number of menu items. Statistical analyses were performed using the statistical software package IBM SPSS Statistics version 23. To assess the representativeness of sampled school canteen menus, a χ 2 goodness-of-fit test was used to determine if the distribution of characteristics (i.e. school type and geographical location) differed between schools included in the analysis and schools for which a menu was sought. For the main analyses, between-group differences were assessed using the χ 2 test or Fisher’s exact test (in the case of small sample sizes) for categorical variables and the Kruskal–Wallis test for continuous and ordinal variables. A P value of ≤0·05 was considered significant for all tests. The 95 % CI around the means were calculated for the main outcome variables and are reported in the tables.

Results

Sample characteristics

In total, 136 (49 % of schools for which a menu was sought) schools had a menu available online for analysis (Table 1). Most menus were obtained from school websites (n 130, 96 %), with the remainder sourced from school Facebook pages. There were no significant differences in school type and geographical location between schools included in the analysis and the schools for which a menu was sought.

Table 1 Characteristics of schools with online canteen menus included in the sample, Western Australia, July 2017

On average, canteens were open 4 days per week. Secondary-school canteens were open for significantly more days each week than primary-school canteens (5·0 v. 3·7 d; P<0·001) and combined primary/secondary-school canteens (5·0 v. 3·7 d; P=0·034). There was no difference in the number of canteen operating days between metropolitan and regional schools. The mean number of food and drink items appearing on menus was 56 items (range: 12–114).

Proportion of green, amber and red items

On average, school canteen menus had a predominance of green items (70 %), a moderate amount of amber items (28 %) and a small proportion of red items (2 %). Tables 2 and 3 show the average proportion of items and 95 % CI in each traffic-light category by school type and location. The mean proportion of green items was significantly higher on primary-school canteen menus compared with secondary-school canteen menus (72 v. 64 %; P<0·001). Secondary-school menus had a higher proportion of red items compared with primary-school menus (6 v. 1 %; P<0·001) and combined primary/secondary-school menus (6 v. 1 %; P=0·008). There were no significant differences in the proportion of amber items according to school type (see Table 2), or in the proportion of green, amber and red items by location (see Table 3).

Table 2 Proportions of green, amber and red items on online canteen menus (n 136) by school type, Western Australia, July 2017

a,bValues within each colour category with unlike superscript letters were significantly different (P<0·01).

Table 3 Proportions of green, amber and red items on online canteen menus (n 136) by school location, Western Australia, July 2017

Compliance with green, amber and red targets

The HFD policy specifies that school canteen menus must offer ≥60 % green items, ≤40 % amber items and have no red items( 15 ). The majority of canteen menus included in the analysis had ≥60 % green items (84 %) and ≤40 % amber items (90 %), but only half (52 %) excluded red items. However, the actual percentage of red items offered was low as described above. Overall, 48 % of school canteen menus met all three traffic-light targets.

Primary-school canteen menus demonstrated higher levels of compliance than menus from other school types across individual traffic-light targets and in combination. Primary-school menus were more likely than secondary-school menus to provide ≥60 % green items (89 v. 64 %; P=0·005), exclude red items (62 v. 8 %; P<0·001) and comply with all three traffic-light criteria (59 v. 4 %; P<0·001). Combined primary/secondary-school canteen menus were more likely than those from secondary schools to avoid the use of red items (50 v. 8 %; P=0·012) and comply with all three traffic-light criteria (40 v. 4 %; P=0·017). There were no significant differences in compliance according to school location.

Detailed summary of food and drink items classified as red featured on menus

As indicated above, a key area of non-compliance with the HFD policy was the inclusion of red items on canteen menus; 48 % of menus offered at least one red item. Across the 136 menus analysed, 174 red items were identified. The mean number of red items included on all menus analysed was 1·3 items (range: 0–9 items). Taking into consideration only menus that included at least one red food or drink (n 65), the average number of red items included was 2·6 items (range: 1–9 items). Table 4 shows the breakdown of these items into food and drink categories. The most frequently included items were ice creams and icy poles classified as red (i.e. those not based on milk or >99 % fruit juice, or those with a chocolate coating), certain types of drinks (e.g. flavoured water, juice in portions >250 ml or containing <99 % juice, and iced tea products), jelly without fruit and crisps. Soft drinks and sports drinks were seldom listed, with only one occurrence of each across the audited menus. Confectionery (chocolate and lollies) accounted for just 2 % (n 3) of all red items included on menus.

Table 4 Red food and drink items featuring on online canteen menus (n 65), Western Australia, July 2017

* In total, 174 red food and drink items were identified from the 136 menus analysed.

Extent of colour-coding of menus

Fifty-four (40 %) menus were colour-coded. Primary-school menus were more likely than secondary-school menus to be colour-coded (47 v. 16 %; P=0·005). Presence of colour-coding did not differ significantly by school location.

There was a high degree of accuracy in traffic-light categorisation for those menus that were colour-coded. On average, 90 % of items were coded correctly (range: 50–100 %). Although still considered high, the accuracy of colour-coding was significantly lower on regional school menus compared with metropolitan school menus (84 v. 92 %; P=0·04). There were no significant differences in the accuracy of colour-coding by school type.

Additional menu requirements

As noted earlier, in addition to requirements for the proportion of green, amber and red items offered for sale, school canteens are expected to meet additional menu requirements. The majority of canteen menus included in the analysis met these requirements: 99 % incorporated raw vegetables, 91 % had fruit available, 87 % included plain water, 77 % restricted the availability of amber savoury items to ≤2 days per week, and 61 % offered plain milk. In terms of the provision of raw vegetables, 99 % of canteen menus included a salad sandwich, 79 % offered a salad bowl or plate, and 36 % offered vegetable sticks.

Between-group differences in meeting these menu requirements were observed, with secondary-school canteen menus less likely to restrict the availability of amber savoury items to ≤2 days per week than primary-school canteen menus (50 v. 81 %; P=0·003) and combined primary/secondary-school menus (50 v. 100 %; P=0·006). Primary-school menus were also more likely than secondary-school menus to include plain milk (67 v. 40 %; P=0·012). A higher proportion of primary-school menus included fruit for sale compared with combined primary/secondary-school menus (94 v. 70 %; P=0·034). As almost all menus in the main analysis included salad sandwiches, between-group differences were assessed only for having a salad bowl/plate or vegetable sticks available for purchase. Primary-school canteen menus were more likely than secondary-school menus to include vegetable sticks (42 v. 12 %; P=0·006). No significant differences were observed in meeting the additional menu requirements by school location.

Discussion

The majority of WA school menus included in the present analysis were meeting HFD policy requirements relating to the minimum proportion of green items and maximum proportion of amber items they are allowed to include. Of particular interest in the analysis is that, on average, 70 % of the foods and drinks appearing on canteen menus were green items, which far exceeds the 60 % needed to be compliant with the HFD policy. While the proportion of menus completely excluding red items was lower, the actual number of red items that appeared was small. Food and drink items that are clearly identifiable as red choices, such as soft drinks and lollies, seldom appeared on canteen menus. The types of red items that did appear (such as non-compliant ice creams, icy poles, flavoured water and juices) are items that canteen staff may find difficult to categorise into the appropriate traffic-light category. This suggests that offering additional education about the traffic-light categorisation of these items or expanding the online nutrition database that classifies green and amber foods and drinks( Reference Reilly, Nathan and Wiggers 32 ) has the potential to markedly improve overall compliance with the policy.

The present study found that 48 % of menus met all traffic-light targets. These results can be compared with the 2016 evaluation of the HFD policy that used self-reported compliance measures. In 2016, 81 % of school principals indicated that their school achieved total or near-total compliance with the policy( Reference Pettigrew, Talati and Sauzier 23 ). The difference in results may reflect the samples included in each analysis (the present study included a higher proportion of respondents from metropolitan schools than the 2016 evaluation) and the different methodologies used. In addition, as noted above, school representatives may not always be able to classify food and drink items into the correct traffic-light category( Reference Ardzejewska, Tadros and Baxter 33 ), which may lead to errors in their self-reported compliance with the HFD policy requirements. It is worth noting that the WA Government currently assesses school compliance with the HFD policy annually via principal self-report. It is apparent that self-report may not be a sufficiently accurate measure of compliance and governments should consider moving towards more robust ongoing monitoring criteria.

The results of the present study can also be compared with the national canteen menu audit conducted in 2014 (menus collected online in 2012), which found that 62 % of WA school menus adhered to the HFD policy guidelines in terms of including a minimum of 60 % green items and excluding the use of red items( Reference Woods, Bressan and Langelaan 16 ). This is higher than the 48 % compliance with traffic-light targets found in the current analysis. The smaller sample size in the Woods et al.( Reference Woods, Bressan and Langelaan 16 ) study (forty-two schools from WA) and the focus only on green and red traffic-light targets (i.e. not including the requirement to have ≤40 % amber menu items) in the Woods et al.( Reference Woods, Bressan and Langelaan 16 ) study may provide some explanation for the different results found. There were also changes made to the categorisation of items into traffic-light categories in WA in 2013 that may account for the higher rate of compliance with the HFD policy observed in the Woods et al.( Reference Woods, Bressan and Langelaan 16 ) study compared with the present study. Changes included the re-categorisation of flavoured waters, <99 % juices, juice in portion sizes >250 ml and icy poles based on <99 % juice from amber to red. Therefore, many of the red items identified on canteen menus in the present study would have been categorised as amber items in 2012 when the previous WA menu audit was conducted( Reference Woods, Bressan and Langelaan 16 ). The difference in results found between the 2012 menu audit and the present study highlights the need to effectively communicate policy changes to enable schools to achieve compliance.

The present study found that secondary-school menus were less likely than primary-school menus to meet the requirements of the HFD policy across multiple aspects of compliance. This is consistent with the findings from the 2016 evaluation of the HFD policy( Reference Pettigrew, Talati and Sauzier 23 ) and with other research conducted across different regions in Australia that has found secondary schools to be less compliant with canteen policies compared with primary schools( Reference Woods, Bressan and Langelaan 16 , Reference de Silva-Sanigorski, Breheny and Jones 20 ). The lower compliance of secondary schools with the requirement to restrict amber savoury commercial products to ≤2 days per week may in part be explained by the larger number of primary and combined primary/secondary schools compared with secondary schools that were open for ≤2 days each week, which meant they were automatically compliant. Secondary schools may also face particular barriers that impact on the healthfulness of foods and drinks offered by the canteen. For example, lower engagement of parents with the P&C Committee can mean there are fewer volunteer workers available to prepare meals, which can result in a reliance on amber ‘heat-and-serve’ commercial products( Reference Drummond and Sheppard 34 ). School stakeholders may have a perception that adolescents demand unhealthy menu items to a greater extent than students of primary-school age, and canteens can feel pressured to offer these options( Reference Ardzejewska, Tadros and Baxter 33 , Reference Drummond and Sheppard 34 ). Education and support initiatives that address the unique barriers faced by secondary schools may help address the lower rates of secondary-school compliance with the HFD policy.

As discussed in the introduction, the rate of adherence to canteen nutrition guidelines is low in the majority of Australian states and territories( Reference Wu, Berg and Neeson 12 , Reference Woods, Bressan and Langelaan 16 ). In contrast, the results of the present study indicate that WA schools are on average exceeding the guidelines relating to the provision of green foods and drinks and the majority are not providing red items. There are several factors that may explain why compliance with canteen nutrition guidelines appears to much higher in WA compared with other Australian states and territories. WA is the only state to set clear targets on the proportion of menu items that may be offered in each traffic-light category rather than using qualitative descriptions such as ‘majority to be green’( Reference Wu, Berg and Neeson 12 ). The target of 60 % green is also higher compared with other states and territories (‘majority green’ suggests >50 % green). WA schools are not permitted to sell red foods at all, whereas some states and territories permit the sale of red foods twice per term. WA schools are also required to restrict the availability of amber savoury commercial products to ≤2 days each week. These stringent and quantifiable targets have been in place for over a decade, indicating that setting a clear expectation to school canteens about the foods and drinks they should provide actually improves compliance, despite the need for schools to reach more stringent targets overall.

Limitations and strengths

Several limitations should be considered when interpreting the present study’s findings. First, the study included only a small proportion of government schools in WA (17 %), so the results are not necessarily generalisable to all WA government schools and may not be generalisable to Catholic or independent schools. Second, many schools in WA (particularly regional schools) do not have a canteen but may instead run other food-related initiatives such as a school breakfast club or lunch programme. While these programmes are still expected to comply with the HFD policy, it was outside the scope of the current evaluation to assess compliance in these settings. Additionally, the present study evaluated only the canteen-related components of compliance and did not assess adherence to other aspects of the HFD policy such as avoiding the provision of red foods to students at school events and in class.

Third, the menus included in the present analysis were sourced online. Not all schools with a canteen have a website or Facebook page, and those with an online presence may not have their menu available for download. Although there were no significant differences by school type and geographical location between schools included in the analysis and all schools for which a menu was sought, it is possible that there were systematic differences in other school characteristics that were not included in the analysis. Unpublished data from WASCA indicate that in 2013, 75 % of government schools had a canteen. This differs from the 48 % of the searched government schools for which an online canteen menu could be located. Schools that have menus freely available online may be those that are more compliant with the HFD policy and therefore the results of the study may overestimate true compliance with the policy. Future research in this area should look to use additional strategies to increase the sample of menus included in the analysis, such as by contacting schools and asking them to submit menus.

Fourth, schools could have failed to include on their menus the full range of items offered for sale. For example, additional recess items may be available at the point of sale or a wider range of drinks may be offered than included on the menu. As schools are aware that they are being monitored for their compliance with the policy, the foods and drinks least likely to be listed on the menu are those that are unhealthy, which may mean that the true proportion of red items on WA canteen menus has been underestimated.

The major strength of the present study was the methodology used to assess school canteen compliance with the HFD policy. Canteen menu audits have been found to be an accurate method of assessing canteen compliance with healthy food and drink policies, particularly when compared with self-report measures( Reference Reilly, Nathan and Wolfenden 25 ). Self-report measures may be subject to a social desirability bias, which is the tendency for respondents to give answers they believe the researcher desires( Reference Villasenor, Cadmus-Bertram and Patterson 35 ). Collecting menus online may have reduced the impact of selection bias( Reference Delgado-Rodriguez and Llorca 36 ), thus potentially explaining some of the difference between the audit results and the outcomes of previous self-report surveys( Reference Pettigrew, Donovan and Jalleh 22 , Reference Pettigrew, Talati and Sauzier 23 ). School representatives who choose to complete and return a voluntary survey documenting their school’s compliance with the HFD policy are likely to have a greater interest in health and nutrition and a stronger motivation to follow the policy compared with those who choose not to participate in such a survey.

Conclusions

The present study found a sample of WA government school menus to be highly compliant with the requirements of the HFD policy to include ≥60 % green items and ≤40 % amber items. While a large proportion of menus included red items, the actual number of red items identified was very low. Providing schools with specific guidance about the categorisation of red items commonly appearing on canteen menus thus has the potential to dramatically improve compliance rates. Given the lower adherence of secondary-school canteen menus to the HFD policy across multiple aspects of compliance, secondary schools may need to be provided with additional resources and services that take account of the unique barriers they face compared with other school settings.

Acknowledgements

Acknowledgements: The authors acknowledge the support of Zenobia Talati and Michelle Jongenelis in providing advice on the manuscript. Financial support: The Western Australia Department of Health funds the Western Australian School Canteen Association (Inc). to implement and evaluate the Western Australian Healthy Food and Drink Policy. Conflict of interest: M.S. and A.F. are employed by the Western Australian School Canteen Association (Inc.), and G.M. and S.P. are employed in a university research unit contracted to evaluate the Healthy Food and Drink Policy. Authorship: M.S. and S.P. conceptualised the study; G.M. collected menus online, performed data analysis and took primary responsibility for preparing the manuscript; M.S. and A.F. coded menus and provided technical advice on the policy; and S.P. assisted with the preparation of the manuscript. All authors approved the final manuscript. Ethics of human subject participation: This study was approved by the Curtin University Human Research Ethics Committee (approval number HRE2016-0140-04). Permission to conduct the project was also granted by the Department of Education Western Australia.

References

1. da Silveira, JA, Taddei, JA, Guerra, PH et al. (2013) The effect of participation in school-based nutrition education interventions on body mass index: a meta-analysis of randomized controlled community trials. Prev Med 56, 237243.Google Scholar
2. Van Cauwenberghe, E, Maes, L, Spittaels, H et al. (2010) Effectiveness of school-based interventions in Europe to promote healthy nutrition in children and adolescents: systematic review of published and ‘grey’ literature. Br J Nutr 103, 781797.Google Scholar
3. Wang, D & Stewart, D (2013) The implementation and effectiveness of school-based nutrition promotion programmes using a health-promoting schools approach: a systematic review. Public Health Nutr 16, 10821100.Google Scholar
4. National Health and Medical Research Council (2013) Australian Dietary Guidelines. Canberra: NHMRC.Google Scholar
5. Cleland, V, Worsley, A & Crawford, D (2004) What are grade 5 and 6 children buying from school canteens and what do parents and teachers think about it? Nutr Diet 61, 145150.Google Scholar
6. Budd, GM & Volpe, SL (2006) School-based obesity prevention: research, challenges, and recommendations. J Sch Health 76, 485495.Google Scholar
7. Driessen, CE, Cameron, AJ, Thornton, LE et al. (2014) Effect of changes to the school food environment on eating behaviours and/or body weight in children: a systematic review. Obes Rev 15, 968982.Google Scholar
8. Jaime, PC & Lock, K (2009) Do school based food and nutrition policies improve diet and reduce obesity? Prev Med 48, 4553.Google Scholar
9. Cullen, KW, Watson, K, Zakeri, K et al. (2006) Exploring changes in middle-school student lunch consumption after local school food service policy modifications. Public Health Nutr 9, 814820.Google Scholar
10. Hawkes, C, Jewell, J & Allen, K (2013) A food policy package for healthy diets and the prevention of obesity and diet-related non-communicable diseases: the NOURISHING framework. Obes Rev 14, 159168.Google Scholar
11. World Health Organization (2008) School Policy Framework: Implementation of the WHO Global Strategy on Diet, Physical Activity and Health. Geneva: WHO.Google Scholar
12. Wu, JHY, Berg, J & Neeson, M (2016) Overview of development and implementation of school canteen nutrition guidelines in Australia. J Home Econ Inst Aust 23, 210.Google Scholar
13. Stylianou, M & Walker, JL (2018) An assessment of Australian school physical activity and nutrition policies. Aust N Z J Public Health 42, 1621.Google Scholar
14. Commonwealth of Australia (2014) National Healthy School Canteens: Guidelines for Healthy Foods and Drinks Supplied in School Canteens. Canberra: Commonwealth of Australia.Google Scholar
15. Department of Education Western Australia (2014) Healthy Food and Drink Policy and Procedures. Perth: Department of Education WA.Google Scholar
16. Woods, J, Bressan, A, Langelaan, C et al. (2014) Australian school canteens: menu guideline adherence or avoidance? Health Promot J Aust 25, 110115.Google Scholar
17. Yoong, SL, Nathan, NK, Wyse, RJ et al. (2015) Assessment of the school nutrition environment: a study in Australian primary school canteens. Am J Prev Med 49, 215222.Google Scholar
18. Hills, A, Nathan, N, Robinson, K et al. (2015) Improvement in primary school adherence to the NSW Healthy School Canteen Strategy in 2007 and 2010. Health Promot J Aust 26, 8992.Google Scholar
19. Nathan, N, Yoong, SL, Sutherland, R et al. (2016) Effectiveness of a multicomponent intervention to enhance implementation of a healthy canteen policy in Australian primary schools: a randomised controlled trial. Int J Behav Nutr Phys Act 13, 106.Google Scholar
20. de Silva-Sanigorski, A, Breheny, T, Jones, L et al. (2011) Government food service policies and guidelines do not create healthy school canteens. Aust N Z J Public Health 35, 117121.Google Scholar
21. Catholic Education Commission of Western Australia (2013) Healthy Food and Drink Choices. Perth: Catholic Education Commission of WA.Google Scholar
22. Pettigrew, S, Donovan, RJ, Jalleh, G et al. (2013) Predictors of positive outcomes of a school food provision policy in Australia. Health Promot Int 29, 317327.Google Scholar
23. Pettigrew, S, Talati, Z, Sauzier, M et al. (2018) Stakeholder perceptions of a school food policy ten years on. Public Health Nutr 21, 13701374.Google Scholar
24. Nathan, N, Wolfenden, L, Morgan, PJ et al. (2013) Validity of a self-report survey tool measuring the nutrition and physical activity environment of primary schools. Int J Behav Nutr Phys Act 10, 75.Google Scholar
25. Reilly, K, Nathan, N, Wolfenden, L et al. (2016) Validity of four measures in assessing school canteen menu compliance with state-based healthy canteen policy. Health Promot J Aust 27, 215221.Google Scholar
26. Dick, M, Lee, A, Bright, M et al. (2012) Evaluation of implementation of a healthy food and drink supply strategy throughout the whole school environment in Queensland state schools, Australia. Eur J Clin Nutr 66, 11241129.Google Scholar
27. New South Wales Department of Health (2006) NSW Healthy School Canteen Strategy Evaluation Report 2005. Sydney: NSW Department of Health.Google Scholar
28. Department of Education Western Australia (2017) School Lists. http://det.wa.edu.au/schoolinformation/detcms/navigation/school-lists/ (accessed July 2017)Google Scholar
29. Federation of Canteens in Schools Inc. (2017) FOCiS Product Registration Program: Food Industry Handbook. East Perth: FOCiS.Google Scholar
30. Western Australian School Canteen Association (Inc.) (2018) Canteens. https://www.waschoolcanteens.org.au/canteens/ (accessed February 2019).Google Scholar
31. Western Australia School Canteen Association (Inc.) (2017) Star Choice Buyers Guide January 2017. East Perth: WASCA.Google Scholar
32. Reilly, KL, Nathan, N, Wiggers, J et al (2018) Scale up of a multi-strategic intervention to increase implementation of a school healthy canteen policy: findings of an intervention trial. BMC Public Health 18, 860.Google Scholar
33. Ardzejewska, K, Tadros, R & Baxter, D (2012) A descriptive study on the barriers and facilitators to implementation of the NSW (Australia) Healthy School Canteen Strategy. Health Educ J 72, 136145.Google Scholar
34. Drummond, C & Sheppard, L (2011) Examining primary and secondary school canteens and their place within the school system: a South Australian study. Health Educ Res 26, 739749.Google Scholar
35. Villasenor, A, Cadmus-Bertram, L & Patterson, RE (2017) Overview of nutritional epidemiology. In Nutrition in the Prevention and Treatment of Disease, 4th ed., pp. 145–166 [AM Coulston, CJ Boushey, MG Ferruzzi et al., editors]. London: Academic Press.Google Scholar
36. Delgado-Rodriguez, M & Llorca, J (2004) Bias. J Epidemiol Community Health 58, 635641.Google Scholar
Figure 0

Table 1 Characteristics of schools with online canteen menus included in the sample, Western Australia, July 2017

Figure 1

Table 2 Proportions of green, amber and red items on online canteen menus (n 136) by school type, Western Australia, July 2017

Figure 2

Table 3 Proportions of green, amber and red items on online canteen menus (n 136) by school location, Western Australia, July 2017

Figure 3

Table 4 Red food and drink items featuring on online canteen menus (n 65), Western Australia, July 2017