Hostname: page-component-586b7cd67f-t8hqh Total loading time: 0 Render date: 2024-11-23T21:38:47.110Z Has data issue: false hasContentIssue false

Development and evaluation of the Food Bank Health and Nutrition Assessment

Published online by Cambridge University Press:  30 January 2023

Cassandra J Nguyen*
Affiliation:
Nutrition Department, University of California, Davis, Davis, CA, USA
Caitlin Kownacki
Affiliation:
Office of Extension and Outreach, University of Illinois at Urbana-Champaign, Urbana, IL, USA
Veronica Skaradzinski
Affiliation:
Office of Extension and Outreach, University of Illinois at Urbana-Champaign, Urbana, IL, USA
Kaitlyn Streitmatter
Affiliation:
Office of Extension and Outreach, University of Illinois at Urbana-Champaign, Urbana, IL, USA
Stephanie Acevedo
Affiliation:
Office of Extension and Outreach, University of Illinois at Urbana-Champaign, Urbana, IL, USA
Stephen D Ericson
Affiliation:
Feeding Illinois, Geneva, IL, USA
Jessica E Hager
Affiliation:
Feeding America, Chicago, IL, USA
Jennifer McCaffrey
Affiliation:
Office of Extension and Outreach, University of Illinois at Urbana-Champaign, Urbana, IL, USA
*
*Corresponding author: Email [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Objective:

Efforts to improve the nutritional quality and health promotion in the charitable food system have been undertaken. Though methods exist to track these efforts in terms of food banks’ inventory, there are not research-tested tools to assess, monitor and influence policy, systems and environmental (PSE) changes. The study objective was to develop and evaluate a novel assessment tool that could be used to evaluate a food bank’s efforts to improve the promotion of health and nutritious foods.

Design:

The study had five phases: (1) initial development; (2) iterative review and revisions; (3) pilot testing; (4) content validity assessment and (5) inter-rater and test-retest assessment. The Food Bank Health and Nutrition Assessment (FB-HANA) was drafted after reviewing existing policies, nutrition-focused charitable food systems guidance and similar tools for food pantries.

Setting:

Midwestern United States.

Participants:

Eleven food banks.

Results:

Stakeholders and pilot testers provided initial feedback to refine the FB-HANA’s flow, ease of completion and collection of contextual information. External experts rated the FB-HANA and each of the eight objectives as content valid. A set of two assessments completed by twenty-six community-based professionals, employed by Extension and fourteen food bank staff across eleven food banks, supported moderate to excellent inter-rater and test-retest reliability for the FB-HANA overall and each of its objectives.

Conclusions:

Evidence suggests that the FB-HANA can be used by either food bank or community-based professionals, such as Extension staff, to provide a perspective on ways food banks promote health and nutrition through PSE approaches.

Type
Research Paper
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2023. Published by Cambridge University Press on behalf of The Nutrition Society

Attaining and maintaining a healthy diet is considerably difficult for the millions of people in the USA who experience food insecurity, defined by the US Department of Agriculture as an economic and social condition of limited or uncertain access to adequate food(Reference Coleman-Jensen, Rabbitt and Gregory1). The likelihood of experiencing food insecurity is unevenly distributed across the population. As a product of historical and modern policies and practices, African American, Latino and Native American individuals experience food insecurity at higher rates than non-Hispanic white adults(Reference Coleman-Jensen, Rabbitt and Gregory1,Reference Nikolaus, Johnson and Benally2) . The US government has several efforts, such as the Supplemental Nutrition Assistance Program (SNAP)(3), which attempt to address food insecurity. However, some households experiencing food insecurity do not meet eligibility criteria for federal programs, or for those who do, the benefits are at times insufficient to address the households’ food needs(Reference Waxman, Joo and Gonzalez4). In response to these gaps in the social safety net, non-governmental private organisations – broadly termed the charitable food system – have arisen to distribute foods to individuals with unmet needs.

The charitable food system in the USA is composed of organisations with storage warehouses (i.e. food banks) that often accept all types and sizes of food donations, purchase large quantities of food and receive food from federal programs. Food banks then re-distribute the food through consumer-facing sites (e.g. food pantries, shelves, soup kitchens, programs, etc.). Consumer-facing sites then make groceries or hot meals available to individuals (commonly referred to as neighbours, guests or clients). This system serves individuals and households in immediate need of food, often with minimal or no screening requirements, and is increasingly providing additional services (e.g. SNAP application assistance, referral to community health services) aimed at addressing systemic and longer term needs(Reference Martin5).

Developed largely in the 1980s in the USA, this system was originally referred to as the ‘emergency food system’ to reflect the short-term supply of food distributed to households(Reference Poppendieck6). However, there is increasing evidence of long-term use among food pantry clientele(Reference Kaiser and Cafer7,Reference Kicinski8) . Today, the largest non-profit network of food banks in the USA, Feeding America, includes 200 food banks and 60 000 food pantries and meal programs across the country to support the needs of individuals and families(9). An estimated 20 % of households in a nationally representative sample were served by the charitable food system in 2020(Reference Waxman, Gupta and Gonzalez10). Given that the system serves individuals at high risk of food insecurity(Reference Kaiser and Cafer7,Reference Liu, Zhang and Remley11,Reference Gundersen, Engelhard and Hake12) and provides a non-negligible portion of users’ diets(Reference Liu, Desmond and Wright13Reference Mousa and Freeland-Graves15), the charitable food system is an opportune setting for nutrition-related programming, as well as efforts to meet individuals’ cultural food needs and preferences.

There are notable critiques of the charitable food system’s historical and, in some cases, current efforts to provide services that promote food security and nutrition. Assessments of food pantry inventories have indicated shortfalls of key nutrients and food groups(Reference Simmet, Depa and Tinnemann16). However, it is important to note this low quality of foods may be a reflection of the broader US food system and supply priorities, and a by-product of the charitable food system’s reliance on donated foods. Though actors in the charitable food system increasingly recognise health promotion, equity and nutrition as important – if not vital – parts of a food bank’s role, published estimates suggest a minority of food banks have formal nutrition policies(Reference Wetherill, White and Seligman17). Nutrition policies are one tool for food banks to develop decision markers for food donations, purchasing or data collection.

Food banks and food pantries face the challenge of persistent variability in the quantity, quality and type of foods received through donations. This variability has consequences for the staff and volunteers needed to handle and process donations(Reference Millar, Parizeau and Fraser18). Stakeholders have noted issues of safety and appeal of perishable foods received for distribution, which may be considered inedible and necessitate disposal by food banks, pantries or clients(Reference Dave, Thompson and Svendsen-Sanchez19). Cultural relevance and usability of items distributed are also of importance. Surveys of clients have indicated that some food pantries do not have food their families like, or they do not know how to prepare the available foods(Reference Dave, Thompson and Svendsen-Sanchez19Reference Greer, Cross-Denny and McCabe21).

Despite the barriers, there are many ongoing efforts to improve the charitable food system’s policies, systems and environments (PSEs) with the aim of supporting individual and community nutrition and health. Much of the published work in this area has focused on initiatives in food pantries, as the consumer-facing side of the system. These initiatives have included efforts such as distribution of suggested donation lists(Reference Nikolaus, Laurent and Loehmer22,Reference Nikolaus, Kownacki and Darvesh23) , coordination with food policy councils(Reference Remley, Kaiser and Osso24,Reference Stluka, Moore and Eicher-Miller25) , developing nutrition-focused policies, transitioning distribution from traditional pre-packaged boxes to client-choice models(Reference Nikolaus, Laurent and Loehmer22Reference Remley, Kaiser and Osso24), incorporating wrap-around social services(Reference Remley, Kaiser and Osso24,Reference Martin, Wu and Wolff26) , partnering with the health care system(Reference Reinoso, Haut and Claffey27) and reorganising how items appear to ‘nudge’ clients towards healthier items(Reference Nikolaus, Laurent and Loehmer22Reference Remley, Kaiser and Osso24,Reference Wilson28) , among others(Reference Nikolaus, Laurent and Loehmer22,Reference Nikolaus, Kownacki and Darvesh23,Reference Martin, Wu and Wolff26) . These initiatives – many of which began within the last decade – focus on making healthier choices easy and accessible(Reference Fleischhacker, Parks and Yaroch29) and are coupled with established nutrition education programming(Reference Guthrie30).

Though not as widely documented in the literature, changes to practices and policies in food pantries have coincided with upstream initiatives undertaken by food banks(Reference Campbell, Webb and Ross31). In efforts to track and improve the nutritional quality of food banks’ inventories, a variety of nutrition ranking systems and guidelines were developed(Reference Battista Hesse, Peachey and Wang32Reference Martin, Wolff and Callahan34). In 2019, a national panel of experts convened by Healthy Eating Research (HER; a national program of the Robert Wood Johnson Foundation) developed the HER Nutrition Guidelines for the Charitable Food System to promote consistent and approachable nutrition classifications for diverse charitable food settings across the USA.(Reference Schwartz, Levi and Lott35) In addition to these national efforts to rank and shift the nutritional composition of food banks’ inventories, case studies have detailed how individual food banks have implemented incremental changes to policies and practices to focus on nutrition and well-being of their community members(Reference Swords36,Reference Rowland, Mayes and Faitak37) . A food bank in New England modified the ordering system their food pantry agency members interacted with and found that the introduction of nutrition ranking information to this system resulted in significant increases in the nutritional quality of monthly orders(Reference Martin, Xu and Schwartz38). Another food bank in New York state assessed the optimal combinations of days and volunteers to increase the amount of fresh produce they could glean from local farmers to supplement their inventory(Reference Sönmez, Lee and Gómez39). As of 2021, 20 % of the food banks in the Feeding America network reported using the HER Nutrition Guidelines for the Charitable Food System (J. Hager, personal communication, May 4, 2022). Though the HER nutrition ranking system provides a method for food banks to assess the nutrition quality of their food inventory, there have been no published methods to capture the range of supplementary practices and policies that food banks have been using to promote nutrition and health.

The current study was undertaken to address the need for a method to assess, measure and track the different strategies used by food banks to promote health and nutrition through their practices and policies. This work was started by staff affiliated with the University of Illinois Extension who are responsible for implementing SNAP-Ed in the state of Illinois and who collaborate with food banks interested in updating policies and practices to better promote nutrition and health. The objective of the current study was to develop and evaluate a novel assessment tool that could be used by food bank staff and partnering community-based professionals, such as Extension staff, in diverse settings to evaluate efforts to improve the promotion of health and nutrition in food bank settings. The study was undertaken with the expectation that the final tool could be used by SNAP-Ed implementing agencies, such as Extension and other community-based health professionals, as well as food bank staff and volunteers.

Methods

The Food Bank Health and Nutrition Assessment (FB-HANA) was developed as a tool to quantify the ways food banks promote health and nutrition among charitable food recipients through PSE approaches. The goal of completing an FB-HANA is to gain new insights about health and nutrition practices, identify areas of opportunity for action planning and to determine a baseline against which progress can be measured. The FB-HANA was created for use as a self-assessment or as a measure that external assessors could use to support food banks. Assessments were completed with a combination of site observations, review of food bank’s documents and interviewing food bank staff (if completed by an external assessor). The development and evaluation of the FB-HANA was conducted over five phases (Fig. 1): (1) initial development; (2) iterative review and revisions; (3) pilot testing; (4) content validity assessment and (5) inter-rater and test-retest assessment. The distinct steps and the stakeholders involved in each phase are described below.

Initial development

The development of the FB-HANA was initiated in November 2019 as a product of collaborative efforts between Extension staff and staff within a statewide charitable food distribution network to promote the adoption of nutrition policies by food banks in Illinois. To evaluate the effectiveness of these collaborative efforts to prompt nutrition policy adoption and implementation of related practices, staff searched for existing assessment tools. No tool was identified and staff at food banks and charitable food networks indicated their interest and need for such an assessment tool with the research team. Thus, the FB-HANA development team convened in March 2020 to create an assessment that met the needs of the IL-based nutrition policy initiative while also being usable by food banks in other states. The FB-HANA development team was composed of five Extension staff who had backgrounds in public health, social work and community nutrition and experience partnering with charitable food distribution organisations to promote nutrition and health. FB-HANA development team members generated an initial list of FB-HANA objectives and related strategies based on a review of food bank policies (five in Illinois and fifteen from other states) as well as adapted strategies from an existing assessment tool for food pantries(Reference Nikolaus, Laurent and Loehmer22,Reference Nikolaus, Kownacki and Darvesh23) .

Iterative review and revisions

To increase the breadth of the tool and ensure that it was written in terms that were relevant and understandable to a variety of audiences, the draft of the FB-HANA was sent to external stakeholders to provide feedback and suggested revisions. Stakeholders included academic faculty with expertise in community nutrition and evaluation; Extension staff with pragmatic experience working with food banks; staff at food banks that partnered with Extension and staff at charitable food distribution networks. Feedback was solicited and used to revise the draft of the FB-HANA from April 2020 to February 2021. During this phase, a faculty member with experience developing and evaluating tools to assess the nutrition environment in charitable foods organisations(Reference Nikolaus, Laurent and Loehmer22) joined the FB-HANA development team.

Pilot testing

The FB-HANA was pilot tested by Extension and food bank staff at two food banks to understand its usability in the field. One of the food banks was affiliated with Feeding America and the other food bank was affiliated with a regional food bank network. The selection of food banks in differing networks was intentionally done to determine usability in different food bank systems. The Extension and food bank staff completed the FB-HANA in-person together. Both the food bank and Extension staff were interviewed after each assessment to ask about their overall impressions of the process, challenges faced and any suggested changes to the FB-HANA. The interviewer took notes during each interview and compiled them into a summary. The summary was reviewed by the FB-HANA development team to inform additional revisions. The pilot testing phase was completed between March 2021 and April 2021.

Content validity assessment

To establish content validity, invitations were sent to practitioners and academic faculty to provide a review of the FB-HANA. Potential reviewers were identified through an email listserv of charitable food staff, publications of food banking nutrition research and existing partnerships. Reviewers were sent an electronic questionnaire to assess content validity of the FB-HANA. On this questionnaire, each objective of the FB-HANA and the overall tool was scored according to its relevance to the objective ‘To quantify ways food banks promote health and nutrition through policy, system and environmental approaches’ on a four-point scale. The scale ranged from 1 = not relevant, 2 = unable to assess relevance without item revision or item is in need of such revision that it would no longer be relevant, 3 = relevant but needs minor alterations to 4 = extremely relevant. The questionnaire also included an open-answer item for reviewers to identify their background and experience with the charitable foods sector. Reviewers were asked to return their reviews within 2 weeks of being sent the questionnaire and eight individuals returned completed content validity assessments. Responses on the four-point scale were compared with content validity index thresholds and to be considered content valid at least 80 % of reviewers needed to rate each objective and the overall tool as a 3 or above on the four-point scale(Reference Lynn40). The content validity phase was completed between April and June 2021.

Inter-rater and test-retest reliability assessment

Between June and October 2021, all food banks affiliated with Feeding America and Midwest Food Bank in Illinois were invited to participate in the reliability testing phase. Each food bank that agreed to participate in this phase was scheduled to complete two FB-HANAs, separated by 3–4 weeks. At least one Extension staff and at least one food bank staff independently completed FB-HANA documentation during each assessment. Extension staff had prior experience conducting assessments in other charitable food settings, but no training specific to the FB-HANA procedures were provided. All staff completing assessments were provided a link to the FB-HANA on the Qualtrics, LLC (Provo, UT) web-based platform 1 to 2 d in advance of the scheduled assessment. Staff were asked not to discuss content of the FB-HANA or the answers they selected with other staff. Responses were required for all scored components of the FB-HANA to ensure the reliability estimates were based on complete datasets. During each assessment, one additional Extension staff was present to serve as a ‘monitor’ to ensure that there was no discussion about selections made and any logistical questions were answered. Monitoring staff did not submit any data for the reliability estimates. The second assessment conducted 3–4 weeks after the initial assessment was completed by the same staff as the initial assessment.

Both reliability outcomes were estimated with intra-class correlation coefficients. Inter-rater reliability was calculated by comparing scores at the initial assessment produced by different staff. This comparison was made for overall FB-HANA scores and scores for each of the FB-HANA’s objectives. The intra-class correlation coefficient (ICC) for inter-rater reliability was produced from a one-way random-effects model. The one-way random-effects model was first generated based on all assessors present at the initial assessment. A second model was built based only on the Extension staff completing assessments at the initial assessment to compare the inter-rater reliability produced. Test-retest reliability was calculated by comparing FB-HANA overall scores and scores on each of the objectives produced at the two different assessments by the same staff members. The ICC for test-retest reliability was produced from a mixed effects model based on all assessors who completed both a first and second assessment at their respective food bank(s). The first model only included an ID variable for the food bank, whereas a second model was built that included a dummy variable indicating whether the assessor was an Extension staff. This second model was used to compare how assessments completed by food bank staff differed from those completed by Extension staff. Each ICC and the corresponding 95 % CI was interpreted as <0·5 = poor reliability, 0·5–0·75 = moderate reliability, 0·75–0·9 = good reliability and >0·9 = excellent reliability(Reference Koo and Li41).

Results

Initial development, iterative review and revisions

The FB-HANA development team produced a list of potential strategies and related objectives for the tool. This list was shared during meetings and via e-mail with seven stakeholders with experience working with the charitable foods system to provide feedback. The purpose of the tool was clarified during this phase, with the team deciding the goal of the assessment was to ‘provide perspective on ways food banks promote health and nutrition through policy, system and environmental approaches.’ The HER Nutrition Guidelines for the Charitable Food System were published during this phase(Reference Schwartz, Levi and Lott35) and strategies focused on equity were added after the draft of the tool was compared against the guidelines. The preliminary list of strategies was organised into eight objectives (Table 1). Each scored strategy was structured as a statement which the assessor would answer yes or no to for ease of completion. To support programmatic planning, additional information about the food bank, such as participation in a formal network, special programs and reach, sources of food and funding and external conditions were collected (but not scored) on the FB-HANA.

Table 1 Objectives and strategies in the food bank health and nutrition assessment (FB-HANA)

Note. CI = confidence interval; ICC = intra-class correlation coefficient.

ICC estimates for inter-rater reliability were produced from one-way random-effects models based on 3–5 raters at 11 food banks.

ICC estimates for test-retest reliability were produced from mixed effects models based on two assessments completed by 3–5 raters at 11 food banks.

Pilot testing

All Extension (n 2) and food bank (n 2) staff who participated in pilot testing provided feedback via interviews or e-mail correspondence. Overall, the FB-HANA was considered useful with good flow between sections and feasible to complete. Staff estimated the FB-HANA took approximately 70 min to complete but shared that almost half of this time was dedicated to finding the documents needed to provide accurate information on food and funding sources for unscored components of the FB-HANA. To improve efficiency of time used, suggestions to clarify what the assessment entails, who in the food bank should complete it and the documents which may be needed were incorporated into the cover page of the FB-HANA. Feedback led to additional clarification of terms, reasons for some data collection and an explicit acknowledgement on the FB-HANA cover page that not all strategies would be relevant for each food bank. At the end of the pilot test, the food bank staff indicated interest and eagerness to use the results to begin planning their next steps; given this, the FB-HANA was placed in a web-based surveying platform (Qualtrics), formatted for ease of completion on mobile or portable computing devices (i.e. tablets or laptops) and structured to auto-generate a report of results for users immediately upon completion.

Content validity assessment

The eight content validity reviewers included four food bank staff, one Extension staff, and three academic researchers. All reviewers rated the FB- HANA overall and objectives 1–3 and 5–8 as relevant (3 or above on 4-point scale), far exceeding the 80 % threshold required. Objective 4 was rated as relevant by most reviewers (88 %), still meeting the necessary threshold for content validity. Qualitative comments from reviewers resulted in re-ordering of objectives and strategies as well as revisions to strategy and objective wording. As one example, a strategy focused on provision of microwave recipes was updated to more general phrasing that recipes provided ‘require minimal cooking equipment.’ Additionally, four new strategies were added to increase the number of relevant practices and policies assessed.

The final version of the FB-HANA was produced after incorporating content validity feedback. All sixty-five strategies were answered with binary response of options of ‘Yes, this strategy is present at the time of the assessment’ or ‘No, this strategy is not present at the time of the assessment.’ These response options are not sensitive to strategies which are in development or generally present, but not on the day of assessment. Yet, the restrictive binary option of yes or no was selected to maximise ease of use and reliability. The full FB-HANA is freely available online on a web platform which incorporates display logic(42), and a list of the individual strategies is shown in a Supplemental Table. Of note, some strategies are organised as ‘sub-strategies’ and are displayed only if a preceding question was answered to indicate the ‘sub-strategies’ were relevant. For example, if the food bank indicates they do not have a written nutrition policy, the following twelve strategies under objective 3 are not displayed (and subsequently unaffirmed). Finally, the FB-HANA development team decided to incorporate a definition of nutritious into the instructions to create a more uniform understanding among assessors. If the food bank had a nutrition ranking system in place, this was to be used to inform the interpretation of the term nutritious used throughout the FB-HANA; if the food bank did not have a ranking system in place, items categorised as green by the HER guidelines(Reference Schwartz, Levi and Lott35) were used as the reference for what was to be considered nutritious.

Inter-rater and test-retest reliability assessment

All eleven food banks invited to participate agreed to contribute to the reliability assessment. Descriptive characteristics of these food banks based on food bank staffs’ selections for non-scored elements of the FB-HANA during the first assessment are shown in Table 2. A total of forty individuals participated as raters. There were twenty-six Extension staff serving as raters with a mean of 2·4 (0·5 sd) Extension staff completing ratings per food bank. There were fourteen food bank staff completing assessments, with a mean of 1·3 (0·5 sd) staff per food bank. Each food bank staff only assessed their own respective food bank, whereas Extension staff rated a range of 1–7 unique food banks (mean = 2·2 and sd = 2·1).

Table 2 Characteristics of food banks who participated in the inter-rater and test-retest reliability phase for the evaluation of the food bank health and nutrition assessment (FB-HANA)

Note. Estimates rely on data provided by the food bank staff at the initial assessment. In the case that >1 food bank staff member was present at the initial assessment and responses were not identical, the last response recorded was used.

The inter-rater reliability of the overall FB-HANA among all raters met the threshold for excellent reliability (Table 1), and the inter-rater reliability for individual objective scores indicated good to excellent reliability. When ICC estimates for inter-rater reliability of the overall FB-HANA score were produced from a one-way random effects model restricted to the two to three Extension staff at the initial assessments, the ICC increased to 0·96 with a narrower 95 % CI of 0·80, 0·98 (data not shown). The second assessment was completed at all food banks 3 to 5 weeks (mean = 3·9, sd = 0·6) after the initial assessment. The test-retest reliability of the overall FB-HANA when comparing first and second assessments from all raters met criteria for excellent reliability (Table 1). Test-retest reliability for individual objectives varied from moderate to excellent reliability, with the lowest ICC produced for Objective 1: Food Bank Identifies and Responds to Nutrition Needs of Communities Served and the highest produced for Objective 3: Food Bank Adopts, Implements and Shares Nutrition Policy.

A second mixed-effects model with a dummy variable indicating affiliation as Extension or food bank added was built to compare how scores differed by assessor type. Extension staff produced significantly lower FB-HANA scores (β = −1·28; 95 % CI (−2·45, −0·11); P = 0·032) than their food bank staff counterpoints. Additionally, the ICC estimate of test-retest reliability was marginally higher (ICC = 0·82) with a narrower 95 % CI of 0·65, 0·92.

Discussion

The objective of the current study was to develop and test a tool that could be used by food bank and community-based nutrition professionals to assess current practices to promote nutrition and health through PSE initiatives and monitor change over time. Findings indicate that the resulting tool, the FB-HANA has strong content validity as well as good to excellent inter-rater and test-retest reliability. Results indicate the FB-HANA can be employed directly by food banking professionals, as a self-assessment, or by external staff, such as Extension (or other SNAP-Ed implementing) staff, to guide the provision of technical assistance.

The FB-HANA can be used to initiate preparation and planning to promote nutrition and health as well as to supplement existing resources. Many of the food banks who contributed to reliability testing intended to use the results to inform organisational plans. These plans included the development and adoption of nutrition policies, distribution of surveys to staff or clients and initiation of a nutrition advisory board. Extension staff are using the assessments conducted for the reliability phase as baseline measures to evaluate the implementation of policies and practices. Results suggest these evaluations could be completed by Extension or food bank staff, given the strong test-retest reliability for the FB-HANA regardless of assessor type. However, it is worth considering that food bank staff systematically scored their food banks higher on the FB-HANA than Extension staff. Future research, particularly qualitative studies, might consider exploring what contributes to these scoring differences as well as the unique approaches that Extension and food bank staff take in planning PSE initiatives.

Planning for PSE initiatives, regardless of whether they are lead by Extension or food bank staff can be further supported by Feeding America’s Nutrition in Food Banking Toolkit(43) as well as the published case studies of other food banks’ efforts to implement changes in practices(Reference Swords36,Reference Rowland, Mayes and Faitak37) . FB-HANA evaluations and subsequent planning might also support and supplement downstream efforts to assess and improve the consumer nutrition environment in food pantries(Reference Nikolaus, Laurent and Loehmer22,Reference Nikolaus, Kownacki and Darvesh23) . In a Minnesota sample, food banks comprised an average of 50 % of food pantries’ inventories, but this varied from 3 to 99 % in the sample(Reference Nanney, Grannon and Cureton44), so complementary efforts in both food banks and food pantries are warranted.

A clear insight from the FB-HANA development process was the need for recognition and assessment of who is being served, and by whom, within the charitable food system. At the national level, young adults, women, non-Hispanic Black adults, Hispanic adults, low-income households, adults with a disability and single parents are among those most likely to need the supports of the charitable food system(Reference Waxman, Joo and Gonzalez4,Reference Waxman, Gupta and Gonzalez10) . However, there is geographic and cultural variation in characteristics of individuals of families seeking support from the charitable food system, therefore food banks and pantries are increasingly striving to reflect the cultural composition and diversity of their respective communities among their staff and volunteers as well as with the food and services offered. The need for community assessment, tailoring to community needs and representation of clientele in decision making are recommended in the Nutrition in Food Banking Toolkit(43). Thus, these considerations were incorporated into numerous strategies in the final FB-HANA. Assessments completed by food bank staff at the initial reliability assessment indicated that over half of food banks identified the diet-related conditions of concern (55 %) or sought feedback about preferred foods (73 %) among individuals served by their member agencies, but few had advisory boards which included current or former recipients of charitable food assistance (18 %; data not shown).

Another important insight from the FB-HANA development was the common practice of food banks connecting to a variety of organisations in the food system and larger community. Though speculative, food banks which have numerous, diverse connections in the community may be able to provide more variety in their food and services as well as have greater capacity to restrict or reject donated goods from a single donor source. Diverse connections may position food banks to be more nimble and adaptable to surges in charitable food reliance, such as the spike in need in 2020 as a result of the COVID-19 pandemic(Reference Waxman, Gupta and Gonzalez10). Future climate or public health emergencies may cause similar rapid increases in charitable food system reliance. Food banks may be positioned to adapt to disruptions in the food system by adopting a nutrition policy, which can guide the use of funds to purchase foods. These hypotheses should be tested in future observational studies assessing how food bank characteristics relate to PSE initiatives.

Notably, there are factors upstream of the food bank which can impact the food bank’s ability to promote nutrition and health. For example, national and state-level policies that impact the ability of farmers to sell or donate produce can act as an incentive or deterrent to improving the charitable food system’s quality of foods(Reference Osland and Baker45). Gleaning un-harvested foods from farmers’ fields is not commonly reported by food banks(Reference Millar, Parizeau and Fraser18), but food banks expanding their presence and connection to farmers, gardeners and other community members can help optimise the ability of gleaning to contribute nutritious fresh produce(Reference Sönmez, Lee and Gómez39). Though challenges to transporting, storing and distributing perishable foods in the charitable food system will need to be taken into consideration(Reference Osland and Baker45Reference Levi, Schwartz and Campbell47).

Though tools like the FB-HANA and the corresponding instrument for food pantry settings, the Nutrition Environment Food Pantry Assessment Tool(Reference Nikolaus, Laurent and Loehmer22), have a role in supporting the nutrition and health promotion in the charitable foods system, there are inherent issues related to justice and equity within the system. For many, there is stigma associated with eating donated food, though still healthy and safe, which otherwise may have been discarded(Reference Millar, Parizeau and Fraser18). Volunteers often far outnumber staff in organisations within the charitable food system(Reference Mousa and Freeland-Graves15), which can result in unstable or unpredictable labour. Further, food pantry clientele are often not represented among leaders in the charitable food system(Reference Cooksey Stowers, Marfo and Gurganus48). This may, in part, explain why results of a recent qualitative study found that stakeholders wrongly perceived the charitable food system as contributing only negligibly to clients’ diets overall(Reference Cooksey Stowers, Marfo and Gurganus48). In response to these structural inequities, some food banks have shifted to community-hub models where redistributing food is supplemented with additional activities, such as a Speaker’s Bureau which focuses on leadership development and advocacy among food pantry clientele(Reference Swords36), incorporation of a milk bank, policy change advocacy and benefits enrollment support(Reference Strickland and Whitman49). Though the research team incorporated many of these innovations into strategies in the FB-HANA, additional efforts outside of the charitable food system are likely needed to address food access inequities.

Limitations

The current research study is not without limitations. The sample of food banks who participated in reliability testing for the FB-HANA were limited to four midwestern states. These states may employ policies and practices which are systematically different than those used by food banks in other regions. Fortunately, content validity reviewers had experience with food banking practices in states outside this region, which may have resulted in a greater variety of strategies being added to the final FB-HANA prior to reliability testing. Nonetheless, future studies which draw data from food banks across the USA would be valuable to characterisze practices in different settings and could provide valuable data to assess floor or ceiling effects within the measure. Though the overall FB-HANA scores had evidence of excellent reliability, individual objectives’ reliability estimates were lower. This variation in reliability was likely related to the lack of formal training needed for the FB-HANA and may improve with additional training. One final limitation is that results do not provide insight into how policies and practices may relate to downstream nutrition or health effects among clients of the charitable food system. Additional research will be needed to investigate whether food banking policies and practices translate to outcomes among food pantry clientele.

Fig. 1 Five phases and timeline of food bank-health and nutrition assessment (FB-HANA) development and evaluation

Conclusions

Evidence suggests that the FB-HANA is a content valid tool with adequate inter-rater and test-retest reliability that can provide insights on how food banks promote health and nutrition through PSE approaches. Furthermore, the FB-HANA can be used by both food bank and external staff. Early informal results suggested that the FB-HANA can be used to initiate conversations related to policy adoption and practice changes, contributing to the evolution of the charitable food system to better meet needs of clientele by promoting nutrition, health and equity.

Acknowledgements

Acknowledgements: The authors would like to express their sincere gratitude to all individuals for the time, effort and expertise they contributed to the FB-HANA development, including those who provided feedback during the iterative review, provided feedback during the content validity review, participated in pilot testing and/or participated in reliability testing: Wayne Cannon – Peoria Area Food Bank, Central Illinois Food Bank, Rick Crump – Greater Chicago Food Depository, Jenny Duez – Saint Louis Area Food Bank, Andrea Hensgen – Sauk Valley Foodbank, Tara Ingham – Midwest Food Bank, Michael Miller – River Bend Food Bank, Sharon McNeal, Liz Gentile, and Jacqui Hebein – Northern Illinois Food Bank, Heather Owens and Glenn Roberts – Tri-State Food Bank, Monica Scheuer – Midwest Food Bank, Emily Yoder – Eastern Illinois Foodbank, Kathryn Bernstein, Kelly Brasseur, Laura Held, Brenda Davis Koester, Dana Mitchel, Stephanie Staley, Marianna Wetherill, and University of Illinois field staff Akinwale Akingbule, Dominique Cobbs, Stace Coussens, Carol Erickson, Joey Fonseca-Islas, Katrina Galati, Ashley Hoffman, Dale Kehr, Tayler Louscher, Susan Glassman, Nayaab Sattar, Kayla Swaar, Shirley Vouris and Toni Kay Wright and others who wish to remain anonymous. Financial support: This work is supported by the Supplemental Nutrition Assistance Program – Education (SNAP Ed) in Illinois. Authorship: C.J.N., C.K. and J.M. conceptualised the study. C.J.N. designed the research approach and analysed the data. C.J.N., C.K., V.S., K.S., S.A., S.E. and J.H. facilitated data collection procedures and processes. C.J.N. wrote the paper. All authors provided substantial revisions prior to reading and approving the final manuscript. Ethics of human subject participation: The described study is not human subjects’ research as the focus is on policies and procedures used by organisations, not on individuals or how they perceive policies and procedures used by organisations affect them.

Conflicts of interest:

None of the authors declare conflicts of interest or financial benefit from the results of this study.

Supplementary material

For supplementary material accompanying this paper visit https://doi.org/10.1017/S1368980023000204

References

Coleman-Jensen, A, Rabbitt, MP, Gregory, CA et al. (2021) Household Food Security in the United States in 2020. Washington, DC: U.S. Department of Agriculture, Economic Research Service.Google Scholar
Nikolaus, CJ, Johnson, S, Benally, T et al. (2022) Food insecurity among American Indian and Alaska native people: a scoping review to inform future research and policy needs. Adv Nutr 13, 15661583.CrossRefGoogle ScholarPubMed
United States Department of Agriculture (2018) SNAP Fact Sheet. https://www.usda.gov/sites/default/files/documents/snap_fact_sheet.pdf (accessed February 2023).Google Scholar
Waxman, E, Joo, N & Gonzalez, D (2019) Who is Accessing Charitable Food in America? Washington, DC: Urban Institute.Google Scholar
Martin, KS (2021) Reinventing Food Banks and Pantries: New Tools to End Hunger. Washington, DC: Island Press.Google Scholar
Poppendieck, J (1994) Dilemmas of emergency food: a guide for the perplexed. Agric Hum Values 11, 6976.CrossRefGoogle Scholar
Kaiser, ML & Cafer, AM (2017) Exploring long-term food pantry use: differences between persistent and prolonged typologies of use. J Hunger Environ Nutr 12, 4663.CrossRefGoogle Scholar
Kicinski, LR (2012) Characteristics of short and long-term food pantry users. Mich Sociol Assoc 26, 5874.Google Scholar
Waxman, E, Gupta, P & Gonzalez, D (2021) Charitable Food Use Increased Nearly 50 Percent from 2019 to 2020. Washington, DC: Urban Institute.Google Scholar
Liu, Y, Zhang, Y, Remley, DT et al. (2019) Frequency of food pantry use is associated with diet quality among Indiana food pantry clients. J Acad Nutr Diet 119, 17031712.CrossRefGoogle ScholarPubMed
Gundersen, C, Engelhard, E & Hake, M (2017) The determinants of food insecurity among food bank clients in the United States. J Consum Aff 51, 501518.CrossRefGoogle Scholar
Liu, Y, Desmond, NE, Wright, BN et al. (2021) Nutritional contributions of food pantries and other sources to the diets of rural, Midwestern food pantry users in the USA. Br J Nutr 125, 891901.CrossRefGoogle Scholar
Verpy, H, Smith, C & Reicks, M (2003) Attitudes and behaviors of food donors and perceived needs and wants of food shelf clients. J Nutr Educ Behav 35, 615.CrossRefGoogle ScholarPubMed
Mousa, TY & Freeland-Graves, JH (2017) Organizations of food redistribution and rescue. Public Health 152, 117122.CrossRefGoogle ScholarPubMed
Simmet, A, Depa, J, Tinnemann, P et al. (2017) The nutritional quality of food provided from food pantries: a systematic review of existing literature. J Acad Nutr Diet 117, 577588.CrossRefGoogle ScholarPubMed
Wetherill, MS, White, KC & Seligman, H (2019) Charitable food as prevention: food bank leadership perspectives on food banks as agents in population health. Community Dev 50, 92107.CrossRefGoogle Scholar
Millar, S, Parizeau, K & Fraser, EDG (2020) The limitations of using wasted food to “feed hungry people”. J Hunger Environ Nutr 15, 574584.CrossRefGoogle Scholar
Dave, JM, Thompson, DI, Svendsen-Sanchez, A et al. (2017) Development of a nutrition education intervention for food bank clients. Health Promot Pract 18, 221228.CrossRefGoogle ScholarPubMed
Bertmann, F, Rogomentich, K, Belarmino, EH et al. (2021) The food bank and food pantries help food insecure participants maintain fruit and vegetable intake during COVID-19. Front Nutr 8, 673158.CrossRefGoogle ScholarPubMed
Greer, AE, Cross-Denny, B, McCabe, M et al. (2016) Giving economically disadvantaged, minority food pantry patrons’ a voice: implications for equitable access to sufficient, nutritious food. Fam Community Health 39, 199206.CrossRefGoogle ScholarPubMed
Nikolaus, CJ, Laurent, E, Loehmer, E et al. (2018) Nutrition environment food pantry assessment tool (NEFPAT): development and Evaluation. J Nutr Educ Behav 50, 724728.CrossRefGoogle ScholarPubMed
Nikolaus, CJ, Kownacki, C, Darvesh, Z et al. (2021) Technical assistance is related to improvements in the food pantry consumer nutrition environment. J Nutr Educ Behav 53, 742750.CrossRefGoogle ScholarPubMed
Remley, DT, Kaiser, ML & Osso, T (2013) A case study of promoting nutrition and long-term food security through choice pantry development. J Hunger Environ Nutr 8, 324336.CrossRefGoogle Scholar
Stluka, S, Moore, L, Eicher-Miller, HA et al. (2018) Voices for food: methodologies for implementing a multi-state community-based intervention in rural, high poverty communities. BMC Public Health 18, 1055.CrossRefGoogle ScholarPubMed
Martin, KS, Wu, R, Wolff, M et al. (2013) A novel food pantry program: food security, self-sufficiency, and diet-quality outcomes. Am J Prev Med 45, 569575.CrossRefGoogle ScholarPubMed
Reinoso, D, Haut, D, Claffey, S et al. (2022) Addressing food insecurity: lessons learned from co-locating a food pantry with a federally qualified health center. Int J Integr Care 22, 24.CrossRefGoogle ScholarPubMed
Wilson, N (2016) When the cupboards are bare: nudging food pantry clients to healthier foods. J Assoc Consum Res 1, 125133.CrossRefGoogle Scholar
Fleischhacker, S, Parks, CA & Yaroch, AL (2019) Addressing food insecurity in the United States: the role of policy, systems changes, and environmental supports. Transl Behav Med 9, 827836.CrossRefGoogle ScholarPubMed
Guthrie, JF (2017) Integrating behavioral economics into nutrition education research and practice. J Nutr Educ Behav 49, 700705.CrossRefGoogle ScholarPubMed
Campbell, E, Webb, K, Ross, M et al. (2015) Nutrition-Focused Food Banking. Washington, DC: Institute of Medicine.CrossRefGoogle Scholar
Battista Hesse, M, Peachey, A & Wang, D (2019) Establishing a three-tier color-coded approach to categorize the nutrient density of food bank foods. SAGE Open 9.CrossRefGoogle Scholar
Seidel, M, Laquatra, I, Woods, M et al. (2015) Applying a nutrient-rich foods index algorithm to address nutrient content of food bank food. J Acad Nutr Diet 115, 695700.CrossRefGoogle ScholarPubMed
Martin, KS, Wolff, M, Callahan, K et al. (2019) Supporting wellness at pantries: development of a nutrition stoplight system for food banks and food pantries. J Acad Nutr Diet 119, 553559.CrossRefGoogle ScholarPubMed
Schwartz, M, Levi, R, Lott, M et al. (2020) Healthy Eating Research Nutrition Guidelines for the Charitable Food System. Durham, NC: Healthy Eating Research.Google Scholar
Swords, A (2019) Action research on organizational change with the food bank of the Southern Tier: a regional food bank’s efforts to move beyond charity. Agric Hum Values 36, 849865.CrossRefGoogle Scholar
Rowland, B, Mayes, K, Faitak, B et al. (2018) Improving health while alleviating hunger: best practices of a successful hunger relief organization. Curr Dev Nutr 2, nzy057.CrossRefGoogle ScholarPubMed
Martin, K, Xu, R & Schwartz, MB (2020) Food pantries select healthier foods after nutrition information is available on their food bank’s ordering platform. Public Health Nutr 24, 18.Google ScholarPubMed
Sönmez, E, Lee, D, Gómez, MI et al. (2015) Improving food bank gleaning operations: an application in New York State. Am J Agric Econ 98, 549563.CrossRefGoogle Scholar
Lynn, MR (1986) Determination and quantification of content validity. Nurs Res 35, 382386.CrossRefGoogle ScholarPubMed
Koo, TK & Li, MY (2016) A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med 15, 155163.CrossRefGoogle ScholarPubMed
Illinois Extension (2022) FB-HANA: Food Bank Health and Nutrition Assessment. https://go.illinois.edu/FB-HANA (accessed October 2022).Google Scholar
Feeding America (2021) Nutrition in Food Banking Toolkit. https://hungerandhealth.feedingamerica.org/resource/nutrition-in-food-banking-toolkit/ (accessed February 2023).Google Scholar
Nanney, MS, Grannon, KY, Cureton, C et al. (2016) Application of the Healthy Eating Index-2010 to the hunger relief system. Public Health Nutr 19, 29062914.CrossRefGoogle Scholar
Osland, TJ & Baker, GA (2020) Fresh produce donations in California: opportunities for and challenges to increasing volume and reducing food insecurity. J Food Distrib Res 51.Google Scholar
Yan, S, Caspi, C, Trude, ACB et al. (2020) How urban fo od pantries are stocked and food is distributed: food pantry manager perspectives from Baltimore. J Hunger Environ Nutr 15, 113.Google Scholar
Levi, R, Schwartz, M, Campbell, E et al. (2022) Nutrition standards for the charitable food system: challenges and opportunities. BMC Public Health 22, 495.CrossRefGoogle ScholarPubMed
Cooksey Stowers, K, Marfo, NYA, Gurganus, EA et al. (2020) The hunger-obesity paradox: exploring food banking system characteristics and obesity inequities among food-insecure pantry clients. PLoS ONE 15, e0239778.CrossRefGoogle ScholarPubMed
Strickland, K & Whitman, JR (2019) Beyond food distribution: the context of food bank innovation in Alabama. J Hunger Environ Nutr 15, 553573.CrossRefGoogle Scholar
Figure 0

Table 1 Objectives and strategies in the food bank health and nutrition assessment (FB-HANA)

Figure 1

Table 2 Characteristics of food banks who participated in the inter-rater and test-retest reliability phase for the evaluation of the food bank health and nutrition assessment (FB-HANA)

Figure 2

Fig. 1 Five phases and timeline of food bank-health and nutrition assessment (FB-HANA) development and evaluation

Supplementary material: File

Nguyen et al. supplementary material

Nguyen et al. supplementary material

Download Nguyen et al. supplementary material(File)
File 37.2 KB