The current number of people suffering from undernutrition globally is estimated at 852 million, with a third of these in sub-Saharan Africa alone(1). Although some of these countries report to have adequate food at the national level, this does not guarantee food security at the household level. Yet most of the studies using household food insecurity measures have been conducted in developed countries where the prevalence of food insecurity is relatively lowReference Nord, Andrews and Carlson(2, Reference Vozoris and Tarasuk3).
Food security is a complex issue; it is defined as ‘a state where all people, at all times, have physical and economic access to sufficient, safe and nutritious food to meet their dietary needs and food preferences for an active and healthy life’(4). The demand for an instrument to measure food insecurity in a simple but valid and reliable manner is high. It is needed by policy-makers, researchers and programme officers trying to target, monitor and evaluate interventions and policy measures aimed at improving food security. However, before approaching the subject of prevalence and determinants of food insecurity in developing countries, the problem of measurement must be adequately addressed.
Most developing countries still rely on aggregate data using food balance sheets and early-warning systems that do not necessarily provide adequate information on household-level food securityReference Quinn and Kennedy(5). The use of household perceptions of food needs and coping strategies as an alternative indicator in measuring food insecurity has proved to be a good and cost-effective methodReference Maxwell, Ahiadeke, Levin, Armar-Klemesu, Zakariah and Lamptey(6). Radimer and colleagues have utilised these food insecurity perceptions by developing a ‘hunger index’ through qualitative interviews with women from low-income householdsReference Radimer, Olson, Greene, Campbell and Habicht(7). These indices have proved to be valid and reliable in the context for which they were developedReference Radimer, Olson, Greene, Campbell and Habicht(7, Reference Kendall, Olson and Frongillo8) and also in some developing countries where they have been usedReference Studdert, Frongillo and Valois(9–Reference Sharif and Khor12). However, there are indications that validated measurements may vary in their performance across different population groups and culturesReference Wilde(13–Reference Coates, Frongillo, Rogers, Webb, Wilde and Houser15). Also, cut-off points used to identify ‘at-risk’ or ‘affected’ households can result in inaccurate estimates without proper renaming, as scores that are numerically identical may have different severity meanings across culturesReference Coates, Frongillo, Rogers, Webb, Wilde and Houser(15).
The objective of the present study was to assess the construct validity, criterion-related validity and internal consistency of the Radimer/Cornell food insecurity measure for use in rural Kilimanjaro, Tanzania.
Methods
Location
A more detailed description of the area has been provided elsewhereReference Klouman, Masenga, Klepp, Sam, Nkya and Nkya(16, Reference Mmbaga, Hussain, Leyna, Klouman, Masenga, Sam, Mnyika and Klepp17). In brief, Oria village is part of Kahe Ward in Moshi rural district, located at the foot of Mount Kilimanjaro about 30 km south of the regional administrative capital, Moshi. The village has a weekly market where a wide variety of commodities are sold. The market is used by local and neighbouring villagers as well as business persons from Moshi.
Subjects
Of the 2093 inhabitants aged 15–44 years who were invited to participate in the study, 1528 (73·0 %) agreed. Lack of permanent address in the village was the only exclusion criterion. The present analysis is restricted to data from women aged 15–44 years with children under 5 years old (n = 530). The population mainly consisted of peasants who grow maize, paddy and vegetables, petty businessmen selling agricultural products and fish, and a few employed individuals. Most of the villagers were also involved in farm and non-farm labour to supplement their income.
Instrument adaptation
A nine-item Radimer/Cornell food insecurity measure (Table 1) was translated to Swahili by two of the principal authors. All items were phrased as questions, with responses categorised as ‘never’, ‘sometimes’ or ‘often’. The phrase ‘balanced meal’ for the children (Q7) was translated to ‘mlo kamili’ meaning ‘full meal’. This is interpreted to mean a meal with meat, starch, vegetables and fruit, and confirms with local traditional knowledgeReference King and Burgess(18). The translated instrument was then subjected to a question-by-question review by the authors and 10 research assistants with good knowledge of the research area and experience in nutrition counselling at local maternal and child health clinics. Each item was examined to ensure face validity in the local context and a transfer of conceptual meaning in Swahili. The revised instrument was then pre-tested in a rural community with similar characteristics to the study population. A convenience sample of 150 participants was used.
* Question was excluded from the analysis.
Data collection procedure
A cross-sectional survey was conducted during the pre-harvest (rainy) season from March to May 2005. Eligible participants were identified through house-to-house registration and counter-checked with existing village census lists. Interviews were conducted with each respondent near their home by a team of trained research assistants under supervision of one of the principal authors. A revised version of a previously used questionnaire was used to collect information on sociodemographic characteristics. The questionnaire included the Third National Health and Nutrition Examination Survey (NHANES III) food sufficiency question and a question on woman’s meal skipping from the Community Childhood Hunger Identification Project (CCHIP). The food sufficiency question administered was ‘Which of the following statements best describes the amount of food eaten in your household: (1) have enough to eat; (2) sometimes have enough to eat; and (3) often do not have enough to eat?’
Assessment of validity
Three aspects of validity of the Radimer/Cornell measure were assessed: (1) construct validity using principal component factor analysis; (2) internal consistency (precision) using Cronbach’s alpha; and (3) criterion-related validity (accuracy) by comparing the developed Radimer/Cornell measure with sociodemographic factors and the NHANES and CCHIP questions. In the absence of a criterion measure (gold standard), accuracy can be assessed by comparing the food insecurity measure with comparison measures such as determinants, consequences of food insecurity or other measures of food insecurityReference Nunnaly and Bernstein(19). This analytic strategy has been well described and used by FrongilloReference Frongillo and Nanama(20, Reference Frongillo21).
The study received research ethical approval from the Tanzanian Ethical Committee of the Ministry of Health and from the Norwegian Committee for Medical Research Ethics. All participants provided written or a thumb print informed consent. Individual health education was given to all participants to correct any misconceptions concerning the study and all households in the village were provided with a small food package irrespective of their participation status.
Data analysis
Frequency distribution of all Radimer/Cornell food insecurity items was done for descriptive purposes. The food insecurity items were then subjected to principal component factor analysis. Two- to four-factor solutions were explored and followed up by oblique rotation to assist in the interpretation. Factors with an eigenvalue of approximately one or more were retained. Subscales were developed using items that consistently grouped together and had factor loading with an absolute value of 0·4 or more. These items were considered to reflect the same construct. Internal consistency of the developed scales was assessed using Cronbach’s alpha. A scale with an α coefficient of 0·7 or higher was considered reliableReference Carmines and Zeller(22). The question on ‘affording to eat the way you think you should’ (Q4, Table 1) was omitted from the analysis due to: (1) poor correlation with other Radimer/Cornell food insecurity items (r < 0·2); (2) when removed the internal consistency of the scale improved from Cronbach’s α = 0·802 to 0·853; and (3) the percentage of affirmative response (75·7 %) was higher than for other items. The χ 2 test for trend in proportions was run to compare sociodemographic characteristics and the NHANES III and CCHIP food insecurity indicators across the Radimer/Cornell food insecurity categories. A two-tailed P value of <0·05 was considered significant. All analyses were carried out using SPSS version 12.0 (SPSS Inc., Chicago, IL, USA).
Results
Sample characteristics
Demographic characteristics of the women in the sample are summarised in Table 2. The mean age of the respondents was 28·0 (standard deviation 6·4) years. Most of the women (78·5 %; 416/530) were married or cohabiting and in a monogamous relationship (83·2 %; 346/416). About 81·0 % (427/530) had primary education and a majority (83·2 %; 441/530) were peasants.
*Mean (standard deviation).
Radimer/Cornell food insecurity items
Affirmative responses to the eight food insecurity items ranged from 43·2 % to 68·3 %. The most frequently endorsed food insecurity item was Q3, ‘Has your family ever eaten the same type of food for several days consecutively because you did not have enough money to buy different food?’, as noted in Table 3. The least endorsed food insecurity item was Q4, ‘Have you often been hungry but do not eat because you can not afford enough food?’ About 82·0 % (432/530) of the women responded positively to one or more of the food insecurity items at the household level and 71·1 % (377/530) responded that their children had experienced one or more of the food insecurity items at the child level. Only 14·0 % (74/530) of the women responded ‘never’ to all questions and were characterised as food-secure.
*Responding ‘sometimes’ or ‘often’ to the Radimer/Cornell food insecurity items.
†Factor 1 explained 55·2 % of the total variance.
‡Factor 2 explained 11·0 % of the total variance.
Construct validity
The rotated principal component factor analysis of the Radimer/Cornell food insecurity items revealed two factors: (1) altered eating pattern at household level and (2) altered eating pattern at child level (Table 3). Five items loaded onto the first factor with loadings ranging from 0·67 to 0·86. The remaining three items came together as the second factor with loadings between 0·74 and 0·89. The total variance explained by these two factors was 66·2 %. The first factor extracted explained 55·2 % of the total variance and the second factor accounted for 11·0 % of the total variance.
Internal consistency
The subscales had good reliability. Cronbach’s α for the household subscale was 0·853 (n = 5 items) and for the child subscale 0·784 (n = 3 items).
Criterion-related validity
Criterion-related validity was assessed by creating the Radimer/Cornell food insecurity measure and investigating its relationship to sociodemographic factors and the NHANES III and CCHIP food insecurity indicators. The measure was created by assigning women to three exclusive groups: (1) all women responding ‘never’ to all food insecurity items were categorised as food-secure (14·0 %); (2) all women responding ‘sometimes’ or ‘often’ to the household factors but not any of the child-level factors were categorised as food-insecure at household level (17·4 %; 92/530); and (3) all women who responded ‘sometimes’ or ‘often’ to the child-level factors were categorised as food-insecure at child level (68·7 %; 364/530).
Table 4 depicts the relationship between sociodemographic factors, the NHANES III indicator, the CCHIP indicator and the Radimer/Cornell food insecurity measure. Food insecurity status was strongly associated with most of the sociodemographic characteristics. Age and marital status were significantly and positively correlated with food insecurity. Women who were categorised as food-insecure at the child level were more likely to be older (≥33 years) and separated, divorced or widowed. On the other hand, education and occupation were significantly and negatively correlated with food insecurity, whereby as food insecurity status worsened women were more likely to have no formal education and be involved in farming. Overall, the Radimer/Cornell food insecurity measure agreed on 72·3 % (383/530) of the women with the NHANES III indicator and on 36·7 % (194/530) of the women with the CCHIP indicator on the determination of food insecurity status.
*P value for χ 2 test for trend across food insecurity status.
†Food sufficiency question from the Third National Health and Nutrition Examination Survey.
‡Woman’s meal skipping question from the Community Childhood Hunger Identification Project.
Discussion
The purpose of the present study was to determine the validity and reliability of the Radimer/Cornell food insecurity measure in assessing food insecurity in a rural Tanzanian population. The final adapted scale in this study had eight Radimer/Cornell food insecurity items including the question on food monotony suggested by Kendall et al.Reference Kendall, Olson and Frongillo(8). The definition of ‘balanced diet’ as used by Radimer and other food security tools has been observed to be difficult to use in developing countriesReference Studdert, Frongillo and Valois(9, Reference Derrickson, Sakai and Anderson23). In this study the term ‘balanced food’ was conceptualised to reflect local knowledge which is similar to traditional definitionsReference King and Burgess(18).
Principal component factor analysis revealed two factors that identified altered eating patterns at the household and child level. Other studies have found the same factors in addition to two other factors, namely individual-level factor and qualitative factor. The total variance explained by the two identified factors compares well with other studiesReference Radimer, Olson, Greene, Campbell and Habicht(7, Reference Kendall, Olson and Frongillo8). Moreover, the internal consistency of our subscales is good and similar to others although the child food insecurity subscale is slightly lowerReference Radimer, Olson, Greene, Campbell and Habicht(7, Reference Kendall, Olson and Frongillo8). The inability of our study to identify these other factors may be due to: (1) the use of fewer items addressing quality aspects of food insecurity; (2) the population studied clearly was more vulnerable to food insecurity and thus overrode the qualitative aspects of food insecurity with the quantitative aspectsReference Kendall, Olson and Frongillo(8, Reference Coates, Frongillo, Rogers, Webb, Wilde and Houser15); and (3) the scale used was primarily developed for a different target population and hence lacked culturally sensitive expressions that related to the other factors. However, the absence of these other factors of food insecurity (qualitative and individual-level factor) in our analysis does not exclude them from existing in the study population.
Food insecurity has been described as a managed process where households and individuals respond actively to the risks they encounter on a daily basisReference Radimer, Olson, Greene, Campbell and Habicht(7). These responses have been noted to follow a general pattern and have led researchers to use them as a ‘proxy’ for the severity of food insecurity. The two factors identified in our study covered a range of elements of the food insecurity concept. The questions related to presence of anxiety (Q1 and Q2), the quality of food consumed (Q3 and Q7) and a lack of food in quantity (Q4, Q5, Q6 and Q8). The distribution of affirmative responses showed that these experiences were common in this population. However, the pattern of the affirmative responses in our data differed from that in studies conducted elsewhere, where child issues had lower affirmative responses compared with household issues and adult issuesReference Kendall, Olson and Frongillo(8, Reference Studdert, Frongillo and Valois9, Reference Welch, Mock and Netrebenko24). Response patterns of households when confronted with food constraints have been shown to differ across and within culturesReference Maxwell, Ahiadeke, Levin, Armar-Klemesu, Zakariah and Lamptey(6, Reference Coates, Frongillo, Rogers, Webb, Wilde and Houser15), as well as between households with and without childrenReference Wilde(13). In addition, the age of children referred to in our study was younger (0–5 years) whereas other studies defined children as between 0 and 18 years oldReference Radimer, Olson, Greene, Campbell and Habicht(7, Reference Kendall, Olson and Frongillo8). Thus, the pattern of affirmative responses observed suggests the distribution of behaviours adopted during these situations, rather than the degree of severity of food insecurity as observed elsewhereReference Kendall, Olson and Frongillo(8, Reference Studdert, Frongillo and Valois9, Reference Welch, Mock and Netrebenko24). Further research is needed to identify coping strategies geared towards protecting children that may identify severity of food insecurity in this community.
Approximately 69·0 % of the women were classified as having food insecurity at child level. Women whose children were categorised as food-insecure were also more likely to be from a household considered to be food-insecure. These categories used to describe food insecurity have been suggested by Radimer et al. and reaffirmed by other researchersReference Kendall, Olson and Frongillo(8, Reference Zalilah and Ang11, Reference Welch, Mock and Netrebenko24). Responding ‘sometimes’ or ‘often’ to the food insecurity items identifies a household or individual into a certain group of food insecurity status. This hunger index developed by Radimer et al. (and utilised in this study) is conceptually clear, simple and straightforward to identify households in need of intervention. It is practical in developing countries where there is limited skilled manpower to analyse complex data. However, in order to identify those in immediate need of assistance, a different method of categorisation may be appropriate in order to spread out the households. The use of scores or addition of other categories may work as alternativesReference Studdert, Frongillo and Valois(9, Reference Nnkwe and Yegammia10).
The selected sociodemographic characteristics showed a significant association with food insecurity status in the expected directions. This finding is consistent with other studiesReference Radimer, Olson, Greene, Campbell and Habicht(7–Reference Nnkwe and Yegammia10). In the assessment of food insecurity status, the agreement of the NHANES III indicator was good but poor for the CCHIP indicator. However, both indicators were very good at categorising women who were food-secure. The NHANES III and CCHIP indicators seem to measure less severe food insecurity status which the Radimer/Cornell measure assesses as food security. This supports the ability of the Radimer/Cornell food insecurity measure to identify households experiencing increasingly severe food insecurity levels in this rural population.
The strength of this study lies in the use of a sample of women from the general population to validate the Radimer/Cornell food insecurity measure in rural Tanzania. The sample provided a broad range of food insecurity experiences to be included in the study. This allowed a modest inference to the external validity of the Radimer/Cornell measure in other rural areas of Kilimanjaro where similar situations may existReference Schmidt and Hunter(25). Although the adapted Radimer/Cornell measure addressed several of the domains of food insecurity, its use as a generic tool may have limited the scope of food insecurity experiences that could be identified within the population. Also, due to lack of a criterion measure (‘gold standard’) of food insecurity in Tanzania, the accuracy of the Radimer/Cornell tool is debatable. However, the consistent and significant association of the measure to its determinants education and occupation, and the other food insecurity measures in the expected directions, provides reasonable assurance that the measure is functioning as intended. Furthermore, the Radimer/Cornell measure at this stage cannot be used for monitoring purposes as its stability across time was not assessed.
In conclusion, our findings suggest that the adapted Radimer/Cornell measure may have some utility in assessing food insecurity in settings like rural Tanzania. This could be a simple and cheap alternative to provide timely and informative information on food and nutrition needs at the household level. Further research is needed to assess the accuracy of experienced-based measures of food security in Africa and explore culturally sensitive expressions of food insecurity that could be included to improve assessment.
Acknowledgements
The authors are grateful to the participants for their time and to the hardworking spirit of the research team. This study was funded in part by a grant from the Norwegian Programme for Development, Research and Higher Education (NUFU) and facilitated by the collaborating institutions: Muhimbili University College of Health Sciences, Kilimanjaro Christian Medical College and Centre for Education Development Arusha in Tanzania and the Universities of Oslo and Bergen, Norway. The contribution of each authors are: G.H.L., conception and design of the study, drafting the manuscript, analysis and interpretation of the data; E.J.M., conception and design of the study, analysis, interpretation of the data and substantial revision of the manuscript; K.S.M., analysis, interpretation of the data and substantial revision of the manuscript; K.-I.K., conception and designing of the study, analysis, interpretation of the data and substantial revision of the manuscript. The authors declare that they have no competing interests in whatever form.