The gold standard for measuring food or energy intake (EI) in free-living humans is the doubly labelled water (DLW) method. DLW provides an accurate measure of total daily energy expenditure and, during a period of energy balance, total daily energy expenditure is equal to EI(Reference Livingstone and Black1, Reference Schoeller2). When a large energy deficit is present during the DLW period, however, it is difficult to obtain an accurate (valid) estimate of an individual's short-term EI using DLW, even if changes in energy stores are considered(Reference de Jonge, DeLany, Nguyen, Howard, Hadley, Redman and Ravussin3). This limitation is noteworthy, since researchers and clinicians frequently require an estimate of EI during diets or periods of energy restriction. Additional limitations of the DLW method include: (1) cost; (2) availability; (3) its inability to provide important information about the type and micro- and macronutrient composition of foods ingested. Nevertheless, seemingly few valid and reliable alternatives for estimating EI are available.
Self-report methods are frequently used to collect EI data, including 24 h food recall and pen-and-paper food records. When estimating EI with 24 h food recall, a trained individual interviews the participant about his/her food and beverage consumption over the previous 24 h. This method relies on the ability of the participant to accurately recall the types and amounts of foods consumed during the previous 24 h, and it assumes that these foods are representative of habitual EI. Consequently, this method is subject to error(Reference O'Neil4–Reference Samuel-Hodge, Fernandez, Henriquez-Roldan, Johnston and Keyserling6). For example, EI estimated with 24 h recall in New Zealand's National Nutrition Survey resulted in significant underestimation of EI, particularly among women and obese participants(Reference Pikholz, Swinburn and Metcalf5), and 24 h recall with multiple-pass methodology resulted in significant underestimation of EI in a sample of African-American women diagnosed with type 2 diabetes(Reference Samuel-Hodge, Fernandez, Henriquez-Roldan, Johnston and Keyserling6). Efforts to improve the accuracy of 24 h recall have been disappointing. For example, financial incentives were not found to improve diet recall(Reference Hendrickson and Mattes7).
Food records are another self-report method frequently used to estimate food intake. When using food records, participants estimate the portion sizes of foods that they eat and record this portion size and a description of the food on the food record, which is typically pen and paper. The accuracy of this method has been questioned(Reference Beaton, Burema and Ritenbaugh8, Reference Tran, Johnson, Soultanakis and Matthews9). Tightly controlled studies that compared self-reported EI to EI measured with DLW indicate that individuals significantly under-report their EI when using food records(Reference Schoeller, Bandini and Dietz10, Reference Bandini, Schoeller, Cyr and Dietz11). Moreover, overweight and obese individuals tend to under-report EI to a greater degree than lean individuals(Reference Schoeller, Bandini and Dietz10), and individuals tend to selectively under-report fat intake(Reference Goris, Westerterp-Plantenga and Westerterp12). Different methods have been used to try to improve the accuracy of food records, but the validity of these methods remains questionable. For example, an individualised approach to food records that considered variability in EI and estimated energy requirements resulted in underestimates of EI of 27 % or more(Reference Rennie, Coward and Jebb13), and a method that included visual aids to improve portion-size estimates underestimated EI by 14 % with marked variability(Reference Koebnick, Wagner and Thielecke14).
Software applications housed on hand-held devices such as personal digital assistants (PDA) have been developed to reduce the burden of keeping a food record and to improve their accuracy. Nevertheless, food records kept on PDA appear no more accurate than 24 h recall(Reference Beasley, Riley and Jean-Mary15) or traditional food records(Reference Yon, Johnson, Harvey-Berino, Gold and Howard16) and do not improve the accuracy of self-report EI(Reference Yon, Johnson, Harvey-Berino and Gold17). Importantly, Beasley et al. (Reference Beasley, Riley and Jean-Mary15) noted that the largest source of error in estimated EI resulted from participants' poor estimation of portion size. Individuals have difficulty estimating portion size even after training and these errors negatively affect EI estimates(Reference Blake, Guthrie and Smiciklas-Wright18). Our laboratory found that participants more accurately estimated portion size after extensive training, though a large degree of variability in portion-size estimates remained(Reference Martin, Anton, York-Crowe, Heilbronn, VanSkiver, Redman, Greenway, Ravussin and Williamson19). Together, these findings indicate that methods are needed that do not rely on the participant to estimate portion sizes.
Methods to measure EI that do not rely on the participant to estimate portion size are limited. Direct observation of food selection and plate waste by trained observers results in accurate EI estimates(Reference Comstock, St Pierre and Mackiernan20, Reference Wolper, Heshka, Heymsfield and Allison21), but this method is not applicable to free-living conditions. The digital photography of foods method(Reference Williamson, Allen, Martin, Alfonso, Gerald and Hunt22, Reference Williamson, Allen, Martin, Alfonso, Gerald and Hunt23), however, could be modified for free-living conditions. When using this method, the plate of foods selected by an individual is photographed and the individual's plate waste is photographed following the meal. Reference or standard portions of known quantities of the foods are also photographed. In the laboratory, trained registered dietitians use these photographs to estimate the portion size of food selection and plate waste by comparing these photographs to the standard portion photographs. These estimates are entered into a computer application that calculates the weight (g), energy (kJ or kcal) and macro- and micronutrients of food selection, plate waste, and food/EI based on a US Department of Agriculture database(24). The digital photography method has been found to be highly reliable and accurate when used to measure the EI of adults(Reference Williamson, Allen, Martin, Alfonso, Gerald and Hunt22, Reference Williamson, Allen, Martin, Alfonso, Gerald and Hunt23) and children(Reference Martin, Newton, Anton, Allen, Alfonso, Han, Stewart, Sothern and Williamson25) in cafeteria settings. Portion-size estimates from digital photography correlate highly with weighed portion sizes (r>0·90; P < 0·0001) and mean differences between directly weighing foods and digital photography are minimal ( < 6 g)(Reference Williamson, Allen, Martin, Alfonso, Gerald and Hunt23). Agreement is high among trained registered dietitians who estimate portion sizes using digital photography; for example, intraclass correlation coefficients (ICC) are consistently >0·90(Reference Martin, Newton, Anton, Allen, Alfonso, Han, Stewart, Sothern and Williamson25).
To our knowledge, only a few studies have used digital photographs to estimate EI in free-living conditions. A research group in Japan used a PDA with a digital camera to collect EI data in free-living conditions. The method results in EI estimates comparable with weighed food records. Nevertheless, these studies relied on samples of young lean college women who were majoring in food and nutrition, and the criteria (food records) are prone to error(Reference Wang, Kogashiwa and Kira26, Reference Wang, Kogashiwa, Ohta and Kira27). When used in a more diverse sample of males and females, the method resulted in EI estimates that were significantly lower than estimates from weighed records, and under-reporting in males was associated with obesity(Reference Kikunaga, Tin, Ishibashi, Wang and Kira28). Nevertheless, these important studies demonstrate the likely utility of such technology.
The purpose of the present paper is to describe the development of the remote food photography method (RFPM) and to report the first reliability and validity tests of this method. The RFPM relies on the validated digital photography method(Reference Williamson, Allen, Martin, Alfonso, Gerald and Hunt22, Reference Williamson, Allen, Martin, Alfonso, Gerald and Hunt23) to analyse food photographs and estimate EI, but the photographs are collected in free-living conditions with a camera-enabled cell phone and are sent to the researchers in near real time via a cellular network. Two pilot studies and the main study, which includes tests of reliability and validity, are described. It was hypothesised that initial reliability and validity data would suggest that the RFPM is a viable method for measuring EI in free-living conditions. The three studies reported here were conducted at the Pennington Biomedical Research Center (PBRC; Baton Rouge, LA, USA). All applicable institutional and government regulations concerning the ethical use of human volunteers were followed. All participants provided written informed consent and the research was approved by the Institutional Review Board of the PBRC.
Pilot study 1
The purpose of pilot study 1 was to overcome the primary limitation of adapting the digital photography method for free-living humans, which is the need for a photograph of a weighed standard portion from the dining location. When the digital photography method is utilised in the cafeteria, a photograph is taken of a standard portion of weighed food. In the laboratory, trained registered dietitians estimate EI by comparing the photographs of food selection and plate waste to the standard portion photograph. When photographs are collected in free-living conditions, it is unfeasible for participants to weigh and take a photograph of a standard portion of each food that they eat.
Procedures
To overcome this limitation, we created a large database of standard portion photographs from previous studies and we took new standard portion photographs of foods that are frequently consumed (for example, cereal) but were under-represented in the database. This database is called the ‘archive’ and it includes over 2100 photographs of different foods, and over 250 photos of different portion sizes of the same foods. Each food is linked to energy and nutrient information from the US Department of Agriculture database(24). In rare cases when a food item is not represented in the US Department of Agriculture database, data from the manufacturer is utilised (for example, food label, website).
During pilot study 1, we simulated food selection and plate waste in the laboratory by taking photographs of foods with a PDA (Palm Pilot, Zire™ 72; Palm Inc., Sunnyvale, CA, USA) equipped with a digital camera. We took photographs of thirty-one different foods that were grouped together to simulate sixteen meals (for example, hamburger, ketchup, French fries, soda). Each simulated meal consisted of a mean of 3·88 foods; hence, each food was represented twice with two different portion sizes. For each simulated meal, the amount of food selected and plate waste was determined randomly. Food selection ranged from 35 to 800 % of the standard portion, and plate waste ranged from 0 to 90 % of the amount of food selected. The amount of food in each photograph was carefully weighed and recorded.
Data analytic plan
To test if use of a standard portion photograph from the archive facilitated reliable and valid/accurate estimates of EI, trained registered dietitians estimated food selection and plate waste using two methods in the following order: (1) without photographs of a standard portion; (2) with photographs of a standard portion from the archive. For each of the two methods, we compared the registered dietitians' estimates of food selection to the actual amount of food that was selected with dependent t tests. Similarly, plate waste and EI from each method were compared with weighed plate waste and EI. To test inter-rater reliability, two registered dietitians estimated EI for all of the foods (100 % over-sample) and ICC were calculated. We predicted that the registered dietitians' EI estimates would not differ significantly from EI measured by directly weighing foods when a standard-portion photograph from the archive was used, but the estimates would differ significantly when no photograph from the archive was used.
Results
Inter-rater agreement between the two trained registered dietitians who estimated EI was high with and without the archive (Table 1); therefore, the registered dietitians' estimates were averaged. Estimated food selection and EI differed significantly from weighed food selection and EI when the archive was not utilised, but this difference was not significant when the archive was utilised (Table 1). Estimated plate waste did not differ from weighed plate waste for either method. Estimated EI only differed from weighed EI by − 8·2 % on average when the archive was utilised.
Table 1 Comparison of food selection, plate waste and energy intake (EI) estimated with the remote food photography method with weighed EI when a standard-portion photograph from the archive was and was not utilised during the estimation procedure (pilot study 1)
ICC, intraclass correlation coefficient.
***P < 0·0001.
† ICC with 95 % CI represent agreement between the two registered dietitians who estimated EI (100 % over-sample).
Discussion
The first pilot study demonstrated that trained registered dietitians can reliably and accurately estimate EI with standard-portion photographs from the archive. Estimated food selection, plate waste and EI differed by − 8·2 % on average from directly weighed food when the archive was used.
Pilot study 2
Participants and procedures
Pilot study 2 was a feasibility study to determine if free-living people could use the PDA to take pictures of their food selection and plate waste. Male and female adults (aged 18–54 years) with BMI 19–35 kg/m2 (inclusive) were enrolled. Participants were asked to take pictures of their food selection, including energy-containing beverages, and plate waste for four consecutive days and to label the pictures with a brief description of the foods. When participants returned the PDA to the researchers, they were asked about their satisfaction with the method and factors that hindered their ability to take photographs of their foods. Trained registered dietitians estimated EI using the digital photography method. During this process, they recorded problems with the pictures that limited their ability to estimate EI from the photographs. No data analyses were planned for this pilot and feasibility study, which served the purpose of identifying barriers to collecting digital photography data in free-living conditions and analysing the data.
Results
Participant characteristics for pilot study 2 are depicted in Table 2. The sample was predominantly Caucasian (67 %) and female (79 %). Pilot study 2 demonstrated that free-living individuals can use a PDA to take pictures of their food selection and plate waste and also identified factors that inhibit application of the method to free-living conditions. Moreover, the study identified ways to modify procedures to overcome these factors.
Table 2 Baseline characteristics and sex and race distribution of study participants
(Mean values with their standard errors or numbers and percentages)
First, participants occasionally forgot to take photographs of their food selection and plate waste. To address this problem, ecological momentary assessment (EMA)(Reference Stone and Shiffman29) technology was adopted and alarms were installed on the Palm Pilots™ to remind participants to take photographs of their foods. Second, the researchers could not review the data until the participants returned the PDA at the end of the 4 d study. Therefore, systematic mistakes in taking the pictures could not be corrected, and these mistakes negatively affected data quality for the entire study. To address this problem, future research relied on cellular phones equipped with digital cameras and data transfer capabilities that allowed photographs to be sent to the researchers in near real time. Third, many photographs were difficult to analyse due to poor lighting; consequently, the new data collection devices (cell phones) included a flash and computer software is being developed to digitally enhance photographs. Fourth, participants occasionally provided poor descriptions of foods in pictures due to the time required to type the description. To correct this problem, participants were instructed to quickly record voice (or text) messages with the cell phone to describe the foods. Finally, participants required experiential training with the data collection devices to take good photographs; therefore, we created a 20–30 min training paradigm.
Discussion
The results of the second pilot study provided important information about factors that inhibit data collection in free-living conditions, and the study identified ways to overcome these limitations. The results of this study were instrumental in guiding development of the RFPM and addressing factors that affected data quality.
Main study
The aim of the main study was to finalise the development and procedures for the RFPM and to obtain reliability and validity data from laboratory and free-living conditions.
Measures
Remote food photography method
The procedures for the RFPM were finalised based on the results of the two pilot studies and consisted of the following:
(1) Participants were trained to use the cell phones to take pictures of their food selection and plate waste, label the pictures, and send these pictures to the researchers over the cellular network;
(2) Participants received and were asked to respond to four to six automated prompts that reminded them to take photographs and to send the photographs to the researchers. These prompts utilised EMA(Reference Stone and Shiffman29) principles and consisted of emails and text messages;
(3) Participants were provided with a telescoping pen to standardise the distance of the camera from the food and were instructed to take photographs at a 45° angle;
(4) Participants were instructed to record their EI using traditional pen-and-paper methods or a voice recording on the phone in case of technology failure (we also interviewed participants at the end of the data collection period to name foods that were difficult to identify or were poorly described).
Participants were trained on these procedures during a 20–30 min individual experiential training session during which they showed mastery of the procedures before being dismissed. The phones used during the research were Motorola i860 phones (Motorola, Inc., Schaumburg, IL, USA), which were equipped with 1·3-mega pixel cameras and 4 × digital zoom. Data analysis/estimation of EI followed the validated digital photography of foods method(Reference Williamson, Allen, Martin, Alfonso, Gerald and Hunt22, Reference Williamson, Allen, Martin, Alfonso, Gerald and Hunt23) and is outlined in the Introduction of the present paper.
Participants completed a form before data collection that asked them to rate their comfort level with using a cell phone (1 = not at all comfortable; 5 = extremely comfortable). After data collection, participants completed a form that asked about their satisfaction with the RFPM, and their satisfaction with sending the photographs to the researchers (1 = extremely dissatisfied; 6 = extremely satisfied). Participants also rated their perceived ease of using the RFPM (1 = very difficult; 6 = extremely easy), and if they would rather use the RFPM or pen-and-paper records to record intake. Collection of these data began after we started the trial; therefore, data were only available on a subset of the study sample.
Weighed energy intake
EI measured by directly weighing foods served as the gold standard criterion for EI and was used to test the validity of the RFPM over 3 d. EI was measured under two conditions. First, participants ate meals in the Ingestive Behavior Laboratory of the PBRC. Second, a group of participants were provided with pre-weighed food in a cooler and were asked to eat this food in their natural environment for dinner. The participants returned the cooler the following morning and the remaining food was weighed to calculate EI. Participants used the RFPM in the laboratory and their natural environment.
Participants
Fifty-two participants were randomised and two participants failed to complete the study. Inclusion criteria were: healthy male or female aged 18–54 years with BMI 20–35 kg/m2 (inclusive). Exclusion criteria were: use of medications that influenced eating behaviour, diagnosis of chronic illness, tobacco use, aversion to study foods, and, for females, irregular menstrual cycle and pregnancy. The inclusion and exclusion criteria were lenient to recruit a diverse sample that is representative of people who participate in research or seek weight-loss treatment, increasing the generalisability of the study.
Random assignment and procedures
All participants completed training in the RFPM. Participants were randomly assigned (1:1 ratio) to the dine-in or take-out group. On each test day, all participants consumed a standard breakfast (Table 3). In the dine-in condition, participants completed 3 d of food intake testing, during which lunch and dinner were eaten in the laboratory. In the take-out condition, participants completed 3 d of food intake testing, but they only ate lunch in the laboratory. Dinner was eaten out of the cooler in free-living conditions. Participants used the RFPM during all lunch and dinner meals; therefore, two EI measures were collected: (1) weighed EI; (2) EI estimated with the RFPM.
Table 3 Description (energy and macronutrient content) of the foods served during breakfast, lunch and dinner during the main study
* Participants selected and were served one of the three sandwich choices for lunch.
† Elongated rolls.
In the dine-in and take-out conditions, the same types and amounts of foods were provided (Table 3) and test days were 2–7 d apart. Excess food was provided to ensure plate waste and provide a conservative test of the RFPM since the presence of plate waste creates more opportunity for error and is not always present in people's natural environment, i.e. many people eat all of their portions.
Data analytic plan
The reliability of the RFPM was examined by calculating ICC for EI measured with the RFPM and directly weighing foods over the 3 d of testing in both free-living and laboratory conditions. Agreement among the three registered dietitians who scored the photographs was examined with ICC (27 % of meals were over-sampled). For the following analyses, EI data were averaged over the 3 d of testing.
Three series of analyses were conducted to test the validity of the RFPM. First, EI estimated with the RFPM was compared with weighed EI measured in the Ingestive Behavior Laboratory. These analyses relied on data from the dine-in group (their lunch and dinner data were combined). A second laboratory-based test of the RFPM relied on the take-out group's lunch data. Third, the take-out group's dinner data were analysed to test the validity of the RFPM in free-living conditions. The second and third series of analyses allowed examination of the accuracy of the RFPM in laboratory v. free-living conditions with the same sample of participants. For each series of analyses, Pearson correlation coefficients were calculated between the RFPM and weigh-back method, and the Bland–Altman technique(Reference Bland and Altman30) was used to determine if: (1) the methods differ significantly from each other; (2) the accuracy of the RFPM varies with the amount of food eaten (EI).
The validity of the RFPM was also examined as a function of body mass or weight (kg), age and sex. Error was calculated by determining the percentage difference between EI estimated with the RFPM and directly weighed foods. Error was regressed against body weight with and without sex in the model to test for significance of slopes. A similar analysis was conducted with age. These analyses were conducted for each of the three samples outlined in the previous paragraph, namely: (1) the combined lunch and dinner data from the dine-in group, (2) the take-out group's lunch data, which were collected in the laboratory; (3) the take-out group's dinner data that were collected in free-living conditions.
Results
Participant characteristics for the main study are depicted in Table 2. The sample consisted of 54 % females and 70 % Caucasians.
Ecological momentary assessment and missing data
A total of 157 EMA prompts were sent near dinner time to participants in the take-out group and all were received, though thirty-seven (23·6 %) were delivered at the incorrect time (prompts were sent via an email server that delayed delivery of some messages). Participants responded to 118 (98·3 %) of the 120 prompts that were delivered on time.
Each group, dine-in and take-out, consumed 150 meals that were measured with the RFPM and by directly weighing foods. For the dine-in group, all 150 meals were consumed in the Ingestive Behavior Laboratory. When using the weigh-back method, data from three meals were not analysed due to technical error or protocol violations, including eating only certain ingredients from the sandwiches, which made it impossible to obtain weighed intake. Four meals were not analysed due to poor picture quality or missing pictures.
The take-out group consumed 150 meals (seventy-five meals in the laboratory and seventy-five meals in free-living conditions). In the laboratory, data from seven meals were not analysed: one meal had missing pictures; three meals had poor-quality pictures; three meals involved protocol violations. In free-living conditions, data from eleven meals were not analysed: five meals had poor-quality pictures; six meals had protocol violations. Protocol violations included not eating the food provided by the researchers due to eating other foods.
Reliability of the remote food photography method
Agreement was high among the three registered dietitians who used photographs from the RFPM to estimate EI. The ICC for food selection, plate waste and EI were 0·99 (95 % CI 0·99, 0·99), 0·91 (95 % CI 0·87, 0·94) and 0·88 (95 % CI 0·81, 0·91), respectively. The ICC for intake (kJ) of fat, carbohydrate and protein were 0·92 (95 % CI 0·88, 0·94), 0·85 (95 % CI 0·77, 0·89) and 0·85 (95 % CI 0·79, 0·90), respectively. These values are consistent with inter-rater agreement when the digital photography method is used in cafeteria settings(Reference Williamson, Allen, Martin, Alfonso, Gerald and Hunt22, Reference Williamson, Allen, Martin, Alfonso, Gerald and Hunt23, Reference Martin, Newton, Anton, Allen, Alfonso, Han, Stewart, Sothern and Williamson25).
EI estimated with the RFPM was reliable over the 3 d of testing. Based on the dine-in group's combined lunch and dinner data, the RFPM produced reliable estimates of EI in laboratory conditions (ICC 0·62; P < 0·0001). Moreover, data from the dinner meal of the take-out group indicated that the RFPM produced reliable estimates of EI in free living conditions (ICC 0·68; P < 0·0001). These values are consistent with ICC calculated from directly weighing food intake in the laboratory over a number of days(Reference Martin, Williamson, Geiselman, Walden, Smeets, Morales and Redmann31). In the present study, the ICC for food intake measured in the laboratory were 0·68 and 0·70 for lunch and dinner, respectively (P < 0·0001).
Validity of the remote food photography method
Participants took and sent photographs of good quality to the researchers. Fig. 1 contains representative pictures from the study.
Fig. 1 Representative pictures of food selection (a) and plate waste (b) taken by a participant and sent to the researchers via the wireless network.
The first series of analyses tested the validity of the RFPM in laboratory conditions and included the dine-in group's combined lunch and dinner data. EI estimated with the RFPM correlated highly with weighed EI, though the RFPM significantly underestimated EI ( − 368 kJ ( − 88 kcal); − 4·7 %; Table 4). Bland–Altman analysis indicated that this bias was consistent over different levels of EI (Fig. 2).
Table 4 Summary of analyses to test the validity of energy intake (EI) estimated with the remote food photography method (RFPM) compared with directly weighed foods in laboratory and free-living conditions (main study)†
***P < 0·0001.
† EI estimated with the RFPM was compared with weighed EI with Pearson correlations and dependent t tests.
Fig. 2 Bland and Altman analysis comparing the remote food photography method (RFPM) with weighed energy intake (EI) in the laboratory. Lunch and dinner data from the dine-in group were included in these analyses. The RFPM bias in estimating EI was consistent over different levels of EI (R 2 0·03; adjusted R 2 − 0·01; P = 0·39).
The second series of analyses tested the validity of the RFPM in laboratory conditions by analysing the take-out group's lunch data. EI estimated with the RFPM correlated highly with weighed EI, and the RFPM non-significantly underestimated EI ( − 151 kJ ( − 36 kcal); − 5·5 %; Table 4). Bland and Altman analysis indicated that this bias was consistent over different levels of EI (Fig. 3).
Fig. 3 Bland and Altman analysis comparing the remote food photography method (RFPM) with weighed energy intake (EI) in laboratory conditions by analysing lunch data from the take-out group. The RFPM bias in estimating EI was consistent over different levels of EI (R 2 0·03; adjusted R 2 − 0·02; P = 0·45).
The third series of analyses tested the validity of the RFPM in free-living conditions by analysing the take-out group's dinner data. EI estimated with the RFPM correlated highly with weighed EI, and the RFPM significantly underestimated EI ( − 406 kJ ( − 97 kcal); − 6·6 %; Table 4). Bland and Altman analysis indicated that this bias was consistent over different levels of EI (Fig. 4).
Fig. 4 Bland and Altman analysis comparing the remote food photography method (RFPM) with weighed energy intake (EI) in free-living conditions by analysing the dinner data from the take-out group. The RFPM bias in estimating EI was consistent over different levels of EI (R 2 0·08; adjusted R 2 0·04; P = 0·18).
Validity of the remote food photography method as a function of body mass (kg), age and sex
Regression analysis indicated that there was no significant association between body weight (kg) and the RFPM error (percentage difference between EI estimated with the RFPM and weighed EI) with (adjusted R 2 − 0·07 to 0·08; P values >0·45) or without (adjusted R 2 − 0·04 to 0·01; P values >0·30) sex in the models. Age also was not associated with error (adjusted R 2 − 0·07 to 0·08; P values >0·65). Error did not differ significantly between men and women in the take-out group at lunch (t(21) = − 0·73; P = 0·47) or dinner (t(22) = − 0·75; P = 0·46). Error was significantly larger for women ( − 9·2 %) compared with men ( − 0·7 %) in the dine-in group (t(23) = − 2·08; P = 0·05).
Satisfaction ratings
Thirty-five participants had data on their comfort level (1 = not at all comfortable; 5 = extremely comfortable) of using cell phones before data collection. Thirty (85·7 %) participants rated their comfort level as 4 or higher. After data collection, forty-seven participants had satisfaction data (1 = extremely dissatisfied; 6 = extremely satisfied) and thirty-seven (78·8 %) participants rated their satisfaction with the RFPM as 5 or higher and forty (85 %) participants rated their satisfaction with sending photographs to the researchers as 5 or higher. Last, forty-four (93·6 %) participants rated the ease of use of the RFPM as 5 or higher, and almost all participants (forty-four; 93·6 %) indicted they would rather use the RFPM rather than pen and paper to record food intake.
Discussion
The RFPM was found to produce reliable and valid estimates of EI in both laboratory and free-living conditions. The degree of error for the RFPM was very small ( − 4·7 to − 6·6 %) when compared with error of 37 % or more associated with self-report methods(Reference Schoeller, Bandini and Dietz10–Reference Goris, Westerterp-Plantenga and Westerterp12), and the error was similar in both laboratory and free-living conditions. Moreover, error associated with the RFPM was not found to vary by the amount of energy/food eaten or body weight, which is a significant liability of self-report methods(Reference Pikholz, Swinburn and Metcalf5). Error also did not differ by age, and only one of three comparisons found that error differed by sex (this comparison relied on data from the laboratory). The majority of participants rated their satisfaction with the RFPM and with sending pictures to the researchers favourably and almost all (93·6 %) participants indicated that they would rather use the RFPM compared with pen-and-paper records to record food intake. Thus, the RFPM appears to be a promising new method for estimating group and individual EI.
Implications of the findings
The RFPM has important implications for both research and clinical practice. Obtaining accurate estimates of food and macronutrient intake from free-living individuals is important for researchers who investigate the nutritional adequacy of the diet and interventions to modify food intake and body weight. Additionally, the RFPM allows individuals to receive virtually immediate feedback about their energy and micro- and macronutrient intake from professionals in a remote location. Individuals can obtain clinical and dietary recommendations based on food intake data that are reviewed in near real time, and they do not need to go to a clinic to receive this feedback.
The RFPM is a promising method to estimate EI with innovative technology. Nevertheless, our experiences during these studies remind us of the complexities of collecting EI data from free-living individuals and the barriers that negatively affect data quality, as described in the following paragraphs. Therefore, the RFPM continues to be modified to address these barriers, and these modifications include the following.
First, the RFPM relies on the ability of participants to remember to take photographs of their food selection and plate waste. The use of EMA methodology provided automated prompts reminding participants to take photographs, but missing data are unavoidable. To reduce missing data, it is clear that secondary methods are needed to capture EI data when the participant forgets to take photographs or when photographing food is not possible. In current and future studies, we include explicit instructions for participants to record food intake with pen and paper or to use the phone to make voice recordings describing the food and portion size. Additionally, we monitor incoming data and contact participants immediately if their data are of poor quality or if photographs are missing. Participants have responded positively to these procedures, since the procedures indicate that the researchers are invested in data collection and that participants are accountable.
Second, participants' food descriptions do not always convey important details about the food item, such as the method of preparation. Therefore, when participants return the cell phone to the researchers, they answer questions about foods that are difficult to identify and that have poor descriptions. During this meeting, the participant also provides the researchers with pen-and-paper records or voice recordings that were used to record EI in the case of technology failure.
Third, a considerable amount of personnel time is required to schedule EMA prompts, monitor incoming data, etc. Therefore, the methodology is being further modified and computer applications are being developed to: (1) automatically deliver EMA prompts and modify the prompts based on the participants' adherence; (2) monitor incoming data and alert the researcher and participant when data appear to be missing, for example, when an odd number of photographs are received; (3) digitally enhance the quality and lighting of photographs; (4) automatically estimate the amount of food represented in pictures using computer imaging algorithms. These aims are part of ongoing research and development to facilitate data collection in free-living conditions where participants eat ad libitum and to minimise under-recording or participants failing to take and send photographs. Also, the computer imaging techniques being developed will determine the angle and distance of the camera phone from the food, which will facilitate accurate estimates of EI even when foods are eaten off plates that vary in size. To accomplish this aim, participants will include a standard-size object in the photograph, for example, a dollar bill or six-inch ruler. An additional aim of the ongoing research is to determine if participants under-eat when they use the RFPM. Under-eating is known to occur when food intake is monitored using other methods, for example, Goris et al. (Reference Goris, Westerterp-Plantenga and Westerterp12).
Strengths and limitations
The study has important strengths, including a diverse study sample and excellent retention (only two participants failed to complete the protocol). Additionally, participants considered under-reporters were not excluded from the data analysis, which is common in other studies. Last, the RFPM was tested in controlled laboratory and free-living conditions in the same sample (the take-out group), which allows direct comparisons of the accuracy between laboratory and free-living conditions.
The study has important limitations that also must be considered. First, participants in the take-out group of the main study collected data during free-living conditions, though they ate food from a cooler provided by the researchers. Consequently, the variety of food was limited and not necessarily representative of their habitual daily intake. Although these conditions were contrived, they were necessary since other criterion measures of EI during free-living conditions, for example, DLW, were not feasible for this study. Second, EI was only measured for 3 d.
Conclusions
The studies reported here describe the development and initial support for the reliability and validity of the RFPM, as well as high user satisfaction ratings. Ongoing research is refining the methodology and testing the RFPM in free-living conditions against EI measured with DLW. Our findings suggest that the RFPM is a promising new method for estimating EI in free-living conditions.
Acknowledgements
This work was partially supported by the National Institutes of Health and the National Science Foundation (National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK) grant 1 K23 DK068052-01A2; National Heart Lung and Blood Institute, National Institute on Aging, and National Science Foundation grant 1 R21 AG032231-01) and a Clinical Nutrition Research Unit Center grant (1P30 DK072476) entitled ‘Nutritional Programming: Environmental and Molecular Interactions’ sponsored by the NIDDK. The content is solely the responsibility of the authors and does not necessarily represent the official view of the National Institutes of Health. There are no conflicts of interest associated with the study.
C. K. M. was the study principal investigator and laboratory director; H. H. conducted the statistical analyses; S. M. C. was the laboratory manager who collected and managed data, H. R. A. developed the digital photography computer application and data collection software; C. C. supervised the dietary aspects of the protocol; S. D. A. was involved in study design, collection of data, and results interpretation.
