Hostname: page-component-78c5997874-8bhkd Total loading time: 0 Render date: 2024-11-14T09:34:19.781Z Has data issue: false hasContentIssue false

Doubly labelled water–calibration approach attenuates the underestimation of energy intake calculated from self-reported dietary assessment data in Japanese older adults

Published online by Cambridge University Press:  02 September 2021

Daiki Watanabe*
Affiliation:
National Institute of Health and Nutrition, National Institutes of Biomedical Innovation, Health and Nutrition, 1-23-1 Toyama, Shinjuku-ku, Tokyo162-8636, Japan Institute for Active Health, Kyoto University of Advanced Science, 1-1 Nanjo Otani, Sogabe-cho, Kameoka-city, Kyoto621-8555, Japan
Tsukasa Yoshida
Affiliation:
National Institute of Health and Nutrition, National Institutes of Biomedical Innovation, Health and Nutrition, 1-23-1 Toyama, Shinjuku-ku, Tokyo162-8636, Japan Institute for Active Health, Kyoto University of Advanced Science, 1-1 Nanjo Otani, Sogabe-cho, Kameoka-city, Kyoto621-8555, Japan
Eiichi Yoshimura
Affiliation:
National Institute of Health and Nutrition, National Institutes of Biomedical Innovation, Health and Nutrition, 1-23-1 Toyama, Shinjuku-ku, Tokyo162-8636, Japan
Hinako Nanri
Affiliation:
National Institute of Health and Nutrition, National Institutes of Biomedical Innovation, Health and Nutrition, 1-23-1 Toyama, Shinjuku-ku, Tokyo162-8636, Japan
Chiho Goto
Affiliation:
Department of Health and Nutrition, Faculty of Health and Human Life, Nagoya Bunri University, Aichi, Japan
Kazuko Ishikawa-Takata
Affiliation:
National Institute of Health and Nutrition, National Institutes of Biomedical Innovation, Health and Nutrition, 1-23-1 Toyama, Shinjuku-ku, Tokyo162-8636, Japan Faculty of Applied Biosciences, Tokyo University of Agriculture, Tokyo, Japan
Naoyuki Ebine
Affiliation:
Faculty of Health and Sports Science, Doshisha University, Kyoto, Japan
Hiroyuki Fujita
Affiliation:
Institute for Active Health, Kyoto University of Advanced Science, 1-1 Nanjo Otani, Sogabe-cho, Kameoka-city, Kyoto621-8555, Japan Department of Bioscience and Biotechnology, Faculty of Bioenvironmental Science, Kyoto University of Advanced Science, Kyoto, Japan
Misaka Kimura
Affiliation:
Institute for Active Health, Kyoto University of Advanced Science, 1-1 Nanjo Otani, Sogabe-cho, Kameoka-city, Kyoto621-8555, Japan Laboratory of Applied Health Sciences, Kyoto Prefectural University of Medicine, Kyoto, Japan Department of Nursing, Doshisha Women’s College of Liberal Arts, Kyoto, Japan
Yosuke Yamada*
Affiliation:
National Institute of Health and Nutrition, National Institutes of Biomedical Innovation, Health and Nutrition, 1-23-1 Toyama, Shinjuku-ku, Tokyo162-8636, Japan Institute for Active Health, Kyoto University of Advanced Science, 1-1 Nanjo Otani, Sogabe-cho, Kameoka-city, Kyoto621-8555, Japan
*
*Corresponding authors: Email [email protected]; [email protected]
*Corresponding authors: Email [email protected]; [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Objective:

Self-reported energy intake (EI) estimation may incur systematic errors that could be attenuated through biomarker calibration. We aimed to confirm whether calibrated EI was comparable to total energy expenditure (TEE) measured using the doubly labelled water (DLW) technique.

Design:

Cross-sectional study.

Setting:

General older population from the Kyoto–Kameoka Study, Japan.

Participants:

This study included sub- and main cohorts of 72 and 8058 participants aged≥ 65 years, respectively. EI was evaluated using a validated FFQ, and calibrated EI was obtained using a previously developed equation based on the DLW method. TEE was considered representative of true EI and also measured using the DLW method. We used a Wilcoxon signed-rank test and correlation analysis to compare the uncalibrated and calibrated EI with TEE.

Results:

In the sub-cohort, the median TEE, uncalibrated EI and calibrated EI were 8559 kJ, 7088 kJ and 9269 kJ, respectively. The uncalibrated EI was significantly lower than the TEE (median difference = –1847 kJ; interquartile range (IQR): –2785 to –1096), although the calibrated EI was not (median difference = 463 kJ; IQR: –330 to 1541). The uncalibrated (r = 0·275) and calibrated EI (r = 0·517) significantly correlated with TEE. The reproducibility was higher for calibrated EI (interclass correlation coefficient (ICC) = 0·982) than for uncalibrated EI (ICC = 0·637). Similar findings were observed when stratifying the sample by sex. For medians, uncalibrated EI was lower (about 17 %) than calibrated EI in the main cohort.

Conclusions:

Biomarker calibration may improve the accuracy of self-reported dietary intake estimation.

Type
Research Paper
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NCCreative Common License - SA
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike licence (https://creativecommons.org/licenses/by-nc-sa/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the same Creative Commons licence is included and the original work is properly cited. The written permission of Cambridge University Press must be obtained for commercial re-use.
Copyright
© The Author(s), 2021. Published by Cambridge University Press on behalf of The Nutrition Society

Diet–disease relationships in nutritional epidemiological studies are dependent on the accuracy of the dietary survey results obtained. Epidemiological studies usually use FFQ, dietary records (DR) or 24-h dietary recalls to assess participants’ habitual dietary habits(Reference Korth, Bhutani and Neuhouser1Reference Willett3). However, dietary assessment methods relying on self-reported data are known for inaccuracies related to the collection and analysis of individuals’ dietary intake information(Reference Korth, Bhutani and Neuhouser1,Reference Livingstone and Black4Reference Watanabe, Nanri and Sagayama7) .

Total energy expenditure (TEE) measured using the doubly labelled water (DLW) method is considered an objective biomarker of energy intake (EI) and the gold standard for its estimation in individuals with stable body weight(Reference Korth, Bhutani and Neuhouser1,Reference Livingstone and Black4Reference Tomoyasu, Toth and Poehlman10) . Previous evidence indicates that compared to TEE determined using the DLW method, DR and 24-h dietary recall underestimate EI by approximately 10–20 %, and FFQ underestimate EI by approximately 20–30 %(Reference Park, Dodd and Kipnis6,Reference Watanabe, Nanri and Sagayama7) . Moreover, underestimation of EI is associated with individual characteristics; data from national surveys demonstrate that age, sex and BMI are associated with underreporting or overreporting of EI in both the USA(Reference Murakami and Livingstone11) and Japan(Reference Murakami, Livingstone and Okubo12). Thus, it is difficult to accurately evaluate the EI from self-administered FFQ because of the systematic errors incurred due to participants’ characteristics.

The Strengthening the Reporting of Observational Studies in Epidemiology – Nutritional Epidemiology (STROBE-nut) guidelines recommend using biomarkers to estimate dietary intake(Reference Lachat, Hawwash and Ocke13). Neuhouser et al. reported a new approach involving the use of biomarkers to calibrate systematic errors in EI estimated from self-administered FFQ(Reference Neuhouser, Tinker and Shaw5). Calibrated EI, as opposed to non-calibrated EI, is associated with a substantially increased risk of diabetes(Reference Tinker, Sarto and Howard14). Therefore, diet–disease associations determined without calibration of self-reported measurement errors should be considered with caution, and information regarding EI imbalance could be useful for disease prevention. To calibrate variables, such as age, sex and weight status, that are associated with misreporting(Reference Murakami and Livingstone11,Reference Murakami, Livingstone and Okubo12) , we previously developed an equation for EI estimated from an FFQ using the DLW method in Japanese older adults(Reference Watanabe, Nanri and Sagayama7). Although this approach may be unable to completely prevent systematic errors, it could lower the systematic errors that occur with self-reported dietary assessment methods to a reasonable level, through regression-based calibration. Moreover, it is important to consider the required sample size for accurate EI estimates(Reference Watanabe, Nanri and Yoshida2). However, to our knowledge, the efficacy of the calibration approach for the sample size required for accurate EI estimation has not been evaluated thoroughly. In the present study, we aimed to: (1) evaluate whether the EI estimation is comparable to the TEE measured using the DLW method; (2) to compare the required sample size for accurate EI estimates with and without the calibration approach and (3) compare the uncalibrated and calibrated EI in a large cohort of older adults. We hypothesised that the biomarker calibration approach would improve the accuracy and precision of self-reported EI. The results of this study could help address the biases incurred with self-reporting in dietary assessment methods.

Methods

Study population

The Kyoto–Kameoka Study is a cohort study of older adults aged≥65 years living in Kameoka City, Kyoto Prefecture, Japan. The study details have been explained elsewhere(Reference Watanabe, Nanri and Yoshida2,Reference Watanabe, Nanri and Sagayama7,Reference Watanabe, Yoshida and Nanri15Reference Yamada, Nanri and Watanabe17) . In brief, the cohort participants undertook an FFQ under the Health and Nutrition Status Survey on 14 February 2012(Reference Yamada, Nanri and Watanabe17). The questionnaires were collected by mail and valid responses were received from 8319 participants. Health-related information, including medical history, socio-economic status, smoking habits, height and body weight, was extracted from the mail surveys(Reference Yamada, Nanri and Watanabe17). Of the 8319 respondents, those who self-reported that they needed long-term care (n 136), those with missing data for BMI (n 39) and those for whom estimated EI based on the FFQ was more than three standard deviations higher or lower than the mean value for their sex (n 86) were excluded from the analyses(Reference Watanabe, Yoshida and Nanri15). The remainder (n 8058) were included in the study as the main cohort.

From the main cohort, 147 individuals were re-assessed in May–June 2012 for DLW measurement. The details have been explained elsewhere(Reference Watanabe, Nanri and Yoshida2,Reference Watanabe, Nanri and Sagayama7) . Using their data, we previously developed an equation for DLW-calibrated EI(Reference Watanabe, Nanri and Sagayama7). Of this sub-cohort, 72 individuals underwent the second assessment for DLW measurement in August 2012. Thus, the sub-cohort comprised 72 individuals. This study was conducted in compliance with the STROBE-nut criteria(Reference Lachat, Hawwash and Ocke13).

Energy intake assessment

The EI was assessed using an FFQ(Reference Imaeda, Goto and Tokudome18,Reference Tokudome, Goto and Imaeda19) , which has been previously validated for middle-aged(Reference Tokudome, Goto and Imaeda20) and older adults(Reference Watanabe, Nanri and Yoshida2,Reference Watanabe, Nanri and Sagayama7) . We determined the participants’ average yearly food intake by requesting them to report the frequency at which they consumed the forty-seven food and beverage items included in the FFQ. Fixed portion sizes for each sex were derived from 1-d weighted DR(Reference Tokudome, Goto and Imaeda19). EI was calculated using the programme developed based on the Standard Tables of Food Composition in Japan(21). Spearman’s rank correlation coefficient between the EI derived from the FFQ and those derived from the DR were 0·19 for men and 0·40 for women(Reference Watanabe, Nanri and Yoshida2). The EI estimated from FFQ were 10–13 % lower than those estimated from DR for both men and women(Reference Watanabe, Nanri and Yoshida2). To confirm the reproducibility, we compared the participants’ EI through another round of FFQ in 14 February 2012 and August 2012.

Calculation of calibrated energy intake

The calibrated EI was calculated using a previously developed equation(Reference Watanabe, Nanri and Sagayama7) aimed at attenuating the systematic errors derived from some variables. The EI (estimated using FFQ data) was calibrated via a stepwise multiple regression model using TEE (measured using the DLW technique) as the dependent variable. Age, sex, BMI and EI estimated using FFQ data were included in the model as significant independent variables. The determinant coefficient (R 2) of the linear regression analysis was 0·36(Reference Watanabe, Nanri and Sagayama7). The models followed the following equation:

$$\eqalign{C\; = \; {\beta _0}\; + \;{\beta _1}\;ag{e_1}\left( {1\;if \ge 75\;years,0\;if{\rm{ \lt }}75\;years} \right) + {\beta _2}\;se{x_2}\left( {1{\mkern 1mu} if\;female,0\;if\;male} \right) + \;{\beta _3}\;BM{I_3}\; + \;{\beta _4}\;E{I_4}$$

In the above equation, C is the calibrated EI. The intercept (β 0) was 1384.92 kcal (5795 kJ) in this FFQ. For binary variables, –166.98 kcal (–699 kJ) was the coefficient (β 1) for age and – 354.72 kcal (–1484 kJ) was the coefficient (β 2) for sex. For continuous variables, the coefficient for BMI (β 3) was 25.55 kcal (107 kJ/kg/m2) and that for EI (β 4) was 0.24 kcal (1 kJ). This each coefficient was multiplied by a value for the age (1 if≥ 75 years, 0 if < 75 years), sex (1 if female, 0 if male), BMI (continuous) and EI (continuous), and all of the values were summed to obtain a calibrated EI.

BMI was calculated by dividing the self-reported body weight (kg) by the square of the height (m). We previously reported that self-reported BMI did not differ from measured BMI (mean difference: 0.4 kg/m2 in men and 0.5 kg/m2 in women) in this cohort; the Pearson’s correlation coefficient between BMI derived from self-report and those derived from measurement was 0.916 in men and 0.912 in women(Reference Watanabe, Yoshida and Watanabe16). In addition, the interclass correlation coefficient (ICC) as a measure of the reproducibility of self-reported BMI was 0.910 for men and 0.888 for women(Reference Watanabe, Yoshida and Watanabe16).

Doubly labelled water

TEE was measured using the DLW method over approximately 2 weeks during May–June 2012 and August 2012. The details have been explained elsewhere(Reference Watanabe, Nanri and Sagayama7,Reference Yamada, Hashii-Arishima and Yokoyama22) . In brief, we collected the participants’ urine samples before they drank DLW on the morning of day 0 (baseline). Thereafter, the participants drank water containing a premixed dose of 0.12 g/kg estimated total body water of 2H2O (99.9 atom %, Taiyo Nippon Sanso, Tokyo, Japan) and 2.5 g/kg estimated total body water of H218O (10.0 atom %, Taiyo Nippon Sanso, Tokyo, Japan). The urine samples were collected on the morning of days 1, 2, 8, 9, 15 and 16. Concentration of 18O (No) and 2H (Nd) in the urine samples was measured using isotope ratio MS (Hydra 20-20 Stable Isotope Mass Spectrometers; SerCon Ltd, Crewe, UK). The No and Nd dilution spaces were determined by dividing the dose of the administered tracer (as moles of 2H- or 18O-water) using the intercept method at baseline and on days 1, 2, 8, 9, 15 and 16. TEE was calculated using the modified Weir’s equation using the carbon dioxide production rate (rCO2 (mol/d)) and 24-h estimated RER(Reference Weir23). The rCO2 (mol/d) was calculated using the rates of 18O and 2H elimination per d. The RER used for TEE calculation was set at 0.86 for all participants based on previous observations(Reference Sagayama, Yamada and Racine24). We assumed perfect nourishment balance conditions, which determine that the food quotient has to be equal to the RER(Reference Black, Prentice and Coward25).

Statistical analysis

Descriptive statistics for categorical variables are expressed as numbers of individuals and percentages. The variables for missing values were supplemented through multivariate imputation from five data sets using the R multivariate imputation by chained equation package(Reference van Buuren and Groothuis-Oudshoorn26). All missing values were assumed to be missing at random.

We examined the data for distribution and normality (skewness and kurtosis). The large main cohort data were normally distributed, according to a Jarque–Bera test, and the small sub-cohort data were non-normally distributed, according to a Shapiro–Wilk test (see online Supplemental Fig. 1). To display these variables consistently, the variables such as EI and TEE are shown as median with interquartile range (IQR).

To evaluate the accuracy of the median EI, we used the Wilcoxon signed-rank test to compare the TEE measured by DLW and the uncalibrated and calibrated EI. The ranking of an individual’s EI was evaluated using Spearman’s rank correlation analysis between the TEE and uncalibrated and calibrated EI. Deattenuated correlation coefficients were calculated using Willett’s equation to correct within-person variation in the DLW method that was performed twice (May–June and August 2012)(Reference Willett3). Using the previously established equation(Reference Meng, Rosenthal and Rubin27), we were compared the equivalence of validity of the EI by the correlation coefficients between the uncalibrated and calibrated EI estimated using FFQ data against the TEE. We evaluated the reproducibility of the EI estimated from the FFQ obtained twice using the ICC.

We validated the group and individual mean uncalibrated and calibrated EI, estimated using FFQ data, by using previously reported equations(Reference Watanabe, Nanri and Yoshida2). These equations used within-person variance, between-person variance and a ratio of within-person to between-person variance to estimate the required sample size and the appropriate number of survey repetitions. These analyses were also performed after stratifying the sample by sex(Reference Watanabe, Nanri and Yoshida2).

In the main cohort, we compared the uncalibrated and calibrated EI and the EI/predicted BMR (pBMR) using the Wilcoxon signed-rank test. The pBMR was estimated using the equation by Ganpule et al. for Japanese individuals(Reference Ganpule, Tanaka and Ishikawa-Takata28) given that, in a comparison of several different equations for calculating pBMR, this equation provided the best results(Reference Miyake, Tanaka and Ohkawara29). EI is predicted to exhibit a negative correlation with age and a positive correlation with BMI and body weight(Reference Hall, Sacks and Chandramohan30). We compared the associations of calibrated and uncalibrated EI with age, body weight and BMI.

For all statistical analyses, the two-sided level of significance was 5 %. All analyses were conducted using JMP Pro for Windows (SAS Institute Inc.) and/or R software 3.4.3 (R Core Team).

Results

Table 1 shows the participants’ characteristics stratified by sex in the cohort. The participants of the sub-cohort, for whom TEE was measured using DLW, tended to be male, alcohol drinkers, and have attained higher education than the remainder of the main cohort; however, these differences were minor.

Table 1 Comparison of the characteristics of the participants included in the main and sub-cohorts stratified by sex

HSES, high socio-economic status.

* Missing values were supplemented using the multivariate imputation method: smoking status (n 366; 4.5 %), alcohol drinker (n 312; 3.9 %), family structure (n 626; 7.8 %), socio-economic status (n 389; 4.8 %), education attainment (n 939; 11.7 %), denture use (n 220; 2.7 %) and medications (n 648; 8.0 %).

BMI was calculated as body weight (kg) divided by height squared (m2).

Table 2 shows the comparison of TEE, measured using DLW, and uncalibrated and calibrated EI, assessed using FFQ data. Among all participants, the median TEE, uncalibrated EI and calibrated EI were 8559 kJ, 7088 kJ and 9269 kJ, respectively. The uncalibrated EI was significantly lower than the TEE (median difference = –1847 kJ; IQR: –2785 to –1096), but the calibrated EI (median difference = 463 kJ; IQR: –330 to 1541) was comparable to the TEE. Similar findings were observed when stratifying the sample by age, sex and BMI, with more marked results for men, individuals aged < 75 years, and for those with a BMI of ≥ 25 kg/m2. The uncalibrated (crude: r = 0.275; deattenuated: r = 0.306) and calibrated EI (crude: r = 0.517; deattenuated: r = 0.576) significantly correlated with the TEE measured using DLW. Moreover, Meng’s Z-test comparison revealed a significant difference in the correlation coefficient between uncalibrated and calibrated EI, estimated using FFQ data, against the TEE. The reproducibility (ICC) of the TEE measured using DLW was 0.619 (see online Supplemental Table 1), and it was higher for the calibrated EI (ICC = 0.982) than for the uncalibrated EI (ICC = 0.637; Table 3).

Table 2 Validation of uncalibrated and calibrated energy intake against TEE measured using the DLW method

CC, correlation coefficient; DLW, doubly labelled water; IQR, interquartile range; TEE, total energy expenditure.

* Indicates statistical significance (P < 0 05).

The variables are shown as median (IQR).

The values are shown as median difference (IQR). Statistical analysis was conducted by using a Wilcoxon signed-rank test.

§ The values are shown as Spearman’s rank correlation coefficient. Deattenuated correlation coefficients were calculated using Willett’s equation(Reference Willett3) to correct within-person variation in the twice-performed DLW method in May–June and August 2012. The deattenuated correlation was calculated according to the following: r c = r o (1 + (S2 w/S2 b)n)0.5; r c, corrected correlation coefficient; r o, observed correlation coefficient; S2 w, within-person variance; S2 b, between-person variance; n, number of replicates per person. Details of the within- and between-person variations used in this calculation are provided in Supplemental Table 1.

|| To compare the ranking of an individual’s energy intake between uncalibrated and calibrated estimates determined from FFQ data, we used the Meng et al. equation(Reference Meng, Rosenthal and Rubin27). If the results presented significant differences, these relationships were interpreted as not being equivalent.

Energy intake conversion factor: 1 kJ = 0.239 kcal.

Table 3 Reproducibility of uncalibrated and calibrated energy intake estimated using FFQ data assessed twice

ICC, intraclass correlation coefficient; IQR, interquartile range.

* Statistical significance (P < 0.05).

First and second surveys were conducted on 14 February 2012 and August 2012, respectively. The variables are shown as median (IQR).

The values are shown as median difference (IQR). Statistical analysis was conducted using a Wilcoxon signed-rank test.

§ Intraclass correlation coefficients were analysed using Pearson’s correlation analysis.

Energy intake conversion factor: 1 kJ = 0.239 kcal.

Table 4 shows the sample size and number of survey repetitions required for uncalibrated and calibrated EI stratified by sex. To estimate a group’s ‘true’ mean uncalibrated and calibrated EI using FFQ data within a 95 % CI with 0.5 % deviation, 13 327 and 1972 participants were needed, respectively. For uncalibrated and calibrated EI, the FFQ needed to be repeated four times and once, respectively, to obtain a correlation coefficient (r) of 0.95 between an individual’s measured value and their ‘true’ unmeasured mean EI. These differences did not greatly differ when the sample was stratified by sex.

Table 4 The sample size and frequency of surveys required for uncalibrated and calibrated energy intake estimation stratified by sex

CC, correlation coefficient; CVb, coefficient of between-person variation; CVw, coefficient of within-person variation; EI, energy intake; VR, within-person/between-person variance ratio.

* The within-person variance (CVw) and between-person variance (CVb) for EI were calculated using ANOVA.

The group size = 1.962×[(CVb2 + CVw2)/D02] was required to estimate a group’s ‘true’ mean EI within a 95 % CI with a specified % deviation (D0). All values represent group sizes.

The number of dietary survey repetitions (ND1) = [r 2/(1 − r 2)]×VR was required to obtain a specified CC between an individual’s estimated and unestimated ‘true’ mean EI, where r is the specified CC and an index of confidence related to an individual’s classification or ranking within a population. All values represent numbers of measurements.

§ The number of dietary survey repetitions (ND2) = (1.96 × CVw/D1)2 required to estimate an individual’s ‘true’ mean EI within a 95 % CI with a specified % deviation (D1). All values represent numbers of measurements.

We compared the calibrated and uncalibrated EI in the main cohort (Table 5). Among all participants, the median EI with and without calibration was 8756 kJ/d (IQR: 7973 to 9939) and 7222 kJ/d (IQR: 6219 to 8451), respectively (median difference = −1525 kJ (IQR:−2336 to−720); P < 0.01). Similar findings were observed when the sample was stratified by age, sex and BMI, with more marked results for BMI (<18.5 kg/m2: median difference = −829 kJ(IQR:−1547 to−179); 18.5–24.9 kg/m2: median difference = −1459 kJ (IQR:−2193 to−689);≥25 kg/m2: median difference = −2148 kJ (IQR:−3010 to −1309); P < 0.01). Although it was confirmed that the main cohort data were normally distributed, these results were similar to those of paired t test as a parametric statistic (see online Supplemental Table 2). These results were similar for EI/pBMR (see online Supplemental Table 3). Moreover, calibrated EI significantly correlated with age (r = −0.296), body weight (r = 0.707) and BMI (r = 0.367), but no correlation with these variables was evident for uncalibrated EI (see online Supplemental Table 4).

Table 5 Comparison of calibrated and uncalibrated energy intakes in main cohort

IQR, interquartile range.

* Indicates statistical significance (P < 0.05).

Values are expressed as median (IQR).

To compare the uncalibrated and calibrated energy intake, statistical analysis was conducted using a Wilcoxon signed-rank test.

Energy intake conversion factor: 1 kJ = 0.239 kcal.

Discussion

These results underscore the importance of biomarker calibration methods in nutritional epidemiological research. When compared to TEE measured using the DLW method, our results indicated that calibrated EI was more accurate and precise than uncalibrated EI. Additionally, we observed that the calibration approach substantially improved sample size and the number of survey repetitions required for EI stratified by sex, which was not considered in the previous study(Reference Neuhouser, Tinker and Shaw5). Moreover, the uncalibrated EI derived from FFQ data was lower (about 17 %) than the calibrated EI in the main cohort. To the best of our knowledge, this is the first study to demonstrate that the calibration approach using a biomarker improves not only the systematic errors of self-reported EI but also sample size and the number of survey repetitions required for EI estimation. Therefore, these results may provide useful insights into the effective approach for improving statistical power to detect and verify diet–disease associations in cohort studies using an FFQ where sample size cannot be increased for a variety of reasons.

FFQ are widely used in large-scale epidemiological studies; however, their findings are more uncertain than those of carefully conducted DR or 24-h dietary recall(Reference Park, Dodd and Kipnis6,Reference Watanabe, Nanri and Sagayama7) . Our previous findings indicated that, compared with TEE measured using the DLW method, the 7-d DR underestimates EI by approximately 9 % whereas the FFQ underestimates EI by approximately 18 %(Reference Watanabe, Nanri and Sagayama7). To rectify the underestimation of dietary intake estimated from FFQ, a recent review emphasised using the regression calibration approach to attenuate measurement errors of nutrient intake in nutritional epidemiology(Reference Bennett, Landry and Little31). According to a systematic review, to date, many studies have used this approach by estimating dietary intake using DR and 24-h dietary recall as references(Reference Bennett, Landry and Little31). However, it is unclear whether systematic errors due to self-report bias can be reduced using statistical techniques based on dietary intake data estimated using self-reported dietary assessment methods, such as DR and 24-h dietary recall(Reference Looman, Boshuizen and Feskens32). Our results indicate that the uncalibrated EI was significantly lower than the TEE, but the calibrated EI was comparable to the TEE, and similar findings were observed when stratifying the sample by age, sex and BMI. Objective biomarkers may not affect the systematic errors caused by reporting bias in self-reported dietary assessments, such as DR and 24-h dietary recall(Reference Korth, Bhutani and Neuhouser1,Reference Park, Dodd and Kipnis6,Reference Watanabe, Nanri and Sagayama7) . Therefore, it is important to consider which biases can be rectified using the biomarker calibration approach, and our developed equation may attenuate some systematic errors related to variables such as age, sex and BMI.

Our findings indicate that calibrated EI had a higher reproducibility than uncalibrated EI. The lower within- and between-person variance observed for calibrated EI could be a possible explanation for this difference. When the within- and between-person variance in a population is high, surveys need to be conducted more frequently and with larger samples to accurately assess dietary intake(Reference Watanabe, Nanri and Yoshida2). For the population in this study, assessment of uncalibrated and calibrated EI would require the FFQ to be repeated four times and once, respectively, to achieve a correlation coefficient of (r) < 0.95 between the observed and ‘true’ mean intake. Previous evidence indicates that the reproducibility (Pearson’s correlation coefficient) of TEE measured using DLW is 0.72(Reference Neuhouser, Tinker and Shaw5). In fact, most biomarkers are considered representative of a person’s ‘true’ nutritional status, presuming that low within-person variation exists(Reference Kaaks33,Reference Neuhouser, Patterson and King34) . Similarly, our results indicate that the reliability of the TEE estimates for replicate measures was rather good (ICC = 0.619), with the within-person variation for TEE being lower than that of the uncalibrated EI estimated using FFQ data (9.8 % for TEE; 12.6 % for EI). The above-mentioned studies and our findings indicate that calibrated EI is more reliable and reproducible compared to uncalibrated EI.

In this study, the uncalibrated EI was significantly lower than the calibrated EI in the main cohort (median difference: –1525 kJ) and lower than the TEE in the sub-cohort (median difference: –1847 kJ). These differences were similar to those between the calibrated EI and TEE. The fact that BMI increases concurrently with EI is predictable based on energy input and output(Reference Hall, Sacks and Chandramohan30). Some previous studies reported a larger magnitude of measurement errors and a higher frequency of EI underreporting in individuals with obesity(Reference Schoeller, Thomas and Archer9Reference Murakami, Livingstone and Okubo12). Similarly, our results revealed a larger difference between uncalibrated and calibrated EI in participants with a higher BMI. Moreover, the correlations between EI and age, body weight, and BMI were significant for the calibrated EI but not for the uncalibrated EI. The average BMI reportedly increases proportionally with a rise in a region’s population size(35) and the prevalence of obesity in adults is predicted to increase in the USA(35,Reference Ward, Bleich and Cradock36) . Emphasising the importance of some behaviours can lead to an increase in systematic reporting bias because participants may modify their reports in the desired direction without actual behavioural change(Reference Taber, Stevens and Murray37). As such, media and public health messages about the importance of combating obesity(Reference Hilton, Patterson and Teyhan38) that primarily focus on eating less could potentially explain why participants may underreport their EI. Similarly, age and sex are factors that contribute to misreporting of dietary intake(Reference Murakami and Livingstone11,Reference Murakami, Livingstone and Okubo12) . Using a biomarker calibration approach could reduce the age-, sex- and BMI-related systemic bias and may help verify diet–disease associations, especially in regions with a higher prevalence of obesity.

The main strength of this study is that it not only confirmed the accuracy of calibrated EI against TEE measured using DLW but also highlighted the reproducibility of calibrated EI assessed using FFQ data. These data are essential to confirm the precision of previously developed equations for calibration models. The reliability of the calibrated EI estimates was acceptable. However, the study also had a few methodological limitations. Firstly, the calibration equation used in this study was based on the TEE in a subsample of participants with stable body weight in the Kyoto–Kameoka Study(Reference Watanabe, Nanri and Sagayama7). The TEE, measured using the DLW method, is assumed to provide a true reflection of EI in individuals with stable body weight. However, if the study cohort included participants with unstable body weight, the estimated calibrated EI could contain systematic errors. In addition, to evaluate the validity of DLW-calibrated EI, we used replicate measures of TEE measured using the DLW method in the population wherein the calibration equation was developed. Further evaluation is needed to verify this equation’s validity in other participants from the Kyoto–Kameoka Study. Secondly, since we relied on self-reported information for weight and height in this study, we were unable to completely exclude systematic errors due to self-reporting. For example, the BMI included in the DLW calibration equation was derived from self-reported data and could be inadequate as calibration factors. Nevertheless, calibration of the EI reduced the underestimation of EI against the TEE measured using the DLW technique. In addition, we previously reported that the estimates of self-reported height, body weight and BMI among older adults in this sub-cohort are sufficiently accurate and reproducible(Reference Watanabe, Yoshida and Watanabe16), similar to observations of another Japanese cohort study(Reference Wada, Tamakoshi and Tsunekawa39). Finally, this study used a new equation to calibrate EI calculated with a TEE measured using the DLW technique as a recovery biomarker. This equation may have excluded other covariates that were not assessed in the Kyoto–Kameoka Study but potentially contributed to the systematic measurement errors. This may be the cause of the lower value of the determinant coefficient (R 2). These limitations may make generalisation of the results difficult. Therefore, verification by a well-designed study with a larger randomised sample is needed to elucidate whether the determinant coefficient of the calibration equation increases by further inclusion of covariates that may potentially contribute to the systematic measurement errors.

Recently, cohort studies reported that EI or protein intake estimated using the biomarker calibration approach is associated with the prevalence of frailty(Reference Watanabe, Yoshida and Nanri15), incidence of diabetes(Reference Tinker, Sarto and Howard14), cancer(Reference Prentice, Shaw and Bingham40) and risk of CVD events(Reference Prentice, Huang and Kuller41), whereas self-reported dietary intake demonstrated only weak(Reference Watanabe, Yoshida and Nanri15) or no associations(Reference Tinker, Sarto and Howard14,Reference Prentice, Shaw and Bingham40,Reference Prentice, Huang and Kuller41) with these factors. Perhaps, the difficulty in accurately measuring dietary intake from self-reported dietary assessments may explain why a clear association between diet and disease has not been established yet. Many authors consider that self-reported EI should not be taken into account when investigating the risk factors for diseases associated with overweight and obesity(Reference Tinker, Sarto and Howard14,Reference Watanabe, Yoshida and Nanri15,Reference Prentice, Shaw and Bingham40,Reference Prentice, Huang and Kuller41) . Underreporting of EI by individuals with obesity may disturb the accurate estimation of the effect of EI on the risk of diseases, such as diabetes and heart disease, which are associated with overweight rather than underweight. We plan to apply these biomarker-calibrated EI in the diet–disease analyses of the Kyoto–Kameoka Study cohort. The use of this approach holds promise for providing accurate EI values that can help establish guidelines applicable to public health and clinical nutrition.

Conclusions

The findings of our study demonstrate that calibrated EI was more accurate and precise than uncalibrated EI against TEE measured using the DLW technique. Further, the uncalibrated EI values were approximately 17 % lower than calibrated EI values in the main cohort. Therefore, using biomarkers to calibrate EI could partially resolve the systematic errors that have hindered nutritional epidemiological research for several decades and may prove useful in closing the knowledge gap in diet–disease associations.

Acknowledgements

Acknowledgements: We thank all members of the Kyoto–Kameoka Study group for their valuable contributions. We acknowledge several administrative staff of Kameoka City and Kyoto Prefecture. We wish to express our gratitude to all the participants for their cooperation in this study. The authors also thank Shinkan Tokudome, who was a former director of the National Institute of Nutrition and Health for providing useful FFQ advice. We would like to thank Editage (www.editage.jp) for English-language editing. Financial support: The Kyoto–Kameoka Study was conducted with JSPS KAKENHI and was supported by a research grant provided to Misaka Kimura (grant number 24240091), Yosuke Yamada (grant number 15H05363) and Daiki Watanabe (grant number 21K17699); a grant and administrative support by the Kyoto Prefecture Community-based Integrated Elderly Care Systems Promotion Organization since 2011; and Kameoka City under the programme of the Long-term Care Insurance and Planning Division of the Health and Welfare Bureau for the Elderly, the Ministry of Health, Labour and Welfare, and the WHO Collaborating Centre on Community Safety Promotion. Conflicts of interest: There are no conflicts of interest. Authorship: The authors’ responsibilities were as follows: H.F., M.K. and Y.Y.: designed the research (project conception, development of overall research plan and study oversight); T.Y., E.Y., K.I.-T., N.E., M.K. and Y.Y.: conducted the research (data collection); D.W., H.N., C.G. and K.I.-T.: analysed the data or performed statistical analysis; D.W. and Y.Y.: data interpretation; D.W. and Y.Y.: literature review; D.W. and Y.Y. wrote the paper; D.W., T.Y., E.Y., H.N., C.G., K.I.-T., N.E., H.F., M.K. and Y.Y. had primary responsibility for the final content. All authors read and approved the final manuscript. Ethics of human subject participation: This study was conducted according to the guidelines laid down in the 1964 Declaration of Helsinki and all procedures involving research study participants were approved by the Research Ethics Committee of Kyoto Prefectural University of Medicine (RBMR-E-363), the National Institutes of Biomedical Innovation, Health and Nutrition (NIBIOHN-76-2), and Kyoto University of Advanced Science (No. 20-1). Informed consent was obtained from all individual participants.

Supplementary material

For supplementary material accompanying this paper visit https://doi.org/10.1017/S1368980021003785

References

Korth, AL, Bhutani, S, Neuhouser, ML et al. (2020) Comparison of methods used to correct self-reported protein intake for systematic variation in reported energy intake using quantitative biomarkers of dietary intake. J Nutr 150, 13301336.CrossRefGoogle ScholarPubMed
Watanabe, D, Nanri, H, Yoshida, T et al. (2019) Validation of energy and nutrition intake in Japanese elderly individuals estimated based on a short food frequency questionnaire compared against a 7-d dietary record: the Kyoto-Kameoka study. Nutrients 11, 688.CrossRefGoogle Scholar
Willett, W (2012) Nutritional Epidemiology, 3rd ed. New York: Oxford University Press.CrossRefGoogle Scholar
Livingstone, MB & Black, AE (2003) Markers of the validity of reported energy intake. J Nutr 133, Suppl. 3, 895S920S.CrossRefGoogle ScholarPubMed
Neuhouser, ML, Tinker, L, Shaw, PA et al. (2008) Use of recovery biomarkers to calibrate nutrient consumption self-reports in the women’s health initiative. Am J Epidemiol 167, 12471259.CrossRefGoogle ScholarPubMed
Park, Y, Dodd, KW, Kipnis, V et al. (2018) Comparison of self-reported dietary intakes from the automated self-administered 24-h recall, 4-d food records, and food-frequency questionnaires against recovery biomarkers. Am J Clin Nutr 107, 8093.CrossRefGoogle ScholarPubMed
Watanabe, D, Nanri, H, Sagayama, H et al. (2019) Estimation of energy intake by a food frequency questionnaire: calibration and validation with the doubly labeled water method in Japanese older people. Nutrients 11, 1546.CrossRefGoogle ScholarPubMed
Prentice, RL, Mossavar-Rahmani, Y, Huang, Y et al. (2011) Evaluation and comparison of food records, recalls, and frequencies for energy and protein assessment by using recovery biomarkers. Am J Epidemiol 174, 591603.CrossRefGoogle ScholarPubMed
Schoeller, DA, Thomas, D, Archer, E et al. (2013) Self-report-based estimates of energy intake offer an inadequate basis for scientific conclusions. Am J Clin Nutr 97, 14131415.CrossRefGoogle ScholarPubMed
Tomoyasu, NJ, Toth, MJ & Poehlman, ET (1999) Misreporting of total energy intake in older men and women. J Am Geriatr Soc 47, 710715.CrossRefGoogle ScholarPubMed
Murakami, K & Livingstone, MB (2015) Prevalence and characteristics of misreporting of energy intake in US adults: NHANES 2003–2012. Br J Nutr 114, 12941303.CrossRefGoogle ScholarPubMed
Murakami, K, Livingstone, MBE, Okubo, H et al. (2018) Prevalence and characteristics of misreporting of energy intake in Japanese adults: the 2012 national health and nutrition survey. Asia Pac J Clin Nutr 27, 441450.Google ScholarPubMed
Lachat, C, Hawwash, D, Ocke, MC et al. (2016) Strengthening the reporting of observational studies in epidemiology-nutritional epidemiology (STROBE-nut): an extension of the STROBE statement. PLoS Med 13, e1002036.10.1371/journal.pmed.1002036CrossRefGoogle ScholarPubMed
Tinker, LF, Sarto, GE, Howard, BV et al. (2011) Biomarker-calibrated dietary energy and protein intake associations with diabetes risk among postmenopausal women from the women’s health initiative. Am J Clin Nutr 94, 16001606.CrossRefGoogle ScholarPubMed
Watanabe, D, Yoshida, T, Nanri, H et al. (2021) Association between the prevalence of frailty and doubly labeled water-calibrated energy intake among community-dwelling older adults. J Gerontol A Biol Sci Med Sci 76, 876884.CrossRefGoogle ScholarPubMed
Watanabe, D, Yoshida, T, Watanabe, Y et al. (2020) A U-shaped relationship between the prevalence of frailty and body mass index in community-dwelling Japanese older adults: the Kyoto-Kameoka study. J Clin Med 9, 1367.CrossRefGoogle ScholarPubMed
Yamada, Y, Nanri, H, Watanabe, Y et al. (2017) Prevalence of frailty assessed by fried and Kihon checklist indexes in a prospective cohort study: design and demographics of the Kyoto-Kameoka longitudinal study. J Am Med Dir Assoc 18, 733.e7733.e15.CrossRefGoogle Scholar
Imaeda, N, Goto, C, Tokudome, Y et al. (2007) Reproducibility of a short food frequency questionnaire for Japanese general population. J Epidemiol 17, 100107.CrossRefGoogle Scholar
Tokudome, S, Goto, C, Imaeda, N et al. (2004) Development of a data-based short food frequency questionnaire for assessing nutrient intake by middle-aged Japanese. Asian Pac J Cancer Prev 5, 4043.Google ScholarPubMed
Tokudome, Y, Goto, C, Imaeda, N et al. (2005) Relative validity of a short food frequency questionnaire for assessing nutrient intake v. 3-d weighed diet records in middle-aged Japanese. J Epidemiol 15, 135145.CrossRefGoogle Scholar
Council for Science and Technology & Ministry of Education, Culture, Sports, Science and Technology (2001) Standard Tables of Food Composition in Japan, Fifth Revised and Enlarged Edition. Tokyo, Japan: National Printing Bureau.Google Scholar
Yamada, Y, Hashii-Arishima, Y, Yokoyama, K et al. (2018) Validity of a triaxial accelerometer and simplified physical activity record in older adults aged 64–96 years: a doubly labeled water study. Eur J Appl Physiol 118, 21332146.CrossRefGoogle ScholarPubMed
Weir, JB (1949) New methods for calculating metabolic rate with special reference to protein metabolism. J Physiol 109, 19.CrossRefGoogle ScholarPubMed
Sagayama, H, Yamada, Y, Racine, NM et al. (2016) Dilution space ratio of 2H and 18O of doubly labeled water method in humans. J Appl Physiol 120, 13491354.CrossRefGoogle ScholarPubMed
Black, AE, Prentice, AM & Coward, WA (1986) Use of food quotients to predict respiratory quotients for the doubly-labelled water method of measuring energy expenditure. Hum Nutr Clin Nutr 40, 381391.Google ScholarPubMed
van Buuren, S & Groothuis-Oudshoorn, K (2011) Mice: multivariate imputation by chained equations in R. J Stat Softw 45, 167.Google Scholar
Meng, X, Rosenthal, R & Rubin, DB (1992) Comparing correlated correlation coefficients. Psychol Bull 111, 172175.CrossRefGoogle Scholar
Ganpule, AA, Tanaka, S, Ishikawa-Takata, K et al. (2007) Interindividual variability in sleeping metabolic rate in Japanese subjects. Eur J Clin Nutr 61, 12561261.CrossRefGoogle ScholarPubMed
Miyake, R, Tanaka, S, Ohkawara, K et al. (2011) Validity of predictive equations for basal metabolic rate in Japanese adults. J Nutr Sci Vitaminol 57, 224232.CrossRefGoogle ScholarPubMed
Hall, KD, Sacks, G, Chandramohan, D et al. (2011) Quantification of the effect of energy imbalance on bodyweight. Lancet 378, 826837.CrossRefGoogle ScholarPubMed
Bennett, DA, Landry, D, Little, J et al. (2017) Systematic review of statistical approaches to quantify, or correct for, measurement error in a continuous exposure in nutritional epidemiology. BMC Med Res Methodol 17, 146.CrossRefGoogle ScholarPubMed
Looman, M, Boshuizen, HC, Feskens, EJ et al. (2019) Using enhanced regression calibration to combine dietary intake estimates from 24 h recall and FFQ reduces bias in diet-disease associations. Public Health Nutr 22, 27382746.CrossRefGoogle ScholarPubMed
Kaaks, RJ (1997) Biochemical markers as additional measurements in studies of the accuracy of dietary questionnaire measurements: conceptual issues. Am J Clin Nutr 65, 1232S1239S.CrossRefGoogle ScholarPubMed
Neuhouser, ML, Patterson, RE, King, IB et al. (2003) Selected nutritional biomarkers predict diet quality. Public Health Nutr 6, 703709.CrossRefGoogle ScholarPubMed
NCD Risk Factor Collaboration (2019) Rising rural body-mass index is the main driver of the global obesity epidemic in adults. Nature 569, 260264.CrossRefGoogle Scholar
Ward, ZJ, Bleich, SN, Cradock, AL et al. (2019) Projected U.S. state-level prevalence of adult obesity and severe obesity. N Engl J Med 381, 24402450.CrossRefGoogle ScholarPubMed
Taber, DR, Stevens, J, Murray, DM et al. (2009) The effect of a physical activity intervention on bias in self-reported activity. Ann Epidemiol 19, 316322.CrossRefGoogle ScholarPubMed
Hilton, S, Patterson, C & Teyhan, A (2012) Escalating coverage of obesity in UK newspapers: the evolution and framing of the “obesity epidemic” from 1996 to 2010. Obesity 20, 16881695.CrossRefGoogle ScholarPubMed
Wada, K, Tamakoshi, K, Tsunekawa, T et al. (2005) Validity of self-reported height and weight in a Japanese workplace population. Int J Obes 29, 10931099.CrossRefGoogle Scholar
Prentice, RL, Shaw, PA, Bingham, SA et al. (2009) Biomarker-calibrated energy and protein consumption and increased cancer risk among postmenopausal women. Am J Epidemiol 169, 977989.CrossRefGoogle ScholarPubMed
Prentice, RL, Huang, Y, Kuller, LH et al. (2011) Biomarker-calibrated energy and protein consumption and cardiovascular disease risk among postmenopausal women. Epidemiology 22, 170179.CrossRefGoogle ScholarPubMed
Figure 0

Table 1 Comparison of the characteristics of the participants included in the main and sub-cohorts stratified by sex

Figure 1

Table 2 Validation of uncalibrated and calibrated energy intake against TEE measured using the DLW method

Figure 2

Table 3 Reproducibility of uncalibrated and calibrated energy intake estimated using FFQ data assessed twice

Figure 3

Table 4 The sample size and frequency of surveys required for uncalibrated and calibrated energy intake estimation stratified by sex

Figure 4

Table 5 Comparison of calibrated and uncalibrated energy intakes in main cohort

Supplementary material: File

Watanabe et al. supplementary material

Watanabe et al. supplementary material 1

Download Watanabe et al. supplementary material(File)
File 63.4 KB
Supplementary material: File

Watanabe et al. supplementary material

Watanabe et al. supplementary material 2

Download Watanabe et al. supplementary material(File)
File 37.5 KB