Online Dietary Intake Estimation: Reproducibility and Validity of the Food4Me Food Frequency Questionnaire Against a 4-Day Weighed Food Record

1Given the continuing rise in some noncommunicable diseases and the growing burden of diet-related ill health, researchers are seeking new and innovative ways of facilitating dietary change. These include the application of digital technologies, which are revolutionizing the delivery of health-related services because of their reduced costs and wide reach. Online interventions are particularly promising because they have the potential to increase exposure to health promotion material. Recent estimates show that Internet use has increased by >150% in North America and by nearly 400% in Europe since 2000, with a total of 78.6% and 63.2% of these populations, respectively, now classified as Internet users. Given their lower costs, Internet-based services have the potential to enhance the cost-benefit ratio for interventions aimed at prevention of diet-related noncommunicable diseases. Furthermore, interactive Web-based interventions have been shown to increase patient activation and self-management capabilities in chronically ill adults and enhance weight loss in obese individuals (compared with non-Web-based interventions).

2To quantify dietary change in response to an intervention, an accurate and validated means of assessing food intake is essential. Population-level food intake is usually assessed in 1 of 3 ways: a food frequency questionnaire (FFQ), 24-hour recall, or estimated or weighed food record (WFR). The WFR, which involves weighing all foods and drinks consumed over a 3-7 day period, is often considered the most accurate measure of intake and has been referred to as the imperfect gold standard. However, prospective recording of food consumption can alter the type and quantity of foods eaten and, therefore, introduce bias into the estimate of food intake. The FFQ and 24-hour recall, which rely on retrospective recording of food consumption, are also prone to reporting bias, including overestimated consumption of “healthy” foods, such as fruit and vegetables, and underestimation of “unhealthy” food intake. WFR require participants to be highly motivated and are labor-intensive for both participants and researchers. Conversely, FFQ are inexpensive to process and can be self-administered electronically, making them suitable for online interventions. Other advantages include reducing paper use, postage costs, and the space; security; and organization required for paper file storage. For this reason, FFQ are most commonly used in large-scale epidemiological and intervention studies to determine food and nutrient intake.

3The present research was conducted as part of the Food4Me study, which aims to test the utility of online personalized dietary advice using an online FFQ to assess dietary intake. The Food4Me FFQ includes 157 food items and food portion photographs and has been described previously by Forster et al. FFQ are generally validated against existing dietary assessment methods, such as WFR, and several FFQ have been validated for electronic and online use recently.

4The Food4Me FFQ has been shown to have good agreement with the European Prospective Investigation of Cancer (EPIC)-Norfolk FFQ for the estimation of energy-adjusted nutrient intakes. The aim of this study is to further validate the Food4Me FFQ against a WFR and to assess its reproducibility using a test-retest methodology.

5To accurately estimate the Bland-Altman limits of agreement between 2 methods, a sample size of 50-100 is required. Allowing for 20% dropout, 121 participants aged ≥18 years were recruited from the University of Reading, UK, via email and poster advertising. Participants were provided with a study information sheet before participation and were asked to sign an informed consent form. A participant information form, which included self-reported weight and height measurements, was used to assess suitability for the study. Individuals reporting health issues or ill health, self-reported or diagnosed food intolerances, or special nutritional requirements (eg, pregnancy or lactation) were ineligible to participate. Ethical approval for the study was obtained from the School of Chemistry, Food and Pharmacy Research Ethics Committee, University of Reading, UK (01-12-Lovegrove).

6Reproducibility of the Food4Me FFQ was determined by asking participants to complete the questionnaire on 2 occasions 4 weeks apart, mimicking its application in the Food4Me study. To assess the validity of the FFQ against a 4-day WFR, half the sample (those recruited first) were asked to complete a 4-day WFR 1 week following the first administration of the Food4Me-FFQ. Participants who completed both the Food4Me FFQ and 4-day WFR were also asked to complete a dietary record usability-rating questionnaire on Survey Monkey (Survey Monkey Inc, Palo Alto, CA, USA) in the week following the completion of the second Food4Me FFQ. The usability-rating questionnaire included questions about ease of use and willingness to complete the records. Participants were asked not to change their diet during the study.

7Participants were asked to record all foods and beverages consumed over a nonconsecutive 4-day period that included 3 weekdays (Monday to Thursday) and 1 weekend day (Saturday to Sunday). Before completing the WFR, participants were coached on how to describe food products by a dietitian and provided with weighing scales (Salter Disc Electronic Kitchen Scales SKU# 1036 WHSSDR). When participants were unable to provide weighed portion size information, this was estimated retrospectively within 1 week using the Ministry of Agriculture, Fisheries and Food Portion Size Atlas.

8The self-administered Food4Me FFQ is an online, semiquantitative food frequency questionnaire (developed by University College Dublin and Crème Software Ltd). To complete the questionnaire, participants were provided with a website address and unique log-in details. On logging into the server, participants were directed to a webpage containing detailed instructions on how to complete the FFQ. The questionnaire contained questions on the average consumption of 157 food items over the previous month. The food items were divided into the following 11 categories: (1) cereal, (2) bread and savory biscuits, (3) potatoes, rice and pasta, (4) meat and fish, (5) dairy products and fat, (6) fats and spreads, (7) sweets and snacks, (8) soups, sauces and spreads, (9) drinks, (10) fruit, and (11) vegetables. During completion of the Food4Me FFQ, participants were required to provide information on frequency of consumption and portion size. Frequency of consumption was measured by selecting one of the following options: never or less than once a month, 1-3 times a month, once a week, 2-4 times a week, 5-6 times per week, once a day, 2-3 times per day, 5-6 times per day, and >6 times per day. Food portion size was estimated using photographs. Each food item had 3 photographs representing small, medium, and large portions and these descriptors were provided below the appropriate image. Participants could select one of the following options: very small, small, small/medium, medium, medium/large, large, or very large which were linked electronically to portion sizes (in grams) (see Figure 1). Food intake (g/day) was calculated by multiplying frequency of consumption by the specified portion size (see Forster et al for detailed methods). Further screenshots of the online Food4Me FFQ are shown in Multimedia Appendix 1.

9The dietary record usability-rating questionnaire was comprised of 5 questions about the completion of the Food4Me FFQ and the 4-day WFR. Participants who completed both the Food4Me FFQ and the 4-day WFR (n=49) were asked to select one of the following responses to indicate their level of agreement: strongly agree, agree, neither agree nor disagree, disagree, or strongly disagree to the following questions:

10I found the Food4Me FFQ / 4-day WFR easy to complete

11I found the Food4Me FFQ / 4-day WFR too time consuming

12I found the Food4Me FFQ / 4-day WFR interesting to complete

13I found the Food4Me FFQ / 4-day WFR made me reflect on my intake

14In the future I would be willing to complete more Food4Me FFQ/ 4-day WFR

15The Henry equation was used to calculate basal metabolic rate (BMR), and BMR was multiplied by a physical activity level (PAL) of 1.1 to calculate the lowest possible estimated energy requirements (EER) for each participant. Participants reporting energy intakes lower than their EER were classified as underreporters. Participants reporting a daily energy intake greater than 4500 kcal, which is considered implausibly high, were excluded from the analysis.

16Estimated nutritional intake data from the Food4Me FFQ were generated automatically by the online Food4Me programmed system, as described by Forster et al. Composition of the food items listed in the FFQ were derived from WISP (Tinuviel Software, Anglesey, UK) and modified to include recipes of composite dishes, generic commercial foods, new foods on the market, and current manufacturers information. The 4-day WFR intakes were analyzed using WISP (Tinuviel Software, Anglesey, UK). For the purpose of the current study, consumption of dietary supplements was not included in the analyses.

17Statistical analyses were performed using SPSS version 20.0 (IBM Corp, Armonk, NY, USA). Mean nutrient intakes and standard deviations were calculated for baseline characteristics, repeated Food4Me FFQ, and 4-day WFR. Differences in participant characteristics and energy intakes (kcal) were assessed using a paired 2-sample t test. Nutrient intakes were compared using general linear model (GLM) analysis controlling for energy and gender where there was significant interaction between gender and nutrient intake. Data were checked for normality using the Shapiro-Wilk test and, depending on the outcome, the association between dietary intake methods and repeated Food4Me FFQ were assessed using either Pearson product-moment correlation or Spearman correlation coefficient (SCC, rho). A P value of <.05 was considered statistically significant.

18The relative agreement between the dietary intake methods and repeated Food4Me FFQ was assessed using cross-classification of nutrient intakes to estimate the percentage of participants classified into quartiles as follows: exact agreement (percentage of cases classified into the same quartile), exact agreement plus adjacent (percentage of cases cross-classified into the same or adjacent quartile), disagreement (percentage of cases cross-classified 2 quartiles apart), and extreme disagreement (percentage of cases cross-classified into extreme quartiles). For intakes of energy and macronutrients, the Bland-Altman method was used to further assess the limits of agreement between the 2 methods (Food4Me FFQ and WFR) and between the repeated Food4Me FFQ. As per the Bland-Altman methodology, dietary records were considered comparable/ repeatable if greater than 95% of data plots lay within 2 standard deviations of the mean. GraphPad PRISM version 6 was used to produce the Bland-Altman plots (GraphPad Software, Inc, La Jolla, CA, USA).

19Differences in food group intakes between the FFQ and WFR and repeated Food4Me FFQ were also examined. For this purpose, food items in the Food4Me FFQ and 4-day WFR were arranged into 35 food groups as per previous validation by Forster et al. SCC were calculated to assess the strength of association between methods for estimated intakes of the 35 food groups. To assess the relative agreement between the dietary methods and repeated FFQ for daily food group intake, food groups were also cross-classified to estimate the percentage of participants classified by the 2 methods into quartiles of exact agreement, exact agreement plus adjacent, disagreement, and extreme disagreement.

20A total of 121 participants were screened for inclusion in the study, of which 113 were deemed eligible. Reasons for exclusion included self-diagnosed food intolerance (n=7) and medication use (n=1). Before completion, 10 participants dropped out of the study and a further 3 were excluded from analysis due to a reported energy intake >4500 kcal. The final dataset for analysis included 100 participants, of whom 49 had also completed the 4-day WFR, as illustrated in Figure 2. A total of 48 participants completed the Diet Record Usability-Rating Questionnaire.

21Self-reported demographic characteristics of the participants in the reproducibility and validation study are shown in Table 1. No significant differences were observed between age and body mass index (BMI) for males and females. Participants who completed the WFR (validation study) were, on average, 4.6 years younger than the participant group as a whole.

22Mean energy and nutrient intakes estimated by repeated measures of the Food4Me FFQ (FFQ1 and FFQ2) are presented in Table 2. Estimated energy intakes were significantly higher in the first administration of the FFQ compared with the second administration (difference=135 kcal/day, equivalent to 6.5% higher, P<.05). With the exception of carbohydrate, no significant differences were observed between macronutrient and micronutrient intakes estimated by FFQ1 and FFQ2. Overall, the Food4Me FFQ showed good reproducibility for energy-adjusted nutrient intakes. A total of 16 participants were found to underreport in both FFQ with a further 3 underreporting in FFQ1 and 5 in FFQ2. The removal of underreporters from both FFQ (n=24) did not impact on the reproducibility of the questionnaire (data not shown).

23Bland-Altman plots for estimates of energy (kcal), total fat (% total energy, TE), protein (%TE) and carbohydrate (%TE) intakes are shown in Figure 3. The Food4Me FFQ showed good reproducibility for the estimation of daily protein intake, with less than 5% of cases falling outside of the limits of agreement. For energy and total fat intake, 6% of cases fell outside of the limits of agreement and for carbohydrate 7%, indicating similar reproducibility. The mean difference (bias) between energy intakes was relatively small (135 kcal/day) with greater values being estimated at FFQ1. Conversely, estimates of energy-adjusted protein and total fat intake were higher at FFQ2 with biases of –0.22 %TE and –1.23 %TE, respectively. In contrast with the energy-adjusted macronutrient intakes, variation between estimates of energy increased with higher mean energy intakes (Figure 3), suggesting poorer reproducibility for those participants reporting higher energy intakes.

24Correlation coefficients for estimates of energy and nutrient intakes between repeated administrations of the Food4Me FFQ are shown in Table 3. Correlation coefficients ranged from.65 (vitamin D) to.90 (alcohol) with a mean value of.75. Correlations were significant for all nutrients (P<.01). The cross-classification of quartiles of mean estimated daily energy and nutrient intakes between repeated administrations of the Food4Me FFQ is also shown in Table 3. The percentage of participants classified into quartiles of exact agreement ranged from 45% (polyunsaturated fatty acids %TE) to 74% (vitamin A retinol equivalents, RE). For classifications of exact agreement plus adjacent, values were consistently high, ranging from 87% (vitamin D) to 98% (vitamin A RE). The mean percentage of participants classified into quartiles of disagreement was 7% with less than 1% of participants on average classified into extreme disagreement.

25To assess differences in food group intake between repeated administrations of the online Food4Me FFQ, food items were categorized into 35 food groups. Correlation coefficients and cross-classification of mean food group intakes are presented in Table 4. SCC ranged from.55 (tinned fruit or vegetables) to.92 (alcoholic beverages) with a mean value of.75. Correlations were significant for all food groups (P<.01). The percentage of participants classified into quartiles of exact agreement ranged from 46% (fats and oils) to 86% (tinned fruit or vegetables). For classifications of exact agreement plus adjacent values were consistently high, ranging from 81% (eggs and egg dishes) to 99% (alcoholic beverages). The mean percentage of participants classified into quartiles of disagreement was 7% and for extreme disagreement was 1%.

26Mean energy and nutrient intakes estimated by the 4-day WFR and Food4Me FFQ (FFQ1) are presented in Table 5. There were no significant differences between estimates of energy intake. However, when underreporters had been removed (n=19), a significant difference in intake was observed (P<.05) (Table 5). In total, 12 participants underreported in the 4-day WFR and 15 underreported in the Food4Me FFQ1, with 8 of these underreporting in both methods.

27After controlling for energy, estimated intakes of macronutrients were similar for both the WFR and the Food4Me FFQ with no significant differences between intakes of total fat (g, TE), polyunsaturated fatty acids (PUFA g, %TE), protein (g, %TE), carbohydrate (g), and total sugars (g, %TE) (Table 5). However, estimated intakes of saturated fatty acids (SFA) (g, %TE) and monounsaturated fatty acids (MUFA) (g, %TE) were significantly higher (P<.001), and estimated intake of carbohydrate (%TE) was significantly lower (P=.01), for the FFQ than for the WFR. For micronutrients, no significant differences were observed between energy-controlled estimates of folate, iron, thiamin, vitamin B6, and vitamin E. Estimated intakes of calcium, total carotene, riboflavin, vitamin B12, vitamin C, retinol, and vitamin D intakes were significantly different between 4-day WFR and FFQ1 (all were higher for the FFQ). After controlling for energy and, where appropriate, gender, vitamin C intakes were no longer significantly different. Removing underreporters from the dataset reduced the agreement between the 2 methods for folate, vitamin B6, and vitamin E, but improved agreement for energy-controlled carbohydrate and vitamin D, with no significant differences observed between estimates of these nutrients (data not shown).

28Bland-Altman plots for mean energy (kcal), total fat (%TE), protein (%TE) and carbohydrate (%TE) for the 4-day WFR and FFQ1 are shown in Figure 4. Overall, less than 5% of cases fell outside of the limits of agreement for all plots indicating good agreement between the methods. The mean difference (bias) between energy intakes was relatively small (178 kcal/day) with greater values being estimated in the Food4Me FFQ, as was the case for energy derived from total fat and protein.

29Correlation coefficients for estimates of energy and nutrient intakes and cross-classification of quartiles of mean daily intakes between 4-day WFR and FFQ1 are presented in Table 6. Correlation coefficients ranged from.23 (vitamin D) to.65 (protein, %TE) with a mean value of.47. Correlation was significant for the majority of nutrients at the P<.01 level, with the exception of total fat (%TE), PUFA (%TE), and vitamin D. Retinol and vitamin E showed significant correlation at the P<.05 level. The percentage of participants classified into quartiles of exact agreement ranged from 22% (total fat, %TE) to 53% (MUFA, g). For classifications of exact agreement plus adjacent, values were consistently high, ranging from 65% (sodium) to 88% (total fat, g, and total sugars, g, %TE). The mean percentage of participants classified into quartiles of disagreement was 16% with less than 4% of participants classified into extreme disagreement.

30To assess differences in food group intakes between 4-day WFR and FFQ1, food items were categorized into 35 food groups. Correlation coefficients and cross-classification of mean food group intakes are presented in Table 7. SCC ranged widely from.11 (soups, sauces and miscellaneous foods) to.73 (yogurts) with a mean value of.2. Correlations were significant for the 63% of food groups (22 of 35).

31The percentage of participants classified into quartiles of exact agreement ranged from 18% (nuts and seeds, herbs and spices) to 55% (teas and coffees). For classifications of exact agreement plus adjacent, values were high ranging from 55% (soups, sauces and miscellaneous foods) to 90% (milk, chipped, fried and roast potatoes, teas and coffees, and other beverages) with a mean of 78%. The mean percentage of participants classified into quartiles of disagreement was 17% and for extreme disagreement was 5%.

32Mean values and standard deviations for responses to the dietary record usability-rating questionnaire are shown in Table 8.

33The Food4Me FFQ was considered significantly easier and less time consuming to complete than the 4-day WFR. However, the 4-day WFR was rated as significantly more interesting than the Food4Me FFQ, making participants reflect more on their food intake. Participants were more willing to complete further Food4Me FFQ than 4-day WFR.

34Previous validation of the Food4Me FFQ has demonstrated good agreement with the printed EPIC-Norfolk FFQ for the estimation of food and nutrient intake. In this study, participants were asked to complete the Food4Me and EPIC-Norfolk FFQ in a random order, 4 weeks apart. Good agreement between cross-classifications of daily energy and nutrient intakes, estimated using the 2 FFQ, demonstrated the utility of the Food4Me FFQ for ranking individuals based on their nutrient intake. However, it was noted that further testing of the Food4Me FFQ was required to establish its wider utility. The present study thus aimed to demonstrate the reproducibility of the Food4Me FFQ and its validity against a 4-day WFR.

35Overall, the Food4Me FFQ demonstrated good reproducibility for the estimation of intakes of nutrients and food groups. Reported energy intakes were significantly lower with the second administration of the Food4Me FFQ, but correlations between energy intakes were high (r=.77). Correlation coefficients for nutrient intakes ranged from.65-.90, showing above-average performance compared with the range of.50-.80 proposed by Willet. The mean unadjusted correlation coefficient (r=.75) for energy and nutrient intake compared well with previous studies on both computerized and non-Web-based FFQ. Associations between food group intakes were similarly strong with an average unadjusted SCC of.75; previous studies have reported correlations of.66 and.72. Cross-classification analysis of repeated measures of intakes of energy, nutrients, and food groups indicated a high level of reproducibility with classification into quartiles of exact agreement plus adjacent averaging 92% for energy and nutrient intake and for food group intakes. Cross-classifications were within the range reported by previous studies. Bland-Altman plots demonstrated a good level of reproducibility for energy-controlled total fat, protein, and carbohydrate intake, which reinforces evidence for the reliability of the Food4Me FFQ.

36Estimated energy and nutrient intakes were higher on the first administration of the Food4Me FFQ than on the second administration. This pattern has been observed in numerous other reproducibility studies, and is proposed to result from learning effects and questionnaire fatigue. The above-average reproducibility of the Food4Me FFQ could be attributed to the addition of food photographs to the FFQ for the estimation of portion size intake. Use of tools that allow participants to report their own portion sizes tend to report higher correlation coefficients between repeat administrations. The relatively short interval between repeat administrations of the FFQ is another factor likely to have contributed to the questionnaire’s good performance. Tsubono et al found that correlation coefficients tended to be lower when FFQ were repeated after a long time interval (6 months to 1 year) compared with a shorter time interval (1 to 6 months), and proposed that the temporal difference may be due to changes in dietary habits which are more likely to occur with longer time intervals. In addition, it has also been suggested that for very short time intervals between administrations, respondents may remember and replicate their entries rather than reporting their diet intake accurately. However, with a large FFQ containing 157 food items, as used in the present study, it is unlikely that many participants would be able to remember their earlier responses.

37The degree of underreporting between the Food4Me FFQ and 4-day WFR varied, with 12 (24%) and 15 (15%) participants deemed to be underreporting in the 4-day WFR and Food4Me FFQ, respectively. Given that the WFR is described as the gold standard for assessing intake, our observation that estimates of energy intake were similar between the Food4Me FFQ and the 4-day WFR and that a smaller proportion of participants appeared to underreport with the Food4Me FFQ suggests that the Food4Me FFQ is a promising tool for estimating habitual food intake.

38Overall, the results of the validation study showed moderate agreement between the Food4Me FFQ and 4-day WFR for the estimation of energy and nutrient intake. Ranks of energy and nutrient intake estimated using the Food4Me FFQ were highly comparable to the 4-day WFR with the percentage of individuals classified into quartiles of exact agreement and exact agreement plus adjacent averaging 40% and 80%, respectively. Previous studies comparing FFQ with food records have reported average exact agreement classifications between 34% and 49% and exact agreement plus adjacent quartile classifications of 77%. Estimates of intake showing disagreement between measurement tools in the present study were small and were comparable with the aforementioned studies. Cross-classifications of estimates of food group intake were similar to that of the nutrients, with classification into quartiles of exact agreement plus adjacent averaging 78% and Bland-Altman plots demonstrated good agreement between the 2 methods for estimates of energy and energy-adjusted macronutrient intakes.

39In the present study, 22 of 30 nutrients assessed had a correlation coefficient greater than the.4 threshold that was proposed by Cade at al., and 13 of 30 achieved a correlation greater than or equal to the “desirable”.5 proposed by Masson et al. The average unadjusted correlation coefficient of.47 compared favorably with the range reported by similar validation studies comparing FFQ with food records:.34-.46. SCC for food group intakes were highly variable, ranging from.11 (soups, sauces and miscellaneous foods) to.73 (yogurts), with a mean value of.2. Similar studies have reported correlations ranging from.09 to.83,.17 to.95, and.09 to.58 with mean values of.38,.63, and.58, respectively. However, it is difficult to compare results from these studies because the type of food records and time intervals between dietary assessments differed substantially and there may be substantial differences in the food items included in particular food groups in each of the studies. Variation between Food4Me FFQ and 4-day WFR estimates were greatest for soups, sauces and spreads, carrots, other fruit and vegetables, and tinned fruit and vegetables. It is possible that intakes of these foods might have been overestimated in the Food4Me FFQ, as has been observed previously when several food items within a food group are listed separately in a questionnaire (eg, carrots could be counted under both fresh and tinned carrots and under tinned vegetables). In addition, foods perceived as healthy, such as fruit and vegetables, are prone to overestimation in FFQ. Furthermore, because they refer to just 4 days’ intake, WFR provide a limited snapshot of an individual’s diet only and are less able to assess patterns of dietary intake than the Food4Me FFQ, which attempts to capture intakes over the previous month. It is thought that individuals may be able to more accurately estimate the consumption of some foods (eg, alcoholic beverages) than others, as was the case in the present study. Alcohol is often considered a confounder in nutrition research given that it constitutes the difference between food and total dietary energy intake; therefore, it is important that it is estimated reliably using the Food4Me FFQ. It is also encouraging that estimates of fish products were well correlated, as these foods are eaten less frequently and may be prone to underrepresentation in 4-day WFR. However, it is surprising that some more commonly consumed foods such as breakfast cereals and porridge show much weaker correlation (r=.27).

40Our observation that participants in the present study reported that the Food4Me FFQ was easier to use and less time consuming compared with the 4-day WFR, is promising given the movement of health service delivery toward Web-based interventions. Moreover, completion of the Food4Me FFQ was associated with less reflection by participants on their dietary intake, which is known to influence eating behavior. Minimizing the impact of a questionnaire on dietary behavior is beneficial in nutrition intervention studies to ensure that study outcomes are not biased by the methods used for dietary assessment.

41Strengths of the present study include the comparison of the Food4Me FFQ with the gold standard, a WFR, and the use of multiple methods to assess the validation and reproducibility of the Food4Me FFQ. In addition, this validation study had an adequate sample size similar to those used in previous studies. It should be noted that the validation of the Food4Me FFQ was assessed in a convenient rather than a nationally representative sample of the population, although the inclusion/exclusion criteria used were the same as those intended for the Food4Me study. The use of a convenient university population, with a potentially higher education level, may have implications on the ability of the wider population to complete the online Food4Me FFQ.

42Limitations of the study include the use of those recruited first to complete the 4-day WFR because these individuals may have been more motivated to comply with the guidelines. A further limitation is the use of nonconsecutive days in the 4-day WFR, which may have resulted in participants making up food intake on the days they do not record (eg, eating healthy for the record days and overconsuming between record days). However, nonconsecutive recording does have the advantage of capturing a greater diversity of food intake over a week’s period.

43A potential criticism of the assessment of reproducibility is the short duration between repeated measures. It has been suggested that for very short time intervals, respondents may remember and replicate their entries rather than accurately reporting their dietary intake, but this is unlikely to be a significant problem in the present study where the Food4Me FFQ contained 157 food items. Remembering their responses to such a long list of questions after a period of 4 weeks is a memory challenge beyond most people’s abilities. The average reported correlation coefficient for crude total fat intake using FFQs repeated after 1 month or less was.68, which compares very favorably with the correlation coefficient of.81 in the present study, showing above-average performance for the Food4Me FFQ. Cade et al suggested that the time interval between repeated measures using a dietary instrument should be chosen to minimize changes in dietary intake and our use of 4 weeks fits that criterion.

44In conclusion, the self-administered online Food4Me FFQ demonstrates good reproducibility for the estimation of energy, nutrient, and food group intakes and moderate agreement for the assessment of energy and nutrient intakes when compared with a 4-day WFR in an adult population. Consequently, the online Food4Me FFQ was considered suitable for the assessment of dietary intake in healthy adults.