Next Article in Journal
The Comparative Reliability and Feasibility of the Past-Year Canadian Diet History Questionnaire II: Comparison of the Paper and Web Versions
Previous Article in Journal
Adequacy of Usual Vitamin and Mineral Intake in Spanish Children and Adolescents: ENALIA Study
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Nutrients
Volume 9
Issue 2
10.3390/nu9020128
nutrients-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Validity of the Food Frequency Questionnaire Assessing the Folate Intake in Women of Reproductive Age Living in a Country without Food Fortification: Application of the Method of Triads

by
Milica Zekovic
1,*,
Marija Djekic-Ivankovic
1,
Marina Nikolic
1,
Mirjana Gurinovic
1,
Dusanka Krajnovic
2 and
Marija Glibetic
1
1
Centre of Research Excellence in Nutrition and Metabolism, Institute for Medical Research (IMR), University of Belgrade, Tadeusa Koscuska 1, 11158 Belgrade, Serbia
2
Department of Social Pharmacy and Pharmaceutical Legislation, Faculty of Pharmacy, University of Belgrade, Vojvode Stepe 450, 11000 Belgrade, Serbia
*
Author to whom correspondence should be addressed.
Nutrients 2017, 9(2), 128; https://doi.org/10.3390/nu9020128
Submission received: 12 December 2016 / Revised: 31 January 2017 / Accepted: 6 February 2017 / Published: 13 February 2017
Browse Figures
Versions Notes

Abstract

:
The study aimed to examine the external validity of the Folate Food Frequency Questionnaire (F-FFQ) designed for assessing the folate intake in Serbian women of reproductive age. The F-FFQ was tested against repeated 24 h dietary recalls and correspondent nutritional biomarkers (red blood cells (RBC) and serum folate concentrations) using the method of triads. In a cross sectional study, 503 women aged 18–49 years completed dietary questionnaires and representative validation subsample (n = 50) provided fasting blood samples for biomarker analyses. Correlation coefficients were calculated between each of the dietary methods and three pair-wise correlations were applied for the calculation of validity coefficients. Correlation coefficients observed between F-FFQ and three 24 h recalls were r = 0.56 (p < 0.001) and r = 0.57 (p < 0.001) for total sample and validation group, respectively. Bland–Altman plot and cross-classification analyses indicated good agreement between methods. High validity coefficients were determined between the true intake (I) and dietary assessment methods, F-FFQ (Q) and 24 h dietary recalls (R) (ρQIrbc = 0.871 and ρQIser = 0.814; ρRIrbc = 0.652 and ρRIser = 0.698), and moderate ones for biomarkers (B) (ρBIrbc = 0.428 and ρBIser = 0.421). The F-FFQ is valid instrument for the assessment of dietary folate intake in women living in Serbia, a country without mandatory folic acid food fortification.

1. Introduction

Nutritional imbalances during pregnancy can influence gene expression and cause abnormalities of fetal phenotype. Scientific progress in the comprehension of congenital anomalies has led to the conclusion that optimally balanced maternal diet with adequate intake of macro- and micronutrients can contribute to reducing the incidence of these disorders [1]. For the prevention of adverse pregnancy outcomes and normal fetal development folate, water-soluble B9 vitamin, is recognized as a nutrient of particular importance [2].
The term folate refers to a group of related compounds including folates naturally present in foods and the synthetic, fully oxidized form, folic acid. The biological functions of folate as a co-enzyme are essentially based on single-carbon units transfer in the processes of purine and pyrimidine nucleotides biosynthesis and metabolism of amino acids methionine, serine, glycine and histidine [3]. Since the pteridine cycle, an element of the folate structure, cannot be synthesized de novo in mammalian body, adequate amount of these compounds with a critical role in numerous biochemical processes must be provided through food and/or supplementation [4]. Unlike naturally occurring folate vitamers, which are labile and prone to losing biological activity during storage, food processing and preparation, folic acid retains stability and is therefore successfully used in the form of supplements and for food fortification [5,6].
There is substantial scientific evidence that maintaining adequate folate status before conception and during the first trimester of pregnancy significantly reduces the risk of occurrence and recurrence of neural tube defects (NTD) [2,7]. Given that the closure of the neural tube, fundamental for the proper formation of the nervous system, occurs during the third and fourth week (i.e., from Day 21 to Day 28) from conception, and that up to 41% of pregnancies are unplanned, it is clear that throughout this period the majority of women are still not, or have only become aware of the pregnancy [8,9]. For this reason, it is crucial to ensure optimal folate intake and status in all women of childbearing age.
Recommendation for optimal dietary intake of naturally-occurring mixed forms of folate for adults is 400 µg according to US Institute of Medicine (IOM) and World Health Organization/Food and Agricultural Organization of the United Nations (WHO/FAO) Expert Consultation group [10]. These organizations emphasize that, in addition to healthy diet, due to problematic stability and bioavailability of food folate, for optimal NTD prevention, it is necessary to provide 400 µg of folic acid daily by supplementation when planning pregnancy or throughout childbearing age [11]. Since it is difficult to attain general compliance with advice on nutrition and supplement usage, many countries worldwide have introduced controlled and strictly regulated folic acid food fortification. In Serbia, such policy has not been implemented and availability of voluntarily fortified food is limited. Furthermore, prior studies indicate that the intake of folate in this country is bellow values recommended by authorities [12], while only 3.9% of women report taking folic acid supplements during periconceptional period [13]. Concern regarding folate inadequacy and associated health issues is widespread across Europe. Majority of European countries lack fortification policy and current strategies, based primarily on dietary counseling and promotion of folic acid supplementation, have not had appreciable public health effect on reducing the prevalence of suboptimal folate intake and NTDs [14,15,16,17].
In facing the challenge of achieving folate adequacy, the first step is reliable and objective nutritional assessment performed with standardized and validated instruments. To address this concern, we developed the Food Frequency Questionnaire for folate intake assessment (F-FFQ). Food Frequency Questionnaires are used to assess usual diet during a defined period of time in a simple and cost-effective manner with relatively small burden imposed on researchers and respondents. Due to aforementioned advantages, this instrument is commonly used in nutritional epidemiological studies all over the world. However, it is important to highlight that a universal FFQ, which could be applied for all population groups and all research questions, does not exist. Demographic, socio-economic, geographical, climatic, cultural and medical status factors all have influence on the diet and FFQ must be created or adapted in accordance with the characteristics of a particular study population [18]. Furthermore, in order to ensure proper interpretation of data obtained by FFQ, it is important to determine the association between reported intakes from the FFQ and true dietary intake [19].
The aim of the present study is to determine whether the F-FFQ is valid tool for assessing the dietary intake of folate in Serbian women of reproductive age.

2. Materials and Methods

In this study, the relative ability of the F-FFQ to estimate folate intake was tested against reference method (repeated 24 h dietary recalls), and correspondent biomarkers of folate intake (concentration of folate in serum and red blood cells (RBC)) using the method of triads [20,21]. This triangular approach relies on the availability of quantitative intake information from three methods and uses the correlations between each of them to calculate the validity coefficient. The validity coefficient represents the correlation between the dietary intake reported by the F-FFQ and the unknown true dietary intake. Given that FFQ and 24 h recalls commonly share errors related to misreporting, the main benefit of applying the triads method is the inclusion of biomarkers—objective and independent indicators of nutrient intake [20,21,22]. This approach enables broadening of validation parameters and more comprehensive analyses.

2.1. Study Participants

In a one-year period, from June 2014 to July 2015, a cross-sectional study was conducted as a part of a national integrated project with an objective to estimate dietary intake and biomarkers of folate status among women of reproductive age in Serbia. During the recruitment process, flyers with the invitation for participation in the study were available in selected primary health care facilities (community pharmacies and health centers) and educational institutions throughout country. Recruitment material contained detailed information regarding the purpose and objectives of the research, study protocol, as well as rights and expectations of the potential participants. The inclusion criteria for the study were: female sex, age between 18 and 49 years and a regular menstrual cycle. Exclusion criteria comprised: pregnancy, breast feeding, use of drugs that interact with folate metabolism, hormonal substitution and menopause.
Recruitment process and sample overview are presented in Figure 1.

2.2. Anthropometry

Anthropometry included height and weight measurement of participants dressed only in light clothing. Height was measured to the nearest 0.1 cm (Perspective Enterprises, Kalamazoo, MI, USA) and weight to the nearest 0.1 kg (TBF-300, Tanita Corp., Tokyo, Japan). Body Mass Index (BMI) was calculated as weight (kg)/height-squared (m2) [23].

2.3. Food Frequency Questionnaire

The FFQ for folate (F-FFQ) was developed by combining a validated FFQ for folate in Croatia region [24] with the NCI/Block Health Habits and History Questionnaire [25]. Further adaptation of the F-FFQ included folate-rich traditional foods consumed in Serbia (such as baked beans “prebranac”, stuffed dock leaves, ajvar/pindjur (traditional roasted red pepper spread), sun-dried peppers stuffed with beans, and dock/spinach pie) (Table S1). Face and content validity of the questionnaire were assessed by an expert panel consisting of five researchers from the Center of Research Excellence in Nutrition and Metabolism in Serbia. The questionnaire was pilot tested for clarity and format improvement among 20 women of reproductive age who did not participate in the main study.
The F-FFQ was designed to capture habitual intake over the previous three months and was self-administered in the presence of trained dietitians. Photographs of food portion sizes (small, medium, and large) were included in the FFQ. In addition to pre-specified portion size options, there was a possibility for respondents to determine usual portion in an open-ended manner. The questionnaire included the following frequency of consumption options: “never”, “once per month”, “2–3 times per month”, “once a week”, “2–3 times per week”, “4–6 times per week” and “every day”. In the case respondents consumed certain food more than once per day they were instructed to specify portion that corresponds to daily intake. All the reported frequencies for ninety food items listed in F-FFQ were converted to frequencies per day with reference to a base value of 1.0 for the “every day” option. Estimates of amounts of food consumed per day were calculated by multiplying the daily equivalent frequency of consumption of food items by the chosen portion size.
In addition, to enhance interpretation of F-FFQ estimates, general questions related to age, education, previous medical conditions, detailed vitamin supplements and medication use and lifestyle habits regarding smoking, physical activity/exercise, alcohol as well as coffee and tea consumption were also incorporated in questionnaire.

2.4. Twenty-Four-Hour Dietary Recalls

Three 24 h dietary recalls per participant were performed by multiple pass during the last two weeks of the period covered by the F-FFQ. Interviews were conducted on nonconsecutive days, with two of the recalls being on weekdays and one on a weekend day. Survey calendar was defined so that adequate proportion of weekdays is captured on a group level. Within the structured interview participants reported the complete consumption of food and beverages in preceding 24 h. Data regarding the type of the food or dishes, time and place of consumption, cooking or processing method and the amounts consumed were recorded in suitable survey form in chronological order. All the interviews were done face to face and led by a trained professional according to standardized protocol. The estimated time of data collection was 15–30 min. In order to improve the accuracy of the portion estimate, the questionnaires were administered in conjunction with Food Atlas [26,27]. This amount estimation tool contains color photographs of various portions of foods and dishes whose selection was made on the basis of previously conducted national studies. For each item four to nine serving sizes, measured using calibrated digital scale, were available. All photographs were made in a standardized, uniform manner, with identical lighting, background and shooting distance, so that comparative factors (e.g., plate, cup and cutlery of defined dimensions) were clearly shown as an aid for selection.

2.5. Dietary Data Assessment

Quantitative food consumption data, obtained with both instruments (i.e., 24 h dietary recall and FFQ), were processed with DIET ASSESS & PLAN (DELTA Electronic Ltd., Subotica, Serbia), advanced dietary intake assessment and nutrition planning software tool, which has been applied previously in national, regional and international nutritional surveys and evaluated in European Food Safety Authority (EFSA) trial ring [26,27,28,29]. Nutrient intake calculation was performed using the Serbian Food Composition Database, harmonized with EuroFIR standards and embedded in EuroFIR Food Platform and Balkan food platform [30]. For dietary supplement users, content specified by manufacturer and reported information regarding dosage, consumption frequency and duration were taken into account. Total folate intake was estimated in µg dietary folate equivalents (DFE)/day using formula: µg of DFE = [µg of food folate + (1.7 × µg of synthetic folic acid)] and related to recommended values proposed by WHO—Estimated Average Requirements (EAR; 320 µg/day) and Recommended Nutrient Intake (RNI; 400 µg/day) for adults [10].

2.6. Biochemical Assessment

Within two days after completing the F-FFQ, blood samples of fifty randomly selected participants were collected by trained medical staff via venipuncture. Prior to specimen collection participants fasted overnight and analyses were performed immediately. Samples were collected in plastic Serum Separator Tube and in tripotassiumethylendiaminetetraacetic acid (K3 EDTA) tube (BD Vacutainer; Becton, Dickenson and Company, Plymouth, United Kingdom) for serum and RBC folate concentration analyses, respectively. Biomarkers were determined using the ARCHITECT Folate kit (Abbott Laboratories, Abbott Park, IL, USA), based on Chemiluminescent Microparticle Immunoassay (CMIA) technology and traceable to the Folate WHO International Standard 03/178, on Architect i2000 analyzer (Abbott Laboratories, Abbott Park, IL, USA). Special attention was paid to keeping samples, calibrators and controls protected from light. Prior to RBC hemolysate preparation hematocrit of the EDTA specimen was determined according to the manufacturer’s instructions [31]. The accuracy of the assay was verified with three level control materials (ARCHITECT Folate Controls, Abbott Laboratories, Abbott Park, IL, USA) and all were within manufacturer’s specified range. All assays were done in duplicate. The intra-assay coefficients of variation for folate serum and RBC were 4.3% and 4.7%, while the inter-assay coefficients of variation were 6.1% and 6.3%, respectively.
Based on cut-off values proposed by WHO, folate serum concentrations <6.8 nmol/L were related to folate deficiency, concentrations between 6.8 nmol/L and 13.4 nmol/L to possible deficiency, and values >13.5 nmol/L to adequate status [32]. RBC folate concentrations below 340 nmol/L were considered indicative for folate deficiency and concentrations ≥906 nmol/L as optimal for achieving the greatest reduction of risk for NTD-affected pregnancy [33].

2.7. Statistical Analyses

The normality of the data distribution was analyzed using Shapiro–Wilk test for the total sample and the validation group separately. When data were not normally distributed, values were log transformed before analyses. For all parameters, differences between the total sample and validation group were tested using the Wilcoxon Rank Sum test.
Several statistical techniques were applied to evaluate validity of the F-FFQ. Pearson correlation coefficients were calculated to assess association between dietary folate intake estimated by F-FFQ and 24 h recalls on crude and energy-adjusted data for both total sample and validation subgroup [34]. Agreement between methods was further examined by classification of the variables into the quartiles (i.e., in four groups divided by 25th percentile, median and 75th percentile). We calculated the quartiles of folate intake assessed by F-FFQ for the validation group and cross-tabulated these with respective quartiles of 24 h-recall-derived estimates and biomarker levels. Rank of the variable that corresponds to the Pth percentile in the sample was calculated using formula (P/100)(1 + n), where n is the number of observations. Since the number of participants in validation subsample in our study was 50 calculated ranks were not integer. Therefore, they were rounded to the nearest rank [35]. Discordance and agreement in quartile ranking was assessed as the percentage classification in the same, same or adjacent, opposite (first and third or second and fourth quartile) and absolutely opposite quartile (grossly misclassified—first and fourth quartile). Linear regression analyses were performed to test for significant linear trends between folate intake assessed by F-FFQ, 24 h recalls and folate biomarkers, adjusting for research settings.
Furthermore, to visualize agreement between folate intake results obtained from F-FFQ and 24 h recalls the Bland–Altman plot was constructed [36]. The arithmetic difference in folate intakes between the two methods for each individual was plotted against the average estimation of the two methods. The 95% limit of agreement was calculated as the mean difference ±1.96 standard deviation (SD).
The comprehensive triangular approach to validation, known as the method of triads, was applied as well. Validity coefficient (VC) for the FFQ was calculated using the correlations between the FFQ and the biomarker (rQB), 24 h recalls and the biomarker (rBR) and the FFQ and 24 h recalls (rQR) as shown in the following equation:
ρQI = √(rQB × rQR/rBR)
This method has been described in detail by Ocke and Kaaks [20]. Correlation between the biomarker and the FFQ and calculated validity coefficient were used as lower and upper limits of validity coefficients. The 95% confidence intervals for the validity coefficients were estimated using bootstrap sampling where 1000 samples of equal size (n = 50) were obtained with replacement from the study subjects [20,37].
A p value < 0.05 was considered statistically significant. All statistical analyses were performed using R software package (R Foundation for Statistical Computing, Vienna, Austria) [38].

2.8. Ethical Approval

This study was conducted in accordance with the guidelines laid down in the Declaration of Helsinki and all procedures involving human subjects were approved by the Institute for Medical Research Ethics Committee in Serbia (EO112/2015). Written informed consent for inclusion was obtained from all participants.

3. Results

The average age of participants was 34.09 (SD = 10.74) years. Distributed in age groups, 88, 179, 159 and 78 of the studied women were 18–25, 25–35, 35–45 and 45–49 years old, respectively. Total sample and validation group were not statistically different in weight (65.09 (SD = 8.15) kg vs. 62.24 (SD = 6.06) kg), height (168.89 (SD = 5.21) cm vs. 169.94 (SD = 4.42) cm), BMI (22.83 (SD = 2.64) kg/m2 vs. 21.99 (SD = 1.93) kg/m2) and waist to hip ratio (0.77 (SD = 0.06) vs. 0.76 (SD = 0.04)).
According to anthropometric measurements, 4.17% of the women were classified in the category of underweight (BMI < 18.5 kg/m2), 20.08% in overweight (BMI = 25.0–29.9 kg/m2) and 5.57% in obese (BMI ≥ 30.0 kg/m2) while 70.18% had BMI within normal range (BMI = 18.5–24.9 kg/m2) [23]. At the time of the survey, 2.58% of the participants had primary education, 58.65% secondary and 38.77% post-secondary education. Consumption of folic acid in the form of single or multivitamin/multivitamin–multimineral supplements at least once a week was reported by 4.77% of women. Smoking habit was reported by 29.22% of participants in total sample and 26.04% in validation group. Based on F-FFQ self-reports, among 503 studied women 41.75% consumed alcohol on a weekly basis, 89.66% consumed coffee and 63.61% tea at least a cup a day. Moderate physical activity between 30 min and 3.5 h weekly was stated by 76.34% of women in the main sample and 77.73% in validation subgroup.
Estimated daily energy, macronutrient and folate intake together with correlations between the estimates of the dietary intakes by the F-FFQ and 24 h recalls are presented in Table 1. Pearson correlation coefficients between folate intake assessed by F-FFQ and 24 h dietary recalls did not substantially change after adjustment for total energy intake based on residual model, neither for total sample (crude data: r = 0.56, p-value < 0.001 vs. energy-adjusted data: r = 0.53, p-value < 0.001) nor for validation subgroup (crude data: r = 0.57, p-value < 0.001 vs. energy-adjusted data r = 0.59, p-value < 0.001). There were no significant differences in intake estimates between the total sample and validation group (p > 0.05). Only 6.16% and 6.76% of all the participants reached folate EAR benchmark while 96.22% and 93.64% had folate intakes bellow recommended 400 µg DFE/day based on repeated 24 h recalls and FFQ, respectively.
In Table 2 the median values and 5th and 95th percentiles of the daily intake levels of twelve food groups and the corresponding relative contributions of these food groups to the daily folate intake based on 24 h dietary recalls are presented. Major folate food sources, identified for total 503 women using both dietary methods, are presented in Table 3.
Mean folate serum level in the studied women was 12.29 (SD = 6.59) nmol/L and RBC folate 438.66 (SD = 144.63) nmol/L. Using a cut-off value of 6.8 nmol/L for serum folate and 340 nmol/L for RBC folate, the prevalence of blood folate levels indicative for folate deficiency was 30% (n = 15) and 24% (n = 12), respectively. Adequate folate serum concentrations were observed in 38% (n = 19) of studied participants. None of the women met or exceeded 906 nmol/L, the value of RBC folate associated with lowest risk of having NTD-affected pregnancy. A significant increase of serum and RBC folate concentrations were identified with an increase of folate intake (p < 0.05; Table 4).
The ability of F-FFQ to classify participants into the correct quartile of folate intake assessed by 24 h recalls and biochemical indices is summarized in Table 5. The F-FFQ classified more than 80% of subjects correctly or closely as 24 h recalls and folate biomarkers. Figure 2 illustrates correlations between the F-FFQ, 24 h dietary recalls and biomarkers of folate status (i.e., serum and RBC folate). Furthermore, Bland–Altman plots indicated good agreement between methods, as less than 5% (precisely 20 cases, i.e., 3.98%) of cases fell beyond the limits of agreement (Figure 3).
Application of the method of triads enabled triangular comparisons of the correlation coefficients between F-FFQ, reference method (repeated 24 h recalls) and biochemical measurements—serum folate (Figure 4a) and RBC folate level (Figure 4b). The validity coefficient of the F-FFQ was high for both serum and RBC folate, indicating a strong relationship between true folate dietary intake and F-FFQ estimates (Figure 4a,b).

4. Discussion

Nutritional status assessment is nowadays recognized as an important part of medical care at individual and population level. In order to generate reliable information in the sphere of nutrition research, the use of valid, comprehensive instruments adapted to specific characteristics of the population of interest is essential. The aim of the present study was to validate the Food Frequency Questionnaire for the assessment of folate intake (F-FFQ) among women of reproductive age in Serbia, a country without mandatory folic acid food fortification. Therefore, we collected dietary intake data by applying two methods (24 h dietary recalls and FFQ), determined concentrations of two biochemical indicators of folate status and applied the method of triads [20]. Validity coefficients for F-FFQ were high regardless of biomarker used (ρQIrbc = 0.871 and ρQIser = 0.814). Moreover, a high level of agreement between the F-FFQ and 24 h dietary recalls was determined with Bland–Altman plot and cross-classification analysis.
The estimated daily folate intakes by F-FFQ were 206.2 µg DFE for all 503 studied women and 214.1 µg DFE for the validation subsample. Results of this study are in agreement with previously published data for the population of Serbian women assessed by seven-day food record (228.0 µg/day) [12]. In addition, similar values have been reported in studies conducted in other European countries that assessed folate intake in women using an alternative FFQ (Sweden: 225.0 µg/day [39], The Netherlands: 177.0 µg/day [40], Italy: 222.4 µg/day [41], Norway: 209.0 µg/day [42]), 24 h dietary recalls (Poland: 211.0 µg/day [43], Finland: 205.0 µg/day [44], Greece: 227.2 µg/day [45], Austria: 212.7 µg/day [46]) and 48-h dietary recalls (Spain: 196.9 µg/day [47]). In our study, the main food groups contributing folate intake were identified as vegetables/vegetable products (37.35% of average daily intake), grains/grain products (23.39% of average daily intake) and fruits/fruit products (11.52% of average daily intake). These results are in accordance with the recent comparison of standardized dietary folate intake across ten countries participating in the European Prospective Investigation into Cancer and Nutrition (EPIC) study [48]. A number of national dietary surveys indicate widespread prevalence of suboptimal folate intake among women of childbearing age in Europe highlighting the perspective of achieving folate status associated with lowest risk of folate-related disease (e.g., NTDs), rather than merely preventing evident folate deficiency (i.e., megaloblastic anemia) [14,49,50]. More than 90% of women in our study had folate intake bellow the recommended 400 µg DFE/day. To ensure adequate folate intake and status in general population and particularly in women of reproductive age mandatory folic acid food fortification policies have been established in many countries worldwide, which is not the case in Serbia. Availability of imported and voluntarily fortified foods is rather limited in Serbian market. In addition, results of our study confirm previous findings that folic acid in the form of dietary supplements is rarely consumed by Serbian women of reproductive age [13]. Potential consequences resulting from inadequate folate status on pregnancy outcomes and overall health should be perceived by Serbian public health authorities. It would be wise to consider implementation of educational programs to raise awareness about the significance of this nutrient, as well as nutritional interventions in the form of controlled fortification of selected foodstuffs or targeted supplementation.
It has been suggested that associations between dietary instruments (FFQ and 24 h recalls) estimated by correlation coefficients should be greater than or equal to 0.3, preferably over 0.4 and optimally in the range of 0.5–0.7 [18]. Correlation coefficient observed in the present study between F-FFQ and the average values of three 24 h dietary recalls were r = 0.56 (p < 0.001) for the total sample, and r = 0.57 (p <0.001) for the validation group. The strength of these correlations compare favorably to findings reported in other FFQ validation studies. Pauwels et al. [51] developed FFQ to assess usual intake of methyl-group donors and validated it against seven-day food record among Flemish women of reproductive age. They reported a correlation coefficient between two dietary methods of r = 0.58. Similar correlation coefficient (r = 0.56) was found by Jackson et al. [52] during validation of the 120-item FFQ against repeated 24 h recalls in 70 men and women in Jamaica. Another study compared folate intake assessed by short FFQ and seven-day weighted food record among 37 men and women and reported partial correlation coefficient (controlling for gender) of r = 0.53 [53]. In the Northern Sweden, a region without food fortification, FFQ was validated against 24 h recalls where Spearman correlation coefficient between estimates of folate intake based on two methods was r = 0.57 for female participants [39]. French et al. [54] developed FFQ to assess the folate intake of women of childbearing age in Canada and validated it against seven-day food record. The observed correlation coefficient between the two methods was r = 0.51. Recent study conducted among 67 British women of reproductive age explored the validity of purposefully designed FFQ for the assessment of usual dietary intake of micronutrient methyl donors (folate, choline and betaine) and selected antioxidants. The observed deattenuated correlation coefficient between the FFQ and estimates from three multiple-pass 24 h dietary recalls for folate was r = 0.47 for diet only and r = 0.80 when supplements were included [55].
In the present validation study serum and RBC folate concentrations were used to validate the dietary estimates of folate intake. Both biomarkers correlated significantly with the intake assessed by dietary methods. Correlation coefficients between F-FFQ and biomarkers were comparable with results of previously published studies for both folate concentration in erythrocytes (rrbc = 0.37 versus 0.34 [24], 0.33 [52] and 0.35 [56]) and in the serum (rser = 0.28 versus 0.25 [40], 0.20 [52] and 0.26 [57]). Folate serum level is considered to reflect recent intake, while the concentration in red blood cells indicates long-term folate exposure and tissue stores. Taking into consideration that folate accumulates in erythrocytes only during erythropoiesis, RBC folate represents integrative measure of folate intake for the period which corresponds to average lifespan of erythrocytes (i.e., 120 days) [58]. Given that this time-frame is similar to the defined reference period of F-FFQ (i.e., three months), the higher value of correlation coefficient between folate intake assessed by the F-FFQ and the concentration in erythrocytes in relation to the serum is logical. Based on WHO recommendation RBC folate concentration in women of reproductive age should be at least 906 nmol/L so as to ensure optimal prevention of neural tube defects [33]. This value has not been recorded in none of the study participants.
Although correlation analysis is a popular technique which is relatively simple to interpret and compare with results of previously conducted studies, it measures the strength of association between variables, but not the agreement between them [36]. In accordance with recommendations that various statistical approaches should be applied when assessing validity of FFQ, we constructed Bland–Altman plots and performed classification in categories of consumption and status indicators [59]. Bland–Altman plot showed that that the estimates of folate intake obtained by the F-FFQ were comparable to those from repeated 24 h dietary recalls and unlikely to cause systematic bias. Our FFQ performed well in quartile assignment considering that 84% of respondents were correctly classified in the same or adjacent quartile as 24 h recalls and 82% as biochemical status indicators. Similar results of cross-classification analyses were reported in other FFQ validation studies. Percentage of subjects classified within one quartile of folate intake (FFQ versus 24 h recalls) was 84% and 83% for FFQs developed and validated by Johansson et al. [39] and Fayet et al. [56], respectively. In the present study F-FFQ grossly misclassified 4% of women, which is comparable with 4.3% reported by Jackson et al. [52].
Application of the method of triads enabled simultaneous comparison of the F-FFQ with 24 h dietary recalls and biomarkers. In our study, high validity coefficients were determined between the true intake (I) and dietary assessment methods (F-FFQ and repeated 24 h dietary recalls) (ρQIrbc = 0.871 and ρQIser = 0.814; ρRIrbc = 0.652 and ρRIser = 0.698) and moderate ones for biomarkers (ρBIrbc = 0.428 and ρBIser = 0.421). Similar to other studies where the triangulation approach to validation of FFQ has been applied, the obtained validity coefficients for the F-FFQ and 24 h recalls were higher in relation to values for both biomarkers [40,53,60,61,62]. This could be explained by the fact that FFQ and 24 h recalls are methods designed to estimate dietary intake, while the biochemical markers are likely to be influenced by other factors in addition to diet. Our results for validity coefficients are comparable with other studies that used the triads model in validation of FFQ for assessment of folate intake (ρQIrbc = 0.871 versus 0.75, 0.690man and 0.410women; ρQIser = 0.814 versus 0.940, 0.850 man, 0.690women and 0.720) [40,53,63], as well as other nutrients such as vitamin D (0.847) [60], α-carotene (0.850) [64], β-carotene (0.760) [37] and vitamin B12 (0.950) [65]. This triangulation analyses provided additional valuable insight into F-FFQ’s performance and strengthened the evidence supporting its validity.
The F-FFQ is specific in respect to gender, age and geographic determiners, and, based on our knowledge, this is the first FFQ created and validated for the assessment of folate intake by women of reproductive age in Serbia. Advantages of this validation study include: method of data collection (i.e., interviewer-administered questionnaires according to standardized protocol), application of a detailed food list with incorporated photographs of various food portion sizes and comprehensive statistical validity confirmation with healthy women of reproductive age from different regions of Serbia. Additional advantage is consideration of dietary supplements consumption as well as analysis of folate biomarkers of recent intake and long-term status. Given that there were 503 participants in the total sample, among which 50 provided blood samples for biomarker validation analyses, the sample size in this study was harmonized with recommendations for validation studies [66]. Similar or smaller sample size has been reported for previously conducted studies using the triads method approach (n = 50 versus 53 [40], 36 [53], 20 [60] and 28 [64]). Furthermore, narrow 95% confidence intervals for the validity coefficients confirm adequate sample size in our study. It is noteworthy that in this study the so-called Heywood cases (values of validation coefficients greater than 1) have not occurred, which implies absence of random sampling fluctuation between methods or violation of basic model assumptions [20]. Additionally, in order to ensure questionnaire appropriateness regarding cultural and geographic determinants of diet, attention was dedicated to inclusion of locally available food items and traditional dishes that are consumed in Serbia [67]. Due to similar dietary patterns and cultural background, F-FFQ might be useful tool for the assessment of folate intake among other population groups in the Balkans’ region. However, before F-FFQ is used in another population, additional studies are required to explore its validity.
A potential limitation of this study is that the blood sampling for biomarker analyses was conducted only once. Moreover, reproducibility of F-FFQ has not been assessed in this study. However, according to the Altman, method with poor repeatability will never agree well with another method [68]. Good results of F-FFQ and 24 h dietary recalls agreement evaluation suggest that weak reproducibility of this instrument is quite unlikely. Future studies should explore in detail seasonal variations in folate dietary intake by collecting dietary data for every participant in each season over the year, as this was outside the scope of this study due to organizational and financial constraints. However, is unlikely to be a significant limitation since the recent large-scale survey across Europe reported absence of systematic variations for folate intake according to the season of dietary intake collection [48]. Finally, as in most researches in the field of nutrition, general limitations of dietary assessment instruments should be considered. Both dietary methods depend on the memory of respondents and their perception of portion sizes. Nevertheless, potential restrictions were minimized by highly trained interviewers, use of comprehensive Food Atlas and relatively young age of participants.

5. Conclusions

Several approaches were used to examine the external validity of the F-FFQ and it performed consistently well. The application of the triads method resulted in high validity coefficients between the true intake and the F-FFQ regardless of biomarker used (ρQIrbc = 0.871 and ρQIser = 0.814) with narrow 95% confidence intervals and the absence of Haywood cases. Furthermore, Bland–Altman and cross-classification analyses indicated good agreement between methods and satisfactory ranking potential of the F-FFQ. Therefore, considering presented results and similarities with other validation studies, we could conclude that F-FFQ is valid instrument for the assessment of dietary folate intake in women living in Serbia, a country without mandatory folic acid food fortification. In addition, the presented data strongly imply that the Serbian public health strategy should include nutrition initiatives targeting improvement of folate intake and status among women of reproductive age.

Supplementary Materials

The following are available online at https://www.mdpi.com/2072-6643/9/2/128/s1, Table S1: Food list—F-FFQ.

Acknowledgments

We gratefully thank all the women who volunteered to participate in the study for their cooperation, time and motivation. We particularly thank Agnes Kadvan for database management and software support. This work was supported by the Ministry of Education, Science and Technological Development of the Republic of Serbia (grant number III 41030).

Author Contributions

M. Glibetic formulated the research questions; M. Gurinovic, D. Krajnovic and M. Zekovic designed the research; M. Zekovic conducted research; M. Zekovic and M. Nikolic analyzed the data; M. Zekovic, M. Djekic-Ivankovic and M. Nikolic drafted and revised the paper; and M. Zekovic had primary responsibility for the final content. All authors read and approved the final manuscript.

Conflicts of Interest

The authors declare no conflict of interest. The founding sponsors had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, and in the decision to publish the results.

References

  1. Safi, J.; Joyeux, L.; Chalouhi, G.E.; Safi, J.; Joyeux, L.; Chalouhi, G.E. Periconceptional Folate Deficiency and Implications in Neural Tube Defects. J. Pregnancy 2012, 2012, 1–9. [Google Scholar] [CrossRef] [PubMed]
  2. Eichholzer, M.; Tönz, O.; Zimmermann, R. Folic acid: A public-health challenge. Lancet 2006, 367, 1352–1361. [Google Scholar] [CrossRef]
  3. Lucock, M. Folic acid: Nutritional biochemistry, molecular biology, and role in disease processes. Mol. Genet. Metab. 2000, 71, 121–138. [Google Scholar] [CrossRef]
  4. Krishnaswamy, K.; Madhavan Nair, K. Importance of folate in human nutrition. Br. J. Nutr. 2001, 85 (Suppl. 2), S115–S124. [Google Scholar] [CrossRef] [PubMed]
  5. Crider, K.S.; Bailey, L.B.; Berry, R.J. Folic acid food fortification-its history, effect, concerns, and future directions. Nutrients 2011, 3, 370–384. [Google Scholar] [CrossRef] [PubMed]
  6. Mcnulty, H.; Pentieva, K. Folate bioavailability. Proc. Nutr. Soc. 2004, 63, 529–536. [Google Scholar] [CrossRef] [PubMed]
  7. Wald, N.J.; Law, M.R.; Morris, J.K.; Wald, D.S. Quantifying the effect of folic acid. Lancet 2001, 358, 2069–2073. [Google Scholar] [CrossRef]
  8. Blom, H.J. Folic acid, methylation and neural tube closure in humans. Birth Defects Res. Part A Clin. Mol. Teratol. 2009, 85, 295–302. [Google Scholar] [CrossRef] [PubMed]
  9. Singh, S.; Sedgh, G.; Hussain, R. Unintended pregnancy: Worldwide levels, trends, and outcomes. Stud. Fam. Plan. 2010, 41, 241–250. [Google Scholar] [CrossRef]
  10. World Health Organization; Food and Agricultural Organization of the United Nations. Vitamin and Mineral Requirements in Human Nutrition, 2nd ed.; World Health Organization: Geneva, Switzerland, 2004. [Google Scholar]
  11. Gomes, S.; Lopes, C.; Pinto, E. Folate and folic acid in the periconceptional period: Recommendations from official health organizations in thirty-six countries worldwide and WHO. Public Health Nutr. 2016, 19, 176–189. [Google Scholar] [CrossRef] [PubMed]
  12. Gurinovic, M.; Kadvan, A.; Vukotic, M. The quality of nutrition of schoolchildren and adult members of families. In Yugoslav Study of Atherososclerosis Precursors in Schoolchildren in Serbia: Twenty Years Follow-Up; Nedeljkovic, S., Ed.; Medical Faculty University of Belgrade: Belgrade, Serbia, 2011; pp. 343–368. [Google Scholar]
  13. Odalovic, M.; Vezmar Kovacevic, S.; Ilic, K.; Sabo, A.; Tasic, L. Drug use before and during pregnancy in Serbia. Int. J. Clin. Pharm. 2012, 34, 719–727. [Google Scholar] [CrossRef] [PubMed]
  14. McNulty, H.; Scott, J.M. Intake and status of folate and related B-vitamins: Considerations and challenges in achieving optimal status. Br. J. Nutr. 2008, 99 (Suppl. 3), S48–S54. [Google Scholar] [CrossRef] [PubMed]
  15. Li, K.; Wahlqvist, M.L.; Li, D. Nutrition, One-Carbon Metabolism and Neural Tube Defects: A Review. Nutrients 2016, 8. [Google Scholar] [CrossRef] [PubMed]
  16. Khoshnood, B.; Loane, M.; de Walle, H.; Arriola, L.; Addor, M.-C.; Barisic, I.; Beres, J.; Bianchi, F.; Dias, C.; Draper, E.; et al. Long term trends in prevalence of neural tube defects in Europe: Population based study. BMJ 2015, 351, h5949. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Pietruszka, B.; Brzozowska, A. Folic acid supplementation practice in Europe-Plenary lecture. Polish J. Food Nutr. Sci. 2006, 15/56, 93–99. [Google Scholar]
  18. Willett, W.; Lenart, E. Reproducibility and Validity of Food Frequency Questionnaires. In Nutritional Epidemiology; Oxford University Press: New York, NY, USA, 2013; pp. 96–141. [Google Scholar]
  19. Jain, M.G.; Rohan, T.E.; Soskolne, C.L.; Kreiger, N. Calibration of the dietary questionnaire for the Canadian Study of Diet, Lifestyle and Health cohort. Public Health Nutr. 2003, 6, 79–86. [Google Scholar] [CrossRef] [PubMed]
  20. Ocké, M.C.; Kaaks, R.J. Biochemical markers as additional measurements in dietary validity studies: Application of the method of triads with examples from the European Prospective Investigation into Cancer and Nutrition. Am. J. Clin. Nutr. 1997, 65, 1240S–1245S. [Google Scholar] [PubMed]
  21. Kaaks, R.J. Biochemical markers as additional measurements in studies of the accuracy of dietary questionnaire measurements: Conceptual issues. Am. J. Clin. Nutr. 1997, 65, 1232S–1239S. [Google Scholar] [PubMed]
  22. Potischman, N. Biologic and methodologic issues for nutritional biomarkers. J. Nutr. 2003, 133 (Suppl.), 875S–880S. [Google Scholar] [PubMed]
  23. World Health Organization. Obesity: Preventing and Managing the Global Epidemic. Report of a WHO Consultation; World Health Organization: Geneva, Switzerland, 2000. [Google Scholar]
  24. Barić, I.C.; Šatalić, Z.; Keser, I.; Cecić, I.; Sučić, M. Validation of the folate food frequency questionnaire with serum and erythrocyte folate and plasma homocysteine. Int. J. Food Sci. Nutr. 2009, 60, 10–18. [Google Scholar] [CrossRef] [PubMed]
  25. Block, G.; Subar, A.F. Estimates of nutrient intake from a food frequency questionnaire: The 1987 National Health Interview Survey. J. Am. Diet. Assoc. 1992, 92, 969–977. [Google Scholar] [PubMed]
  26. Gurinovic, M.; Milešević, J.; Kadvan, A.; Nikolić, M.; Djekić-Ivanković, M.; Dupouy, E.; Finglas, P.; Glibetić, M. Advances in capacity development by applying Diet Asses Plan-DAP platform and tools for public health nutrition research and policies implementation in Balkan region. In 11th International Food Data Conference (IFDC), Food Composition and Public Health Nutrition; Longvah, T., Ed.; National Institute of Nutrition: Hyderabad, India, 2015; p. 105. [Google Scholar]
  27. Gurinović, M.; Milešević, J.; Kadvan, A.; Nikolić, M.; Zeković, M.; Djekić-Ivanković, M.; Dupouy, E.; Finglas, P.; Glibetić, M. Development, features and application of Diet Assess&Plan (DAP) software in supporting public health nutrition research in Central Eastern European Countries (CEEC). Food Chem. 2016. [Google Scholar] [CrossRef]
  28. Gurinović, M.; Milešević, J.; Novaković, R.; Kadvan, A.; Djekić-Ivanković, M.; Šatalić, Z.; Korošec, M.; Spiroski, I.; Ranić, M.; Dupouy, E.; Oshaug, A.; Finglas, P.; Glibetić, M. Improving nutrition surveillance and public health research in Central and Eastern Europe/Balkan Countries using the Balkan Food Platform and dietary tools. Food Chem. 2016, 193, 173–180. [Google Scholar] [CrossRef] [PubMed]
  29. Gavrieli, A.; Naska, A.; Konstantinidi, C.; Berry, R.; Roe, M.; Harvey, L.; Finglas, P.; Glibetic, M.; Gurinovic, M.; Trichopoulou, A. Dietary Monitoring Tools for Risk Assessment. EFSA Support. Publ. 2014, 11. [Google Scholar] [CrossRef]
  30. Gurinović, M.; Milešević, J.; Kadvan, A.; Djekić-Ivanković, M.; Debeljak-Martačić, J.; Takić, M.; Nikolić, M.; Ranković, S.; Finglas, P.; Glibetić, M. Establishment and advances in the online Serbian food and recipe data base harmonized with EuroFIRTM standards. Food Chem. 2016, 193, 30–38. [Google Scholar] [CrossRef] [PubMed]
  31. Abbott Laboratoires. Operator Manual ARCHITECT i2000 SR Abbott Diagnostic Folate; Abbott Laboratories: Abbott Park, IL, USA, 2010. [Google Scholar]
  32. World Health Organization. Serum and Red Blood Cell Folate Concentrations for Assessing Folate Status in Populations; World Health Organization: Geneva, Switzerland, 2015. [Google Scholar]
  33. World Health Organization. Guideline: Optimal Serum and Red Cell Folate Concentrations in Women of Reproductive Age for Prevention of Neural Tube Defects; World Health Organization: Geneva, Switzerland, 2015. [Google Scholar]
  34. Willett, W.C.; Howe, G.R.; Kushi, L.H. Adjustment for total energy intake in epidemiologic studies. Am. J. Clin. Nutr. 1997, 65, 1220S–1228S. [Google Scholar] [PubMed]
  35. Van Belle, G.; Fisher, L.D.; Heagerty, P.J.; Lumley, T. Descriptive Statistics. In Biostatistics: A Methodology For the Health Sciences; John Wiley & Sons, Inc.: Hoboken, NJ, USA, 2004; pp. 25–61. [Google Scholar]
  36. Bland, J.M.; Altman, D.G. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986, 1, 307–310. [Google Scholar] [CrossRef]
  37. Kabagambe, E.K.; Baylin, A.; Allan, D.A.; Siles, X.; Spiegelman, D.; Campos, H. Application of the method of triads to evaluate the performance of food frequency questionnaires and biomarkers as indicators of long-term dietary intake. Am. J. Epidemiol. 2001, 154, 1126–1135. [Google Scholar] [CrossRef] [PubMed]
  38. R Development Core Team. R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2014. [Google Scholar]
  39. Johansson, I.; Van Guelpen, B.; Hultdin, J.; Johansson, M.; Hallmans, G.; Stattin, P. Validity of food frequency questionnaire estimated intakes of folate and other B vitamins in a region without folic acid fortification. Eur. J. Clin. Nutr. 2010, 64, 905–913. [Google Scholar] [CrossRef] [PubMed]
  40. Verkleij-Hagoort, A.C.; de Vries, J.H.M.; Stegers, M.P.G.; Lindemans, J.; Ursem, N.T.C.; Steegers-Theunissen, R.P.M. Validation of the assessment of folate and vitamin B12 intake in women of reproductive age: The method of triads. Eur. J. Clin. Nutr. 2007, 61, 610–615. [Google Scholar] [CrossRef] [PubMed]
  41. Agodi, A.; Barchitta, M.; Quattrocchi, A.; Marchese, A.E.; Boffetta, P. Folate deficiency is not associated with increased mitochondrial genomic instability: Results from dietary intake and lymphocytic mtDNA 4977-bp deletion in healthy young women in Italy. Mutagenesis 2014, 29, 101–106. [Google Scholar] [CrossRef] [PubMed]
  42. Brevik, A.; Vollset, S.E.; Tell, G.S.; Refsum, H.; Ueland, P.M.; Loeken, E.B.; Drevon, C.A.; Andersen, L.F. Plasma concentration of folate as a biomarker for the intake of fruit and vegetables: The Hordaland Homocysteine Study. Am. J. Clin. Nutr. 2005, 81, 434–439. [Google Scholar] [PubMed]
  43. Waśkiewicz, A.; Sygnowska, E.; Broda, G. Dietary intake of vitamins B6, B12 and folate in relation to homocysteine serum concentration in the adult Polish population - WOBASZ Project. Kardiol. Pol. 2010, 68, 275–282. [Google Scholar] [PubMed]
  44. Alfthan, G.; Laurinen, M.S.; Valsta, L.M.; Pastinen, T.; Aro, A. Folate intake, plasma folate and homocysteine status in a random Finnish population. Eur. J. Clin. Nutr. 2003, 57, 81–88. [Google Scholar] [CrossRef] [PubMed]
  45. Manios, Y.; Moschonis, G.; Mavrogianni, C.; Bos, R.; Singh-Povel, C. Micronutrient intakes among children and adults in Greece: The role of age, sex and socio-economic status. Nutrients 2014, 6, 4073–4092. [Google Scholar] [CrossRef] [PubMed]
  46. Elmadfa, I.; Meyer, A.L. Austrian Nutrition Report 2012; Federal Ministry of Health, University of Vienna, Institute of Nutritional Sciences: Vienna, Austria, 2012. [Google Scholar]
  47. Planells, E.; Sánchez, C.; Montellano, M.A.; Mataix, J.; Llopis, J. Vitamins B6 and B12 and folate status in an adult Mediterranean population. Eur. J. Clin. Nutr. 2003, 57, 777–785. [Google Scholar] [CrossRef] [PubMed]
  48. Park, J.Y.; Nicolas, G.; Freisling, H.; Biessy, C.; Scalbert, A.; Romieu, I.; Chajès, V.; Chuang, S.-C.; Ericson, U.; Wallström, P.; et al. Comparison of standardised dietary folate intake across ten countries participating in the European Prospective Investigation into Cancer and Nutrition. Br. J. Nutr. 2012, 108, 552–569. [Google Scholar] [CrossRef] [PubMed]
  49. Elmadfa, I.; Meyer, A.; Nowak, V.; Hasenegger, V.; Putz, P.; Verstraeten, R.; Remaut-DeWinter, A.M.; Kolsteren, P.; Dostálová, J.; Dlouhý, P.; et al. European Nutrition and Health Report 2009. Forum Nutr. 2009, 62, 1–405. [Google Scholar] [PubMed]
  50. Hoey, L.; McNulty, H.; Duffy, M.E.; Hughes, C.F.; Strain, J.J. EURRECA-Estimating folate requirements for deriving dietary reference values. Crit. Rev. Food Sci. Nutr. 2013, 53, 1041–1050. [Google Scholar] [CrossRef] [PubMed]
  51. Pauwels, S.; Doperé, I.; Huybrechts, I.; Godderis, L.; Koppen, G.; Vansant, G. Reproducibility and validity of an FFQ to assess usual intake of methyl-group donors. Public Health Nutr. 2015, 18, 2530–2539. [Google Scholar] [CrossRef] [PubMed]
  52. Jackson, M.D.; Walker, S.P.; Younger, N.M.; Bennett, F.I. Use of a food frequency questionnaire to assess diets of Jamaican adults: Validation and correlation with biomarkers. Nutr. J. 2011, 10, 28. [Google Scholar] [CrossRef] [PubMed]
  53. Pufulete, M.; Emery, P.W.; Nelson, M.; Sanders, T.A.B. Validation of a short food frequency questionnaire to assess folate intake. Br. J. Nutr. 2002, 87, 383–390. [Google Scholar] [CrossRef] [PubMed]
  54. French, M.R.; Langdon, C.; Levy-Milne, R. Development of a validated food frequency questionnaire to determine folate intake. Can. J. Diet. Pract. Res. Publ. Dietit. Can. 2001, 62, 82–86. [Google Scholar]
  55. Coathup, V.; Wheeler, S.; Smith, L. A method comparison of a food frequency questionnaire to measure folate, choline, betaine, vitamin C and carotenoids with 24 h dietary recalls in women of reproductive age. Eur. J. Clin. Nutr. 2015, 70, 1–6. [Google Scholar] [CrossRef] [PubMed]
  56. Fayet, F.; Flood, V.; Petocz, P.; Samman, S. Relative and biomarker-based validity of a food frequency questionnaire that measures the intakes of vitamin B 12, folate, iron, and zinc in young women. Nutr. Res. 2011, 31, 14–20. [Google Scholar] [CrossRef] [PubMed]
  57. Brantsaeter, A.L.; Haugen, M.; Alexander, J.; Meltzer, H.M. Validity of a new food frequency questionnaire for pregnant women in the Norwegian Mother and Child Cohort Study (MoBa). Matern. Child Nutr. 2008, 4, 28–43. [Google Scholar] [CrossRef] [PubMed]
  58. Bailey, L.B.; Stover, P.J.; Mcnulty, H.; Fenech, M.F.; Iii, J.F.G.; Mills, J.L.; Pfeiffer, C.M.; Fazili, Z.; Zhang, M.; Ueland, P.M.; et al. Biomarkers of Nutrition for Development—Folate Review 1–5. J. Nutr. 2015, 145, 1636S–1680S. [Google Scholar] [CrossRef] [PubMed]
  59. Flood, V.M.; Smith, W.T.; Webb, K.L.; Mitchell, P. Issues in assessing the validity of nutrient data obtained from a food-frequency questionnaire: Folate and vitamin B12 examples. Public Health Nutr. 2007, 7, 751–756. [Google Scholar] [CrossRef]
  60. Djekic-Ivankovic, M.; Weiler, H.A.; Nikolic, M.; Kadvan, A.; Gurinovic, M.; Mandic, L.M.; Glibetic, M. Validity of an FFQ assessing the vitamin D intake of young Serbian women living in a region without food fortification: The method of triads model. Public Health Nutr. 2015, 19, 1–9. [Google Scholar] [CrossRef] [PubMed]
  61. Combet, E.; Lean, M.E.J. Validation of a short food frequency questionnaire specific for iodine in U.K. females of childbearing age. J. Hum. Nutr. Diet. 2014, 27, 599–605. [Google Scholar] [CrossRef] [PubMed]
  62. Pauwels, S.; Doperé, I.; Huybrechts, I.; Godderis, L.; Koppen, G.; Vansant, G. Validation of a food-frequency questionnaire assessment of methyl-group donors using estimated diet records and plasma biomarkers: The method of triads. Int. J. Food Sci. Nutr. 2014, 65, 768–773. [Google Scholar] [CrossRef] [PubMed]
  63. Shai, I.; Rosner, B.A.; Shahar, D.R.; Vardi, H.; Azrad, A.B.; Kanfi, A.; Schwarzfuchs, D.; Fraser, D. Dietary evaluation and attenuation of relative risk: Multiple comparisons between blood and urinary biomarkers, food frequency, and 24-h recall questionnaires: The DEARR study. J. Nutr. 2005, 135, 573–579. [Google Scholar] [PubMed]
  64. McNaughton, S.A.; Marks, G.C.; Gaffney, P.; Williams, G.; Green, A. Validation of a food-frequency questionnaire assessment of carotenoid and vitamin E intake using weighed food records and plasma biomarkers: The method of triads model. Eur. J. Clin. Nutr. 2005, 59, 211–218. [Google Scholar] [CrossRef] [PubMed]
  65. Shuaibi, A.M.; Sevenhuysen, G.P.; House, J.D. Validation of a Food Choice Map with a 3-Day Food Record and Serum Values to Assess Folate and Vitamin B-12 Intake in College-Aged Women. J. Am. Diet. Assoc. 2008, 108, 2041–2050. [Google Scholar] [CrossRef] [PubMed]
  66. Serra-Majem, L.; Frost Andersen, L.; Henríque-Sánchez, P.; Doreste-Alonso, J.; Sánchez-Villegas, A.; Ortiz-Andrelluchi, A.; Negri, E.; La Vecchia, C. Evaluating the quality of dietary intake validation studies. Br. J. Nutr. 2009, 102, S3–S9. [Google Scholar] [CrossRef] [PubMed]
  67. Teufel, N.I. Development of culturally competent food-frequency questionnaires. Am. J. Clin. Nutr. 1997, 65, 1173S–1178S. [Google Scholar] [PubMed]
  68. Altman, D.G. Practical Statistics For Medical Research; Chapman & Hall/CRC: London, UK, 1991. [Google Scholar]
Nutrients 09 00128 g001 550
Figure 1. Recruitment process and sample overview (FFQ, Food Frequency Questionnaire).
Figure 1. Recruitment process and sample overview (FFQ, Food Frequency Questionnaire).
Nutrients 09 00128 g001
Nutrients 09 00128 g002 550
Figure 2. Correlations between folate intake assessed by the F-FFQ and the average of 24 h recalls in: (a) total sample (n = 503); and (b) validation subsample (n = 50); and folate intake assessed by the FFQ and: (c) folate serum concentration; and (d) red blood cells (RBC) folate concentration among Serbian women of reproductive age. All correlations were significant: (a) r = 0.56, p < 0.001; (b) r = 0.57, p < 0.001; (c) rser = 0.28, p < 0.01; and (d) rrbc = 0.37, p < 0.01.
Figure 2. Correlations between folate intake assessed by the F-FFQ and the average of 24 h recalls in: (a) total sample (n = 503); and (b) validation subsample (n = 50); and folate intake assessed by the FFQ and: (c) folate serum concentration; and (d) red blood cells (RBC) folate concentration among Serbian women of reproductive age. All correlations were significant: (a) r = 0.56, p < 0.001; (b) r = 0.57, p < 0.001; (c) rser = 0.28, p < 0.01; and (d) rrbc = 0.37, p < 0.01.
Nutrients 09 00128 g002
Nutrients 09 00128 g003 550
Figure 3. Bland–Altman plot assessing the agreement between the F-FFQ and the average of three 24 h dietary recalls for estimating folate intake, Serbian women of reproductive age. For each participan, the difference in folate intakes between the two methods was plotted against the mean folate intake by two methods: solid line, mean difference; and dotted line, 95% limits of agreement (LOA).
Figure 3. Bland–Altman plot assessing the agreement between the F-FFQ and the average of three 24 h dietary recalls for estimating folate intake, Serbian women of reproductive age. For each participan, the difference in folate intakes between the two methods was plotted against the mean folate intake by two methods: solid line, mean difference; and dotted line, 95% limits of agreement (LOA).
Nutrients 09 00128 g003
Nutrients 09 00128 g004 550
Figure 4. Triangular relationship of the correlation coefficients (rQB, rRB, rQR) between folate intake estimated by the FFQ (Q), the average of the three 24 h dietary recalls (R) and the biomarkers (B) of folate status: (a) folate concentration in serum; and (b) red blood cells (RBC) folate concentration, and validity coefficients (VC: ρQI, ρBI, ρRI) between true intake (I) and estimated intakes, with 95% confidence intervals. * The lower limit of the true validity coefficient is correlation between the biomarker and the two dietary methods (F-FFQ and 24 h recalls), and the upper limit is calculated by the method of triads.
Figure 4. Triangular relationship of the correlation coefficients (rQB, rRB, rQR) between folate intake estimated by the FFQ (Q), the average of the three 24 h dietary recalls (R) and the biomarkers (B) of folate status: (a) folate concentration in serum; and (b) red blood cells (RBC) folate concentration, and validity coefficients (VC: ρQI, ρBI, ρRI) between true intake (I) and estimated intakes, with 95% confidence intervals. * The lower limit of the true validity coefficient is correlation between the biomarker and the two dietary methods (F-FFQ and 24 h recalls), and the upper limit is calculated by the method of triads.
Nutrients 09 00128 g004
Table
Table 1. Daily energy and nutrient intake assessed by the F-FFQ and average of the three 24 h dietary recalls with correlations between the estimates of the dietary intake by applied questionnaires among Serbian women of reproductive age.
Table 1. Daily energy and nutrient intake assessed by the F-FFQ and average of the three 24 h dietary recalls with correlations between the estimates of the dietary intake by applied questionnaires among Serbian women of reproductive age.
NutrientTotal Sample (n = 503)Pearson Correlation CoefficientValidation Group (n = 50)Pearson Correlation Coefficient
F-FFQ24 h RecallsF-FFQ24 h Recalls
MeanSDMeanSDrMeanSDMeanSDr
Energy (kcal)1724.62330.021734.20318.500.53 **1727.29200.361718.93219.400.59 **
Carbohydrates (% TEI)52.239.2150.947.23 51.025.5149.886.08
Carbohydrates (g)225.1942.72220.8559.780.51 *220.3123.58214.3528.210.52 **
Fat (% TEI)27.8110.6128.307.21 29.346.7431.416.30
Fat (g)53.2923.9054.5323.720.41 **56.3114.9059.9914.850.47 *
Protein (% TEI)19.522.9320.223.50 19.202.0518.492.62
Protein (g)84.1613.8787.6617.510.39 **82.917.3879.468.920.40 *
Folate (µg/1000 kcal)118.9835.44121.6642.730.53 **123.9532.27119.9035.760.53 **
Folate (µg)205.2061.30211.0081.060.56 **214.1060.78206.1065.310.57 **
1 F-FFQ, Folate Food Frequency Questionnaire; %TEI, percentage of total energy intake; * p-value < 0.01, ** p-value < 0.001.
Table
Table 2. Daily intake levels presented as the median values and 5th and 95th percentiles of twelve food groups and their corresponding contributions to daily folate intake based on repeated 24 h dietary recalls among Serbian women of reproductive age.
Table 2. Daily intake levels presented as the median values and 5th and 95th percentiles of twelve food groups and their corresponding contributions to daily folate intake based on repeated 24 h dietary recalls among Serbian women of reproductive age.
Food GroupsIntake of the Food Group (g/Day)Contribution to Total Folate Intake
MedianP5P95%Folate Intake (µg/Day)
Vegetables and vegetable products175.0763.95318.2037.3579.66
Grains and grain products195.9190.68338.8223.3949.89
Fruits and fruit products130.759.31378.1711.5224.57
Milk and milk products241.6915.68481.1210.4822.35
Meat and meat products95.6212.31200.875.7712.31
Nuts, seeds and kernel products6.000.0066.003.016.42
Beverages (non-milk)1.140.0432.592.65.55
Miscellaneous5.870.0078.482.34.91
Eggs and egg products8.880.0064.101.453.09
Sea food and related products0.000.00107.451.112.37
Sugar and sugar products17.550.7564.970.982.09
Fat and oil11.690.0032.620.040.09
Table
Table 3. Major folate food sources assessed by the F-FFQ and 24 h dietary recalls among Serbian women of reproductive age.
Table 3. Major folate food sources assessed by the F-FFQ and 24 h dietary recalls among Serbian women of reproductive age.
Food24 h Dietary Recall (n = 503)F-FFQ (n = 503)
µg DFE/Day (Total Sample)µg DFE/Day (Consumers Only)Number of Consumers% of ConsumersAverage Frequency of Consumption
Bread white15.6730.1132865.21every day
Beans10.08218.3843486.282–3 times per month
Tomato, raw9.4518.7548295.834–6 times a week
Yoghurt 2.8% mf7.6516.0541983.30once a week
Chicken, liver7.14251.1945690.66once a week
Peas, green6.1193.5742283.902–3 times per month
Banana, raw6.0648.3849297.812–3 times per week
Egg, hen, whole5.7822.4548796.822–3 times per week
Pepper, red5.0351.0732163.822–3 times per month
Potato4.9812.9122544.732–3 times per month
Strawberries, raw4.8426.9541983.30once a week
String beans4.4367.1124849.302–3 times per month
Lettuce, green leaf4.2917.9835470.382–3 times per month
Orange juice, fresh3.1762.1623246.12once a week
Cabbage, white2.7112.0639378.132–3 times per month
DFE, dietary folate equivalents.
Table
Table 4. Estimated serum and RBC folate concentrations by quartile of intake assessed by F-FFQ among Serbian women of reproductive age.
Table 4. Estimated serum and RBC folate concentrations by quartile of intake assessed by F-FFQ among Serbian women of reproductive age.
QuartilesFolate Intake (µg/Day)nSerum Folate (nmol/L)RBC Folate (nmol/L)
Mean95% CIp for TrendMean95% CIp for Trend
1st quartile<168.43 (147.31)139.545.73–13.35 378.29304.73–451.84
2nd quartile168.43–194.12 (182,60)1311.487.51–15.45 399.05306.61–491.48
3rd quartile194.12–245.62 (217.37)1212.188.78–15.58 447.27358.51–536.02
4th quartile245.62–362.34 (306.81)1215.9011.51–20.290.0139526.05444.62–607.480.0113
RBC, red blood cells.
Table
Table 5. Cross-classification (%) of folate intake into quartiles by the F-FFQ and validation methods (the average of three 24 h recalls and biomarkers of folate status, i.e., serum and red blood cells (RBC folate concentrations) for 50 participants of validation subsample, Serbian women of reproductive age.
Table 5. Cross-classification (%) of folate intake into quartiles by the F-FFQ and validation methods (the average of three 24 h recalls and biomarkers of folate status, i.e., serum and red blood cells (RBC folate concentrations) for 50 participants of validation subsample, Serbian women of reproductive age.
Folate Intake/Status Assessed byFolate Intake Assessed by F-FFQ
Same QuartileSame or Adjacent QuartileOpposite QuartileGrossly Misclassified
24 h recall6884124
Folate RBC5082144
Folate serum4882126

Share and Cite

MDPI and ACS Style

Zekovic, M.; Djekic-Ivankovic, M.; Nikolic, M.; Gurinovic, M.; Krajnovic, D.; Glibetic, M. Validity of the Food Frequency Questionnaire Assessing the Folate Intake in Women of Reproductive Age Living in a Country without Food Fortification: Application of the Method of Triads. Nutrients 2017, 9, 128. https://doi.org/10.3390/nu9020128

AMA Style

Zekovic M, Djekic-Ivankovic M, Nikolic M, Gurinovic M, Krajnovic D, Glibetic M. Validity of the Food Frequency Questionnaire Assessing the Folate Intake in Women of Reproductive Age Living in a Country without Food Fortification: Application of the Method of Triads. Nutrients. 2017; 9(2):128. https://doi.org/10.3390/nu9020128

Chicago/Turabian Style

Zekovic, Milica, Marija Djekic-Ivankovic, Marina Nikolic, Mirjana Gurinovic, Dusanka Krajnovic, and Marija Glibetic. 2017. "Validity of the Food Frequency Questionnaire Assessing the Folate Intake in Women of Reproductive Age Living in a Country without Food Fortification: Application of the Method of Triads" Nutrients 9, no. 2: 128. https://doi.org/10.3390/nu9020128

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop