Abstract
Background: The use of linked data in the Semantic Web is a promising approach to add value to nutrition research. An ontology, which defines the logical relationships between well-defined taxonomic terms, enables linking and harmonizing research output. To enable the description of domain-specific output in nutritional epidemiology, we propose the Ontology for Nutritional Epidemiology (ONE) according to authoritative guidance for nutritional epidemiology. Methods: Firstly, a scoping review was conducted to identify existing ontology terms for reuse in ONE. Secondly, existing data standards and reporting guidelines for nutritional epidemiology were converted into an ontology. The terms used in the standards were summarized and listed separately in a taxonomic hierarchy. Thirdly, the ontologies of the nutritional epidemiologic standards, reporting guidelines, and the core concepts were gathered in ONE. Three case studies were included to illustrate potential applications: (i) annotation of existing manuscripts and data, (ii) ontology-based inference, and (iii) estimation of reporting completeness in a sample of nine manuscripts. Results: Ontologies for “food and nutrition” (n = 37), “disease and specific population” (n = 100), “data description” (n = 21), “research description” (n = 35), and “supplementary (meta) data description” (n = 44) were reviewed and listed. ONE consists of 339 classes: 79 new classes to describe data and 24 new classes to describe the content of manuscripts. Conclusion: ONE is a resource to automate data integration, searching, and browsing, and can be used to assess reporting completeness in nutritional epidemiology.
1. Introduction
Nutritional epidemiology provides evidence regarding the effects of human diets on health [1]. Unfortunately, most evidence is produced by short-term randomized trials or observational studies with small effect sizes [2]. Large-scale studies are time-consuming and demand substantial involvement of participants. Integrated analysis of shared data could increase the power of analysis and add considerable value to research [3]. However, due to the various descriptions of data and research output in nutritional epidemiology, retrieval and use of shared data is challenging. Reporting guidelines describe essential information for manuscripts and are potentially useful to standardize the description of research output [4].
An ontology framework developed from such guidelines enables a standardized method of data descriptions in Semantic Web [5,6]. An ontology consists of terms and their relationships to structure the description of shared data in the Semantic Web [7]. While a terminology defines the terms, an ontology defines the relationships between these terms to structure the description of shared data. Ontology terms and their relations are human-readable, but their electronic identifiers also enable computer processing such as inferencing and machine learning [8,9]. An introduction to ontology with simple examples was given by Noy and McGuinness [7].
Ontologies can contribute to make research output such as data, manuscripts, and study protocols findable, accessible, interoperable, and reusable (FAIR) [10]. FAIR research output is now made mandatory by research funders such as the European Commission for the establishment of a European Open Science Cloud [11].
The development of a virtual research infrastructure to share research output with researchers, consumers, the public, and the private sector is a promising prospect for nutrition science [12]. Despite calls since 2007 [13], progress toward an ontology for nutritional epidemiology is limited. FoodOn was developed as a taxonomy for food classification and description [14], with subsequent identifiers in Langual and FoodEx2 [15,16]. Although generic ontologies such as the Ontology for Nutritional Studies [17] and Bionutrition Ontology [18] are available, none of these enable describing nutritional epidemiologic output.
We present the Ontology for Nutritional Epidemiology (ONE), as well as case studies to illustrate potential applications. The purpose of developing ONE was not to introduce a novel controlled vocabulary or terminology, but to define the relationships between (often existing) terms to describe nutritional epidemiology. ONE, hence, identifies relevant existing ontology terms and introduces a minimum of new terms.
ONE has three components: (1) “descriptors for nutritional epidemiologic data”: meta-data descriptions for nutritional epidemiologic data; (2) “STROBE-nut (strengthening the reporting of observational studies in epidemiology—an extension for nutritional epidemiology) items”: quality descriptors for reporting nutritional epidemiologic studies; and (3) “nutritional epidemiologic terms”: core nutritional epidemiologic concepts. ONE is registered on Bioportal (https://bioportal.bioontology.org/ontologies/ONE), and is available on the STROBE-nut website (https://www.STROBE-nut.org) and Github (https://github.com/cyang0128/Nutritional-epidemiologic-ontologies).
The present study was conducted in the context of the European Nutritional Phenotype Assessment and Data Sharing Initiative, a collaborative effort of 16 multidisciplinary consortia from 50 research centers in nine countries, aiming to promote data sharing in nutrition.
To facilitate the reading of the article, a table of acronyms is presented (Table 1).
Table 1.
Key concepts used in the manuscript.
2. Materials and Methods
A scoping review of existing ontology terms provided a basis for the development of ONE. Next, ONE was developed by converting paper-based standards [4,23,24] into an ontology representation, including a separate taxonomic hierarchy of specific nutritional epidemiologic terms. Finally, ONE was applied in three case studies to illustrate its potential applications.
2.1. Review and Summary of Existing Ontologies for Use in Nutritional Epidemiology
As a sub-discipline of epidemiology, nutritional epidemiology analyzes the relationship between dietary intake and health [25]. As an interdisciplinary science, nutritional epidemiology also requires knowledge from other disciplines such as nutrition, food science, medicine, etc. Instead of developing a new stand-alone ontology, we firstly considered existing ontologies in epidemiology [26], as well as the relevant disciplines, and then identified missing elements for nutritional epidemiology [13].
On 13 April 2018, all ontologies in the three main medical ontology libraries [27,28]—OBO Foundry (http://www.obofoundry.org/) [29], BioPortal (https://bioportal.bioontology.org/) [30], and Ontology Lookup Service (https://www.ebi.ac.uk/ols/index) [31]—were reviewed by C.Y. and H.A. independently. On 26 May 2019, an update of the review was carried out to retrieve ontologies published between 13 April 2018 and 26 May 2019. Ontologies were included if their scope met part of the controlled vocabulary requirement of nutritional epidemiology, as shown in Table A1 (Appendix A).
A pre-established data extraction spreadsheet was used to list all ontologies for review. Three review rounds were conducted. During the first review round, the full names of all the ontologies were assessed. During the second review round, the short descriptions of the ontologies on their BioPortal homepage were reviewed. If the information from the descriptions was insufficient or in case of reviewer disagreement, ontologies were included in the next review round. Finally, during the third review round, the included terms and taxonomies of the ontologies were reviewed. Disagreements were resolved through discussion until a consensus was reached. In case some ontologies were inaccessible, information for these ontologies was reviewed in relevant publications or web pages.
The FAIR principles provide essential guidance to search and integrate data at the individual and meta-level. The required types of controlled vocabulary to achieve FAIR principles in nutritional epidemiology were summarized (Table A1, Appendix A), and the ontologies were classified accordingly. A quality assessment of the selected ontologies was conducted using the modules by Burton-Jones et al. [32]. Minor changes were made to present the quality of multiple medical ontologies. On 16 May 2018, statistics were collected through BioPortal (https://bioportal.bioontology.org/), Agroportal (http://agroportal.lirmm.fr/), and Ontobee (http://www.ontobee.org/).
2.2. Development of ONE
The ontology is represented in the resource description framework (RDF) format [33] and edited using the default text editor of Microsoft Windows 7. A quality assessment of ONE was conducted as proposed by Burton-Jones, Storey, Sugumaran, and Ahluwalia [32]. The relevance, authority, and history module were not assessed, however, as they require data collection after publishing the ontology.
2.2.1. Existing Data Standards in Nutritional Epidemiology
The terms of two existing standards for nutrition research (i.e., minimal meta-data descriptors [23] and data quality descriptors [24]) were represented in ONE. The ontology terms were grouped as “descriptors for nutritional epidemiologic data”.
In case certain terms were found in more than one ontology, the term with the definition that best described the intended term was selected by a domain expert. When no exact terms were found in the selected ontologies, a synonym term was obtained from a domain expert if the definition was suitable.
However, if the exact term or the synonym could not be retrieved from existing ontologies, a new electronic identifier was attributed: (1) for terms only used in nutritional epidemiologic research, the identifier “one:nexxxxx” (xxxxx = five digits) was assigned, where “one” represents “ontology for nutritional epidemiology”, and “ne” represents “only used in nutritional epidemiology” (e.g., identifier for “dietary assessment administration”: one:ne00057); (2) for other terms that can also be used in other subjects, identifier “one:Txxxxx” (xxxxxx = five digits) was assigned, where “one” represents “ontology for nutritional epidemiology” and “T” represents “temporary” (e.g., identifier for “food composition table”: one:T00027). Terms indicated with “T” should, hence, be developed in their corresponding domain ontology. The list of temporary terms will be reviewed on a regular basis and updated where needed.
2.2.2. Reporting Guidelines in Nutritional Epidemiology
The “strengthening the reporting of observational studies in epidemiology” (STROBE) reporting guidelines for nutritional epidemiology [4] were used as the basis to develop the ontology for reporting of nutritional epidemiology. The collection of ontology terms is allocated under the term “STROBE-nut items” in ONE. For the STROBE-nut reporting items (e.g., title, abstract, etc.), electronic identifier “one:reportxxxxx” (xxxxx = five digits) was given, where “one” represents “ontology for nutritional epidemiology”, and “report” represents “reporting items” (e.g., identifier for “title”: one:report00001); for the STROBE-nut recommendations, identifier “one:report/nut-x” (x = one digit) was assigned, where “one” represents “ontology for nutritional epidemiology”, and “report/nut-x” represents “the STROBE-nut recommendations for reporting on items” (e.g., identifier for “STROBE-nut recommendation 1”: one:report/nut-1).
2.2.3. Nutritional Epidemiologic Terms
The term “nutritional epidemiologic terms” (electronic identifier: one:terms) was used to group the specific nutritional epidemiologic terms summarized from the standard descriptions during the previous steps. The taxonomy presents terms to describe the core concepts, study design, and data measurement characteristics of nutritional epidemiology. However, those terms do not cover generic information to report research, such as study name, study duration, study area, etc. Terms used for generic study information, however, are considered part of the minimal data requirements and quality descriptors, and were, hence, mainly retrieved from other existing ontologies.
2.3. Applications of ONE
ONE was applied in three case studies to illustrate its potential applications: (i) study annotation and term query, (ii) ontology-based inference, and (iii) estimation of reporting completeness in a sample of nine manuscripts.
Firstly, an existing manuscript [34] and one of its corresponding datasets were annotated manually using ONE terms (Syntax available on Bioportal). Terms from other ontologies were also used to annotate nutrition information that was not related to nutrition (e.g., geography, season, etc.).
Secondly, the potential ontology-based inference was described. Inference on the basis of the taxonomy of terms can significantly improve the quality of data search and integration. Three terms used to annotate the manuscripts were selected for this case study [34]. By showing partial taxonomic hierarchies of the three terms, we explained how to infer unknown information from available information.
Thirdly, an assessment of reporting completeness was conducted using ONE, similar to the ontology-based meta-analyses by Kupershmidt et al. [35] and Ramaprasad and Syn [36]. A convenient sample of nine published manuscripts [37,38,39,40,41,42,43,44,45] was manually annotated using STROBE-nut terms of ONE for this purpose. By querying the electronic identifiers of STROBE-nut terms, the reporting frequencies of STROBE-nut terms were obtained. The hierarchies of STROBE-nut terms and one annotated manuscript were compared to illustrate where STROBE-nut terms were reported in the manuscript.
3. Results
3.1. Review and Summary of Existing Ontology Vocabulary for Use in Nutritional Epidemiology
In total, 1146 ontologies were retrieved, of which 237 were selected and classified according to their scope (Figure 1). As shown in Table A2 (Appendix A), 158 ontologies were selected to annotate data (33 ontologies for food/dietary agricultural products, four ontologies for nutrients/chemical compounds, 100 ontologies for disease and specific population (e.g., student health record ontology), and 21 ontologies for data management), and 35 were selected for metadata annotation (35 ontologies for research terminology and no ontology for metadata representation). There were also 44 ontologies to describe supplementary (meta) data (e.g., ethical issues, demographics, fundamental ontology knowledge frameworks, etc.). Among the ontologies found, no ontology was developed as a frame (e.g., guidance and guidelines) to present meta-data in nutritional epidemiologic information.
Figure 1.
Review and selection process of ontologies for nutritional epidemiology.
The quality assessment (Figure A1a) shows that 14% of the selected ontologies had less than 100 terms. Most of the selected ontologies (65%) had 101–10,000 terms, while 15% of the selected ontologies had more than 10,000 terms. The richness module (Figure A1b) shows that 15% of the selected ontologies had no properties, 23% of the selected ontologies had 1–10 properties, and 55% of the selected ontologies had more than 10 properties, including 14% of the selected ontologies with over 100 properties. Figure A1c,d indicate that 25% of the terms had no definitions, and 94% of the selected ontologies were not peer-reviewed. The lawfulness module (Figure A1e), authority module (Figure A1f), and history module (Figure A1g) represent the practicality of the selected ontologies. Only 2% of the selected ontologies were inaccessible due to error ontology files (Figure A1e). Only 8% of the selected ontologies were not mapped, while 20% of the selected ontologies were made of more than 300 mapped ontologies (Figure A1f). Less than half (47%) of the selected ontologies were visited less than 10 times per month (Figure A1g).
3.2. Development of ONE
The structure of ONE is shown in Figure 2, and a quality description is included in Table A3 (Appendix A). ONE consists of 339 classes. It reuses classes from 22 existing ontologies, where the main referred medical ontologies are NCIT (National Cancer Institute Thesaurus, 43 classes) and MeSH (Medical Subject Headings, 33 classes). ONE proposes 79 new classes to describe nutrition data and 24 new classes to describe the content of manuscript.
Figure 2.
The overall structure of the ontology for nutritional epidemiology (ONE).
The electronic identifiers of terms are written after the corresponding terms. The electronic identifiers (e.g., NCIT:C94729) consist of two parts: (1) an ontology acronym (e.g., “NCIT” is the acronym of “ontology for National Cancer Institute Thesaurus”), and (2) a code of the term in the ontology (e.g., C94729 is code of “season” in NCIT ontology).
3.2.1. Existing Data Standards in Nutritional Epidemiology
The main taxonomies of the minimal data requirements and data quality descriptors are shown in Figure 3 and Figure 4, respectively. The collection of ontology terms is reported in Table A8 and Table A9 (Appendix A), respectively. Recommendations for generic terms that could not be found in existing ontologies of other subjects are indicated as footnotes of Table A8 and Table A9 (Appendix A).
Figure 3.
The ontology taxonomy of minimal data requirements.
Figure 4.
The ontology taxonomy of data quality descriptors of observational studies in nutritional epidemiology.
3.2.2. STROBE-Nut Reporting Guidelines in Nutritional Epidemiology
For the collection of ontology terms for STROBE-nut reporting guidelines, the STROBE reporting items (e.g., title, abstract, etc.) were used as a taxonomic hierarchy of terms. The specific STROBE-nut recommendations were arranged under their corresponding STROBE reporting items (Figure 5).
Figure 5.
The ontology taxonomy of strengthening the reporting of observational studies in epidemiology (STROBE)-nut (nutritional epidemiology) items.
3.2.3. Nutritional Epidemiologic Terms
Nutritional epidemiologic terms and their taxonomic hierarchy are shown in Table 2. All the terms were arranged according to the relevant descriptors listed in the minimal data requirements [23] and data quality descriptors [24]. The terms at the first hierarchy level are the descriptors (i.e., nutritional epidemiologic terms), while the terms at the second and third hierarchy levels are the options of descriptors (i.e., terms with more specific descriptions used for specific conditions). The taxonomic hierarchy also includes relevant terms of other ontologies. The present ontology has concepts related to dietary assessment tool, dietary assessment questionnaire, dietary data validation, dietary data processing, and dietary data quality descriptions.
Table 2.
Hierarchical structure of nutritional epidemiologic terms.
3.3. Application of ONE
3.3.1. Case Study 1: Study Annotation and Term Query
The annotations for a manuscript [34] and its dataset collected in Cameroon [46] are presented in Table A4 and Table A5 (Appendix A), respectively. Using ONE terms (e.g., “study name”, “study objective”, “study population”, etc.) to link the manuscript/dataset to its meta-data, the manuscript/dataset is annotated according to the data standards and STROBE-nut reporting guidelines included in ONE. Applying ONE avoids confusion when annotating the manuscript and dataset since all term definitions become available. This facilitates the correct understanding by annotators and users of annotated manuscripts and datasets.
3.3.2. Case Study 2: Ontology-Based Inference
Using the annotation in case study 1, the potential for ontology-based inferencing is presented in Table A6 (Appendix A). Using “country”, “study”, and “method” as relationships between the manuscript and its meta-data, the manuscript is annotated as “a cross-sectional study collecting data in Cameroon by 24-h recall method”. The annotation is inferred to a more generic annotation through the taxonomies of terms in the United States National Library of Medicine Medical Subject Headings (MeSH) and ONE ontology. The upper level terms of “MeSH:D002163”, “MeSH:D03430”, and “one:ne00003” are “MeSH:D000350”, “MeSH:D016021”, and “one:ne00001” (second column), respectively. According to the labels of the three upper level terms, the inferred information (third column) is obtained: “this is an epidemiologic study collecting data in Central Africa by dietary assessment method”. The ontology inference now enables integration and a wider search of data. For example, when searching information annotated for “Central Africa”, the present data from “Cameroon” are identifiable.
3.3.3. Case Study 3: Estimation of Reporting Completeness in a Sample of Nine Manuscripts
The STROBE-nut annotation of nine manuscripts is added under ONE class “case studies: study description” [47]. Table A7a (Appendix A) counts the number of STROBE-nut items described in each manuscript, while Table A7b (Appendix A) reports the frequency of each STROBE-nut item reported in the nine manuscripts. Additional details on the hierarchy of annotation is available in Table A7c (Appendix A). For instance, the study by Mills, Brown, Wrieden, White, and Adams [37] indicates three STROBE-nut items (i.e., Nut-13, Nut-14, and Nut-16) that were reported in the “methods section”, instead of the “results section” of manuscripts as recommended by STROBE-nut.
4. Discussion
We reviewed existing ontologies to identify terms for annotating nutritional epidemiologic research output. Ontology terms were collected to describe the minimal information needed to annotate and link research outputs such as data, manuscript, and study protocols to facilitate study identification, retrieval, integration, and reuse.
To date, an ontology for study level description in nutrition epidemiology is missing. The present work adds value to the Cochrane PICO (i.e., patient, population, or problem; intervention, comparison, and outcome) ontology [5], which is being developed to formulate research questions, and search and characterize clinical studies, as well as meta-analyses. ONE complements the work of GODAN (Global Open Data for Agriculture and Nutrition) [48], LanguaL [16], and FoodEx2 [14] initiatives, which focused on food items and their properties. Moreover, ONE can be considered as an extension of the Epidemiology Ontology (EPO) that summarizes the features of generic epidemiologic studies [26,49].
To our knowledge, it is the first time that an ontology is developed based on manuscript reporting guidelines such as STROBE-nut [50]. Reporting guidelines are widely applied and endorsed by journals as tools to improve completeness of reporting in biomedical research, to enable easier searching, filtering, and navigation of research findings for further policy, practice, or research [51,52]. However, reporting guidelines remain a paper-based initiative. The conversion into a machine-readable representation could expand the use of reporting guidelines to searching and inferring of information. Converting other research reporting guidelines such as CONSORT (CONsolidated Standards of Reporting Trials) [53] or PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) [54] into ontologies would significantly improve the scope of their application. For instance, assessment of reporting completeness remains a manual and ad hoc exercise and was only attempted in a handful of cases [55,56,57]. The application of ontologies could potentially be used for automatic monitoring of reporting completeness of manuscripts. It would enable identification of frequently and rarely reported STROBE-nut items and where they are applied in the manuscripts and, as such, provide insights to update the standards [58]. Other potential applications of ontologies for research output include the monitoring of trends in research and identification of neglected areas, as shown in the use of the gene ontology for genetic research [59]. Similar applications are useful for recommendations o minimal data requirements and data quality descriptions.
To update ONE, automated processes will be required [13]. Ontology learning, a process where machines are taught by humans how to build ontologies from text, provides useful prospects in this regard [60]. Ontology learning from text was demonstrated earlier [61]. For instance, Arguello Casteleiro et al. [62] applied deep learning to extract a cardiovascular disease ontology from biomedical literature. However, considerable technical challenges remain, and sustained effort by nutritionists and machine learning expertise will be required.
Development of user-friendly applications of ontology-based annotation will be required to apply ONE and minimize the burden of ongoing work by researchers. To date, most researchers in nutritional epidemiology are unfamiliar with ontologies. Further ontology development in nutritional epidemiology will, therefore, require the contribution of researchers working in multiple research areas. Additional training and capacity-building efforts are needed to ensure uptake and ownership by the nutrition research community. Ad hoc training sessions were organized previously [63], but will require further development and integration in academic curricula.
The strength of the current work is the use of existing standards and recommendations that are developed for nutrition research [51,64]. Those standards are developed by and used in the nutrition research community and ensure validity of ONE in the wider research community. Existing ontologies were reviewed as a preparation to convert existing standards into an ontology. As such, the review is a useful resource for researchers and ontology developers in nutritional epidemiology. However, some of the reviewed ontologies did not contain terms that were essential for ONE and consequent ontology-based inferring.
The existing ontologies reviewed, including ONE, are not yet sufficient to annotate all aspects of nutritional epidemiology. For example, an ontology to connect dietary intake data to food nutrition composition data based on international/local food composition tables is still missing. Meanwhile, ontologies for other reporting guidelines such as CONSORT [53] and PRISMA [54] would facilitate the reporting of findings from other types of research. To enable ontology applications in nutritional epidemiology, additional contributions are required from researchers working on multiple research areas. In addition, four reviewed ontologies (Randomized Controlled Trials Ontology (RCTONT) [65], Non-Randomized Controlled Trials Ontology (NONRCTO) [66], Immune Disorder Ontology (IMMDIS) [67], and Neglected Tropical Disease Ontology (NTDO) [68]) contained errors in the formats and could not be assessed. Identifying these data gaps is hopefully an incentive to address the missing elements.
5. Conclusions
To conclude, this study introduced a comprehensive ontology for reporting nutritional epidemiologic studies and data. When applied at scale, application of ONE could enable monitoring of reporting completeness of nutritional epidemiology in the biomedical literature. Ultimately, the generated ontologies should be integrated with other linked data and applied in data collection tools, text editors, journal submission systems, or data repositories for convenient and scalable search, quality checking, etc.
Author Contributions
Conceptualization, B.D.B. and P.K.; investigation, C.Y. and H.A.; methodology, C.Y. and C.L.; software, C.Y., N.T., and F.P.; supervision, F.P. and C.L.; writing—original draft, C.Y. and C.L.; writing—review and editing, C.Y., H.A., B.D.B., P.K., N.T., D.H., J.B., A.B., F.P., and C.L.
Funding
The European Nutritional Phenotype Assessment and Data Sharing Initiative (ENPADASI) is part of the Joint Programming Initiative (JPI) “a healthy diet for a healthy life” and is funded by national funding agencies in nine European countries. The work in this manuscript is funded by the FWO Research Foundation Flanders, grant number G0D4815N. C.Y. is funded by a scholarship from the Chinese Scholarship Council. C.L. received funding from Bioversity Int for the work on standards for dietary assessment.
Acknowledgments
We would like to thank Giles Hanley-Cook for the language review.
Conflicts of Interest
The authors declare no conflicts of interest.
Appendix A
Figure A1.
Quality characteristics of selected ontologies for nutritional epidemiology.
Table A1.
Scope of controlled vocabulary in nutritional epidemiology to achieve the FAIR principle.
Table A2.
Classification of selected ontologies according to the scope of ONE (complete list).
Table A3.
Metrics for quality assessment of ONE. n/a—not available.
Table A4.
Case study: dietary species richness as a measure of food biodiversity and nutritional quality of diet (Lachat et al. 2018), study description.
Table A5.
Case study: dietary species richness as a measure of food biodiversity and nutritional quality of diet (Lachat et al. 2018), Cameroon dataset description.
Table A6.
Case study: ontology-based inferences.
Table A7.
Case study: estimation of reporting completeness in a sample of nine manuscripts (reporting quality reference by using STROBE-nut terms).
(a) Mapped STROBE-nut terms per manuscript
(b) Mapping rate of each STROBE-nut term
(c) Hierarchy mapping
Table A8.
Ontology view of minimal data requirement of observational studies.
Table A9.
Ontology view of data quality descriptors of observational studies.
References
- Willett, W. Nutritional Epidemiology, 2nd ed.; Oxford University Press: New York, NY, USA, 1998. [Google Scholar]
- Concato, J.; Shah, N.; Horwitz, R.I. Randomized, controlled trials, observational studies, and the hierarchy of research designs. N. Engl. J. Med. 2000, 342, 1887–1892. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Chan, A.W.; Song, F.; Vickers, A.; Jefferson, T.; Dickersin, K.; Gotzsche, P.C.; Krumholz, H.M.; Ghersi, D.; van der Worp, H.B. Increasing value and reducing waste: Addressing inaccessible research. Lancet 2014, 383, 257–266. [Google Scholar] [CrossRef] [Scilit]
- Lachat, C.; Hawwash, D.; Ocké, M.C.; Berg, C.; Forsum, E.; Hörnell, A.; Larsson, C.; Sonestedt, E.; Wirfält, E.; Åkesson, A.; et al. Strengthening the Reporting of OBservational studies in Epidemiology–Nutritional Epidemiology (STROBE-nut): An extension of the STROBE statement. PLoS Med. 2016, 13, e10002036. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Cochrance Linked Data. Cochrane PICO Ontology. Available online: https://linkeddata.cochrane.org/pico-ontology (accessed on 20 July 2018).
- Institute for Health Metrics and Evaluation; Global Burden of Disease Study 2015 (GBD 2015) Data Input Sources Tool. Global Burden of Disease Study 2015 (GBD 2015) Data Input Sources Tool. Available online: http://ghdx.healthdata.org/gbd-2015/data-input-sources (accessed on 7 December 2018).
- Noy, N.F.; McGuinness, D.L. Ontology Development 101: A Guide to Creating Your First Ontology; Knowledge Systems Laboratory Stanford University: Stanford, CA, USA, 2001. [Google Scholar]
- Rhee, S.Y.; Wood, V.; Dolinski, K.; Draghici, S. Use and misuse of the gene ontology annotations. Nat. Rev. Genet. 2008, 9, 509–515. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Fang, W.D.; Zhang, L.; Wang, Y.X.; Dong, S.B. Toward a semantic search engine based on ontologies. In Proceedings of the 2005 International Conference on Machine Learning and Cybernetics, Guangzhou, China, 8–21 August 2005; Volume 1–9, pp. 1913–1918. [Google Scholar]
- Wilkinson, M.D.; Dumontier, M.; Aalbersberg, I.J.; Appleton, G.; Axton, M.; Baak, A.; Blomberg, N.; Boiten, J.W.; da Silva Santos, L.B.; Bourne, P.E.; et al. The FAIR Guiding Principles for scientific data management and stewardship. Sci. Data 2016, 3, 160018. [Google Scholar] [CrossRef] [Scilit]
- Boulos, M.; Yassine, A.; Shirmohammadi, S.; Namahoot, C.; Brückner, M. Towards an “Internet of Food”: Food Ontologies for the Internet of Things. Future Internet 2015, 7, 372–392. [Google Scholar] [CrossRef] [Scilit]
- Snoek, H.M.; Eijssen, L.M.T.; Geurts, M.; Vors, C.; Brown, K.A.; Bogaardt, M.-J.; Dhonukshe-Rutten, R.A.M.; Evelo, C.T.; Fezeu, L.K.; Finglas, P.M.; et al. Advancing food, nutrition, and health research in Europe by connecting and building research infrastructures in a DISH-RI: Results of the EuroDISH project. Trends Food Sci. Technol. 2018, 73, 58–66. [Google Scholar] [CrossRef] [Scilit]
- Lemay, D.G.; Zivkovic, A.M.; German, J.B. Building the bridges to bioinformatics in nutrition research. Am. J. Clin. Nutr. 2007, 86, 1261–1269. [Google Scholar] [CrossRef] [Scilit]
- European Food Safety Authority. The Food Classification and Description System FoodEx2; European Food Safety Authority: Parma, Italy, 2015. [Google Scholar]
- Dooley, M.D.; Griffiths, J.E.; Gosal, S.G.; Buttigieg, L.P.; Hoehndorf, R.; Lange, C.M.; Schriml, M.L.; Brinkman, F.S.L.; Hsiao, W.L.W. FoodOn: A harmonized food ontology to increase global food traceability, quality control and data integration. npj Sci. Food 2018, 2, 23. [Google Scholar] [CrossRef] [Scilit]
- Danish Food Informatics. LanguaL—The International Framework for Food Description. Available online: http://www.langual.org/ (accessed on 20 July 2018).
- Vitali, F.; Lombardo, R.; Rivero, D.; Mattivi, F.; Franceschi, P.; Bordoni, A.; Trimigno, A.; Capozzi, F.; Felici, G.; Taglino, F.; et al. ONS: An ontology for a standardized description of interventions and observational studies in nutrition. Genes Nutr. 2018, 13, 12. [Google Scholar] [CrossRef] [Scilit]
- Coffran, C.; Meehan, D.; Ronning, A. Bionutrition Ontology. Available online: http://purl.bioontology.org/ontology/BNO (accessed on 13 August 2018).
- Eftimov, T.; Korosec, P.; Korousic Seljak, B. StandFood: Standardization of Foods Using a Semi-Automatic System for Classifying and Describing Foods According to FoodEx2. Nutrients 2017, 9, 542. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- National Library of Medicine. Medical Subject Headings 2017. Available online: https://www.nlm.nih.gov/mesh/meshhome.html (accessed on 25 November 2018).
- Golbeck, J.; Fragoso, G.; Hartel, F.; Hendler, J.; Oberthaler, J.; Parsia, B. The National Cancer Institute’s Thesaurus and Ontology. SSRN Electron. J. 2003, 1. [Google Scholar] [CrossRef] [Scilit]
- Brickley, D.; Guha, R.V. RDF Schema 1.1. Available online: https://www.w3.org/TR/rdf-schema/ (accessed on 26 May 2019).
- Pinart, M.; Nimptsch, K.; Bouwman, J.; Dragsted, L.O.; Yang, C.; De Cock, N.; Lachat, C.; Perozzi, G.; Canali, R.; Lombardo, R.; et al. Joint Data Analysis in Nutritional Epidemiology: Identification of Observational Studies and Minimal Requirements. J. Nutr. 2018, 148, 285–297. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Yang, C.; Pinart, M.; Kolsteren, P.; Van Camp, J.; De Cock, N.; Nimptsch, K.; Pischon, T.; Laird, E.; Perozzi, G.; Canali, R.; et al. Perspective: Essential Study Quality Descriptors for Data from Nutritional Epidemiologic Research. Adv. Nutr. 2017, 8, 639–651. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Boeing, H. Nutritional epidemiology: New perspectives for understanding the diet-disease relationship? Eur. J. Clin. Nutr. 2013, 67, 424–429. [Google Scholar] [CrossRef] [Scilit]
- Pesquita, C.; Ferreira, J.D.; Couto, F.M.; Silva, M.J. The epidemiology ontology: An ontology for the semantic annotation of epidemiological resources. J. Biomed. Semant. 2014, 5, 4. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- D’Aquin, M.; Noy, N.F. Where to Publish and Find Ontologies? A Survey of Ontology Libraries. J. Web Semant. 2012, 11, 96–111. [Google Scholar] [CrossRef] [Scilit]
- World Wide Web Consortium. Ontology Repositories. Available online: https://www.w3.org/wiki/Ontology_repositories (accessed on 13 April 2018).
- Smith, B.; Ashburner, M.; Rosse, C.; Bard, J.; Bug, W.; Ceusters, W.; Goldberg, L.J.; Eilbeck, K.; Ireland, A.; Mungall, C.J.; et al. The OBO Foundry: Coordinated evolution of ontologies to support biomedical data integration. Nat. Biotechnol. 2007, 25, 1251–1255. [Google Scholar] [CrossRef] [Scilit]
- Noy, N.F.; Shah, N.H.; Whetzel, P.L.; Dai, B.; Dorf, M.; Griffith, N.; Jonquet, C.; Rubin, D.L.; Storey, M.A.; Chute, C.G.; et al. BioPortal: Ontologies and integrated data resources at the click of a mouse. Nucleic Acids Res. 2009, 37, W170–W173. [Google Scholar] [CrossRef] [Scilit]
- Cote, R.G.; Jones, P.; Apweiler, R.; Hermjakob, H. The Ontology Lookup Service, a lightweight cross-platform tool for controlled vocabulary queries. BMC Bioinform. 2006, 7, 97. [Google Scholar] [CrossRef] [Scilit]
- Burton-Jones, A.; Storey, V.C.; Sugumaran, V.; Ahluwalia, P. A semiotic metrics suite for assessing the quality of ontologies. Data Knowl. Eng. 2005, 55, 84–102. [Google Scholar] [CrossRef] [Scilit]
- RDF Working Group. Resource Description Framework (RDF). Available online: https://www.w3.org/RDF/ (accessed on 16 September 2018).
- Lachat, C.; Raneri, J.E.; Smith, K.W.; Kolsteren, P.; Van Damme, P.; Verzelen, K.; Penafiel, D.; Vanhove, W.; Kennedy, G.; Hunter, D.; et al. Dietary species richness as a measure of food biodiversity and nutritional quality of diets. Proc. Natl. Acad. Sci. USA 2018, 115, 127–132. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Kupershmidt, I.; Su, Q.J.; Grewal, A.; Sundaresh, S.; Halperin, I.; Flynn, J.; Shekar, M.; Wang, H.; Park, J.; Cui, W.; et al. Ontology-based meta-analysis of global collections of high-throughput public data. PLoS ONE 2010, 5. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Ramaprasad, A.; Syn, T. Ontological Meta-Analysis and Synthesis. Commun. Assoc. Inf. Syst. 2015, 37. [Google Scholar] [CrossRef] [Scilit]
- Mills, S.; Brown, H.; Wrieden, W.; White, M.; Adams, J. Frequency of eating home cooked meals and potential benefits for diet and health: Cross-sectional analysis of a population-based cohort study. Int. J. Behav. Nutr. Phys. Act. 2017, 14, 109. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Mills, S.; Adams, J.; Wrieden, W.; White, M.; Brown, H. Sociodemographic characteristics and frequency of consuming home-cooked meals and meals from out-of-home sources: Cross-sectional analysis of a population-based cohort study. Public Health Nutr. 2018, 21, 2255–2266. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Abris, G.P.; Kim, N.H.; Provido, S.M.P.; Hong, S.; Yu, S.H.; Lee, C.B.; Lee, J.E. Dietary diversity and nutritional adequacy among married Filipino immigrant women: The Filipino Women’s Diet and Health Study (FiLWHEL). BMC Public Health 2018, 18, 359. [Google Scholar] [CrossRef] [Scilit]
- Chatelan, A.; Beer-Borst, S.; Randriamiharisoa, A.; Pasquier, J.; Blanco, J.M.; Siegenthaler, S.; Paccaud, F.; Slimani, N.; Nicolas, G.; Camenzind-Frey, E.; et al. Major Differences in Diet across Three Linguistic Regions of Switzerland: Results from the First National Nutrition Survey menuCH. Nutrients 2017, 9, 1163. [Google Scholar] [CrossRef] [Scilit]
- Lam, M.C.L.; Adams, J. Association between home food preparation skills and behaviour, and consumption of ultra-processed foods: Cross-sectional analysis of the UK National Diet and nutrition survey (2008–2009). Int. J. Behav. Nutr. Phys. Act. 2017, 14, 68. [Google Scholar] [CrossRef] [Scilit]
- Llanaj, E.; Ádány, R.; Lachat, C.; D’Haese, M. Examining food intake and eating out of home patterns among university students. PLoS ONE 2018. [Google Scholar] [CrossRef] [Scilit]
- Arsenault, J.E.; Nikiema, L.; Allemand, P.; Ayassou, K.A.; Lanou, H.; Moursi, M.; De Moura, F.F.; Martin-Prevel, Y. Seasonal differences in food and nutrient intakes among young children and their mothers in rural Burkina Faso. J. Nutr. Sci. 2014, 3, e55. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- De Cock, N.; Van Lippevelde, W.; Vervoort, L.; Vangeel, J.; Maes, L.; Eggermont, S.; Braet, C.; Lachat, C.; Huybregts, L.; Goossens, L.; et al. Sensitivity to reward is associated with snack and sugar-sweetened beverage consumption in adolescents. Eur. J. Nutr. 2016, 55, 1623–1632. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Workicho, A.; Belachew, T.; Feyissa, G.T.; Wondafrash, B.; Lachat, C.; Verstraeten, R.; Kolsteren, P. Household dietary diversity and Animal Source Food consumption in Ethiopia: Evidence from the 2011 Welfare Monitoring Survey. BMC Public Health 2016, 16, 1192. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Bechem, M.; Huybregts, L.; van Damme, P. Biodiversity and Complementary Feeding Practices of Children in the North West Region of Cameroon; Harvard Dataverse: Cambridge, MA, USA, 2014. [Google Scholar]
- Yang, C. Case Studies: Study Description Ontology for Nutritional Epidemiology. Available online: http://purl.bioontology.org/ontology/ONE?conceptid=http%3A%2F%2Fpurl.bioontology.org%2Fontology%2FONE%2Fstandards%23caseStudies_study (accessed on 5 October 2018).
- GODAN. Global Open Data for Agriculture and Nutrition. Available online: https://www.godan.info/ (accessed on 20 July 2018).
- Ferreira, J.D.; Paolotti, D.; Couto, F.M.; Silva, M.J. On the usefulness of ontologies in epidemiology research and practice. J. Epidemiol. Community Health 2013, 67, 385–388. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Glasziou, P.; Altman, D.G.; Bossuyt, P.; Boutron, I.; Clarke, M.; Julious, S.; Michie, S.; Moher, D.; Wager, E. Reducing waste from incomplete or unusable reports of biomedical research. Lancet 2014, 383, 267–276. [Google Scholar] [CrossRef] [Scilit]
- von Elm, E.; Altman, D.G.; Egger, M.; Pocock, S.J.; Gøtzsche, P.C.; Vandenbroucke, J.P.; STROBE-Initiative. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE)statement: Guidelines for reporting observational studies. PLoS Med. 2007, 4, e296. [Google Scholar] [CrossRef] [Scilit]
- the Centre for Statistics in Medicine (CSM). Equator: Enhancing the QUAlity and Transparency of Health Research. Available online: http://www.equator-network.org/library/translations-of-reporting-guidelines/ (accessed on 17 September 2018).
- Moher, D.; Hopewell, S.; Schulz, K.F.; Montori, V.; Gotzsche, P.C.; Devereaux, P.J.; Elbourne, D.; Egger, M.; Altman, D.G. CONSORT 2010 explanation and elaboration: Updated guidelines for reporting parallel group randomised trials. BMJ 2010, 340, c869. [Google Scholar] [CrossRef]
- Moher, D.; Liberati, A.; Tetzlaff, J.; Altman, D.G.; Group, P. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Med. 2009, 6, e1000097. [Google Scholar] [CrossRef] [Scilit]
- Moher, D.; Jones, A.; Lepage, L.; CONSORT Group (Consolidated Standards for Reporting of Trials). Use of the CONSORT Statement and Quality of Reports of Randomized Trials. JAMA 2001, 285, 1992. [Google Scholar] [CrossRef] [Scilit]
- Panic, N.; Leoncini, E.; de Belvis, G.; Ricciardi, W.; Boccia, S. Evaluation of the endorsement of the preferred reporting items for systematic reviews and meta-analysis (PRISMA) statement on the quality of published systematic review and meta-analyses. PLoS ONE 2013, 8, e83138. [Google Scholar] [CrossRef] [Scilit]
- Sorensen, A.A.; Wojahn, R.D.; Manske, M.C.; Calfee, R.P. Using the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement to assess reporting of observational trials in hand surgery. J. Hand Surg. Am. 2013, 38, 1584.e2–1589.e2. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Wilkinson, M.D.; Verborgh, R.; Bonino da Silva Santos, L.O.; Clark, T.; Swertz, M.A.; Kelpin, F.D.L.; Gray, A.J.G.; Schultes, E.A.; van Mulligen, E.M.; Ciccarese, P.; et al. Interoperability and FAIRness through a novel combination of Web technologies. PeerJ Comput. Sci. 2017, 3, e110. [Google Scholar] [CrossRef] [Scilit]
- Stoeger, T.; Gerlach, M.; Morimoto, R.I.; Nunes Amaral, L.A. Large-scale investigation of the reasons why potentially important genes are ignored. PLoS Biol. 2018, 16, e2006643. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Yang, H.; Callan, J. Human-Guided Ontology Learning. Available online: https://www.cs.cmu.edu/~callan/Papers/hcir08-yang.pdf (accessed on 28 October 2018).
- Gomez-Perez, A.; Manzano-Macho, D. An overview of methods and tools for ontology learning from texts. Knowl. Eng. Rev. 2004, 19, 187–212. [Google Scholar] [CrossRef] [Scilit]
- Arguello Casteleiro, M.; Demetriou, G.; Read, W.; Fernandez Prieto, M.J.; Maroto, N.; Maseda Fernandez, D.; Nenadic, G.; Klein, J.; Keane, J.; Stevens, R. Deep learning meets ontologies: Experiments to anchor the cardiovascular disease ontology in the biomedical literature. J. Biomed. Semant. 2018, 9, 13. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- ENPADASI Consortium. Project Deliverable Report (D6.3, D6.5 Workshops). Available online: http://www.enpadasi.eu/deliverables_final_pdf/D6.3_D6.5.pdf (accessed on 28 October 2018).
- ENPADASI Consortium. European Nutritional Phenotype Assessment and Data Sharing Initiative (ENPADASI). Available online: http://www.enpadasi.eu/ (accessed on 17 September 2018).
- Zaveri, A. Randomized Controlled Trials Ontology. Available online: https://bioportal.bioontology.org/ontologies/RCTONT (accessed on 26 May 2019).
- Zaveri, A. Non-Randomized Controlled Trials Ontology. Available online: https://bioportal.bioontology.org/ontologies/NONRCTO (accessed on 26 May 2019).
- Scheuermann, R. Immune Disorder Ontology. Available online: https://bioportal.bioontology.org/ontologies/IMMDIS (accessed on 26 May 2019).
- Santana, F. Neglected Tropical Disease Ontology. Available online: https://bioportal.bioontology.org/ontologies/NTDO (accessed on 26 May 2019).
© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).





