An Ontology to Standardize Research Output of Nutritional Epidemiology: From Paper-Based Standards to Linked Content
by
, , ,
Chen Yang
1
,
Henry Ambayo
1,
Bernard De Baets
2
,
Patrick Kolsteren
1,
Nattapon Thanintorn
3,
Dana Hawwash
1,
Jildau Bouwman
4,
Antoon Bronselaer
5,
Filip Pattyn
6,† and
Carl Lachat
1,*,† 1
Department of Food Technology, Safety and Health, Ghent University, 9000 Ghent, Belgium
2
KERMIT, Department of Data Analysis and Mathematical Modelling, Ghent University, 9000 Ghent, Belgium
3
Department of Pathology and Anatomical Sciences, University of Missouri, Columbia, MO 65203, USA
4
Netherlands Organization for Applied Scientific Research, NL-2509 Zeist, The Netherlands
5
Department of Telecommunications and information processing, Ghent University, 9000 Ghent, Belgium
6
ONTOFORCE, 9052 Ghent, Belgium
*
Author to whom correspondence should be addressed.
†
These authors contributed equally to this work.
Nutrients 2019, 11(6), 1300; https://doi.org/10.3390/nu11061300
Submission received: 13 May 2019
/
Revised: 3 June 2019
/
Accepted: 6 June 2019
/
Published: 8 June 2019
Abstract
:Background: The use of linked data in the Semantic Web is a promising approach to add value to nutrition research. An ontology, which defines the logical relationships between well-defined taxonomic terms, enables linking and harmonizing research output. To enable the description of domain-specific output in nutritional epidemiology, we propose the Ontology for Nutritional Epidemiology (ONE) according to authoritative guidance for nutritional epidemiology. Methods: Firstly, a scoping review was conducted to identify existing ontology terms for reuse in ONE. Secondly, existing data standards and reporting guidelines for nutritional epidemiology were converted into an ontology. The terms used in the standards were summarized and listed separately in a taxonomic hierarchy. Thirdly, the ontologies of the nutritional epidemiologic standards, reporting guidelines, and the core concepts were gathered in ONE. Three case studies were included to illustrate potential applications: (i) annotation of existing manuscripts and data, (ii) ontology-based inference, and (iii) estimation of reporting completeness in a sample of nine manuscripts. Results: Ontologies for “food and nutrition” (n = 37), “disease and specific population” (n = 100), “data description” (n = 21), “research description” (n = 35), and “supplementary (meta) data description” (n = 44) were reviewed and listed. ONE consists of 339 classes: 79 new classes to describe data and 24 new classes to describe the content of manuscripts. Conclusion: ONE is a resource to automate data integration, searching, and browsing, and can be used to assess reporting completeness in nutritional epidemiology.
1. Introduction
Nutritional epidemiology provides evidence regarding the effects of human diets on health [1]. Unfortunately, most evidence is produced by short-term randomized trials or observational studies with small effect sizes [2]. Large-scale studies are time-consuming and demand substantial involvement of participants. Integrated analysis of shared data could increase the power of analysis and add considerable value to research [3]. However, due to the various descriptions of data and research output in nutritional epidemiology, retrieval and use of shared data is challenging. Reporting guidelines describe essential information for manuscripts and are potentially useful to standardize the description of research output [4].
An ontology framework developed from such guidelines enables a standardized method of data descriptions in Semantic Web [5,6]. An ontology consists of terms and their relationships to structure the description of shared data in the Semantic Web [7]. While a terminology defines the terms, an ontology defines the relationships between these terms to structure the description of shared data. Ontology terms and their relations are human-readable, but their electronic identifiers also enable computer processing such as inferencing and machine learning [8,9]. An introduction to ontology with simple examples was given by Noy and McGuinness [7].
Ontologies can contribute to make research output such as data, manuscripts, and study protocols findable, accessible, interoperable, and reusable (FAIR) [10]. FAIR research output is now made mandatory by research funders such as the European Commission for the establishment of a European Open Science Cloud [11].
The development of a virtual research infrastructure to share research output with researchers, consumers, the public, and the private sector is a promising prospect for nutrition science [12]. Despite calls since 2007 [13], progress toward an ontology for nutritional epidemiology is limited. FoodOn was developed as a taxonomy for food classification and description [14], with subsequent identifiers in Langual and FoodEx2 [15,16]. Although generic ontologies such as the Ontology for Nutritional Studies [17] and Bionutrition Ontology [18] are available, none of these enable describing nutritional epidemiologic output.
We present the Ontology for Nutritional Epidemiology (ONE), as well as case studies to illustrate potential applications. The purpose of developing ONE was not to introduce a novel controlled vocabulary or terminology, but to define the relationships between (often existing) terms to describe nutritional epidemiology. ONE, hence, identifies relevant existing ontology terms and introduces a minimum of new terms.
ONE has three components: (1) “descriptors for nutritional epidemiologic data”: meta-data descriptions for nutritional epidemiologic data; (2) “STROBE-nut (strengthening the reporting of observational studies in epidemiology—an extension for nutritional epidemiology) items”: quality descriptors for reporting nutritional epidemiologic studies; and (3) “nutritional epidemiologic terms”: core nutritional epidemiologic concepts. ONE is registered on Bioportal (https://bioportal.bioontology.org/ontologies/ONE), and is available on the STROBE-nut website (https://www.STROBE-nut.org) and Github (https://github.com/cyang0128/Nutritional-epidemiologic-ontologies).
The present study was conducted in the context of the European Nutritional Phenotype Assessment and Data Sharing Initiative, a collaborative effort of 16 multidisciplinary consortia from 50 research centers in nine countries, aiming to promote data sharing in nutrition.
To facilitate the reading of the article, a table of acronyms is presented (Table 1).
2. Materials and Methods
A scoping review of existing ontology terms provided a basis for the development of ONE. Next, ONE was developed by converting paper-based standards [4,23,24] into an ontology representation, including a separate taxonomic hierarchy of specific nutritional epidemiologic terms. Finally, ONE was applied in three case studies to illustrate its potential applications.
2.1. Review and Summary of Existing Ontologies for Use in Nutritional Epidemiology
As a sub-discipline of epidemiology, nutritional epidemiology analyzes the relationship between dietary intake and health [25]. As an interdisciplinary science, nutritional epidemiology also requires knowledge from other disciplines such as nutrition, food science, medicine, etc. Instead of developing a new stand-alone ontology, we firstly considered existing ontologies in epidemiology [26], as well as the relevant disciplines, and then identified missing elements for nutritional epidemiology [13].
On 13 April 2018, all ontologies in the three main medical ontology libraries [27,28]—OBO Foundry (http://www.obofoundry.org/) [29], BioPortal (https://bioportal.bioontology.org/) [30], and Ontology Lookup Service (https://www.ebi.ac.uk/ols/index) [31]—were reviewed by C.Y. and H.A. independently. On 26 May 2019, an update of the review was carried out to retrieve ontologies published between 13 April 2018 and 26 May 2019. Ontologies were included if their scope met part of the controlled vocabulary requirement of nutritional epidemiology, as shown in Table A1 (Appendix A).
A pre-established data extraction spreadsheet was used to list all ontologies for review. Three review rounds were conducted. During the first review round, the full names of all the ontologies were assessed. During the second review round, the short descriptions of the ontologies on their BioPortal homepage were reviewed. If the information from the descriptions was insufficient or in case of reviewer disagreement, ontologies were included in the next review round. Finally, during the third review round, the included terms and taxonomies of the ontologies were reviewed. Disagreements were resolved through discussion until a consensus was reached. In case some ontologies were inaccessible, information for these ontologies was reviewed in relevant publications or web pages.
The FAIR principles provide essential guidance to search and integrate data at the individual and meta-level. The required types of controlled vocabulary to achieve FAIR principles in nutritional epidemiology were summarized (Table A1, Appendix A), and the ontologies were classified accordingly. A quality assessment of the selected ontologies was conducted using the modules by Burton-Jones et al. [32]. Minor changes were made to present the quality of multiple medical ontologies. On 16 May 2018, statistics were collected through BioPortal (https://bioportal.bioontology.org/), Agroportal (http://agroportal.lirmm.fr/), and Ontobee (http://www.ontobee.org/).
2.2. Development of ONE
The ontology is represented in the resource description framework (RDF) format [33] and edited using the default text editor of Microsoft Windows 7. A quality assessment of ONE was conducted as proposed by Burton-Jones, Storey, Sugumaran, and Ahluwalia [32]. The relevance, authority, and history module were not assessed, however, as they require data collection after publishing the ontology.
2.2.1. Existing Data Standards in Nutritional Epidemiology
The terms of two existing standards for nutrition research (i.e., minimal meta-data descriptors [23] and data quality descriptors [24]) were represented in ONE. The ontology terms were grouped as “descriptors for nutritional epidemiologic data”.
In case certain terms were found in more than one ontology, the term with the definition that best described the intended term was selected by a domain expert. When no exact terms were found in the selected ontologies, a synonym term was obtained from a domain expert if the definition was suitable.
However, if the exact term or the synonym could not be retrieved from existing ontologies, a new electronic identifier was attributed: (1) for terms only used in nutritional epidemiologic research, the identifier “one:nexxxxx” (xxxxx = five digits) was assigned, where “one” represents “ontology for nutritional epidemiology”, and “ne” represents “only used in nutritional epidemiology” (e.g., identifier for “dietary assessment administration”: one:ne00057); (2) for other terms that can also be used in other subjects, identifier “one:Txxxxx” (xxxxxx = five digits) was assigned, where “one” represents “ontology for nutritional epidemiology” and “T” represents “temporary” (e.g., identifier for “food composition table”: one:T00027). Terms indicated with “T” should, hence, be developed in their corresponding domain ontology. The list of temporary terms will be reviewed on a regular basis and updated where needed.
2.2.2. Reporting Guidelines in Nutritional Epidemiology
The “strengthening the reporting of observational studies in epidemiology” (STROBE) reporting guidelines for nutritional epidemiology [4] were used as the basis to develop the ontology for reporting of nutritional epidemiology. The collection of ontology terms is allocated under the term “STROBE-nut items” in ONE. For the STROBE-nut reporting items (e.g., title, abstract, etc.), electronic identifier “one:reportxxxxx” (xxxxx = five digits) was given, where “one” represents “ontology for nutritional epidemiology”, and “report” represents “reporting items” (e.g., identifier for “title”: one:report00001); for the STROBE-nut recommendations, identifier “one:report/nut-x” (x = one digit) was assigned, where “one” represents “ontology for nutritional epidemiology”, and “report/nut-x” represents “the STROBE-nut recommendations for reporting on items” (e.g., identifier for “STROBE-nut recommendation 1”: one:report/nut-1).
2.2.3. Nutritional Epidemiologic Terms
The term “nutritional epidemiologic terms” (electronic identifier: one:terms) was used to group the specific nutritional epidemiologic terms summarized from the standard descriptions during the previous steps. The taxonomy presents terms to describe the core concepts, study design, and data measurement characteristics of nutritional epidemiology. However, those terms do not cover generic information to report research, such as study name, study duration, study area, etc. Terms used for generic study information, however, are considered part of the minimal data requirements and quality descriptors, and were, hence, mainly retrieved from other existing ontologies.
2.3. Applications of ONE
ONE was applied in three case studies to illustrate its potential applications: (i) study annotation and term query, (ii) ontology-based inference, and (iii) estimation of reporting completeness in a sample of nine manuscripts.
Firstly, an existing manuscript [34] and one of its corresponding datasets were annotated manually using ONE terms (Syntax available on Bioportal). Terms from other ontologies were also used to annotate nutrition information that was not related to nutrition (e.g., geography, season, etc.).
Secondly, the potential ontology-based inference was described. Inference on the basis of the taxonomy of terms can significantly improve the quality of data search and integration. Three terms used to annotate the manuscripts were selected for this case study [34]. By showing partial taxonomic hierarchies of the three terms, we explained how to infer unknown information from available information.
Thirdly, an assessment of reporting completeness was conducted using ONE, similar to the ontology-based meta-analyses by Kupershmidt et al. [35] and Ramaprasad and Syn [36]. A convenient sample of nine published manuscripts [37,38,39,40,41,42,43,44,45] was manually annotated using STROBE-nut terms of ONE for this purpose. By querying the electronic identifiers of STROBE-nut terms, the reporting frequencies of STROBE-nut terms were obtained. The hierarchies of STROBE-nut terms and one annotated manuscript were compared to illustrate where STROBE-nut terms were reported in the manuscript.
3. Results
3.1. Review and Summary of Existing Ontology Vocabulary for Use in Nutritional Epidemiology
In total, 1146 ontologies were retrieved, of which 237 were selected and classified according to their scope (Figure 1). As shown in Table A2 (Appendix A), 158 ontologies were selected to annotate data (33 ontologies for food/dietary agricultural products, four ontologies for nutrients/chemical compounds, 100 ontologies for disease and specific population (e.g., student health record ontology), and 21 ontologies for data management), and 35 were selected for metadata annotation (35 ontologies for research terminology and no ontology for metadata representation). There were also 44 ontologies to describe supplementary (meta) data (e.g., ethical issues, demographics, fundamental ontology knowledge frameworks, etc.). Among the ontologies found, no ontology was developed as a frame (e.g., guidance and guidelines) to present meta-data in nutritional epidemiologic information.
The quality assessment (Figure A1a) shows that 14% of the selected ontologies had less than 100 terms. Most of the selected ontologies (65%) had 101–10,000 terms, while 15% of the selected ontologies had more than 10,000 terms. The richness module (Figure A1b) shows that 15% of the selected ontologies had no properties, 23% of the selected ontologies had 1–10 properties, and 55% of the selected ontologies had more than 10 properties, including 14% of the selected ontologies with over 100 properties. Figure A1c,d indicate that 25% of the terms had no definitions, and 94% of the selected ontologies were not peer-reviewed. The lawfulness module (Figure A1e), authority module (Figure A1f), and history module (Figure A1g) represent the practicality of the selected ontologies. Only 2% of the selected ontologies were inaccessible due to error ontology files (Figure A1e). Only 8% of the selected ontologies were not mapped, while 20% of the selected ontologies were made of more than 300 mapped ontologies (Figure A1f). Less than half (47%) of the selected ontologies were visited less than 10 times per month (Figure A1g).
3.2. Development of ONE
The structure of ONE is shown in Figure 2, and a quality description is included in Table A3 (Appendix A). ONE consists of 339 classes. It reuses classes from 22 existing ontologies, where the main referred medical ontologies are NCIT (National Cancer Institute Thesaurus, 43 classes) and MeSH (Medical Subject Headings, 33 classes). ONE proposes 79 new classes to describe nutrition data and 24 new classes to describe the content of manuscript.
The electronic identifiers of terms are written after the corresponding terms. The electronic identifiers (e.g., NCIT:C94729) consist of two parts: (1) an ontology acronym (e.g., “NCIT” is the acronym of “ontology for National Cancer Institute Thesaurus”), and (2) a code of the term in the ontology (e.g., C94729 is code of “season” in NCIT ontology).
3.2.1. Existing Data Standards in Nutritional Epidemiology
The main taxonomies of the minimal data requirements and data quality descriptors are shown in Figure 3 and Figure 4, respectively. The collection of ontology terms is reported in Table A8 and Table A9 (Appendix A), respectively. Recommendations for generic terms that could not be found in existing ontologies of other subjects are indicated as footnotes of Table A8 and Table A9 (Appendix A).
3.2.2. STROBE-Nut Reporting Guidelines in Nutritional Epidemiology
For the collection of ontology terms for STROBE-nut reporting guidelines, the STROBE reporting items (e.g., title, abstract, etc.) were used as a taxonomic hierarchy of terms. The specific STROBE-nut recommendations were arranged under their corresponding STROBE reporting items (Figure 5).
3.2.3. Nutritional Epidemiologic Terms
Nutritional epidemiologic terms and their taxonomic hierarchy are shown in Table 2. All the terms were arranged according to the relevant descriptors listed in the minimal data requirements [23] and data quality descriptors [24]. The terms at the first hierarchy level are the descriptors (i.e., nutritional epidemiologic terms), while the terms at the second and third hierarchy levels are the options of descriptors (i.e., terms with more specific descriptions used for specific conditions). The taxonomic hierarchy also includes relevant terms of other ontologies. The present ontology has concepts related to dietary assessment tool, dietary assessment questionnaire, dietary data validation, dietary data processing, and dietary data quality descriptions.
3.3. Application of ONE
3.3.1. Case Study 1: Study Annotation and Term Query
The annotations for a manuscript [34] and its dataset collected in Cameroon [46] are presented in Table A4 and Table A5 (Appendix A), respectively. Using ONE terms (e.g., “study name”, “study objective”, “study population”, etc.) to link the manuscript/dataset to its meta-data, the manuscript/dataset is annotated according to the data standards and STROBE-nut reporting guidelines included in ONE. Applying ONE avoids confusion when annotating the manuscript and dataset since all term definitions become available. This facilitates the correct understanding by annotators and users of annotated manuscripts and datasets.
3.3.2. Case Study 2: Ontology-Based Inference
Using the annotation in case study 1, the potential for ontology-based inferencing is presented in Table A6 (Appendix A). Using “country”, “study”, and “method” as relationships between the manuscript and its meta-data, the manuscript is annotated as “a cross-sectional study collecting data in Cameroon by 24-h recall method”. The annotation is inferred to a more generic annotation through the taxonomies of terms in the United States National Library of Medicine Medical Subject Headings (MeSH) and ONE ontology. The upper level terms of “MeSH:D002163”, “MeSH:D03430”, and “one:ne00003” are “MeSH:D000350”, “MeSH:D016021”, and “one:ne00001” (second column), respectively. According to the labels of the three upper level terms, the inferred information (third column) is obtained: “this is an epidemiologic study collecting data in Central Africa by dietary assessment method”. The ontology inference now enables integration and a wider search of data. For example, when searching information annotated for “Central Africa”, the present data from “Cameroon” are identifiable.
3.3.3. Case Study 3: Estimation of Reporting Completeness in a Sample of Nine Manuscripts
The STROBE-nut annotation of nine manuscripts is added under ONE class “case studies: study description” [47]. Table A7a (Appendix A) counts the number of STROBE-nut items described in each manuscript, while Table A7b (Appendix A) reports the frequency of each STROBE-nut item reported in the nine manuscripts. Additional details on the hierarchy of annotation is available in Table A7c (Appendix A). For instance, the study by Mills, Brown, Wrieden, White, and Adams [37] indicates three STROBE-nut items (i.e., Nut-13, Nut-14, and Nut-16) that were reported in the “methods section”, instead of the “results section” of manuscripts as recommended by STROBE-nut.
4. Discussion
We reviewed existing ontologies to identify terms for annotating nutritional epidemiologic research output. Ontology terms were collected to describe the minimal information needed to annotate and link research outputs such as data, manuscript, and study protocols to facilitate study identification, retrieval, integration, and reuse.
To date, an ontology for study level description in nutrition epidemiology is missing. The present work adds value to the Cochrane PICO (i.e., patient, population, or problem; intervention, comparison, and outcome) ontology [5], which is being developed to formulate research questions, and search and characterize clinical studies, as well as meta-analyses. ONE complements the work of GODAN (Global Open Data for Agriculture and Nutrition) [48], LanguaL [16], and FoodEx2 [14] initiatives, which focused on food items and their properties. Moreover, ONE can be considered as an extension of the Epidemiology Ontology (EPO) that summarizes the features of generic epidemiologic studies [26,49].
To our knowledge, it is the first time that an ontology is developed based on manuscript reporting guidelines such as STROBE-nut [50]. Reporting guidelines are widely applied and endorsed by journals as tools to improve completeness of reporting in biomedical research, to enable easier searching, filtering, and navigation of research findings for further policy, practice, or research [51,52]. However, reporting guidelines remain a paper-based initiative. The conversion into a machine-readable representation could expand the use of reporting guidelines to searching and inferring of information. Converting other research reporting guidelines such as CONSORT (CONsolidated Standards of Reporting Trials) [53] or PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) [54] into ontologies would significantly improve the scope of their application. For instance, assessment of reporting completeness remains a manual and ad hoc exercise and was only attempted in a handful of cases [55,56,57]. The application of ontologies could potentially be used for automatic monitoring of reporting completeness of manuscripts. It would enable identification of frequently and rarely reported STROBE-nut items and where they are applied in the manuscripts and, as such, provide insights to update the standards [58]. Other potential applications of ontologies for research output include the monitoring of trends in research and identification of neglected areas, as shown in the use of the gene ontology for genetic research [59]. Similar applications are useful for recommendations o minimal data requirements and data quality descriptions.
To update ONE, automated processes will be required [13]. Ontology learning, a process where machines are taught by humans how to build ontologies from text, provides useful prospects in this regard [60]. Ontology learning from text was demonstrated earlier [61]. For instance, Arguello Casteleiro et al. [62] applied deep learning to extract a cardiovascular disease ontology from biomedical literature. However, considerable technical challenges remain, and sustained effort by nutritionists and machine learning expertise will be required.
Development of user-friendly applications of ontology-based annotation will be required to apply ONE and minimize the burden of ongoing work by researchers. To date, most researchers in nutritional epidemiology are unfamiliar with ontologies. Further ontology development in nutritional epidemiology will, therefore, require the contribution of researchers working in multiple research areas. Additional training and capacity-building efforts are needed to ensure uptake and ownership by the nutrition research community. Ad hoc training sessions were organized previously [63], but will require further development and integration in academic curricula.
The strength of the current work is the use of existing standards and recommendations that are developed for nutrition research [51,64]. Those standards are developed by and used in the nutrition research community and ensure validity of ONE in the wider research community. Existing ontologies were reviewed as a preparation to convert existing standards into an ontology. As such, the review is a useful resource for researchers and ontology developers in nutritional epidemiology. However, some of the reviewed ontologies did not contain terms that were essential for ONE and consequent ontology-based inferring.
The existing ontologies reviewed, including ONE, are not yet sufficient to annotate all aspects of nutritional epidemiology. For example, an ontology to connect dietary intake data to food nutrition composition data based on international/local food composition tables is still missing. Meanwhile, ontologies for other reporting guidelines such as CONSORT [53] and PRISMA [54] would facilitate the reporting of findings from other types of research. To enable ontology applications in nutritional epidemiology, additional contributions are required from researchers working on multiple research areas. In addition, four reviewed ontologies (Randomized Controlled Trials Ontology (RCTONT) [65], Non-Randomized Controlled Trials Ontology (NONRCTO) [66], Immune Disorder Ontology (IMMDIS) [67], and Neglected Tropical Disease Ontology (NTDO) [68]) contained errors in the formats and could not be assessed. Identifying these data gaps is hopefully an incentive to address the missing elements.
5. Conclusions
To conclude, this study introduced a comprehensive ontology for reporting nutritional epidemiologic studies and data. When applied at scale, application of ONE could enable monitoring of reporting completeness of nutritional epidemiology in the biomedical literature. Ultimately, the generated ontologies should be integrated with other linked data and applied in data collection tools, text editors, journal submission systems, or data repositories for convenient and scalable search, quality checking, etc.
Author Contributions
Conceptualization, B.D.B. and P.K.; investigation, C.Y. and H.A.; methodology, C.Y. and C.L.; software, C.Y., N.T., and F.P.; supervision, F.P. and C.L.; writing—original draft, C.Y. and C.L.; writing—review and editing, C.Y., H.A., B.D.B., P.K., N.T., D.H., J.B., A.B., F.P., and C.L.
Funding
The European Nutritional Phenotype Assessment and Data Sharing Initiative (ENPADASI) is part of the Joint Programming Initiative (JPI) “a healthy diet for a healthy life” and is funded by national funding agencies in nine European countries. The work in this manuscript is funded by the FWO Research Foundation Flanders, grant number G0D4815N. C.Y. is funded by a scholarship from the Chinese Scholarship Council. C.L. received funding from Bioversity Int for the work on standards for dietary assessment.
Acknowledgments
We would like to thank Giles Hanley-Cook for the language review.
Conflicts of Interest
The authors declare no conflicts of interest.
Appendix A
Figure A1.
Quality characteristics of selected ontologies for nutritional epidemiology.
Table A1.
Scope of controlled vocabulary in nutritional epidemiology to achieve the FAIR principle.
| FAIR Principle | Requires Controlled Vocabulary on | Applications | |
|---|---|---|---|
| Data Level | Metadata Level | ||
| Findable Reusable | Food, nutrients, disease and specific population, supplementary data, data management | Research terminology, metadata representation, supplementary metadata | Data search |
| Data integration | |||
Table A2.
Classification of selected ontologies according to the scope of ONE (complete list).
Table A3.
Metrics for quality assessment of ONE. n/a—not available.
| Metrics Suite | Attributes | Description | Assessment for ONE |
|---|---|---|---|
| Syntactic quality | Lawfulness | Correctness of syntax | No error detected |
| Richness | Breadth of syntax used | 1 defined property, but all ONE classes can be converted to properties | |
| Semantic quality | Interpretability | Meaningfulness of terms | Terms come from well-defined guidelines |
| Consistency | Consistency of meaning of terms | No term is used in more than 1 way in the ontology | |
| Clarity | Average number of word senses | Close to 1, because they are all academic terms | |
| Pragmatic quality | Comprehensiveness | Number of classes and properties | 339 classes and 1 property |
| Accuracy | Accuracy of information | Checked manually, no error detected | |
| Relevance | Relevance of information for a task | n/a, assess in the future | |
| Social quality | Authority | Extent to which other ontologies rely on it | n/a, assess in the future |
| History | Number of times ontology has been used | n/a, assess in the future |
Table A4.
Case study: dietary species richness as a measure of food biodiversity and nutritional quality of diet (Lachat et al. 2018), study description.
Table A4.
Case study: dietary species richness as a measure of food biodiversity and nutritional quality of diet (Lachat et al. 2018), study description.
| Preferred Name | Lachat C et al. 2018 PNAS |
|---|---|
| ID (Identifier) | http://one.ugent.be/standards#lachatc2018pnas |
| Study Name | Dietary species richness as a measure of food biodiversity and nutritional quality of diet |
| Study objective | To assess the intricate relationship between food biodiversity and diet quality |
| Study population | General population |
| Study terminated | 06/06/2017 |
| Study description | We applied biodiversity indicators to dietary intake data from and assessed associations with diet quality of women and young children. |
| age.max | 43 |
| age.min | 0.5 |
| Data analysis permission | accessible raw data |
| Data sharing policy | Publicly accessible |
| Metadata | Publicly accessible |
| Aggregate data sharing policy | Publicly accessible |
| Contact information | [email protected] |
| Contact person | Lachat C (orcid) |
| Country | Sri Lanka |
| Cameroon | |
| Congo | |
| Benin | |
| Vietnam | |
| Kenya | |
| Ecuador | |
| DOI (Digital Object Identifier) | http://doi.org/10.1073/pnas.1709194115 |
| Epidemiologic Studies | Cross-sectional studies |
| Funding Organization | http://www.fwo.be/en |
| label | Lachat C et al. 2018 PNAS |
| Population Characteristics | Women |
| Rural population | |
| Child | |
| prefixIRI | lachatc2018pnas |
| prefLabel | Lachat C et al. 2018 PNAS |
| Principal Investigator | Lachat C (orcid) |
| Publications | http://www.pnas.org/content/115/1/127 |
| Recruitment period | Benin:01/10/2013-31/12/2013,01/05/2014-31/07/2014; Cameroon:01/07/2013-31/08/2013; Congo:01/07/2009-30/09/2009; Ecuador:01/03/2011-31/03/2011; Kenya:01/09/2014-30/09/2014; 01/04/2015-30/04/2015; Sir Lanka: 01/07/2013-30/09/2013; Vietnam: 01/08/2014-31/12/2014 |
| Sampling method | Convenience sampling |
| strobe-nut | nut-22.1 |
| nut-8.1 | |
| nut-20 | |
| nut-8.3 | |
| nut-11 | |
| nut-22.2 | |
| nut-12.3 | |
| nut-8.5 | |
| nut-5 | |
| nut-1 | |
| nut-8.2 | |
| nut-7.1 | |
| nut-12.1 | |
| nut-19 | |
| Total number of females recruited | 2188 |
| Total number of participants recruited | 6226 |
| subClassOf | Case studies: study description |
Lachat, C.; Raneri, J.E.; Smith, K.W.; Kolsteren, P.; Van Damme, P.; Verzelen, K.; Penafiel, D.; Vanhove, W.; Kennedy, G.; Hunter, D.; et al. Dietary species richness as a measure of food biodiversity and nutritional quality of diets. Proc. Natl. Acad. Sci. USA 2018, 115, 127–132. doi:10.1073/pnas.1709194115.
Table A5.
Case study: dietary species richness as a measure of food biodiversity and nutritional quality of diet (Lachat et al. 2018), Cameroon dataset description.
Table A5.
Case study: dietary species richness as a measure of food biodiversity and nutritional quality of diet (Lachat et al. 2018), Cameroon dataset description.
| Preferred Name | Cameroon Dataset-Lachat C et al. 2018 PNAS |
|---|---|
| ID | http://one.ugent.be/standards#lachatc2018pnasCameroon |
| Country | Cameroon |
| Dietary assessment administration | Interview-administered |
| Dietary assessment method | 24-h recall |
| Dietary assessment questionnaire | Self-developed questionnaires |
| Dietary intake data | Unadjusted data |
| Food composition table | West Africa Food Composition Table (2012), FAO (Food and Agriculture Organization) |
| Food quantification method | Food quantification method not specifically tailored to the characteristics of the population |
| Health outcomes | 01/07/2013-31/08/2013 |
| label | Cameroon dataset; Lachat C et al. 2018 PNAS |
| Matched consumed food to referred food composition data | Exact matching |
| Matched to a different food | |
| Number of recall/measurement days per individual | 2 |
| Portion size of dietary intake data | Converted portion size |
| Directly expressed portion size | |
| prefixIRI | lachatc2018pnasCameroon |
| prefLabel | Cameroon dataset; Lachat C et al. 2018 PNAS |
| Quantification of portion sizes | Portion sizes are assessed digitally and verified by trained staff (or packaging) |
| Random selection | Convenience sampling |
| Sample representativeness | Non-representative sample |
| Sampling | 01/07/2013-31/08/2013 |
| Seasons | Rainy season |
| Selection of recall/measurement days | Non-consecutive, non-random days |
| The time of diet records | Not during eating occasions nor immediately after |
| subClassOf | Case studies: dataset description |
Lachat, C.; Raneri, J.E.; Smith, K.W.; Kolsteren, P.; Van Damme, P.; Verzelen, K.; Penafiel, D.; Vanhove, W.; Kennedy, G.; Hunter, D.; et al. Dietary species richness as a measure of food biodiversity and nutritional quality of diets. Proc. Natl. Acad. Sci. USA 2018, 115, 127–132. doi:10.1073/pnas.1709194115.
Table A6.
Case study: ontology-based inferences.
| Annotations of Carl et al. 2018 | Upper Level Terms According to Their Taxonomic Hierarchies | Inferred Information |
|---|---|---|
| Country: Cameroon (MeSH:D002163) | Africa, Central (MeSH:D000350) | The study was conducted in central Africa |
| Study: cross-sectional study (MeSH:D03430) | Epidemiologic studies (MeSH:D016021) | This study is an epidemiologic study |
| Method: 24-h recall (one:ne00003) | Dietary assessment method (one:ne00001) | The study used a dietary assessment method |
Table A7.
Case study: estimation of reporting completeness in a sample of nine manuscripts (reporting quality reference by using STROBE-nut terms).
(a) Mapped STROBE-nut terms per manuscript
| Publications | Number of STROBE-Nut Items (Mapped/Total) |
|---|---|
| Mills et al. 2017 | 21/24 |
| Abris et al. 2018 | 17/24 |
| Chatelan et al. 2017 | 18/24 |
| Lam et al. 2017 | 16/24 |
| Llanaj et al. 2018 | 15/24 |
| Arsenault et al. 2014 | 15/24 |
| De Cock et al. 2016 | 15/24 |
| Mills et al. 2018 | 14/24 |
| Workicho et al. 2016 | 9/24 |
(b) Mapping rate of each STROBE-nut term
| Mapping Rate (%) | Number of Items | STROBE-Nut Items |
|---|---|---|
| 100% mapping rate | 3 | 1; 8.1; 19 |
| high mapping rate (100%–75%) | 9 | 5; 6; 7.1; 7.2; 8.5; 11; 14; 20; 22.1 |
| medium mapping rate (75%–50%) | 5 | 8.2; 8.6; 12.1; 12.2; 13 |
| low mapping rate (50%–25%) | 3 | 8.3; 9; 22.2 |
| extreme low mapping rate (<25%) | 4 | 8.4; 12.3; 16; 17 |
(c) Hierarchy mapping
| STROBE-Nut Reporting Guideline | Mills et al. 2017 |
|---|---|
|
|
Table A8.
Ontology view of minimal data requirement of observational studies.
| Descriptors | Options | |
|---|---|---|
| b,c ISA (Investigation, Study and Assay) framework-Investigation (one:T00001) | ||
| 1 | Study name (NCIT_C686631) | Acronym (NCIT_C93495) |
| 2 | Country (ancestro_0003) | (ancestro ontology) |
| 3 | Study aim (NCIT_C94090) | |
| 4 | Principal Investigator (NCIT_C19924) | |
| 5 | Contact information (NCIT_C60776); contact person (NCIT_C25461) | |
| 6 | Funding Organization (VIVO_core#FundingOrganization) | |
| 7 | Upload (NCIT_C48914) URL (HL7_C1710546) | Study reference link page description (NCIT_C94131) b Study registration number (one:T00002) IRB-IEC Approval (CARELEX_ IRB-IEC_Approval) Informed consent (MeSH_D007258) Study protocol (NCIT_C70817) Questionnaires (NCIT_C17048) Standard Operating Procedures (SIO_000964) Publications (MeSH:D011642): Type (MeSH:D011642 subclasses), DOI (EDAM_data_1188), URL (HL7_C1710546) Other |
| 8 | Study terminated (NCIT_C70757) | DD/MM/YYYY (xsd:datetime) |
| 9 | b,d Data sharing policy (one:T00003) | b,d Publicly accessible (one:T00005) b,d Accessible upon request (one:T00006) b,d Not publicly accessible (one:T00007) |
| 10 | b,d Aggregate Data sharing policy (one:T00004) | |
| 11 | Metadata (MeSH: D000071253) | |
| 12 | b,d Data analysis permission (one:T00008) | b,d accessible raw data (one:T00009) b,d federated analysis (one:T00010) |
| b,c ISA framework-Study(one:T00011) | ||
| 1 | Epidemiologic Studies (MeSH_D016021) | Cohort (MeSH_D015331) Cross-sectional (MeSH_D003430) Case-control (MeSH_D016022) Seroepidemiologic study (MeSH_D016036) Other (subclasses of MeSH_D016021) |
| 2 | Study description (NCIT_C142704) | |
| 3 | Study population (NCIT_C70833) | General population (NCIT_C18241) |
| 4 | Population characteristics (MeSH_D011154) | MeSH_D011154 subclasses |
| 5 | b,e population representativeness (one:T00012) | b,e National level (one:T00013) b,e Subnational level (one:T00014) b,e Community level (one:T00015) |
| 6 | Type of sampling (NCIT_C71492) | Equal probability sampling method (NCIT_C71517) - b,g Simple Random Sampling (one:T00016), - b,g Stratified Random Sampling (one:T00017) - b,g Multi-Stage Sampling (one:T00018)Non-probability sampling (NCIT_C127781) - b,g Voluntary response sampling (one:T00019) - b,g Judgement sampling (one:T00020) - b,g Convenience sampling (one:T00021) |
| 7 | Control group (MeSH_D035061, NCIT_C28143) | |
| 8 | Type of controls (NCIT_C49647) | |
| 9 | Recruitment period (NCIT_C142664) | DD/MM/YYYY (xsd:datetime) |
| 10 | Follow-ups (NCIT_C16033) | time (xsd:datetime) actions (CTV3_X79tx) |
| 11 | Total number of participants recruited (MeSH_D011153) | b, f total number of males (one:T00022) b, f total number of females (one:T00023) |
| 12 | b Participants age range (one:T00024) | b, i age.min (one:T00025) b, i age.max (one:T00026) |
| b, c ISA framework-Assay (one:T00027) | ||
| 1 | a Dietary assessment method (one:ne00001) | a Dietary records (one:ne00002) - a Dietary records: PDA-technologies (one:ne00007) - a Dietary records: Mobile phone-based technologies (one:ne00008) - a Dietary records: Camera-recorder–based technologies (one:ne00009) - a Dietary records: Tape-recorder–based technologies (one:ne00010) a 24-Hour Recall (one:ne00003) - a 24-Hour Recall: Interactive computer-based technologies (one: 00011) - a 24-Hour Recall: Interactive web-based technologies (one: 00012) a Screener (one:ne00004) - a Screener: Interactive computer-based technologies (one:ne00013) - a Screener: Interactive web-based technologies (one:ne00014) - a Screener: qualitative (only frequency) (one:ne00015) - a Screener: semi-quantitative (one:ne00016) - a Screener: quantitative (one:ne00017) a Food Frequency Questionnaire (one:ne00005) - a FFQ: Interactive computer-based technologies (one:ne00018) - a FFQ: Interactive web-based technologies (one:ne00019) - a FFQ: qualitative (only frequency) (one:ne00020) - a FFQ: semi-quantitative (one:ne00021) - a FFQ: quantitative (one:ne00022) a Diet History (one:ne00006) a Other: please specify |
| 2 | b, j Food composition Table (one: T00027) | |
| 3 | Food product type (FoodOn_03400361) | Food, Drinks, Dietary supplements (classes of FoodOn) |
| 4 | a Dietary intake data (one:ne00023) | a Unadjusted data (preferred option) (one:ne00024) a Adjusted data for total energy intake using density method (one:ne00025) a Adjusted data for total energy intake using residual method (one:ne00026) a Estimates of usual intake from short-term measurements (one:ne00027) Other: describe |
| 5 | Physical activity measurement (NCIT_C120914) | b, h Objective measurement (one:T00028) b, h Subjective measurement (one:T00029) |
| 6 | Tobacco use (MeSH_D064424) | |
| 7 | Alcohol consumption (NCIT_C16273) | |
| 8 | Anthropometry (MeSH_D000886) | Weight (MeSH_DD001835) Height (MeSH_D001827) Waist circumference (MeSH_D055105) BMI status (MeSH_D015992) Body fat distribution (MeSH_D050218) |
| 9 | Socio-demographic factor (ONTOAD_AD000403) | |
| 10 | Health outcomes (HL7_C1550208) | xsd:datetime |
| 11-12 | Genitourinary samples (CTV_X7ADQ) | Blood sample (CTV3_X7ADI) Serum sample (CTV3_X7AE4) Plasma sample (CTV3_X7AEI) Urine sample (CTV3_X7ABI) Saliva sample (CTV3_4128) Faeces sample (CTV3_x7AAR) Other: please specify (subclasses of CTV3_X7ADQ) |
| 13 | Fasting (CTV3_X78 × 9) | |
| 14 | sampling (NCIT_C25662) | xsd:datetime |
| 15 | Omics (EDAM_topic3391) | Biomarkers (EDAM_topic3360) Metabolomics (EDAM_topic3172) Proteomics (EDAM_topic0121) Genomics (EDAM_topic0622) Transcriptomics (EDAM_topic3308) |
| 16 | Metabolite profiling (OBI_0000366) | |
| 17 | mass spectrometry (MeSH_D013058) chromatography (MeSH_D002845) | |
a undefined nutritional epidemiologic term; b other undefined terms; recommendation: put undeveloped term (s) in selected ontology: c: GODAN framework; NCIT: subclasses of body weight measurement (NCIT_C92648). ISA framework; d FAIR guiding principle, under “to be accessible” and “to be reusable”; e MeSH term, subclasses of “population characteristics MeSH_D011154”, f MeSH term, subclasses of MeSH_D011153; g NCIT: subclasses of NCIT_C71517/NCIT_C127781; h NCIT: subclasses of NCIT_120914; i XML schema (XSD); j GODAN project;.
Table A9.
Ontology view of data quality descriptors of observational studies.
| Descriptors | Options | |
|---|---|---|
| Study design (NCIT_C15320) Cohort (MeSH_D015331) Cross-sectional (MeSH_D003430) Case-control (MeSH_D016022) | ||
| 1 | Response rate (EO:0000139) | Response rate (EO:0000139) b Cooperation rate (one:T00101) |
| 2 | Covariates (NCIT_C142645) Cofounding factors (MESH/D015986) | |
| 3 | b Method for confirming diagnosis (one:T00102) | owl:class (i.e., method) b non-validated diagnosis (one:T00103) |
| 4 | missing data (NCIT_C142610) - b missing data-exposure (one:T00104) - b missing data-outcome (one:T00105) | xsd:decimal |
| 5 | missing data (NCIT_C142610) | b Missing (completely) at random (one:T00106) b Missing not at random (one:T00107) |
| 6 | Random selection (OBCS_0000063) | |
| 7 | ** sample representativeness (one:T00108) | b Representative sample (one:T00109) b Non-representative sample (one:T00110) |
| 8 | Incidence (NCIT_C61299) | b Incident cases (one:T00111) |
| 9 | Control groups (NCIT_C28143) | b Control group from same population as cases (one:T00112) b Controls group from similar population as cases (one:T00113) b Controls group from another population (one:T00114) |
| 10 | Lost to follow-up (MESH/D059012, (NCIT_C48227) | xsd:decimal |
| a Dietary assessment method (one:ne00001): a Dietary records (one:ne00002), a 24-Hour Recall (one:ne00003), a Screener (one:ne00004), a Food Frequency Questionnaire (one:ne00005), a Diet History (one:ne00006) | ||
| 1 | Administration (NCIT:C25409) - a Dietary assessment administration (one:ne00028) | a Dietary assessment administration (one:ne00028) - a Proxy-administered (one:ne00029) - a Self-administered not verified by interviewer (one:ne00030) - a Self-administered and checked by interviewer (one:ne00031) - a Interview-administered (one:ne00032) - a Interview-administered using AMPM (one:ne00033) |
| 2 | Questionnaire (NCIT_C64253) - a Dietary assessment questionnaire (one:ne00034) | a Dietary assessment questionnaire (one:ne00034) - a Self-developed questionnaires (one:ne00035) - a Use of standardized questionnaire (one:ne00036) - a Adopted other Questionnaires (one:ne00037) |
| 3 | Content validity (NCIT_C78690) - a Content validity of dietary assessment questionnaire (one:ne00038) | a Content validity of dietary assessment questionnaire (one:ne00038) - a verified content validity in another population (one:ne00039) - a verified content validity in a comparable population in terms of both age and dietary habits (one:ne00040) |
| 4 | a Reference of dietary assessment questionnaire validation (one:ne00041) | a Reference of the dietary assessment questionnaire validation (one:ne00041) - a dietary assessment methods (one:ne00001) - a Food Frequency Questionnaire (one:ne00005) - a 24-Hour Recall (one:ne00003) - a Dietary records (one:ne00002) - a short term dietary record (one:ne00042) - a long term weighted dietary record (>7 days) (one:ne00043) - a objective methods (one:ne00044) - a biomarker of dietary intake (one:ne00045) |
| 5 | Validated information (OBI_0302838) - a validated information of dietary assessment questionnaire (one:ne00046) | a Properties of dietary assessment questionnaire (one:ne00047) - a inter-rater reliability (NCIT_C78688) a Frequency options to identify between-person variations (one:ne00048) a Food items lead to underestimated target nutrients intake (one:ne00049) |
| 6 | a Validation type for dietary assessment questionnaire (one:ne00050) | Concurrent validity (OBCS_0000160) precision (NCIT_C48045) |
| 7 | Season (NCIT_C94729) | Season (NCIT_C94729) - b All seasons (one:T00115) - Summer (NCIT_C94732) - Winter (NCIT_C94730) - Spring (NCIT_C94731) - Autumn (NCIT_C94733) |
| 8 | a Quantification of portion sizes (one:ne00051) | a Quantification of portion sizes (one:ne00051) - a Not quantified (one:ne00052) - a Standard portion sizes without aids (one:ne00053) - a Standard portion sizes with aids (one:ne00054) skos:definition such as pictures, models, standard household measure, utensils, etc. - a Portion sizes are assessed digitally but not verified by trained staff (one:ne00055) - a Portion sizes are assessed digitally and verified by trained staff (or packaging) (one:ne00056) |
| 9 | a Portion size of dietary intake data (one:ne00057) | a Portion size of dietary intake data (one:ne00057) - a directly expressed portion size (one:ne00058) - a converted portion size (one:ne00059) - a unconverted portion size (one:ne00060) |
| 10 | b, c Food composition Table (one: T00027) - b Geographically-specific food composition data (one:T00116) | |
| 11 | a Matched consumed food to referred food composition data (one:ne00060) | a Matched consumed food to referred food composition data (one:ne00060) - a exact matching (one:ne00061) - a matched to means of min. 3 food items (one:ne00062) - a matched to same food items with similar moisture content (one:ne00063) - a matched to a different food (one:ne00064)Percentage in xsd:decimal |
| 12 | a Representativeness of the week/weekend days (one:ne00065) | Weekend (NCIT_C137684) Weekday (NCIT_C86936) |
| 13 | a Number of recall/measurement days per individual (one:ne00066) | xsd:integer |
| 14 | a Selection of recall/measurement days (one:ne00067) | a Selection of recall/measurement days (one:ne00067) - a Convenience selection (one:ne00068) - a Consecutive days (one:ne00069) - a Non-consecutive, non-random days (one:ne00070) - a Randomly over the week (one:ne00071) |
| 15 | a The time of diet records (one:ne00072) | a The time of diet records (one:ne00072) - a Not during eating occasions nor immediately after (one:ne00073) - a Immediately after eating occasion (one:ne00074) - a During eating occasion (one:ne00075) |
| 16 | a Food quantification method (one:ne00076) | a Food quantification method (one:ne00076) - a Food quantification method tailored to the characteristics of the population (one:ne00077) - a Food quantification method not specifically tailored to the characteristics of the population (one:ne00078) |
| Anthropometry (MeSH:D000886) | ||
| 1 | b Training of assessor (one:T00117) | b Training of assessors (one:T00117) - b without assessors (one:T00118) = Self-report (NCIT_C74528) - b trained assessors (one:T00119) - b trained assessors using Standard Operating Procedures (one:T00120) - b trained assessors not using Standard Operating Procedures (one:T00121) - b untrained assessors using Standard Operating Procedures (one:T00122) |
| 2 | Body Weight Measurement (NCIT_C92648) | Body Weight Measurement (NCIT_C92648) - Self-Report (NCIT_C74528) - Proxy Data Origin (NCIT_C142651) - b, d Measured with no clothing instructions by an assessor (one:T00123) - b, d Measured naked or with only light clothing by an assessor (one:T00124) |
| 3 | b Height measurement (one:T00125) | b Height measurement (one:T00125) - Self-Report (NCIT_C74528) - Proxy Data Origin (NCIT_C142651) - b Measured with shoes (one:T00126) - b Measured barefoot (one:T00127) |
| 4 | b Waist circumference measurement (one:T00128) | b Waist circumference measurement (one:T00128) - Self-Report (NCIT_C74528) - Proxy Data Origin (NCIT_C142651) - b Measured with no clothing instructions (one:T00129) - b Measured naked or with only light clothing (one:T00130) |
| 5 | Measurement of body mass index (SNOMEDCT_698094009) | Measurement of body mass index (SNOMEDCT_698094009) - Self-Report (NCIT_C74528) - b Assessed using pictograms or silhouettes (one:T00131) - Objective Measurement (NCIT_C142618): xsd:definition weight & height, body scanner, etc. |
| 6 | b Adiposity measurement (one:T00132) | bioelectrical impedance analysis (NCIT_C43545) Dual X-ray Absorptiometry (NCIT_C48789) Waist-to-hip ratio (NCIT_C17651) Skin fold (CMO_0000246) |
a undefined nutritional epidemiologic term; b other undefined terms; recommendation: put undeveloped term (s) in selected ontology: c GODAN framework; NCIT: subclasses of body weight measurement (NCIT_C92648).
References
- Willett, W. Nutritional Epidemiology, 2nd ed.; Oxford University Press: New York, NY, USA, 1998. [Google Scholar]
- Concato, J.; Shah, N.; Horwitz, R.I. Randomized, controlled trials, observational studies, and the hierarchy of research designs. N. Engl. J. Med. 2000, 342, 1887–1892. [Google Scholar] [CrossRef] [PubMed]
- Chan, A.W.; Song, F.; Vickers, A.; Jefferson, T.; Dickersin, K.; Gotzsche, P.C.; Krumholz, H.M.; Ghersi, D.; van der Worp, H.B. Increasing value and reducing waste: Addressing inaccessible research. Lancet 2014, 383, 257–266. [Google Scholar] [CrossRef]
- Lachat, C.; Hawwash, D.; Ocké, M.C.; Berg, C.; Forsum, E.; Hörnell, A.; Larsson, C.; Sonestedt, E.; Wirfält, E.; Åkesson, A.; et al. Strengthening the Reporting of OBservational studies in Epidemiology–Nutritional Epidemiology (STROBE-nut): An extension of the STROBE statement. PLoS Med. 2016, 13, e10002036. [Google Scholar] [CrossRef] [PubMed]
- Cochrance Linked Data. Cochrane PICO Ontology. Available online: https://linkeddata.cochrane.org/pico-ontology (accessed on 20 July 2018).
- Institute for Health Metrics and Evaluation; Global Burden of Disease Study 2015 (GBD 2015) Data Input Sources Tool. Global Burden of Disease Study 2015 (GBD 2015) Data Input Sources Tool. Available online: http://ghdx.healthdata.org/gbd-2015/data-input-sources (accessed on 7 December 2018).
- Noy, N.F.; McGuinness, D.L. Ontology Development 101: A Guide to Creating Your First Ontology; Knowledge Systems Laboratory Stanford University: Stanford, CA, USA, 2001. [Google Scholar]
- Rhee, S.Y.; Wood, V.; Dolinski, K.; Draghici, S. Use and misuse of the gene ontology annotations. Nat. Rev. Genet. 2008, 9, 509–515. [Google Scholar] [CrossRef] [PubMed]
- Fang, W.D.; Zhang, L.; Wang, Y.X.; Dong, S.B. Toward a semantic search engine based on ontologies. In Proceedings of the 2005 International Conference on Machine Learning and Cybernetics, Guangzhou, China, 8–21 August 2005; Volume 1–9, pp. 1913–1918. [Google Scholar]
- Wilkinson, M.D.; Dumontier, M.; Aalbersberg, I.J.; Appleton, G.; Axton, M.; Baak, A.; Blomberg, N.; Boiten, J.W.; da Silva Santos, L.B.; Bourne, P.E.; et al. The FAIR Guiding Principles for scientific data management and stewardship. Sci. Data 2016, 3, 160018. [Google Scholar] [CrossRef] [Green Version]
- Boulos, M.; Yassine, A.; Shirmohammadi, S.; Namahoot, C.; Brückner, M. Towards an “Internet of Food”: Food Ontologies for the Internet of Things. Future Internet 2015, 7, 372–392. [Google Scholar] [CrossRef]
- Snoek, H.M.; Eijssen, L.M.T.; Geurts, M.; Vors, C.; Brown, K.A.; Bogaardt, M.-J.; Dhonukshe-Rutten, R.A.M.; Evelo, C.T.; Fezeu, L.K.; Finglas, P.M.; et al. Advancing food, nutrition, and health research in Europe by connecting and building research infrastructures in a DISH-RI: Results of the EuroDISH project. Trends Food Sci. Technol. 2018, 73, 58–66. [Google Scholar] [CrossRef]
- Lemay, D.G.; Zivkovic, A.M.; German, J.B. Building the bridges to bioinformatics in nutrition research. Am. J. Clin. Nutr. 2007, 86, 1261–1269. [Google Scholar] [CrossRef] [Green Version]
- European Food Safety Authority. The Food Classification and Description System FoodEx2; European Food Safety Authority: Parma, Italy, 2015. [Google Scholar]
- Dooley, M.D.; Griffiths, J.E.; Gosal, S.G.; Buttigieg, L.P.; Hoehndorf, R.; Lange, C.M.; Schriml, M.L.; Brinkman, F.S.L.; Hsiao, W.L.W. FoodOn: A harmonized food ontology to increase global food traceability, quality control and data integration. npj Sci. Food 2018, 2, 23. [Google Scholar] [CrossRef]
- Danish Food Informatics. LanguaL—The International Framework for Food Description. Available online: http://www.langual.org/ (accessed on 20 July 2018).
- Vitali, F.; Lombardo, R.; Rivero, D.; Mattivi, F.; Franceschi, P.; Bordoni, A.; Trimigno, A.; Capozzi, F.; Felici, G.; Taglino, F.; et al. ONS: An ontology for a standardized description of interventions and observational studies in nutrition. Genes Nutr. 2018, 13, 12. [Google Scholar] [CrossRef]
- Coffran, C.; Meehan, D.; Ronning, A. Bionutrition Ontology. Available online: http://purl.bioontology.org/ontology/BNO (accessed on 13 August 2018).
- Eftimov, T.; Korosec, P.; Korousic Seljak, B. StandFood: Standardization of Foods Using a Semi-Automatic System for Classifying and Describing Foods According to FoodEx2. Nutrients 2017, 9, 542. [Google Scholar] [CrossRef] [PubMed]
- National Library of Medicine. Medical Subject Headings 2017. Available online: https://www.nlm.nih.gov/mesh/meshhome.html (accessed on 25 November 2018).
- Golbeck, J.; Fragoso, G.; Hartel, F.; Hendler, J.; Oberthaler, J.; Parsia, B. The National Cancer Institute’s Thesaurus and Ontology. SSRN Electron. J. 2003, 1. [Google Scholar] [CrossRef]
- Brickley, D.; Guha, R.V. RDF Schema 1.1. Available online: https://www.w3.org/TR/rdf-schema/ (accessed on 26 May 2019).
- Pinart, M.; Nimptsch, K.; Bouwman, J.; Dragsted, L.O.; Yang, C.; De Cock, N.; Lachat, C.; Perozzi, G.; Canali, R.; Lombardo, R.; et al. Joint Data Analysis in Nutritional Epidemiology: Identification of Observational Studies and Minimal Requirements. J. Nutr. 2018, 148, 285–297. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Yang, C.; Pinart, M.; Kolsteren, P.; Van Camp, J.; De Cock, N.; Nimptsch, K.; Pischon, T.; Laird, E.; Perozzi, G.; Canali, R.; et al. Perspective: Essential Study Quality Descriptors for Data from Nutritional Epidemiologic Research. Adv. Nutr. 2017, 8, 639–651. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Boeing, H. Nutritional epidemiology: New perspectives for understanding the diet-disease relationship? Eur. J. Clin. Nutr. 2013, 67, 424–429. [Google Scholar] [CrossRef] [Green Version]
- Pesquita, C.; Ferreira, J.D.; Couto, F.M.; Silva, M.J. The epidemiology ontology: An ontology for the semantic annotation of epidemiological resources. J. Biomed. Semant. 2014, 5, 4. [Google Scholar] [CrossRef] [PubMed]
- D’Aquin, M.; Noy, N.F. Where to Publish and Find Ontologies? A Survey of Ontology Libraries. J. Web Semant. 2012, 11, 96–111. [Google Scholar] [CrossRef]
- World Wide Web Consortium. Ontology Repositories. Available online: https://www.w3.org/wiki/Ontology_repositories (accessed on 13 April 2018).
- Smith, B.; Ashburner, M.; Rosse, C.; Bard, J.; Bug, W.; Ceusters, W.; Goldberg, L.J.; Eilbeck, K.; Ireland, A.; Mungall, C.J.; et al. The OBO Foundry: Coordinated evolution of ontologies to support biomedical data integration. Nat. Biotechnol. 2007, 25, 1251–1255. [Google Scholar] [CrossRef]
- Noy, N.F.; Shah, N.H.; Whetzel, P.L.; Dai, B.; Dorf, M.; Griffith, N.; Jonquet, C.; Rubin, D.L.; Storey, M.A.; Chute, C.G.; et al. BioPortal: Ontologies and integrated data resources at the click of a mouse. Nucleic Acids Res. 2009, 37, W170–W173. [Google Scholar] [CrossRef]
- Cote, R.G.; Jones, P.; Apweiler, R.; Hermjakob, H. The Ontology Lookup Service, a lightweight cross-platform tool for controlled vocabulary queries. BMC Bioinform. 2006, 7, 97. [Google Scholar] [CrossRef]
- Burton-Jones, A.; Storey, V.C.; Sugumaran, V.; Ahluwalia, P. A semiotic metrics suite for assessing the quality of ontologies. Data Knowl. Eng. 2005, 55, 84–102. [Google Scholar] [CrossRef]
- RDF Working Group. Resource Description Framework (RDF). Available online: https://www.w3.org/RDF/ (accessed on 16 September 2018).
- Lachat, C.; Raneri, J.E.; Smith, K.W.; Kolsteren, P.; Van Damme, P.; Verzelen, K.; Penafiel, D.; Vanhove, W.; Kennedy, G.; Hunter, D.; et al. Dietary species richness as a measure of food biodiversity and nutritional quality of diets. Proc. Natl. Acad. Sci. USA 2018, 115, 127–132. [Google Scholar] [CrossRef] [PubMed]
- Kupershmidt, I.; Su, Q.J.; Grewal, A.; Sundaresh, S.; Halperin, I.; Flynn, J.; Shekar, M.; Wang, H.; Park, J.; Cui, W.; et al. Ontology-based meta-analysis of global collections of high-throughput public data. PLoS ONE 2010, 5. [Google Scholar] [CrossRef] [PubMed]
- Ramaprasad, A.; Syn, T. Ontological Meta-Analysis and Synthesis. Commun. Assoc. Inf. Syst. 2015, 37. [Google Scholar] [CrossRef]
- Mills, S.; Brown, H.; Wrieden, W.; White, M.; Adams, J. Frequency of eating home cooked meals and potential benefits for diet and health: Cross-sectional analysis of a population-based cohort study. Int. J. Behav. Nutr. Phys. Act. 2017, 14, 109. [Google Scholar] [CrossRef] [PubMed]
- Mills, S.; Adams, J.; Wrieden, W.; White, M.; Brown, H. Sociodemographic characteristics and frequency of consuming home-cooked meals and meals from out-of-home sources: Cross-sectional analysis of a population-based cohort study. Public Health Nutr. 2018, 21, 2255–2266. [Google Scholar] [CrossRef] [PubMed]
- Abris, G.P.; Kim, N.H.; Provido, S.M.P.; Hong, S.; Yu, S.H.; Lee, C.B.; Lee, J.E. Dietary diversity and nutritional adequacy among married Filipino immigrant women: The Filipino Women’s Diet and Health Study (FiLWHEL). BMC Public Health 2018, 18, 359. [Google Scholar] [CrossRef]
- Chatelan, A.; Beer-Borst, S.; Randriamiharisoa, A.; Pasquier, J.; Blanco, J.M.; Siegenthaler, S.; Paccaud, F.; Slimani, N.; Nicolas, G.; Camenzind-Frey, E.; et al. Major Differences in Diet across Three Linguistic Regions of Switzerland: Results from the First National Nutrition Survey menuCH. Nutrients 2017, 9, 1163. [Google Scholar] [CrossRef]
- Lam, M.C.L.; Adams, J. Association between home food preparation skills and behaviour, and consumption of ultra-processed foods: Cross-sectional analysis of the UK National Diet and nutrition survey (2008–2009). Int. J. Behav. Nutr. Phys. Act. 2017, 14, 68. [Google Scholar] [CrossRef]
- Llanaj, E.; Ádány, R.; Lachat, C.; D’Haese, M. Examining food intake and eating out of home patterns among university students. PLoS ONE 2018. [Google Scholar] [CrossRef]
- Arsenault, J.E.; Nikiema, L.; Allemand, P.; Ayassou, K.A.; Lanou, H.; Moursi, M.; De Moura, F.F.; Martin-Prevel, Y. Seasonal differences in food and nutrient intakes among young children and their mothers in rural Burkina Faso. J. Nutr. Sci. 2014, 3, e55. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- De Cock, N.; Van Lippevelde, W.; Vervoort, L.; Vangeel, J.; Maes, L.; Eggermont, S.; Braet, C.; Lachat, C.; Huybregts, L.; Goossens, L.; et al. Sensitivity to reward is associated with snack and sugar-sweetened beverage consumption in adolescents. Eur. J. Nutr. 2016, 55, 1623–1632. [Google Scholar] [CrossRef] [PubMed]
- Workicho, A.; Belachew, T.; Feyissa, G.T.; Wondafrash, B.; Lachat, C.; Verstraeten, R.; Kolsteren, P. Household dietary diversity and Animal Source Food consumption in Ethiopia: Evidence from the 2011 Welfare Monitoring Survey. BMC Public Health 2016, 16, 1192. [Google Scholar] [CrossRef] [PubMed]
- Bechem, M.; Huybregts, L.; van Damme, P. Biodiversity and Complementary Feeding Practices of Children in the North West Region of Cameroon; Harvard Dataverse: Cambridge, MA, USA, 2014. [Google Scholar]
- Yang, C. Case Studies: Study Description Ontology for Nutritional Epidemiology. Available online: http://purl.bioontology.org/ontology/ONE?conceptid=http%3A%2F%2Fpurl.bioontology.org%2Fontology%2FONE%2Fstandards%23caseStudies_study (accessed on 5 October 2018).
- GODAN. Global Open Data for Agriculture and Nutrition. Available online: https://www.godan.info/ (accessed on 20 July 2018).
- Ferreira, J.D.; Paolotti, D.; Couto, F.M.; Silva, M.J. On the usefulness of ontologies in epidemiology research and practice. J. Epidemiol. Community Health 2013, 67, 385–388. [Google Scholar] [CrossRef] [PubMed]
- Glasziou, P.; Altman, D.G.; Bossuyt, P.; Boutron, I.; Clarke, M.; Julious, S.; Michie, S.; Moher, D.; Wager, E. Reducing waste from incomplete or unusable reports of biomedical research. Lancet 2014, 383, 267–276. [Google Scholar] [CrossRef]
- von Elm, E.; Altman, D.G.; Egger, M.; Pocock, S.J.; Gøtzsche, P.C.; Vandenbroucke, J.P.; STROBE-Initiative. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE)statement: Guidelines for reporting observational studies. PLoS Med. 2007, 4, e296. [Google Scholar] [CrossRef]
- the Centre for Statistics in Medicine (CSM). Equator: Enhancing the QUAlity and Transparency of Health Research. Available online: http://www.equator-network.org/library/translations-of-reporting-guidelines/ (accessed on 17 September 2018).
- Moher, D.; Hopewell, S.; Schulz, K.F.; Montori, V.; Gotzsche, P.C.; Devereaux, P.J.; Elbourne, D.; Egger, M.; Altman, D.G. CONSORT 2010 explanation and elaboration: Updated guidelines for reporting parallel group randomised trials. BMJ 2010, 340, c869. [Google Scholar] [CrossRef]
- Moher, D.; Liberati, A.; Tetzlaff, J.; Altman, D.G.; Group, P. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Med. 2009, 6, e1000097. [Google Scholar] [CrossRef]
- Moher, D.; Jones, A.; Lepage, L.; CONSORT Group (Consolidated Standards for Reporting of Trials). Use of the CONSORT Statement and Quality of Reports of Randomized Trials. JAMA 2001, 285, 1992. [Google Scholar] [CrossRef]
- Panic, N.; Leoncini, E.; de Belvis, G.; Ricciardi, W.; Boccia, S. Evaluation of the endorsement of the preferred reporting items for systematic reviews and meta-analysis (PRISMA) statement on the quality of published systematic review and meta-analyses. PLoS ONE 2013, 8, e83138. [Google Scholar] [CrossRef]
- Sorensen, A.A.; Wojahn, R.D.; Manske, M.C.; Calfee, R.P. Using the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement to assess reporting of observational trials in hand surgery. J. Hand Surg. Am. 2013, 38, 1584.e2–1589.e2. [Google Scholar] [CrossRef] [PubMed]
- Wilkinson, M.D.; Verborgh, R.; Bonino da Silva Santos, L.O.; Clark, T.; Swertz, M.A.; Kelpin, F.D.L.; Gray, A.J.G.; Schultes, E.A.; van Mulligen, E.M.; Ciccarese, P.; et al. Interoperability and FAIRness through a novel combination of Web technologies. PeerJ Comput. Sci. 2017, 3, e110. [Google Scholar] [CrossRef] [Green Version]
- Stoeger, T.; Gerlach, M.; Morimoto, R.I.; Nunes Amaral, L.A. Large-scale investigation of the reasons why potentially important genes are ignored. PLoS Biol. 2018, 16, e2006643. [Google Scholar] [CrossRef] [PubMed]
- Yang, H.; Callan, J. Human-Guided Ontology Learning. Available online: https://www.cs.cmu.edu/~callan/Papers/hcir08-yang.pdf (accessed on 28 October 2018).
- Gomez-Perez, A.; Manzano-Macho, D. An overview of methods and tools for ontology learning from texts. Knowl. Eng. Rev. 2004, 19, 187–212. [Google Scholar] [CrossRef]
- Arguello Casteleiro, M.; Demetriou, G.; Read, W.; Fernandez Prieto, M.J.; Maroto, N.; Maseda Fernandez, D.; Nenadic, G.; Klein, J.; Keane, J.; Stevens, R. Deep learning meets ontologies: Experiments to anchor the cardiovascular disease ontology in the biomedical literature. J. Biomed. Semant. 2018, 9, 13. [Google Scholar] [CrossRef] [PubMed]
- ENPADASI Consortium. Project Deliverable Report (D6.3, D6.5 Workshops). Available online: http://www.enpadasi.eu/deliverables_final_pdf/D6.3_D6.5.pdf (accessed on 28 October 2018).
- ENPADASI Consortium. European Nutritional Phenotype Assessment and Data Sharing Initiative (ENPADASI). Available online: http://www.enpadasi.eu/ (accessed on 17 September 2018).
- Zaveri, A. Randomized Controlled Trials Ontology. Available online: https://bioportal.bioontology.org/ontologies/RCTONT (accessed on 26 May 2019).
- Zaveri, A. Non-Randomized Controlled Trials Ontology. Available online: https://bioportal.bioontology.org/ontologies/NONRCTO (accessed on 26 May 2019).
- Scheuermann, R. Immune Disorder Ontology. Available online: https://bioportal.bioontology.org/ontologies/IMMDIS (accessed on 26 May 2019).
- Santana, F. Neglected Tropical Disease Ontology. Available online: https://bioportal.bioontology.org/ontologies/NTDO (accessed on 26 May 2019).
Figure 1.
Review and selection process of ontologies for nutritional epidemiology.
Figure 2.
The overall structure of the ontology for nutritional epidemiology (ONE).
Figure 3.
The ontology taxonomy of minimal data requirements.
Figure 4.
The ontology taxonomy of data quality descriptors of observational studies in nutritional epidemiology.
Figure 4.
The ontology taxonomy of data quality descriptors of observational studies in nutritional epidemiology.
Figure 5.
The ontology taxonomy of strengthening the reporting of observational studies in epidemiology (STROBE)-nut (nutritional epidemiology) items.
Figure 5.
The ontology taxonomy of strengthening the reporting of observational studies in epidemiology (STROBE)-nut (nutritional epidemiology) items.
Table 1.
Key concepts used in the manuscript.
| Concepts | Descriptions |
|---|---|
| FAIR [10] | The “findable, accessible, interoperable, and reusable” or FAIR data principles were launched in 2016 to guide data sharing. The FAIR principles are considered key to enhance and enable use of research data. |
| FoodOn [15] | FoodOn is an ontology to represent knowledge of food in different domains, such as agriculture, medicine, food safety inspection, shopping patterns, sustainable development, etc. |
| LanguaL and FoodEx2 [16,19] | LanguaL and FoodEx2 are systems for food classification and enable describing, searching, and retrieving data related to food. |
| MeSH [20] | MeSH stands for “Medical Subject Headings”. It involves hierarchically organized terminology of biomedical information. MeSH is widely applied in National Library of Medicine (NLM) databases for information querying. |
| NCIT [21] | NCIT stands for the “National Cancer Institute’s Thesaurus”. It involves hierarchically organized terminology/ontology in the cancer domain. |
| STROBE-nut [4] | As an extension of the STROBE (strengthening the reporting of observational studies in epidemiology) reporting guideline, STROBE-nut (“nut” represents “nutritional epidemiology”) helps researchers to report nutritional epidemiologic research. |
| RDF [22] | RDF stands for “resource description framework”, and is a standard to describe web resources. |
Table 2.
Hierarchical structure of nutritional epidemiologic terms.
| 1st Hierarchy Level | 2nd Hierarchy Level | 3rd Hierarchy Level |
|---|---|---|
| Dietary assessment tool (one:ne00001) | Dietary records (one:ne00002) | Dietary record: short term (one:00042) Dietary record: long term weighted (>7 days) (one:ne00043) Dietary records: PDA (Personal Digital Assistant) technologies (one:ne00007) Dietary records: mobile phone-based technologies (one:ne00008) Dietary records: camera recorder-based technologies (one:ne00009) Dietary records: tape recorder-based technologies (one:ne00010) |
| 24-h recall (one:ne00003) | 24-h recall: interactive computer-based technologies (one: 00011) 24-h recall: interactive web-based technologies (one: 00012) | |
| Screener (one:ne00004) | Screener: Interactive computer-based technologies (one:ne00013) Screener: Interactive web-based technologies (one:ne00014) Screener: qualitative (only frequency) (one:ne00015) Screener: semi-quantitative (one:ne00016) Screener: quantitative (one:ne00017) | |
| Food Frequency Questionnaire (FFQ) (one:ne00005) | FFQ: interactive computer-based technologies (one:ne00018) FFQ: interactive web-based technologies (one:ne00019) FFQ: qualitative (only frequency) (one:ne00020) FFQ: semi-quantitative (one:ne00021) FFQ: quantitative (one:ne00022) | |
| Diet history (one:ne00006) | ||
| Dietary intake data (one:ne00023) | Unadjusted data (preferred option) (one:ne00024) Adjusted data for total energy intake using density method (one:ne00025) Adjusted data for total energy intake using residual method (one:ne00026) Estimates of usual intake from short-term measurements (one:ne00027) | |
| (External upper level: administration (NCIT:C25409)) Dietary assessment administration (one:ne00028) | Proxy-administered (one:ne00029) Self-administered not verified by interviewer (one:ne00030) Self-administered and checked by interviewer (one:ne00031) Interview-administered (one:ne00032) Interview-administered using AMPM (Automated Multiple Pass Method) (one:ne00033) | |
| (External upper level: questionnaire (NCIT_C17048)) Dietary assessment questionnaire (one:ne00034) | Self-developed questionnaires (one:ne00035) Use of standardized questionnaire (one:ne00036) Adopted other questionnaires (one:ne00037) | |
| (External upper level: content validity (NCIT_C78690)) Content validity of dietary assessment questionnaire (one:ne00038) | Verified content validity in another population (one:ne00039) Verified content validity in a comparable population in terms of both age and dietary habits (one:ne00040) | |
| Reference of dietary assessment questionnaire validation (one:ne00041) | Dietary assessment methods (one:ne00001) | |
| Objective methods (one:ne00044) | Biomarker of dietary intake (one:ne00045) | |
| Validated information (OBI_0302838) Validated information of dietary assessment questionnaire (one:ne00046) | Properties of dietary assessment questionnaire (one:ne00047) | Inter-rater reliability (NCIT_C78688) |
| Frequency options to identify between-person variations (one:ne00048) | ||
| Food items lead to underestimated target nutrients intake (one:ne00049) | ||
| Validation type for dietary assessment questionnaire (one:ne00050) | Concurrent validity (OBCS_0000160) precision (NCIT_C48045) | |
| Quantification of portion sizes (one:ne00051) | Not quantified (one:ne00052) Standard portion sizes without aids (one:ne00053) Standard portion sizes with aids (one:ne00054) Portion sizes are assessed digitally but not verified by trained staff (one:ne00055) Portion sizes are assessed digitally and verified by trained staff (or packaging) (one:ne00056) | |
| Portion size of dietary intake data (one:ne00057) | Directly expressed portion size (one:ne00058) Converted portion size (one:ne00059) Unconverted portion size (one:ne00060) | |
| Matched consumed food to referred food composition data (one:ne00060) | Exact matching (one:ne00061) Matched to means of min. 3 food items (one:ne00062) Matched to same food items with similar moisture content (one:ne00063) Matched to a different food (one:ne00064) Percentage in xsd:decimal | |
| Representativeness of the week/weekend days (one:ne00065) | Weekend (NCIT_C137684) Weekday (NCIT_C86936) | |
| Number of recall/measurement days per individual (one:ne00066) | xsd:integer | |
| Selection of recall/measurement days (one:ne00067) | Convenience selection (one:ne00068) Consecutive days (one:ne00069) Non-consecutive, non-random days (one:ne00070) Randomly over the week (one:ne00071) | |
| The time of diet records (one:ne00072) | Not during eating occasions nor immediately after (one:ne00073) Immediately after eating occasion (one:ne00074) During eating occasion (one:ne00075) | |
| Food quantification method (one:ne00076) | Food quantification method tailored to the characteristics of the population (one:ne00077) Food quantification method not specifically tailored to the characteristics of the population (one:ne00078) |
© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Share and Cite
MDPI and ACS Style
Yang, C.; Ambayo, H.; De Baets, B.; Kolsteren, P.; Thanintorn, N.; Hawwash, D.; Bouwman, J.; Bronselaer, A.; Pattyn, F.; Lachat, C. An Ontology to Standardize Research Output of Nutritional Epidemiology: From Paper-Based Standards to Linked Content. Nutrients 2019, 11, 1300. https://doi.org/10.3390/nu11061300
AMA Style
Yang C, Ambayo H, De Baets B, Kolsteren P, Thanintorn N, Hawwash D, Bouwman J, Bronselaer A, Pattyn F, Lachat C. An Ontology to Standardize Research Output of Nutritional Epidemiology: From Paper-Based Standards to Linked Content. Nutrients. 2019; 11(6):1300. https://doi.org/10.3390/nu11061300
Chicago/Turabian StyleYang, Chen, Henry Ambayo, Bernard De Baets, Patrick Kolsteren, Nattapon Thanintorn, Dana Hawwash, Jildau Bouwman, Antoon Bronselaer, Filip Pattyn, and Carl Lachat. 2019. "An Ontology to Standardize Research Output of Nutritional Epidemiology: From Paper-Based Standards to Linked Content" Nutrients 11, no. 6: 1300. https://doi.org/10.3390/nu11061300
APA StyleYang, C., Ambayo, H., De Baets, B., Kolsteren, P., Thanintorn, N., Hawwash, D., Bouwman, J., Bronselaer, A., Pattyn, F., & Lachat, C. (2019). An Ontology to Standardize Research Output of Nutritional Epidemiology: From Paper-Based Standards to Linked Content. Nutrients, 11(6), 1300. https://doi.org/10.3390/nu11061300
Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.
