Next Article in Journal
The Impact of COVID-19 Lockdown Measures and COVID-19 Infection on Cognitive Functions: A Review in Healthy and Neurological Populations
Previous Article in Journal
Self-Compassion and Well-Being during the COVID-19 Pandemic: A Study of Greek College Students
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Development and Validation of Nutrition and Food Safety Educational Material for Fish Processors in Nigeria

by
Grace Adeola Adegoye
1,2,
Terezie Tolar-Peterson
2,3,*,
Henrietta Nkechi Ene-Obong
4,
Joseph Nkem Nuntah
5,
Monica M. Pasqualino
6,7,
Rahel Mathews
2,
Juan L. Silva
2,
Wen-Hsing Cheng
2,
Marion Willard Evans, Jr.
8 and
Lauren Pincus
6
1
Department of Nutrition and Health Science, Ball State University, Muncie, IN 47306, USA
2
Department of Food Science, Nutrition and Health Promotion, Mississippi State University, Starkville, MS 39762, USA
3
Department of Health Science and Human Ecology, California State University San Bernardino, San Bernardino, CA 92407, USA
4
Department of Human Nutrition and Dietetics, University of Calabar, Calabar 540271, Nigeria
5
Department of Aquaculture and Fisheries Management, University of Benin, Benin 300213, Nigeria
6
WorldFish One CGIAR, Jalan Batu Maung, Bayan Lepas 11960, Malaysia
7
Center for Human Nutrition, Department of International Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD 21205, USA
8
College of Nursing and Health Professions, The University of Southern Mississippi, Hattiesburg, MS 39406, USA
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2023, 20(6), 4891; https://doi.org/10.3390/ijerph20064891
Submission received: 6 December 2022 / Revised: 27 February 2023 / Accepted: 6 March 2023 / Published: 10 March 2023

Abstract

:
Introduction: fish can be an affordable and accessible animal-source food in many Low- and Middle-Income Countries (LMIC). Background: Traditional fish processing methods pose a risk of exposing fish to various contaminants that may reduce their nutritional benefit. In addition, a lack of literacy may increase women fish processors’ vulnerability to malnutrition and foodborne diseases. Objective: The overall aim of the project was to educate women and youth fish processors in Delta State, Nigeria about the benefit of fish in the human diet and to develop low literacy tools to help them better market their products. The objective of this study was to describe the development and validation of a low-literacy flipbook designed to teach women fish processors about nutrition and food safety. Method: developing and validating instructional material requires understanding the population, high-quality and relevant graphics, and the involvement of relevant experts to conduct the content validation using the Content Validity Index (CVI) and the index value translated with the Modified Kappa Index (k). Result: The Item-level Content Validity Index (I-CVI) value of all domains evaluated at the initial stage was 0.83 and the Scale-level Content Validity Index (S-CVI) was 0.90. At the final stage, the material was validated with CVI 0.983 by four experts and satisfied the expected minimum CVI value for this study (CVI ≥ 0.83, p-value = 0.05). The overall evaluation of the newly developed and validated flipbook was “excellent”. Conclusions: the developed material was found to be appropriate for training fish processors in Nigeria in nutrition and food safety and could be modified for a population of fish processors in other LMICs.

1. Introduction

Nutrition literacy is the degree to which individuals can obtain, process, and understand nutrition information and skills needed to make appropriate nutrition decisions [1,2]. It is a strategy for improving the quality of nutrition, diets, and food security [3,4]. Food security is defined as “when people at all times have physical, social, and economic access to sufficient, safe, and nutritious food to meet dietary needs and food preferences for an active and healthy life” [5]. Food safety is a global public health concern [6]. Awareness of nutrition and food safety is crucial in disease prevention [7].
Nutrition and food safety literacy is of global importance and could be considered an integral component of food security. Unfortunately, it is not fully appreciated by many public health authorities despite a global increase in the prevalence of foodborne illnesses [8]. Food literacy is “understanding nutrition information and acting on it in a way that is consistent with nutrition goals and food wellbeing” [9]. Therefore, teaching nutrition and food safety may be an effective way to improve the nutritional value, quality, and safety of food products. A recent study documented that food safety instruction creates a positive shift in the knowledge paradigm, stimulates a behavioral change towards safe food handling, and minimizes the risk of foodborne illnesses [10]. Health education and promotional tools are effective interventions for modifying health behavior [11]. Printed educational materials such as modules and flipbooks enhance learning, facilitate the delivery of key messages in an entrancing mode, serve as reminders and reinforcement for oral communication [12], and improve knowledge, satisfaction, and adherence to health instruction [13].
The educational level or literacy status of the audience or target population is important to consider when providing nutrition and food safety instructions. Despite the relatively high educational attainment in Nigeria, with 45% of women and 62% of men having completed secondary education or higher [14], malnutrition and foodborne diseases remain prevalent and contribute to increased food insecurity. Therefore, there is a need for nutrition and food safety literacy education.
Nigeria’s tertiary institution’s curriculum for the training of fishery graduates covers fishery technology, processing and storage, and fish nutrition [15]. However, to the best knowledge of the authors, there is no validated, easy-to-understand nutrition and food safety material for training small-scale fish processors in order to improve the quality and safety of processed fish products in Nigeria.
This study was developed as part of the Feed the Future Innovation Lab for Fish (FIL), the US Government’s hunger and food security initiative funded by the United States Agency for International Development (USAID). This initiative aims to reduce poverty and improve nutrition, food security, and livelihoods in low-income countries by supporting projects in sustainable aquaculture and fisheries [16], as well as working towards achieving the Sustainable Development Goals 1, 2, and 5 [17] through innovation central to advancing novel solutions that support goals that reduce global hunger, poverty, and undernutrition and promote quality education and gender equality.
Malnutrition, food insecurity, and poverty remain persistent public health concerns in sub-Saharan African countries [18]. Aquaculture and fisheries have been identified as indigenous resources with the potential to provide a solution to these problems because they serve as a wellspring of animal-based proteins and a source of income for many people [19,20], including marginalized women and youths that are culturally deprived of employment, higher pay, and education. Despite the potential capacity of the aquaculture and fisheries system to improve nutrition, food security, and livelihood, most African countries remain impoverished and malnourished [21] as a result of poor handling, processing, storage, and preservation. Training is an identified need [22] to address the lack of formal education on safe fish handling and processing among small-scale or artisanal fish processors in low-income countries. A study conducted in Northern Nigeria showed that women employed in small-scale fishing and processing businesses have limited access to extension services and training, capital, and modern technology [23]. Little or no education is a factor that affects the acquisition and adoption of improved fish processing techniques [24]. Improved food quality could prevent malnutrition and micronutrient deficiencies that often result from low-quality diets. The food safety knowledge and handling practices among the stakeholders influence the quality and safety of fish products available for the consumers [25]. Contaminated food products (a result of poor handling and processing) can lead to food-borne disease outbreaks. A study in Nigeria showed that a majority of fish vendors lacked knowledge about microbial contamination and the risks associated with unhygienic fish handling [26].
Fish processing methods in low-income countries remain limited to traditional salting, sun-drying, and smoking [27,28]. These methods provide some level of preservation, require no technical know-how or skills, and are cost-effective. However, these methods are not sustainable because of possible exposure to contaminants such as smoke, Polycyclic Aromatic Hydrocarbon (PAH) [29,30], dust, sand, insects, dirt, pests, microorganisms (bacterial, mold), and others during and after processing [31,32]. This contributes to increased post-harvest waste with a consequential effect on food security, nutrition, and the economy.
The USAID Feed the Future Innovation Lab for Fish (FTF FIL) aimed to enhance nutrition and food security among sub-Saharan African countries including Ghana, Uganda, Kenya, Zambia, Nigeria, and Malawi [16,33]. This study is one of the innovative strategies of the Fish Innovation Lab (FIL). It addresses the objective of a project implemented in Delta State, Nigeria (Nourishing Nations: Improving the Quality and Safety of Processed Fish Products in Nigeria) to both educate women and youth fish processors in the Delta State about the benefit of fish in the human diet and to develop low-literacy tools which can help better market their products. This objective was accomplished by developing training materials to improve knowledge in nutrition, food safety, and fish processing methods as a sustainable contribution to improve the quality of processed fish, nutrition, livelihood, and income.
The Nourishing Nations project was implemented in collaboration with the International Center for Living Aquatic Resources Management (ICLARM), also known as WorldFish. In addition, the Food and Agricultural Organization of the United Nations, in partnership with academia and research institutions (Mississippi State University FTF), also aimed at the SDGs 2, 12, and 14 [34] to improve food and nutrition security and alleviate poverty among the vulnerable population through sustainable aquaculture development efforts.
Training, workshops, and sustainable projects are part of the innovative approach sponsored by the USAID FTF FIL to achieve its goal, which requires designing and developing training material appropriate for the target population.
Developing suitable, comprehensible, culturally appropriate, and relevant training material is important for improving nutrition and food safety knowledge, food handling behavior, and quality fish production. This study aimed to develop and validate low-literacy materials to teach fish processors in Delta State, Nigeria about nutrition and safe fish handling and processing to address knowledge gaps, food insecurity, poor quality processed fish products, and food safety issues. To the authors’ knowledge, no validated nutrition and food safety low-literacy material is presently available in Nigeria for training fish processors in these areas. The developed and validated nutrition and food safety flipbook will be a useful tool in the interactive training of small-scale fish processors.

2. Methods

2.1. Curriculum Development

The first step in the process of developing low-literacy educational materials was the curriculum development (Figure 1). Curriculum themes were designed to meet the objectives of the Nourishing Nations project which focused on improving nutrition knowledge and the quality of processed fish products in Delta State, Nigeria. Designed curriculum included collaborative or complementary topics on nutrition and food safety to form content focused on improving nutrition knowledge, safe fish handling, and processing among fish processors. Table 1 presents the content of the nutrition and food safety flipbook, which contained the following modules: (1) healthy eating; (2) animal-source food, with a focus on fish for human nutrition; (3) food safety; (4) fish processing techniques; (5) food poisoning and contamination, with a focus on fish contamination; (6) hygiene practices; (7) the economic and nutritional benefits of fish consumption. Specific objectives were formulated for each module to maximize achievement toward the set goal of improving nutrition and food safety awareness among women fish processors.

2.2. Review of the Relevant Literature

Selecting relevant scientific information for content development involved a literature review of books, periodicals, and publications on nutrition, food safety, safe fish handling, processing, hygiene, and sanitation. The low-literacy training material was developed and prepared in English and written at the 4th-grade reading level. It contained few words with adequate information and appropriate illustrations, pictures, and high-quality and culturally appropriate infographics [35]. Jargon and technical terms were avoided to achieve high readability and comprehensibility [36]. A draft of the material was created using Microsoft Word and PowerPoint. A high-resolution camera and smartphone were used to capture graphics. The seven-module flipbook was developed with an average of ten slides per module and titled: “Nutrition education, food safety, and safe fish handling practice guide for fish processors in Nigeria” (Supplementary Material).

2.3. Selection of Experts

A content evaluation panel is a group of experts that individually validate each item of the material at the initial stage and collectively evaluate at the final stage [37]. The selection of experts was guided by recommendations for the minimum acceptable CVI values (Table 2). The selected group of experts included nutritionists or dietitians, public/environmental health specialists, low-literacy education experts, fisheries and fish value chain experts, and food safety experts. Selecting members from different geographical locations can raise the chance of recognizing colloquial terms inappropriate for an instrument [38]. Twelve experts were therefore selected representing Nigerian and USA nationalities using well-defined criteria including areas of expertise, experience, and qualifications [39]. An introduction letter was sent to each expert to solicit the panel’s participation. Four of the invited panelists declined participation based on either conflict of time or interest. Eight accepted, but only six completed the assignment at the initial stage of the content validation. Four were invited for the final content validation. The number of panelists that participated in this study aligned with the expert recommendation [39,40].

2.4. Content Validity Index

After panel members accepted the task, they were sent the educational material in a PowerPoint format with the accompanying multiple-choice questions for each module. Each panelist was provided with one Content Validation Index (CVI) assessment form via email that contained ten domains for each of the seven modules of the low-literacy flipbook. The ten domains, identified and modified based on the Taveres model [40] to suit this study, included: (1) objective, (2) content, (3) relevance, (4) language, (5) infographics, (6) design, (7) motivation, (8) culture, (9) methodology, and (10) pre-and post-quiz test. Panel members were asked to indicate their agreement through a five-point Likert scale to determine the relevancy of each of the ten domains.
Panelists outside of the United States were requested to send their CVI report forms through email, while those within Mississippi State University submitted their report forms in person. Panelist judgments were analyzed by computing the Item-level Content Validity Index (I-CVIs) and the Scale-level Content Validity Index (S-CVIs) to determine the relevancy of the items in the domains. I-CVI was also compared with the Modified Kappa Index (k*); this is an index of agreement among the panelists that the item is relevant and is categorized as fair, good, or excellent [41].
CVI was used to determine the degree of usefulness of each component of the training material. Using a content validity panel of six members, a minimum value of 0.99 was required for the CVI at p-value = 0.05 [42]. In this study, the expected minimum CVI value based on the number of experts involved was between 0.83 and 1.0. The higher the percentage of the panelists’ agreement on the relevancy or essentiality of the evaluated item, the greater the degree of its content validity. The Content Validity Ratio (CVR) was used in determining the rejection or retention of specific items.
The content validation data collected were entered in Microsoft Office Excel (Microsoft Corporation) and analyzed using the CVI [41].
The study was determined exempted by the Mississippi State University Institutional Research Board (IRB).

3. Results

3.1. Content Validity Index

Educational materials and instructions written with advanced English or above fourth-grade reading level may be too technical and difficult to understand by a low-literate population and this may likely jeopardize the validity and credibility of such instruments. A study from the Bangladesh perspective shows that comprehensible English learning material improves students’ performance [44]. Another study in Morocco reveals an advantageous impact of comprehensive inputs on English learners [45].
The result of this study shows that the developed flipbook has a high Content Validity Index, which is an indicator of the appropriateness, comprehensibility, and adaptability of the material by the low-literate population.
Supplementary Table S1 presents the results of the initial and final validation by six and four panelists, respectively. The I-CVI value of all domains evaluated at the initial stage was 0.83, except for the infographic domain in module one, which was 0.81, and the culture domain in module two, with a value of 0.77. The S-CVI for the initial validation was 0.90 and increased to 0.983 at the final validation after making necessary adjustments based on the panelists’ recommendations, as summarized in Table 3. The recommendations helped to improve the cultural appropriateness of the newly developed material from the I-CVI value of 0.77 to 0.92.

3.2. I-CVI and Modified Kappa Index translation

Table 4 presents the I-CVI evaluation table and the number of panelists agreeing using six and four experts. It also shows the computed probability of chance occurrence (Pc) based on the number of panelists (N) and the number agreeing on relevance (A) to determine the kappa designating agreement on relevance (k*) and compared with the evaluation criteria for kappa (EK).
Overall, I-CVI = 0.67 when four out of five or four out of six of the panelists rated an item as relevant; I-CVI = 0.83 when five out of six rated an item as relevant; I-CVI = 0.75 when three out of four rated an item as relevant; I-CVI = 1 when all the panelists rated an item as four.
The minimum I-CVI in the final validation using four experts was 0.75, k* value = 0.67, and Ek evaluation description as “good”. The maximum content validity value that could be achieved = 1, k* value −1.00, and Ek evaluation description as “excellent”.

4. Discussion

Content validity is the degree of agreement or intersect between the performance of the material under evaluation and the ability to function in the job performance domain. The relevancy of each component of the flipbook was determined using the Content Validity Index (CVI).
Based on the results of this study, the developed material was found to be appropriate for training fish processors in Nigeria in nutrition and food safety. The Item-level Content Validity Index (I-CVI) value of all domains evaluated at the initial stage was 0.83 and the Scale-level Content Validity Index (S-CVI) was 0.90. At the final stage, the material was validated with CVI 0.983 by four experts and satisfied the expected minimum CVI value for this study (CVI ≥ 0.83, p-value = 0.05). The overall evaluation of the newly developed and validated flipbook was “excellent”.
The development and validation of a new training material is a process that includes curriculum development, objective formulation, a review of the literature, content development [35,36], and judgment quantification.
The educational material was modified based on the CVI value. The panelists’ recommendations were instrumental in improving the overall content, language, and cultural appropriateness of the nutrition and food safety flipbook.
The CVI value for the nutrition and food safety flipbook also satisfied Davis’s recommendation [46] that a new content validity instrument should have a minimum S-CVI of 0.80. In addition, Polit and Beck [47] recommended that an overall scale could be judged as having excellent content validity if it would be composed of items with I-CVIs that meet Lynn’s criteria [43,48] (I-CVI = 1.00 with 3 to 5 panelists and a minimum of I-CVI of 0.78 for 6 to 10 panelists and an S-CVI/Ave of 0.90 or higher).
The overall evaluation description of the new flipbook was evaluated as “excellent” [41]. In this study, we compared the Pc = 0.031 (Table 4) with the Pc value 0.041 [41]. Although both values were still within the kappa range for excellence, the I-CVI comparison with the Modified Kappa Index and the evaluation criteria described guideline by Cicchetti and Sparrow [41] shows that the content validity using six and four experts was “good” when k is between 0.60–0.74, and “excellent” when k is >0.74.
This study is the first to develop and validate a flipbook that imparts basic nutrition and food safety information to small-scale fish processors in low-income countries. The Content Validity Index of other educational materials was considered for evaluation and compared with the validity index of the nutrition and food safety flipbook. Results of a recent study that describe the validity of android-based learning media developed using the Aiken formula for content validation, show that an index value > 0.750 is considered high validity [49]. Another study, aiming to develop and describe the quality and practicality of the measurement instrument for college students’ entrepreneurial skills, showed that content validity > 0.700 is valid based on the experts’ judgment using the Aiken V formula [50]. A closely related educational booklet for healthy eating for pregnant women had a Content Validity Index of 0.91 [13]. In this study, the CVI of the educational flipbook on nutrition and food safety for small-scale fish processors has a Content Validity Index of 0.983 and is translated, with a Modified Kappa Index (k) > 0.74, as “excellent”.
The validated material was tested in training 122 women and youth fish processors in three senatorial districts in Delta State, Nigeria in a 3-day interactive training using a train-the-trainer approach [51,52]. Knowledge evaluation of the participants using pre- and post-assessment quizzes showed a positive shift in knowledge paradigm among the fish processors [53].

Strengths and Limitations of the Study

The strength of the study was the variety of disciplines of the panelists, whose areas of expertise and recommendations were found essential in the development of the material. In addition, the heterogeneity of cultural backgrounds reduces cultural biases and improves the cultural appropriateness of the newly developed nutrition and food safety flipbook. The number of panelists at the initial and final validation stage was within the recommended value to achieve the minimum acceptable CVI values for a newly developed material. The encompassing quality of the flipbook has the potential to provide the user with diverse integrated knowledge on eating healthy, benefits of fish consumption for human nutrition, safe food handling, improved fish processing methods, prevention of food contamination, hygiene practices, and economic potential of quality fish consumption presented in the seven modules of the flipbook.
A limitation in the development of the flipbook was the westernized graphics and pictures when culturally familiar photo illustrations were not available. In the future, the researchers will engage the expertise of professional artists and graphic designers in drawing appropriate and suitable images or pictures that depict the cultural values of the targeted population.

5. Conclusions

Creating educational material involves presenting key points in an easy-to-read format, high-quality graphic aids, and contributions of experts from relevant professions. The newly developed low-literacy seven-module flipbook on nutrition and safe fish handling and processing for fish processors in Nigeria was successfully validated and considered suitable and culturally appropriate for the target population. The flipbook has the potential to contribute to the improvement of knowledge about nutrition, healthy eating, dietary diversity, food security, and animal-source food in an effort to mitigate malnutrition among children, young female adolescents, and women in low- and middle-income countries. The educational material would also help to improve long-practiced fish processing methods, food safety, and food handling practices among women fish processors in Delta State, Nigeria. Finally, the newly developed and validated flipbook will be available to the public in a printable and downloadable form for teaching low-literacy fish processors nutrition, safe fish handling, and processing.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/ijerph20064891/s1. References [53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69] are cited in the supplementary material.

Author Contributions

Conceptualization and research design, G.A.A. and T.T.-P.; Methodology, G.A.A.; Validation, H.N.E.-O., J.N.N., R.M. and J.L.S.; Formal analysis, G.A.A.; Investigation, G.A.A.; Resources, T.T.-P., J.L.S., M.W.E.J. and Lauren Pincus; Data curation, G.A.A.; Writing—original draft, G.A.A.; Writing—review & editing, G.A.A., T.T.-P., M.M.P., R.M., J.L.S., W.-H.C., M.W.E.J. and L.P.; Visualization, G.A.A.; Supervision, T.T.-P., H.N.E.-O., R.M. and L.P.; Project administration, T.T.-P., H.N.E.-O., J.N.N. and M.M.P.; Funding acquisition, T.T.-P., M.M.P. and L.P. All authors have read and agreed to the published version of the manuscript.

Funding

Feed the Future Innovation Lab for Fish through the United States Agency for International Development (USAID), Award No. 7200AA18CA00030; M. Lawrence, PI, and provides support to Nourishing Nations (Grant No. 322553 012000 027000 609360; T. Tolar-Peterson).

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved as exempted by the Institutional Review Board of Mississippi State University (IRB-20-072) on 9/29/2020.

Informed Consent Statement

This manuscript is made possible by the generous support of the American people provided by the Feed the Future Innovation Lab for Fish through the United States Agency for International Development (USAID) and the partial contribution of the Mississippi Agricultural and Forestry Experiment Station (MAFES), Mississippi State University, Mississippi, USA. The contents are the responsibility of the authors and do not necessarily reflect the views of USAID or the United States Government. The Feed the Future Innovation Lab for Fish is managed by Mississippi State University through an award from USAID.

Data Availability Statement

Data supporting reported results (Supplementary Table S1) can be found at: https://zenodo.org/record/7402378#.ZAdcUHZKjIW.

Acknowledgments

The authors acknowledge the contribution of the panelists Omishakin Ademola M., Oni Bamidele B., Reeder Nicole, and Hendrix Jasmine for their participation in this study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Gibbs, H.; Chapman-Novakofski, K. A review of health literacy and its relationship to nutrition education. Top. Clin. Nutr. 2012, 27, 325–333. [Google Scholar] [CrossRef] [Green Version]
  2. Silk, K.J.; Sherry, J.; Winn, B.; Keesecker, N.; Horodynski, M.A.; Sayir, A. Increasing Nutrition Literacy: Testing the Effectiveness of Print, Web site, and Game Modalities. J. Nutr. Educ. Behav. 2008, 40, 3–10. [Google Scholar] [CrossRef]
  3. Velardo, S. Nutrition Literacy for the Health Literate. J. Nutr. Educ. Behav. 2017, 49, 183. [Google Scholar] [CrossRef] [PubMed]
  4. West, E.G.; Lindberg, R.; Ball, K.; McNaughton, S.A. The role of a food literacy intervention in promoting food security and food literacy—ozharvest’s nest program. Nutrients 2020, 12, 2197. [Google Scholar] [CrossRef]
  5. Food and Agriculture Organization of the United Nations. Rome declaration on world food security and World Food Summit plan of action. In World Food Summit; Food and Agriculture Organization of the United Nations: Rome, Italy, 1996; pp. 1–17. [Google Scholar]
  6. WHO. Food Safety: What You Should Know; World Health Organization: Geneva, Switzerland, 2015. [Google Scholar]
  7. Losasso, C.; Cibin, V.; Cappa, V.; Roccato, A.; Vanzo, A.; Andrighetto, I.; Ricci, A. Food safety and nutrition: Improving consumer behaviour. Food Control 2012, 26, 252–258. [Google Scholar] [CrossRef]
  8. World Health Organization. WHO Estimates of the Global Burden of Foodborne Diseases: Foodborne Disease Burden Epidemiology Reference Group 2007–2015; World Health Organization: Geneva, Switzerland, 2015. [Google Scholar]
  9. National Academies of Sciences, Engineering, and Medicine. Food Literacy: How Do Communications and Marketing Impact Consumer Knowledge, Skills, and Behavior? Workshop Summary; The National Academies Press: Washington, DC, USA, 2016. [Google Scholar] [CrossRef]
  10. Kendall, P.; Scharff, R.; Baker, S.; LeJeune, J.; Sofos, J.; Medeiros, L. Food Safety Instruction Improves Knowledge and Behavior Risk and Protection Factors for Foodborne Illnesses in Pregnant Populations. Matern. Child Health J. 2017, 21, 1686–1698. [Google Scholar] [CrossRef]
  11. Cushing, C.C.; Brannon, E.E.; Suorsa, K.I.; Wilson, D.K. Systematic review and meta-analysis of health promotion interventions for children and adolescents using an ecological framework. J. Pediatr. Psychol. 2014, 39, 949–962. [Google Scholar] [CrossRef] [Green Version]
  12. Birhanu, Z.; Godesso, A.; Jira, C.; Morankar, S. Assessment of Production and Distribution of Printed Information Education Communication (IEC) Materials in Ethiopia and Utilization in the Case of Jimma Zone, Oromiya National Regional State: A Cross-Sectional Study. Ethiop. J. Health Sci. 2011, 21 (Suppl. S1), 77–83. Available online: https://www.ajol.info/index.php/ejhs/article/view/74272 (accessed on 5 January 2022.). [PubMed]
  13. de Oliveira, S.C.; de Oliveira Lopes, M.V.; Fernandes, A.F.C. Development and validation of an educational booklet for healthy eating during pregnancy. Rev. Lat.-Am. De Enferm. 2014, 22, 611–620. [Google Scholar] [CrossRef] [Green Version]
  14. National Population Commission of Nigeria. Nigeria Demographic and Health Survey 2013; National Population Commission: Abuja, Nigeria; NPC and ICF International: Rockville, MD, USA, 2014; pp. 201–221. Available online: https://dhsprogram.com/pubs/pdf/FR293/FR293.pdf (accessed on 8 January 2022).
  15. Nwadiaro, C.S. Fisheries training in Nigeria’s tertiary institutions-curriculum, staffing, equipment and other facilities: A critique of NUC’S minimum benchmark academic standards (MBAS) document. In Proceedings of the 25th Annual Conference of the Fisheries Society of Nigeria (FISON), Topo Badagry, Nigeria, 25–29 October 2010; Fisheries Society of Nigeria: Lagos, Nigeria, 2010. Available online: http://hdl.handle.net/1834/38255 (accessed on 8 January 2022).
  16. Feed the Future, The U.S Government’s Global Hunger and Food Security Initiatives. Available online: https://www.feedthefuture.gov/ (accessed on 8 January 2022).
  17. United Nations, Department of Economic and Social Affairs. Development Goals (SDGs). Available online: https://sdgs.un.org/ (accessed on 8 January 2022).
  18. Wudil, A.H.; Usman, M.; Rosak-Szyrocka, J.; Pilař, L.; Boye, M. Reversing Years for Global Food Security: A Review of the Food Security Situation in Sub-Saharan Africa (SSA). Int. J. Environ. Res. Public Health 2022, 19, 14836. [Google Scholar] [CrossRef]
  19. Chan, C.Y.; Tran, N.; Pethiyagoda, S.; Crissman, C.C.; Sulser, T.B.; Phillips, M.J. Prospects and challenges of fish for food security in Africa. Glob. Food Secur. 2019, 20, 17–25. [Google Scholar] [CrossRef]
  20. Kaleem, O.; Sabi, A.F.B.S. Overview of aquaculture systems in Egypt and Nigeria, prospects, potentials, and constraints. Aquac. Fish. 2021, 6, 535–547. [Google Scholar] [CrossRef]
  21. Adeyeye, S.A.O.; Adebayo-Oyetoro, A.O.; Tiamiyu, H.K. Poverty and malnutrition in Africa: A conceptual analysis. Nutr. Food Sci. 2017, 47, 754–764. [Google Scholar] [CrossRef]
  22. Ogunremi, J.B. Awareness, training needs and constraints on fishing technologies among small scale fishermen in Ondo State, Nigeria. J. Agric. Sci. 2016, 8, 169. [Google Scholar] [CrossRef] [Green Version]
  23. Ibrahim, H.I.; Kigbu, A.A.; Mohammed, R. Women’s experiences in small-scale fish processing in Lake Feferuwa fishing community, Nasarawa State, Nigeria. Livest. Res. Rural. Dev. 2011, 23, 1–8. [Google Scholar]
  24. Odediran, O.F.; Ojebiyi, W.G. Awareness and adoption of improved fish processing technologies among fish processors in Lagos State, Nigeria. Res. J. Agric. Environ. Manag. 2017, 6, 046–054. [Google Scholar]
  25. Aboagye, E.; Tano-Debrah, K.W.A.K.U.; Kunadu, A.P.H. Microbial quality of fish along with the Tilapia, Africancatfish and Sardinella artisanal value chains in Kpong and James Town, Ghana. Int. J. Bonorowo Wetl. 2020, 10, 1–17. [Google Scholar] [CrossRef]
  26. Grema, H.A.; Kwaga, J.; Bello, M.; Onimisi, H.U. Assessment of food hygiene knowledge, attitudes and practices of fish handlers in Kaduna State, Nigeria. Adv. Anim. Vet. Sci. 2018, 7, 131–137. [Google Scholar] [CrossRef] [Green Version]
  27. Ibourahema, C.; Stéphane Isaac, F.F.; Adja Massagna, C.; Kouakou Ahossi, K. Habits and Technical Systems at Work in Artisanal Fish Processing in Three Localities of Sassandra-marahoue’s District of Côte d’ivoire. Asian Food Sci. J. 2023, 22, 25–32. [Google Scholar] [CrossRef]
  28. Onyango, D.M.; Lung’ayia, H.B.O.; Owigar, R.; Oduor, A.O.; Sifuna, A.W.; Otuya, P.; Kowenje, C. Evaluation of Fish Processing and Preservation Systems along the Shores of Lake Victoria towards Enhancement of Sun Drying Technology. 2017. Available online: https://repository.spu.ac.ke/xmlui/handle/123456789/719 (accessed on 8 January 2022).
  29. Essumang, D.K.; Dodoo, D.K.; Adjei, J.K. Effect of smoke generation sources and smoke curing duration on the levels of polycyclic aromatic hydrocarbon (PAH) in different suites of fish. Food Chem. Toxicol. 2013, 58, 86–94. [Google Scholar] [CrossRef]
  30. Assogba, M.F.; Afé, O.H.I.; Ahouansou, R.H.; Anihouvi, D.G.H.; Kpoclou, Y.E.; Djago, D.; Douny, C.; Igout, A.; Mahillon, J.; Hounhouigan, D.J.; et al. Performances of the barrel kiln used in cottage industry for fish processing and effects on physicochemical characteristics and safety of smoked fish products. J. Sci. Food Agric. 2022, 102, 851–861. [Google Scholar] [CrossRef] [PubMed]
  31. Al-Reza, S.; Karmaker, S.; Hasan, M.; Roy, S.; Hoque, R.; Rahman, N. Effect of traditional fish processing methods on the proximate and microbiological characteristics of Laubuka dadiburjori during storage at room temperature. J. Fish. Aquat. Sci. 2015, 10, 232. [Google Scholar]
  32. Adeyeye, S.A.O. Traditional fish processing in Nigeria: A critical review. Nutr. Food Sci. 2016, 46, 321–335. [Google Scholar] [CrossRef]
  33. Mississippi State University, Feed the Future Innovation Lab for Fish. Available online: https://www.fishinnovationlab.msstate.edu/about (accessed on 17 February 2023).
  34. FAO. Strengthening Food Security through Innovative Aquaculture Management. 2020. Available online: https://www.fao.org/3/ca9300en/CA9300EN.pdf (accessed on 17 February 2023).
  35. Ip, M. Keys to clear communication—How to improve comprehension among patients with limited health literacy. Today’s Dietit. 2010, 12, 4. Available online: https://acces.bibl.ulaval.ca/login?url=https://search.ebscohost.com/login.aspx?direct=true&db=rzh&AN=2010682586&lang=fr&site=ehost-live (accessed on 5 January 2022).
  36. Plimpton, S.; Root, J. Materials and strategies that work in low literacy health communication. Public Health Rep. 1994, 109, 86–92. [Google Scholar]
  37. Garcia, M.; Chismark, E.A.; Mosby, T.; Day, S.W. Development and validation of a nutritional education pamphlet for low-literacy pediatric oncology caregivers in Central America. J. Cancer Educ. 2010, 25, 512–517. [Google Scholar] [CrossRef]
  38. Grant, J.; Kinney, M.; Guzzetta, C. A methodology for validating nursing diagnoses. Adv. Nurs. Sci. 1990, 12, 65–74. Available online: https://journals.lww.com/advancesinnursingscience/Fulltext/1990/04000/A_methodology_for_validating_nursing_diagnoses.7.aspx (accessed on 5 January 2022). [CrossRef]
  39. Grant, J.S.; Davis, L.L. Focus on Quantitative Methods: Selection and Use of Content Experts for Instrument Development. Res. Nurs. Health 1997, 20, 269–274. [Google Scholar] [CrossRef]
  40. Tavares, P.A.J.; Hamamoto Filho, P.T.; Ferreira, A.S.S.B.S.; Avila, M.A.G. Construction and Validation of Educational Material for Children with Hydrocephalus and Their Informal Caregivers. World Neurosurg. 2018, 114, 381–390. [Google Scholar] [CrossRef] [Green Version]
  41. Polit, D.F.; Beck, C.T.; Owen, S.V. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res. Nurs. Health 2007, 30, 459–467. [Google Scholar] [CrossRef]
  42. Lawshe, C.H. A quantitative approach to content validity. Pers. Psychol. 1975, 28, 563–575. [Google Scholar] [CrossRef]
  43. Lynn, M.R. Determination and Quantification of Content Validity. Nurs. Res. 1986, 35, 382–386. Available online: https://journals.lww.com/nursingresearchonline/Fulltext/1986/11000/Determination_and_Quantification_Of_Content.17.aspx (accessed on 8 January 2022). [CrossRef] [PubMed]
  44. Mubashshir, A.A. The Effectiveness of Comprehensible Input in Primary Level English Language Classes: A Perspective from Bangladesh. Ph.D. Thesis, Brac University, Dhaka, Bangladesh, 2022. [Google Scholar]
  45. Aqachmar, S. Potential Impact of Comprehensible Input on Moroccan Students’ English Language Fluency. GSJ 2022, 10, 1–10. [Google Scholar]
  46. Davis, L.L. Instrument review: Getting the most from a panel of experts. Appl. Nurs. Res. 1992, 5, 194–197. [Google Scholar] [CrossRef]
  47. Polit, D.F.; Beck, C.T. The content validity index: Are you sure you know what’s being reported? Critique and recommendations. Res. Nurs. Health 2006, 29, 489–497. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  48. Yusoff, M.S.B. ABC of Content Validation and Content Validity Index Calculation. Educ. Med. J. 2019, 11, 49–54. [Google Scholar] [CrossRef]
  49. Verawati, A.; Agustito, D.; Pusporini, W.; Utami, W.B.; Widodo, S.A. Designing Android learning media to improve problem-solving skills of ratio. Adv. Mob. Learn. Educ. Res. 2022, 2, 216–224. [Google Scholar] [CrossRef]
  50. Nofrida, E.R.; Slamet; Prasojo, L. D.; Mahmudah, F.N. The development of an instrument to measure the college student entrepreneurship skills. Pegem J. Educ. Instr. 2022, 13, 241–250. [Google Scholar] [CrossRef]
  51. Mississippi State University, Feed the Future Innovation Lab for Fish. 2021. Available online: https://www.fishinnovationlab.msstate.edu/newsroom/2021/10/recent-trainings-nigeria-taught-importance-food-safety-fish-processing (accessed on 17 February 2023).
  52. Iannotti, L.; Ragsdale, K.; Torell, E. Role of Fish and Other Aquatic Animal-Source Food in Enhancing Nutrition and Food Security Among Vulnerable Populations in Sub-Saharan Africa: Evidence from Ghana, Kenya, Nigeria, and Zambia. In APHA 2022 Annual Meeting and Expo; APHA: Washington, DC, USA, 2022. [Google Scholar]
  53. Adegoye, G.A. Improving Nutrition and Food Safety Knowledge of Small-Scale Fish Processors in Delta State, Nigeria. Ph.D. Thesis, Mississippi State University, Starkville, MI, USA, 2022. [Google Scholar]
  54. World Vegetable Center. Home Garden Toolkit. Available online: https://avrdc.org/ (accessed on 13 January 2021).
  55. Modern Farmer. A Guide to the Roots and Tubers You Didn’t Know You Loved. 2016. Available online: https://modernfarmer.com/2016/01/roots-tubers-guide/ (accessed on 12 March 2021).
  56. USDA MyPlate, Food and Nutrition Service, US Department of Agriculture. Available online: https://www.myplate.gov/ (accessed on 13 January 2021).
  57. Brown, J.E. Nutrition through the Life Cycle, 6th ed.; Cengage Learning: Boston, MA, USA, 2016. [Google Scholar]
  58. Centers for Disease Control and Prevention (CDC). Breastfeeding. Available online: https://www.cdc.gov/breastfeeding/about-breastfeeding/ (accessed on 19 January 2021).
  59. Centers for Disease Control and Prevention (CDC). Public Health Image Library (PHIL) ID: 6901. Available online: https://phil.cdc.gov/details.aspx?pid=6902 (accessed on 19 January 2021).
  60. Diei, Y.; Ndiaye, O. Guide to Proper Artisanal Fish Handling and Processing Practices. Programme for the Integrated Development of Artisanal Fisheries in West Africa Programme (IDAF), Cotonou, Benin, 1998; 35p. IDAF/WP/129. Available online: http://www.fao.org/3/an685e/an685e.pdf (accessed on 14 January 2021).
  61. FAO/PAHO-WHO Course for Food Handlers. Food and Agriculture Organization of the United Nations Regional Office for Asia and the Pacific Bangkok. Food Handler’s Manual. 2014. Available online: https://iris.paho.org/handle/10665.2/34129 (accessed on 13 January 2021).
  62. FAO. The Principles and Practice of Fish Handling and Processing. Available online: http://www.fao.org/3/x5927e/x5927e01.htm (accessed on 3 February 2021).
  63. Servsafe Manager, 2017, 7th ed.; National Restaurant Association Educational Foundation: Washington DC, USA, 2017.
  64. Nigerian Smoked Fish Market Potential. Available online: https://www.meat-machinery.com/meat-processing-insight/nigerian-smoked-fish-market-potential.html (accessed on 14 January 2021).
  65. Federal Republic of Nigeria Official Gazette: No. 27 Lagos, 15th February 2016. Vol. 103. Short Title: National Environmental Health Practice Regulations, 2016, pp. B223–B266. Available online: https://gazettes.africa/archive/ng/2016/ng-government-gazette-dated-2016-02-15-no-27.pdf (accessed on 26 February 2021).
  66. Cailliau, B. Hygiène et sécurité alimentaire. L’Aide-Soignante 2013, 27, 25–29. [Google Scholar] [CrossRef]
  67. Troell, M.; Jonell, M.; Crona, B. The role of seafood in sustainable and healthy diets. In The EAT-Lancet Commission report Through a Blue Lens; The Beijer Institute: Stockholm, Sweden, 2019; pp. 1–24. [Google Scholar]
  68. WorldFish Nigeria Strategy 2018–2022. WorldFish. Strategy: 2018-09. pp. 1–16. Available online: http://pubs.iclarm.net/resource_centre/2018-09.pdf (accessed on 5 January 2021).
  69. Adegoye, G.A.; Tolar-Peterson, T.; Pincus, L. Nutrition Education, Food Safety, and Safe Fish Handling Practice Guide for Fish Processors- Facilitators Guide. Zenodo 2022. [Google Scholar] [CrossRef]
Figure 1. Flowchart for the content validation process. (This illustration is the detailed process involved in the development of the nutrition education, food safety, and safe fish-handling practice guide for fish processors. The process design was the authors’ perception based on a review of the existing literature on content validity and development commonly used in the nursing and health field).
Figure 1. Flowchart for the content validation process. (This illustration is the detailed process involved in the development of the nutrition education, food safety, and safe fish-handling practice guide for fish processors. The process design was the authors’ perception based on a review of the existing literature on content validity and development commonly used in the nursing and health field).
Ijerph 20 04891 g001
Table 1. Nutrition and Food Safety Curriculum and Content.
Table 1. Nutrition and Food Safety Curriculum and Content.
Modules/Topics Lesson Outline (Content)ObjectivesKey Learning Areas
Module 1
Nutrition education
healthy eating habits
  • What is healthy eating?
  • Healthy diet.
  • Benefits of eating healthy.
  • Benefits of breastfeeding. Choose MyPlate for Nigeria: fruits, vegetables, proteins, grains, dairy, roots, and tubers.
  • Dietary diversity: how to make a healthy meal.
  • Summary and evaluation pre and post quiz.
(i) Understand the importance of eating healthy.
(ii) Identify better food choices and combinations.
Healthy eating, eating a
variety of foods to optimize nutrition.
Module 2
Animal source protein.
Fish nutrition
  • Identify animal-source proteins.
  • Nutritional value of fish.
  • Health benefits of fish consumption for: infants and children, pregnant and breastfeeding women, adults.
  • Dietary recommendations for eating fish.
  • Summary and evaluation pre and post quiz.
(i) Understand the benefits of eating fish.
(ii) Learn about variety of foods that are good for growth and health.
The potential of fish in reducing micronutrient deficiencies among children and women of reproductive age.
Module 3
Food safety:
fish safety and handling
  • Define food safety.
  • Keys to food safety.
  • Foodborne illnesses.
  • Safe fish-handling practices.
  • Unsafe conditions that spoil fish.
  • Safe practices: handwashing, personal hygiene, personal protective wears.
  • Summary and evaluation pre and post quiz.
(i) Understand the concept of food safety.
(ii) Understand the consequences of unsafe food handling.
Why is food safety important?
Introduce food safety focusing on safe fish handling.
Module 4
Fish processing:
fish processing techniques
  • Fish processing methods: traditional methods.
  • Modern methods: local and new processed fish products.
  • Fish processing: preparation and procedure.
  • Summary and evaluation pre and post quiz.
(i) Learn a better and safer method of fish processing.
(ii) Recognize the advantage of new methods in improving the quality of fish products.
Safe and quality fish
processing techniques.
Introduce food processing and focus on improved (safe) fish processing techniques and their impact on quality, safety, and nutrition.
Module 5
Food poisoning:
fish poisoning and contamination
  • Define food poisoning.
  • Identify fish contaminants.
  • Classification of contaminants: biological, chemical, and physical.
  • Sources of fish contamination:
    • 10 Fs concept: flies, fingers, fork, fomites, fluid, foe (pests), fumes, field, feces, and Fahrenheit (temp).
  • Safety guidelines for pesticide use.
  • Health implications of fish poisoning and contamination.
  • Preventive measures.
  • Summary and evaluation pre and post quiz.
(i) Identity fish contaminants and health risks.
(ii) Know the preventive measures.
Preventive measures.
Introduce food poisoning and focus on how to prevent or
avoid food poisoning contamination.
Module 6
Hygiene rules and good practices:
hygiene rules for fish handlers
  • Hygiene rules.
  • Sanitary requirements for fish processing.
  • Personal hygiene, sanitation, and disinfection.
  • Good practices: good hygienic practices, aquacultural, harvest, transport, processing, handling, packaging, and storage practices.
  • Summary and evaluation pre and post quiz.
(i) Know the importance of hygiene and sanitation.
(ii) Apply good practices in fish processing.
Good practices: emphasis on personal and improved food hygiene practices of fish processors.
Introduce food safety rules and focus on safe fish handling, food hygiene regulations, and practices.
Module 7
Economic benefits of quality and safe fish products.
  • Fish quality.
  • Fish loss and waste in the value chain.
  • Poverty reduction.
  • Economic empowerment.
  • Improved nutrition and dietary diversity.
  • Improved health and wellbeing.
  • Summary and evaluation pre and post quiz.
Understand the economic benefits of quality and safe fish products for an individual and family.Economic empowerment through quality fish production.
Introduce economic benefits of quality, nutritious, and safe fish products.
Table 2. The number of experts and acceptable cut-off CVI score.
Table 2. The number of experts and acceptable cut-off CVI score.
Number of ExpertsMin. Acceptable CVI ValuesSource
3–5 1.00 [41,42,43]
6–8≥0.83 [41,43]
90.78[42,43]
The number of panelists and the corresponding degree of agreement acceptable for the cut-off CVI score.
Table 3. Summary of the qualitative analysis of the experts’ recommendations.
Table 3. Summary of the qualitative analysis of the experts’ recommendations.
Recommendations of the Expert
Module 1Increase the text font size and sizes of the pictures. Use appropriate colors.
Replace dairy with milk and use meals or plates instead of diet.
Replace milk in the suggested MyPlate for Nigeria with another source such as soy products or available substitutes.
Module 2Include a picture of a well-nourished mother with a healthy child.
Use a clear image to show the benefits of the fish.
Use appropriate child images and words, change child to infants or baby.
Move the “Benefits of breastfeeding to infants and mothers” to Module 1.
Module 3Use more visible, culturally appropriate, and relatable pictures.
Quiz #2: What are safe practices? Change TV series to Watching TV.
Quiz #3: Option A is too long, keep the answers or options brief and precise.
Module 4Number the items on the slides rather than bullets for easier reference.
On slide 5, remove the statement “excess salt intake may increase the risk of high blood pressure” because it is not relevant to the module.
Reorder slides on fish processing and procedures (15–17).
Quiz #2: Keep options brief and concise. Do not trick the participants.
Module 5Increase the eligibility on slide 1, increase the spacing and the font size.
Label the pictures on slides 4–7. This will enhance learning.
Create separate slides for the biological contaminants and biological carriers of diseases.
Replace iodine with antiseptics with “open wounds on your hands” and consider using forks and a spoon when handling fish.
Module 6Generally, font size should be increased.
Separate sanitary requirements of fish processing premises from health requirements for fish processors.
Check the dilution formula and change the chlorine to water volume.
Quiz #1: remove the word “except” from the question, provide one correct option, and do not try to trick your audience with low literacy.
Module 7Emphasize the economic benefit of a quality fish product.
Use a brighter color to enhance the readability of the content.
Slide 8 content is more relevant to food safety.
Reconstruct Quiz 1 to health benefits of quality and safe fish products.
Change Quiz 2 to economic benefits of quality and safe fish products.
Quiz # 3: You can save money by reducing the fish waste generated: (a) yes, (b) maybe, (c) I do not think so. The options are relative and subjective. Use options yes, no, and I don’t know instead.
CoverUse culturally appropriate images to enhance acceptability and inclusiveness.
Table 4. I-CVI evaluation table and number of experts in agreement.
Table 4. I-CVI evaluation table and number of experts in agreement.
Number of ExpertsThe Number Giving 4 or 5 RatingI-CVIPck*EK
331.000.1251.00Excellent
320.670.3750.47Fair
441.000.0631.00Excellent
430.750.250.67Good
551.000.0311.00Excellent
540.800.1560.76Excellent
661.000.0161.00Excellent
650.830.0940.81Excellent
64 **0.670.2340.57Fair
I-CVI—Item-level Content Validity Index. Pc = [N!/A! (N − A)!] × 0.5N, probability of chance occurrence, where N = number of experts and A = number agreeing on relevance. k* = (I-CVI − Pc)/(1 − Pc) kappa designating agreement on relevance; EK, evaluation criteria for kappa, described guideline by Cicchetti and Sparrow (1981). Fair = K of 0.40–0.59. Good = K of 0.60–0.74. Excellent = K of > 0.74. ** binomial variable (Polit et al., 2007).
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Adegoye, G.A.; Tolar-Peterson, T.; Ene-Obong, H.N.; Nuntah, J.N.; Pasqualino, M.M.; Mathews, R.; Silva, J.L.; Cheng, W.-H.; Evans, M.W., Jr.; Pincus, L. Development and Validation of Nutrition and Food Safety Educational Material for Fish Processors in Nigeria. Int. J. Environ. Res. Public Health 2023, 20, 4891. https://doi.org/10.3390/ijerph20064891

AMA Style

Adegoye GA, Tolar-Peterson T, Ene-Obong HN, Nuntah JN, Pasqualino MM, Mathews R, Silva JL, Cheng W-H, Evans MW Jr., Pincus L. Development and Validation of Nutrition and Food Safety Educational Material for Fish Processors in Nigeria. International Journal of Environmental Research and Public Health. 2023; 20(6):4891. https://doi.org/10.3390/ijerph20064891

Chicago/Turabian Style

Adegoye, Grace Adeola, Terezie Tolar-Peterson, Henrietta Nkechi Ene-Obong, Joseph Nkem Nuntah, Monica M. Pasqualino, Rahel Mathews, Juan L. Silva, Wen-Hsing Cheng, Marion Willard Evans, Jr., and Lauren Pincus. 2023. "Development and Validation of Nutrition and Food Safety Educational Material for Fish Processors in Nigeria" International Journal of Environmental Research and Public Health 20, no. 6: 4891. https://doi.org/10.3390/ijerph20064891

APA Style

Adegoye, G. A., Tolar-Peterson, T., Ene-Obong, H. N., Nuntah, J. N., Pasqualino, M. M., Mathews, R., Silva, J. L., Cheng, W. -H., Evans, M. W., Jr., & Pincus, L. (2023). Development and Validation of Nutrition and Food Safety Educational Material for Fish Processors in Nigeria. International Journal of Environmental Research and Public Health, 20(6), 4891. https://doi.org/10.3390/ijerph20064891

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop