Next Article in Journal
Problems Associated with Co-Infection by Multidrug-Resistant Klebsiella pneumoniae in COVID-19 Patients: A Review
Previous Article in Journal
Effects of Flap Design on the Periodontal Health of Second Lower Molars after Impacted Third Molar Extraction
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Impact Evaluation of An Interdisciplinary Educational Intervention to Health Professionals for the Treatment of Mild to Moderate Child Malnutrition in Mexico: A Difference-in-Differences Analysis

by
Sonia Sánchez-Encalada
1,
Myrna Mar Talavera-Torres
2,
Antonio R. Villa-Romero
1,
Marcela Agudelo-Botero
3 and
Rosa María Wong-Chew
1,*
1
División de Investigación, Facultad de Medicina, Universidad Nacional Autónoma de Mexico, Mexico City 04510, Mexico
2
Hospital Pediátrico de Coyoacán, Mexico City 04000, Mexico
3
Centro de Investigación en Políticas, Población y Salud, Facultad de Medicina, Universidad Nacional Autónoma de Mexico, Mexico City 04510, Mexico
*
Author to whom correspondence should be addressed.
Healthcare 2022, 10(12), 2411; https://doi.org/10.3390/healthcare10122411
Submission received: 15 October 2022 / Revised: 13 November 2022 / Accepted: 24 November 2022 / Published: 30 November 2022

Abstract

:
The prevalence of undernutrition in Mexican children younger than 5 years old has been 14% since 2006. There are clinical practice guidelines for mild to moderate malnutrition in children in the Mexican health system; however, they are not applied. In addition, the knowledge and practices of health professionals (HP) to treat malnutrition in health centers are insufficient to perform adequate assessments and correct treatments. An impact evaluation of an interdisciplinary educational intervention was carried out on 78 HPs for the treatment of children with mild to moderate malnutrition of low resources, with 39 in the intervention group and 37 in the counterfactual group, estimated as the comparison group. A Food and Agriculture Organization (FAO)-validated questionnaire adapted to child malnutrition about knowledge, attitudes, and practices was applied before, after, and 2 months after a malnutrition workshop. The difference-in-differences analysis showed that the educational intervention group had a significant improvement in knowledge, attitudes, and practices before and after the intervention (grades of 54.6 to 79.2 respectively, p = 0.0001), compared with the comparison group (grades of 79.2 and 53.4, respectively, p = 0.0001), which was maintained over two months (grades of 71.8 versus 49.8, p = 0.0001, respectively). The multivariate analysis showed that the probability of improvement in learning by 30% was 95-fold higher in the educational intervention group versus the comparison group, OR = 95.1 (95% CI 14.9–603.0), and this factor was independent of sex, age, education, or hospital position. Despite the availability of clinical practice guidelines for the assessment and treatment for child malnutrition, education in malnutrition for HPs is effective and needed to achieve a significant improvement in children’s health.

1. Introduction

One of the global public health problems to solve urgently is child undernutrition (ChUN) [1]. In 2019, half of the worldwide deaths of children under five years old were due to malnutrition and associated diseases such as gastrointestinal and respiratory infections [2]. Focusing on nutritional well-being offers the opportunity to create synergy between public health and equity, according to the Sustainable Development Goals 2030 Agenda, especially health-related goals, such as zero hunger, health and wellness, and hygiene and sanitation, to promote nutritional resilience [1].
In Mexico, stunting (low height for age) in children under 5 years old is a disease with a prevalence of 14% that has not changed since 2006, according to the National Health and Nutrition Survey (ENSANUT) from 2006, 2012, 2016, and 2018 [3]. This chronic malnutrition affects the physical health, mental development, and emotional well-being, in some cases irreversibly, so its detection and treatment in early stages are necessary to prevent serious consequences [4]. The most prevalent forms of ChUN in Mexico City are mild to moderate where the clinical manifestations are few or imperceptible and often underestimated and not diagnosed [5]. Therefore, the proper knowledge of first contact health professionals (HP) in primary care is necessary to detect and treat these patients correctly and on time to prevent severe malnutrition [6].
The Food and Agriculture Organization (FAO) and the 2020 Global Health Report have proposed HP education as one of the better strategies to fight ChUN. Education has been considered an economic, viable, and sustainable strategy that empowers the participants. It can be extended as a network to generate changes in knowledge and reach several people at the same time [1,7,8]. In the year 2004, Anand et al. observed that knowledge and practices of HP were insufficient to assess the correct treatment of child malnutrition (TCM) in health centers. In addition, in the year 2015 [9], Restier et al. (2015) showed that HP underestimate the prevalence of malnutrition in children by half and overestimate the frequency of appropriate screening practices and its detection [10]. On the other hand, in 2019, Nimpagaritse et al. agreed that TCM in health centers is deficient and that clinical practice guidelines are not applied effectively, which causes lower detection and deficient attention [11].
Evidence has shown that HP education is an indispensable strategy to improve their knowledge, attitudes, and practices; its effect has positive impacts on improving care and the health of the patients. In the year 2021, a study carried out in South Africa evaluated a mentoring intervention for HP for the treatment of HIV and the improvement of infant feeding. This group observed that participation in a multidisciplinary training team was associated with an attitude score improvement of five points, significantly higher in the intervention group compared to the control group [12]. However, in Mexico, there is no evidence of impact evaluations of educational programs for HP to treat mild to moderate undernutrition. Currently, it has been proposed that action-oriented nutrition education is effective to promote significant learning [13].
The aim of this study is to evaluate the impact of an interdisciplinary educational intervention on HP for the treatment of mild to moderate ChUN in Mexico City. The obtained evidence will be useful for decision makers to analyze the possibility of implementing educational programs on primary healthcare HP about ChUN. This could improve their knowledge, attitudes, and practices and therefore help them give proper care on time and give assertive recommendations to the mothers.

2. Material and Methods

2.1. Study Setting and Population

An impact evaluation was performed at the Hospital Pediátrico de Coyoacán during the period of January to June of 2022. This institution is a pediatric hospital that gives attention to children from very low-income families from the south of Mexico City. It was chosen because it serves as a primary and secondary care and treats children without severe complications [14]. The study population invited to participate included HP of any age with different positions at the institution, such as attending physicians, medical residents, interns, students, nurses, and nutritionists who were involved in the health care of the children (approximately 141 HP). Administrative, technical, and quartermaster personnel were excluded

2.2. Procedures

An impact evaluation to assess a social health program in Mexico and to provide information to decision-makers allowing improvements in implementation was carried out in two stages:
Stage I. Management.
First, the study was submitted for approval by the hospital authorities and by the teaching department. This research group designed an educational intervention based on the taxonomy of meaningful learning, and a theory of change (ToC) was developed to achieve the desired result, with intermediate and long-term objectives, assumptions, and risks. Subsequently, a FAO knowledge, attitudes, and practices (KAP) survey for health care providers and other personnel regarding HIV patients [15] was semantically and constructively adapted to the treatment of child malnutrition (Section 2.4) and reviewed by three experts; pertinent changes were made according to their observations.
Stage II. Implementation.
The program was scheduled with the teaching department, and all attending physicians, residents, interns, students, nutritionists, and nurses were invited to participate in the study. The assignment was not randomized; those who were available to take the workshop constituted the intervention group (IG), and the counterfactual group was estimated as the comparison group (CG), which included those who only answered the questionnaire. The KAP questionnaire was applied to both groups as the baseline or diagnostic measure, and informed consent was signed. A two-hour active interdisciplinary medical and nutritional workshop was given to the IG by a DSc. pediatrician and an MSc. nutrition education specialist. At the end of the workshop, the KAP questionnaire was applied again to both groups, and to observe the effect over time, the KAP questionnaire was applied to both groups two months after the intervention. The malnutrition workshop was given twice to reach the sample size calculated for the study.

2.3. Theory of Change (ToC)

A ToC is an impact evaluation essential step that outlines how the project is supposed to achieve the intended results. It is a flexible, non-linear map that describes a results chain as a useful tool, specifies the evaluation question(s), and selects indicators to assess performance. At the beginning of the educational intervention design, a ToC map to describe and evaluate the approach of the intended outcomes was constructed. The impact the study wanted to achieve, located outside the ceiling of accountability (level that cannot be measured and therefore is outside the responsibility of the intervention outcome), was to improve HP undernutrition care to decrease mild to moderate undernutrition in Mexican children younger than 5 years old. The long-term outcome was to improve HP undernutrition care in the IG compared to the CG. The intermediate outcomes were to produce changes in the KAPs of HPs to treat undernutrition and give correct counseling to their mothers through a significant learning strategy by attending a 2-h active workshop. The principal indicator was the information collected in the KAP questionnaire before, after, and two months after the educational intervention in both groups. The rationale was that HPs needed to be updated about mild to moderate child undernutrition screening, medical treatment, nutritional care, and counseling to the mothers in order to be detect and treat undernutrition properly. Finally, we assumed that all HPs would answer the questionnaire before, after, and two months after the intervention and remain at the institution [16] (Figure 1).

2.4. Knowledge, Attitudes, and Practices Questionnaire Adapted for Malnutrition for Health Professionals (KAP)

A survey instrument for mild to moderate undernutrition was developed based on the validated FAO instruments of adaptable KAP model questionnaires using appendix 6, module 5. These questionnaires were already validated and needed to be adapted to the local context and the requirements of the specific project or intervention. The adaptation was constructed conceptually based on the KAP-FAO/WHO guidelines on malnutrition and food [15], on the KAP survey for healthcare providers and other professionals in relation to HIV/AIDS [17], and on the WHO/UNICEF reports, specific to the treatment of malnourished children [18]. To evaluate the comprehensibility of the instrument, the draft was evaluated by three experts in malnutrition (outside the study population), and open comments were obtained. The questionnaire was anonymous and was made up of 55 closed questions (true/false, Yes/No, don’t know answers); it also included a clinical case to evaluate the classification and diagnosis of the nutrition status according to the Z-score and recommendations to mothers. It did not include psychometric characteristics. An individual identification number was created for each participant, and general information such as sex, age, educational level, and position at the institution were also included; 39 questions evaluated knowledge, 6 evaluated practices, and 6 evaluated attitudes (51 total items). To grade the questionnaires, 1 was designated for the correct answers and positive KAP, and 0 was designated for incorrect or negative ones. The rating was calculated using a scale from 0 to 100, where 100 was the maximum grade obtained of the total of correct answers (51 items).

2.5. Educational Intervention

We designed an action-oriented, face-to-face workshop. It consisted of a one-day, two-hour session of two disciplines: medical and nutritional. The main objectives of this intervention were that HPs acquire knowledge, positives practices, and attitudes for the adequate treatment of children with mild to moderate malnutrition and give assertive recommendations to their mothers based on Dr. Fink’s meaningful learning taxonomy. Meaningful learning refers to the learning that causes a lasting change in the student and that becomes important for their life, promoting their development of critical and practical thinking through the dynamics and the resolution of a clinical case [13]. The topics included in the workshop were: the general context of malnutrition, recognition of the malnourished child, risk factors, classification according to the Z-score and diagnosis, correct diet for children with mild to moderate malnutrition, and recommendations to mothers according to the clinical practice guidelines for the diagnosis and treatment of malnutrition in children under five years of age at primary care; they were prepared with the participation of the National Health System Institutions and coordinated by the Technological Excellence National Center (GPC—SS-119-18) [19]. A team dynamic was implemented using specific educational material for food orientation based on the Equivalents Mexican System.

2.6. Sample Size Calculation

The sample size was calculated using the Epidat app, version 4.2, for the difference of proportions formula, considering Zα = 1.96, and Zβ = 0.84. The main outcome variable was the difference of 30% before and after the intervention [20]. A total of 78 participants were included, 39 in each group (intervention and comparison group).

2.7. Statistical Analysis

The data was analyzed with the SPSS program, version 25. To show possible differences in knowledge, attitudes, and practices of the 78 health professionals, a difference-in-differences analysis was performed using specific statistical tests depending on the variable distribution. We used the Student’s t-test or Wilcoxon’s t-test for related samples and the Student’s t-test or a Mann–Whitney U test between groups. Finally, for the evaluation over time (two months after the intervention), an ANOVA of repeated measures or Friedman’s test was used. To estimate the probability of improvement in learning within the IG and the possible association with the co-variables (position in the institution, sex, level of education, age), multivariate logistic regression models were carried out, where the OR (odds ratio) was obtained, derived from the exponential of regression coefficients.

Difference-in-Differences Estimation

To determine the effect of the educational intervention on the KAP variables, we used the difference-in-differences (DinD) analysis using specific statistic tests. DinD models compare changes in outcomes that occur due to an intervention compared to changes that would normally occur over time in the absence of an intervention using a comparison group. The following equation was used to calculate the DinD impact estimate: (DD) = (B − A) − (D − C), where (B − A) is the difference in outcomes for the IG, and (D − C) is the difference in outcomes for the CG [21].

2.8. Ethical Considerations and Informed Consent

The study was approved by the Research and Ethics Committees of the Faculty of Medicine of the Universidad Nacional Autónoma de México (#059/2014) and by the Ethics and Research Committees of the Coyoacán Pediatric Hospital (#3020010514). Confidentiality of personal data was maintained throughout the study by making participants’ information anonymous and asking them to provide honest answers. The participation of the HPs was voluntary and uncompensated. The informed consent was displayed on the initial page of the survey, read, and signed. The study was carried out according to the Declaration of Helsinki. As significant differences were found in the intervention group, the same workshop was given to the comparison group once the study was over.

3. Results

Seventy-eight HPs were included in the study. Out of 78 participants, 76 correctly responded to the questionnaire, with a response rate of 97.4%. To estimate the impact of the educational intervention, we compared the outcomes of the IG with 39 HPs with the estimation of the counterfactual group obtained from 37 HPs as the CG.

3.1. Demographic Characteristics

The baseline characteristics in both groups were not statistically different, so equal groups were assumed. The mean age was 32.2 ± 13.8 for the IG and 34.7 ± 13.2 for the CG. Of the participants, 7 (17.9%) were men and 32 (82.1%) were women in the IG, and 7 (18.9%) were men and 30 (81.1%) were women in the CG (p = 0.57). Regarding the educational level, the majority were undergraduate (30 (76.9%) for the IG and 29 (78.4%) for the CG), and 15 were postgraduate, 7 (17.9%) for the IG and 8 (21.6%) for the CG (p = 0.36). In regards to the hospital positions, the majority were nurses, 11 (28.2%) for the IG and 14 (37.8%) for the CG, and attending physicians, 4 (10.3%) for the IG and 8 (21.6%) for the CG (p = 0.34) (Table 1).

3.2. Knowledge, Attitudes, and Practices of Health Professionals on the Treatment of Moderate to Mild Undernutrition in Children and Recommendations to Their Mothers

We calculated the differences in the grades of the complete questionnaires (KAP) by sections before and after the intervention and between the intervention and the comparative groups using the Student’s t-test, Wilcoxon, or Mann–Whitney U tests, depending on the sample distribution. We found significant differences in all the characteristics before and after the workshop on KAP, with grades of 54.6 ± 6.6 before to 79.2 ± 8.2 after the workshop in the IG vs. 51.6 ± 8.2 to 53.4 ± 11.4 in the CG (p = 0.0001). In the analysis of the KAP questionnaire by sections, the grades for knowledge were 50.3 ± 8.8 before the workshop to 77.9 ± 10.3 after the workshop in the IG (p = 0.0001) vs. 47.7 ± 9.5 to 50.6 ± 12.7 in the CG; for practices, the grades were 38.4 (0–100) before to 88.0 (33–100) after the workshop in the IG (p = 0.0001) vs. 34.2 (0–100) to 35.1 (0–100) in the CG; finally, for attitudes, the grades were 85.0 (50–100) before to 89.3 (66–100) after the workshop in the IG (p = 0.0001) vs. 77.4 (33.1–100) to 72.9 (16.6–100) in the CG.
To calculate the DinD outcomes two months later, we used the ANOVA or the Friedman tests depending on the variable distribution. Statistically significant differences were found in all the characteristics in the baseline and in the 2 month grades before and after the workshop: 50.3 ± 8.8 to 71.7 ± 5.6 in the IG (p = 0.0001) vs. 47.7 ± 9.5 to 43.3 ± 4.8 in the CG for knowledge; 38.4 (0–100) to 68.8 (33–100) in the IG (p = 0.0001) vs. 34.2 (0–100) to 33.3 (33–33) in the CG for practices; and 85.0 (50–100) to 92.2 (83–100) in the IG (p = 0.0001) vs. 77.4 (33.1–100) to 78.5 (16.6–3.3) in the CG for attitudes. In the comparison between groups, the paragraph describes the grades before, after and 2 months after the intervention, and it also says that there were differences between the IG and CG: 71.7 ± 5.6 in the IG vs. 44.3 ± 4.8 in the CG (p = 0.0001) for knowledge; 68.8 (33–100) in the IG vs. 33.3 (33–33) in the CG (p = 0.0001) for practices; and 92.2 (83–100) in the IG vs. 78.5 (16.6–3.3) in the CG (p = 0.0001) for attitudes (Table 2). Table 3 summarizes the DinD analysis in the overall KAP questionnaire according to the previously described formula (Table 3).

3.3. Multivariate Analysis

Given the significant associations in the bivariate analysis, a multivariate logistic regression analysis was performed. The multivariate model is shown in Table 4, with a 30% cut-off point of learning. In terms of personal variables, it was found that the probability of improving in learning by 30% was 95-fold higher in the intervention group with regards to the comparison group, OR = 95.07 (95% CI 14.9–603.0), and this factor was independent of sex, age, education level, or hospital position (Table 4).

4. Discussion

Undernutrition in children under 5 years of age is a constant public health problem worldwide. In several countries, the double and triple burden of malnutrition is observed even within the same family; the trend is clear, despite the actions that are being carried out, and progress is slow to achieve well-being for all, according to the 2030 agenda [1].
Since the 2000s, the Pan American Health Organization (PAHO) has highlighted the need to educate HPs because the knowledge acquired at school tends to become obsolete. Therefore, a theoretical–practical education became essential for the improvement of competencies through a permanent health education program coordinated by the health centers’ human resources departments [22]. On the other hand, PAHO/WHO recognized that primary healthcare (PHC) constituted a central element in the health policies of Latin American countries as the main strategy to achieve some of the Millennium Development Goals (zero hunger, reduce poverty, eliminate acute and chronic malnutrition, and reduce infant and maternal mortality) [6]. They also emphasized that HP education could be an effective strategy to improve PHC services in malnourished children [23].
Nutrition is an important component of healthcare; several studies have concluded that offering nutritional treatment as part of the medical query is essential, and that it can have a positive impact on the health of the patients [24]. In 2016, Mogre et al. showed the importance of several educational interventions in healthcare systems that improved patient health by helping health students and professionals appreciate the importance of delivering nutrition care and to feel competent enough to deliver it [25]. This relates to Bzowyckyj et al. and Sharma et al., who showed that HP education programs can have direct impacts on patients and communities, as well as on HP learners themselves [26,27]. In Mexico City (2017), a quasi-experimental study demonstrated that an educational intervention by health professionals to low-income mothers with undernourished children improved the Z-score for weight/age after 6 months after the intervention with the same family resources [28]. However, in Mexico, there are no educational programs for HPs to treat child undernutrition. The current Mexican social programs are focused on attending undernutrition through monthly cash transfers or basic food baskets to families, monthly medical consultations, or sporadic food orientation talks in healthcare centers [29]. Hence, it is important to plan a good strategy that increases the capacities of the HPs to be able to attend the needs of these families.
The care expected from PHC workers includes nutrition assessment, education, and counseling interventions, monitoring, and evaluation [30]. Given those requirements, we adapted a FAO-KAP questionnaire for HPs who worked in a pediatric hospital that provided PHC in the south of Mexico City. Then, we designed a medical and nutritional workshop about the diagnosis and treatment of childhood mild to moderate undernutrition and about counseling low-income parents about ongoing care for their children. We conducted an impact evaluation to assess an educational intervention through scores obtained on the KAPs of the health professionals who participated in the workshop.
At the baseline measure, we confirmed that the KAPs of the HPs were insufficient to detect and treat child undernutrition, as well as to give proper counsel to parents, probably because health professionals are not familiar with, nor do they apply the specific guidelines, to treat children suffering from undernutrition. This relates to Gera et al., who observed that maternal care-seeking behavior could be more appropriate with the implementation of an integrated management of a childhood illness strategy (IMCI) [31]. We observed that the KAPs of HPs improved by 25.8 points after the educational intervention (grades of 53.4 to 79.2) compared to the CG (grades of 54.5 to 51.6)); the difference was statistically significant in the IG. This effect persisted after two months (grade of 71.8). Moreover, the DinD analysis showed that between groups, there was a statistically significant 22.8-point difference, suggesting that this impact can be attributed to the educational intervention. These results showed that KAPs about child undernutrition in HPs can be improved with an interactive multidisciplinary workshop based on meaningful learning and persist over time. This is in agreement with Sunguya et al. (Japan 2013), who showed in a systematic review of nutrition education provided to doctors and nurses on the diagnosis and treatment of malnourished children that training HPs improved knowledge, recommendations, and clinical practice, and it was reflected in the health improvement of malnourished children [32]. It is also in agreement with Mogre et al., who showed in a systematic review of 46 papers that educational interventions of HPs improved skills, attitudes, knowledge, and clinical practices [33].
In addition, we observed that the educational intervention improved KAPs in all the health staff, according to that observed by Sumantra-Ray et al. (England, 2014) and Levy et al. (2010). They agreed that a nutrition intervention to all educational levels was useful to improve the nutritional knowledge and skills of junior doctors, assistant physicians, nurses, and others and reported enthusiasm for the hospital setting, increasing awareness of clinical and public health nutrition outcomes [34,35]. Despite the statistically significant difference in the results, we observed that over time, the trend of knowledge began to decrease, possibly due to basic concept oblivion, so we agree with Huang et al. [36] that nutrition education programs offer a practical approach to continuing education for HPs; they may help eliminate the barriers to providing nutrition in primary care, such as lack of knowledge, skills, and self-confidence to give counseling, as well as eliminate negative attitudes towards the delivery of nutrition care [37,38,39].
The significant OR of 95 found in the KAPs of HPs in the multivariate analysis, which was independent of sex, age, educational level, and hospital position, could be due to the study design, to the interdisciplinary intervention, and to the teaching strategy delivered by expert HPs. Our results emphasized those of Robert et al., who showed that strengthening the interaction between HPs and caregivers is necessary to prevent malnutrition, responding to the context and culture of the community [40]. In addition, we agree with Crowley et al., who showed in a systematic review that nutrition is insufficiently incorporated into medical education, regardless of country, setting, or year of medical education [41].
One of the benefits of impact evaluations is that they provide credible evidence on the program performance and effectiveness; our results suggested that the design and delivery achieved the desired outcome: improvement of the KAPs of HPs; that can be attributed to the educational intervention. Nevertheless, our study had limitations; we cannot assume that our intervention would be effective in other institutions. The sample size and only one hospital setting reduces the possibility of contrasting with other types of health institutions and HP competences, which may be affected by other environmental variables.

5. Conclusions

We conclude that the current KAPs about undernutrition in children in primary healthcare by HPs are not adequate. An educational workshop provided to HPs about child undernutrition is an essential strategy to improve KAPs that could result in better nutrition care and better counseling to the mother. The particular characteristics of the intervention, such as geographic region, focus on meaningful learning, and the action-oriented, interdisciplinary nature of the workshop were relevant to the improvement of the KAPs of the HPs. In addition, we conclude that the intervention is equitable and inclusive to all heath staff, and we suggest it should be part of a continuing education program in primary healthcare centers around the country.

Author Contributions

Conceptualization, S.S.-E. and R.M.W.-C.; formal analysis, S.S.-E., A.R.V.-R. and R.M.W.-C.; investigation, S.S.-E., M.M.T.-T., M.A.-B. and R.M.W.-C.; methodology, S.S.-E., A.R.V.-R. and R.M.W.-C.; project administration, R.M.W.-C.; supervision, A.R.V.-R. and R.M.W.-C.; writing—original draft, S.S.-E.; writing—review and editing, M.M.T.-T., A.R.V.-R., M.A.-B. and R.M.W.-C. All authors have read and agreed to the published version of the manuscript.

Funding

Publication funding was provided by the Facultad de Medicina, Universidad Nacional Autónoma de México.

Institutional Review Board Statement

The study was approved by the Research and Ethics Committees of the Facultad de Medicina, Universidad Nacional Autónoma de Mexico (#059/2014) and by the Ethics and Research Committees of the Pediatric Hospital of Coyoacán (#3020010514).

Informed Consent Statement

The informed consent was displayed on the initial page of the survey, read, and signed. The study was carried out according to the Declaration of Helsinki.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to privacy issues.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. 2020 Global Nutrition Report: Action on Equity to End Malnutrition; Development Initiatives: Bristol, UK, 2020.
  2. UNICEF/OMS 2019. Disponible en Desnutrición Infantil. Available online: https://www.unicef.org (accessed on 3 September 2022).
  3. Shamah-Levy, T.; Vielma-Orozco, E.; Heredia-Hernández, O.; Romero-Martínez, M.; Mojica-Cuevas, J.; Cuevas-Nasu, L.; Santaella-Castell, J.A.; Rivera-Dommarco, J. Encuesta Nacional de Salud y Nutrición 2018-19: Resultados Nacionales; Instituto Nacional de Salud Pública: Cuernavaca, Mexico, 2020. [Google Scholar]
  4. Ramos, G.R. Desnutrición. In Medicina Interna Pediátrica; Loredo, A.A., Ed.; McGraw-Hill Interamericana: Mexico City, Mexico, 1996. [Google Scholar]
  5. Márquez-González, H.; García-Sámano, V.M.; Caltenco-Serrano, M.L.; García-Villegas, E.A.; Márquez-Flores, H.; Villa-Romero, A.R. Clasificación y evaluación de la desnutrición en el paciente pediátrico. Residente 2012, 7, 59–69. [Google Scholar]
  6. Rodríguez-Martín, A.; Novalbos-Ruiz, J.P.; Jiménez-Rodríguez, A.; Ramos, M.B.; Sánchez, J.M.R. Implicaciones de la desnutrición en atención primaria. Nutr. Hosp. 2010, 25 (Suppl. 3), 67–79. [Google Scholar]
  7. FAO. Training Needs Analysis in Nutrition Education, including E-Learning. Informe Final; FAO: Roma, Italy, 2011; Available online: https://www.fao.org/nutrition/education/professional-training/needs-assessment/en/ (accessed on 14 October 2022).
  8. Anderson, M.D.; Settee, P. Knowledge and education for peoples’ sovereignty. Globalizations 2020, 17, 1300–1309. [Google Scholar] [CrossRef]
  9. Anand, K. Management of Sick Children by Health Workers in Ballabgarh: Lessons for Implementation of IMCI in India. J. Trop. Pediatr. 2004, 50, 41–47. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  10. Restier, L.; Duclos, A.; Jarri, L.; Touzet, S.; Denis, A.; Occelli, P.; Kassai-Koupai, B.; Lachaux, A.; Loras-Duclaux, I.; Colin, C.; et al. Incorrect evaluation of the frequency of malnutrition and of its screening in hospitalized children by health care professionals: Subjective evaluation of nutritional assessment. J. Eval. Clin. Pract. 2015, 21, 958–962. [Google Scholar] [CrossRef]
  11. Nimpagaritse, M.; Korachais, C.; Nsengiyumva, G.; Macq, J.; Meessen, B. Addressing malnutrition among children in routine care: How is the Integrated Management of Childhood Illnesses strategy implemented at health centre level in Burundi? BMC Nutr. 2019, 5, 22. [Google Scholar] [CrossRef] [Green Version]
  12. Goga, A.; Doherty, T.; Manda, S.; Nkwenika, T.; Haskins, L.; John, V.; Engebretsen, I.M.; Feucht, U.; Dhansay, A.; Rollins, N.; et al. Translating new evidence into clinical practice: A quasi-experimental controlled before–after study evaluating the effect of a novel outreach mentoring approach on knowledge, attitudes and confidence of health workers providing HIV and infant feeding counselling in South Africa. BMJ Open 2020, 10, e034770. [Google Scholar]
  13. Fink, L.D. Una Guía Auto-Dirigida al Diseño de Cursos Para el Aprendizaje Significativo; Jossey-Bass: San Francisco, CA, USA, 2003. [Google Scholar]
  14. Hospital Pediátrico de Coyoacán, Ciudad de México. Available online: https://www.defe.mx/mexico-df/hospitales-centros-medicos/hospital-pediatrico-coyoacan (accessed on 7 November 2022).
  15. Macías, Y.F.; Glasauer, P. Guidelines for Assessing Nutrition-Related Knowledge, Attitudes and Practices—KAP Manual; Food and Agriculture Organization of the United Nations: Rome, Italy, 2014. [Google Scholar]
  16. De Silva, M.; Lee, L.; Ryan, G. Using Theory of Change in the Development, Implementation and Evaluation of Complex Health Interventions, a Practical Guide; The Centre for Global Mental Health: London, UK; The Mental Health Innovation Network: Oslo, Norway, 2014. [Google Scholar]
  17. Encuesta CAP (Conocimientos, Actitudes y Prácticas) Para las y los Proveedores de Atención a la Salud y otro Personal en Relación con el VIH/SIDA; International Planned Parenthood Federation, IPPF: London, UK, 2008; 25p, Available online: https://healtheducationresources.unesco.org/library/documents/encuesta-cap-conocimientos-actitudes-y-practicas-para-las-y-los-proveedores-de (accessed on 7 November 2022).
  18. OMS/UNICEF. 5 Formas de Acabar con la Desnutrición Infantil. 2021. Available online: https://www.unicef.es (accessed on 5 September 2022).
  19. de Salud, S. Guías de Práctica Clínica Para el Diagnóstico y Tratamiento de la Desnutrición en Menores de Cinco Años de Edad en el Primer Nivel de Atención; Actualización 2018, GPC-SS-119-18; CENETEC: Mexico City, Mexico, 2018. [Google Scholar]
  20. Hargrove, E.; Berryma, D.; Yoder, J.; Beverly, E. Assessment of nutrition knowledge and attitudes of preclinical osteopathic medical students. J. Osteo. Assoc. 2017, 117, 622–633. [Google Scholar] [CrossRef] [Green Version]
  21. Gertler, P.J.; Martinez, S.; Premand, P.; Rawlings, L.B.; Vermeersch, C.M. Impact Evaluation in Practice, 2nd ed.; World Bank Group, International Bank for Reconstruction and Development/The World Bank: Washington, DC, USA, 2016; pp. 1–141. [Google Scholar]
  22. OPS/OMS. La Capacitación del Personal de los Servicios de Salud en Proyectos Relacionados con los Procesos de Reforma Sectorial. In Programa de Desarrollo de Recursos Humanos (HSR); OPS/OMS: Mexico City, Mexico, 2002. [Google Scholar]
  23. INSP; FAO; OPS; SSA. Prevención de Mala Nutrición en Niñas y Niños en México ante la Pandemia de COVID-19. Recomendaciones Dirigidas a Tomadores de Decisiones; UNICEF: Mexico City, Mexico, 2021. [Google Scholar]
  24. United Nations Children’s Fund. Improving Child Nutrition: The Achievable Imperative for Global Progress; United Nations Children’s Fund: New York, NY, USA, 2013; pp. 1–124. [Google Scholar]
  25. Mogre, V.; Scherpbier, A.; Dornan, T.; Stevens, F.; Aryee, P.A.; Cherry, M.G. A realist review of educational interventions to improve the delivery of nutrition care by doctors and future doctors. Syst. Rev. 2014, 3, 148. [Google Scholar] [CrossRef] [Green Version]
  26. Bzowyckyj, A.S.; Dow, A.; Knab, M.S. Evaluating the Impact of Educational Interventions on Patients and Communities: A Conceptual Framework. Acad. Med. 2017, 92, 1531–1535. [Google Scholar] [CrossRef]
  27. Sharma, N.; Gupta, M.; Aggarwal, A.K.; Gorle, M. Effectiveness of a culturally appropriate nutrition educational intervention delivered through health services to improve growth and complementary feeding of infants: A quasiexperimental study from Chandigarh, India. PLoS ONE 2020, 15, e0229755. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Sánchez-Encalada, S.; Talavera-Torres, M.M.; Wong-Chew, R.M. An Educational Intervention to Mothers Improved the Nutritional Status of Mexican Children Younger Than 5 Years Old With Mild to Moderate Malnutrition. Glob. Pediatr. Health Mex. 2019, 6, 2333794X1988482. [Google Scholar] [CrossRef] [PubMed]
  29. Morales-Ruán, M.C.; Shamah-Levy, T.; Mundo-Rosas, V.; Cuevas-Nasu, L.; Lozada-Tequeanes, A.L.; Romero-Martínez, M. Evolución de los Programas de Ayuda Alimentaria en México a través de información de la Ensanut MC 2016. Salud Pública Mex. 2018, 60, 319–327. [Google Scholar] [CrossRef] [PubMed]
  30. Tsai, A.G.; Wadden, T.A. Treatment of obesity in primary care practice in the United States: A systematic review. J. Gen. Intern. Med. 2009, 24, 1073–1079. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  31. Gera, T.; Shah, D.; Garner, P.; Richardson, M.; Sachdev, H.S. Integrated Management of Childhood Illness (IMCI) Strategy for Children under Five. Cochrane Database Syst. Rev. 2016, 31, CD010123. [Google Scholar] [CrossRef] [Green Version]
  32. Sunguya, B.F.; Poudel, K.C.; Mlunde, L.B.; Urassa, D.P.; Yasuoka, J.; Jimba, M. Nutrition Training Improves Health Workers’ Nutrition Knowledge and Competence to Manage Child Undernutrition: A Systematic Review. Front. Public Health 2013, 1, 37. [Google Scholar] [CrossRef] [Green Version]
  33. Mogre, V.; Scherpbier, A.J.J.A.; Stevens, F.; Aryee, P.; Cherry, M.G.; Dornan, T. Realist synthesis of educational interventions to improve nutrition care competencies and delivery by doctors and other healthcare professionals. BMJ Open 2016, 6, e010084. [Google Scholar] [CrossRef] [Green Version]
  34. Ray, S.; Laur, C.; Douglas, P.; Rajput-Ray, M.; Van Der Es, M.; Redmond, J.; Eden, T.; Sayegh, M.; Minns, L.; Griffin, K.; et al. Nutrition education and leadership for improved clinical outcomes: Training and supporting junior doctors to run ‘Nutrition Awareness Weeks’ in three NHS hospitals across England. BMC Med. Educ. 2014, 14, 109. [Google Scholar] [CrossRef] [Green Version]
  35. Levy, J.; Harris, J.; Darby, P.; Sacks, R.; Dumanovsky, T.; Silver, L. The primary care nutrition training program: An approach to communication on behavior change. Health Promot. Pract. 2011, 12, 761–768. [Google Scholar] [CrossRef]
  36. Huang, J.; Yu, H.; Marin, E.; Brock, S.; Carden, D.; Davis, T. Physicians’ weight loss counseling in two public hospital primary care clinics. Acad. Med. 2004, 79, 156–161. [Google Scholar] [CrossRef]
  37. Laschinger, H.K.S.; Tresolini, C.P. An exploratory study of nursing and medical students health promotion counselling self-efficacy. Nurse Educ. Today 1999, 19, 408–418. [Google Scholar] [CrossRef] [PubMed]
  38. Foster, G.D.; Wadden, T.A.; Makris, A.P.; Davidson, D.; Sanderson, R.S.; Allison, D.B.; Kessler, A. Primary care physicians’ attitudes about obesity and its treatment. Obes. Res. 2003, 11, 1168–1177. [Google Scholar] [CrossRef] [PubMed]
  39. Taipa-Mendes, A.M.; Amaral, T.F.; Gregório, M. Undernutrition risk and nutritional screening implementation in hospitals: Barriers and time trends (2019–2020). Clin. Nutr. ESPEN 2021, 45, 192–199. [Google Scholar] [CrossRef] [PubMed]
  40. Robert, R.C.; Creed-Kanashiro, H.M.; Villasante, R.; Narro, M.R.; Penny, M.E. Strengthening health services to deliver nutrition education to promote complementary feeding and healthy growth of infants and young children: Formative research for a successful intervention in peri-urban Trujillo, Peru. Matern. Child Nutr. 2017, 13, e12264. [Google Scholar] [CrossRef]
  41. Crowley, J.; Ball, L.; Hiddink, G.J. Nutrition in medical education: A systematic review. Lancet Planet Health 2019, 3, e379–e389. [Google Scholar] [CrossRef]
Figure 1. Theory of change. Indicator: The information collected in the KAP questionnaire before, after and two months after the educational intervention in both groups. Rationale: HP needed to be educated about mild to moderate children undernutrition screening, treatment, nutrition care and counseling to the mothers. Assumptions and risks: HP would answer the questionnaire before, after and two months after the intervention and remain in the institution. Source: Own elaboration based on Mary De Silva’s theory of change practical guide (2014).
Figure 1. Theory of change. Indicator: The information collected in the KAP questionnaire before, after and two months after the educational intervention in both groups. Rationale: HP needed to be educated about mild to moderate children undernutrition screening, treatment, nutrition care and counseling to the mothers. Assumptions and risks: HP would answer the questionnaire before, after and two months after the intervention and remain in the institution. Source: Own elaboration based on Mary De Silva’s theory of change practical guide (2014).
Healthcare 10 02411 g001
Table 1. Demographic characteristics of the population by group.
Table 1. Demographic characteristics of the population by group.
CharacteristicsIntervention
Group
Comparative Group p
n = 39n = 37
Age (years), mean ± SD32.2 ± 13.834.7 ± 13.20.42
Variable, n (%)
Sex 0.57
Men7 (17.9)7 (18.9)
Women32 (82.1)30 (81.1)
Educational level 0.36
Bachelors degree2 (5.1)0
Undergraduate30 (76.9)29 (78.4)
Postgraduate7 (17.9)8 (21.6)
Hospital position 0.34
Nursing assistant9 (23.1)5 (13.5)
Nurse staff11 (28.2)14 (37.8)
Interns10 (25.6)5 (13.5)
Residents5 (12.8)5 (13.5)
Attending physicians4 (10.3)8 (21.6)
Table 2. Difference-in-differences estimation in knowledge, attitudes, and practices (KAP).
Table 2. Difference-in-differences estimation in knowledge, attitudes, and practices (KAP).
Characteristic GradesIntervention Group
n = 39
pComparative
Group
n = 37
pDifference between Groups
mean ± SD mean ± SD
KAP
Baseline54.6 ± 6.6 51.6 ± 8.2
After the intervention79.2 ± 8.20.0001 *,+53.4 ± 11.40.2425.8
After two months **71.8 ± 110.0001 *,&49.8 ± 3.5
Knowledge
Baseline50.3 ± 8.8 47.7 ± 9.5
After the intervention77.9 ± 10.30.0001 *,+50.6 ± 12.70.2127.3
After two months **71.7 ± 5.60.0001 *,&44.3 ± 4.8
Median
(min–max)
Median
(min–max)
Nutritional knowledge
Baseline66.6 (33–100) 66.6 (16.6–83)
After the intervention83.3 (50–100)0.0001 *,++66.6 (16–100) 16.7
After two months **83.3 (33–100)0.0001 *,/65.0 (16.6–66)0.30
Diagnosis, classification of undernourished children, and clinical case
Baseline13.6 (0–66.6) 17.1 (0–100)
After the intervention83.7 (0–100)0.0001 *,++21.6 (0–100) 62.1
After two months **92.8 (33–100)0.0001 *,/55.5 (33–100)0.19
Recommendations to mothers
Baseline19.4 (0–60) 17.3 (0–100)
After the intervention78.9 (0–100)0.0001 *,++24.8 (0–100) 54.1
After two months **74.1 (40–100)0.0001 *,/28.0 (20–60)0.82
Practices
Baseline38.4 (0–100) 34.2 (0–100)
After the intervention88.0 (33–100)0.0001 *,++35.1 (0–100) 52.9
After two months **68.8 (33–100)0.0001 *,/33.3 (33–33)1.00
Attitudes
Baseline85.0 (50–100) 77.4 (33.1–100)
After the intervention89.3 (66–100)0.0001 *,++72.9 (16.6–100) 16.4
After two months **92.2 (83–100)0.0001 *,/78.5 (16.6–3.3)1.00
** Information of 7 participants of the comparative group and 15 of the treatment group. * p < 0.05. +: t-student; ++: Wilcoxon; &: ANOVA; /: Friedman tests.
Table 3. DinD calculation in the complete KAP questionnaire.
Table 3. DinD calculation in the complete KAP questionnaire.
CharacteristicAfterBeforeDifference
Intervention group79.253.479.2 − 53.4 = 25.8 *
Comparison group54.651.654.6 − 51.6 =3.0
Difference24.6 *1.825.8 − 3.0 = 22.8 *
* p < 0.05.
Table 4. Logistic multivariate analysis adjusted by sex, age, educational level, and hospital position to estimate the probability of improving in learning.
Table 4. Logistic multivariate analysis adjusted by sex, age, educational level, and hospital position to estimate the probability of improving in learning.
VariableOR(95% CI)p
Group
Comparison
Intervention

1.0
95.0

-
14.9–603.0

-
0.0001 *
Sex
Male
Female

1.0
1.5

-
0.3–9.6

-
0.65
Age (years)1.01.0–1.10.67
Educational level
Undergraduate0.20.0–6.00.18
Postgraduate0.30.0–9.60.51
Hospital position
Nurses3.80.0–28.00.54
Interns 0.50.0–24.50.72
Residents0.80.0–61.20.91
Attending physicians1.30.0–52.90.89
* p < 0.05.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Sánchez-Encalada, S.; Talavera-Torres, M.M.; Villa-Romero, A.R.; Agudelo-Botero, M.; Wong-Chew, R.M. Impact Evaluation of An Interdisciplinary Educational Intervention to Health Professionals for the Treatment of Mild to Moderate Child Malnutrition in Mexico: A Difference-in-Differences Analysis. Healthcare 2022, 10, 2411. https://doi.org/10.3390/healthcare10122411

AMA Style

Sánchez-Encalada S, Talavera-Torres MM, Villa-Romero AR, Agudelo-Botero M, Wong-Chew RM. Impact Evaluation of An Interdisciplinary Educational Intervention to Health Professionals for the Treatment of Mild to Moderate Child Malnutrition in Mexico: A Difference-in-Differences Analysis. Healthcare. 2022; 10(12):2411. https://doi.org/10.3390/healthcare10122411

Chicago/Turabian Style

Sánchez-Encalada, Sonia, Myrna Mar Talavera-Torres, Antonio R. Villa-Romero, Marcela Agudelo-Botero, and Rosa María Wong-Chew. 2022. "Impact Evaluation of An Interdisciplinary Educational Intervention to Health Professionals for the Treatment of Mild to Moderate Child Malnutrition in Mexico: A Difference-in-Differences Analysis" Healthcare 10, no. 12: 2411. https://doi.org/10.3390/healthcare10122411

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop