Next Article in Journal
Effectiveness of Plyometric and Eccentric Exercise for Jumping and Stability in Female Soccer Players—A Single-Blind, Randomized Controlled Pilot Study
Next Article in Special Issue
A Systematic Review to Examine the Evidence in Developing Social Prescribing Interventions That Apply a Co-Productive, Co-Designed Approach to Improve Well-Being Outcomes in a Community Setting
Previous Article in Journal
Leading Enterovirus Genotypes Causing Hand, Foot, and Mouth Disease in Guangzhou, China: Relationship with Climate and Vaccination against EV71
Previous Article in Special Issue
Rationing of Nursing Care in Intensive Care Units
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 18
Issue 1
10.3390/ijerph18010293
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Effectiveness of an Evidence-Based Practice (EBP) Educational Program on Undergraduate Nursing Students’ EBP Knowledge and Skills: A Cluster Randomized Control Trial

by
Daniela Cardoso
1,2,*,
Filipa Couto
3,
Ana Filipa Cardoso
1,
Elzbieta Bobrowicz-Campos
4,
Luísa Santos
4,
Rogério Rodrigues
1,
Verónica Coutinho
4,
Daniela Pinto
4,
Mary-Anne Ramis
5,
Manuel Alves Rodrigues
1 and
João Apóstolo
1
1
Health Sciences Research Unit: Nursing, Nursing School of Coimbra, Portugal Centre for Evidence-Based Practice: A Joanna Briggs Institute Centre of Excellence, 3004-011 Coimbra, Portugal
2
FMUC—Faculty of Medicine, University of Coimbra, 3000-370 Coimbra, Portugal
3
Alfena Hospital—Trofa Health Group, Health Sciences Research Unit: Nursing, Nursing School of Coimbra, 3000-232 Coimbra, Portugal
4
Health Sciences Research Unit: Nursing, Nursing School of Coimbra, 3004-011 Coimbra, Portugal
5
Mater Health, Evidence in Practice Unit & Queensland Centre for Evidence Based Nursing and Midwifery: A Joanna Briggs Institute Centre of Excellence, 4101 Brisbane, Australia
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(1), 293; https://doi.org/10.3390/ijerph18010293
Submission received: 30 November 2020 / Revised: 28 December 2020 / Accepted: 29 December 2020 / Published: 3 January 2021
(This article belongs to the Special Issue Evidence-Based Practice and Advanced Nursing Care)
Browse Figure
Review Reports Versions Notes

Abstract

:
Evidence-based practice (EBP) prevents unsafe/inefficient practices and improves healthcare quality, but its implementation is challenging due to research and practice gaps. A focused educational program can assist future nurses to minimize these gaps. This study aims to assess the effectiveness of an EBP educational program on undergraduate nursing students’ EBP knowledge and skills. A cluster randomized controlled trial was undertaken. Six optional courses in the Bachelor of Nursing final year were randomly assigned to the experimental (EBP educational program) or control group. Nursing students’ EBP knowledge and skills were measured at baseline and post-intervention. A qualitative analysis of 18 students’ final written work was also performed. Results show a statistically significant interaction between the intervention and time on EBP knowledge and skills (p = 0.002). From pre- to post-intervention, students’ knowledge and skills on EBP improved in both groups (intervention group: p < 0.001; control group: p < 0.001). At the post-intervention, there was a statistically significant difference in EBP knowledge and skills between intervention and control groups (p = 0.011). Students in the intervention group presented monographs with clearer review questions, inclusion/exclusion criteria, and methodology compared to students in the control group. The EBP educational program showed a potential to promote the EBP knowledge and skills of future nurses.

1. Introduction

Evidence-based practice (EBP) is defined as “clinical decision-making that considers the best available evidence; the context in which the care is delivered; client preference; and the professional judgment of the health professional” [1] (p. 2). EBP implementation is recommended in clinical settings [2,3,4,5] as it has been attributed to promoting high-value health care, improving the patient experience and health outcomes, as well as reducing health care costs [6]. Nevertheless, EBP is not the standard of care globally [7,8,9], and some studies acknowledge education as an approach to promote EBP adoption, implementation, and sustainment [10,11,12,13,14,15].
It has been recommended that educational curricula for health students should be based on the five steps of EBP in order to support developing knowledge, skills, and positive attitudes toward EBP [16]. These steps are: translation of uncertainty into an answerable question; search for and retrieval of evidence; critical appraisal of evidence for validity and clinical importance; application of appraised evidence to practice; and evaluation of performance [16].
To respond to this recommendation, undergraduate nursing curricula should include courses, teaching strategies, and training that focus on the development of research and EBP skills for nurses to be able to incorporate valid and relevant research findings in practice. Nevertheless, teaching research and EBP to undergraduate nursing students is a challenging task. Some studies report that undergraduate students have negative attitudes/beliefs toward research and EBP, especially toward the statistical components of the research courses and the complex terminology used. Additionally, students may not understand the importance of the link between research and clinical practice [17,18,19]. In fact, a lack of EBP and research knowledge is commonly reported by nurses and nursing students as a barrier to EBP. It is imperative to provide the future nurses with research and EBP skills in order to overcome the barriers to EBP use in clinical settings.
At an international level, several studies have been performed with undergraduate nursing students to assess the effectiveness of EBP interventions on multiple outcomes, such as EBP knowledge and skills [20,21,22,23]. The Classification Rubric for EBP Assessment Tools in Education (CREATE) [24] suggests EBP knowledge should be assessed cognitively using paper and pencil tests, as EBP knowledge is defined as “learners’ retention of facts and concepts about EBP” [24] (p. 5). Additionally, the CREATE framework suggests EBP skills should be assessed using performance tests, as skills are defined as “the application of knowledge” [24] (p. 5). Despite these recommendations, few studies have assessed EBP knowledge and skills using both cognitive and performance instruments.
Therefore, this study aims to evaluate the effectiveness of an EBP educational program on undergraduate nursing students’ EBP knowledge and skills using a specific cognitive and performance instrument. The intervention used in this study was recently developed [25], and this is the first study designed to assess its effectiveness in undergraduate EBP.

2. Materials and Methods

2.1. Design

A cluster randomized controlled trial with two-armed parallel group design was undertaken (ClinicalTrials.gov Identifier: NCT03411668).

2.2. Sample Size Calculation

The sample size was calculated using the software G*Power 3.1.9.2. (Heinrich-Heine-Universität Dusseldorf, Düsseldorf, Germany) Recognizing that there were no studies performed a priori using a cognitive and performance instrument to assess the effectiveness of an EBP educational program on undergraduate nursing students’ EBP knowledge and skills, we used an effect size of 0.25, which is a small effect size as proposed by Cohen [26]. A power analysis based on a type I error of 0.05; power of 0.80; effect size f = 0.25; and ANOVA repeated measures between factors determined a sample size of 98 as total.
Taking into account that our study used clusters (optional courses) and that each one had an average of 25 students, we needed at least four clusters to cover the total sample size of 98. However, to cover potential losses to follow-up, we included a total of six optional courses.

2.3. Participants’ Recruitment and Randomization

We recruited participants from one Portuguese nursing school in 2018. From the 12 optional clinical nursing courses (such as Community Nursing Intervention in Vulnerable Groups; Ageing; Health and Citizenship; The Child with Special Needs: Diagnoses and Interventions in Pediatric Nursing; Liaison Psychiatry Nursing; Nursing in the Emergency Room; etc.) in the 8th semester of the nursing program (last year before graduation), students from three clinical nursing courses were randomly assigned to the experimental group (EBP educational program) and students from another three clinical nursing courses were randomly assigned to the control group (no intervention—education as usual) before the baseline assessment. An independent researcher performed this assignment using a random number generator from the random.org website [27]. This assignment was performed based on a list of the 12 optional courses provided through the nursing school’s website.

2.4. Intervention Condition

The participants in the intervention group received education as usual plus the EBP educational program, which was developed by Cardoso, Rodrigues, and Apóstolo [25]. This intervention included EBP contents regarding models of thinking about EBP, systematic reviews types, review question development, searching for studies, study selection process, data extraction, and data synthesis.
This program was implemented in 6 sessions over 17 weeks:
  • Sessions 1–3—total of 12 h (4 h per session) during the first 7 weeks using expository methods with practice tasks to groups of 20–30 students.
  • Sessions 4–6—total of 6 h (2 h per session) during the last 10 weeks using active methods through mentoring to groups of 2–3 students.
Due to the nature of the intervention, it was not possible to blind participants regarding treatment assignment nor was it feasible to blind the individuals delivering treatment.

2.5. Control Condition

The participants in the control group received only education as usual; i.e., students allocated to this control condition received the standard educational contents (theoretical, theoretical–practical, practical) delivered by the nursing educators of the selected nursing school.

2.6. Assessment

All participants were assessed before (week 0) and after the intervention (week 18) using a self-report instrument. EBP knowledge and skills were assessed by the Adapted Fresno Test for undergraduate nursing students [28]. This instrument was adapted from the Fresno Test, which was originally developed in 2003 to measure knowledge and skills on EBP in family practice residents [29]. The Adapted Fresno Test for undergraduate nursing students has seven short answer questions and two fill-in-the-blank questions [28]. At the beginning of the instrument, two scenarios, which suggest clinical uncertainty, are presented. These two scenarios are used to guide the answers to questions 1 to 4: (1) write a clinical question; (2) identify and discuss the strengths and weaknesses of information sources as well as the advantages and disadvantages of information sources; (3) identify the type of study most suitable for answering the question of one of the clinical scenarios and justify the choice; and (4) describe a possible search strategy in Medline for one of the clinical scenarios, explaining the rationale. The next three short answer questions require that the students identify topics for determining the relevance and validity of a research study and address the magnitude and value of research findings. The last two questions are fill-in-the-blank questions. The answers are scored using a modified standardized grading system [28], which was adapted from the original [29]. The instrument has a total minimum score of 0 and a maximum score of 101. The inter-rater correlation for the total score of the Adapted Fresno Test was 0.826 [28]. The rater that graded the answers to the Adapted Fresno Test was blinded to treatment assignment.
Despite the fact that in the study proposal we did not consider any kind of qualitative analysis in order to assess EBP knowledge and skills in a more practical context, we decided during the development of the study to perform a qualitative analysis of monographs at the posttest. The monographs were developed by small groups of nursing students and were the final written work submitted by the students for their bachelor’s degree course. In this work, the students were asked to define a review question regarding the context of clinical practice where they were performing their clinical training. Students then proceeded to answer the review question through a systematic process of searching and selecting relevant studies and extracting and synthesizing the data. From the 58 submitted monographs (30 from the control group and 28 from the intervention group), 18 were randomized for evaluation (nine from the control group and nine from the intervention group) by an independent researcher using the random.org website [27] based on a list provided by the research team. Three independent experts (one psychologist with a doctoral qualification and two qualified nurses, one with a master’s degree) performed a qualitative analysis of the selected monographs. All experts had experience with the EBP approach and were blinded to treatment assignment. The experts independently used an evaluation form to guide the qualitative analysis of each monograph. This form presented 11 guiding criteria regarding review questions, inclusion/exclusion criteria, methodology (namely search strategy, study selection process, data extraction, and data synthesis), results presentation, and congruency between the review questions and the answers to them that were provided in the conclusion section. Thereafter, the experts met to discuss any discrepancies in their qualitative analysis until consensus was reached.

2.7. Statistical Analyses

The data were analyzed using Statistical Package for the Social Sciences (SPSS; version 24.0; SPSS Inc., Chicago, IL, USA). Differences in sociodemographic characteristics of study participants and outcome data at baseline were analyzed using Pearson’s chi-squared test for nominal data and independent the t-test for continuous data.
Taking into account the central limit theorem and that ANOVA tests are robust to violation of assumptions [30], we decided to perform two-way mixed ANOVA to compare the outcome between and within groups. The Wilcoxon signed-rank test was used to analyze how many participants had improved their EBP knowledge and skills item-by-item, how many remained the same, and how many had decreased performance within each group. Statistical significance was determined by p-values less than 0.05.
To minimize the noncompliance impact, an intention-to-treat (ITT) analysis was used to analyze participants in the groups that they were initially randomized to [31] by using the last observation carried forward imputation method.

2.8. Ethics

This study was approved by the Ethical Committee of the Faculty of Medicine of the University of Coimbra (Reference: CE-037/2017). The institution where the study was carried out provided written approval. All participants gave informed consent, and the data were managed in a confidential way.

3. Results

Twelve potential clusters (optional courses in the 8th semester of the nursing program) were identified as eligible for this study. Of these, three were randomized for the intervention group and three for the control group. During the intervention, eight participants (two in the intervention group and six in the control group) were lost to follow-up because they did not fill-in the instrument in the post-intervention. Figure 1 shows the flow of participants through each stage of the trial.

3.1. Demographic Characteristics

As Table 1 displays, 148 undergraduate nursing students with an average age of 21.95 years (SD = 2.25; range: 21–41) participated in the study. A large majority of the sample were female (n = 118, 79.7%), had a 12th grade educational level (n = 144, 97.3%), and had participated in some form of EBP training (n = 121, 81.8%).
At baseline, the experimental and control groups were comparable regarding sex, age, education, EBP training, and performance on the Adapted Fresno Test (Table 1 and Table 3). The baseline data were similar with dropouts excluded; therefore, only ITT analysis results are presented.

3.2. EBP Knowledge and Skills

3.2.1. Adapted Fresno Test

The two-way mixed ANOVA showed a statistically significant interaction between the intervention and time on EBP knowledge and skills, F (1, 146) = 9.550, p = 0.002, partial η2 = 0.061 (Table 2). Excluding the dropouts, the two-way mixed ANOVA analysis was similar. Thus, only the ITT analysis results are presented.
To determine the difference between groups at baseline and post-intervention, two separate between-subjects ANOVAs (i.e., two separate one-way ANOVAs) were performed. At the pre-intervention, there was no statistically significant difference in EBP knowledge and skills between groups: F (1,146) = 0.221, p = 0.639, partial η2 = 0.002. At the post-intervention, there was a statistically significant difference in EBP knowledge and skills between groups: F (1,146) = 6.720, p = 0.011, partial η2 = 0.044 (Table 3).
To determine the differences within groups from the baseline to post-intervention, two separate within-subjects ANOVAs (repeated measures ANOVAs) were performed. There was a statistically significant effect of time on EBP knowledge and skills for the intervention group: F (1,73) = 53.028, p < 0.001, partial η2 = 0.421 and for the control group: F (1,73) = 13.832, p < 0.001, partial η2 = 0.159 (Table 3).
The results of repeated measures ANOVA and between-subjects ANOVA analysis are similar if we exclude the dropouts; therefore, only ITT analysis results are presented.
The results of the Wilcoxon signed-rank test for each item of the Adapted Fresno Test are presented in Table 4. The results of this analysis revealed that students in both the intervention and control groups significantly improved their knowledge and skills in writing a focused clinical question (Item 1) (intervention group: Z = −4.572, p < 0.000; control group: Z = −2.338, p = 0.019), in building a search strategy (item 3) (intervention group: Z = −4.740, p < 0.000; control group: Z = −4.757, p < 0.000), in identifying and justifying the study design most suitable for answering the question of one of the clinical scenarios (item 4) (intervention group: Z = −4.508, p < 0.000; control group: Z = −3.738, p < 0.000), and in describing the characteristics of a study to determine its relevance (item 5) (intervention group: Z = −2.699, p = 0.007; control group: Z = −1.980, p = 0.048).
The students in the control group significantly improved their knowledge and skills in describing the characteristics of a study to determine its validity (item 6) (Z = −2.714, p = 0.007). The students in the intervention group significantly improved their knowledge and skills in describing the characteristics of a study to determine its magnitude and significance (item 7) (Z = −2.543, p = 0.011). No other significant differences were detected.
The results of the within groups comparison with the Wilcoxon signed-rank test are similar if we exclude the dropouts; therefore, only ITT analysis results are presented.

3.2.2. Qualitative Analysis of Monographs

Based on the experts’ consensus report of each monograph, the analysis of the intervention group monographs showed that the students’ groups clearly defined their review questions and inclusion/exclusion criteria. These groups of students effectively searched for studies using appropriate databases, keywords, Boolean operators, and truncation. Additionally, we found thorough descriptions from students concerning the selection process, data extraction, and data synthesis. However, only three students’ groups provided a good description of the review findings with an appropriate data synthesis as well as a clear answer to the review question in the conclusion section of their monographs. It is noted that the criteria for the results and conclusion sections were more difficult to successfully achieve, even in the intervention group.
The monographs of the control groups showed weaknesses throughout. From the nine monographs of the control group, only two presented the review question in a way that was clearly defined. In all of the monographs, the inclusion/exclusion criteria were either not very informative, unclear, or did not match with the defined review questions. Additionally, the search strategies were not clear and demonstrated limited understanding, such as lack of use of appropriate synonyms, absent truncations, and no definition of the search field for each word or expression to be searched. None of the monographs from the control group reported information about the methods used to study the selection process, to extract data, or to synthesize data. In the conclusion section, students from the control group also demonstrated difficulties in synthesizing the data and limitations by providing a clear answer to the review question.

4. Discussion

This study sought to evaluate the effectiveness of an EBP educational program on undergraduate nursing students’ EBP knowledge and skills. Even though both groups improved after the intervention in EBP knowledge and skills, the study results showed that the improvement was greater in the intervention group. This result was reinforced by the results of the qualitative analysis of monographs.
To the best of our knowledge, this is the first study to use a cognitive and performance assessment instrument (Adapted Fresno Test) with undergraduate nursing students, as suggested by CREATE [24]. Additionally, it is the first study conducted using the EBP education program [25]. Therefore, comparison of our findings with similar studies in terms of the type of assessment instrument and intervention is limited.
However, comparing our study with other previous research using other types of instruments and interventions demonstrates similar results [20,21,22,23]. In a quasi-experimental study [20], it was found that an EBP educational teaching strategy showed positive results in improving EBP knowledge in undergraduate nursing students. A study showed that undergraduate nursing students who received an EBP-focused interactive teaching intervention improved their EBP knowledge [21]. Another study indicated that a 15-week educational intervention in undergraduate nursing students (second- and third-year) significantly improved their EBP knowledge and skills [22]. In addition, a study by Zhang, Zeng, Chen, and Li revealed a significant improvement in undergraduate nursing students’ EBP knowledge after participating in a two-phase intervention: a self-directed learning process and a workshop for critical appraisal of literature [23].
Despite the effectiveness of the program in improving EBP knowledge and skills, the students included in the present study had low levels of EBP knowledge and skills as assessed by the Adapted Fresno Test at the pretest and posttest. These low levels of EBP knowledge and skills, especially at the pretest, might have influenced our study results. As a matter of fact, the Adapted Fresno Test is a demanding test since it requires that students retrieve and apply knowledge while doing a task associated with EBP based on scenarios involving clinical uncertainty. Consequently, this kind of test is very useful to truly assess EBP knowledge retention and abilities in clinical scenarios that do not allow guessing the answers. Notwithstanding, due to these characteristics, the Adapted Fresno Test may possibly be less sensitive when small changes occur or when students have low levels of EBP knowledge and skills. Nevertheless, even using instruments with Likert scales, other studies also showed that students have low levels of EBP knowledge and skills [21,22,23].
The low levels of EBP knowledge and skills of the undergraduate nursing students may be a reflection of a persistent, traditional education with regard to research. By this we mean that the focus of training remains on primary research—preparing students to be “research generators” instead of preparing them to be “evidence users” [32]. Furthermore, the designed and tested intervention used in this study was limited in time (only 17 weeks), was provided by only two instructors, and was delivered to fourth-year undergraduate nursing students, which are limitations for curriculum-wide integration of EBP.
Indeed, a curriculum that promotes EBP should facilitate students’ acquisition of EBP knowledge and skills over time and with levels of increasing complexity through their participation in EBP courses and during their clinical practice experiences [32,33,34,35]. As Moch, Cronje, and Branson suggest, “It is only in such practical settings that students can experience the challenges intrinsic to applying scientific evidence to the care of real patients. In these clinical settings, students can experience both the frustrations and the triumphs inevitable to integrating scientific knowledge into patient care.” [35] (p. 11). Therefore, in future studies, other broad approaches for curriculum-wide integration of EBP as well as its long-term effects should be evaluated.
Previously in the Discussion, we highlighted the limitations of the proposed intervention in terms of time constraints (only 17 weeks), instructors’ constraints (only two instructors provided the intervention), and participants’ constraints (fourth-year undergraduate nursing students). In addition, the study was also restricted to one Portuguese nursing school, which can limit the generalization of the results. However, our study tried to address some of the fragilities identified in other studies [20,21,22,23] on the effectiveness of EBP educational interventions by including a control group and by measuring EBP knowledge and skills with an objective measure and not a self-reported measure.
Bearing this in mind, future studies in multiple sites should assess the long-term effects of the EBP educational intervention and the impact on EBP knowledge and skills of potential variations in contents and teaching methods. In addition, studies using more broad interventions for curriculum-wide integration of EBP should also be performed.

5. Conclusions

Our findings show that the EBP educational program was effective in improving the EBP knowledge and skills of undergraduate nursing students. Therefore, the use of an EBP approach as a complement to the research education of undergraduate nursing students should be promoted by nursing schools and educators. This will help to prepare the future nurses with the EBP knowledge and skills that are essential to overcome the barriers to EBP use in clinical settings, and consequently, to contribute to better health outcomes.

Author Contributions

Conceptualization, D.C., M.A.R., and J.A.; methodology, D.C., M.A.R., and J.A.; validation, D.C., M.A.R., and J.A.; formal analysis, D.C., F.C., and A.F.C.; investigation, D.C., F.C., A.F.C., E.B.-C., L.S., R.R., V.C., D.P., M.-A.R., M.A.R., and J.A.; resources, D.C., M.A.R., and J.A.; data curation, D.C., F.C., and A.F.C.; writing—original draft preparation, D.C.; writing—review and editing, F.C., A.F.C., E.B.-C., L.S., R.R., V.C., D.P., M.-A.R., M.A.R., and J.A.; supervision, M.A.R. and J.A.; project administration, D.C. All authors have read and agreed to the published version of the manuscript.

Funding

This work was funded by National Funds through the FCT—Foundation for Science and Technology, I.P., within the scope of the project Ref. UIDP/00742/2020.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by Ethical Committee of Faculty of Medicine of the University of Coimbra (protocol code: CE-037/2017 and date of approval: 22 May 2017).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available because this issue was not considered within the informed consent signed by the participants of the study.

Acknowledgments

This paper contributed toward the D.C. PhD in Health Sciences—Nursing. The authors gratefully acknowledge the support of the Health Sciences Research Unit: Nursing (UICISA: E), hosted by the Nursing School of Coimbra (ESEnfC) and funded by the Foundation for Science and Technology (FCT). Moreover, the authors gratefully thank Catarina Oliveira for all the support as a Ph.D. supervisor and Isabel Fernandes, Maria da Nazaré Cerejo, and Irma Brito for help and facilitation of data collection.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Pearson, A.; Jordan, Z.; Munn, Z. Translational Science and Evidence-Based Healthcare: A Clarification and Reconceptualization of How Knowledge Is Generated and Used in Healthcare. Nurs. Res. Pract. 2012, 2012. [Google Scholar] [CrossRef] [Green Version]
  2. International Council of Nurses. Closing the Gap: From Evidence to Action; International Council of Nurses: Geneva, Switzerland, 2012; ISBN 978-92-95094-75-8. [Google Scholar]
  3. Institute of Medicine. Leadership Commitments to Improve Value in Health Care: Finding Common Ground: Workshop Summary; National Academies Press: Washington, DC, USA, 2009; ISBN 978-0-309-11053-2. [Google Scholar]
  4. World Health Organization. World Report on Knowledge for Better Health: Strengthening Health Systems; World Health Organization: Geneva, Switzerland, 2004; ISBN 9241562811. [Google Scholar]
  5. World Health Organization. European Strategic Directions for Strengthening Nursing and Midwifery towards Health 2020 Goals; World Health Organization: Copenhagen, Denmark, 2015. [Google Scholar]
  6. Melnyk, B.M.; Gallagher-Ford, L.; Long, L.E.; Fineout-Overholt, E. The establishment of evidence-based practice competencies for practicing registered nurses and advanced practice nurses in real-world clinical settings: Proficiencies to improve healthcare quality, reliability, patient outcomes, and costs. Worldviews Evid. Based Nurs. 2014, 11, 5–15. [Google Scholar] [CrossRef]
  7. Duncombe, D. A multi-institutional study of the perceived barriers and facilitators to implementing evidence-based practice. J. Clin. Nurs. 2018, 27, 1216–1226. [Google Scholar] [CrossRef] [PubMed]
  8. Fink, R.; Thompson, C.J.; Bonnes, D. Overcoming barriers and promoting the use of research in practice. J. Nurs. Adm. 2005, 35, 121–129. [Google Scholar] [CrossRef] [PubMed]
  9. Melnyk, B.M.; Fineout-Overholt, E.; Gallagher-Ford, L.; Kaplan, L. The state of evidence-based practice in US nurses: Critical implications for nurse leaders and educators. J. Nurs. Adm. 2012, 42, 410–417. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  10. Asokan, G. Evidence-based practice curriculum in allied health professions for teaching-research-practice nexus. J. Evid. Based Med. 2012, 5, 226–231. [Google Scholar] [CrossRef] [PubMed]
  11. Black, A.T.; Balneaves, L.G.; Garossino, C.; Puyat, J.H.; Qian, H. Promoting evidence-based practice through a research training program for point-of-care clinicians. J. Nurs. Adm. 2015, 45, 14. [Google Scholar] [CrossRef] [Green Version]
  12. Kalb, K.A.; O’Conner-Von, S.K.; Brockway, C.; Rierson, C.L.; Sendelbach, S. Evidence-based teaching practice in nursing education: Faculty perspectives and practices. Nurs. Educ. Perspect. 2015, 36, 212–219. [Google Scholar] [CrossRef]
  13. Melnyk, B.M. Breaking down Silos and Making Use of the Evidence-Based Practice Competencies in Healthcare and Academic Programs: An Urgent Call to Action. Worldviews Evid. Based Nurs. 2018, 15, 3–4. [Google Scholar] [CrossRef]
  14. Melnyk, B.M.; Fineout-Overholt, E.; Feinstein, N.F.; Sadler, L.S.; Green-Hernandez, C. Nurse practitioner educators’ perceived knowledge, beliefs, and teaching strategies regarding evidence-based practice: Implications for accelerating the integration of evidence-based practice into graduate programs. J. Prof. Nurs. 2008, 24, 7–13. [Google Scholar] [CrossRef]
  15. Mohsen, M.M.; Safaan, N.A.; Okby, O.M. Nurses’ Perceptions and Barriers for Adoption of Evidence Based Practice in Primary Care: Bridging the Gap. Am. J. Nurs. Res. 2016, 4, 25–33. [Google Scholar] [CrossRef]
  16. Dawes, M.; Summerskill, W.; Glasziou, P.; Cartabellotta, A.; Martin, J.; Hopayian, K.; Porzsolt, F.; Burls, A.; Osborne, J. Sicily statement on evidence-based practice. BMC Med. Educ. 2005, 5, 1. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Al Furaikh, S.; Al Omairi, B.; Ganapathy, T. A cross-sectional survey on nursing students’ attitude towards research. J. Health Spec. 2017, 5, 185–191. [Google Scholar] [CrossRef]
  18. Burkhart, P.V.; Hall, L.A. Developing the next generation of nurse scientists. Nurse Educ. 2015, 40, 160–162. [Google Scholar] [CrossRef]
  19. Halcomb, E.J.; Peters, K. Nursing student feedback on undergraduate research education: Implications for teaching and learning. Contemp. Nurse 2009, 33, 59–68. [Google Scholar] [CrossRef]
  20. Ashktorab, T.; Pashaeypoor, S.; Rassouli, M.; Alavi-Majd, H. The Effectiveness of Evidence Based Practice Education in Nursing Students Based on Rogers’s Diffusion of Innovation Model. Middle East. J. Sci. Res. 2013, 16, 684–691. [Google Scholar]
  21. Kim, S.C.; Brown, C.E.; Fields, W.; Stichler, J.F. Evidence-based practice-focused interactive teaching strategy: A controlled study. J. Adv. Nurs. 2009, 65, 1218–1227. [Google Scholar] [CrossRef]
  22. Ruzafa-Martínez, M.; López-Iborra, L.; Armero Barranco, D.; Ramos-Morcillo, A.J. Effectiveness of an evidence-based practice (EBP) course on the EBP competence of undergraduate nursing students: A quasi-experimental study. Nurse Educ. Today 2016, 38, 82–87. [Google Scholar] [CrossRef]
  23. Zhang, Q.; Zeng, T.; Chen, Y.; Li, X. Assisting undergraduate nursing students to learn evidence-based practice through self-directed learning and workshop strategies during clinical practicum. Nurse Educ. Today 2012, 32, 570–575. [Google Scholar] [CrossRef]
  24. Tilson, J.K.; Kaplan, S.L.; Harris, J.L.; Hutchinson, A.; Ilic, D.; Niederman, R.; Potomkova, J.; Zwolsman, S.E. Sicily statement on classification and development of evidence-based practice learning assessment tools. BMC Med. Educ. 2011, 11. [Google Scholar] [CrossRef] [Green Version]
  25. Cardoso, D.; Rodrigues, M.A.; Apóstolo, J. Evidence-based practice educational program: A Portuguese experience with undergraduate nursing students. Int. J. Evid. Based Healthc. 2019, 17, S72–S74. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Cohen, J. Statistical Power Analysis for the Behavioral Sciences, 2nd ed.; Lawrence Erlbaum Associates: Hillsdale, MI, USA, 1988. [Google Scholar]
  27. Haahr, M. RANDOM.ORG: True Random Number Service. Available online: https://www.random.org (accessed on 12 April 2019).
  28. Cardoso, D.; Couto, F.; Cardoso, A.F.; Louçano, C.; Rodrigues, M.; Pereira, R.; Parola, V.; Coelho, A.; Ferraz, L.; Pinto, D.; et al. Fresno test to measure evidence-based practice knowledge and skills for Portuguese undergraduate nursing students: A translation and adaptation study. Nurse Educ. Today 2020. [Google Scholar] [CrossRef]
  29. Ramos, K.D.; Schafer, S.; Tracz, S.M. Validation of the Fresno test of competence in evidence based medicine. BMJ 2003, 326, 319–321. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  30. Tabachnick, B.G.; Fidell, L.S. Using Multivariate Statistics; Pearson Education: Boston, MA, USA, 2013. [Google Scholar]
  31. Gupta, S.K. Intention-to-treat concept: A review. Perspect. Clin. Res. 2011, 2, 109–112. [Google Scholar] [CrossRef] [PubMed]
  32. Fineout-Overholt, E.; Stillwell, S.B.; Williamson, K.M.; Cox III, J.F.; Robbins, B.W. Teaching Evidence-Based Practice in Academic Settings. In Evidence-Based Practice in Nursing & Healthcare: A Guide to Best Practice, 3rd ed.; Melnyk, B., Fineout-Overholt, E., Eds.; Lippincott, Williams & Wilkins: Philadelphia, PA, USA, 2015. [Google Scholar]
  33. Bloom, K.C.; Olinzock, B.J.; Radjenovic, D.; Trice, L.B. Leveling EBP content for undergraduate nursing students. J. Prof. Nurs. 2013, 29, 217–224. [Google Scholar] [CrossRef]
  34. Melnyk, B.M. Educational Programming in Undergraduate and Graduate Academic Curricula: Friend or Foe to Accelerating Evidence-Based Practice? Worldviews Evid. Based Nurs. 2013, 10, 185–186. [Google Scholar] [CrossRef]
  35. Moch, S.D.; Cronje, R.J.; Branson, J. Undergraduate Nursing Evidence-Based Practice Education: Envisioning the Role of Students. J. Prof. Nurs. 2010, 26, 5–13. [Google Scholar] [CrossRef]
Ijerph 18 00293 g001 550
Figure 1. Consolidated Standards of Reporting Trials (CONSORT) diagram showing the flow of participants through each stage of the trial. ITT: intention-to-treat.
Figure 1. Consolidated Standards of Reporting Trials (CONSORT) diagram showing the flow of participants through each stage of the trial. ITT: intention-to-treat.
Ijerph 18 00293 g001
Table
Table 1. Socio-demographic characterization of the sample—ITT analysis.
Table 1. Socio-demographic characterization of the sample—ITT analysis.
TotalIntervention GroupControl Group
(n = 148)(n = 74)(n = 74)
Mean ± SDMean ± SDMean ± SDIndependent t-testp-Value *
(Min–Max)(Min–Max)(Min–Max)
Age in years21.95 ± 2.2522.20 ± 2.84 21.70 ± 1.42 1.3530.178
(21–41)(21–41)(21–31)
n (%)n (%)n (%)X2p-Value *
Female118 (79.7)63 (85.1)55 (74.3)2.6760.102
Male30 (20.3)11 (14.9)19 (25.7)
Education 0.9930.609
12th grade 144 (97.3)72 (97.3)72 (97.3)
Graduation2 (1.4)1 (1.4)1 (1.4)
Master1 (0.7)1 (1.4)-
Missing1 (0.7)-1 (1.4)
EBP training * 0.2210.638
Yes121 (81.8)59 (79.7)62 (83.8)
No26 (17.6)14 (18.9)12 (16.2)
Missing1 (0.7)1 (1.4)-
* Defined as any kind and duration of evidence-based practice (EBP) training, such as EBP contents in a course, a workshop, a seminar.
Table
Table 2. Main effects of time and group and interaction effects on EBP knowledge and skills—ITT analysis.
Table 2. Main effects of time and group and interaction effects on EBP knowledge and skills—ITT analysis.
Outcome MeasureEffectsFp-ValuePartial Eta2
EBP knowledge and skills assessed by Adapted Fresno TestTime × Group9.5500.0020.061
Table
Table 3. Repeated measures ANOVA and between-subjects ANOVA—ITT analysis.
Table 3. Repeated measures ANOVA and between-subjects ANOVA—ITT analysis.
BaselinePost-Test
Mean ± SDMean ± SDRepeated Measures ANOVAp
EBP knowledge and skills assessed by Adapted Fresno Testintervention group (n = 74)6.85 ± 5.1612.47 ± 7.2153.028<0.001
Control group (n = 74)7.26 ± 5.349.73 ± 5.5613.832<0.001
Between-subjects ANOVA 0.2216.720
p 0.6390.011
Table
Table 4. Within groups comparison with Wilcoxon signed-rank test for each item of the Adapted Fresno Test—ITT analysis.
Table 4. Within groups comparison with Wilcoxon signed-rank test for each item of the Adapted Fresno Test—ITT analysis.
Intervention Group (n = 74)Control Group (n = 74)
StatusnZpStatusnZp
Item 1Improved43−4.572<0.000Improved29−2.3380.019
Decreased13Decreased16
Maintained18Maintained29
Item 2Improved20−1.4980.134Improved24−0.3710.711
Decreased32Decreased19
Maintained22Maintained31
Item 3Improved49−4.740<0.000Improved41−4.757<0.000
Decreased14Decreased10
Maintained11Maintained23
Item 4Improved43−4.508<.000Improved33−3.738<.000
Decreased8Decreased10
Maintained23Maintained31
Item 5Improved9−2.6990.007Improved6−1.9800.048
Decreased0Decreased1
Maintained65Maintained67
Item 6Improved12−1.2360.216Improved4−2.7140.007
Decreased9Decreased15
Maintained53Maintained55
Item 7Improved11−2.5430.011Improved8−1.9410.052
Decreased2Decreased2
Maintained61Maintained64
Item 8Improved1−0.5770.564Improved2−1.1340.257
Decreased2Decreased5
Maintained71Maintained67
Item 9Improved4−0.3780.705Improved50.0001.000
Decreased3Decreased5
Maintained67Maintained64
Total Adapted Fresno TestImproved54–5.7800.000Improved45−3.3540.001
Decreased13Decreased17
Maintained7Maintained12
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Cardoso, D.; Couto, F.; Cardoso, A.F.; Bobrowicz-Campos, E.; Santos, L.; Rodrigues, R.; Coutinho, V.; Pinto, D.; Ramis, M.-A.; Rodrigues, M.A.; et al. The Effectiveness of an Evidence-Based Practice (EBP) Educational Program on Undergraduate Nursing Students’ EBP Knowledge and Skills: A Cluster Randomized Control Trial. Int. J. Environ. Res. Public Health 2021, 18, 293. https://doi.org/10.3390/ijerph18010293

AMA Style

Cardoso D, Couto F, Cardoso AF, Bobrowicz-Campos E, Santos L, Rodrigues R, Coutinho V, Pinto D, Ramis M-A, Rodrigues MA, et al. The Effectiveness of an Evidence-Based Practice (EBP) Educational Program on Undergraduate Nursing Students’ EBP Knowledge and Skills: A Cluster Randomized Control Trial. International Journal of Environmental Research and Public Health. 2021; 18(1):293. https://doi.org/10.3390/ijerph18010293

Chicago/Turabian Style

Cardoso, Daniela, Filipa Couto, Ana Filipa Cardoso, Elzbieta Bobrowicz-Campos, Luísa Santos, Rogério Rodrigues, Verónica Coutinho, Daniela Pinto, Mary-Anne Ramis, Manuel Alves Rodrigues, and et al. 2021. "The Effectiveness of an Evidence-Based Practice (EBP) Educational Program on Undergraduate Nursing Students’ EBP Knowledge and Skills: A Cluster Randomized Control Trial" International Journal of Environmental Research and Public Health 18, no. 1: 293. https://doi.org/10.3390/ijerph18010293

APA Style

Cardoso, D., Couto, F., Cardoso, A. F., Bobrowicz-Campos, E., Santos, L., Rodrigues, R., Coutinho, V., Pinto, D., Ramis, M.-A., Rodrigues, M. A., & Apóstolo, J. (2021). The Effectiveness of an Evidence-Based Practice (EBP) Educational Program on Undergraduate Nursing Students’ EBP Knowledge and Skills: A Cluster Randomized Control Trial. International Journal of Environmental Research and Public Health, 18(1), 293. https://doi.org/10.3390/ijerph18010293

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop