Next Article in Journal
Lung Support Service: Implementation of a Nationwide Text Message Support Program for People with Chronic Respiratory Disease during the COVID-19 Pandemic
Next Article in Special Issue
Alteration of Cell Membrane Permeability by Cetyltrimethylammonium Chloride Induces Cell Death in Clinically Important Candida Species
Previous Article in Journal
Psychometric Validation of the Indonesian Version of Children’s Revised Impact of Event Scale 13
Previous Article in Special Issue
Pulsed-Xenon Ultraviolet Light Highly Inactivates Human Coronaviruses on Solid Surfaces, Particularly SARS-CoV-2
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Systematic Review

Effectiveness of Infection Control Teams in Reducing Healthcare-Associated Infections: A Systematic Review and Meta-Analysis

1
Bureau of International Health Cooperation, National Center for Global Health and Medicine, Tokyo 162-8655, Japan
2
Center for Surveillance, Immunization, and Epidemiologic Research, National Institute of Infectious Diseases, Tokyo 162-8640, Japan
3
Center for Evidence-Based Medicine and Clinical Research, Dhaka 1230, Bangladesh
4
Global Health Nursing, Graduate School of Nursing Sciences, St. Luke’s International University, Tokyo 104-0044, Japan
5
Tokyo Foundation for Policy Research, Minato, Tokyo 106-0032, Japan
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(24), 17075; https://doi.org/10.3390/ijerph192417075
Submission received: 17 November 2022 / Revised: 11 December 2022 / Accepted: 15 December 2022 / Published: 19 December 2022
(This article belongs to the Special Issue New Advances in Infection Control Research)

Abstract

:
The infection control team (ICT) ensures the implementation of infection control guidelines in healthcare facilities. This systematic review aims to evaluate the effectiveness of ICT, with or without an infection control link nurse (ICLN) system, in reducing healthcare-associated infections (HCAIs). We searched four databases to identify randomised controlled trials (RCTs) in inpatient, outpatient and long-term care facilities. We judged the quality of the studies, conducted meta-analyses whenever interventions and outcome measures were comparable in at least two studies, and assessed the certainty of evidence. Nine RCTs were included; all were rated as being low quality. Overall, ICT, with or without an ICLN system, did not reduce the incidence rate of HCAIs [risk ratio (RR) = 0.65, 95% confidence interval (CI): 0.45–1.07], death due to HCAIs (RR = 0.32, 95% CI: 0.04–2.69) and length of hospital stay (42 days vs. 45 days, p = 0.52). However, ICT with an ICLN system improved nurses’ compliance with infection control practices (RR = 1.17, 95% CI: 1.00–1.38). Due to the high level of bias, inconsistency and imprecision, these findings should be considered with caution. High-quality studies using similar outcome measures are needed to demonstrate the effectiveness and cost-effectiveness of ICT.

1. Introduction

Healthcare-associated infections (HCAIs) are infections acquired by patients while receiving care for other illnesses from hospitals, acute care clinics, community health centres or care homes [1]. HCAIs are common in acute care hospitals, affecting 7–10% of patients globally [2]. They also occur in different types of care settings, such as outpatient clinics, ambulatory surgical centres, outpatient dialysis facilities and long-term care facilities (nursing homes and rehabilitation facilities) [3].
Up to 70% of HCAIs are preventable [4,5,6]. In hospitals, infection control departments with dedicated personnel are an important feature of HCAI prevention [7]. To prevent HCAIs, infection control guidelines need to be implemented, which is usually the task of the infection control team (ICT) [8]. An ICT plays important roles in different aspects of infection control, such as (1) developing and disseminating guidelines and policies, (2) coordinating continuous education and training, (3) establishing systems for the surveillance of HCAIs, (4) monitoring and auditing the practices and standards of care and (5) building effective links with other staff and departments [2,9].
The core members of ICT are doctors, epidemiologists, microbiologists and nurses, known as infection control nurses (ICNs). At present, the ICT system has expanded to include new roles, such as infection control link nurses (ICLNs) and infection control champions. ICLNs and infection control champions are ward-based staff working under the supervision of ICNs [10] and acting as a link between their own clinical wards and the ICT [9]. The ICT and ICLN system are also applied in nursing homes [11,12,13,14,15].
ICT was established in the United Kingdom in 1950s and ICLN system was first introduced in 1990s. To date, previous reviews have also reported on ICT work practices [9], concept of the ICLN system [16] and facilitators and barriers in the ICLN system implementation [17]. However, an initial search for literature on infection control revealed the paucity of systematic reviews on the efficacy of ICT, with or without ICLN system, in inpatient hospitals and outpatient and long-term care facilities. In this systematic review, we therefore aimed to evaluate its effectiveness, with or without the ICLN systems, in reducing the rate of HCAIs in inpatient hospitals and outpatient and long-term care facilities.

2. Materials and Methods

2.1. Protocol and Registration

We registered the review protocol in the International Prospective Register of Systematic Reviews (PROSPERO) (registration number: CRD42020172173) and published it in BMJ Open [18]. This review adheres to the Preferred Reporting Items for Systematic Reviews and Meta-analysis (PRISMA) statement [19] (Supplementary Material Table S1).

2.2. Eligibility Criteria

Randomised controlled trials (RCTs) that compared an ICT, with or without the ICLN system, with any other intervention or no intervention were eligible (Supplementary Material Table S2). We included studies on patients of all ages in inpatient hospitals and outpatient facilities, and residents in long-term care facilities to examine the patient-based outcomes as well as any type of healthcare professional (doctors, nurses and nursing home staff) to examine their behavioural outcomes. In this review, ICT is defined as a team composed of medical and nursing staff certified infection prevention and control or its equivalent [2]. The primary and secondary outcomes of this review are as follows:

2.3. Primary Outcome

2.3.1. Patient-Based Outcomes

  • Incidence rate of HCAIs (for the incidence rate of HCAIs, we did not restrict the types of HCAIs or the timing of outcome assessment. The incidence rate refers to the number of infection episodes per 1000 days or the number of infected patients per total number of patients during the study period).
  • Death due to HCAIs (the rate of death due to HCAIs refers to the number of patients who died with HCAIs per total number of patients with HCAIs).
  • Length of hospital stays presented in days.

2.3.2. Staff-Based/Behavioural Outcomes

Compliance with infection control practices as measured by study authors.

2.4. Secondary Outcome

Cost related to HCAIs.

2.5. Search Strategies

We searched four electronic databases, namely PubMed, EMBASE, CINAHL and Cochrane Central Register of Controlled Trials (CENTRAL), from inception to May 2020. The search strategy is presented in the protocol [18] and Supplementary Material Table S3). We imported the output of four databases to the EndNote reference management software [20]. Duplicate studies were removed, and the remaining ones were imported to the online reference management software, Covidence (Covidence systematic review [software], Veritas Health Innovation, Melbourne, Australia; available at www.covidence.org, accessed on 28 September 2020) for the study selection.

2.6. Study Selection

Five pairs of authors (MMT, MOR, RH, SM, SO, JM, YY, CM, MN and TB) independently performed screening of titles and abstracts for potential eligibility. Disagreements were resolved through discussions. Then, pairs of authors (MMT, MOR, RH, SO, JM, YY and CM) independently evaluated the full texts and selected the studies by applying the eligibility criteria (Supplementary Material Table S2). Disagreements were settled by discussions or involvement of the third author (TB). In the published protocol of this review, we described that we would exclude the study if the study outcomes were hand hygiene compliance or antimicrobial prescription. However, we decided to update the protocol and included the studies reporting hand hygiene among others, considering that if we strictly follow the original exclusion criteria, we will have to exclude studies that report our primary or secondary outcomes.

2.7. Data Extraction

The first author (MMT) prepared a standardised data extraction form and piloted the form using at least one related study, and two authors (MOR and RH) reviewed it. For each study, the following data were extracted: study author (first author only), year of publication, study design, setting, country, characteristics and number of participants, details of intervention and control, types of outcome measures and study results. The data was independently extracted by two of the authors (MMT, MOR or RH), and discrepancies between the authors were resolved through discussions.

2.8. Risk-of-Bias Assessment

Two of the three authors (MMT, MOR or RH) independently evaluated the risk of bias of each included study using the Cochrane risk-of-bias tool [21]. This tool addresses random sequence generation, allocation concealment, blinding of participants and personnel, blinding of outcome assessment, incomplete outcome data, selective reporting and other bias. Each domain was rated as low, high or unclear risk of bias. Any discrepancies were resolved through discussions.

2.9. Data Analysis

We conducted meta-analyses when two or more studies investigated a comparable intervention and outcome. We entered the raw data in RevMan 5.4 to pool the results and employed random-effect meta-analysis as most ICTs can be considered complex interventions [22]. We used the risk ratio (RR) for dichotomous data and the mean differences for continuous data with corresponding 95% confidence intervals (CI). We employed the I2 statistic to measure the heterogeneity among the included studies and interpreted the results in accordance with the definitions in the Cochrane Handbook for Systematic Reviews of Interventions [23]. Furthermore, we reported the results narratively when there were an insufficient number of studies for data to be pooled.
According to our protocol, we conducted subgroup analysis by categories of intervention by ICT (performing surveillance of HCAIs, educating healthcare professional and monitoring infection control practices). However, we could not conduct subgroup analysis by type of healthcare facilities (hospital, nursing homes, or others) due to an insufficient number of studies. We planned to conduct sensitivity analysis on primary outcomes by excluding trials with a high risk of bias. However, all the studies had a high risk of bias, so we did not conduct any sensitivity analysis.
We used the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach to evaluate the certainty of evidence for three outcomes: incidence rate of HCAIs, death due to HCAIs and compliance with infection control practices [24]. The GRADE approach has five domains (risk of bias, imprecision, inconsistency, indirectness and publication bias) to rate the certainty of evidence as very low, low, moderate and high. We were not able to evaluate publication bias through funnel plot as there were an insufficient number of studies for this assessment. We used the GRADEpro web-based platform to make a ‘Summary of Findings’ table, considering the certainty of evidence (GRADEpro GDT: GRADEpro Guideline Development Tool [Software]. McMaster University and Evidence Prime, 2022, available at www.gradepro.org, accessed on 31 May 2022).

3. Results

3.1. Results of the Search

In total, 12,666 studies were identified from the four databases. After removing duplicates, 11,719 titles and abstracts were screened. The screening excluded a large number of studies (n = 11,676). A total of 43 studies were assessed using the full text. Finally, 35 studies were excluded due to inappropriate study design, intervention or outcome and lack of full text (conference abstract and protocol). Nine studies were included in this review (Figure 1) [25,26,27,28,29,30,31,32,33].

3.2. Characteristics of the Included Studies

The characteristics of the included studies are presented in Table 1. The included studies were published between 1990 and 2020 and were cluster-randomised controlled trials. The number of clusters was small, ranging from 6 to 45. The clusters were hospital wards, outpatient long-term haemodialysis units, or nursing homes. Five studies were conducted in inpatient hospitals, one in outpatient long-term haemodialysis units and three in nursing homes. Three studies were from the USA; two from Hong Kong and one each from England, Ireland, Italy and Thailand. The study duration varied from 5 weeks to 20 months.

3.2.1. Participants

The participants in the included studies were patients, residents and healthcare personnel (nurses and nursing staff). The number of patients or residents was reported in four studies: 2085 patients in hospitals and outpatient long-term haemodialysis units and 1743 residents in nursing homes. The number of healthcare personnel targeted by the intervention was reported in five studies: 1508 nurses and 333 nursing home staff. In the inpatient hospital setting, the participants were nurses in three studies, patients in one study and both of them in one study. In the outpatient haemodialysis unit setting, the participants were patients. In the nursing home setting, the participants were residents in one study and both residents and nursing home staff in two studies.

3.2.2. Description of Interventions

Four studies investigated the effect of ICT without ICLN system [28,29,31,32], whereas the other five studies examined the effect of ICT with ICLN system ([25,26,27,30,33] (Appendix A Table A1). The members of ICT in the included studies were infection control doctors, ICNs, nephrologists, dialysis staff, surgical intensive care unit (ICU) co-directors, ICU physicians, nurses and infection control practitioners. The ICLN system was implemented, with selection of nurses or staff as link nurses, opinion leaders, or champions. The ICTs in the included studies performed the following infection control measures: developing and disseminating guidelines and policies [26,33], coordinating continuous education and training [25,26,27,29,30,32,33], performing surveillance of HCAIs [28,31], monitoring and auditing the practices [26,27,29,30,32,33] and standards of care and building effective links with other staff and departments [25,26,27,30,33].

3.2.3. Control

Of the included studies, five had a usual care control, two had lecture control and two had no intervention as a control (Appendix A Table A1).

3.2.4. Outcomes

Two studies reported patient-based outcomes; four studies, staff-based outcomes; and three studies, both outcomes (Appendix A Table A1). For patient-based outcomes, the incidence rate of HCAIs was evaluated in five studies [25,28,29,30,31], death due to HCAIs in two studies [28,31] and the length of hospital stay in one study [28]. For staff-based outcomes, nurses’ compliance with infection control practices [26,29,33], changes in infection control scores [25,27,33] and proportion of compliance with infection control guidelines at the facility level [30,32] were measured and reported. Only one study reported the cost related to HCAIs [28].

3.2.5. Funding Sources

Six studies reported being funded, and out of those six, three did not declare the funding sources.

3.3. Risk of Bias

The overall risk-of-bias assessment is presented in Figure 2 and Figure 3. All studies were judged as having a high risk of bias due to one of the four reasons: (1) the participants and personnel were not blinded, (2) the outcome assessment was not blinded, (3) the outcome data were incomplete and (4) there was a significant imbalance between the intervention and control clusters at baseline. Blinding is inherently difficult with ICT interventions as the intervention can be easily identified by ICT members or the participants.

3.4. Effectiveness of Interventions

The summary of findings is presented in Table 2.

3.4.1. Primary Outcomes

Patient-Based Outcomes

  • Incidence Rate of HCAIs
Five studies evaluated the incidence rate of HCAIs [25,28,29,30,31]. Three studies that reported the number of patients/residents with HCAIs were included in the meta-analysis (Figure 4). Overall, the ICT with or without ICLNs had no significant effect on the incidence rate reduction of HCAIs (RR = 0.65, 95% CI: 0.45–1.07, very low certainty of evidence). We conducted a subgroup analysis by dividing the studies according to the categories of intervention by ICT: (1) surveillance of HCAIs [28,31] and (2) continuous education and monitoring of infection control practices [25]. The subgroup analysis did not exhibit any significance in the test for subgroup differences (Group 1.1.1: RR = 0.52, 95% CI: 0.30–0.88, Group 1.1.2: RR = 0.98, 95% CI: 0.67–1.41, p = 0.06) (Figure 4).
Two studies reported the mean HCAI rate [29,30]. We could not conduct a meta-analysis due to the unavailability of the number of participants in the study conducted in hospitals in USA [29]. The authors in that study reported significant reduction in the mean HCAI rate in the intervention groups compared to the control groups (adjusted incidence rate ratio = 0.19, 95% CI: 0.06–0.57). Another study conducted in nursing homes in USA reported no significant reduction in the mean HCAI rate in the intervention groups compared to the control groups (relative difference = −6.7, 95% CI: −36.2–36.4) [30].
2.
Death Due to HCAIs
Two studies reported death due to HCAIs [28,31]. The meta-analysis (Figure 5) revealed no significant effect of the ICT intervention on death due to HCAIs (RR = 0.32, 95% CI: 0.04–2.69, very low certainty of evidence).
3.
Length of Hospital Stay
One study reported this outcome [28]. The result of this study indicated no significant difference in the length of hospital stay between the intervention and control groups (42 days vs. 45 days, p = 0.52).

Staff-Based/Behavioural Outcomes

The included studies reported compliance in three different outcome measurements.
  • Proportion of Compliance with Infection Control Practices
Three studies evaluated the proportion of compliance with infection control practices among nurses or staff. One study [29] could not be included in the meta-analysis as it insufficiently reported its outcome by providing only the figure without any numerical data. In that study, the infection control practices were increased in both the intervention and control groups over time [29]. The meta-analysis of two studies (Figure 6) revealed a significant effect (RR = 1.17, 95% CI: 1.00–1.38, moderate certainty of evidence) [26,33].
2.
Changes in the Infection Control Compliance Score
Three studies evaluated the changes in the infection control compliance scores. One study conducted in the nursing homes reported that the mean infection control audit score was significantly higher in the intervention group than in the control group at 12 months (82% vs. 64%, p < 0.001) [25]. One study conducted in the hospital reported a significant increase in the self-reported compliance with standard precaution scores (15.43 vs. 14.32, p = 0.024) [27]. One study conducted in the hospital reported the change in the mean infection control practice scores, suggesting that the ICT with ICLNs was superior to the control (5.63 in the intervention group with lectures and demonstration, 4.96 in the intervention group with demonstration vs. 3.29 in the control, p < 0.05 in both comparisons) [33].
3.
Proportion of Compliance with Infection Control Guidelines at the Facility Level
Two studies conducted in the nursing homes reported the compliance with infection control guidelines at the facility level. One randomised pair-matched pilot study reported the compliance at the facility level in two outcomes: weekly surface swab bacterial counts and hand-washing occasions per resident/week [30]. The two outcomes were found to be improved in the intervention in nursing homes compared with the control. One cluster-RCT reported on hand hygiene facilities, environmental cleanliness and safe disposal of clinical waste [32]. No statically significant difference was observed between the intervention and control groups.

3.4.2. Secondary Outcomes

Cost Related to HCAIs

Only one study reported cost related to HCAIs [28]. The result of this study indicated significant difference in the cost for the treatment of HCAIs between the intervention and control groups (USD 337.3 vs. USD 516.6, p = 0.01).

4. Discussion

4.1. Main Findings

This systematic review synthesised the effectiveness of the ICT, with or without ICLN system, in inpatient hospital, outpatient long-term haemodialysis unit and nursing home settings. Nine cluster-RCTs included in this review tested five different types of infection control measures performed by the ICT with or without ICLN system: formulating and revising guidelines, performing surveillance of HCAIs, training and educating healthcare professionals/staff, monitoring and auditing practices and standard of care and liaising with other staff and departments. The control groups received usual care, lecture only, or no intervention. All the included studies were rated as having high risk of bias. Overall, we found no significant evidence suggesting that the ICT, with or without ICLN system, compared with the control is effective in reducing the incidence of HCAIs (very low certainty of evidence), or death due to HCAIs (very low certainty of evidence). However, we found significant evidence suggesting that the ICT with ICLN system compared with the control is effective in improving nurses’ compliance with infection control practices (moderate certainty of evidence). We were unable to conduct a meta-analysis for two outcomes, length of hospital stay and cost related to HCAIs, due to the heterogeneity of outcome measures and only one study evaluating the outcome, respectively.
Here are the possible reasons for the failure of ICT in reducing the incidence rate of HCAIs in the studies included in this review. The first reason could be the lack of surveillance for infection by ICT. Among the categories of intervention by ICT, surveillance could be a key category for prevention of infections or outbreak. Hence, surveillance used to be the primary task of infection preventionists [34,35]. The scope of surveillance depends on the type of facility and resources available; thus, each ICT should perform surveillance appropriate to its facility and resources. Second, ICT in nursing homes could face more challenges due to the fact that the nursing home setting is not a closed system [25]. The unrecognised reservoirs of infection, either residents or staff, may have remained undetected during the study due to non-participation and they may limit the success of ICT intervention in reducing the infections. Decolonisation of colonised patients and healthcare workers may be an additional effective measure to reduce HCAIs.

4.2. Agreements and Disagreements with Other Reviews

To the best of our knowledge, this is the first systematic review of RCTs that investigated the effectiveness of the interventions performed by the ICT, with or without ICLN system, in preventing HCAIs. Previous Cochrane reviews on professional adherence to infection control guidelines, adherence to standard precautions and infection control strategies for methicillin-resistant Staphylococcus aureus found that education alone or with other supportive interventions (employing specialised infection control personnel) may improve professional adherence to infection control guidelines [36,37,38]. We included six additional RCTs not included in the above Cochrane reviews [27,28,29,30,31,33] and excluded some studies included in the Cochrane reviews as they were not RCTs.
Another systematic review including one of our nine RCTs reported that multidisciplinary intervention, including education by the ICT, is effective in improving compliance with infection control practices among healthcare workers [39]. One systematic review by Aboelela et al. reported that educational programmes and establishment of a multidisciplinary team may be effective strategies in reducing HCAIs; however, the effects of interventions on healthcare workers’ compliance with infection control practices were mixed [40]. These findings were based on the non-randomised intervention (pre–post comparison) studies that achieved quality scores of 80% or higher.

4.3. Implications for Policy

ICT in inpatient setting is already recommended in many countries [41] although it may not be the case for an ICLN system. Our review showed that ICT with an ICLN system, improved nurses’ compliance with infection control practices although it does not offer any implication on the effect of ICT without an ICLN system on nurses’ compliance with infection control practices or its comparative effectiveness.
Certain barriers to the improvement of compliance with infection control practices may stand in the way of the successful implementation of ICT, such as workload, lack of manpower and insufficient time and budget as suggested by Alhumaid et.al. [42]. This highlights the need for the support of the government and leadership of the directors of healthcare facilities or legislation.

4.4. Implications for Research

This systematic review proves the need for higher-quality studies in the research on ICT. WHO strongly recommended that infection control program with a dedicated and trained team should be in place in acute health care facilities for the prevention of HCAIs. However, this recommendation was based on limited published evidence, only two studies [43]. This shows that the effectiveness of ICT in reducing HCAIs has not been well evaluated; thus, it is advisable to conduct more studies to provide robust insights, especially in the current COVID-19 era. In the future update of this review, it may be possible to evaluate the effects of ICT on the outbreak response during the COVID-19 pandemic. A head-to-head RCT of ICT with an ICLN system and ICT without an ICLN system should ideally be conducted to answer the question on whether an ICLN system is an indispensable component of an effective ICT.
Future studies should include both patient-based clinical outcomes (such as incidence rate of HCAIs, death due to HCAIs and length of hospital stay) and staff-based outcomes to obtain a full picture of the effectiveness of ICT. For the staff-based outcome, a better reporting of compliance of infection control practices should be applied. Only two or three studies were included in the meta-analysis of each outcome due to variation in the outcome measures or inadequate outcome data. Future studies should employ similar outcome measures to allow comparison across studies and pooling of results to provide strong evidence.
Previous studies reported that nurses’ compliance with infection control practices can help reduce the rate of HCAIs [44,45,46]. A clear link between ICT and improvement of compliance has been proven by our analysis; however, there is no clear evidence to link the improvement of compliance ICT to HCAI reduction. Further analysis is warranted to evaluate a causal relationship between improvement of compliance and subsequent reduction in HCAIs.

4.5. Strengths and Limitations

The strengths of our review are the comprehensive literature searches, rigorous methodology (assessment of eligibility, data extraction and assessment of risk of bias independently) and use of the GRADE approach in rating the certainty of evidence for each outcome. However, this review has some limitations. First, the detailed information of each ICT could not be obtained from the included studies, such as how the ICT was developed and the members of ICT were selected in each included study. Second, the interventions and outcome measurements were heterogeneous. There were differences in the format, structure and length of interventions delivered by the ICT and ICLNs. A high variability in outcome measurement rendered pooling of the result data inappropriate. Third, the certainty of evidence was very low as a consequence of high risk of bias, heterogeneity across the studies and imprecision of the meta-analyses results. Fourth, we restricted this review to RCTs, and found only a small number of heterogeneous studies with low-quality evidence. Fifth limitation is the old publication year of some of the studies that may not reflect the current infection control resources or the challenges.

5. Conclusions

There is a dearth of evidence for the effect of ICT, with or without ICLN system, in inpatient hospitals and outpatient and long-term care facilities. We did not observe any statistically significant evidence of ICT in reducing the incidence rate of HCAIs, death due to HCAIs and length of hospital stay; however, ICT with ICLN system likely improves nurses’ compliance with infection control practices. Due to the high level of bias, inconsistency and imprecision, these findings should be considered with caution. High-quality studies using similar outcome measures are needed to demonstrate the effectiveness and cost-effectiveness of ICT in the healthcare settings.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/ijerph192417075/s1, Table S1: PRISMA 2020 checklist; Table S2: Eligibility criteria; Table S3: Search strategy.

Author Contributions

Conceptualisation, M.M.T., S.M., T.B. and E.O.; methodology, M.M.T., S.M., T.B. and M.O.R.; investigation, M.M.T., M.O.R., R.H., S.M., S.O., J.M., Y.Y., C.M., M.N. and T.B.; formal analysis, M.M.T. and M.O.R.; validation, E.O.; visualisation, M.M.T. and M.O.R.; writing—original draft preparation, M.M.T.; writing—review and editing, M.M.T., M.O.R., R.H., S.M., S.O., J.M., Y.Y., C.M., M.N. and T.B.; supervision, E.O.; project administration, M.M.T.; funding acquisition, S.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by JSPS KAKENHI Grant Number JP 21K17320. The funding body played no role in developing the study nor in writing the manuscript.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The authors would like to acknowledge the critical input and support of the technical staff from the Bureau of International Health Cooperation, National Center for Global Health and Medicine, Japan and financial support from JSPS KAKENHI Grant Number JP 21K17320.

Conflicts of Interest

The authors declare no conflict of interest. The institution which employs M.M.T., R.H., S.M., S.O., J.M., Y.Y., C.M., M.N. and T.B. received funding from NIPRO pharmaceuticals (manufacturer of generic antimicrobial interventions) for consultation for tuberculosis diagnostic development. None of the authors of this review were involved in the consultation. None of the authors have access to or control of NIPRO funds. The same institution also received a fee from Japan International Cooperation Agency (JICA) to provide trainings on infection control in low-and middle-income countries. NIPRO and JICA have had no input into the design, execution, interpretation, or writing of this review.

Appendix A

Table A1. Description of interventions and outcomes in included studies.
Table A1. Description of interventions and outcomes in included studies.
StudyControl Intervention Reported Outcomes
ICT with or without ICLN SystemDetails of InterventionCategory *Patient-BasedStaff-BasedCost
Baldwin 2010 [25] Usual practiceICT with ICLN systemAn infection control nurse (ICN) provided 2 h infection control education with practical demonstration to all nursing staff. Some staff were selected as ICLNs to reinforce all aspects of good infection control. ICLNs received additional training (5 h). Repeated training at 3 months and 6 months.2, 5Methicillin-resistant Staphylococcus aureus prevalence in residentsChange in infection control audit scoresNR
Ching 1990 [26]Lectures only by ICNICT with ICLN systemAn ICT drafted the urinary catheter care guideline and introduced it via selection and training (3 h) of ICLNs. ICN provided educational program (30-min lectures, repeated five times) followed by demonstration by ICLNs conducted in small groups of six to ten nurses within their own wards.1, 2, 4, 5NRIncorrect practices in urinary catheter careNR
Donati 2020 [27]Standard multimodal approach used in the hospitalICT with ICLN systemAn ICT designed an intervention to improve the clinical nurses’ compliance with standard precautions and implemented in via selection and interactive training (3 h) of ICLNs. ICLNs collected observational data and organised a 30 min audit and feedback session quarterly with the head nurse and ICN. Lasted for 12 months.2, 4, 5NRCompliance with standard precautions NR
Korbkitjaroen 2011 [28]Regular health care and HCAI preventionICT without ICLN systemAn ICT (consisted of infection control doctor and infection control nurse) visited the wards, identified risk factors for developing HCAIs in each patient, coordinated with the local health care team to eliminate or minimise such risk factors, and encouraged responsible personnel to comply with the appropriate infection control measures for each patient. Lasted for 4 months.3Prevalence of HCAI, length of hospital stays among HCAI patients, mortality due to HCAINRCost of antibiotics to treat HCAIs
Marsteller 2012 [29]Usual careICT without ICLN systemAn interdisciplinary team of ICT (consisted of surgical intensive care unit co-directors, ICU physicians, nurses and infection control practitioners) provided a multifaceted intervention involving evidence-based practices and the comprehensive Unit–based Safety Program to prevent central line-associated bloodstream infections. Lasted for 19 months.2, 4Quarterly rate of central line-associated bloodstream infectionsSelf-perceived infection prevention behavioursNR
McCneghy 2017 [30]No interventionICT with ICLN systemAn ICT (consisted of nursing home staff who were identified as Hero In Prevention champion) received an intensive education on infection control. They collected and entered data (infection control product consumption and surface swab) into an audit and feedback tool weekly. Lasted for 3 months.2, 4, 5Infection rates and hospitalisationFacility compliance (Product consumption-hand washing, surface swab)NR
Mokrzycki 2006 [31]Usual care ICT without ICLN systemA collaborative ICT (consisted of infection manager [nurse], nephrologists, dialysis staff) worked closely and made recommendations on antibiotic adjustments, dose and duration and tunnelled cuffed catheter management. Lasted for 24 months.3Recurrent tunnelled cuffed catheter-associated bacteraemia, death from episodesNRNR
Rao 2009 [32]No interventionICT without ICLN systemAn ICT (consisted of infection control doctor and infection control nurse) provided: (1) teaching and training for healthcare workers and nursing staff on HCAI, (2) training on environmental cleanness, hand hygiene, sharp disposal, (3) personal alcohol-containing gel, (4) 24-h telephone support. Lasted for 16 months.2, 4NRCompliance with hand hygiene facilities, environmental cleanliness and clinical waste disposalNR
Seto 1991 [33]In-service lecture only by ICN ICT with ICLN systemAn ICT introduced the urinary catheter care guideline. An ICN selected opinion leaders to disseminate the new guideline via(1) In-service lecture + demonstration tutorial by opinion leaders(2) Demonstration tutorial by opinion leaders only1, 2, 4, 5NRCompliance with guidelines, direct observation on practiceNR
* Category: (1) developing and disseminating guidelines and policies, (2) coordinating continuous education and training, (3) establishing systems for surveillance of HCAIs (including outbreak detection), (4) monitoring and auditing the practices and standards of care and (5) building effective links with other staff and departments.

References

  1. World Health Organization. Report on the Burden of Endemic Health Care-Associated Infection Worldwide; World Health Organization: Geneva, Switzerland, 2011. [Google Scholar]
  2. World Health Organization. Improving Infection Prevention and Control at the Health Facility: Interim Practical Manual Supporting Implementation of the WHO Guidelines on Core Components of Infection Prevention and Control Programmes; World Health Organization: Geneva, Switzerland, 2018. [Google Scholar]
  3. Office of Disease Prevention and Health. Healthcare-Associated Infections. Available online: https://www.healthypeople.gov/2020/topics-objectives/topic/healthcare-associated-infections (accessed on 27 June 2022).
  4. Umscheid, C.A.; Mitchell, M.D.; Doshi, J.A.; Agarwal, R.; Williams, K.; Brennan, P.J. Estimating the proportion of healthcare-associated infections that are reasonably preventable and the related mortality and costs. Infect. Control Hosp. Epidemiol. 2011, 32, 101–114. [Google Scholar] [CrossRef] [PubMed]
  5. Schreiber, P.W.; Sax, H.; Wolfensberger, A.; Clack, L.; Kuster, S.P.; Swissnoso. The preventable proportion of healthcare-associated infections 2005-2016: Systematic review and meta-analysis. Infect. Control Hosp. Epidemiol. 2018, 39, 1277–1295. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Harbarth, S.; Sax, H.; Gastmeier, P. The preventable proportion of nosocomial infections: An overview of published reports. J. Hosp. Infect. 2003, 54, 258–266. [Google Scholar] [CrossRef]
  7. Mazzeffi, M.; Galvagno, S.; Rock, C. Prevention of Healthcare-associated Infections in Intensive Care Unit Patients. Anesthesiology 2021, 135, 1122–1131. [Google Scholar] [CrossRef] [PubMed]
  8. Jenner, E.A.; Wilson, J.A. Educating the infection control team—Past, present and future. A British perspective. J. Hosp. Infect. 2000, 46, 96–105. [Google Scholar] [CrossRef]
  9. Hale, R.; Powell, T.; Drey, N.S.; Gould, D.J. Working practices and success of infection prevention and control teams: A scoping study. J. Hosp. Infect. 2015, 89, 77–81. [Google Scholar] [CrossRef]
  10. Dawson, S.J. The role of the infection control link nurse. J. Hosp. Infect. 2003, 54, 251–257. [Google Scholar] [CrossRef]
  11. Ahlbrecht, H.; Shearen, C.; Degelau, J.; Guay, D.R. Team approach to infection prevention and control in the nursing home setting. Am. J. Infect. Control 1999, 27, 64–70. [Google Scholar] [CrossRef]
  12. Ali-Brandmeyer, O.; Blanckaert, K.; Nion-Huang, M.; Simon, L.; Birgand, G.; Network, C.P. Consumption of alcohol-based hand rub in French nursing homes: Results from a nationwide survey, 2018–2019. J. Hosp. Infect. 2021, 118, 27–31. [Google Scholar] [CrossRef]
  13. Psevdos, G.; Papamanoli, A.; Barrett, N.; Bailey, L.; Thorne, M.; Ford, F.; Lobo, Z. Halting a SARS-CoV-2 outbreak in a US Veterans Affairs nursing home. Am. J. Infect. Control 2021, 49, 115–119. [Google Scholar] [CrossRef]
  14. Rummukainen, M.; Jakobsson, A.; Karppi, P.; Kautiainen, H.; Lyytikainen, O. Promoting hand hygiene and prudent use of antimicrobials in long-term care facilities. Am. J. Infect. Control 2009, 37, 168–171. [Google Scholar] [CrossRef]
  15. Rummukainen, M.L.; Jakobsson, A.; Matsinen, M.; Jarvenpaa, S.; Nissinen, A.; Karppi, P.; Lyytikainen, O. Reduction in inappropriate prevention of urinary tract infections in long-term care facilities. Am. J. Infect. Control 2012, 40, 711–714. [Google Scholar] [CrossRef]
  16. Dekker, M.; Jongerden, I.P.; van Mansfeld, R.; Ket, J.C.F.; van der Werff, S.D.; Vandenbroucke-Grauls, C.; de Bruijne, M.C. Infection control link nurses in acute care hospitals: A scoping review. Antimicrob. Resist. Infect. Control 2019, 8, 20. [Google Scholar] [CrossRef] [PubMed]
  17. Peter, D.; Meng, M.; Kugler, C.; Mattner, F. Strategies to promote infection prevention and control in acute care hospitals with the help of infection control link nurses: A systematic literature review. Am. J. Infect. Control 2018, 46, 207–216. [Google Scholar] [CrossRef]
  18. Thandar, M.M.; Matsuoka, S.; Rahman, O.; Ota, E.; Baba, T. Infection control teams for reducing healthcare-associated infections in hospitals and other healthcare settings: A protocol for systematic review. BMJ Open 2021, 11, e044971. [Google Scholar] [CrossRef] [PubMed]
  19. Page, M.J.; Moher, D.; Bossuyt, P.M.; Boutron, I.; Hoffmann, T.C.; Mulrow, C.D.; Shamseer, L.; Tetzlaff, J.M.; Akl, E.A.; Brennan, S.E.; et al. PRISMA 2020 explanation and elaboration: Updated guidance and exemplars for reporting systematic reviews. BMJ 2021, 372, n160. [Google Scholar] [CrossRef] [PubMed]
  20. The EndNote Team. EndNote, EndNote X9; Clarivate: Philadelphia, PA, USA, 2013. [Google Scholar]
  21. Sterne, J.A.C.; Savovic, J.; Page, M.J.; Elbers, R.G.; Blencowe, N.S.; Boutron, I.; Cates, C.J.; Cheng, H.Y.; Corbett, M.S.; Eldridge, S.M.; et al. RoB 2: A revised tool for assessing risk of bias in randomised trials. BMJ 2019, 366, l4898. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Tanner-Smith, E.E.; Grant, S. Meta-Analysis of Complex Interventions. Annu. Rev. Public Health 2018, 39, 135–151. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Cochane Handbook for Systematic Reviews of Interventions, Version 6.0 [Updated July 2019]; Higgins, J.P.T.; Thomas, J.; Chandler, J.; Cumpston, M.; Li, T.; Page, M.J.; Welch, V.A. (Eds.) Cochrane: London, UK, 2019. [Google Scholar]
  24. Guyatt, G.H.; Oxman, A.D.; Vist, G.E.; Kunz, R.; Falck-Ytter, Y.; Alonso-Coello, P.; Schünemann, H.J.; Group, G.W. GRADE: An emerging consensus on rating quality of evidence and strength of recommendations. BMJ Clin. Res. Ed. 2008, 336, 924–926. [Google Scholar] [CrossRef] [Green Version]
  25. Baldwin, N.S.; Gilpin, D.F.; Tunney, M.M.; Kearney, M.P.; Crymble, L.; Cardwell, C.; Hughes, C.M. Cluster randomised controlled trial of an infection control education and training intervention programme focusing on meticillin-resistant Staphylococcus aureus in nursing homes for older people. J. Hosp. Infect. 2010, 76, 36–41. [Google Scholar] [CrossRef]
  26. Ching, T.Y.; Seto, W.H. Evaluating the efficacy of the infection control liaison nurse in the hospital. J. Adv. Nurs. 1990, 15, 1128–1131. [Google Scholar] [CrossRef] [PubMed]
  27. Donati, D.; Miccoli, G.A.; Cianfrocca, C.; Di Stasio, E.; De Marinis, M.G.; Tartaglini, D. Effectiveness of implementing link nurses and audits and feedback to improve nurses’ compliance with standard precautions: A cluster randomized controlled trial. Am. J. Infect. Control 2020, 48, 1204–1210. [Google Scholar] [CrossRef] [PubMed]
  28. Korbkitjaroen, M.; Vaithayapichet, S.; Kachintorn, K.; Jintanothaitavorn, D.; Wiruchkul, N.; Thamlikitkul, V. Effectiveness of comprehensive implementation of individualized bundling infection control measures for prevention of health care-associated infections in general medical wards. Am. J. Infect. Control 2011, 39, 471–476. [Google Scholar] [CrossRef] [PubMed]
  29. Marsteller, J.A.; Sexton, J.B.; Hsu, Y.J.; Hsiao, C.J.; Holzmueller, C.G.; Pronovost, P.J.; Thompson, D.A. A multicenter, phased, cluster-randomized controlled trial to reduce central line-associated bloodstream infections in intensive care units *. Crit. Care Med. 2012, 40, 2933–2939. [Google Scholar] [CrossRef]
  30. McConeghy, K.W.; Baier, R.; McGrath, K.P.; Baer, C.J.; Mor, V. Implementing a Pilot Trial of an Infection Control Program in Nursing Homes: Results of a Matched Cluster Randomized Trial. J. Am. Med. Dir. Assoc. 2017, 18, 707–712. [Google Scholar] [CrossRef]
  31. Mokrzycki, M.H.; Zhang, M.; Golestaneh, L.; Laut, J.; Rosenberg, S.O. An interventional controlled trial comparing 2 management models for the treatment of tunneled cuffed catheter bacteremia: A collaborative team model versus usual physician-managed care. Am. J. Kidney Dis. Off. J. Natl. Kidney Found. 2006, 48, 587–595. [Google Scholar] [CrossRef]
  32. Gopal Rao, G.; Jeanes, A.; Russell, H.; Wilson, D.; Atere-Roberts, E.; O’Sullivan, D.; Donaldson, N. Effectiveness of short-term, enhanced, infection control support in improving compliance with infection control guidelines and practice in nursing homes: A cluster randomized trial. Epidemiol. Infect. 2009, 137, 1465–1471. [Google Scholar] [CrossRef]
  33. Seto, W.H.; Ching, T.Y.; Yuen, K.Y.; Chu, Y.B.; Seto, W.L. The enhancement of infection control in-service education by ward opinion leaders. Am. J. Infect. Control 1991, 19, 86–91. [Google Scholar] [CrossRef]
  34. Sydnor, E.R.; Perl, T.M. Hospital epidemiology and infection control in acute-care settings. Clin. Microbiol. Rev. 2011, 24, 141–173. [Google Scholar] [CrossRef] [Green Version]
  35. Haley, R.W.; Culver, D.H.; White, J.W.; Morgan, W.M.; Emori, T.G.; Munn, V.P.; Hooton, T.M. The efficacy of infection surveillance and control programs in preventing nosocomial infections in US hospitals. Am. J. Epidemiol. 1985, 121, 182–205. [Google Scholar] [CrossRef]
  36. Flodgren, G.; Conterno, L.O.; Mayhew, A.; Omar, O.; Pereira, C.R.; Shepperd, S. Interventions to improve professional adherence to guidelines for prevention of device-related infections. Cochrane Database Syst. Rev. 2013, 3, CD006559. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Hughes, C.; Tunney, M.; Bradley, M.C. Infection control strategies for preventing the transmission of meticillin-resistant Staphylococcus aureus (MRSA) in nursing homes for older people. Cochrane Database Syst. Rev. 2013, 11, CD006354. [Google Scholar] [CrossRef] [PubMed]
  38. Moralejo, D.; El Dib, R.; Prata, R.A.; Barretti, P.; Correa, I. Improving adherence to Standard Precautions for the control of health care-associated infections. Cochrane Database Syst. Rev. 2018, 2, CD010768. [Google Scholar] [CrossRef]
  39. Lee, M.H.; Lee, G.A.; Lee, S.H.; Park, Y.H. Effectiveness and core components of infection prevention and control programmes in long-term care facilities: A systematic review. J. Hosp. Infect. 2019, 102, 377–393. [Google Scholar] [CrossRef] [Green Version]
  40. Aboelela, S.W.; Stone, P.W.; Larson, E.L. Effectiveness of bundled behavioural interventions to control healthcare-associated infections: A systematic review of the literature. J. Hosp. Infect. 2007, 66, 101–108. [Google Scholar] [CrossRef] [PubMed]
  41. World Health Organization. Guidelines on Core Components of Infection Prevention and Control Programmes at the National and Acute Health Care Facility Level; World Health Organization: Geneva, Switzerland, 2016. [Google Scholar]
  42. Alhumaid, S.; Al Mutair, A.; Al Alawi, Z.; Alsuliman, M.; Ahmed, G.Y.; Rabaan, A.A.; Al-Tawfiq, J.A.; Al-Omari, A. Knowledge of infection prevention and control among healthcare workers and factors influencing compliance: A systematic review. Antimicrob. Resist. Infect. Control 2021, 10, 86. [Google Scholar] [CrossRef] [PubMed]
  43. Storr, J.; Twyman, A.; Zingg, W.; Damani, N.; Kilpatrick, C.; Reilly, J.; Price, L.; Egger, M.; Grayson, M.L.; Kelley, E.; et al. Core components for effective infection prevention and control programmes: New WHO evidence-based recommendations. Antimicrob. Resist. Infect. Control 2017, 6, 6. [Google Scholar] [CrossRef] [Green Version]
  44. Donati, D.; Biagioli, V.; Cianfrocca, C.; De Marinis, M.G.; Tartaglini, D. Compliance with Standard Precautions among Clinical Nurses: Validity and Reliability of the Italian Version of the Compliance with Standard Precautions Scale (CSPS-It). Int. J. Environ. Res. Public Health 2019, 16, 121. [Google Scholar] [CrossRef] [Green Version]
  45. Ista, E.; van der Hoven, B.; Kornelisse, R.F.; van der Starre, C.; Vos, M.C.; Boersma, E.; Helder, O.K. Effectiveness of insertion and maintenance bundles to prevent central-line-associated bloodstream infections in critically ill patients of all ages: A systematic review and meta-analysis. Lancet Infect. Dis. 2016, 16, 724–734. [Google Scholar] [CrossRef]
  46. Furuya, E.Y.; Dick, A.W.; Herzig, C.T.; Pogorzelska-Maziarz, M.; Larson, E.L.; Stone, P.W. Central Line-Associated Bloodstream Infection Reduction and Bundle Compliance in Intensive Care Units: A National Study. Infect. Control Hosp. Epidemiol. 2016, 37, 805–810. [Google Scholar] [CrossRef]
Figure 1. PRISMA flow diagram of literature search, screen and selection criteria.
Figure 1. PRISMA flow diagram of literature search, screen and selection criteria.
Ijerph 19 17075 g001
Figure 2. Risk of bias graph: review authors’ judgements about each risk of bias item presented as percentages across all included studies.
Figure 2. Risk of bias graph: review authors’ judgements about each risk of bias item presented as percentages across all included studies.
Ijerph 19 17075 g002
Figure 3. Risk of bias summary: review authors’ judgements about each risk of bias item for each included study [25,26,27,28,29,30,3132,33,].
Figure 3. Risk of bias summary: review authors’ judgements about each risk of bias item for each included study [25,26,27,28,29,30,3132,33,].
Ijerph 19 17075 g003
Figure 4. Meta-analysis for the incidence rate of HCAIs [25,28,31].
Figure 4. Meta-analysis for the incidence rate of HCAIs [25,28,31].
Ijerph 19 17075 g004
Figure 5. Meta-analysis for the death due to HCAIs [28,31].
Figure 5. Meta-analysis for the death due to HCAIs [28,31].
Ijerph 19 17075 g005
Figure 6. Meta-analysis for the proportion of compliance with infection control practices [26,33].
Figure 6. Meta-analysis for the proportion of compliance with infection control practices [26,33].
Ijerph 19 17075 g006
Table 1. Characteristics of included studies (n = 9).
Table 1. Characteristics of included studies (n = 9).
CharacteristicsNo%
Publication year1990–2000222.22
2001–2010333.33
2011–2020444.44
LocationUSA333.33
Europe333.33
Asia333.33
SettingInpatient hospitals555.56
Outpatient haemodialysis units111.11
Nursing homes333.33
Type of interventionICT444.44
ICT + ICLN system555.56
Outcome assessedPatient-based
HCAIs555.56
Deaths222.22
Length of hospital stay222.22
Staff-based
Compliance777.78
Cost111.11
HCAIs, healthcare-associated infections; ICLN, infection control link nurse; ICT, infection control team; USA, The Unite States of America.
Table 2. Summary of findings and GRADE evidence profile.
Table 2. Summary of findings and GRADE evidence profile.
OutcomesAnticipated Absolute Effects (95% CI)Relative Effect (95% CI)No of Participants (Studies)Certainty of the Evidence (GRADE)
Risk with Usual CareRisk with Infection Control Team
Incidence rate of HCAIs (follow-up: range 4 months to 20 months)116 per 100075 per 1000
(46 to 124)
RR 0.65
(0.40 to 1.07)
2511
(3 RCTs)
⨁◯◯◯
Very low a,b,c
Death due to HCAIs (follow-up: range 4 months to 20 months)296 per 100095 per 1000
(12 to 797)
RR 0.32
(0.04 to 2.69)
299
(2 RCTs)
⨁◯◯◯
Very low a,b,c
Compliance with infection control practices (follow-up: mean 5 weeks)419 per 1000491 per 1000
(419 to 579)
RR 1.17
(1.00 to 1.38)
914
(2 RCTs)
⨁⨁⨁◯
Moderate a
Explanations: a Downgraded one level due to performance bias, attrition bias and other bias; b Downgraded one level for inconsistency due to heterogeneity across the studies (I2 > 50%); c downgraded one level for imprecision due to wide 95% CI.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Thandar, M.M.; Rahman, M.O.; Haruyama, R.; Matsuoka, S.; Okawa, S.; Moriyama, J.; Yokobori, Y.; Matsubara, C.; Nagai, M.; Ota, E.; et al. Effectiveness of Infection Control Teams in Reducing Healthcare-Associated Infections: A Systematic Review and Meta-Analysis. Int. J. Environ. Res. Public Health 2022, 19, 17075. https://doi.org/10.3390/ijerph192417075

AMA Style

Thandar MM, Rahman MO, Haruyama R, Matsuoka S, Okawa S, Moriyama J, Yokobori Y, Matsubara C, Nagai M, Ota E, et al. Effectiveness of Infection Control Teams in Reducing Healthcare-Associated Infections: A Systematic Review and Meta-Analysis. International Journal of Environmental Research and Public Health. 2022; 19(24):17075. https://doi.org/10.3390/ijerph192417075

Chicago/Turabian Style

Thandar, Moe Moe, Md. Obaidur Rahman, Rei Haruyama, Sadatoshi Matsuoka, Sumiyo Okawa, Jun Moriyama, Yuta Yokobori, Chieko Matsubara, Mari Nagai, Erika Ota, and et al. 2022. "Effectiveness of Infection Control Teams in Reducing Healthcare-Associated Infections: A Systematic Review and Meta-Analysis" International Journal of Environmental Research and Public Health 19, no. 24: 17075. https://doi.org/10.3390/ijerph192417075

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop