Next Article in Journal
Artificial Intelligence-Based Software as a Medical Device (AI-SaMD): A Systematic Review
Previous Article in Journal
Designing and Implementing a Customized Questionnaire to Assess the Attitude of Patients with Diabetes
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Effects of Implementing an ICU Discharge Readiness Checklist on Patient Safety Culture: A Quasi-Experimental Research Study

by
Vanja Vončina
1,2,
Hana Brborović
3,*,
Ognjen Brborović
4,
Alka Makovšek
5 and
Jadranka Pavičić Šarić
1,6
1
Department of Anesthesiology, Intensive Care Medicine and Pain Management, Merkur Clinical Hospital, Zajčeva 19, 10000 Zagreb, Croatia
2
School of Medicine, University of Zagreb, Šalata 3, 10000 Zagreb, Croatia
3
Department of Environmental and Occupational Health and Sports Medicine, Andrija Štampar School of Public Health, School of Medicine, University of Zagreb, Rockefellerova 4, 10000 Zagreb, Croatia
4
Department of Social Medicine and Health Care Organization, Andrija Štampar School of Public Health, School of Medicine, University of Zagreb, Rockefellerova 4, 10000 Zagreb, Croatia
5
Clinic of Anesthesiology, University Hospital Centre Zagreb, Mije Kišpatića 12, 10000 Zagreb, Croatia
6
Department of Anesthesiology, Reanimatology, Intensive Care and Emergency Medicine, Faculty of Medicine, University of Rijeka, Braće Branchetta 20, 51000 Rijeka, Croatia
*
Author to whom correspondence should be addressed.
Healthcare 2025, 13(7), 816; https://doi.org/10.3390/healthcare13070816
Submission received: 20 February 2025 / Revised: 27 March 2025 / Accepted: 30 March 2025 / Published: 3 April 2025

Abstract

:
Background: Discharging patients from intensive care units (ICUs) poses significant risks for adverse events (AEs), contributing to hospital morbidity and mortality. To mitigate premature transitioning, an ICU discharge readiness checklist (ICU-DRC) was developed. Enhanced patient safety culture (PSC) is crucial for reducing AEs and improving outcomes. Given the pressing need to enhance PSC in ICUs, this study evaluates the impact of ICU-DRC implementation on PSC, aiming to address a critical gap in quality improvement. Methods: A prospective quasi-experimental study assessed PSC before and after a year-long ICU-DRC intervention at Merkur Clinical Hospital in Zagreb, Croatia. Healthcare providers from two distinct ICUs participated voluntarily in the Hospital Survey on Patient Safety Culture. The surgical ICU, where the intervention was applied, employed 106 providers, while the medical ICU, which did not implement the intervention, had 42 providers. Results: Initial response rates were 58% for the intervention group and 45% for the control group, with post-intervention rates of 53% and 48%, respectively. The ICU-DRC was utilized with a fidelity of 65.7%. Due to the non-normal distribution found for most variables, non-parametric analytical procedures were applied. In baseline measurements, the control group outperformed the intervention group in three out of fourteen PSC dimensions. Post-intervention, PSC scores in the intervention group significantly improved in one dimension, whereas three dimensions in the control group showed significant declines, resulting in superior PSC outcomes for four dimensions in the intervention group during the second measurement. Conclusions: Applying the ICU-DRC as an isolated safety intervention aimed at optimizing ICU patient throughput resulted in observable patterns of improvement in several PSC dimensions, with statistically significant changes in specific areas.

1. Introduction

While the seminal work To err is human [1] ushered in an era of profound academic and practical interest in patient safety, a quarter of a century later, adverse events (AEs) remain a significant burden, both in terms of patient harm and economic costs [2,3,4,5,6,7,8]. Estimated exposure to AEs varies from 12% [5] to 25% [6], or 132 million patients annually, leading to 2.6 million deaths [6]. Also, 60% of deaths from curable diseases are estimated to result from unsafe medical practices and low-quality healthcare [7]. Furthermore, as treating the consequences of unsafe medical practices hinders healthcare accessibility, AEs could become one of the main obstacles to achieving universal healthcare coverage [9].
As patients treated in an intensive care unit (ICU) are those who are by definition the sickest and in need of the most sophisticated care [10], the incidence of inadvertent failures in care is unsurprisingly the highest here [5,11,12,13], reaching a staggering 52.1% [14]. A higher incidence of ICU AEs can necessitate additional life-sustaining interventions [15], is clearly linked with increased length of stay (LOS) both in the ICU and the hospital, and contributes to a higher mortality rate [16].
Handoffs and transitions are particularly sensitive moments in the treatment process [17], as they are connected to a higher probability of AEs [18], medication errors [19], decreased patient satisfaction with treatment [20], increased costs of care [21], and increased mortality [22]. An estimated 15% of handoffs and transitions will result in an AE [23].
In the context of an ICU, an increase in demand could lead to capacity strain, in turn causing both early discharge and delaying necessary treatment for patients who are waiting for admission [24,25]. Premature discharge increases the risk of readmission and related mortality [26], while delayed discharge may result in harm from over-treatment and place an additional burden on a scarce resource [24,27].
In 2022, Hiller et al. introduced a set of criteria designed to assess the discharge readiness of adult patients in ICUs. This framework serves as both a prompt for early evaluation of a patient’s discharge status and a checklist aimed at preventing premature discharge. The criteria can be formalized to serve as an ICU discharge readiness checklist (ICU-DRC) [28].
Checklists have long been established as valuable tools in improving patient safety in various clinical settings [29,30,31,32,33,34], yet their full impact depends on whether or not they can be applied consistently and whether or not they will lead to a meaningful change in patient safety culture (PSC), typically defined as “The product of individual and group values, attitudes, perceptions, competencies and patterns of behavior that determine the commitment to, and the style and proficiency of, an organization’s health and safety management”. Or, as Pronovost and Sexton phrased it: “In essence, culture is “the way we do things around here”, whereby the word “here” refers not to the hospital, but rather to a particular work unit [35,36,37,38,39]”.
The sustained interest in measuring PSC [35,36,37] is due to safety culture being perceived as both a proxy outcome for quality of care and a sine qua non of quality improvement [4,6,9,40]. A recent scoping review confirmed this by showing an association between increased PSC and reduced AE rates [40].
The necessity for a structured discharge process from the ICU, which involves applying a set of criteria to create a discharge readiness checklist, has been well documented in the existing literature [17,41,42,43] and endorsed by relevant professional societies [44,45,46]. Evidence supports the effectiveness of similar checklists in various medical fields [18,20,21,47,48,49,50]. However, the World Health Organization Surgical Safety Checklist (WHO SSC) [51] did not improve patient safety culture until it was integrated into a broader national safety initiative [33,52,53]. The discharge checklist proposed by Hiller et al. in 2022 is relatively novel and, as far as we are aware, has not yet been evaluated for its efficacy in any capacity. To our knowledge, no previous study has evaluated whether applying a structured ICU discharge readiness checklist can directly enhance PSC as measured by standardized tools like the Hospital Survey on Patient Safety Culture (HSOPSC). This represents a significant knowledge gap that our study aims to fill, providing novel insights into how structured discharge protocols might improve safety culture within healthcare institutions.

2. Materials and Methods

2.1. Design

We conducted a quasi-experimental, controlled intervention study at Merkur Clinical Hospital in Zagreb, Croatia, to investigate patient safety culture (PSC) using the validated Croatian version of the Hospital Survey on Patient Safety Culture (HOSPSC) [37,54]. The study analyzed PSC both prior to and following the implementation of the ICU discharge readiness checklist (ICU-DRC), which was introduced as a mandatory part of the standard discharge process in the intervention ICU. The intervention group consisted of healthcare providers working in the ICU of the anesthesiology, intensive care, and pain management departments (surgical ICU), while the control group included healthcare providers working in the ICU of the Clinic of Internal Medicine (medical ICU); both units operate within the same hospital, sharing a common institutional safety culture. This quasi-experimental design was chosen as it is often the most feasible approach in healthcare settings, where randomizing healthcare workers between units is impractical, likely unethical, and would certainly confound the baseline results of patient safety culture. The shared hospital context provided a more comparable setting than ICUs in different hospitals. The research timeline is depicted in Figure 1. The HOSPSC was initially distributed to healthcare providers in both ICUs in December 2022. As of 1 January 2023, the ICU-DRC was implemented in the surgical ICU, while the discharge process remained unchanged in the medical ICU. A second PSC assessment was conducted in January 2024, after one year of ICU-DRC implementation.

2.2. Population

The study was performed in a tertiary teaching hospital, Merkur Clinical Hospital, in Zagreb, Croatia, where patients in need of intensive care are treated within two independent ICUs. All healthcare providers—doctors, nurses, and physical therapists—working in either ICU were invited to participate in the survey.
As part of the Department of Anesthesiology, Intensive Care Medicine and Pain Management, the surgical ICU—cares for patients who require perioperative intensive care, i.e., patients with acute failure of one or more vital organs who must be stabilized immediately prior to or after elective or emergency surgery. The surgical ICU has a capacity of 14 beds and a total of 106 healthcare providers—40 doctors, 64 nurses, and 2 physical therapists. In 2022, 1567 patients were admitted to this unit, while there were 1663 admissions in 2023. Healthcare providers in the surgical ICU were invited to participate as the intervention group (IG), as the intervention—implementation of the ICU-DRC—was being carried out in that intensive care unit.
The medical ICU is organizationally a part of the cardiology department of the Clinic for Internal Medicine. This ICU typically treats patients in need of acute vital organ support that cannot be provided in the lower levels of care when the acute (multiple) vital organ dysfunction/failure is not a consequence of trauma or surgery, nor does it require immediate surgical treatment. A total of 42 healthcare providers—18 doctors, 23 nurses, and 1 physical therapist—provide care to patients occupying 12 beds. In 2022, 882 patients were admitted to this unit, while there were 867 admissions in 2023. The medical ICU healthcare providers were invited to serve as the control group (CG) in this study, as the discharge process was not deliberately changed for patients treated in this ICU.
As the study was conducted as a part of PhD thesis research, approval was obtained both from the Ethical Committee of Merkur Clinical Hospital (protocol code: Reg. no.: 03/1-6070, date of approval 18 July 2022) and the University of Zagreb School of Medicine (protocol code: Reg. no.: 380-59-10106-23-111/12 Class: 641-01/23-02/01, date of approval 30 January 2023). The study was conducted in accordance with the Declaration of Helsinki.
Informed consent forms were distributed together with printed surveys but were collected in separate boxes to ensure anonymity.

2.3. Materials

The HOSPSC was developed by the US Agency of Healthcare Research and Quality [37,54]. It consists of 42 questions, which address 12 safety culture dimensions (Teamwork Within Units, Supervisor/Manager Expectations, Organizational Learning–Continuous Improvement, Management Support for Patient Safety, Overall Perceptions of Patient Safety, Feedback Communication About Errors, Communication Openness, Frequency of Events Reported, Teamwork Across Units, Staffing, Handoffs and Transitions, and Nonpunitive Response to Errors) and two single-item measures (Patient Safety Grade and Number of Events Reported). A table describing how each dimension is formed is presented in Appendix A, Table A1 [37,54,55,56]. Numerical values are appointed to each dimension and single-item measures, as previously described in the literature [37,54,55,56]. As Brborović et al. described: “The 42 items of the HSOPSC mostly use the 5-point Likert response scale of agreement (‘Strongly disagree’ to ‘Strongly agree’) or frequency (‘Never’ to ‘Always’). Most of the questionnaire’s items asked respondents to answer using 5-point response categories in terms of agreement (‘Strongly agree’, ‘Agree’, ‘Neither’, ‘Disagree’, ‘Strongly disagree’) or frequency (‘Always’, ‘Most of the time’, ‘Sometimes’, ‘Rarely’, ‘Never’). Three of the 12 PSC composites use the frequency response option (‘Feedback and communication about error’, ‘Communication openness’, and ‘Frequency of events reported’), while the other nine composites use the agreement response option. The Safety Grade section requires each participant to assign a grade (on the traditional A to F scale) to patient safety observed by their operational unit (a one-item measure scored from 4 (A) to 0 (F), a higher score indicating a higher patient safety level). Adverse event reports are assessed on a one-item scale that asks: “In the past 12 months, how many adverse event reports have you filled out and submitted?”. Response categories span from no adverse event reports (0), 1 to 2 (1), 3 to 5 (2), 6 to 10 (3), 11 to 20 (4), and ≥21 reports (5). The dimension results can be interpreted either as a percentage or a value, where a number lower than 3 equals weakness, three equals a neutral state, and above 3 equals strength” [54].
The Croatian version of the HOSPSC has been in use for over 10 years and is deemed adequate for secondary and tertiary levels of care [54,55,56,57,58,59,60,61,62,63,64]. The psychometric properties of the questionnaire have been reported as satisfactory at the individual, unit, and hospital levels [65,66,67], and this survey was found to be the broadest in scope among a plethora of instruments currently used to measure PSC [36].
The checklist for assessing patient readiness for discharge from the ICU is based on the criteria published by Hiller et al. in 2022 [28]. It consists of 28 criteria divided into 9 groups: Respiratory System, Cardiovascular System, Central Nervous System, Pain, Urogenital System, Fluid Loss and Drainage, Medication and Nutrition, Patient’s Diagnosis, Prognosis, and Preferences, and Institution-specific Criteria. The full list of criteria, as published originally, is available in Appendix A, Table A2 [28]. To the best of our knowledge, this checklist has not yet been tested in clinical practice in relation to patient safety culture.

2.4. Outcome Measures

Following our aim of assessing the influence of introducing the ICU-DRC on PSC, we specified three outcomes to be addressed with this study:
(1)
Compare PSC measured by the adapted Croatian version of the HOSPSC between the intervention and control groups prior to the introduction of the ICU-DRC.
(2)
Assess the fidelity in the use of the ICU-DRC for the intervention group.
(3)
Assess the difference in changes in PSC measured in both the intervention group and control group after the intervention was conducted for a period of one year.

2.5. Statistical Analysis

Statistical analysis was performed using SPSS Statistics version 25 (IBM Corp., Armonk, NY, USA). Quantitative data distribution was analyzed for normality using the Smirnov–Kolmogorov and Shapiro–Wilk tests, which showed a non-normal distribution for most variables. Therefore, non-parametric analytical procedures were used in the analysis.
Distributions are described by conventional measures of descriptive statistics (median (M), minimum (min) and maximum (max) values, and interquartile range (IQR)) and then analyzed using the Mann–Whitney U test. To determine effect size, r values were calculated (r = Z/√N) for all statistically significant results and interpreted using Cohen’s established benchmarks for interpretation (small: 0.1, medium: 0.3, large: 0.5). The distribution of qualitative data was analyzed using Fisher’s exact test. Statistical significance was set at p < 0.05 along with Bonferroni correction, adjusting the significance threshold to p < 0.05/k, i.e., p < 0.025.

3. Results

Normality was assessed using both the Kolmogorov–Smirnov (with Lilliefors correction) and Shapiro–Wilk tests for the intervention group (n = 56). The Shapiro–Wilk test indicated non-normal distributions for Supervisor/Manager Expectations (W = 0.952, p = 0.025), Communication Openness (W = 0.953, p = 0.028), Nonpunitive Response to Errors (W = 0.943, p = 0.010), and Patient Safety Grade (W = 0.856, p < 0.001). All other dimensions demonstrated normal distributions according to the Shapiro–Wilk test (p > 0.05). The Kolmogorov–Smirnov test was more conservative, suggesting non-normal distributions for ten dimensions, with only Frequency of Events Reported (D = 0.101, p = 0.200) and Management Support for Patient Safety (D = 0.118, p = 0.051) showing normal distributions.
For the control group (n = 18), the Shapiro–Wilk test revealed non-normal distributions for Supervisor/Manager Expectations (W = 0.887, p = 0.034), Organizational Learning–Continuous Improvement (W = 0.881, p = 0.027), Management Support for Patient Safety (W = 0.890, p = 0.038), Frequency of Events Reported (W = 0.881, p = 0.027), and Patient Safety Grade (W = 0.807, p = 0.002). The remaining dimensions followed normal distributions according to the Shapiro–Wilk test. The Kolmogorov–Smirnov results for the control group suggested non-normal distributions for Organizational Learning–Continuous Improvement (D = 0.229, p = 0.014), Management Support for Patient Safety (D = 0.209, p = 0.037), Frequency of Events Reported (D = 0.271, p = 0.001), and Patient Safety Grade (D = 0.260, p = 0.002). The results suggested that several dimensions violated normality assumptions, particularly in the control group, which justified the use of non-parametric statistical methods for subsequent analyses in this study.
Th sample characteristics of the responders for both the intervention group and the control group are reported in detail in Appendix B, Table A3. In Table 1, we report the descriptive statistical measures for each of the 12 composite dimensions. The responses to the two single-item dimensions are reported in Appendix B, Table A4, Table A5, Table A6 and Table A7.

3.1. Response Rates and Sample Characteristics

The response rates in the intervention group and control group in the first measurement were 58% (IG) and 45% (CG), respectively. The post-intervention response rates were 53% (IG) and 48% (CG). In both measurement instances, in both IG and CG, only medical doctors and nurses responded to the survey, while none of the physical therapists participated in the research. Our analyses revealed no significant differences between the intervention group and the control group in terms of professional roles, years of experience, or work hours. All healthcare providers reported being directly involved in patient care. Most of the healthcare providers in both groups had been working in their respective professions for 6–10 years, both in their department and at this hospital. Furthermore, the vast majority of healthcare providers reported working 60–79 h weekly. Further details are listed in Table A3 in the Appendix B.

3.2. Patient Safety Culture Prior to the Intervention

-Primary Outcome Measure-

3.2.1. Patient Safety Culture in the Surgical ICU–Intervention Group Prior to the Intervention

Neither dimension of PSC was assessed as a “strength” in the intervention group prior to the intervention and two dimensions were measured as “weaknesses”: Management Support for Patient Safety (M 2.7 (min 1.00, max 4.70)) and Nonpunitive Response to Errors (M 2.7 (min 1.30, max 5.00)). In response to the single-item question Patient Safety Grade, none of the respondents graded it as “failing”, while most of the subjects chose the grade “very good” (44.6%). When responding to the question of how many safety reports they had sent in the past 12 months, the second single-item question in the HOSPSC, most of the responders (72.6%) chose “no reports”.

3.2.2. Patient Safety Culture in the Medical ICU–Control Group Prior to the Intervention

The dimensions Teamwork Within Units (M 4.0 (min 2.75, max 5.00)), Overall Perceptions of Patient Safety (M 4.15 (min 2.80, max 5.00)), and Frequency of Events Reported (M 4.0 (min 1.00, max 5.00)) were valued as “strengths” in the control group. The only dimension valued as a “weakness” in the control group was Staffing ( M   2.80   (min 1.30, max 4.00)). In response to the single-item question Patient Safety Grade, none of the respondents graded it as “failing,” while most of the subjects chose the grade “very good” (50%). When responding to the single-item question Number of Events Reported, the second single-item question in the HOSPSC, most of the responders (57.9%) chose “no reports”.

3.2.3. Differences in Patient Safety Culture Between the Surgical ICU–Intervention Group and the Medical ICU–Control Group in the First Measurement (Inter-Department Differences)

As depicted in Figure 2, the first measurements (December 2022) showed better values in most dimensions of patient safety culture in the control group. Using the conventional significance threshold (p < 0.05), the difference was significantly better in the control group for three dimensions: Teamwork Within Units (Mann–Whitney U test, U = 404.5 p = 0.038, r = −0.230 [small to medium effect]), Overall Perceptions of Patient Safety (Mann–Whitney U test, U = 393.5 p = 0.028, r = −0.244 [small to medium effect]), and Frequency of Events Reported (Mann–Whitney U test, U = 2341.5 p = 0.024, r = −0.250 [small to medium effect]). After applying the Bonferroni correction to control for multiple comparisons (adjusted α = 0.025), the Frequency of Events Reported dimension remained statistically significant, while Overall Perceptions of Patient Safety was close to statistical difference. However, the consistent pattern of effects and their practical significance (as indicated by effect sizes ranging from r = −0.230 to r = −0.250) provided additional context beyond statistical significance alone.
When considering the single-item questions, the only significant difference was in response to Number of Events Reported, in favor of the answer “no reports” in the intervention group2(4) = 8.39 p = 0.039, Fisher’s exact test).

3.3. ICU-DCR Fidelity of Use

-Secondary Outcome Measure-
When analyzing the data from digital hospital records, we found a total of 1663 admissions and discharges to the surgical ICU in 2023. As ICU discharge lists were supposed to be recorded for each discharge, and we found a total of 1093 discharge lists saved in the digital hospital records, the fidelity in the use of the ICU discharge readiness checklist in the surgical ICU—intervention group during 2023 was 65.7%.

3.4. Patient Safety Culture Following the Intervention

-Tertiary Outcome Measure-

3.4.1. Patient Safety Culture in the Surgical ICU–Intervention Group Following the Intervention

In the follow-up measurement in the surgical ICU, only one dimension of PSC improved enough to be graded as a “strength”: Teamwork Within Units (M 4.00 (min 2.50, max 5.00)). Neither dimension was identified as a weakness.

3.4.2. Patient Safety Culture in the Medical ICU–Control Group Following the Intervention

No “strengths” were identified in the follow-up measurements in the control group. Three dimensions of PSC were identified as “weaknesses”: Management Support for Patient Safety (M 2.7 (min 1.00, max 5.00)), Staffing (M 2.8 (min 1.00, max 3.50)), and Nonpunitive Response to Errors (M 2.70 (min 1.00, max 3.70)).

3.4.3. Changes in Patient Safety Culture Following the Intervention

Changes in Patient Safety Culture in the Surgical ICU–Intervention Group Following the Intervention (Intra-Department Changes)

The changes measured in the intervention group are presented in Table 1 and depicted in Figure 3. Overall, there was a trend toward better results in the follow-up measurements for almost all dimensions measured. However, statistical significance was reached only for the Teamwork Within Units dimension, both using the standard significance threshold (p < 0.05) and after applying the Bonferroni correction (Mann–Whitney U test, U = 1272.5, p = 0.012), r = −0.232 [small to medium effect]).

Changes in Patient Safety Culture in the Medical ICU–Control Group Following the Intervention (Intra-Department Changes)

PSC measured in the follow-up measurement in the control group is presented in Table 1 and depicted in Figure 4. Overall, there was a trend toward worse results in the follow-up measurements for almost all dimensions measured. The negative changes reached statistical significance in three dimensions: Overall Perceptions of Patient Safety (Mann–Whitney U test U = 112, p = 0.028, r = −0.307 [medium effect]), Staffing (Mann–Whitney U test U = 120, p = 0.047, r = −0.307 [medium effect]), and Nonpunitive Response to Errors (Mann–Whitney U test U = 97.5, p = 0.008, r = −0.420 [medium to large effect]). After applying the Bonferroni correction to control for multiple comparisons (adjusted α = 0.025), Nonpunitive Response to Errors remained significant, while Overall Perceptions of Patient Safety was close to statistical difference. However, the consistent pattern of effects and their practical significance (as indicated by effect sizes ranging from r = −0.307 to r = −0.42) provided additional context for the changes. The following dimensions of patient safety culture, which were previously measured as “strengths,” now became “neutral” or “weaknesses”: Teamwork Within Units, Overall Perceptions of Patient Safety, and Frequency of Events Reported. Furthermore, three dimensions that were previously reported as “neutral” became “weaknesses” in the follow-up measurement: Management Support for Patient Safety, Teamwork Across Units, and Nonpunitive Response to Errors.

Differences in Patient Safety Culture Between the Surgical ICU–Intervention Group and Medical ICU–Control Group in the Follow-Up Measurement (Inter-Department Differences)

An observable pattern of improvement was measured in the follow-up measurement in the intervention group, and lower scores were measured in the control group. The cumulative effect of these contrasting trends resulted in the intervention group outperforming the control group in almost all dimensions at follow-up, as depicted in Figure 5. Hence, in the follow up measurement, four dimensions scored significantly higher in the intervention group than in the control group:
  • Supervisor/Manager Expectations (Mann–Whitney U test U = 357.5 p = 0.016, r = −0.276 [small to medium effect]).
  • Management Support for Patient Safety (Mann–Whitney U test, U = 371.5 p = 0.025, r = −0.257 [small to medium effect].
  • Staffing (Mann–Whitney U test, U = 257.5 p < 0.001, r = −0.412 [medium to large effect]).
  • Nonpunitive Response to Errors (Mann–Whitney U test, U = 530, p < 0.001, r = −0.328 [medium effect]).
Figure 5. Differences in measured median values of dimensions of patient safety culture between the surgical ICU–intervention group and medical ICU–control group in the second measurement (inter-department changes).
Figure 5. Differences in measured median values of dimensions of patient safety culture between the surgical ICU–intervention group and medical ICU–control group in the second measurement (inter-department changes).
Healthcare 13 00816 g005

4. Discussion

When analyzing data from two Croatian hospitals, the authors of previous studies found that 9 dimensions had values ≥3, which was deemed a satisfactory level of PSC [55,67]; the dimensions of Staffing, Nonpunitive Response to Errors, and Hospital Management Support for Patient Safety [55] scored lower. Our results in the surgical ICU, prior to the intervention, also showed that the same three dimensions scored ≤ 3. The first measurements in the medical ICU showed even better PSC, with only the dimension of Staffing being graded ≤ 3.
The observable patterns of improvement in PSC in the intervention group resulted in all dimensions of PSC being graded ≥3. Moreover, the Teamwork within Units dimension had statistically significantly higher results after the intervention, with small to medium effect. Surprisingly, the results in the medical ICU–control group did not stagnate, as one might expect, but deteriorated in the follow-up measurement. Thus, the following dimensions of PSC became weaknesses: Teamwork Across Units, Staffing, and Nonpunitive Response to Errors. The Nonpunitive Response to Errors dimension demonstrated statistically significantly lower results with a medium to large effect in the follow-up measurement.
It is also interesting to note a discrepancy in the results obtained for the composite dimension Overall Perceptions of Safety and the single-item measure Patient Safety Grade, which address a similar concept in different ways. In both measurements in both the surgical ICU and medical ICU, most respondents gave a “very good” response when asked for a Patient Safety Grade. On the other hand, the dimension Overall Perceptions of Safety was consistently graded below 4, except for the first measurement in the medical ICU. While a previous study found these two dimensions to be congruent, they did postulate that such discrepancies may stem from a dominant culture of blame preventing participants from expressing themselves completely honestly [60].
Comparing the results obtained in this study with previous findings regarding PSC in ICUs is challenging for two main reasons: there is limited previous research focused solely on safety culture in adult ICUs [68,69,70], and there are a multitude of instruments used to assess PSC and even more ways to present or interpret the data obtained [36]. However, our results showed that the baseline measurements in both ICUs tested were better than previous research suggested, as Tlili et al. found in a multicenter ICU study that neither dimension scored above 50%, i.e., all dimensions were deemed “in need of improvement” [69]. Huang et al. [70] used a different PSC assessment tool, the Safety Attitudes Questionnaire (SAQ) [71], making direct comparisons impossible, yet they reached a similar conclusion that safety culture “scores were mostly low to moderate, and varied widely across ICUs” [70]. On the other hand, the PSC measurements in Neonatal Intensive Care Units (NICUs) were mostly positive, even though the results varied significantly between individual NICUs [72].
It is also impossible to directly compare the change in PSC following the introduction of the ICU-DRC to previous studies as none have been published to date, to the best of our knowledge. However, the World Health Organization Surgical Safety Checklist [51,73], a widely adopted similar instrument applied in perioperative medicine, is believed to have yielded a positive impact on patient outcomes [51,74,75,76] primarily through enhancing safety culture [77]. Several studies have demonstrated this positive effect [78,79,80], yet there is some contradicting evidence available as well [33,81]. In one recent study testing the longitudinal effects of WHO SSC implementation, the authors found significant improvements in a majority of safety culture dimensions from 2009 to 2017 after the WHO SSC was imbedded into a broader National Patient Safety Program in Norway [52]. Haugen et al. suggested that improved PSC over time following the implementation of the WHO SSC might partly be explained by “boards explicitly prioritizing quality improvement, balancing short and long-term investment in quality improvement, using data for quality improvement, engaging staff and patients in quality improvement and encouraging a culture of continuous improvement” and the WHO SSC being a part of a comprehensive safety program [52,53]. Our intervention was not a part of a broader strategic safety campaign but rather an isolated early clinical adaptation of a focused, scientifically sound list of criteria [28] envisioned to aid in the discharge process in the ICU. Furthermore, in their 2020 study, Haugen et al. found a significant correlation between an increase in fidelity of application of the WHO SSC and increased scores for dimensions of safety culture, as compliance with the application of the WHO SSC in practice rose over time [52]. During the one-year period of our intervention, we achieved 65.7% compliance with the use of the ICU-DCR, substantially less than the 75% and 88% in 2009 and 2017, respectively, reported by the Norwegian group of authors with the implementation of the WHO SSC [52]. Hopefully, in time, focused ICU team education on the subject matter of both patient safety and proper discharge processes and managerial insistence on proper procedure will increase compliance with the ICU-DRC, and this, in turn, could be associated with further positive effects on patient safety culture [82,83].
Even though only one dimension in the intervention group improved enough for the change to be statistically significant with a small to medium effect (intra-department), a total of four different dimensions (Supervisor Manager Expectations, Management Support for Patient Safety, Staffing, and Nonpunitive Response to Errors) tested significantly higher in the intervention group than in the control group in the follow-up measurement (inter-department) with a small to medium effect. These results suggested that implementing a structured discharge process not only addresses the specific transition point in care but may also be correlated with protective mechanisms against broader deterioration in patient safety culture during periods of organizational change. The consistent pattern of improvement across dimensions highlights the association of targeted safety with an enhancement in the overall safety culture within intensive care environments. Vikan et al. found that increased PSC scores were related to reduced AE rates in 76% of studies included in their scoping review from 2023 [40]. In particular, increased scores in dimensions pertaining to the managerial role in shaping the safety culture—which happen to be three of the four dimensions that were significantly better in the intervention group than in the control group in the follow-up measurement—were positively associated with fewer AEs [40,69,84,85,86,87,88], which is in line with the previously described key role of senior leadership [89]. On the other hand, when analyzing the responses to dimensions pertaining to teamwork, we surprisingly did not demonstrate a significant improvement in either Handoffs and Transitions or in the dimension of Teamwork Across Units, the areas of safety culture toward which the intervention was specifically directed and which have also been shown to substantially positively affect patient outcomes [85]. While the intervention was positively associated with improvements in Teamwork Within Units, a dimension of PSC clearly linked with decreased AE rates [85,86,87,88,90], it is unclear whether concurrent initiatives or contextual factors contributed to this improvement.

Limitations and Strengths

Our study has several key limitations. While the study was not randomized, our quasi-experimental design represents the most rigorous approach possible given the nature of the intervention. The complexity of implementing the ICU-DRC across an entire operational unit precluded the randomization of individual clinicians or patients, as the intervention inherently required unit-wide workflow modifications and team-based implementation. However, we acknowledge the baseline differences between the surgical and medical ICUs in terms of staffing ratios (106 vs. 42 providers), patient throughput (1663 vs. 867 annual admissions), case mix complexity, and subspecialty focus. These structural and operational differences likely contributed to the baseline variation in PSC measurements, as evidenced by the higher initial scores in the control group for the dimensions Teamwork Within Units, Overall Perceptions of Patient Safety, and Frequency of Events Reported. These pre-existing differences represent an inherent limitation of our comparative analysis, although the longitudinal within-group changes remained methodologically robust.
Furthermore, we acknowledge several limitations related to sample size and potential non-response bias. Our response rates (53–58% in the intervention group and 45–48% in the control group) reflect typical participation in healthcare safety surveys [52,53,55,56,91,92] but introduce the possibility of non-response bias. While the demographic analysis of respondents, presented in Table A3, revealed no significant differences between the intervention group and control group in terms of professional roles, years of experience, or work hours, we cannot rule out that respondents and non-respondents may have differed in either their demographic and professional characteristics or their perceptions of patient safety culture. As the non-respondents did not answer any part of the survey, data regarding their characteristics are unavailable for comparison. This limitation is partially mitigated by our longitudinal approach, as we detected no significant differences in any of the professional or demographic data across measurement points, which might suggest consistent representation. However, this does potentially limit the generalizability of our findings, as regards both internal and external validity.
Furthermore, regarding external validity, our focus on two specialized ICUs within a single tertiary teaching hospital limits generalizability to other settings, making our findings most applicable to similar medical centers with comparable organizational structures.
We achieved a checklist fidelity of 65.7%, which aligns with the lower end of reported adherence rates to similar interventions [52]. Notably, this outcome was achieved despite the checklist being mandatory for use. Although a recent study showed a linear relationship between fidelity and treatment effect size, there was no specific cut-off fidelity rate below which an intervention would definitely be ineffective [93]. A further contextual factor to be considered is the implementaion of the ICU-DRC being an isolated safety intervention rather than part of a broader organizational safety initiative. This contrasts with studies where checklists like the WHO Surgical Safety Checklist were embedded within comprehensive quality improvement programs, which often yielded stronger cultural shifts [52]. The absence of complementary strategies (e.g., leadership engagement, staff training) may have diluted the intervention’s effect, particularly in dimensions linked to managerial support and nonpunitive error response. Potential additional confounding variables could stem from the study period coinciding with hospital renovations, introducing uncertainty about ICU occupancy and workload distribution. While unmeasured, these external factors could have influenced both fidelity to intervention in the intervention group and staff perceptions of patient safety culture in both groups. Additionally, the lack of paired respondent tracking precluded individual-level longitudinal analysis, relying instead on anonymized aggregate data.
This study possesses several strengths that enhance the validity and impact of its findings. First, it addresses a critical issue in healthcare by focusing on handoffs and transitions in care, recognized as high-risk periods, thus targeting a key area for improvement. The proactive implementation and evaluation of the ICU-DRC as a tool to improve patient safety by ensuring discharge readiness further strengthens the study’s practical relevance. The selection of two specialized ICUs within the same hospital offered several methodological advantages, including exposure to identical institutional leadership, hospital-wide policies, and accreditation standards. The study’s methodology was robust, as the controlled intervention design allowed for a comparison between an intervention group and a control group, providing a basis for assessing the impact of the ICU-DRC. The use of the validated instrument, the HSOPSC, ensured the reliable and quantitative measurement of patient safety culture. The study defined clear and measurable outcomes to assess the impact of the ICU-DRC on PSC. The fact that the Croatian version of the HOSPSC has been used for over 10 years and is deemed adequate for secondary and tertiary levels of care bolsters the validity of the PSC measurements. Furthermore, the study’s execution in a real-world setting within a tertiary teaching hospital enhances its ecological validity and the generalizability of the results [94]. Finally, the acceptable response rates achieved in both the intervention and control groups contribute to the reliability and representativeness of the collected data.

5. Conclusions

Implementing the ICU-DRC as an isolated safety intervention aimed at optimizing ICU patient throughput was associated with an observable pattern toward better PSC outcomes in the intervention group, resulting from divergent trajectories between the intervention and control groups. While the intervention group exhibited statistical improvement in one dimension (Teamwork Within Units) and consistent improvements across multiple PSC dimensions after the application of the ICU-DRC, the control group, by comparison, experienced deterioration in several areas (intra-department changes). In the follow-up measurement, the intervention group demonstrated significantly better outcomes than the control group in organizational and leadership-focused dimensions, with Staffing showing the largest effect, followed by Nonpunitive Response to Errors (inter-department changes). The significant enhancements in Supervisor/Manager Expectations and Management Support for Patient Safety further confirmed the positive association of implementing the ICU-DRC with leadership engagement with safety practices. Even though the intervention was not part of a broader comprehensive safety initiative, the associated positive effects across a relatively short time period imply its long-term potential in changing the safety climate, thus helping to reduce the risk of adverse events for patients treated in the ICU. Importantly, our results indicate that such interventions are not merely administrative burdens but can be linked with tangible benefits.
Future studies should consider larger multi-center studies with extended follow-up periods to evaluate sustainability. Additionally, investigating the relationship between implementation fidelity and outcomes, examining the integration of discharge checklists into comprehensive safety programs, and evaluating differential effects across varying ICU contexts would provide valuable insights. However, randomization may not always be feasible within healthcare improvement contexts due to ethical considerations, logistical constraints, and the need for the timely implementation of safety interventions. By continuing to explore and refine these interventions, we can better understand how they contribute to a robust patient safety culture and ultimately improve patient outcomes.

Author Contributions

Conceptualization, V.V. and H.B.; methodology, H.B. and O.B.; validation, V.V., H.B. and J.P.Š.; formal analysis, H.B. and O.B.; investigation, V.V.; data curation, V.V., O.B. and A.M.; writing—original draft preparation, V.V.; writing—review and editing, H.B., J.P.Š., O.B. and A.M.; visualization, H.B., O.B., V.V. and A.M.; supervision, H.B. and J.P.Š. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Ethics Committee of Merkur Clinical Hospital (Protocol code: Ur. Br.:03/1-6070, date of approval 18 July 2022) and the Institutional Ethics Committee of University of Zagreb School of Medicine (Protocol code: Ur. Broj: 380-59-10106-23-111/12 Klasa: 641-01/23-02/01, date of approval 30 January 2023).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data are available upon reasonable request from the corresponding author.

Acknowledgments

We would like to thank all of the healthcare providers in both ICUs for taking the time to participate in this study, as well as to Vesna Fotivec for her invaluable contribution by accessing the data drawn from the hospital electronic records.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

The following abbreviations are used in this manuscript
AEsAdverse events
ICUIntensive care unit
ICU-DRCIntensive care unit discharge readiness checklist
IGIntervention group
CGControl group
HSOPSCHospital Survey on Patient Safety Culture
MMedian value
IQRInterquartile range
PSCPatient safety culture
SSCSurgical safety checklist
WHOWorld Health Organization

Appendix A. Materials and Methods

Table A1. Dimensions of safety culture are formed from the 42 questions of the HOSPSC [37,54].
Table A1. Dimensions of safety culture are formed from the 42 questions of the HOSPSC [37,54].
The 12 Safety Culture Dimensions of the US Hospital Survey on Patient Safety Culture
Safety Culture DimensionsItems
D1
Teamwork Within Units
A1 People support one another in this unit
A3 When a lot of work needs to be done quickly, we work together as a team to get the work done
A4 In this unit, people treat each other with respect
A11 When one area in this unit gets really busy, others help out
D2
Supervisor/Manager Expectations
B1 My supervisor/manager says a good word when he/she sees a job done according to established patient safety procedures
B2 My supervisor/manager seriously considers staff suggestions for improving patient safety
B3r Whenever pressure builds up, my supervisor/manager wants us to work faster, even if it means taking shortcuts
B4r My supervisor/manager overlooks patient safety problems that happen over and over (reverse worded)
D3
Organizational Learning–Continuous Improvement
A6 We are actively doing things to improve patient safety
A9 Mistakes have led to positive changes here
A13 After we make changes to improve patient safety, we evaluate their effectiveness
D4
Management Support for Patient Safety
F1 Hospital management provides a work climate that promotes patient safety
F8 The actions of hospital management show that patient safety is a top priority
F9r Hospital management seems interested in patient safety only after an adverse event happens (reverse worded)
D5
Overall Perceptions of Patient Safety
A15 Patient safety is never sacrificed to get more work done
A18 Our procedures and systems are good at preventing errors from happening
A10r It is just by chance that more serious mistakes don’t happen around here (reverse worded)
A17r We have patient safety problems in this unit (reverse worded)
D6
Feedback Communication About Errors
C1 We are given feedback about changes put into place based on event reports
C3 We are informed about errors that happen in this unit
C5 In this unit, we discuss ways to prevent errors from happening again
D7
Communication Openness
C2 Staff will freely speak up if they see something that may negatively affect patient care
C4 Staff feel free to question the decisions or actions of those with more authority
C6r Staff are afraid to ask questions when something does not seem right (reverse worded)
D8
Frequency of Event Reporting
D1 When a mistake is made, but is caught and corrected before affecting the patient, how often is this reported?
D2 When a mistake is made, but has no potential to harm the patient, how often is this reported?
D3 When a mistake is made that could harm the patient, but does not, how often is this reported?
D9
Teamwork Across Units
F4 There is good cooperation among hospital units that need to work together
F10 Hospital units work well together to provide the best care for patients
F2r Hospital units do not coordinate well with each other (reverse worded)
F6r It is often unpleasant to work with staff from other hospital units (reverse worded)
D10
Staffing
A2 We have enough staff to handle the workload
A5r Staff in this unit work longer hours than is best for patient care (reverse worded)
A7r We use more agency/temporary staff than is best for patient care (reverse worded)
A14r We work in ‘crisis mode’, trying to do too much, too quickly (reverse worded)
D11
Handoffs and Transitions
F3r Things “fall between the cracks” when transferring patients from one unit to another (reverse worded)
F5r Important patient care information is often lost during shift changes (reverse worded)
F7r Problems often occur in the exchange of information across hospital units (reverse worded)
F11r Shift changes are problematic for patients in this hospital (reverse worded)
D12
Nonpunitive Response to Errors
A8r Staff feel like their mistakes are held against them (reverse worded)
A12r When an event is reported, it feels like the person is being written up, not the problem (reverse worded)
A16r Staff worry that mistakes they make are kept in their personnel file (reverse worded)
Patient Safety Grade *E1 Please give your work area/unit in this hospital an overall grade on patient safety
Number of Events Reported †G1 In the past 12 months, how many event reports have you filled out and submitted?
* Single-item measure—grades A through E as response category. † Single-item measure—numeric response categories.
Table A2. The criteria used to assess ICU discharge readiness, as described by Hiller et al. [28].
Table A2. The criteria used to assess ICU discharge readiness, as described by Hiller et al. [28].
Final List of ICU Discharge CriteriaFit for ICU DischargeNeeds Further Intensive Care Therapy/MonitoringValue Calculation Method to Evaluate Discharge ReadinessCriterion Importance RankExceptions When “Mandatory to Be Met”
Respiratory system
1Is the patient’s (own/artificial) airway patent?yesnon.amandatory to be metEOL-care, agreed treatment limits
2Is the cough effective in a way that the patient can be handled at the receiving unit?yesnon.aMandatory to be metEOL-care, agreed treatment limits, p. with low level of consciousness and requiring long-term artificial airway aspiration
3Blood oxygenation: Stable SpO2 (≥ 92% OR stable around lower patient individual baseline value) AND patient is breathing room air?yesnoWorst value must be above threshold value AND trend must be stable over defined time frameMandatory to be metEOL-care, agreed treatment limits, p. with chronic lung disease
4Respiratory rate: Stable RR trend with 10  ≤  resp  ≤  30 (pm)
OR patient’s individual baseline value is met?
yesnoWorst value must be within acceptable range AND trend must be stable over defined time frameMandatory to be metEOL-care
5If further respiratory support is needed, feasible at the receiving unit?yesnon.aMandatory to be met
6If the patient is in need of tracheal suctioning, feasible at the receiving unit?yesnon.aMandatory to be met
7If the patient is in need of long-term tracheostomy, could adequate care be provided at the receiving unit?yesnon.aMandatory to be metIf patient is sufficiently trained and capable to take care of the tracheostomy
Cardiovascular system
8Heart rate: Stable HR trend with 50  ≤  hr  ≤  110 (bpm) OR patient’s individual baseline value is met?yesnoWorst value must be within acceptable range AND trend must be stable over defined time frameMandatory to be metEOL-care, agreed treatment limits, pre-existing bradycardia
9Cardiac rhythm: Stable cardiac rhythm OR tolerable intermittent arrhythmia over defined time frame?yesnoTrend must be stable over defined time frameMandatory to be metEOL-care, agreed treatment limits, p. has intermittent AF but is otherwise hemodynamically stable with controlled ventricular response
10Mean arterial pressure: Stable MAP trend with 60  <  map  ≤  110 (mmHg)
OR patient’s individual baseline value is met?
yesnoWorst value must be within acceptable range AND trend must be stable over defined time frameMandatory to be metEOL-care, agreed treatment limits
11Hypervolemia/hypovolemia: Does the current volemia status require ICU monitoring?noyesn.aMandatory to be met
12Hemoglobin value stable over defined time frame?yesnoTrend must be stable over defined time frameMandatory to be metEOL-care, agreed treatment limits
13Significant active bleeding or high risk of significant bleeding?noyesn.aMandatory to be metEOL-care, agreed treatment limits
14If the patient needs continued monitoring at the receiving unit, are required technology/staff capabilities in place?yesnon.aMandatory to be met
15If the patient carries a percutaneous transient pacemaker, could that be handled at the receiving unit?yesnon.aMandatory to be met
16If low-dose vasoactives are in use, is the patient manageable at the receiving unit?yesnon.aMandatory to be met
Central nervous system
17Can the neurological status of the patient be adequately handled and monitored at the receiving unit?yesnon.aMandatory to be met
Pain
18Pain therapy sufficient and feasible at the receiving unit?yesnon.aMandatory to be met
Urogenital system
19Do urine output, electrolyte level, and renal function allow patient discharge?yesnon.aMandatory to be metEOL-care, agreed treatment limits
20If required, is renal replacement therapy possible outside the ICU?yesnon.aMandatory to be metEOL-care, agreed treatment limits
Fluid loss and drainage
21Could fluid loss or drainage(s) be monitored and handled adequately at the receiving unit?yesnon.aMandatory to be met
Medication and nutrition
22If the patient needs continuous IV application (e.g., insulin, glucose, antibiotics, vasopressors, nutrition), allowed and feasible at the receiving unit?yesnon.amandatory to be met
Patient diagnosis, prognosis, and preferences
23Patient’s preference is to stop intensive care therapy and to leave the ICUyesnon.aNot mandatory to be met
24Therapeutic susceptibility: Patient does not benefit from ICU care anymore and negative effects may outweighyesnon.amandatory to be met
Institution-specific criteria
25Patient no longer meets ICU admission criteria and meets admission criteria for a lower level of careyesnon.amandatory to be met
26Do current acuity and dependency levels and current workload at the receiving unit allow to admit and take care of this patient?yesnon.amandatory to be met
27If the patient is immune compromised or infectious, could the patient be handled and adequately cared for at the receiving unit?yesnon.amandatory to be met
28If discharge at night or weekend cannot be avoided, are measures in place to protect patient safety?yesnon.amandatory to be metEOL-care, agreed treatment limits, prioritarisation against patients with greater need for intensive care

Appendix B. Results

Table A3. Respondents’ characteristics.
Table A3. Respondents’ characteristics.
Intervention GroupControl Group
Survey timeDecember 2022January 2024December 2022January 2024
n = 62n = 56n = 19n = 20
Characteristics
Professionn (%)n (%)n (%)n (%)
Doctor32 (51.6)23 (41.1)3 (15.8)5 (25)
Nurse30 (48.4)33 (58.9)16 (84.2)15 (75)
Years working in the profession
<12 (3.2)2 (3.6)1 (5.2)2 (10)
1–513 (21)14 (25)12 (63.1)9 (45)
6–1017(27.4)17 (30.4)5 (26.3)6 (30)
11–158 (12.9)6 (10.7)02 (10)
16–2011 (17.7)4 (7.1)01 (5)
>2111 (17.7)13 (23.2)1 (5.2)0
Years working in this department
<14 (6.5)2 (3.6)3 (15.8)3 (15)
1–512 (19.4)13 (23.2)9 (47.4)7 (35)
6–1016 (25.8)18 (32.1)5 (26.3)7 (35)
11–158 (12.9)7 (12.5)1 (5.2)3 (15)
16–2012 (19.4)9 (16.1)00
>2110 (16.1)7 (12.5)1 (5.2)0
Years working at this hospital
<14 (6.5)2 (3.6)2 (10.5)3 (15)
1–510 (16.1)12 (21.4)10 (52.6)7 (35)
6–1018 (29)17 (30.4)4 (21.1)6 (30)
11–158 (12.9)7 (12.5)2 (10.5)3 (15)
16–209 (14.5)9 (16.1)01 (5)
>2113 (21)9 (16.1)1 (5.2)0
Weekly working hours
<200000
20–39 h a week1 (1.6)000
40–59 h a week4 (6.5)8 (14.3)02 (10)
60–79 h a week52 (83.9)43 (76.8)19 (100)16 (80)
80–99 h a week4 (6.5)3 (5.4)02 (10)
>100 h a week1 (1.6)2 (3.6)00
Direct contact with patient
Yes62 (100)56 (100)19 (100)20 (100)
No0000
Table A4. Responses to single-item measure—“Patient Safety Grade”—in the first measurement, prior to the intervention.
Table A4. Responses to single-item measure—“Patient Safety Grade”—in the first measurement, prior to the intervention.
December 2022
Patient Safety GradeIntervention GroupControl GroupTotal
Please give your work area/unit in this hospital an overall grade on patient safetyFailing000
Poor 202
Acceptable17320
Very good25934
Excellent12618
Total561874
Table A5. Responses to single-item measure—“Patient Safety Grade”—in the second measurement, after the intervention.
Table A5. Responses to single-item measure—“Patient Safety Grade”—in the second measurement, after the intervention.
January 2024
Patient Safety GradeIntervention GroupControl GroupTotal
Please give your work area/unit in this hospital an overall grade on patient safetyFailing000
Poor123
Acceptable16723
Very good23831
Excellent16319
Total562076
Table A6. Responses to single-item measure—“Number of Events Reported”—in the first measurement, prior to the intervention.
Table A6. Responses to single-item measure—“Number of Events Reported”—in the first measurement, prior to the intervention.
December 2022
Number of Events ReportedIntervention GroupControl GroupTotal
In the past 12 months, how many event reports have you filled out and submitted?No reports45 *1156
1–2 reports14418
3–5 reports145
6–10 reports101
11–20 reports101
Total621981
* χ2(4) = 8.39 p = 0.039, Fisher’s exact test.
Table A7. Responses to single-item measure—“Number of Events Reported”—in the second measurement, after the intervention.
Table A7. Responses to single-item measure—“Number of Events Reported”—in the second measurement, after the intervention.
January 2024
Intervention GroupControl GroupTotal
In the past 12 months, how many event reports have you filled out and submitted?None441256
1–2 reports10717
3–5 reports213
6–10 reports
11–20 reports
Total562076

References

  1. To Err Is Human: Building a Safer Health System; National Academies Press: Washington, DC, USA, 2000; Available online: http://www.nap.edu/catalog/9728 (accessed on 8 April 2024).
  2. Jung, J.J.; Elfassy, J.; Jüni, P.; Grantcharov, T. Adverse Events in the Operating Room: Definitions, Prevalence, and Characteristics. A Systematic Review. World J. Surg. 2019, 43, 2379–2392. [Google Scholar] [CrossRef] [PubMed]
  3. Geneva: World Health Organization. Global Patient Safety Action Plan 2021–2030 Towards Eliminating Avoidable Harm in Health Care 2021. Available online: https://www.who.int/teams/integrated-health-services/patient-safety/policy/global-patient-safety-action-plan (accessed on 15 June 2024).
  4. National Patient Safety Foundation. Free from Harm 2015. Available online: https://www.ihi.org/resources/publications/free-harm-accelerating-patient-safety-improvement-fifteen-years-after-err#downloads (accessed on 10 June 2024).
  5. Panagioti, M.; Khan, K.; Keers, R.N.; Abuzour, A.; Phipps, D.; Kontopantelis, E.; Bower, P.; Campbell, S.; Haneef, R.; Avery, A.J.; et al. Prevalence, severity, and nature of preventable patient harm across medical care settings: Systematic review and meta-analysis. BMJ 2019, 366, l4185a. [Google Scholar] [CrossRef] [PubMed]
  6. National Academies of Sciences, Engineering, and Medicine; Health and Medicine Division; Board on Health Care Services; Board on Global Health; Committee on Improving the Quality of Health Care Globally. Crossing the Global Quality Chasm: Improving Health Care Worldwide 2018. Available online: http://www.ncbi.nlm.nih.gov/books/NBK535653/ (accessed on 20 September 2024).
  7. Kruk, M.E.; Gage, A.D.; Arsenault, C.; Jordan, K.; Leslie, H.H.; Roder-DeWan, S.; Adeyi, O.; Barker, P.; Daelmans, B.; Doubova, S.V.; et al. High-quality health systems in the Sustainable Development Goals era: Time for a revolution. Lancet Glob. Health 2018, 6, e1196–e1252. [Google Scholar] [CrossRef] [PubMed]
  8. The Economics of Patient Safety: Strengthening a Value-Based Approach to Reducing Patient Harm at National Level. OECD Health Working Papers 2017. Available online: https://www.oecd-ilibrary.org/social-issues-migration-health/the-economics-of-patient-safety_5a9858cd-en (accessed on 20 September 2024).
  9. World Health Organization; World Bank Group; OECD. Delivering Quality Health Services: A Global Imperative for Universal Health Coverage 2018. Available online: http://hdl.handle.net/10986/29970 (accessed on 20 September 2024).
  10. Marshall, J.C.; Bosco, L.; Adhikari, N.K.; Connolly, B.; Diaz, J.V.; Dorman, T.; Fowler, R.A.; Meyfroidt, G.; Nakagawa, S.; Pelosi, P.; et al. What is an intensive care unit? A report of the task force of the World Federation of Societies of Intensive and Critical Care Medicine. J. Crit. Care 2017, 37, 270–276. [Google Scholar] [CrossRef]
  11. Andrews, L.B.; Stocking, C.; Krizek, T.; Gottlieb, L.; Krizek, C.; Vargish, T.; Siegler, M. An alternative strategy for studying adverse events in medical care. Lancet 1997, 349, 309–313. [Google Scholar] [CrossRef]
  12. Bracco, D.; Favre, J.B.; Bissonnette, B.; Wasserfallen, J.B.; Revelly, J.P.; Ravussin, P.; Chioléro, R. Human errors in a multidisciplinary intensive care unit: A 1-year prospective study. Intensiv. Care Med. 2001, 27, 137–145. [Google Scholar] [CrossRef]
  13. Osmon, S.; Harris, C.B.; Dunagan, W.C.; Prentice, D.; Fraser, V.J.; Kollef, M.H. Reporting of medical errors: An intensive care unit experience. Crit. Care Med. 2004, 32, 727–733. [Google Scholar] [CrossRef]
  14. Molina, F.J.; Rivera, P.T.; Cardona, A.; Restrepo, D.C.; Monroy, O.; Rodas, D.; Barrientos, J.G. Adverse events in critical care: Search and active detection through the Trigger Tool. World J. Crit. Care Med. 2018, 7, 9–15. [Google Scholar] [CrossRef]
  15. Giraud, T.; Dhainaut, J.F.; Vaxelaire, J.F.; Joseph, T.; Journois, D.; Bleichner, G.; Sollet, J.P.; Chevret, S.; Monsallier, J.F. Iatrogenic complications in adult intensive care units—A prospective two-center study. Crit. Care Med. 1993, 21, 40–51. [Google Scholar] [CrossRef]
  16. Ahmed, A.H.; Giri, J.; Kashyap, R.; Singh, B.; Dong, Y.; Kilickaya, O.; Erwin, P.J.; Murad, M.H.; Pickering, B.W. Outcome of Adverse Events and Medical Errors in the Intensive Care Unit: A Systematic Review and Meta-analysis. Am. J. Med. Qual. 2015, 30, 23–30. [Google Scholar] [CrossRef]
  17. Stelfox, H.T.; Lane, D.; Boyd, J.M.; Taylor, S.; Perrier, L.; Straus, S.; Zygun, D.; Zuege, D.J. A Scoping Review of Patient Discharge From Intensive Care. Chest 2015, 147, 317–327. [Google Scholar] [CrossRef] [PubMed]
  18. Petersen, L.A.; Brennan, T.A.; O’Neil, A.C.; Cook, E.F.; Lee, T.H. Does Housestaff Discontinuity of Care Increase the Risk for Preventable Adverse Events? Ann. Intern. Med. 1994, 121, 866–872. [Google Scholar] [CrossRef] [PubMed]
  19. Bell, C.M.; Brener, S.S.; Gunraj, N.; Huo, C.; Bierman, A.S.; Scales, D.C.; Bajcar, J.; Zwarenstein, M.; Urbach, D.R. Association of ICU or Hospital Admission With Unintentional Discontinuation of Medications for Chronic Diseases. JAMA 2011, 306, 840–847. [Google Scholar] [CrossRef] [PubMed]
  20. Naylor, M.; Brooten, D.; Jones, R.; Lavizzo-Mourey, R.; Mezey, M.; Pauly, M. Comprehensive Discharge Planning for the Hospitalized Elderly: A Randomized Clinical Trial. Ann. Intern. Med. 1994, 120, 999. [Google Scholar] [CrossRef]
  21. Mansukhani, R.P.; Candelario, D.; Eckert, L.J. Exploring Transitional Care: Evidence-Based Strategies for Improving Provider Communication and Reducing Readmissions. Pharm. Ther. 2015, 40, 690–694. [Google Scholar]
  22. Daly, K.; Beale, R.; Chang, R.W.S. Reduction in mortality after inappropriate early discharge from intensive care unit: Logistic regression triage. BMJ 2001, 322, 1274. [Google Scholar] [CrossRef]
  23. Hellings, J.; Schrooten, W.; Klazinga, N.S.; Vleugels, A. Improving patient safety culture. Int. J. Health Care Qual. Assur. 2010, 23, 489–506. [Google Scholar] [CrossRef]
  24. Almoosa, K.F.; Luther, K.; Resar, R.; Patel, B. Applying the New Institute for Healthcare Improvement Inpatient Waste Tool to Identify “Waste” in the Intensive Care Unit. J. Healthc. Qual. 2016, 38, e29–e38. [Google Scholar] [CrossRef]
  25. Hiller, M.; Burisch, C.; Wittmann, M.; Bracht, H.; Kaltwasser, A.; Bakker, J. The current state of intensive care unit discharge practices—Results of an international survey study. Front. Med. 2024, 11, 1377902. [Google Scholar] [CrossRef]
  26. Chan, C.W.; Farias, V.F.; Bambos, N.; Escobar, G.J. Optimizing Intensive Care Unit Discharge Decisions with Patient Readmissions. Oper. Res. 2012, 60, 1323–1341. [Google Scholar] [CrossRef]
  27. You, S.B.; Ulrich, C.M. Ethical considerations in evaluating discharge readiness from the intensive care unit. Nurs. Ethics 2024, 31, 896–906. [Google Scholar] [CrossRef] [PubMed]
  28. Hiller, M.; Wittmann, M.; Bracht, H.; Bakker, J. Delphi study to derive expert consensus on a set of criteria to evaluate discharge readiness for adult ICU patients to be discharged to a general ward—European perspective. BMC Health Serv. Res. 2022, 22, 773. [Google Scholar] [CrossRef] [PubMed]
  29. Chaparro, A.; Keebler, J.R.; Lazzara, E.H.; Diamond, A. Checklists: A Review of Their Origins, Benefits, and Current Uses as a Cognitive Aid in Medicine. Erg. Des. Q. Hum. Factors Appl. 2019, 27, 21–26. [Google Scholar] [CrossRef]
  30. Pronovost, P.; Needham, D.; Berenholtz, S.; Sinopoli, D.; Chu, H.; Cosgrove, S.; Sexton, B.; Hyzy, R.; Welsh, R.; Roth, G.; et al. An Intervention to Decrease Catheter-Related Bloodstream Infections in the ICU. N. Engl. J. Med. 2006, 28, 2725–2732. [Google Scholar] [CrossRef]
  31. Concha-Torre, A.; Alonso, Y.D.; Blanco, S.Á.; Allende, A.V.; Mayordomo-Colunga, J.; Barrio, B.F. The checklists: A help or a hassle? Pediatría Engl. Ed. 2020, 93, e1–e135. [Google Scholar] [CrossRef]
  32. Thomassen, Ø.; Storesund, A.; Søfteland, E.; Brattebø, G. The effects of safety checklists in medicine: A systematic review: Effects of safety checklists in medicine. Acta Anaesthesiol. Scand. 2014, 58, 5–18. [Google Scholar] [CrossRef]
  33. Sevdalis, N.; Hull, L.; Birnbach, D.J. Improving patient safety in the operating theatre and perioperative care: Obstacles, interventions, and priorities for accelerating progress. Br. J. Anaesth. 2012, 109, i3–i16. [Google Scholar] [CrossRef]
  34. Bosk, C.L.; Dixon-Woods, M.; Goeschel, C.A.; Pronovost, P.J. Reality check for checklists. Lancet 2009, 374, 444–445. [Google Scholar] [CrossRef]
  35. Cooper, D.D. Navigating the Safety Culture Construct: A Review of the Evidence 7 June 2016. Available online: https://www.behavioral-safety.com/articles/safety_culture_review.pdf (accessed on 2 August 2024).
  36. Churruca, K.; Ellis, L.A.; Pomare, C.; Hogden, A.; Bierbaum, M.; Long, J.C.; Olekalns, A.; Braithwaite, J. Dimensions of safety culture: A systematic review of quantitative, qualitative and mixed methods for assessing safety culture in hospitals. BMJ Open 2021, 11, e043982. [Google Scholar] [CrossRef]
  37. Nieva, V.; Sorra, J. Safety culture assessment: A tool for improving patient safety in healthcare organizations. Qual. Saf. Health Care 2003, 12 (Suppl. 2), ii17–ii23. [Google Scholar] [CrossRef]
  38. IAEA. Summary Report on the Post-Accident Review Meeting on the Chernobyl Accident 1986. Available online: https://www.iaea.org/publications/3598/summary-report-on-the-post-accident-review-meeting-on-the-chernobyl-accident (accessed on 25 June 2024).
  39. Pronovost, P.; Sexton, B. Assessing safety culture: Guidelines and recommendations. BMJ Qual. Saf. 2005, 14, 231–233. [Google Scholar]
  40. Vikan, M.; Haugen, A.S.; Bjørnnes, A.K.; Valeberg, B.T.; Deilkås, E.C.T.; Danielsen, S.O. The association between patient safety culture and adverse events—A scoping review. BMC Health Serv. Res. 2023, 23, 300. [Google Scholar] [CrossRef] [PubMed]
  41. Heidegger, C.P.; Treggiari, M.M.; Romand, J.A.; the Swiss ICU Network. A nationwide survey of intensive care unit discharge practices. Intensive Care Med. 2005, 31, 1676–1682. [Google Scholar] [CrossRef] [PubMed]
  42. Lin, F.; Chaboyer, W.; Wallis, M. A literature review of organisational, individual and teamwork factors contributing to the ICU discharge process. Aust. Crit. Care 2009, 22, 29–43. [Google Scholar] [CrossRef]
  43. Li, P.; Stelfox, H.T.; Ghali, W.A. A Prospective Observational Study of Physician Handoff for Intensive-Care-Unit-to-Ward Patient Transfers. Am. J. Med. 2011, 124, 860–867. [Google Scholar] [CrossRef]
  44. de la Oliva, P.; Cambra-Lasaosa, F.J.; Quintana-Diaz, M.; Rey-Galan, C.; Sánchez-Díaz, J.I.; Martín-Delgado, M.C.; de Carlos-Vicente, J.C.; Hernandez-Rastrollo, R.; Holanda-Peña, M.S.; Pilar-Orive, F.J.; et al. Admission, discharge and triage guidelines for paediatric intensive care units in Spain. Med. Intensiv. Engl. Ed. 2018, 42, 235–246. [Google Scholar] [CrossRef]
  45. Egol, A.; Fromm, R.; Guntupalli, K.; Fitzpatrick, M.; Kaufman, D.; Nasraway, S. Task Force of the American College of critical care medicine, Society of Critical Care Medicine. Guidelines for intensive care unit admission, discharge and triage. Crit. Care Med. 1999, 27, 633–638. [Google Scholar] [CrossRef]
  46. Nates, J.L.; Nunnally, M.; Kleinpell, R.; Blosser, S.; Goldner, J.; Birriel, B.; Fowler, C.S.; Byrum, D.; Miles, W.S.; Bailey, H.; et al. ICU Admission, Discharge, and Triage Guidelines: A Framework to Enhance Clinical Operations, Development of Institutional Policies, and Further Research. Crit. Care Med. 2016, 44, 1553–1602. [Google Scholar] [CrossRef]
  47. White, P.F.; Song, D. A new scoring system for determining fast-track eligibility after ambulatory anesthesia. Anesth. Analg. 1999, 88, 34S. [Google Scholar] [CrossRef]
  48. Luther, B.; Wilson, R.D.; Kranz, C.; Krahulec, M. Discharge Processes: What Evidence Tells Us Is Most Effective. Orthop. Nurs. 2019, 38, 328–333. [Google Scholar] [CrossRef]
  49. Weiss, M.E.; Yakusheva, O.; Bobay, K.L.; Costa, L.; Hughes, R.G.; Nuccio, S.; Hamilton, M.; Bahr, S.; Siclovan, D.; Bang, J.; et al. Effect of Implementing Discharge Readiness Assessment in Adult Medical-Surgical Units on 30-Day Return to Hospital: The READI Randomized Clinical Trial. JAMA Netw. Open 2019, 2, e187387. [Google Scholar] [CrossRef] [PubMed]
  50. Ead, H. From Aldrete to PADSS: Reviewing Discharge Criteria After Ambulatory Surgery. J. Perianesth. Nurs. 2006, 21, 259–267. [Google Scholar] [CrossRef] [PubMed]
  51. Haynes, A.B.; Weiser, T.G.; Berry, W.R.; Lipsitz, S.R.; Breizat, A.H.S.; Dellinger, E.P.; Herbosa, T.; Joseph, S.; Kibatala, P.L.; Lapitan, M.C.M.; et al. A Surgical Safety Checklist to Reduce Morbidity and Mortality in a Global Population. N. Engl. J. Med. 2009, 360, 491–499. [Google Scholar] [CrossRef] [PubMed]
  52. Haugen, A.S.; Søfteland, E.; Sevdalis, N.; Eide, G.E.; Nortvedt, M.W.; Vincent, C.; Harthug, S. Impact of the Norwegian National Patient Safety Program on implementation of the WHO Surgical Safety Checklist and on perioperative safety culture. BMJ Open Qual. 2020, 9, e000966. [Google Scholar] [CrossRef]
  53. Haugen, A.S.; Søfteland, E.; Eide, G.E.; Sevdalis, N.; Vincent, C.A.; Nortvedt, M.W.; Harthug, S. Impact of the World Health Organization’s Surgical Safety Checklist on safety culture in the operating theatre: A controlled intervention study. BJA 2013, 110, 807–815. [Google Scholar] [CrossRef]
  54. Brborović, H.; Šklebar, I.; Brborović, O.; Brumen, V.; Mustajbegović, J.; Bajić, Ž.; Komerički, M.; Babić, N. Development of a Croatian version of the US Hospital Survey on Patient Safety Culture questionnaire: Dimensionality and psychometric properties. Postgrad. Med. J. 2014, 90, 125–132. [Google Scholar] [CrossRef]
  55. Brborović, H. Prezentizam i Apsentizam Zdravstvenih Djelatnika i Kultura Sigurnosti Bolesnika 2015. Available online: http://medlib.mef.hr/2381/1/Hana%20Brborovi%C4%87%2C%20doktorska%20disertacija%2C%202015-06-01.pdf (accessed on 1 November 2024).
  56. Brborović, H.; Brborović, O.; Brumen, V.; Pavleković, G.; Mustajbegović, J. Are nurse presenteeism and patient safety culture associated: A cross-sectional study. Arch. Ind. Hyg. Toxicol. 2014, 65, 149–156. [Google Scholar] [CrossRef]
  57. Mesarić, J.; Šimić, D. Patient safety culture—How can it be assessed? Liječnički Vj. 2024, 145, 11–12. [Google Scholar] [CrossRef]
  58. Brborović, H.; Brborović, O. Patient safety culture shapes presenteeism and absenteeism: A cross-sectional study among Croatian healthcare workers. Arch. Ind. Hyg. Toxicol. 2017, 68, 185–189. [Google Scholar] [CrossRef]
  59. Brborović, O.; Brborović, H.; Hrain, L. The COVID-19 Pandemic Crisis and Patient Safety Culture: A Mixed-Method Study. Int. J. Environ. Res. Public Health 2022, 19, 2237. [Google Scholar] [CrossRef]
  60. Brborović, O.; Brborović, H.; Nola, I.A.; Milošević, M. Culture of Blame—An Ongoing Burden for Doctors and Patient Safety. Int. J. Environ. Res. Public Health 2019, 16, 4826. [Google Scholar] [CrossRef] [PubMed]
  61. Šklebar, I.; Mustajbegović, J.; Šklebar, D.; Cesarik, M.; Milošević, M.; Brborović, H.; Šporčić, K.; Petrić, P.; Husedžinović, I. How to improve patient safety culture in Croatian hospitals? Acta Clin. Croat. 2016, 55, 370–380. [Google Scholar] [CrossRef] [PubMed]
  62. Šklebar, I.; Habek, D.; Jurković, I.; Šakić, L.; Martinac, M. The correlation between patient safety culture and regional anesthesia development. Period. Biol. 2013, 115, 239–246. [Google Scholar]
  63. Šklebar, I. Osobitosti kulture bolesnikove sigurnosti u općoj bolnici Bjelovar i bolnicama sličnih karakteristika. Rad. Zavoda Za Znan. I Umjetnički Rad U Bjelovar. 2015, 9, 47–67. [Google Scholar]
  64. Stoyanova, R.; Dimova, R.; Tarnovska, M.; Boeva, T.; Dimov, R.; Doykov, I. Comparing patient safety culture in Bulgarian, Croatian and American hospitals—Preliminary results. Med. Pharm. Rep. 2019, 92, 265. [Google Scholar] [CrossRef]
  65. Sorra, J.S.; Dyer, N. Multilevel psychometric properties of the AHRQ hospital survey on patient safety culture. BMC Health Serv. Res. 2010, 10, 199. [Google Scholar] [CrossRef]
  66. Blegen, M.A.; Gearhart, S.; Sehgal, N.L.; Alldredge, B.K. AHRQ’s Hospital Survey on Patient Safety Culture: Psychometric Analyses. J. Patient Saf. 2009, 5, 139–144. [Google Scholar] [CrossRef]
  67. Sorra, J.; Gray, L.; Streagle, S.; Famolaro, T.; Yount, N.; Behm, J. AHRQ Hospital Survey on Patient Safety Culture: User’s Guide; AHRQ Pulication: Washington, DC, USA, 2018; 18-0036-EF. Available online: https://www.ahrq.gov/sites/default/files/wysiwyg/sops/surveys/hospital/hospitalsurvey2-users-guide.pdf (accessed on 21 November 2024).
  68. Dunstan, E.; Cook, J.L.; Coyer, F. Safety culture in intensive care internationally and in Australia: A narrative review of the literature. Aust. Crit. Care 2019, 32, 524–539. [Google Scholar] [CrossRef]
  69. Tlili, M.A.; Aouicha, W.; Sahli, J.; Ben Cheikh, A.; Mtiraoui, A.; Ajmi, T.; Zedini, C.; Chelbi, S.; Ben Rejeb, M.; Mallouli, M. Assessing patient safety culture in 15 intensive care units: A mixed-methods study. BMC Health Serv. Res. 2022, 22, 274. [Google Scholar] [CrossRef]
  70. Huang, D.T.; Clermont, G.; Kong, L.A.N.; Weissfeld, L.A.; Sexton, J.B.; Rowan, K.M.; Angus, D.C. Intensive care unit safety culture and outcomes: A US multicenter study. Int. J. Qual. Health Care 2010, 22, 151–161. [Google Scholar] [CrossRef]
  71. Sexton, J.B.; Helmreich, R.L.; Neilands, T.B.; Rowan, K.; Vella, K.; Boyden, J.; Roberts, P.R.; Thomas, E.J. The Safety Attitudes Questionnaire: Psychometric properties, benchmarking data, and emerging research. BMC Health Serv. Res. 2006, 6, 44. [Google Scholar] [CrossRef]
  72. Profit, J.; Sharek, P.J.; Cui, X.; Nisbet, C.C.; Thomas, E.J.; Tawfik, D.S.; Lee, H.C.; Draper, D.; Sexton, J.B. The Correlation Between Neonatal Intensive Care Unit Safety Culture and Quality of Care. J. Patient Saf. 2020, 16, e310–e316. [Google Scholar] [CrossRef] [PubMed]
  73. WHO. Surgical Safety Checklist 2009. Available online: https://iris.who.int/bitstream/handle/10665/44186/9789241598590_eng_Checklist.pdf (accessed on 13 June 2024).
  74. Borchard, A.; Schwappach, D.L.B.; Barbir, A.; Bezzola, P. A Systematic Review of the Effectiveness, Compliance, and Critical Factors for Implementation of Safety Checklists in Surgery. Ann. Surg. 2012, 256, 925–933. [Google Scholar] [CrossRef] [PubMed]
  75. Haynes, A.B.; Edmondson, L.; Lipsitz, S.R.; Molina, G.; Neville, B.A.; Singer, S.J.; Moonan, A.T.; Childers, A.K.; Foster, R.; Gibbons, L.R.; et al. Mortality Trends After a Voluntary Checklist-based Surgical Safety Collaborative. Ann. Surg. 2017, 266, 923–929. [Google Scholar] [CrossRef] [PubMed]
  76. Molina, G.; Jiang, W.; Edmondson, L.; Gibbons, L.; Huang, L.C.; Kiang, M.V.; Haynes, A.B.; Gawande, A.A.; Berry, W.R.; Singer, S.J. Implementation of the Surgical Safety Checklist in South Carolina Hospitals Is Associated with Improvement in Perceived Perioperative Safety. J. Am. Coll. Surg. 2016, 222, 725–736e5. [Google Scholar] [CrossRef]
  77. Russ, S.; Rout, S.; Sevdalis, N.; Moorthy, K.; Darzi, A.; Vincent, C. Do Safety Checklists Improve Teamwork and Communication in the Operating Room? A System Review. Ann. Surg. 2013, 258, 856–871. [Google Scholar] [CrossRef]
  78. Haynes, A.B.; Weiser, T.G.; Berry, W.R.; Lipsitz, S.R.; Breizat, A.H.S.; Dellinger, E.P.; Dziekan, G.; Herbosa, T.; Kibatala, P.L.; Lapitan, M.C.M.; et al. Changes in safety attitude and relationship to decreased postoperative morbidity and mortality following implementation of a checklist-based surgical safety intervention. BMJ Qual. Saf. 2011, 20, 102–107. [Google Scholar] [CrossRef]
  79. Kawano, T.; Taniwaki, M.; Ogata, K.; Sakamoto, M.; Yokoyama, M. Improvement of teamwork and safety climate following implementation of the WHO surgical safety checklist at a university hospital in Japan. J. Anesth. 2014, 28, 467–470. [Google Scholar] [CrossRef]
  80. Hill, M.R.; Roberts, M.J.; Alderson, M.L.; Gale, T.C.E. Safety culture and the 5 steps to safer surgery: An intervention study. Br. J. Anaesth. 2015, 114, 958–962. [Google Scholar] [CrossRef]
  81. Erestam, S.; Haglind, E.; Bock, D.; Andersson, A.E.; Angenete, E. Changes in safety climate and teamwork in the operating room after implementation of a revised WHO checklist: A prospective interventional study. Patient Saf. Surg. 2017, 11, 4. [Google Scholar] [CrossRef]
  82. Jones, L.; Pomeroy, L.; Robert, G.; Burnett, S.; Anderson, J.E.; Fulop, N.J. How do hospital boards govern for quality improvement? A mixed methods study of 15 organisations in England. BMJ Qual. Saf. 2017, 26, 978–986. [Google Scholar] [CrossRef] [PubMed]
  83. Jones, K.J.; Skinner, A.M.; High, R.; Reiter-Palmon, R. A theory-driven, longitudinal evaluation of the impact of team training on safety culture in 24 hospitals. BMJ Qual. Saf. 2013, 22, 394–404. [Google Scholar] [CrossRef] [PubMed]
  84. Brubakk, K.; Svendsen, M.V.; Hofoss, D.; Hansen, T.M.; Barach, P.; Tjomsland, O. Associations between work satisfaction, engagement and 7-day patient mortality: A cross-sectional survey. BMJ Open 2019, 9, e031704. [Google Scholar] [CrossRef] [PubMed]
  85. Fan, C.J.; Pawlik, T.M.; Daniels, T.; Vernon, N.; Banks, K.; Westby, P.; Wick, E.C.; Sexton, J.B.; Makary, M.A. Association of Safety Culture with Surgical Site Infection Outcomes. J. Am. Coll. Surg. 2016, 222, 122–128. [Google Scholar] [CrossRef]
  86. Han, Y.; Kim, J.S.; Seo, Y. Cross-Sectional Study on Patient Safety Culture, Patient Safety Competency, and Adverse Events. West. J. Nurs. Res. 2020, 42, 32–40. [Google Scholar] [CrossRef]
  87. Mardon, R.E.; Khanna, K.; Sorra, J.; Dyer, N.; Famolaro, T. Exploring Relationships Between Hospital Patient Safety Culture and Adverse Events. J. Patient Saf. 2010, 6, 226–232. [Google Scholar] [CrossRef]
  88. Najjar, S.; Nafouri, N.; Vanhaecht, K.; Euwema, M. The relationship between patient safety culture and adverse events: A study in palestinian hospitals. Saf. Health 2015, 1, 16. [Google Scholar] [CrossRef]
  89. Sammer, C.E.; Lykens, K.; Singh, K.P.; Mains, D.A.; Lackan, N.A. What is Patient Safety Culture? A Review of the Literature. J. Nurs. Sch. 2010, 42, 156–165. [Google Scholar] [CrossRef]
  90. Brown, D.S.; Wolosin, R. Safety Culture Relationships with Hospital Nursing Sensitive Metrics. J. Healthc. Qual. 2013, 35, 61–74. [Google Scholar] [CrossRef]
  91. Draganović, Š.; Offermanns, G. Overview of Patient Safety Culture in Bosnia and Herzegovina with Improvement Recommendations for Hospitals. J. Patient Saf. 2022, 18, 760–769. [Google Scholar] [CrossRef]
  92. Ahmed, S.S.; Van Rijswijk, S.P.; Farooq, A. Work Climate, Improved Communication, and Cohesive Work Linked with Patient Safety Culture: Findings from a Sport Medicine Hospital. Healthcare 2023, 11, 3109. [Google Scholar] [CrossRef] [PubMed]
  93. Páez, A.; Nunan, D.; McCulloch, P.; Beard, D. The influence of intervention fidelity on treatment effect estimates in clinical trials of complex interventions: A metaepidemiological study. J. Clin. Epidemiol. 2025, 177, 111610. [Google Scholar] [CrossRef] [PubMed]
  94. Andrade, C. Internal, External, and Ecological Validity in Research Design, Conduct, and Evaluation. Indian J. Psychol. Med. 2018, 40, 498–499. [Google Scholar] [CrossRef] [PubMed]
Figure 1. The research timeline.
Figure 1. The research timeline.
Healthcare 13 00816 g001
Figure 2. Differences in measured median values of dimensions of patient safety culture between the surgical ICU—intervention group and the medical ICU—control Group in the first measurement (inter-department differences).
Figure 2. Differences in measured median values of dimensions of patient safety culture between the surgical ICU—intervention group and the medical ICU—control Group in the first measurement (inter-department differences).
Healthcare 13 00816 g002
Figure 3. Changes in median values of dimensions of patient safety culture following the intervention of implementing ICU-DRC in the surgical ICU (intra-department changes).
Figure 3. Changes in median values of dimensions of patient safety culture following the intervention of implementing ICU-DRC in the surgical ICU (intra-department changes).
Healthcare 13 00816 g003
Figure 4. Changes in median values of dimensions of patient safety culture in the medical ICU–control group (no intervention, intra-department).
Figure 4. Changes in median values of dimensions of patient safety culture in the medical ICU–control group (no intervention, intra-department).
Healthcare 13 00816 g004
Table 1. Intra-department values and statistically significant differences across 12 PSC dimensions in the intervention (surgical ICU) and control (medical ICU) groups before (December 2022) and after (January 2024) the intervention.
Table 1. Intra-department values and statistically significant differences across 12 PSC dimensions in the intervention (surgical ICU) and control (medical ICU) groups before (December 2022) and after (January 2024) the intervention.
Dimensions of Patient Safety Culture
Median Values
Surgical ICUMedical ICU
December 2022January 2024Δ *Mann–Whitney U testDecember 2022January 2024Δ *Mann–Whitney U test
D1Teamwork Within Units3.75
(min 2.00, max 5.00)
4.00
(min 2.50, max 5.00)
0.25U = 1272.5, p = 0.012, r = −0.232
(small to medium effect)
4.13
(min 2.75, max 5.00)
3.75
(min 2.50, max 5.00)
−0.38
D2Supervisor/Manager Expectations3.80
(min 1.80, max 5.00)
3.80
(min 1.80, max 5.00)
0.00 3.30
(min 2.50, max 4.80)
3.40
(min 1.50, max 5.00)
0.10
D3Organizational Learning–Continuous Improvement3.00
(min 1.33, max 4.33)
3.00
(min 1.67, max 4.33)
0.00 3.00
(min 2.00, max 3.67)
3.17
(min 2.33, max 4.33)
0.17
D4Management Support for Patient Safety2.70
(min 1.00, max 4.70)
3.00
(min 1.00, max 4.70)
0.30 3.00
(min 2.00, max 4.30)
2.70
(min 1.00, max 5.00)
−0.30U = 122.5, p = 0.056, (Bonferroni-corrected α = 0.025) 
r = −0.307 (medium effect)
D5Overall Perceptions of Patient Safety3.50
(min 1.50, max 5.00)
3.80
(min 1.50, max 4.80)
0.30 4.15
(min 2.80, max 5.00)
3.40
(min 1.80, max 5.00)
−0.75U = 112, p = 0.028, (Bonferroni-corrected α = 0.025)
r = −0.353 (medium effect)
D6Feedback Communication About Errors3.17
(min 1.00, max 5.00)
3.50
(min 1.00, max 5.00)
0.33 3.50
(min 1.67, max 4.67)
3.33
(min 1.67, max 5.00)
−0.17
D7Communication Openness3.30
(min 1.70, max 4.70)
3.70
(min 1.30, max 5.00)
0.40 3.70
(min 1.30, max 4.70)
3.15
(min 2.00, max 5.00)
−0.55
D8Frequency of Events Reported3.00
(min 1.00, max 5.00)
3.00
(min 1.00, max 5.00)
0.00 4.00
(min 1.00, max 5.00)
3.67
(min 1.33, max 5.00)
−0.33
D9Teamwork Across Units3.00
(min 1.80, max 4.80)
3.00
(min 2.00, max 4.50)
0.00 3.15
(min 1.80, max 4.50)
2.80
(min 1.30, max 5.00)
−0.35
D10Staffing3.00
(min 1.30, max 5.00)
3.00
(min 1.30, max 4.80)
0.00 2.80
(min 1.30, max 4.00)
2.30
(min 1.00, max 3.50)
−0.50U = 120, p = 0.047, (Bonferroni-corrected α = 0.025),
r = −0.318 (medium effect)
D11Handoffs and Transitions3.40
(min 2.00, max 5.00)
3.80
(min 2.00, max 5.00)
0.40 3.50
(min 2.00, max 5.00)
3.50
(min 2.30, max 5.00)
0.00
D12Nonpunitive Response to Errors2.70
(min 1.30, max 5.00)
3.00
(min 1.30, max 5.00)
0.30 3.15
(min 1.70, max 5.00)
2.70
(min 1.00, max 3.70)
−0.45U = 97.5, p = 0.008,
r = −0.420 (medium to large effect)
* Values in bold represent a positive change in values, while values in italics represent a negative change in values.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Vončina, V.; Brborović, H.; Brborović, O.; Makovšek, A.; Pavičić Šarić, J. Effects of Implementing an ICU Discharge Readiness Checklist on Patient Safety Culture: A Quasi-Experimental Research Study. Healthcare 2025, 13, 816. https://doi.org/10.3390/healthcare13070816

AMA Style

Vončina V, Brborović H, Brborović O, Makovšek A, Pavičić Šarić J. Effects of Implementing an ICU Discharge Readiness Checklist on Patient Safety Culture: A Quasi-Experimental Research Study. Healthcare. 2025; 13(7):816. https://doi.org/10.3390/healthcare13070816

Chicago/Turabian Style

Vončina, Vanja, Hana Brborović, Ognjen Brborović, Alka Makovšek, and Jadranka Pavičić Šarić. 2025. "Effects of Implementing an ICU Discharge Readiness Checklist on Patient Safety Culture: A Quasi-Experimental Research Study" Healthcare 13, no. 7: 816. https://doi.org/10.3390/healthcare13070816

APA Style

Vončina, V., Brborović, H., Brborović, O., Makovšek, A., & Pavičić Šarić, J. (2025). Effects of Implementing an ICU Discharge Readiness Checklist on Patient Safety Culture: A Quasi-Experimental Research Study. Healthcare, 13(7), 816. https://doi.org/10.3390/healthcare13070816

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop