Next Article in Journal
Longer Leukocytes Telomere Length Predicts a Significant Survival Advantage in the Elderly TRELONG Cohort, with Short Physical Performance Battery Score and Years of Education as Main Determinants for Telomere Elongation
Previous Article in Journal
Thirty-Day Readmission Rates after Takotsubo Syndrome with or without Malignancy: A Nationwide Readmissions Database Analysis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Predictive Model of Good Clinical Outcomes in Patients Undergoing Coronary Angiography after Out-of-Hospital Cardiac Arrest: A Prospective, Multicenter Observational Study Conducted by the Korean Cardiac Arrest Research Consortium

by
Jin Ho Beom
1,
Incheol Park
1,
Je Sung You
1,
Yun Ho Roh
2,
Min Joung Kim
1,*,
Yoo Seok Park
1,* and
on behalf of the Korean Cardiac Arrest Research Consortium (KoCARC) Investigators
1
Department of Emergency Medicine, Yonsei University College of Medicine, Seoul 03722, Korea
2
Biostatistics Collaboration Unit, Department of Biomedical Systems Informatics, Yonsei University College of Medicine, Seoul 03722, Korea
*
Authors to whom correspondence should be addressed.
J. Clin. Med. 2021, 10(16), 3695; https://doi.org/10.3390/jcm10163695
Submission received: 7 July 2021 / Revised: 16 August 2021 / Accepted: 17 August 2021 / Published: 20 August 2021
(This article belongs to the Section Emergency Medicine)

Abstract

:
This observational study aimed to develop novel nomograms that predict the benefits of coronary angiography (CAG) after resuscitating patients with out-of-hospital cardiac arrest (OHCA) regardless of the electrocardiography findings and to perform an external validation of these models. Data were extracted from a prospective, multicenter registry of resuscitated patients with OHCA (October 2015–June 2018). New nomograms were developed based on variables associated with survival discharge and neurologic outcomes; their analysis included 723 and 709 patients, respectively. Patient age (p < 0.001), prehospital defibrillation by emergency medical technicians (EMTs) (p = 0.003), prehospital return of spontaneous circulation (ROSC) (p = 0.02), and time from collapse to ROSC (p < 0.001) were associated with survival discharge. Patient age (p < 0.001), prehospital defibrillation by EMTs (p < 0.001), and time from collapse to ROSC (p < 0.001) were associated with neurologic outcomes. The new nomogram had a good predictive performance, with an area under the curve (AUC) of 0.8832 (95% confidence interval (CI): 0.8358–0.9305) for survival discharge and an AUC of 0.9048 (95% CI: 0.8627–0.9469) for neurologic outcomes. Novel nomograms that predict survival discharge and good neurological outcomes after CAG in patients with OHCA were developed and validated; they can be quickly and easily applied to identify patients who will benefit from CAG.

1. Introduction

The management of out-of-hospital cardiac arrest (OHCA) remains a challenge worldwide [1,2]. The current European Resuscitation Council and American Heart Association guidelines recommend that all patients with cardiac arrest with a suspected cardiac cause of arrest and ST-segment elevation on electrocardiography (ECG) undergo emergent coronary angiography (CAG) [3,4]. In addition, these guidelines state that emergent CAG is reasonable for some adult patients with OHCA and suspected cardiac origin who do not have ST-segment elevation on ECG (such as those who are electrically or hemodynamically unstable) [3,4].
Several previous observational studies and meta-analyses including patients without ST-segment elevation on ECG reported a correlation between CAG and improved neurological outcomes [5,6,7]. However, the Coronary Angiography after Cardiac Arrest without ST Segment Elevation trial, conducted by Lemkes et al., reported no improvement in the survival rates of patients resuscitated after OHCA with an initial shockable rhythm in whom no ST segment elevation or signs of shock were present. Additionally, while coronary artery disease was found in 65% of patients who underwent CAG, most of whom were in a stable state, only approximately 15% of the patients had acute unstable lesions, and thrombotic occlusion was reported in only 5% of them [8]. Therefore, not all patients who undergo successful resuscitation after cardiac arrest benefit from CAG.
The objective of this study was to develop novel nomograms that can predict the prognosis of patients who undergo CAG regardless of the ECG findings after OHCA and to perform an external validation of the novel nomograms. The nomograms developed in this study provide a visual representation of a statistical predictive model that produces numerical probabilities of clinical events, which is more exact than the conventional method that uses odds ratios to predict prognosis [9].

2. Materials and Methods

2.1. Study Design and Setting

This observational study utilized data from a prospective, multicenter registry (Korean Cardiac Arrest Research Consortium (KoCARC) registry) of patients with OHCA who were resuscitated between October 2015 and June 2018. The patients received cardiopulmonary resuscitation (CPR) in accordance with advanced cardiac life support recommendations; targeted temperature management (TTM), extracorporeal CPR (E-CPR), CAG, and percutaneous coronary intervention (PCI) were conducted according to each institution’s protocol. The KoCARC is a multicenter, nationwide collaborative research network of 62 participating secondary or tertiary hospitals that was established to comprehend the multitude of studies conducted in the field of OHCA and to reinforce the cooperative effort in conducting these studies [10]. The KoCARC registry was designed to continuously enroll patients with non-traumatic OHCA, who were transported to the emergency departments (EDs) of the participating hospitals. This study excluded patients with OHCA with obvious non-cardiac etiologies, such as trauma, drowning, poisoning, burns, asphyxia, or hanging. In addition, the registry excluded patients with OHCA who had terminal illnesses documented by medical records, patients under hospice care, pregnant women, and patients with pre-documented do-not-attempt-resuscitation cards [10]. This study was approved by the Institutional Review Board of Yonsei University College of Medicine, Severance Hospital (no. 4-2015-1162) as well as the institutional review boards of each of the participating hospitals. The KoCARC registry database was registered at clinicaltrials.gov as protocol number NCT03222999.

2.2. Korean Emergency Medical Service (EMS) System

The Korean EMS system is a basic-to-intermediate level ambulance service operated by 16 provincial headquarters of the National Fire Department and a single-tiered, fire-based EMS system [11]. The most qualified emergency medical technician (EMT) performs CPR with an automated external defibrillator, evaluates the cardiac rhythm at scene, provides advanced airway management, and administers intravenous fluids. EMTs are not allowed to declare death or stop CPR on the scene unless the patient regains a pulse in the field or during transport to an ED; therefore, all EMS-assessed patients are transported to the nearest ED. In the case of prehospital EMS in Korea, E-CPR is not implemented [12].

2.3. Study Population

The KoCARC registry included data of 874 patients, who underwent CAG regardless of ECG findings (both ST elevation and non-ST elevation) after the return of spontaneous circulation (ROSC), registered from October 2015 to June 2018. In this study, patients aged <18 years, those transferred from other hospitals after ROSC, and those with unknown primary or secondary outcomes at hospital discharge were excluded. For time-related variables (including the time required for emergency medical service (EMS) response), values that were more than two standard deviations (SDs) from the mean were excluded from the data analysis [13].

2.4. Data Collection

All data of the KoCARC registry were anonymized and collected using a web-based case report form (CRF) by the research coordinator at each institution. The CRF comprised seven research fields classified with variables related to OHCA. Each field contained core and optional variables. To improve data quality, the web-based data entry system filtered out outliers or inaccurate values. The research coordinator of each participating hospital was responsible for ensuring data accuracy. The research committee sought to improve the quality of the data by regularly monitoring the data and providing continuous feedback regarding inaccurate data [10].
The following data were retrieved from the KoCARC registry: patient demographics, comorbidities (hypertension, diabetes mellitus, and dyslipidemia), prehospital characteristics (witnessed arrest, place of arrest, bystander cardiopulmonary resuscitation [CPR], prehospital defibrillation by bystanders or EMS personnel, primary ECG rhythm at the scene, and epinephrine use by EMS providers), hospital characteristics (ROSC at ED arrival, initial ECG rhythm at hospital, and total dose of epinephrine used at hospital), post-ROSC characteristics (E-CPR, TTM, coronary angiographic finding, PCI, and vasopressor use in the hospital), cardiac markers, and time intervals (time from EMS call to scene arrival, time from collapse to ED arrival, time from collapse to ROSC, and time from ED arrival to CAG).

2.5. Outcome Measurements

The primary endpoint was survival at hospital discharge. The secondary outcome was a favorable neurologic recovery at hospital discharge, defined as a cerebral performance category (CPC) score of 1 or 2.

2.6. Statistical Analyses

All statistical analyses were performed using the R software, version 3.4.3 for Windows (The R Foundation for Statistical Computing, Vienna, Austria). Continuous variables are presented as means ± SDs, and categorical variables are presented as frequencies (percentages). Independent two-sample t-tests were used to compare continuous variables, and the chi-squared test or Fisher’s exact test was used to compare categorical variables, as appropriate.
The study population was randomly allocated to either a training or validation set at a 7:3 ratio using the split sample validation method. In the training set, a univariate logistic regression analysis was performed to evaluate the prognostic ability of each variable for the primary and secondary outcomes. Then, a multivariable logistic regression analysis with variables with <20% missing data that had a p-value < 0.05 on the univariate binary logistic regression was performed. The variables that were identified as independently associated with survival or neurologic outcomes at hospital discharge were used to create the novel nomograms using the training data set. The performances of the nomograms were evaluated with respect to discrimination and calibration [14]. The predictive accuracies (discriminations) of the models were assessed using area under the receiver-operating characteristic curve (AUC) values and 95% confidence intervals (CIs), which quantify the level of concordance between the predicted probabilities and actual chance of the event of interest occurring. The accuracy of the novel nomograms was internally validated using the bootstrap method using resampling 1000 times of simple random sampling with replacement. The calibration of the nomograms represents how accurate the predicted probabilities are compared with the observed outcome frequencies using graphic representations (calibration curves). A curve along a 45-degree line indicates a perfect calibration model in which the predicted probabilities are identical to the actual outcomes. The calibration curves are presented as apparent and bias-corrected calibration plots using the bootstrapping methods with 500 re-samples. The predictive accuracy and calibration of the novel nomograms generated with the training set were subsequently tested in the validation set. In addition, to verify whether our novel nomogram would be applicable to the patients irrespective of the CAG findings, we performed the sensitivity analysis. According to the CAG findings, the group was divided into patients without actual lesions (normal coronary, insignificant lesion) and patients with actual lesions or decreased blood flow (notable stenosis, vasospasm). All reported p-values are two-sided, and statistical significance was set at p < 0.05.

3. Results

Within the study period, 7576 patients with OHCA were registered in the KoCARC registry. Of these, 874 patients underwent CAG after ROSC. Patients who transferred from other hospitals (n = 108), were aged <18 years (n = 1), or had missing data regarding mortality (n = 17) or CPC score (n = 14) at hospital discharge and patients with data outliers of time variables (n = 25) were excluded from the study. The final analyses included 723 patients for the survival outcome group and 709 patients for the neurological outcome group (Figure 1). Among the 723 patients in the survival outcome group, we could confirm the CAG findings in 519 patients in the KoCARC registry: normal coronary findings in 84 patients (16.2%), an insignificant lesion in 69 patients (13.3%), significant stenosis in 303 patients (58.4%), and vasospasm in 63 patients (12.1%). Of the 723 patients in the survival outcome group, 273 (168 survivors/105 deaths) underwent PCI. Among the 709 patients in the neurological outcome group, we could confirm the CAG findings in 508 patients: normal coronary, 83 patients (16.3%); insignificant lesion, 67 patients (13.2%); significant stenosis, 296 patients (58.3%); and vasospasm, 62 patients (12.2%). Among the 709 patients in the neurological outcome group, 268 (144 good neurologic outcomes/124 poor neurologic outcomes) underwent PCI.
The training set for the survival outcome analyses included 496 patients, and the validation set included 227 patients. The baseline characteristics are summarized in Table 1.
In the univariate logistic regression analysis, patient age, medical history, bystander CPR, shockable rhythm at the scene, prehospital defibrillation by bystanders or EMS providers, epinephrine use by EMS providers, prehospital ROSC, initial shockable rhythm at hospital arrival, total dose of epinephrine used during CPR in the hospital, diastolic blood pressure, vasopressor use in the hospital, and time-related variables (time from EMS call to scene arrival, time from collapse to ROSC, and time from ED arrival to CAG) were identified as significantly associated with survival discharge after CAG (Table 1). Among them, patient age (p < 0.001), prehospital defibrillation by EMS providers (p = 0.003), prehospital ROSC (p = 0.02), and time from collapse to ROSC (p < 0.001) were identified as independent prognostic factors for survival discharge using multivariable logistic regression analysis (Table 2).
These four prognostic factors were included in the novel nomogram for predicting survival discharge after CAG. The time from collapse to ROSC (min) was the factor that contributed the most to the prediction of survival discharge after performing CAG, followed by patient age (Figure 2a). The total points of the variables in the nomogram allowed for the prediction of the survival discharge probability of the patients in the CAG group. For example, a 65-year-old (25 points) patient who was defibrillated by EMS providers (20 points) with ROSC before hospital arrival (17.5 points) and a time from collapse to ROSC of 10 min (92.5 points) would have a total score of 155 and a predicted probability of survival discharge of approximately 90%. The discriminative ability of the novel nomogram was good, with an AUC of 0.8832 (95% CI: 0.8358–0.9305). The AUC of the internally validated nomogram was 0.8881 (95% CI: 0.8386–0.9339), with a statistical power similar to that of the initial nomogram. In the validation set, the discrimination was excellent, with an AUC of 0.9002 (95% CI: 0.869–0.9315) (Figure 2b). The calibration plot of the nomogram demonstrated an excellent agreement between the predicted and observed probabilities of survival discharge in both sets (Figure 2c). The sensitivity analysis in patients with or without actual lesions showed that the AUC values of the novel nomogram were 0.8557 (95% CI: 0.7832–0.9281) and 0.9439 (95% CI: 0.8824–0.9999), which were not significantly different from that of the initial nomogram (p = 0.53 and p = 0.13, respectively).
The training set for the neurologic outcome analyses included 489 patients, and the validation set included 220 patients. The baseline characteristics and variables found to be associated with favorable neurologic outcomes are summarized in Table 3. Patient age (p < 0.001), prehospital defibrillation by EMS providers (p < 0.001), and time from collapse to ROSC (p < 0.001) were identified as independent prognostic factors for neurologic outcomes (Table 2).
These three prognostic factors were included in the novel nomogram for predicting neurologic outcomes at hospital discharge. The time from collapse to ROSC was the most contributing factor in this nomogram (Figure 3a). The AUC of the nomogram was 0.9048 (95% CI: 0.8627–0.9469), and the internally validated AUC was 0.9070 (95% CI: 0.8554–0.9509). In the validation set, the discrimination of the nomogram was good, with an AUC of 0.8742 (95% CI: 0.8383–0.9101) (Figure 3b). The calibration plot of the nomogram demonstrated a good agreement in both sets (Figure 3c). The sensitivity analysis in patients with or without actual lesions showed that the AUC values of the novel nomogram were 0.8906 (95% CI: 0.8234–0.9579) and 0.9490 (95% CI: 0.8872–0.9999), which were not significantly different to that of the initial nomogram (p = 0.73 and p = 0.25, respectively).

4. Discussion

In this study, novel nomograms that predict survival discharge and good neurological outcomes for performing CAG in patients with OHCA were developed and validated. To the best of our knowledge, this is the first study to create a nomogram that determines if CAG will be beneficial by considering various variables in patients with OHCA. These nomograms were based on patient age, prehospital ROSC, prehospital defibrillation by EMS providers, and time from collapse to ROSC, which are readily available data at the prehospital and in-hospital stages of treatment. Therefore, they can be used in an emergency situation and easily applied to each patient individually.
The time from collapse to ROSC was the most contributing variable in the nomograms predicting survival discharge and good neurologic outcomes at hospital discharge after CAG in patients with OHCA. The time from collapse to ROSC may be associated with ischemia. Cardiac ischemia and adenosine triphosphate depletion are believed to worsen over time after cardiac arrest [15]. Longer ischemic periods result in worsened neurological prognoses, and ultimately, increased probabilities of death. Therefore, the time from collapse to ROSC affects the severity of hypoxic-ischemic brain injuries and is one of the major causes of death after cardiac arrest [16,17]. Thus, the time from collapse to ROSC is an important factor for determining the benefits of CAG. Patient age and prehospital defibrillation by EMS providers are also common variables to both nomograms. Several previous studies have reported that a younger age and the use of automated external defibrillators at the scene are associated with better outcomes for patients with OHCA [18,19,20]. Patient age has more influence on the survival discharge in this study. Prehospital ROSC was included on the survival discharge nomogram and not on the neurologic outcome nomogram. A study conducted by David et al. reported that cardiac arrest survival is rare without prehospital ROSC [21]. Another study reported that patients with an initial shockable rhythm or EMS-witnessed arrest in the absence of field ROSC had a survival rate of 0.5% [22]. The results of these previous studies support the nomograms developed in this study.
Recent studies have reported that performing CAG early improved the neurological outcomes and survival rate regardless of ECG findings in survivors of OHCA [23,24]. One study showed that early CAG may be associated with improved survival in patients with bystander-witnessed OHCA with shockable rhythms [25]. However, other studies have reported no association between early CAG and survival in patients with non-ST elevation after cardiac arrest [26,27]. In this study, the time from ED arrival to CAG was approximately 10 times longer in the survival group than in the deceased group (2042.5 ± 4903.8 min vs. 204.6 ± 727.3 min; p < 0.001) and approximately five times longer in the good neurologic outcome group than in the poor neurologic outcome group (2184.0 ± 4916.1 min vs. 483.7 ± 2535.2 min; p < 0.001). These results should not be interpreted to mean that delayed or late CAG results in better outcomes than early CAG. Rather, these results may be attributed to the fact that severely ill patients often receive early CAG, resulting in decreased survival rates and poor neurological outcomes among patients who receive early CAG. In contrast, hemodynamically stable patients who have regained consciousness may receive delayed CAG. The results of previous studies combined with those of this study indicate that it is difficult to decide whether to perform CAG simply based on time because of the various clinical situations that act as confounding factors. Therefore, the novel nomogram developed in this study is a good alternative for deciding whether or not to perform CAG.
This study is not without limitations. First, despite the constant efforts of the KoCARC registry committee to improve the reliability and accuracy of the data, some patients had inaccurate or missing data, which could not be included in this study. Second, only data regarding survival and neurologic prognoses at the time of hospital discharge were collected, although long-term data were not collected in this study. Third, some outlier data for time-related variables were excluded to increase the reliability of the study. Fourth, this study did not include the data of some variables such as echocardiographic finding, which was important to identify clinically relevant characteristics of the patients. Fifth, in the case of patients who underwent E-CPR, different results were obtained, but the analysis was not conducted owing to the small number of patients who underwent E-CPR in this study. Finally, data regarding ST segment elevation on the initial ECG were not available in the KoCARC registry. For the practical application of the newly developed nomogram, further validations including patients with suspected cardiac causes of arrest and non-ST segment elevation are needed.

5. Conclusions

Novel nomograms that predict survival discharge and good neurological outcomes of patients with OHCA undergoing CAG were developed and validated in this study. These nomograms use data that can be obtained during the prehospital and hospital resuscitation period and can be quickly and easily applied to decide if CAG should be performed in resuscitated patients with OHCA.

Author Contributions

J.H.B., I.P. and J.S.Y.: conceptualization, methodology, and software; J.H.B.: data curation and writing—original draft preparation; I.P., Y.S.P. and M.J.K.: visualization and investigation; M.J.K. and Y.S.P.: supervision; Y.H.R.: software and validation; I.P. and J.S.Y.: writing—reviewing and editing. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

This study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Institutional Review Board of Yonsei University College of Medicine, Severance Hospital (no. 4-2015-1162), as well as the institutional review board of each participating hospital. The KoCARC registry database was registered at clinicaltrials.gov as protocol number NCT03222999.

Informed Consent Statement

This study was a retrospective study, and consent wavier has been approved from our IRB because it was not possible to obtain patient consent.

Data Availability Statement

Restrictions apply to the availability of these data. Data was obtained from KoCARC and are available with the permission of KoCARC.

Acknowledgments

We would like to acknowledge and thank investigators from all participating hospitals of KoCARC: Woon Yong Kwon (Seoul National University Hospital), Sang Kuk Han, Phil Cho Choi (Kangbuk Samsung Medical Center), Sang O Park, Jong Won Kim (Konkuk University Medical Center), Han Sung Choi, Jong Seok Lee (Kyung Hee University Hospital), Sung Hyuk Choi, Young Hoon Yoon (Korea University Guro Hospital), Su Jin Kim, Kap Su Han (Korea University Anam Hospital), Min Seob Sim, Gun Tak Lee (Samsung Medical Center), Shin Ahn (Asan Medical Center), Jong Whan Shin, Hui Jai Lee (SMG-SNU Boramae Medical Center), Keun Hong Park, Hahn Bom Kim (Seoul Medical Center), Tae Young Kong (Yonsei University Gangnam Severance Hospital), Chu Hyun Kim (Inje University Seoul Paik Hospital), Youngsuk Cho (Hallym University Kangdong Sacred Heart Hospital), Gu Hyun Kang, Yong Soo Jang (Hallym University Kangnam Sacred Heart Hospital), Tai Ho Im, Jae Hoon Oh (Hanyang University Seoul Hospital), Seok Ran Yeom, Sung Wook Park (Pusan National University Hospital), Jae Hoon Lee (Dong-A University Hospital), Jae Yun Ahn (Kyungpook National University Hospital), Kyung Woo Lee, Tae Chang Jang (Daegu Catholic University Medical Center), Jae-hyug Woo (Gachon University Gil Medical Center), Woon Jeong Lee, Seon Hee Woo (The Catholic University of Korea Incheon St. Mary’s Hospital), Sung Hyun Yun, Jin Won Park (Catholic Kwandong University International St. Mary’s Hospital), Sun Pyo Kim, Yong Jin Park (Chosun University Hospital), Jin Woong Lee, Wonjoon Jeong (Chungnam National University Hospital), Sung Soo Park, Jae Kwang Lee (Konyang University Hospital), Ryeok Ahn, Wook Jin Choi (Ulsan University Hospital), Young Gi Min, Eun Jung Park (Ajou University Hospital), You Hwan Jo, Joong Hee Kim (Seoul National University Bundang Hospital), In Byung Kim, Ki Ok Ahn (Myongji Hospital), Han Jin Cho (Korea University Ansan Hospital), Seung Cheol Lee, Sang Hun Lee (Dongguk University Ilsan Hospital), Young Sik Kim (Bundang Jesaeng Hospital), Jin Sik Park (Sejong Hospital), Dai Han Wi (Wonkwang University Sanbon Hospital), Ok Jun Kim, Min Woo Kang (Cha University Bundang Medical Center), Sang Ook Ha, Won Seok Yang (Hallym University Pyeongchon Sacred Heart Hospital), Soon Joo Wang, Hang A Park (Hallym University Dongtan Sacred Heart Hospital), Jun Hwi Cho, Chan Woo Park (Kangwon National University Hospital), An Mu Eob, Tae Hun Lee (Hallym University Chuncheon Sacred Heart Hospital), Sang Chul Kim, Hoon Kim (Chungbuk National University Hospital), Han Joo Choi, Chan Young Koh (Dankook University Hospital), Hyung Jun Moon, Dong Kil Jeong (Soonchunhyang University Cheonan Hospital), Tae Oh Jung, Jae Chol Yoon (Chonbuk National University Hospital), Seung Yong Lee, Young Tae Park (Dongguk University Gyeongju Hospital), Jin Hee Jeong, Soo Hoon Lee (Gyeongsang National University Hospital), Ji Ho Ryu, Mun Ki Min (Pusan National University Yangsan Hospital), Won Kim, Yi Sang Moon (Cheju Halla General Hospital), Sung Wook Song, Woo Jung Kim (Jeju National University Hospital), Joon-myoung Kwon, Eui Hyuk Kang (Mediplex Sejong Hospital), Sang Chan Jin, Tae-kwon Kim (Keimyung University Dongsan Medical Center), Hyuk Joong Choi (Hanyang University Guri Hospital), Seong Chun Kim (Gyeongsang National University Changwon Hospital), In Soo Cho (Hanil General Hospital). To steering committee, comprised of following individuals: Sung Oh Hwang (Chair, Wonju Severance Christian Hospital), Sang Do Shin (Chair of Steering Committee, Seoul National University hospital), Hyuk Jun Yang (Advisory Committee, Gachon University Gil hospital), Sung Phil Chung (Data Safety and Management Board, Yonsei University Gangnam Severance Hospital), Sung Woo Lee (Security and Monitoring Board, Korea University Anam hospital), Kyung Jun Song (Secretariat, SMG-SNU Boramae Medical Center), Seung Sik Hwang (Epidemiology and Prevention Research Committee, Seoul National University), Gyu Chong Cho (Community Resuscitation Research Committee, Hallym University Kangdong Sacred Heart Hospital), Hyun Wook Ryoo (Emergency Medical Service Resuscitation Research Committee, Kyungpook National University Hospital), Kyoung Chul Cha (Hospital Resuscitation Research Committee, Wonju Severance Christian Hospital), Won Young Kim (Hypothermia and Post-Resuscitation Care Research Committee, Asan Medical Center), Sang Hoon Na (Cardiac Care Resuscitation Research Committee, Seoul National University Hospital), and Young Ho Kwack (Pediatric Resuscitation Research Committee, Seoul National University hospital). We would also like to thank the members of the Secretariat: Jeong Ho Park (Seoul National University Hospital), Sun Young Lee (Seoul National University Hospital), and Sung Kyung Kim (Seoul National University Hospital); the National Fire Agency for providing prehospital EMS data; and the Korean Association of Cardiopulmonary Resuscitation (KACPR) for its support. Yoo Seok Park was supported by the Basic Science Research Program through the National Research Foundation of Korea funded by the Ministry of Education (NRF-2018R1D1A2B07049888). The funding bodies had no role in the design, collection, analysis, or interpretation of this study. For the remaining authors, no conflicts of interest or sources of funding are declared.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Sasson, C.; Rogers, M.A.; Dahl, J.; Kellermann, A.L. Predictors of survival from out-of-hospital cardiac arrest: A systematic review and meta-analysis. Circ. Cardiovasc. Qual. Outcomes 2010, 3, 63–81. [Google Scholar] [CrossRef] [Green Version]
  2. Fugate, J.E.; Brinjikji, W.; Mandrekar, J.N.; Cloft, H.J.; White, R.D.; Wijdicks, E.F.; Rabinstein, A.A. Post-cardiac arrest mortality is declining: A study of the US National Inpatient Sample 2001 to 2009. Circulation 2012, 126, 546–550. [Google Scholar] [CrossRef] [Green Version]
  3. Nolan, J.P.; Sandroni, C.; Bottiger, B.W.; Cariou, A.; Cronberg, T.; Friberg, H.; Genbrugge, G.; Haywood, K.; Lilja, G.; Moulaert, V.R.M.; et al. European Resuscitation Council and European Society of Intensive Care Medicine Guidelines 2021: Post resuscitation care. Resuscitation 2021, 161, 220–269. [Google Scholar] [CrossRef]
  4. Panchal, A.R.; Bartos, J.A.; Cabañas, J.G.; Cariou, A.; Cronberg, T.; Friberg, H.; Genbrugge, C.; Haywood, K.; Lilja, G.; Moulaert, V.R.; et al. Part 3: Adult basic and advanced life support 2020 American Heart Association guidelines for cardiopulmonary resuscitation and emergency cardiovascular care. Circulation 2020, 142, 428–429. [Google Scholar] [CrossRef]
  5. Garcia, S.; Drexel, T.; Bekwelem, W.; Raveendran, G.; Caldwell, E.; Hodgson, L.; Wang, Q.; Adabag, S.; Mahoney, B.; Frascone, R.; et al. Early access to the cardiac catheterization laboratory for patients resuscitated from cardiac arrest due to a shockable rhythm: The Minnesota Resuscitation Consortium Twin Cities Unified Protocol. J. Am. Heart Assoc. 2016, 5, e002670. [Google Scholar] [CrossRef] [Green Version]
  6. Kern, K.B.; Lotun, K.; Patel, N.; Mooney, M.R.; Hollenbeck, R.D.; McPherson, J.A.; McMullan, P.W.; Unger, B.; Hsu, C.H.; Seder, D.B. INTCAR-Cardiology Registry. Outcomes of comatose cardiac arrest survivors with and without ST-segment elevation myocardial infarction: Importance of coronary angiography. JACC Cardiovasc. Interv. 2015, 8, 1031–1040. [Google Scholar] [CrossRef] [Green Version]
  7. Khan, M.S.; Shah, S.M.M.; Mubashir, A.; Khan, A.R.; Fatima, K.; Schenone, A.L.; Khosa, F.; Samady, H.; Menon, V. Early coronary angiography in patients resuscitated from out of hospital cardiac arrest without ST-segment elevation: A systematic review and meta-analysis. Resuscitation 2017, 121, 127–134. [Google Scholar] [CrossRef] [PubMed]
  8. Lemkes, J.S.; Janssens, G.N.; van der Hoeven, N.W.; Jewbali, L.S.; Dubois, E.A.; Meuwissen, M.; Rijpstra, T.; Rijpstra, T.A.; Bosker, H.A.; Blans, M.J.; et al. Coronary angiography after cardiac arrest without ST-segment elevation. N. Engl. J. Med. 2019, 380, 1397–1407. [Google Scholar] [CrossRef] [PubMed]
  9. Demsar, J.; Zupan, B.; Kattan, M.W.; Beck, J.R.; Bratko, I. Naïve Bayesian-based nomogram for prediction of prostate cancer recurrence. Stud. Health Technol. Inform. 1999, 436–441. [Google Scholar] [CrossRef]
  10. Kim, J.Y.; Hwang, S.O.; Shin, S.D.; Yang, H.J.; Chung, S.P.; Lee, S.W.; Song, K.J.; Hwang, S.S.; Cho, G.C.; Moon, S.W.; et al. Korean Cardiac Arrest Research Consortium (KoCARC): Rationale, development, and implementation. Clin. Exp. Emerg. Med. 2018, 5, 165–176. [Google Scholar] [CrossRef] [PubMed]
  11. Lee, D.W.; Moon, H.J.; Heo, N.H.; KoCARC. Association between ambulance response time and neurologic outcome in patients with cardiac arrest. Am. J. Emerg. Med. 2019, 37, 1999–2003. [Google Scholar] [CrossRef]
  12. Song, K.J.; Shin, S.D.; Park, C.B.; Kim, J.Y.; Kim, D.K.; Kim, C.H.; Ha, S.Y.; Marcus, E.; Bentley, J.; Bryan, M. Dispatcher-assisted bystander cardiopulmonary resuscitation in a metropolitan city: A before-after population-based study. Resuscitation 2014, 85, 34–41. [Google Scholar] [CrossRef]
  13. Miller, J. Reaction time analysis with outlier exclusion: Bias varies with sample size. Q. J. Exp. Psychol. A 1991, 43, 907–912. [Google Scholar] [CrossRef] [PubMed]
  14. Iasonos, A.; Schrag, D.; Raj, G.V.; Panageas, K.S. How to build and interpret a nomogram for cancer prognosis. J. Clin. Oncol. 2008, 26, 1364–1370. [Google Scholar] [CrossRef]
  15. Koretsune, Y.; Marban, E. Mechanism of ischemic contracture in ferret hearts: Relative roles of [Ca2+] i elevation and ATP depletion. Am. J. Physiol. 1990, 258, H9–H16. [Google Scholar] [CrossRef] [PubMed]
  16. Fries, M.; Tang, W.; Chang, Y.T.; Wang, J.; Castillo, C.; Weil, M.H. Microvascular blood flow during cardiopulmonary resuscitation is predictive of outcome. Resuscitation 2006, 71, 248–253. [Google Scholar] [CrossRef]
  17. Laver, S.; Farrow, C.; Turner, D.; Nolan, J. Mode of death after admission to an intensive care unit following cardiac arrest. Intensive Care Med. 2004, 30, 2126–2128. [Google Scholar] [CrossRef] [PubMed]
  18. Aissaoui, N.; Bougouin, W.; Dumas, F.; Beganton, F.; Chocron, R.; Varenne, O.; Spaulding, C.; Karam, N.; Montalescot, G.; Aubry, P.; et al. Age and benefit of early coronary angiography after out-of-hospital cardiac arrest in patients presenting with shockable rhythm: Insights from the Sudden Death Expertise Center registry. Resuscitation 2018, 128, 126–131. [Google Scholar] [CrossRef]
  19. Mader, T.J.; Nathanson, B.H.; Millay, S.; Coute, R.A.; Clapp, M.; McNally, B. Out-of-hospital cardiac arrest outcomes stratified by rhythm analysis. Resuscitation 2012, 83, 1358–1362. [Google Scholar] [CrossRef]
  20. Dumas, F.; Bougouin, W.; Geri, G.; Lamhaut, L.; Rosencher, J.; Pène, F.; Chiche, J.D.; Varenne, O.; Carli, P.; Jouven, X.; et al. Emergency percutaneous coronary intervention in post-cardiac arrest patients without ST-segment elevation pattern: Insights from the PROCAT II registry. JACC Cardiovasc. Interv. 2016, 9, 1011–1018. [Google Scholar] [CrossRef]
  21. Wampler, D.A.; Collett, L.; Manifold, C.A.; Velasquez, C.; McMullan, J.T. Cardiac arrest survival is rare without prehospital return of spontaneous circulation. Prehosp. Emerg. Care 2012, 16, 451–455. [Google Scholar] [CrossRef]
  22. Morrison, L.; Visentin, L.; Kiss, A. Validation of a rule for termination of resuscitation in out-of-hospital cardiac arrest. N. Engl. J. Med. 2006, 355, 478–487. [Google Scholar] [CrossRef]
  23. Kim, M.J.; Ro, Y.S.; Shin, S.D.; Song, K.J.; Ahn, K.O.; Hong, S.O.; Kim, Y.T. Association of emergent and elective percutaneous coronary intervention with neurological outcome and survival after out-of-hospital cardiac arrest in patients with and without a history of heart disease. Resuscitation 2015, 97, 115–121. [Google Scholar] [CrossRef] [PubMed]
  24. Camuglia, A.C.; Randhawa, V.K.; Lavi, S.; Walters, D.L. Cardiac catheterization is associated with superior outcomes for survivors of out of hospital cardiac arrest: Review and meta-analysis. Resuscitation 2014, 85, 1533–1540. [Google Scholar] [CrossRef]
  25. Elfwén, L.; Lagedal, R.; James, S.; Jonsson, M.; Jensen, U.; Ringh, M.; Claesson, A.; Oldgren, J.; Herlitz, J.; Rubertsson, S.; et al. Coronary angiography in out-of-hospital cardiac arrest without ST elevation on ECG—Short- and long-term survival. Am. Heart J. 2018, 200, 90–95. [Google Scholar] [CrossRef] [PubMed]
  26. Dankiewicz, J.; Nielsen, N.; Annborn, M.; Cronberg, T.; Erlinge, D.; Gasche, Y.; Hassager, C.; Kjaergaard, J.; Pellis, T.; Friberg, H. Survival in patients without acute ST elevation after cardiac arrest and association with early coronary angiography: A post hoc analysis from the TTM trial. Intensive Care Med. 2015, 41, 856–864. [Google Scholar] [CrossRef]
  27. Bro-Jeppesen, J.; Kjaergaard, J.; Wanscher, M.; Pedersen, F.; Holmvang, L.; Lippert, F.K.; Møller, J.E.; Køber, L.; Hassager, C. Emergency coronary angiography in comatose cardiac arrest patients: Do real-life experiences support the guidelines? Eur. Heart J. Acute Cardiovasc. Care 2012, 1, 291–301. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Patient flowchart. Abbreviations: KoCARC: Korean Cardiac Arrest Research Consortium, ROSC: return of spontaneous circulation, CAG: coronary angiography, CPC: cerebral performance category.
Figure 1. Patient flowchart. Abbreviations: KoCARC: Korean Cardiac Arrest Research Consortium, ROSC: return of spontaneous circulation, CAG: coronary angiography, CPC: cerebral performance category.
Jcm 10 03695 g001
Figure 2. Nomogram for predicting survival discharge. (a) The novel nomogram for predicting survival discharge developed using the training data set is shown. (b) The discriminative ability of the nomogram is excellent, with an area under the curve of 0.9002 (95% confidence interval: 0.869–0.9315). (c) The calibration plot of the prediction model indicates good agreement between the predicted and observed probabilities of survival discharge. Abbreviations: EMS: emergency medical service, ROSC: return of spontaneous circulation.
Figure 2. Nomogram for predicting survival discharge. (a) The novel nomogram for predicting survival discharge developed using the training data set is shown. (b) The discriminative ability of the nomogram is excellent, with an area under the curve of 0.9002 (95% confidence interval: 0.869–0.9315). (c) The calibration plot of the prediction model indicates good agreement between the predicted and observed probabilities of survival discharge. Abbreviations: EMS: emergency medical service, ROSC: return of spontaneous circulation.
Jcm 10 03695 g002aJcm 10 03695 g002b
Figure 3. Nomogram for predicting good neurologic outcomes. (a) The novel nomogram for predicting good neurologic outcomes developed using the training data set is shown. (b) The discriminative ability of the nomogram is good, with an area under the curve of 0.8742 (95% confidence interval: 0.8383–0.9101). (c) The calibration plot of the prediction model indicates good agreement between the predicted and observed probabilities of good neurologic outcomes. Abbreviations: EMS: emergency medical service, ROSC: return of spontaneous circulation.
Figure 3. Nomogram for predicting good neurologic outcomes. (a) The novel nomogram for predicting good neurologic outcomes developed using the training data set is shown. (b) The discriminative ability of the nomogram is good, with an area under the curve of 0.8742 (95% confidence interval: 0.8383–0.9101). (c) The calibration plot of the prediction model indicates good agreement between the predicted and observed probabilities of good neurologic outcomes. Abbreviations: EMS: emergency medical service, ROSC: return of spontaneous circulation.
Jcm 10 03695 g003
Table 1. Patient demographics and clinical characteristics according to survival outcome at discharge.
Table 1. Patient demographics and clinical characteristics according to survival outcome at discharge.
Training Set (n = 496) Validation Set (n = 227)
Survival (n = 334)Death (n = 162)p-ValueSurvival (n = 141)Death (n = 86)p-Value
Age (years) 55.3 ± 13.064.3 ± 13.3<0.00156.1 ± 13.163.3 ± 13.8<0.001
Sex, male279 (83.5)133 (82.1)0.69123 (87.2)72 (83.7)0.46
Medical history
Hypertension 122 (39.1)80 (52.0)0.00864 (46.7)39 (47.6)0.9
Diabetes mellitus 65 (21.0)55 (36.2)<0.00124 (17.8)29 (35.4)0.003
Dyslipidemia 23 (7.80)9 (6.2)0.5311 (8.6)7 (9.6)0.81
Bystander-witnessed 275 (84.1)125 (77.2)0.06108 (77.1)66 (76.7)0.95
Place of arrest 0.02 0.09
Public185 (44.8)75 (46.9) 74 (53.6)41 (47.6)
Private122 (37.7)76 (47.5) 60 (43.5)36 (41.9)
Ambulance16 (4.9)9 (5.6) 4 (2.9)9 (10.5)
Bystander CPR 0.008 0.1
Chest compressions 193 (61.3)73 (46.8) 83 (62.4)42 (50.0)
Prehospital defibrillation by bystanders 14 (4.4)1 (0.6)0.036 (4.6)1 (1.2)0.18
Primary cardiac rhythm at the scene <0.001 <0.001
Shockable263 (85.1)73 (46.5) 113 (85.0)42 (51.9)
Prehospital defibrillation by EMS providers 285 (85.6)81 (51.3)<0.001119 (85.6)45 (52.3)<0.001
Epinephrine use by EMS providers 24 (7.2)21 (13.0)0.0416 (11.4)15 (17.4)0.2
Prehospital ROSC, yes 241 (72.2)20 (12.4)<0.001101 (71.6)11 (12.8)<0.001
Primary cardiac rhythm at hospital <0.001 0.27
Shockable36 (45.6)24 (17.52) 11 (35.5)20 (28.7)
Full dose of epinephrine used during CPR in the hospital (mg)1.6 ± 3.37.1 ± 6.6<0.0011.5± 2.95.7 ± 5.4<0.001
SBP (mmHg)129.0 ± 39.5117.5 ± 40.80.07133.2 ± 38.5121.3 ± 41.70.17
DBP (mmHg)82.4 ± 22.073.4 ± 28.10.0283.5± 26.579.8 ± 32.40.55
HR (beats/min) 103.1 ± 30.698.2 ±32.00.32100.2 ± 31.993.3 ± 34.10.34
Troponin I74.4 ± 650.324.5 ± 141.90.4232.4 ± 254.48.5 ± 26.70.45
E-CPR18 (6.2)48 (29.3)<0.0016 (4.6)20 (28.2)<0.001
Targeted temperature management 132 (40.7)52 (32.7)0.1744 (32.8)28 (33.3)0.61
PCI99 (35.1)66 (41.0)0.2243 (32.1)30 (46.2)0.05
Vasopressor use in the hospital177 (54.3)149 (92.0)<0.00182 (60.3)78 (91.8)<0.001
Time from EMS call to scene arrival, min 7.1 ± 3.68.2 ± 3.60.0027.9 ± 4.78.6 ± 5.30.33
Time from collapse to ED arrival, min 30.3 ± 13.230.4 ± 15.20.9331.3 ± 14.130.0 ± 13.00.51
Time from collapse to ROSC, min21.0 ± 14.144.3 ± 25.2<0.00121.9 ± 17.044.7 ± 24.0<0.001
Time from ED arrival to CAG, min 2042.5 ± 4903.8204.6 ± 727.3<0.0011781.4± 5702.3978.9 ± 5196.90.29
Variables are shown as means ± standard deviations or numbers (percentages). Abbreviations: CPR: cardiopulmonary resuscitation, EMS: emergency medical service, ROSC: return of spontaneous circulation, SBP: systolic blood pressure, DBP: diastolic blood pressure, HR: heart rate, E-CPR: extracorporeal cardiopulmonary resuscitation, PCI: percutaneous coronary intervention, ED: emergency department, CAG: coronary angiography.
Table 2. Predictors of survival discharge and good neurologic outcomes.
Table 2. Predictors of survival discharge and good neurologic outcomes.
Survival DischargeGood Neurologic Outcomes
OR (95% CI)p-ValueOR (95% CI)p-Value
Age0.94 (0.90–0.98)<0.0010.95 (0.92–0.98)<0.001
Prehospital defibrillation by EMS providers3.52 (1.53–8.05)0.0037.84 (3.05–20.17)<0.001
Prehospital ROSC2.96 (1.20–7.29)0.02
Time from collapse to ROSC, min0.95 (0.93–0.97)<0.0010.91 (0.88–0.94)<0.001
Abbreviations: OR: odds radio, CI: confidence interval, EMS: emergency medical service, ROSC: return of spontaneous circulation.
Table 3. Patient demographics and clinical characteristics according to neurologic outcomes at discharge.
Table 3. Patient demographics and clinical characteristics according to neurologic outcomes at discharge.
VariablesTraining Set (n = 489) Validation Set (n = 220)
Good Neurologic Outcome (CPC 1, 2) (n = 210)Poor Neurologic Outcome (CPC ≥ 3) (n = 279)p-ValueGood Neurologic Outcome (CPC 1, 2) (n = 105)Poor Neurologic Outcome (CPC ≥ 3) (n = 115)p-Value
Age (years)54.6 ± 12.7 63.0 ± 13.6<0.00155.0 ± 12.862.7 ± 13.5<0.001
Sex, male234 (83.9)170 (80.9)0.4100 (86.9)90 (85.7)0.79
Medical history
Hypertension101 (38.4)99 (50.3)0.0152 (46.9)47 (46.1)0.91
Diabetes mellitus47 (18.1)71 (36.4)<0.00117 (15.6)35 (34.7)0.001
Dyslipidemia22 (8.76)10 (5.41)0.1811 (10.7)7 (7.5)0.45
Bystander-witnessed232 (84.7)162 (77.9)0.0687 (76.3)82 (78.1)0.75
Place of arrest 0.02 0.003
Public157 (57.7)104 (50.5) 58 (51.8)54 (51.5)
Private103 (37.9)89 (43.2) 51 (45.5)41 (39.1)
Ambulance12 (4.4)13 (6.3) 3 (2.7)10 (9.5)
Bystander CPR <0.001 0.01
Chest compression 174 (65.4)91 (45.5) 73 (66.4)50 (49.5)
Prehospital defibrillation by bystanders13 (4.9)2 (1.0)0.025 (4.6)2 (2.0)0.31
Primary cardiac rhythm at the scene <0.001 <0.001
Shockable233 (90.3)99 (48.7) 100 (92.6)53 (53.00)
Prehospital defibrillation by EMS providers 250 (89.9)111 (53.6)<0.001103 (91.2)58 (55.2)<0.001
Epinephrine use by EMS providers16 (5.7)29 (13.8)0.00212 (10.4)18 (17.1)0.15
Prehospital ROSC, yes226 (81.0)34 (16.2)<0.00193 (80.9)18 (17.1)<0.001
Primary cardiac rhythm at hospital <0.001 0.005
Shockable23 (53.5)37 (21.9) 10 (71.4)20 (24.1)
Full dose of epinephrine used during CPR in the hospital (mg)1.0 ± 2.86.2 ± 6.1<0.0011.2 ± 2.95.0 ± 5.2<0.001
SBP (mmHg)129.4 ± 36.4122.0 ± 44.80.19133.7 ± 39.3122.9 ± 41.10.2
DBP (mmHg)83.7± 20.574.7 ± 27.80.0185.2 ± 27.978.6 ± 29.10.28
HR (beats/min)101.8 ± 28.7102.6 ± 34.10.8699.3 ± 29.795.7 ± 35.70.61
Troponin I85.8 ± 705.621.6 ± 127.60.2839.8 ± 283.67.4 ± 24.40.31
E-CPR9 (3.9)55 (26.1)<0.0013 (2.7) 22 (25.0)<0.001
Targeted temperature management 103 (38.0)82 (40.0)0.6337 (33.6)34 (33.3)0.96
PCI85 (36.8)76 (36.9)0.9835 (30.4)38 (45.8)0.03
Vasopressor use in the hospital137 (50.4)184 (88.0)<0.00159 (53.6)95 (90.5)<0.001
Time from EMS call to scene arrival, min6.9 ± 3.38.1 ± 3.9<0.0017.6 ± 4.98.8 ± 5.00.08
Time from collapse to ED arrival, min30.2 ± 13.430.5 ± 14.70.8430.9 ± 14.330.7 ± 13.30.91
Time from collapse to ROSC, min18.3 ± 11.742.0 ± 24.1<0.00119.6 ± 16.542.6 ± 22.9<0.001
Time from ED arrival to CAG, min2184.0 ± 4916.1483.7 ± 2535.2<0.0012218.1 ± 6287.7828.4 ± 4676.90.07
Variables are shown as means ± standard deviations or numbers (percentages). Abbreviations: CPC: cerebral performance category, CPR: cardiopulmonary resuscitation, EMS: emergency medical service, ROSC: return of spontaneous circulation, SBP: systolic blood pressure, DBP: diastolic blood pressure, HR: heart rate, E-CPR: extracorporeal cardiopulmonary resuscitation, PCI: percutaneous coronary intervention, ED: emergency department, CAG: coronary angiography.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Beom, J.H.; Park, I.; You, J.S.; Roh, Y.H.; Kim, M.J.; Park, Y.S.; on behalf of the Korean Cardiac Arrest Research Consortium Investigators. Predictive Model of Good Clinical Outcomes in Patients Undergoing Coronary Angiography after Out-of-Hospital Cardiac Arrest: A Prospective, Multicenter Observational Study Conducted by the Korean Cardiac Arrest Research Consortium. J. Clin. Med. 2021, 10, 3695. https://doi.org/10.3390/jcm10163695

AMA Style

Beom JH, Park I, You JS, Roh YH, Kim MJ, Park YS, on behalf of the Korean Cardiac Arrest Research Consortium Investigators. Predictive Model of Good Clinical Outcomes in Patients Undergoing Coronary Angiography after Out-of-Hospital Cardiac Arrest: A Prospective, Multicenter Observational Study Conducted by the Korean Cardiac Arrest Research Consortium. Journal of Clinical Medicine. 2021; 10(16):3695. https://doi.org/10.3390/jcm10163695

Chicago/Turabian Style

Beom, Jin Ho, Incheol Park, Je Sung You, Yun Ho Roh, Min Joung Kim, Yoo Seok Park, and on behalf of the Korean Cardiac Arrest Research Consortium (KoCARC) Investigators. 2021. "Predictive Model of Good Clinical Outcomes in Patients Undergoing Coronary Angiography after Out-of-Hospital Cardiac Arrest: A Prospective, Multicenter Observational Study Conducted by the Korean Cardiac Arrest Research Consortium" Journal of Clinical Medicine 10, no. 16: 3695. https://doi.org/10.3390/jcm10163695

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop