Next Article in Journal
Frailty Network in an Acute Care Setting: The New Perspective for Frail Older People
Next Article in Special Issue
Diagnosing Arterial Stiffness in Pregnancy and Its Implications in the Cardio-Renal-Metabolic Chain
Previous Article in Journal
Quality Improvement Initiatives in Renal Biopsy for Patient-Centered Communication by Shared Decision Making
Previous Article in Special Issue
A Narrative Review of the Classical and Modern Diagnostic Methods of the No-Reflow Phenomenon
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Left Ventricle Outflow Tract Velocity-Time Index and Right Ventricle to Left Ventricle Ratio as Predictors for in Hospital Outcome in Intermediate-Risk Pulmonary Embolism

by
Elena Emilia Babes
1,†,
Manuela Stoicescu
1,*,
Simona Gabriela Bungau
2,3,*,
Diana Uivarosan
4,†,
Delia Mirela Tit
2,3,†,
Mirela Marioara Toma
2,
Alexa Florina Bungau
5 and
Cristiana Bustea
5
1
Department of Medical Disciplines, Faculty of Medicine and Pharmacy, University of Oradea, 410073 Oradea, Romania
2
Doctoral School of Biological and Biomedical Sciences, University of Oradea, 410087 Oradea, Romania
3
Department of Pharmacy, Faculty of Medicine and Pharmacy, University of Oradea, 410028 Oradea, Romania
4
Department of Preclinical Disciplines, Faculty of Medicine and Pharmacy of Oradea, University of Oradea, 410073 Oradea, Romania
5
Medicine Program of Study, Faculty of Medicine and Pharmacy, University of Oradea, 410073 Oradea, Romania
*
Authors to whom correspondence should be addressed.
These authors contributed equally to this work.
Diagnostics 2022, 12(5), 1226; https://doi.org/10.3390/diagnostics12051226
Submission received: 18 April 2022 / Revised: 9 May 2022 / Accepted: 11 May 2022 / Published: 13 May 2022

Abstract

:
Accurate estimation of risk with both imaging and biochemical parameters in intermediate risk pulmonary embolism (PE) remains challenging. The aim of the study was to evaluate echocardiographic parameters that reflect right and left heart hemodynamic as predictors of adverse events in intermediate risk PE. This was a retrospective observational study on patients with computed tomography pulmonary angiography diagnosis of PE admitted at Cardiology department of the Clinical Emergency Hospital of Oradea, Romania between January 2018—December 2021. Echocardiographic parameters obtained at admission were studied as predictors of in hospital adverse events. The following adverse outcomes were registered: death, resuscitated cardiac arrest, hemodynamic deterioration and need of rescue thrombolysis. An adverse outcome was present in 50 patients (12.62%). PE related death was registered in 17 patients (4.3%), resuscitated cardiac arrest occurred in 6 patients (1.51%). Another 20 patients (5.05%) required escalation of therapy with thrombolysis and 7 (1.76%) patients developed haemodynamic instability. Echocardiographic independent predictors for in hospital adverse outcome were RV/LV ≥ 1 (HR = 3.599, 95% CI 1.378–9.400, p = 0.009) and VTI ≤ 15 mm (HR = 11.711, 95% CI 4.336–31.633, p < 0.001). The receiver operator curve renders an area under curve for LVOT VTI ≤ 15 mm of 0.792 (95% CI 0.719–0.864, p < 0.001) and for a RV/LV ≥ 1 of 0.746 (95% CI 0.671–0.821, p < 0.001). A combined criterion (LVOT VTI ≤ 15 and RV/LV ≥ 1) showed a positive predictive value of 75% and a negative predictive value of 95% regarding in hospital adverse outcomes. Low LVOT VTI and increased RV/LV are useful for identifying normotensive patients with PE at risk for short term adverse outcomes. Combining an LVOT VTI ≤ 15 cm with a RV/LV ≥ 1 can identify with increased accuracy PE patients with impending risk of clinical deterioration.

1. Introduction

Pulmonary embolism (PE) is a major cause of morbidity and mortality. The annual incidence rate of PE is increasing over time as revealed in longitudinal studies [1,2,3,4]. The rising incidence is correlated with increasing of life expectancy, a higher incidence of risk factors for PE and the large availability of more sensitive imaging diagnostic techniques [5]. The annual incidence of PE in Europe is 115/100,000 population [6]. Acute PE is the third leading cause of death globally, although most of the patients have a low mortality rate and can be treated by anticoagulation alone [7]. Around 10–30% of deaths occur in the first month after presentation [8]. Mortality rates at 30 day and 1-year are 3.9 and 12.9% and increase with the severity of PE [9]. After an episode of PE patients may experience a marked impairment of quality of life due to development of chronic thromboembolic pulmonary hypertension [10].
There are several risk factors for venous thromboembolism that result from an interaction between the individual patient’s risk factors (usually persistent) and setting-related (usually transitory) risk factors. Age, personal history of venous thromboembolism, cancer, comorbidities such as heart failure or respiratory diseases, coagulation disorders, oral contraception and pregnancy are described as predisposing factors for PE. Surgery, orthopedic procedures (lower-limb fractures and joint replacements) and major trauma are associated with increased risk of PE. Common risk factors are shared by PE and atherosclerosis, respectively hypertension, diabetes, hypercholesterolemia, obesity, and smoking. Atherosclerosis and arterial disease may be related to PE by increased platelet activation and coagulation pathway [6].
The clinical presentation of patients with PE is highly variable with a spectrum from critically ill to stable patients. Guidelines differentiate between high-risk, intermediate, and low risk patients. Risk stratification of patients will influence therapeutic management. High risk (massive) PE is associated with hemodynamic instability, respectively obstructive shock, persistent arterial hypotension refractory to treatment, or cardiac arrest. In these patients right ventricular dysfunction (RVD) should be confirmed on echocardiography, to demonstrate that hemodynamic impairment is secondary to PE and thrombolysis is recommended [6]. Low risk PE patients are hemodynamic stable with no signs of RVD on echocardiography or laboratory markers of injury and for them anticoagulation therapy will suffice.
Intermediate-high risk PE encompasses a group of patients with normal blood pressure, signs of right ventricular dysfunction (RVD) on echocardiography or computed tomography pulmonary angiography (CTPA) and elevated cardiac biomarkers (brain natriuretic peptide, troponin). The low-intermediate risk patients have either imaging evidence of RVD or elevated cardiac biomarkers but not both or are classified as being not low-risk by clinical prediction tools. These intermediate risk patients are apparently hemodynamically stable, but up to 10% of them will progress to massive PE with high mortality. Short term mortality rates vary between 2–10% in intermediate-risk patients [5]. There are still controversies regarding the best approach in the management of these patients. Thrombolysis in hemodynamically stable patients with intermediate-high risk PE continues to be an area of debate. Anticoagulant therapy will cause a passive reduction of thrombus size while thrombolytic agents will determine a more rapid clot resolution, improvement of cardiac and respiratory function and symptoms resolution. Although thrombolysis is reasonable in patients with massive acute PE, routine thrombolysis is not recommended in patients with intermediate risk PE due to high risk of bleeding complications. They should be closely monitored over the first days because there is a risk of hemodynamic instability [6]. These patients with intermediate-high risk PE do not necessarily need thrombolysis but sometimes anticoagulant therapy is not sufficient to prevent haemodynamic decompensation.
It is a challenge to identify those patients with intermediate risk who will experience complications and will require escalation of therapy. Rescue systemic thrombolysis, percutaneous catheter-directed thrombolysis or surgical embolectomy are treatment options in patients who become unstable [11,12]. The aggressiveness of therapy must match the severity of disease. The decision of thrombolysis requires careful consideration of the risks and benefits involved and appropriate stratification of risk. The risk of hemodynamic deterioration and death may be difficult to assess and already developed risk scores as Pulmonary Embolism Severity Index (PESI) or BOVA perform better in identification of low-risk patients and can underestimate patient severity.
Echocardiography plays an important role in PE, being recommended for risk estimation by current ESC guidelines [6]. Detecting RVD by imaging performs better than risk stratification scores as PESI or BOVA in predicting poor prognosis in patients with intermediate-risk PE [13]. Even in patients evaluated as being at low risk on clinical models the detection of RVD at echocardiography or CTPA especially associated with increased troponin or brain natriuretic peptide/N-terminal pro b-type natriuretic peptide (BNP/NT-proBNP) is correlated with early death risk [14]. A large number of studies evaluated various echocardiographic elements of RVD as predictors of increased mortality in initially stable patients [15,16,17,18,19,20,21,22].
Acute RV pressure overload and RVD can be detected with echocardiography although the geometry of the RV is complex, and evaluation of RV size and dysfunction is quite challenging. Various echocardiographic parameters were reported for describing RV in PE such as: RV enlargement, RV hypokinesis, flattening or bowing of the interventricular septum, an elevated velocity of tricuspid valve regurgitation, tricuspid annular plane systolic excursion (TAPSE), the combination of a pulmonary ejection time <60 ms with a peak systolic tricuspid valve gradients <60 mmHg and were correlated with outcome in acute PE [5,22,23]. Controversial results are persisting regarding correlation between various echocardiographic parameters of RVD and adverse short-term outcomes in patients with PE. RVD diagnosed by different echo parameters is associated with mortality rates from 4.3% to 16.4% [17,22]. Several studies revealed a modest increased in mortality associated with various parameters of RVD [16,17,18,24,25], while in other studies this was not confirmed [26,27]. A meta-analysis performed by Coutance et al. revealed that although RVD is correlated with high-risk short-term mortality in PE the positive predictive value for death is low [22].
Recently, low left ventricular outflow tract velocity-time integral (LVOT VTI), a marker of LV stroke volume, was demonstrated to predict adverse outcomes in patients with acute PE [27]. LVOT VTI is a reliable surrogate for cardiac output in the absence of LVOT abnormalities, is less prone to error than the estimation of LVOT area and can outperform ejection fraction [28,29].
The aim of this research was to evaluate echocardiographic parameters that reflect RVD and left ventricular underfilling, including RV/LV ratio and LVOT VTI as predictors of in hospital adverse outcome in initially stable patients with intermediate risk PE. To our knowledge this is the first study that studied the value of a combined criteria of LVOT VTI ≤ 15 cm and an RV/LV ratio ≥ 1 in risk stratification of patients with PE.

2. Materials and Methods

2.1. Study Design

A retrospective observational study was performed on 708 patients consecutively admitted with the diagnosis of acute PE in the Cardiology Department of the Clinical County Emergency Hospital of Oradea Romania between January 2018 and December 2021. Inclusion criteria was the diagnosis of acute PE confirmed by contrast enhanced computed tomographic pulmonary angiography (CTPA). Patients presenting with acute PE were classified according to European Society of Cardiology criteria for PE severity. Only patients classified in the intermediate risk class, hemodynamically stable on admission, with systolic blood pressure (BP) of at least 90 mmHg without hemodynamic support were included in the study. Exclusion criteria were as follows: patients with high LVOT velocities due to moderate-severe aortic regurgitation where the estimation of LVOT VTI is not reliable due to overestimation of forward stroke volume, patients with hypertrophic obstructive cardiomyopathy, sepsis, and hypovolemia with dynamic obstruction of LVOT, patients with LVOT VTI with insufficient quality to trace, patients with incomplete echocardiographic data, patients known with chronic pulmonary hypertension.
All patients were treated according to ESC guidelines. They initially received standard anticoagulation therapy most of them with intravenous unfractionated heparin or subcutaneous low-molecular weight heparin. Thrombolytic treatment, respectively systemic thrombolysis with t-PA was administered only when hemodynamic deterioration occurred at the indication of the attending physician or on call physician.
The following adverse events were recorded during hospitalization period: death or resuscitated cardiac arrest, development of hemodynamic instability: cardiogenic shock or need of hemodynamic support, need of systemic rescue thrombolysis. All the patients included in the study had echocardiographic examinations performed in the first 24–48 h after admission. Echocardiographic data were compared between groups of patients with and without adverse events, and those parameters that differed significantly between groups were evaluated regarding their predictive power in multivariate analysis.
The entire study was conducted respecting the World Medical Association Declaration of Helsinki (Ethical Principles for Medical Research Involving Human Subjects) and was approved by the Ethics Committee of the Clinical County Emergency Hospital of Oradea, Bihor County, Romania (decision no 9411/08.04.2021). Each patient included in the study signed the informed consent form.

2.2. Methodology

The diagnosis of PE was defined on CTPA as the presence of a thrombo-embolus in at least one segmental pulmonary artery. Patients with normal BP on admission, PESI III-V or s PESI ≥ 1 in the intermediate risk class were included in the study. The presence of signs of RVD on echocardiography or computed CTPA and elevated cardiac biomarkers categorized patients according to ESC guidelines [6] in the intermediate high- risk category. The low-intermediate risk patients had either imaging evidence of RVD or elevated cardiac biomarkers but not both or were classified as being not low-risk by clinical prediction tools.
Data were obtained from patient’s medical records and from hospital informatic system. Demographic data, medical history, clinical and paraclinical data, risk factors were recorded. Plasma cardiac biomarkers as N-Terminal Pro-B-Type Natriuretic Peptide (NT proBNP) and high sensitive (hs)-troponin were determined on admission. NT-proBNP was determined by using a path fast cardiac biomarker analyzer manufactured by LSI Medience Corporation, a bench-top chemiluminescent immunoassay analyzer providing affordable, core-lab quality results from whole blood. Hs-troponin was determined with Alinity High Sensitive Troponin-I assay (Abbott Diagnostics).
A set of echocardiographic parameters of patients who presented with PE were recorded in the first 24–48 h after admission on a Siemens Acuson X 300 (Siemens Medical Solutions USA, Inc., Seoul, Korea) or on a Philips CX50 POC (Philips Healthcare, Makati, Philippines) system. The selected studied parameters are part of a standard echocardiography examination, are easy to determine, without important interobserver variability and do not require special technical equipment or skills.
The following parameters that reflect right heart changes in PE were recorded: dilatation of the right ventricle (RV) was assessed in apical four chamber view with by measuring LV and RV end-diastolic diameters at the level of mitral and tricuspid valve tips and RV/LV ratio was calculated (RV/LV ratio > 1 was considered elevated); the presence of McConnel sign: hypokinesia of RV free wall with good apical contractions; tricuspid annulus plane systolic excursion (TAPSE) a parameter that reflects RV contractions was measured in M-mode with a normal value >16 mm; pulmonary artery systolic pressure (PSAP) was determined from Doppler derived tricuspid regurgitation velocity using the simplified Bernoulli method; the presence of a paradoxical or flattening septal motion a classic 2D sign indicating an increased pressure in the RV was assessed by visual estimation; the diameter of inferior vena cava was assessed at late expiration. Echocardiographic parameters that reflect the left heart can reveal reduced left heart filling with diminished cardiac output in PE. LVOT VTI was obtained by tracing the envelope of the Doppler spectrum of LVOT systolic flow from the apical five- or three-chamber view using pulsed-wave Doppler, with the sample volume placed within the LVOT, approximately at 1 cm below the aortic valve. The pulsed-wave Doppler sample volume was placed parallel to the subaortic flow for obtaining an optimal VTI with minimal spectral broadening [30]. In patients with atrial fibrillation an average of 5 VTI s was calculated due to beat to beat VTI variability. An LVOT VTI ≤ 15 cm is commonly accepted as low, and this value was used also in our study [31]. Ejection fraction was calculated using bi-plane method of Simpson from apical two and four chambers’ views.
PE related death was confirmed at autopsy or occurred shortly after a clinically severe PE or in the absence of an alternative diagnosis. Cardiac arrest was defined as the need for cardiopulmonary resuscitation. Development of hemodynamic instability was defined as the occurrence of cardiogenic shock defined as sustained reduction of systolic blood pressure < 90 mmHg for at least 15 min or requiring pressor support, or a systolic BP drop ≥ 40 mmHg for >15 min, not caused by new-onset arrhythmia, hypovolemia, or sepsis. Need of systemic rescue thrombolysis was defined as escalation of therapy due to hemodynamic instability and was established at the indication of the attending physician or on call physician.

2.3. Statistical Analysis

Data were analyzed using SPSS statistical package Version 25 [32] and MedCalc statistical software version 19.4 (MedCalc Software, Ostend, Belgium). Results are presented as mean ± SD for continuous variable and frequencies and percentage for categorical variables. Intergroup comparison was made using independent sample t test for continuous variables and Kruskal Wallis test for categorical variable. A value of p < 0.05 was considered statistically significant. For those parameters that were significantly different between groups with and without adverse outcome a multiple regression analysis was performed to determine the value of each parameter as independent predictor for an adverse event. ROC curve analysis was performed for independent predictors of adverse events with determination of AUC (area under curve) to evaluate the accuracy or the performance of these parameters in predicting mortality or adverse outcome. Sensitivity, specificity, positive and negative predictive value were calculated.
The sample size was calculated using the on-line software Open Source Epidemiologic Statistics for Public Health (OpenEpi) version 3.01 [33].

3. Results

A number of 708 patients were consecutively admitted with the diagnosis of acute PE. According to ESC guidelines classification, 509 normotensive patients were included in the intermediate class risk at admission; 396 of them were included in the final evaluation after applying the exclusion criteria (Figure 1).
Adverse outcome (including in hospital death, cardiac arrest, development of cardiogenic shock or sustained hypotension, need of rescue thrombolysis) was present in 50 patients (12.62%). PE related death was registered in 17 patients (4.3%) and resuscitated cardiac arrest occurred in 6 patients (1.51%). Another 20 patients (5.05%) required escalation of therapy with thrombolysis and 7 (1.76%) patients developed hemodynamic instability and received intravenous inotropes. Echocardiographic parameters including RV/LV ratio and LVOT VTI to predict PE-related adverse events, including mortality, cardiac arrest, hemodynamic instability, need of rescue thrombolysis during hospitalization were directly compared in 396 normotensive patients with acute PE.

3.1. Predictors of in Hospital Adverse Outcomes: Death, Resuscitated Cardiac Arrest, Hemodynamic Instability and Need of Reperfusion Therapy

Demographic, clinical characteristics and biomarkers values of patients that developed adverse outcomes during hospitalization compared to those with favorable evolution are recorded in Table 1.
Unfavorable outcome was significantly more frequent in in patients with previous PE/DVT. Patients with adverse short-term events had significantly higher hs-troponin level at admission compared to those with favorable outcome. Echocardiographic parameters were measured in the first 24 h after admission in 327 (82.58%) patients and in the first 48 h for the rest of 69 (17.42%) of patients and are revealed in Table 2.
RVD was more pronounced in patients with unfavorable outcome. A higher RV to LV ratio and a lower TAPSE were measured compared to those with uncomplicated evolution. LVOT VTI was significantly reduced in patients with adverse outcome. In multiple regression analysis independent predictor for in hospital adverse outcome remained high-sensitive troponin level (HR = 1.001, 95% CI 1.000–1.002, p = 0.04), RV to LV ratio ≥ 1 (HR = 3.599, 95% CI 1.378–9.400, p = 0.009) and LVOT VTI ≤ 15 cm (HR = 11.711, 95% CI 4.336–31.633, p < 0.001). The AUC for RV to LV ratio as predictor of adverse outcome was 0.797 (95% CI 0.720–0.874, p < 0.001) (Figure 2a). The AUC for LVOT VTI as predictor of adverse outcome was 0.865 (95% CI 0.821–0.910, p < 0.001) (Figure 2b).
The AUC for an RV to LV ratio ≥ 1 was 0.746 (95% CI 0.671–0.821, p < 0.001) and for LVOT VTI ≤ 15 cm was 0.792 (95% CI 0.719–0.864, p < 0.001) (Figure 3). LVOT VTI ≤ 15 cm had a sensitivity of 76% and a specificity of 82.4% in predicting adverse in hospital outcome. The positive predictive value was 38% and the negative predictive value was 95% for an LVOT VTI ≤ 15 cm.
RV to LV ratio ≥ 1 is a predictor of adverse outcome with a sensitivity of 74%, and a specificity of 75.1%. The positive predictive value for a RV to LV ratio ≥ 1 was 30% and the negative predictive value was 95%. A combined criteria of RV/LV ratio ≥ 1 and an LVOT VTI ≤ 15 mm was present in 44 patients (11.1%). From these patients 33 (66%) had an unfavorable in hospital outcome. The ROC analysis for a combined parameter showed an AUC of 0.814 (95% CI 0.733–0.895, p = 0.041) (Figure 3). A combined parameter had a sensitivity of 66% and a specificity of 96% in predicting an adverse outcome. The positive predictive value of a combined parameter is significantly increased to 75% with a negative predictive value of 95%.

3.2. Predictors of in Hospital Death and Resuscitated Cardiac Arrest

A number of 23 (5.8%) patients experienced death or resuscitated cardiac arrest during hospitalization in intermediate-risk patients. Demographic, clinical and laboratory characteristics are revealed in Table 3.
Patients that experienced cardiac arrest were more commonly female, had lower systolic BP and higher NT-pro BNP and troponin levels at admission. Echocardiographic parameters were compared between patients with and without in hospital cardiac arrest and are revealed in Table 4.
An RV/LV ratio ≥ 1 and a low LVOT VTI were significantly more common patients within hospital death or resuscitated cardiac arrest. In multiple regression analysis only a LVOT VTI ≤ 15 cm remained independent predictor for death and resuscitated cardiac arrest HR = 8.117 (95% CI 1.941–33.946, p = 0.004).

3.3. Predictors of in Hospital Complications: Hemodynamic Instability or Need of Rescue Thrombolysis

Hemodynamic deterioration and need of rescue thrombolysis were registered in 27 (6.82%) patients. Demographic, clinical variable and biomarkers were compared between patients that developed hemodynamic instability or required rescue thrombolysis and those without these complications and are revealed in Table 5.
Hs-troponin recorded at admission was significantly higher in patients that developed in hospital hemodynamic instability or required rescue thrombolysis. Echocardiographic parameters in patients with development of hemodynamic instability or need for in hospital thrombolysis are revealed in Table 6.
A significantly lower TAPSE and LVOT VTI was observed in these patients and an increased RV/LV ratio. In multiple regression analysis an LVOT VTI ≤ 15 cm HR = 3.2 (95% CI 1.043–9.810, p = 0.042) and RV/LV ≥ 1 HR = 3.54 (95% CI 1.090–11.467, p = 0.035) remained independent predictors for hemodynamic deterioration and the need of rescue thrombolysis.

3.4. LVOT VTI and RV/LV Ratio in Intermediate-High Risk Patients

A number of 173 (43.7%) patients were included in the intermediate-high risk group according to ESC classification. Thirty-nine adverse outcome (78%) were recorded in the intermediate high-risk group. In the subgroup of patients that experienced in hospital adverse outcome 38 (97.44%) had a LVOT VTI ≤ 15 cm and 33 (84.62%) had a RV/LV ratio ≥ 1. A low VTI was recorded in only 44.3% and a RV/LV ratio ≥ 1 in only 23.88% from those without in hospital adverse outcome. In intermediate-high risk patients, LVOT VTI ≤ 15 cm as predictor of adverse in hospital outcome (death, resuscitated cardiac arrest, hemodynamic instability or need of rescue thrombolysis) had a sensitivity of 97.43%, a specificity of 55.97%, a positive predictive value of 39.18% and a negative predictive value of 98.68%. The AUC for LVOT VTI was 0.776 (95% CI 0.696–0.838) (Figure 4a). In intermediate-high risk PE patients, the AUC for RV/LV was 0.847 (95% CI 0.78–0.915) (Figure 4b). RV/LV ≥ 1 as predictor of in hospital adverse outcome had a sensitivity of 84.61%, a specificity of 76.12%, a positive predictive value of 50.77% and a negative predictive value of 94.44%.
The AUC for an LVOT VTI ≤ 15 cm was 0.767 (95% CI 0.696–0.838) and for a RV/LV ≥ 1 was 0.804 (95% CI 0.725–0.882) (Figure 5). The combined criteria: LVOT VTI ≤ 15 mmm and RV/LV ≥ 1 had a sensitivity of 82.051%, a specificity of 94.62%, a positive predictive value of 74.42% and a negative predictive value of 91.79%. The AUC for a combined parameter was 0.869 (95% CI 0.794–0.945) (Figure 5).
In the intermediate low risk PE group, there were 11 adverse events (22%). LVOT VTI ≤ 15 cm was recorded in all the patients with adverse outcome. The sensitivity of a LVOT VTI ≤ 15 cm was 100%, specificity was 99.6%, the positive predictive value was 93.87% and the negative predictive value was 100%.

4. Discussion

Echocardiographic parameters correlated with in hospital adverse outcome in patients with PE and normal BP at admission were studied. Main results of this research showed that RV/LV ratio and LVOT VTI were independent predictors of in-hospital adverse outcome. The combination of these two echocardiographic parameters that reflect both RV dysfunction and LV underfilling can reliably identify patients at increased risk of in hospital death, cardiac arrest, hemodynamic deterioration and need for reperfusion therapy. Obstructive shock from acute PE raises pulmonary artery and right ventricular pressure, causing RVD but also a decrease of blood flow across the pulmonary capillary bed to the left heart resulting in LV underfilling and promotes right-to-left septal bowing with a net effect of decreased LV stroke volume. Besides these echocardiographic parameters, several other demographics, clinical risk factors and laboratory parameters were also evaluated regarding their prognostic significance. In univariate analysis previous DVT/PE and hs-troponin were significantly increased in the adverse event group in multivariate analysis only hs troponin remained independent predictor of adverse in hospital outcome. A low BP at admission, female sex and an increased NT-proBNP and hs-troponin were more commonly encountered in the group that experienced cardiac arrest, but these parameters did not persist as independent predictors in a multivariate model.
Risk stratification of hemodynamically stable patients with PE remains a challenge, and although is well known that RVD affects short-term prognosis, the best echocardiographic parameters that can predict adverse outcomes are still an area of debate. The presence of RVD among normotensive patients with PE is a predictor of an increased risk of hemodynamic decompensation [16,19,34]. RVD diagnosed by different echo parameters is also associated with mortality rates from 4.3% to 16.4% [10,13].
An increased RV to LV ratio was found to be correlated with short term adverse outcome including death, cardiac arrest, hemodynamic deterioration and the need of rescue thrombolysis and a ratio ≥ 1 persisted as an independent predictor of in hospital complications after multivariate analysis in our study with a HR of 3.6.
RV/LV is easy to measure and is one of the most used parameters for prognostic assessment in previous studies [16,35]. This was the most important criteria used to identify RVD in the largest study on thrombolysis in intermediate risk pulmonary embolism [36]. RV to LV ratio more than 1 and tricuspid annular plane systolic excursion (TAPSE) less than 16 mm were independent predictors of PE-related mortality and hemodynamic collapse or rescue thrombolysis within the first 30 days in 490 normotensive patients with PE in the study of Pruszczyk et al. An RV/LV ratio ≥ 1 had a sensitivity of 74%, a specificity of 63% and a high negative predictive value of 95%, with a HR of 2.5 (95% CI 1.2–5.7) [37].
Simple measurement of RV/LV diameter ratio by the emergency department specialist on CTPA proved useful in risk stratification of patients with PE in the study of Cho et al. [38]. The RV/LV diameter ratio on transverse CT sections has the strongest predictive value and most robust evidence base for adverse clinical outcomes in patients with acute PE in a systematic review and meta-analysis performed by Meinel et al. [35]. Khemasuwan et al. demonstrated that the ratio of RV to LV end-diastolic diameter with a HR, of 4.4; (95% CI, 1.3–15) and other three parameters: RV systolic pressure, TAPSE and inferior vena cava collapsibility were independently associated with mortality in patients presenting with acute PE who were admitted to the intensive care unit [39].
In the present study, although RV/LV ratio was significantly higher and a RV/LV ratio ≥ 1 was more commonly encountered in the group of patients that experienced death or cardiac arrest, in multivariate analysis RV/LV ratio didn’t t persisted as an independent predictor for short-term combined endpoint of death and resuscitated cardiac arrest, but our study included only patients at intermediate risk.
TAPSE is a quantitative echocardiographic parameter obtained in M-mode that does not require special training for measurement and can provide objective information about RV function. In the present study although TAPSE was correlated in univariate analysis with adverse outcome (including death, cardiac arrest, hemodynamic deterioration, and the need of rescue thrombolysis) its predictive value didn’t t persist in a multivariate model. TAPSE was an independent predictor of survival in normotensive patients with PE in a multicentric prospective study of Lobo et al. and a TAPSE ≤ 16 mm identified those patients with a higher risk of death (HR 4.4; 95% CI 1.3–15.3; p = 0.02) [15]. TAPSE was also preferred for risk stratification in normotensive patients with PE [37].
LVOT VTI can estimate cardiac function and is frequently used in the management of critical patients with shock [40,41]. Intensive care and emergency physicians are using more often transthoracic echocardiography for evaluation of patients with hemodynamic instability. Stroke volume is obtained as a product of LVOT cross sectional area by LVOT VTI, but because LVOT cross sectional area is constant any change in stroke volume is dependent on variations of LVOT VTI [30]. On the other hand, due to ellipsoid shape of the LVOT, estimation of the area of LVOT represents the major source of error in calculating cardiac output. Using LVOT VTI alone rather than stroke volume has been suggested for estimation of cardiac output [28].
Although cardiac output can be evaluated with 2D Simpson s method it seems that LVOT VTI is more accurate and can be used as a surrogate for the stroke volume. A value above 18 cm represents an adequate stroke volume, whereas a value ≤ 15 cm defines a reduced left ventricular stroke volume [38]. LVOT VTI is a feasible parameter in various studies. Bergenzaun et al. [42] obtained LVOT VTI in 95% of all examinations in patients with shock and mechanical ventilation whereas other studies revealed a feasibility for LVOT VTI around 78% [42,43]. Regarding reliability of this parameter the reported intra and interobserver variabilities are low, between 3–8% in various studies [42,43,44,45].
A low LVOT VTI (≤15 cm) is associated with worse prognosis in patients with acute PE [27] and in patients with acute decompensated heart failure [28,31]. Ultrasound assessment of patients in shock is becoming the standard of care in emergency and critical care settings worldwide and LVOT VTI is commonly used being part of point-of-care ultrasound protocol [40]. Low LVOT VTI was associated with adverse outcome in patients with PE and proved to have a prognostic value in patients with intermediate risk PE, guiding risk stratification and management in the study of Yuriditsky et al. Fifty-eight percent of intermediate-high risk patients had low VTI. For the entire cohort a low LVOT VTI was associated with in hospital mortality or cardiac arrest HR 6.95% (95% CI 2–17.9, p = 0.0014) and shock or need for reperfusion (HR 23.3, 95% CI 6.6–82.1, p < 0.0001). Low LVOT VTI was more predictive of shock than death or cardiac arrest [27].
Similar results were observed in our study. LVOT VTI ≤ 15 cm was an independent predictor of in hospital adverse outcome (including in hospital death, cardiac arrest, development of cardiogenic shock, need of rescue thrombolysis). ROC analysis showed an AUC of 0.865, a good accuracy in predicting adverse outcome, a good sensitivity and specificity although positive predictive value remained relatively low. The only independent predictor for death or cardiac arrest in our study as in the study performed by Yuriditsky et al. was a low LVOT VTI. A low LVOT VTI was also an independent predictor of shock or the need or reperfusion in the present study. But in our study a low LVOT VTI was a stronger predictor of death and cardiac arrest than of shock or hemodynamic deterioration, probably because our cohort encompasses only patients at intermediate risk. A low VTI was recorded in 97 patients from 173 included in intermediate high-risk class (56.06%) and this is very similar with the results obtained in the study of Yuriditski et al. [27].
The value of LVOT VTI in predicting adverse outcome was described also in a retrospective study performed by Prosperi-Porta et al. A low stroke volume index was associated with in-hospital death or cardiopulmonary decompensation in normotensive patients with PE. Stroke volume index had excellent performance compared with other clinical and echocardiographic variables. Most often, the authors derived stroke volume index from the LVOT VTI, an echocardiographic surrogate of stroke volume that, as shown in this cohort, can be obtained in the overwhelming majority of patients. The C-statistic for stroke volume index (0.87; 95% CI, 0.78–0.95) outperformed every other marker of RVD including the well-studied TAPSE and the Bova staging system. The ability of stroke volume index to discriminate the prognosis of patients with acute PE was preserved even after comparisons against multiple other RVD markers and after sensitivity analyses [46].
Another recent study on patients with intermediate risk PE confirmed that LVOT VTI (HR 4.212, 5–95% CI 1.384–12.820, p = 0.011), as well as stroke volume index (HR 11.199, 5–95% CI 2.697–48.096, p = 0.001), were independent predictors of short-term mortality as in our study. Also, other echocardiographic parameters as: right atrial enlargement (HR 3.432, 5–95% CI 1.193–9.876, p = 0.022) and the ratio between tricuspid annulus plane excursion and pulmonary arterial systolic pressure (TAPSE/PASP) (HR 4.833, 5–95% 1.230–18.986, p = 0.024) were found to have predictive value in the study of Falsetti et al. In this study as in our study neither RV/LV nor troponin I resulted associated with impaired survival [47].
In the intermediate high-risk group were registered 78% of the in hospital adverse outcomes. Most patients (97.44%) that reached the composite outcome of cardiac arrest, shock or need of reperfusion had a VTI ≤ 15 cm and only 44.3% of patients without adverse outcome during hospitalization had a low LVOT VTI. Similar results were obtained in the study of Yuriditski et al. where 92.3% of patients with adverse outcome had a low LVOT VTI and only 42.6% of outcome-negative patients had a VTI ≤ 15 cm [27].
RVD is correlated with an elevated risk of short-term mortality, but the positive predictive value of various echocardiographic parameters is low (<10%) [22]. However, it is generally accepted that detection of RVD at echocardiography can identify patients with high-risk of hemodynamic deterioration despite anticoagulation. Combining more echocardiographic parameters we can increase the positive predictive value. We postulate that concomitant evaluation of the two echocardiographic parameters that showed independent predictive value for risk estimation in the present study and can estimate simultaneously the right and the left heart could increase the positive predictive value of the echocardiographic parameters. The concomitant presence of an LVOT VTI ≤ 15 cm and of a RV/LV ratio ≥ 1 was associated with an increased specificity and with a higher positive predictive value compared to using LVOT VTI or RV/LV ratio alone.
The first study that used evaluation of left and right heart hemodynamic was the study of Kamran et al. Simultaneous information on both right and left heart performance was provided by the ratio pulmonary systolic arterial pressure/left ventricular stroke volume (PSAP/LVSV) an echocardiographic variable that evaluates the interventricular dependence in PE. The authors found that a ratio ≥1 mmHg/mL was associated with an increased risk of adverse short-term outcomes in patients with acute intermediate risk PE [48].
A recent retrospective study that evaluated the relationship of different echocardiographic parameters with treatment strategy in sub massive and massive PE observed that changes in LVOT VTI, rather than echocardiographic markers of right ventricular dysfunction, may be considered a more useful prognostic marker of both dysfunction and improvement after reperfusion therapy [48]. The value of a low LVOT VTI in predicting adverse outcome in patients with intermediate risk PE is because this parameter reflects a reduced stroke volume and probably a subclinical shock, despite a normal BP.
Hemodynamic instability at admission represents a high risk and in this clinical setting immediate reperfusion therapy is mandatory. For hemodynamically stable patients at presentation, further risk stratification of PE is recommended, as it has implications for determining the appropriate therapeutic management approach. The study included intermediate risk patients because further risk stratification in this group and identification of patients at highest risk of poor outcome that will require escalation of therapy remains a challenge. For patients clinically classified at low risk two recent meta-analysis reported that RVD affects prognosis [14,34]. Echocardiography should be considered in the low-risk group to identify those patients that will require hospitalization. In the study performed by Yuriditski et al., most patients (n = 109, 58%) were categorized as having intermediate-risk. But the study also included a low number of patients at high risk, respectively (11, 5.9%) with a low LVOT VTI being demonstrated in most of them (10, 90.9%). Low risk patients were better represented in this study (n = 68, 36.2%) and low LVOT VTI was present in only in four of them (5.88%) [27]. In the study performed by Kamran et al., that evaluated concomitantly left and right heart hemodynamic, patients with low-risk PE and high-risk (massive) PE were underrepresented and so the performance of pulmonary artery systolic pressure/left ventricle stroke volume (PASP/LVSV) in these patient groups could not be evaluated [48]. The study performed by Antoine et al. had the objective to compare ultrasound-accelerated thrombolysis versus systemic thrombolysis versus anticoagulation alone and their effect on LVOT VTI. This was a retrospective cohort study of subjects with a diagnosis of sub massive or massive pulmonary embolism according to American Heart Association guideline definitions. It was difficult to control for disease severity but in this study most patients had massive-high risk PE. Greater improvement in LVOT VTI was observed in patients treated with ultrasound-accelerated thrombolysis as compared to anticoagulation alone. Changes in LVOT VTI rather than echocardiographic markers of right ventricular dysfunction, were found to be more useful prognostic marker of both dysfunction and improvement after reperfusion therapy [49]. How to better identify patients at risk of hemodynamic deterioration or death in initially stable intermediate risk patients remains a challenge. Both an increased RV to LV ratio and/or a low LVOT VTI are useful for identifying normotensive patients with PE at risk for short term adverse outcome. The combined criteria of a low LVOT VTI ≤ 15 cm and increased RV/LV ratio ≥ 1 had a 75% positive predictive value for in-hospital adverse outcome. The clinical implication is that 75% of those patients that had both criteria developed an adverse outcome during hospitalization. Evaluation of these parameters with point of care ultrasound allows a rapid risk stratification of PE patients. Admission in the intensive care unit and close monitoring is recommended for these patients because they will probably require escalation of therapy.
The limitation of the study is his retrospective nature that may bias the tests performance statistics since echocardiography was performed faster after admission and more complete echocardiographic examinations were recorded in more severe patients. Future prospective studies that will examine the value of combining these two echocardiographic criteria are needed to validate these findings.

5. Conclusions

Low LVOT VTI and an increased RV/LV ratio are useful for identifying normotensive patients with PE at risk for short term adverse outcomes. Combining an LVOT VTI ≤ 15 cm with a RV/LV ratio ≥ 1, can identify PE patients with impending risk of clinical deterioration, that require close monitoring with increased specificity and positive predictive value. These two echocardiographic parameters proved good accuracy for risk stratification of patients with intermediate risk PE.

Author Contributions

Conceptualization, E.E.B.; Data curation, E.E.B. and M.S.; Formal analysis, E.E.B., D.M.T. and A.F.B.; Funding acquisition, S.G.B.; Investigation, E.E.B., M.S., D.U., M.M.T., A.F.B. and C.B.; Methodology, E.E.B. and D.U.; Resources, E.E.B. and M.M.T.; Software, E.E.B.; Supervision, S.G.B. and D.M.T.; Validation, M.S. and C.B.; Visualization, D.M.T. and C.B.; Writing—original draft, E.E.B. and D.M.T.; Writing—review & editing, E.E.B., A.F.B. and S.G.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Romanian Ministry of Research, Innovation and Digitization through Programme 1—Development of the National Research and Development System, Subprogramme 1.2—Institutional Performance—Projects for funding excellence in RDI, Contract No. 29 PFE/30.12.2021 with University of Oradea. APC was supported by the University of Oradea through an internal project.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Ethics Committee of the Clinical County Emergency Hospital of Oradea, Bihor County, Romania (decision no 9411/08.04.2021).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data are available in the electronic registration data base of the Clinical County Emergency Hospital of Oradea, Bihor County, Romania.

Acknowledgments

The authors would like to thank to the University of Oradea, Oradea, Romania for all support.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Keller, K.; Hobohm, L.; Ebner, M.; Kresoja, K.P.; Munzel, T.; Konstantinides, S.V.; Lankeit, M. Trends in thrombolytic treatment and outcomes of acute pulmonary embolism in Germany. Eur. Heart J. 2020, 41, 522–529. [Google Scholar] [CrossRef] [Green Version]
  2. De Miguel-Diez, J.; Jimenez-Garcia, R.; Jimenez, D.; Monreal, M.; Guijarro, R.; Otero, R.; Hernandez-Barrera, V.; Trujillo-Santos, J.; Lopez de Andres, A.; Carrasco-Garrido, P. Trends in hospital admissions for pulmonary embolism in Spain from 2002 to 2011. Eur. Respir. J. 2014, 44, 942–950. [Google Scholar] [CrossRef] [Green Version]
  3. Dentali, F.; Ageno, W.; Pomero, F.; Fenoglio, L.; Squizzato, A.; Bonzini, M. Time trends and case fatality rate of in-hospital treated pulmonary embolism during 11 years of observation in Northwestern Italy. Thromb. Haemost. 2016, 115, 399–405. [Google Scholar]
  4. Lehnert, P.; Lange, T.; Moller, C.H.; Olsen, P.S.; Carlsen, J. Acute pulmonary embolism in a national Danish cohort: Increasing incidence and decreasing mortality. Thromb. Haemost. 2018, 118, 539–546. [Google Scholar] [CrossRef]
  5. Pruszczyk, P.; Skowronska, M.; Ciurzynski, M.; Kurnica, K.; Lankeit, M.; Konstantinidis, S. Assessment of pulmonary embolism severity and the risk of early death. Pol. Arch. Intern. Med. 2021, 131, 16134. [Google Scholar] [CrossRef]
  6. Konstantinides, S.V.; Meyer, G.; Becattini, C.; Bueno, H.; Geersing, G.J.; Harjola, V.P.; Huisman, M.V.; Humbert, M.; Jennings, C.S.; Jimenez, D.; et al. 2019 ESC Guidelines for the diagnosis and management of acute pulmonary embolism developed in collaboration with the European Respiratory Society (ERS). Eur. Heart J. 2020, 41, 543–603. [Google Scholar] [CrossRef]
  7. Jiménez, D.; de Miguel-Díez, J.; Guijarro, R.; Trujillo-Santos, J.; Otero, R.; Barba, R.; Muriel, A.; Meyer, G.; Yusen, R.D.; Monreal, M.; et al. Trends in the management and outcomes of acute pulmonary embolism: Analysis from the RIETE Registry. J. Am. Coll. Cardiol. 2016, 67, 162–170. [Google Scholar] [CrossRef] [Green Version]
  8. Beckman, M.G.; Hooper, W.C.; Critchley, S.E.; Ortel, T.L. Venous thromboembolism: A public health concern. Am. J. Prev. Med. 2010, 38, S495–S501. [Google Scholar] [CrossRef]
  9. Alotaibi, G.S.; Wu, C.; Senthilselvan, A.; McMurtry, M.S. Secular trends in incidence and mortality of acute venous thromboembolism: The AB-VTE population-based study. Am. J. Med. 2016, 129, 879. [Google Scholar] [CrossRef]
  10. Kahn, S.R.; Hirsch, A.M.; Akaberi, A.; Hernandez, P.; Anderson, D.R.; Wells, P.S.; Rodger, M.A.; Solymoss, S.; Kovacs, M.J.; Rudski, L.; et al. Functional and exercise limitations after a first episode of pulmonary embolism: Results of the ELOPE prospective cohort study. Chest 2017, 151, 1058–1068. [Google Scholar] [CrossRef]
  11. Bloomer, T.L.; El-Hayek, G.E.; McDaniel, M.C.; Sandvall, B.C.; Liberman, H.A.; Devireddy, C.M.; Kumar, G.; Fong, P.P.; Jaber, W.A. Safety of catheter-directed thrombolysis for massive and sub massive pulmonary embolism: Results of a multicentre registry and meta-analysis. Catheter. Cardiovasc. Interv. 2017, 89, 754–760. [Google Scholar] [CrossRef]
  12. Babes, E.E.; Bustea, C.; Behl, T.; Abdel-Daim, M.M.; Nechifor, A.C.; Stoicescu, M.; Brisc, C.M.; Moisi, M.; Gitea, D.; Iovanovici, D.C.; et al. Acute coronary syndromes in diabetic patients, outcome, revascularization, and antithrombotic therapy. Biomed. Pharmacother. 2022, 148, 112772. [Google Scholar] [CrossRef]
  13. Chen, Y.L.; Wright, C.; Pietropaoli, A.P.; Elbadawi, A.; Delehanty, J.; Barrus, B.; Gosev, I.; Trawick, D.; Patel, D.; Cameron, S.J. Right ventricular dysfunction is superior and sufficient for risk stratification by a pulmonary embolism response team. J. Thromb. Thrombolysis 2020, 49, 34–41. [Google Scholar] [CrossRef]
  14. Becattini, C.; Maraziti, G.; Vinson, D.R.; Ng, A.C.C.; den Exter, P.L.; Côté, B.; Vanni, S.; Doukky, R.; Khemasuwan, K.; Weekes, A.J.; et al. Right ventricle assessment in patients with pulmonary embolism at low risk for death based on clinical models: An individual patient data meta-analysis. Eur. Heart J. 2021, 42, 3190–3199. [Google Scholar] [CrossRef]
  15. Piazza, G.; Goldhaber, S.Z. Management of sub massive pulmonary embolism. Circulation 2010, 122, 1124–1129. [Google Scholar] [CrossRef] [Green Version]
  16. Pruszczyk, P.; Goliszek, S.; Lichodziejewska, B.; Kostrubiec, M.; Ciurzyński, M.; Kurnicka, K.; Dzikowska-Diduch, O.; Palczewski, P.; Wyzgal, A. Prognostic value of echocardiography in normotensive patients with acute pulmonary embolism. JACC Cardiovasc. Imaging 2014, 7, 553–560. [Google Scholar] [CrossRef] [Green Version]
  17. Sanchez, O.; Trinquart, L.; Colombet, I.; Durieux, P.; Huisman, M.V.; Chatellier, G.; Meyer, G. Prognostic value of right ventricular dysfunction in patients with hemodynamically stable pulmonary embolism: A systematic review. Eur. Heart J. 2008, 29, 1569–1577. [Google Scholar] [CrossRef] [Green Version]
  18. Cho, J.H.; Sridharan, G.K.; Kim, S.H.; Kaw, R.; Abburi, T.; Irfan, A.; Kocheril, A.G. Right ventricular dysfunction as an echocardiographic prognostic factor in hemodynamically stable patients with acute pulmonary embolism: A meta-analysis. BMC Cardiovasc. Disord. 2014, 14, 64. [Google Scholar] [CrossRef]
  19. Lobo, J.L.; Holley, A.; Taoism, V.; Moores, L.; Oribe, M.; Barrón, M.; Otero, R.; Nauffal, D.; Valle, R.; Monreal, M.; et al. Prognostic significance of tricuspid annular displacement in normotensive patients with acute symptomatic pulmonary embolism. J. Thromb. Haemost. 2014, 12, 1020–1027. [Google Scholar] [CrossRef]
  20. McConnell, M.; Solomon, S.D.; Rayan, M.E.; Come, P.C.; Goldhaber, S.Z.; Leeet, R.T. Regional right ventricular dysfunction detected by echocardiography in acute pulmonary embolism. Am. J. Cardiol. 1996, 78, 469–473. [Google Scholar] [CrossRef]
  21. Ten Wolde, M.; Sohne, M.; Quak, E.; Mac Gilavry, M.R.; Bulller, H.R. Prognostic value of echocardiographically assessed right ventricular dysfunction in patients with pulmonary embolism. Arch. Intern. Med. 2004, 164, 1685–1689. [Google Scholar] [CrossRef] [Green Version]
  22. Coutance, G.; Cauderlier, E.; Ehtisham, J.; Hamon, M.; Hamon, M. The prognostic value of markers of right ventricular dysfunction in pulmonary embolism: A meta-analysis. Crit. Care 2011, 15, R103. [Google Scholar] [CrossRef] [Green Version]
  23. Alerhand, S.; Sundaram, T.; Gottlieb, M. What are the echocardiographic findings of acute right ventricular strain that suggest pulmonary embolism? Anaesth. Crit. Care Pain Med. 2021, 40, 100852. [Google Scholar] [CrossRef]
  24. Dahhan, T.; Siddiqui, I.; Tapson, V.F.; Velazquez, E.J.; Sun, S.; Davenport, C.A.; Samad, Z.; Rajagopal, S. Clinical and echocardiographic predictors of mortality in acute pulmonary embolism. Cardiovasc. Ultrasound 2016, 14, 44. [Google Scholar] [CrossRef] [Green Version]
  25. Burgos, L.M.; Scatularo, C.E.; Cigalini, I.M.; Jauregui, J.C.; Bernal, M.I.; Bonorino, J.M.; Thierer, J.; Zaidel, E.J. The addition of echocardiographic parameters to PESI score improves mortality prediction in patients with acute pulmonary embolism: PESI-Echo score. Eur. Heart J. Acute Cardiovasc. Care 2021, 10, 250–257. [Google Scholar] [CrossRef]
  26. Rodrigues, A.C.T.; Cordovil, A.; Monaco, C.G.; Guimares, L.A.B.; de Oliveira, W.A.A.; Fischer, C.H.; de Lira-Pilho, E.B.; Vieira, M.L.C.; Morhy, S.S. Assessing prognosis of pulmonary embolism using tissue-Doppler echocardiography and brain natriuretic peptide. Einstein 2013, 11, 338–344. [Google Scholar] [CrossRef]
  27. Yuriditsky, E.; Mitchell, O.J.; Sibley, R.A.; Xia, Y.; Sista, A.K.; Zhong, J.; Moore, W.H.; Amoroso, N.E.; Goldenberg, R.M.; Smith, D.E.; et al. Low left ventricular outflow tract velocity time integral is associated with poor outcomes in acute pulmonary embolism. Vasc. Med. 2020, 25, 133–140. [Google Scholar] [CrossRef]
  28. Tan, C.; Rubenson, D.; Srivastava, A.; Mohan, R.; Smith, M.R.; Billick, K.; Bardarian, S.; Heywood, J.T. Left ventricular outflow tract velocity time integral outperforms ejection fraction and Doppler-derived cardiac output for predicting outcomes in a select advanced heart failure cohort. Cardiovasc. Ultrasound 2017, 15, 18. [Google Scholar] [CrossRef]
  29. Betcher, J.; Majkrzac, A.; Cranford, J.; Kessler, R.; Theyyunni, N.; Huang, R. Feasibility study of advanced focused cardiac measurements within the emergency department. Crit. Ultrasound J. 2018, 10, 10. [Google Scholar] [CrossRef]
  30. Blanco, P. Rationale for using the velocity–time integral and the minute distance for assessing the stroke volume and cardiac output in point-of-care settings. Ultrasound J. 2020, 12, 21. [Google Scholar] [CrossRef] [Green Version]
  31. Chinen, D.; Fujino, M.; Anzai, T.; Kitakaze, M.; Goto, Y.; Ishihara, M.; Shimizu, W.; Yokoyama, H.; Yasuda, S.; Ogawa, H. Left ventricular outflow tract velocity time integral correlates with low cardiac output syndrome in patients with acute decompensated heart failure. Eur. Heart J. 2013, 34 (Suppl. 1), P4249. [Google Scholar] [CrossRef] [Green Version]
  32. IBM Corp. IBM SPSS Statistics for Windows; Version 25.0; IBM Corp.: Armonk, NY, USA, 2017. [Google Scholar]
  33. Dean, A.G.; Sullivan, K.M.; Soe, M.M. OpenEpi: Open Source Epidemiologic Statistics for Public Health, Version. 2013. Available online: http://www.openepi.com/Menu/OE_Menu.htm (accessed on 18 March 2022).
  34. Barco, S.; Mahmoudpour, S.; Planquette, B.; Sanchez, O.; Konstantinides, S.V.; Meyer, G. Prognostic value of right ventricular dysfunction or elevated cardiac biomarkers in patients with low-risk pulmonary embolism: A systematic review and meta-analysis. Eur. Heart J. 2019, 40, 902–910. [Google Scholar] [CrossRef] [Green Version]
  35. Meinel, F.G.; Nance, J.V., Jr.; Schoepf, U.J.; Hoffmann, V.S.; Thierfelder, K.M.; Costello, P.; Goldhaber, S.Z.; Bamberg, F. Predictive value of computed tomography in acute pulmonary embolism Systematic review and meta-analysis. Am. J. Med. 2015, 128, 747–759. [Google Scholar] [CrossRef]
  36. Meyer, G.; Vicaut, E.; Danays, T.; Agnelli, G.; Becattini, C.; Beyer-Westendorf, J.; Blumhki, E.; Bouvaist, H.; Brenner, B.; Couturaud, F.; et al. Fibrinolysis for patients with intermediate-risk pulmonary embolism. N. Engl. J. Med. 2014, 370, 1402–1411. [Google Scholar] [CrossRef]
  37. Pruszczyk, P.; Kurnicka, K.; Ciurzyński, M.; Hobohm, L.; Thielmann, A.; Sobkowicz, B.; Sawicka, E.; Kostrubiec, M.; Ptaszyńska-Kopczyńska, K.; Dzikowska-Diduch, O.; et al. Defining right ventricular dysfunction by echocardiography in normotensive patients with pulmonary embolism. Pol. Arch. Intern. Med. 2020, 130, 741–747. [Google Scholar] [CrossRef]
  38. Cho, S.-u.; Cho, Y.-d.; Choi, S.-h.; Yoon, Y.-h.; Park, J.-h.; Park, S.-j.; Lee, E.-s. Assessing the severity of pulmonary embolism among patients in the emergency department: Utility of RV/LV diameter ratio. PLoS ONE 2020, 15, e0242340. [Google Scholar] [CrossRef]
  39. Khemasuwan, D.; Yingchoncharoen, T.; Tunsupon, P.; Kusunose, K.; Moghekar, A.; Klein, A.; Tonelli, A.R. Right ventricular echocardiographic parameters are associated with mortality after acute pulmonary embolism. J. Am. Soc. Echocardiogr. 2015, 28, 355–362. [Google Scholar] [CrossRef]
  40. McLean, A.S. Echocardiography in shock management. Crit. Care 2016, 20, 275. [Google Scholar] [CrossRef] [Green Version]
  41. Blanco, P.; Aguiar, F.M.; Blaivas, M. Rapid Ultrasound in Shock (RUSH) Velocity-Time Integral: A proposal to expand the RUSH protocol. J. Ultrasound Med. 2015, 24, 1691–1700. [Google Scholar] [CrossRef]
  42. Bergenzaun, L.; Gudmundsson, P.; Öhlin, H.; During, J.; Ersson, A.; Ihrman, L.; Willenheimer, R.; Chew, M.S. Assessing left ventricular systolic function in shock: Evaluation of echocardiographic parameters in intensive care. Crit. Care 2011, 15, R200. [Google Scholar] [CrossRef] [Green Version]
  43. Dinh, V.A.; Ko, H.S.; Rao, R.; Bansal, R.C.; Smith, D.D.; Kim, T.E.; Nguyen, H.B. Measuring cardiac index with a focused cardiac ultrasound examination in the ED. Am. J. Emerg. Med. 2012, 30, 1845–1851. [Google Scholar] [CrossRef]
  44. McGregor, D.; Sharma, S.; Gupta, S.; Ahmad, S.; Godec, T.; Harris, T. Emergency department non-invasive cardiac output study (EDNICO): A feasibility and repeatability study. Scand. J. Trauma Resusc. Emerg. Med. 2019, 27, 30. [Google Scholar] [CrossRef]
  45. Villavicencio, C.; Leache, J.; Marin, J.; Oliva, I.; Rodriguez, A.; Bodí, M.; Soni, N.J. Basic critical care echocardiography training of intensivists allows reproducible and reliable measurements of cardiac output. Ultrasound J. 2019, 11, 5. [Google Scholar] [CrossRef]
  46. Prosperi-Porta, G.; Solverson, K.; Fine, N.; Humphreys, C.J.; Ferland, A.; Weatherald, J. Echocardiography-Derived Stroke Volume Index Is Associated with Adverse In-Hospital Outcomes in Intermediate-Risk Acute Pulmonary Embolism: A Retrospective Cohort Study. Chest 2020, 158, 1132–1142. [Google Scholar] [CrossRef]
  47. Falsetti, L.; Marra, A.M.; Zaccone, V.; Sampaolesi, M.; Riccomi, F.; Giovenali, L.; Guerrieri, E.; Viticchi, G.; D’Agostino, A.; Gentili, T.; et al. Echocardiographic predictors of mortality in intermediate-risk pulmonary embolism. Intern. Emerg. Med. 2022. [Google Scholar] [CrossRef]
  48. Kamran, H.; Hariri, E.H.; Iskandar, J.P.; Sahai, A.; Haddadin, I.; Harb, S.C.; Campbell, J.; Tefera, L.; Delehanty, J.M.; Heresi, G.A.; et al. Simultaneous Pulmonary Artery Pressure and Left Ventricle Stroke Volume Assessment Predicts Adverse Events in Patients with Pulmonary Embolism. J. Am. Heart Assoc. 2021, 10, e019849. [Google Scholar] [CrossRef]
  49. Antoine, D.; Chuich, T.; Mylvaganam, R.; Malaisrie, C.; Freed, B.; Cuttica, M.; Schimmel, D., Jr. Relationship of left ventricular outflow tract velocity time integral to treatment strategy in submassive and massive pulmonary embolism. Pulm. Circ. 2020, 10, 1–7. [Google Scholar] [CrossRef]
Figure 1. Study flow diagram.
Figure 1. Study flow diagram.
Diagnostics 12 01226 g001
Figure 2. ROC curve for (a) RV/LV as predictor of adverse events in intermediate risk PE; (b) LVOT VTI as predictor of adverse outcome in intermediate risk PE.
Figure 2. ROC curve for (a) RV/LV as predictor of adverse events in intermediate risk PE; (b) LVOT VTI as predictor of adverse outcome in intermediate risk PE.
Diagnostics 12 01226 g002
Figure 3. ROC curves for adverse event prediction in intermediate risk PE.
Figure 3. ROC curves for adverse event prediction in intermediate risk PE.
Diagnostics 12 01226 g003
Figure 4. ROC curves for (a) LVOT VTI as adverse events predictors in intermediate-high risk PE; (b) RV/LV as predictor of adverse events in intermediate-high risk PE.
Figure 4. ROC curves for (a) LVOT VTI as adverse events predictors in intermediate-high risk PE; (b) RV/LV as predictor of adverse events in intermediate-high risk PE.
Diagnostics 12 01226 g004
Figure 5. ROC curves for adverse events prediction in intermediate-high risk PE.
Figure 5. ROC curves for adverse events prediction in intermediate-high risk PE.
Diagnostics 12 01226 g005
Table 1. Comparative baseline demographic, clinical and laboratory parameters in patients with and without in hospital adverse outcomes.
Table 1. Comparative baseline demographic, clinical and laboratory parameters in patients with and without in hospital adverse outcomes.
Death, Resuscitated Cardiac Arrest, Hemodynamic Instability and Need of Reperfusion Therapyp
Adverse OutcomeTotal (396)Yes (50)No (346)
Age (years)73.58 ± 11.22171.22 ± 13.2773.92 ± 10.870.09
Sex (F)202/396 (51%)27/50 (54%)175/346 (50.57%)0.120
Smoking134/396 (33.83%)15/50 (30%)119/346 (34.39%)0.26
History of cancer67/396 (16.92%)8/50 (16%)59/346 (17.05%)0.628
History of cardiovascular disease302/396 (76.3%)31/50 (62%)271/346 (78.32%)0.01 *
Heart failure132/396 (33.33%)14/50 (28%)118/346 (34.10%)0.19
Coronary artery disease86/396 (21.71%)8/50 (16%)78/346 (22.54%)0.14
Valvular heart disease114/396 (28.79%)10/50 (20%)104/346 (30.06%)0.07
Hypertension210/396 (53.03%)20/50 (40%)190/346 (54.91%)0.02 *
History of pulmonary disease106/396 (26.8%)13/50 (26%)93/346 (26.88%)0.896
Obstructive pulmonary disease79/396 (19.94%)10/50 (20%)69/346 (19.94%)0.49
Restrictive pulmonary disease19/396 (4.80%)4/50 (8%)15/346 (4.33%)0.12
Combined obstructive and restrictive pulmonary disease8/396 (2.02%)2/50 (4%)6/346 (1.73%)0.14
Diabetes82/396 (20.7%)13/50 (26%)69/346 (19.94%)0.324
History of stroke41/396 (10.35%)5/50 (10%)36/346 (10.40%)0.46
History of recent surgery 23/396 (5.80%)3/50 (6%)20/346 (5.78%)0.47
History of recent orthopedic surgery or major trauma20/396 (5.05%)4/50 (8%)16/346 (4.62%)0.15
Previous DVT/PE54/396 (13.63%)10/50 (20%)44/346 (12.72%)0.03 *
BMI (kg/m²)30.25 ± 6.7332.87 ± 6.0627.62 ± 6.690.12
Systolic BP (mm Hg)126.85 ± 22.234121.73 ± 21.94128.25 ± 22.170.07
HR91.571 ± 19.1494.142 ± 19.8689 ± 18.420.368
DVT69/396 (17.42%)8/50 (16%)61/346 (17.63%)0.649
Cholesterol (mg/dL)232.6 ± 66.61251.40 ± 32.88213.8 ± 89.550.06
NT-proBNP (pg/mL)5267.354 ± 6991.847307.27 ± 9350.974975 ± 6583.970.187
Hs-Troponin (pg/mL)306.66 ± 579.82711.054 ± 596.66193.32 ± 523.62<0.001 *
Legend: BP—blood pressure, HR—heart rate, DVT—deep vein thrombosis, PE—pulmonary embolism, BMI—body mass index, NT-proBNP—N-terminal pro b-type natriuretic peptide, Hs-Troponin—highly sensitive troponin; * statistically significant (<0.05).
Table 2. Comparative baseline echocardiographic parameters in patients with and without in-hospital adverse outcomes.
Table 2. Comparative baseline echocardiographic parameters in patients with and without in-hospital adverse outcomes.
Death, Resuscitated Cardiac Arrest, Hemodynamic Instability and Need of Reperfusion Therapyp
Adverse OutcomeTotal (396)Yes (50)No (346)
TAPSE < 16 mm116/396 (29.29%)23/50 (46%)93/346 (26.88%)0.022 *
TAPSE (mm)20.35 ± 6.5217.68 ± 5.9320.76 ± 6.510.001 *
Paradoxical movement or flattening of IVS113/396 (28.54%)20/50 (40%)93/346 (26.88%)0.057
PSAP (mmHg)40.38 ± 12.20243.66 ± 14.5239.99 ± 11.8080.129
Mc Connell sign124/396 (31.31%)19/50 (38%)105/346 (30.34%)0.283
RV/LV ≥ 1123/396 (31.1%)36/50 (72%)87/346 (25.14%)<0.001 *
RV/LV0.93 ± 0.311.28 ± 0.450.884 ± 0.26<0.001 *
LVOT VTI (cm)18.87 ± 4.3813.88 ± 2.5819.60 ± 4.10<0.001 *
LVOT VTI ≤ 15 cm99/396 (25%)38/50 (76%)61/346 (17.63%)<0.001 *
LVEF (%)47.60 ± 8.1348.25 ± 8.8647.51 ± 8.060.610
IVC (mm)21.94 ± 8.0723.18 ± 7.9720.25 ± 8.440.451
Legend: TAPSE—tricuspid annular plane systolic excursion, IVS—interventricular septum, PSAP—pulmonary systolic arterial pressure, RV—right ventricle, LV—left ventricle, LVOT VTI—left ventricle outflow tract velocity-time integral, LVEF—left ventricle ejection fraction, IVC—inferior vena cava; * statistically significant (<0.05).
Table 3. Comparative baseline demographic, clinical and laboratory parameters in patients with and without in hospital death or resuscitated cardiac arrest.
Table 3. Comparative baseline demographic, clinical and laboratory parameters in patients with and without in hospital death or resuscitated cardiac arrest.
Death or Resuscitated Cardiac ArrestYes (23)No (373)p
Age (years)73.00 ± 15.9773.61 ± 10.8900.799
Sex (F)13/23 (56.52%)189/373 (50.67%)0.001 *
Smoking7/23 (30.43%)127/373 (34%)0.36
History of cancer4/23 (17.39%)63/373 (16.89%)0.928
History of cardiovascular disease14/23 (60.87%)288/373 (77.21%)0.797
Heart failure8/23 (34.78%)124/373 (33.24%)0.43
Coronary artery disease5/23 (21.74%)81/373 (21.72%)0.49
Valvular heart disease6/23 (26.08%)108/373 (28.95%)0.38
Hypertension11/23 (47.82%)199/373 (53.35%)0.3
History of pulmonary disease5/23 (21.74%)101/373 (27.08%)0.676
Obstructive pulmonary disease3/23 (13.04%)76/373 (20.38%)0.41
Restrictive pulmonary disease1/23 (4.35%)18/373 (4.83%)0.45
Combined obstructive and restrictive pulmonary disease1/23 (4.35%)7/373 (1.88%)0.20
Diabetes6/23 (26.09%)76/373 (20.38%)0.513
History of stroke4/23 (17.39%)37/373 (9.92%)0.12
History of recent surgery1/23 (4.34%)22/373 (5.90%)0.37
History of recent orthopedic surgery or major trauma2/23 (8.69%)18/373 (4.83%)0.20
Previous DVT/PE4/23 (17.39%)50/373 (13.40%)0.13
BMI (kg/m²)33.00 ± 5.8728.60 ± 6.960.20
Systolic BP (mmHg)115.83 ± 16.88128.18 ± 22.40.002 *
HR96.2 ± 10.5987.5 ± 16.460.521
DVT1/23 (4.34%)68/373 (18.23%)0.08/0.007 *
Cholesterol (mg/dL)249 ± 45.17225.57 ± 76.050.56
NT-proBNP (pg/mL)11,029.0 ± 11,349.294883.24 ± 6488.530.01 *
Hs-Troponin (pg/mL)814.70 ± 718.55238.475 ± 525.151<0.001 *
Legend: BP—blood pressure, HR—heart rate, DVT—deep vein thrombosis, PE—pulmonary embolism, BMI—body mass index, NT-proBNP—N-terminal pro b-type natriuretic peptide, Hs-Troponin—high sensitive troponin; * statistically significant (<0.05).
Table 4. Comparative baseline echocardiographic parameters in patients with and without in hospital death or resuscitated cardiac arrest.
Table 4. Comparative baseline echocardiographic parameters in patients with and without in hospital death or resuscitated cardiac arrest.
Death or Resuscitated Cardiac ArrestYes (23)No (373)p
TAPSE < 16 mm9/23 (39.13%)107/373 (28.68%)0.431
TAPSE (mm)19.17 ± 6.2720.43 ± 6.530.36
Paradoxical movement or flattening of IVS11/23 (47.82%)102/373 (27.34%)0.036 *
PSAP (mmHg)45.94 ± 16.21339.98 ± 11.8080.059
McConnel sign10/23 (43.47%)114/373 (30.56%)0.07
RV/LV ≥ 115/23 (65.22%)108/373 (28.95%)0.001 *
RV/LV1.2 ± 0.440.92 ± 0.303<0.001 *
LVOT VTI (cm)13.65 ± 2.7519.19 ± 4.25<0.001 *
LVOT VTI ≤ 15 cm20/23 (86.96%)79/373 (21.18%)<0.001 *
LVEF (%)47.93 ± 11.47247.59 ± 7.960.879
IVC (mm)24.12 ± 6.7520.36 ± 8.900.33
Legend: TAPSE—tricuspid annular plane systolic excursion, IVS—interventricular septum, PSAP—pulmonary systolic arterial pressure, RV—right ventricle, LV—left ventricle, LVOT VTI—left ventricle outflow tract velocity-time integral, LVEF—left ventricle ejection fraction, IVC—inferior vena cava; * statistically significant (<0.05).
Table 5. Comparative baseline demographic, clinical and laboratory parameters in patients with and without in hospital hemodynamic instability or need of reperfusion therapy.
Table 5. Comparative baseline demographic, clinical and laboratory parameters in patients with and without in hospital hemodynamic instability or need of reperfusion therapy.
Hemodynamic Instability or Reperfusion TherapyYes (27)No (369)p
Age (years)69.70 ± 10.55073.86 ± 11.2290.064
Sex (F)13/27 (48.15%)189/369 (51.22%)0.618
Smoking8/279 (9.63%)126/369 (34.14%)0.31
History of cancer4/27 (14.81%)63/369 (17.07%)0.463
History of cardiovascular disease17/27 (62.96%)285/369 (77.24%)0.095
Heart failure6/27 (22.22%)126/369 (31.81%)0.22
Coronary artery disease3/27 (11.11%)83/369 (22.49%)0.14
Valvular heart disease4/27 (14.81%)110/369 (29.81%)0.10
Hypertension9/27 (33.33%)201/369 (54.47%)0.08
History of pulmonary disease8/27 (29.63%)98/369 (26.56%)0.729
Obstructive pulmonary disease5/27 (18.52%)74/369 (20.05%)0.42
Restrictive pulmonary disease2/27 (7.41%)17/369 (4.61%)0.27
Combined obstructive and restrictive pulmonary disease1/27 (3.70%)7/369 (1.89%)0.25
Diabetes7/27 (25.93%)75/369 (20.33%)0.489
History of stroke1/27 (3.70%)40/369 (10.84%)0.12
History of recent surgery2/27 (7.41%)21/369 (5.69%)0.35
History of recent orthopedic surgery or major trauma2/27 (7.41%)18/369 (4.87%)0.28
Previous DVT/PE6/27 (22.22%)48/369 (13%)0.08
BMI (kg/m²)255 ± 14.14227 ± 74.140.34
Systolic BP (mm Hg)127.69 ± 24.382126.74 ± 22.0060.837
HR96.2 ± 10.5987.5 ± 16.460.521
DVT7/27 (25.93%)62/369(16.80%)0.19
Cholesterol (mg/dL)255 ± 15.14227 ± 74.140.15
NT-proBNP (pg/mL)3585 ± 50835377 ± 71020.459
Hs-Troponin (pg/mL)588.02 ± 400.018272. 67 ± 590.270.007 *
Legend: BP—blood pressure, HR—heart rate, DVT—deep vein thrombosis, PE—pulmonary embolism, BMI—body mass index, NT-proBNP—N-terminal pro b-type natriuretic peptide, Hs-troponin—high sensitive troponin; * statistically significant (<0.05).
Table 6. Comparative baseline echocardiographic parameters in patients with and without in hospital hemodynamic instability or need of reperfusion therapy.
Table 6. Comparative baseline echocardiographic parameters in patients with and without in hospital hemodynamic instability or need of reperfusion therapy.
Hemodynamic Instability or Reperfusion TherapyYes (27)No (369)p
TAPSE < 16 mm14/27 (51.85%)102/369 (27.64%)0.013 *
TAPSE (mm)16.40 ± 5.4320.66 ± 6.500.001 *
Paradoxical movement or flattening of IVS9/27 (33.33%)104/369 (28.18%)0.57
PSAP (mm Hg)40.85 ± 12.16440.35 ± 12.230.889
Mc Connell sign9/27 (33.33%)115/369 (31.17%)0.82
RV/LV ≥ 122/27 (81.48%)101/369 (27.37%)<0.001 *
RV/LV1.34 ± 0.450.90 ± 0.29<0.001 *
LVOT VTI (cm)13.96 ± 2.3819.23 ± 4.27<0.001 *
LVOT VTI ≤ 15 cm18/27 (66.66%)81/369 (21.95%)<0.001 *
LVEF (%)48.45 ± 7.01547.54 ± 8.210.612
IVC (mm)20.66 ± 12.0522.19 ± 7.650.77
Legend: TAPSE—tricuspid annular plane systolic excursion, IVS—interventricular septum, PSAP—pulmonary systolic arterial pressure, RV—right ventricle, LV—left ventricle, LVOT VTI—left ventricle outflow tract velocity-time integral, LVEF—left ventricle ejection fraction, IVC—inferior vena cava; * statistically significant (<0.05).
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Babes, E.E.; Stoicescu, M.; Bungau, S.G.; Uivarosan, D.; Tit, D.M.; Toma, M.M.; Bungau, A.F.; Bustea, C. Left Ventricle Outflow Tract Velocity-Time Index and Right Ventricle to Left Ventricle Ratio as Predictors for in Hospital Outcome in Intermediate-Risk Pulmonary Embolism. Diagnostics 2022, 12, 1226. https://doi.org/10.3390/diagnostics12051226

AMA Style

Babes EE, Stoicescu M, Bungau SG, Uivarosan D, Tit DM, Toma MM, Bungau AF, Bustea C. Left Ventricle Outflow Tract Velocity-Time Index and Right Ventricle to Left Ventricle Ratio as Predictors for in Hospital Outcome in Intermediate-Risk Pulmonary Embolism. Diagnostics. 2022; 12(5):1226. https://doi.org/10.3390/diagnostics12051226

Chicago/Turabian Style

Babes, Elena Emilia, Manuela Stoicescu, Simona Gabriela Bungau, Diana Uivarosan, Delia Mirela Tit, Mirela Marioara Toma, Alexa Florina Bungau, and Cristiana Bustea. 2022. "Left Ventricle Outflow Tract Velocity-Time Index and Right Ventricle to Left Ventricle Ratio as Predictors for in Hospital Outcome in Intermediate-Risk Pulmonary Embolism" Diagnostics 12, no. 5: 1226. https://doi.org/10.3390/diagnostics12051226

APA Style

Babes, E. E., Stoicescu, M., Bungau, S. G., Uivarosan, D., Tit, D. M., Toma, M. M., Bungau, A. F., & Bustea, C. (2022). Left Ventricle Outflow Tract Velocity-Time Index and Right Ventricle to Left Ventricle Ratio as Predictors for in Hospital Outcome in Intermediate-Risk Pulmonary Embolism. Diagnostics, 12(5), 1226. https://doi.org/10.3390/diagnostics12051226

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop