Next Article in Journal
Antisclerostin Effect on Osseointegration and Bone Remodeling
Next Article in Special Issue
Reduction of EpCAM-Positive Cells from a Cell Salvage Product Is Achieved by Leucocyte Depletion Filters Alone
Previous Article in Journal
Construction and Validation of a Nomogram Clinical Prediction Model for Predicting Osteoporosis in an Asymptomatic Elderly Population in Beijing
Previous Article in Special Issue
Day -1 CD34+ Cells and Platelet Count Predict the Number of Apheresis in Poor-Mobilizer Patients Rescued by Plerixafor
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Appropriateness of Allogeneic Red Blood Cell Transfusions in Non-Bleeding Patients in a Large Teaching Hospital: A Retrospective Study

1
Department of Anaesthesiology and Intensive Care, Faculty of Medical Sciences in Katowice, Medical University of Silesia, 40-752 Katowice, Poland
2
Transfusion Committee, University Clinical Center, Medical University of Silesia, 40-752 Katowice, Poland
3
Students’ Scientific Society, Department of Anaesthesiology and Intensive Care, Faculty of Medical Sciences in Katowice, Medical University of Silesia, 40-752 Katowice, Poland
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2023, 12(4), 1293; https://doi.org/10.3390/jcm12041293
Submission received: 2 January 2023 / Revised: 2 February 2023 / Accepted: 4 February 2023 / Published: 6 February 2023

Abstract

:
In hemodynamically stable patients, both anemia and red blood cell (RBC) transfusion may be detrimental to patients; hence, a decision regarding RBC transfusion should be based on thorough risk–benefit assessment. According to hematology and transfusion medicine organizations, RBC transfusion is indicated when recommended hemoglobin (Hb) triggers are met, and symptoms of anemia are present. The aim of our study was to examine the appropriateness of RBC transfusions in non-bleeding patients at our institution. We performed a retrospective analysis of all RBC transfusions performed between January 2022 and July 2022. The appropriateness of RBC transfusion was based on the most recent Association for the Advancement of Blood and Biotherapies (AABB) guidelines and some additional criteria. The overall incidence of RBC transfusions at our institution was 10.2 per 1000 patient-days. There were 216 (26.1%) RBC units appropriately transfused and 612 (73.9%) RBC units that were transfused with no clear indications. The incidence of appropriate and inappropriate RBC transfusions were 2.6 and 7.5 per 1000 patient-days, respectively. The most frequent clinical situations when RBC transfusion was classified as appropriate were: Hb < 70 g/L plus cognitive problems/headache/dizziness (10.1%), Hb < 60 g/L (5.4%), and Hb < 70 g/L plus dyspnea despite oxygen therapy (4.3%). The most frequent causes of inappropriate RBC transfusions were: no Hb determination pre-RBC transfusion (n = 317) and, among these, RBC transfused as a second unit in a single-transfusion episode (n = 260); absence of anemia sings/symptoms pre-transfusion (n = 179); and Hb concentration ≥80 g/L (n = 80). Although the incidence of RBC transfusions in non-bleeding inpatients in our study was generally low, the majority of RBC transfusions were performed outside recommended indications. Red blood cell transfusions were evaluated as inappropriate mainly due to multiple-unit transfusion episodes, absence of anemia signs and/or symptoms pre- transfusion, and liberal transfusion triggers. There is still the need to educate physicians on appropriate indications for RBC transfusion in non-bleeding patients.

1. Introduction

The decision regarding red blood cell (RBC) transfusion constitutes a daily challenge to hospital physicians [1]. Transfusion of RBC in massive bleeding saves lives. As an unequivocally benefit in the context of bleeding, RBC transfusion is supported by clinical practice guidelines [2]. RBC transfusion performed outside bleeding emergency has a more complicated risk–benefit profile. In hemodynamically stable patients, both anemia and RBC transfusion may be detrimental to patients; hence, a decision regarding RBC transfusion should be based on thorough risk–benefit assessment.
Anemia is an independent risk factor for myocardial ischemia, stroke, acute kidney injury, and infection [3]. Even mild anemia, defined as hemoglobin (Hb) concentration 110–130 g/L in men and 110–120 g/L in women, doubles long-term mortality in patients scheduled for major elective surgery or hospitalized in the intensive care unit (ICU) [4,5]. Anemia may lead to longer hospitalization [6]. Moreover, anemia may increase the odds of RBC transfusion [7].
On the other hand, transfusion of RBC may lead to prolonged respirator weaning or weaning failure [8], pneumonia [9] and other nosocomial infections, immunomodulation, transfusion-associated cardiac overload (TACO), transfusion-associated acute lung injury (TRALI), thromboembolic complications, allergic reactions, immunization, blood-born pathogen transmission, and early and delayed hemolytic reactions. Finally, RBC transfusion may lead to increased mortality [10] and longer hospitalization.
Taking these into account, decisions regarding RBC transfusion in non-emergency setting should follow thorough risk–benefit assessment in an individual patient. Transfusion of RBC was listed by the American Board of Internal Medicine Foundation’s Choosing Wisely Campaign as one of the top five procedures for which rationale should be questioned by physicians and patients [11]. According to various organizations, RBC should be transfused at a restrictive threshold (i.e., Hb < 70 g/L) [12]. Moreover, the decision regarding RBC transfusion should be based not solely on Hb concentration but also on symptoms of anemia [13] or broader clinical context [14]. Even elderly patients may, if properly managed, tolerate very low Hb concentrations [15]. At last, in deciding on RBC transfusion, some authors suggest using the so called physiologic RBC transfusion triggers [16,17,18].
The aim of our study was to examine the appropriateness of RBC transfusions in non-bleeding patients at our institution.

2. Materials and Methods

We performed a retrospective analysis of all RBC transfusions performed in non-bleeding patients between January 2022 and July 2022. We excluded RBCs that were transfused for bleeding (n = 301) or as preparation for surgery (n = 104). Our institution is a large tertiary medical center affiliated with a medical university with 644 hospital beds in two locations. Both subspecialty surgical and subspecialty medical disciplines are represented at the institution. Gastrointestinal surgery department admits patients scheduled for gastrointestinal oncologic and non-oncologic surgery. The oncologic surgery department is a small unit that admits patients scheduled for oncologic surgery of mostly the breast, thyroid, and pancreas. In the department of autoimmune and metabolic diseases, patients with various medical diagnoses are hospitalized; some of the patients are transferred from medical oncology departments due to deterioration after chemotherapy treatment. The clinical pharmacology department specializes in optimizing the pharmacotherapy of chronic conditions and treatment of patients with dyslipidemias. The intensive care unit (ICU) is a mixed medical–surgical department. There is no hematology department at the institution. Patients with hematological diseases are occasionally hospitalized in the departments of autoimmune and metabolic diseases and clinical pharmacology.
All data were retrieved from the hospital electronic health records (AMMS, Asseco Medical Solutions, Rzeszów, Poland). The percentage of patients who received at least a single RBC was calculated for the institution in general and per hospital department. Incidence of RBC transfusions was calculated as the number of transfusions per 1000 patient-days. Demographic and clinical data on RBC recipients were retrieved: age, sex, hospital department, presence of signs and/or symptoms of anemia pre- and post RBC transfusion, laboratory markers of anaerobic metabolism (central venous oxygen saturation—ScvO2, mixed venous oxygen saturation—SvO2, blood lactate) pre- and post RBC transfusion, and Hb concentration up to 24 h pre- and post RBC transfusion. Hemoglobin concentration was determined using a venous blood sample, which is considered a gold standard for Hb determination.
We evaluated appropriateness of RBC transfusion according to the most recent clinical practice guidelines from the Association for the Advancement of Blood and Biotherapies (AABB) [14]. When deciding on appropriateness of RBC transfusion, both Hb concentration and presence of signs and/or symptoms of anemia were taken into account. As an appropriate trigger for RBC transfusion, Hb concentration <70 g/L was used [12], whereas in patients with a history of coronary artery disease (CAD), Hb concentration < 80 g/L was used. All RBC transfusions with pre-transfusion Hb concentration < 60 g/L were classified as appropriate irrespective of anemia signs and/or symptoms. When pre-transfusion Hb concentration was 60–70 g/L, RBC transfusion was classified as appropriate when at least one sign and/or symptom of anemia was present, and/or at least one laboratory marker of anaerobic metabolism was abnormal. The signs and symptoms of anemia that were looked for in evaluating the appropriateness of RBC transfusion were: dizziness, lightheadedness, headache, problems with concentration, attention deficit, shortness of breath, tachycardia, hypotension, chest pain, and new electrocardiogram (ECG) changes. These cardiologic and respiratory signs and/or symptoms had to be present following attempts at improving patients’ tolerance of anemia through hemodynamic and oxygenation optimization. The most common markers of anaerobic metabolism at our institution, used as so-called physiologic transfusion triggers, were ScvO2 and lactate. The other markers that are used as physiologic transfusion triggers are arterial–venous oxygen difference and oxygen extraction ratio. Physiologic transfusion triggers reflect the patient-sensitive and time-sensitive balance between global oxygen delivery and consumption. The patient’s tolerance of anemia depends on this fine balance. The cut-off value for ScvO2/SvO2 (<55%), indicating a need for RBC transfusion, was derived from the published literature [19]. The cut-off value for blood lactate (>1.8 mmol/L) was based on the reference range from the local laboratory. Lactate was used in the past as a marker of an oxygen deficit, helping in the optimal timing of RBC transfusion [20]. Lactate was used as a physiologic transfusion trigger due to limited number of patients in whom ScvO2 could be determined. Central venous oxygen saturation can only be determined in patients with a central line, with the tip of a central line being located in the lower part of superior vena cava. To sum up, clinical scenarios in which RBC transfusion was deemed appropriate are presented in Table 1.
We classified as inappropriate all RBCs transfused outside the abovementioned clinical scenarios or RBCs transfused with no pre-transfusion Hb determination. At our institution, we support the one-unit transfusion policy [21]. The second unit of RBC transfused during a single-transfusion event was classified as inappropriate even if there were symptoms of anemia or positive laboratory markers of anaerobic metabolism prior to transfusion of the first unit, but no reassessment of Hb concentration, anemia signs/symptoms, or physiologic transfusion triggers was performed following the first RBC unit. Inappropriate RBC transfusions constituted RBC overuse. The incidence of RBC transfusions per 1000 patient-day was calculated as well as percentage of patients in whom at least a single RBC unit was transfused. We calculated the number of appropriately and inappropriately transfused RBCs overall and per hospital department.
Statistical analysis was performed using MedCalc version 18 statistical software (MedCalc Software, Ostend, Belgium). Continuous variables were presented as median and interquartile ranges (IQR) for variables with non-normal distribution. The type of distribution was verified with Shapiro–Wilk test. Categorical variables were expressed as numbers and percentages. Statistical significance was established by the chi-square or the Fischer’s exact test. Intergroup differences were evaluated by the Mann–Whitney test. The variables pre–post RBC transfusion were analyzed using the Wilcoxson test. p < 0.05 was considered statistically significant. Due to retrospective character of the study, the local ethics committee decided that the study did not require the committee’s approval (PCN/CBN/0022/KB/292/21).

3. Results

Out of 24,117 patients, 286 received at least a single RBC unit. The overall incidence of RBC transfusions at our institution was 10.2 per 1000 patient-days. The incidence of RBC transfusions and percentage of RBC-transfused patients in individual hospital departments are presented in Table 2.
The incidence of RBC transfusions was highest in the autoimmune and metabolic diseases department, the ICU, and the clinical pharmacology department. The percentage of RBC-transfused patients was also highest in these three locations.
Demographic and clinical characteristics of patients who were transfused with RBC are presented in Table 3.
The increase in Hb concentration following RBC transfusion was significant (p < 0.01), whereas drop in lactate concentration was not (p = 0.96). In 173 (20.9%) patients, pre-transfusion Hb was <70 g/L, and in 27 (3.3%) patients, lactate was >1.8 mmol/L; in 16 (1.9%), both criteria were met.
During the 7-month period, there were 828 RBC units transfused to non-bleeding patients. There were 171 RBCs given as single-unit transfusions and 657 RBCs as multiple-unit transfusions. The numbers of RBCs that were transfused in clinical situations deemed appropriate indications for RBC transfusion are presented in Figure 1.
The most frequent clinical situations when RBC transfusion was classified as appropriate were: Hb < 70 g/L plus cognitive problems/headache/dizziness (10.1%), Hb < 60 g/L (5.4%), and Hb < 70 g/L plus dyspnea despite oxygen therapy (4.3%). Among patients with CAD in whom RBCs were transfused (n = 42), nine (21.4%) patients had cognitive symptoms, eight (19.0%) patients had dyspnea, and three (0.7%) patients had tachycardia and/or hypotension, while some patients had more than one sign/symptom. Among patients with and without CAD, the most frequent were neurological and respiratory sings/symptoms of anemia. There were 216 (26.1%) RBC units appropriately transfused and 612 (73.9%) RBC units that were transfused outside the abovementioned clinical scenarios. The most frequent causes of inappropriate RBC transfusion were: no Hb determination pre-RBC transfusion (n = 317) and among these RBC transfused as a second unit in a single-transfusion episode (n = 260), absence of anemia sings/symptoms (n = 179), and Hb concentration ≥80 g/L (n = 80). Incidence, number, and total volume of RBCs that were appropriately and inappropriately transfused is presented in Table 4.
Overall, 26.1% RBC transfusions were classified as appropriate and 73.9% as inappropriate. The incidence of appropriate and inappropriate RBC transfusions was 2.6 and 7.5 units per 1000 patient-days, respectively. Hospital departments with the highest percentage of appropriate RBC transfusions (>80%) were the neurology department (100%), ICU (83.7%) and stroke unit (83.3%). The percentage of appropriate RBC transfusions was <34% in all other hospital departments.
Comparison between patients who received appropriate and inappropriate RBC transfusions is presented in Table 5.
The patients who received appropriate and inappropriate RBC transfusions differed in Hb concentration pre–post RBC transfusion, whereas age, sex, CAD status, and lactate pre–post transfusion were not different.

4. Discussion

The overall percentage of RBC-transfused patients at our institution was 1.2%. This percentage was much lower than reported by Borkent-Raven et al. in 2011 (10.9%) [22] and 2010 (13%) [23]. This discrepancy might be due to different populations of patients and analyses performed in different time periods.
The aim of our study was to analyze the appropriateness of RBC transfusions in non-bleeding patients hospitalized at our institution. At our institution, 26.1% RBC transfusions were classified as appropriate. The highest percentage of appropriate RBC transfusions was in the neurology department, the ICU, and stroke unit (83.3–100%). This percentage was below 33% in all other hospital departments. In the study analyzing appropriateness of RBC transfusion in four emergency departments, 78.6% of RBC transfusions were considered appropriate. This high percentage of appropriate RBC transfusions was due to adopted criteria. Clinical scenarios in which RBC transfusion was considered appropriate were (based on the official consensus document from 2013): Hb < 70 g/L (acute anemia irrespective of sign/symptoms), Hb < 80 g/L (chronic anemia with symptoms of anemia or risk factors), Hb < 90 g/L (acute anemia with hemodynamic instability, CAD, heart failure, cerebrovascular disease, and myocardial infarction), and Hb ≥ 90 g/L (acute anemia with hemorrhage or symptoms of anemia) [24]. In our study, we did not consider Hb < 70 g/L without anemia symptoms or Hb < 90 g/L in patients with risk factors as appropriate indications for transfusion. To evaluate the appropriateness of RBC volume, the authors defined over-transfusion as post-transfusion Hb > 20 g/L above the appropriate transfusion trigger, and they showed an over-transfusion percentage of 45%. When this volume of over-transfusion was combined with inappropriate indication, 60% of RBC transfusion episodes and 41% of RBC units were found as unnecessarily transfused [24]. In the study by Shander et al., the panel of experts rated allogeneic RBC transfusions as inappropriate in 59.3% of nonbleeding clinical situations—all scenarios with Hb ≥ 100 g/L and 71.3% of scenarios with Hb 80–99 g/L. In 28.9% of clinical scenarios, RBC transfusion appropriateness was uncertain [25]. However, the authors did not take signs/symptoms of anemia into account when deciding on the appropriateness of RBC transfusion, unlike we did in our study.
The appropriateness of RBC transfusion in our study was based on the most recent AABB guidelines and some additional indications specified by the authors (Table 1). RBCs are transfused to improve the oxygen-carrying capacity of blood and delivery of oxygen to cells. Most clinical practice guidelines on RBC transfusion list specific Hb concentration thresholds as an indication for RBC transfusion. Clinical Practice Guidelines from AABB set the threshold at Hb ≤ 70 g/L in hospitalized hemodynamically stable patients and critically ill patients (strength of recommendation IB) [14]. The aforementioned guidelines set the Hb threshold at ≤80 g/L in patients undergoing orthopedic or cardiac surgery and in patients with coronary artery disease (strength of recommendation IB) although the Hb trigger ≤70 g/L and ≤80 g/L are most probably comparable in these patients [14]. Restrictive transfusion trigger (i.e., Hb 70–75 g/L) was shown to be safe compared to liberal transfusion trigger (i.e., 90–100 g/L) by randomized controlled trials in different populations of patients: the critically ill [26], cardiac surgery patients [27,28], orthopedic surgery patients with cardiac risk factors [29], septic patients [30], and those with malignant tumors [31]. All authors agreed with that RBC transfusion should be tailored to individual situations in accordance with the strategy of individualized therapy. The decision regarding RBC transfusion should be based on patient clinical condition and not only on Hb concentration [32,33]. Every patient has individualized adaptation mechanisms to anemia, so hemoglobin concentration cannot be the only marker of the need for RBC transfusion [34]. There are few exceptions in the context of the non-inferiority of restrictive RBC transfusion trigger. It is not known if, in myelodysplastic syndrome patients, restrictive liberal RBC transfusion trigger is more appropriate [35]. In patients with coronary artery disease (CAD), liberal RBC transfusion triggers should be taken into account [36]. Therefore, we classified RBC transfusions given to symptomatic patients with CAD with Hb < 80g/L as appropriate. Guidelines from AABB also suggest considering clinical context (clinical signs or symptoms of anemia) when deciding on RBC transfusion in non-bleeding patients [13,14]. Although transfusion guidelines are meant as a support tool, they should not replace the clinical judgement of clinicians making decisions on RBC transfusions. There may be situations when patients do not tolerate anemia with Hb concentrations above the restrictive trigger (e.g., myelodysplastic syndrome patients); on the other hand, young, otherwise healthy, chronically anemic patients may tolerate Hb < 6 g/dL well and not require RBC transfusion. The imperative here is to look for signs and symptoms of anemia. The supporting role in the decision regarding RBC transfusions may have physiological transfusion triggers. The most widely available is lactate concentration. Nevertheless, clinicians should be aware of multiple factors influencing lactate concentration in sepsis patients [37]. Moreover, RBC transfusion may not produce a clinically sound drop in lactate concentration, making reassessment following RBC transfusion problematic [38]. In our study, the most frequently reported symptoms of anemia were neurological symptoms. This result is not unusual, as high oxygen consumption makes the brain particularly sensitive to anemia. Some studies even suggest that anemia is strongly associated with overall cognitive impairment and may be a risk factor for dementia (1.39, 95% CI 1.23–1.56, p < 0.001), Alzheimer’s disease (1.59, 95% CI 1.18–2.13, p = 0.002), and mild cognitive impairment (1.36, 95% CI, 1.04–1.78; p = 0.02) [39,40]. On the other hand, Valladao et al. did not notice the association between worse cognitive function or mental disorders and anemia [41]. To reduce unnecessary transfusions, Edwards et al. suggested examining Hb concentration after single RBC transfusion [42]. In our study, multiple-unit RBC transfusions were also classified as inappropriate. Multiple-unit RBC transfusion was also the main cause of inappropriate transfusion in our study. Discharge Hb concentration may be representative and effective retrospective indicator of appropriateness of RBC transfusion [42]. Data on discharge Hb concentration were not retrieved in our study.
Although several guidelines have been proposed to reduce the RBC overuse, our study showed that the unjustified use of RBC persists. Some studies suggest that the decision regarding RBC transfusion may be based on beliefs and fixed behaviors [43,44]. Attempts at the reduction of inappropriate RBC transfusions is especially valid in the context of the low number of blood donors and the ever-increasing demand for blood [45]. Implementation of standardized RBC guidelines, medical staff education, and prospective transfusion-order screening may lead to the reduction of inappropriate RBCs transfusions [46]. Therefore, there is a definite need to educate physicians on appropriate indications for RBC transfusion. The educational interventions may have different results. The traditional approach to educate on appropriateness of RBC transfusions is through direct training campaigns; however, their effectiveness may be limited [47]. Introduction of clinical decision-support (CDS) electronic alerts is potentially more effective. Goodnough et al. showed that transfusions with pre-transfusion Hb > 80 g/L decreased from 60% to 30% following the introduction of CDS [48]. Tavares at al. showed that engagement of physicians may result in a 33% decrease in total number of RBC transfusions [49]. A significant reduction number of inappropriate RBC transfusion—from 25% to 15% of total RBC transfused in the medical-surgical ICU—was noticed after implementation of a transfusion bundle [50]. Introduction of patient blood management (PBM) may lead to more appropriate RBC transfusions in medical and surgical departments [51,52]. Ordering physicians may override the alerts on proper RBC transfusion indicators, and the main reason for this behavior is “protocolized behaviors on specialty services” [53]. Conflicting practices in various clinical specialties, potential costs, and differences in skills and knowledge of co-workers are indicated as the most important impediments to RBC transfusions based on evidence [54].
The last step in the efforts to minimize the incidence of inappropriate RBC transfusions may be the patient’s informed consent for the procedure. Such consent or lack of it should be the result of thorough discussion with the patient about benefits, risks, alternatives, and consequences of refusal of RBC transfusion. In our study, we did not look into the informed consent process specifically. Although at our institution, the consent form for RBC transfusion includes statement on alternative management, we do not know how many patients were offered alternative treatment options.
Our study is not without limitations. Due to the retrospective character of the study, we did not have access to some important clinical information that was not documented in the patients’ case notes. Although we thoroughly analyzed all daily entries of the patients on the day of RBC transfusion, there is a possibility that signs or symptoms of anemia were not properly documented by ordering physicians, and some RBC transfusion episodes could be wrongly evaluated as inappropriate. The presented indications for appropriate RBC transfusions may be judged by some authors as debatable. Some patients (e.g., myelodysplastic syndrome patients) may require RBC transfusion to increase Hb concentration above 80 g/L, which according to our approach was evaluated as inappropriate.

5. Conclusions

Although the incidence of RBC transfusions in non-bleeding inpatients in our study was generally low, the majority of RBC transfusions was performed outside recommended indications. RBC transfusions were rated as inappropriate mainly due to multiple-unit transfusion episodes, absence of anemia signs and/or symptoms before transfusion, and adoption of liberal transfusion triggers. There is still need to educate physicians on appropriate indications for RBC transfusion.

Author Contributions

Conceptualization, P.F.C.; methodology, P.F.C. and Ł.J.K.; investigation, D.W. and J.H.; writing—original draft preparation, P.F.C., D.W. and J.H.; writing—review and editing, Ł.J.K.; visualization, J.H. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding. The APC was funded by Medical University of Silesia in Katowice, Poland.

Institutional Review Board Statement

Ethical review and approval were waived for this study due to retrospective character of the study (Ethics Committee of Medical University of Silesia in Katowice decision number: PCN/CBN/0022/KB/292/21).

Informed Consent Statement

Patient consent was waived due to retrospective character of the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Vincent, J.L.; Jaschinski, U.; Wittebole, X.; Lefrant, J.Y.; Jakob, S.M.; Almekhlafi, G.A.; Pellis, T.; Tripathy, S.; Rubatto Birri, P.N.; Sakr, Y.; et al. Worldwide audit of blood transfusion practice in critically ill patients. Crit. Care 2018, 22, 102. [Google Scholar] [CrossRef] [PubMed]
  2. Tien, H.; Nascimento, B.; Callum, J.; Rizoli, S. An approach to transfusion and hemorrhage in trauma: Current perspectives on restrictive transfusion strategies. Can J. Surg. 2007, 50, 202–209. [Google Scholar] [PubMed]
  3. Athar, M.K.; Puri, N.; Gerber, D.R. Anemia and blood transfusions in critically ill patients. J. Blood Transfus. 2012, 2012, 629204. [Google Scholar] [CrossRef] [PubMed]
  4. Zacharowski, K.; Spahn, D.R. Patient blood management equals patient safety. Best Pract. Res. Clin. Anaesthesiol. 2016, 30, 159–169. [Google Scholar] [CrossRef] [PubMed]
  5. Karoopongse, E.; Srinonprasert, V.; Chalermsri, C.; Aekplakorn, W. Prevalence of anemia and association with mortality in community-dwelling elderly in Thailand. Sci. Rep. 2022, 12, 7084. [Google Scholar] [CrossRef] [PubMed]
  6. Koch, C.G.; Li, L.; Sun, Z.; Hixson, E.D.; Tang, A.; Phillips, S.C.; Blackstone, E.H.; Henderson, J.M. Hospital-acquired anemia: Prevalence, outcomes, and healthcare implications. J. Hosp. Med. 2013, 8, 506–512. [Google Scholar] [CrossRef]
  7. Czempik, P.F.; Wilczek, D.; Herzyk, J.; Krzych, Ł.J. Hospital-Acquired Anemia in Patients Hospitalized in the Intensive Care Unit: A Retrospective Cohort Study. J. Clin. Med. 2022, 11, 3939. [Google Scholar] [CrossRef]
  8. Ghiani, A.; Sainis, A.; Sainis, G.; Neurohr, C. Anemia and red blood cell transfusion practice in prolonged mechanically ventilated patients admitted to a specialized weaning center: An observational study. BMC Pulm. Med. 2019, 19, 250. [Google Scholar] [CrossRef] [PubMed]
  9. Likosky, D.S.; Paone, G.; Zhang, M.; Rogers, M.A.; Harrington, S.D.; Theurer, P.F.; DeLucia, A., 3rd; Fishstrom, A.; Camaj, A.; Prager, R.L.; et al. Red Blood Cell Transfusions Impact Pneumonia Rates After Coronary Artery Bypass Grafting. Ann. Thorac. Surg. 2015, 100, 794–800. [Google Scholar] [CrossRef] [PubMed]
  10. Blet, A.; McNeil, J.B.; Josse, J.; Cholley, B.; Cinotti, R.; Cotter, G.; Dauvergne, A.; Davison, B.; Duarte, K.; Duranteau, J.; et al. Association between in-ICU red blood cells transfusion and 1-year mortality in ICU survivors. Crit. Care 2022, 26, 307. [Google Scholar] [CrossRef]
  11. Burns, C.D.; Brown, J.P.; Corwin, H.L.; Gross, I.; Ozawa, S.J.; Shander, A. Special Report from the Society for the Advancement of Blood Management: The Choosing Wisely Campaign. Anesth Analg 2019, 129, 1381–1386. [Google Scholar] [CrossRef] [PubMed]
  12. Zhang, W.; Zheng, Y.; Yu, K.; Gu, J. Liberal transfusion versus restrictive transfusion and outcomes in critically ill adults: A meta-analysis. Transfus. Med. Hemother. 2021, 48, 60–68. [Google Scholar] [CrossRef]
  13. Carson, J.L.; Grossman, B.J.; Kleinman, S.; Tinmouth, A.T.; Marques, M.B.; Fung, M.K.; Holcomb, J.B.; Illoh, O.; Kaplan, L.J.; Katz, L.M.; et al. Red blood cell transfusion: A clinical practice guideline from the AABB. Ann. Intern. Med. 2012, 157, 49–58. [Google Scholar] [CrossRef] [PubMed]
  14. Carson, J.L.; Guyatt, G.; Heddle, N.M.; Grossman, B.J.; Cohn, C.S.; Fung, M.K.; Gernsheimer, T.; Holcomb, J.B.; Kaplan, L.J.; Katz, L.M.; et al. Clinical practice guidelines from the AABB: Red blood cell transfusion thresholds and storage. JAMA 2016, 316, 2025–2035. [Google Scholar] [CrossRef]
  15. Czempik, P.F.; Wojnarowicz, O.; Krzych, Ł.J. Let us use physiologic transfusion triggers: Favorable outcome in an 86-year-old Jehovah’s witness with a haemoglobin nadir of 44g L-1. Transfus. Apher. Sci. 2020, 59, 102718. [Google Scholar] [CrossRef] [PubMed]
  16. Vallet, B.; Robin, E.; Lebuffe, G. Venous oxygen saturation as a physiologic transfusion trigger. Crit. Care 2010, 14, 213. [Google Scholar] [CrossRef] [PubMed]
  17. Fogagnolo, A.; Taccone, F.S.; Vincent, J.L.; Benetto, G.; Cavalcante, E.; Marangoni, E.; Ragazzi, R.; Creteur, J.; Volta, C.A.; Spadaro, S. Using arterial-venous oxygen difference to guide red blood cell transfusion strategy. Crit. Care 2020, 24, 160. [Google Scholar] [CrossRef] [PubMed]
  18. Czempik, P.F.; Pluta, M.P.; Krzych, Ł.J. Physiologic approach to red blood cell transfusion in non-bleeding critically ill patients. Arch. Med. Sci. 2022, 18, 1423–1425. [Google Scholar] [CrossRef] [PubMed]
  19. Doan, D.H.; Bui, D.P. Mixed Venous Oxygen Saturation Predicts Short-term Outcome in High-risk Cardiac Surgical Patients. Heart Lung Circ. 2018, 27 (Suppl. 3), S510. [Google Scholar] [CrossRef]
  20. Takahashi, D.; Matsui, M.; Shigematsu, R.; Sato, T.; Miyaji, R.; Sakai, M.; Shirahata, A. Effect of transfusion on the venous blood lactate level in very low-birthweight infants. Pediatr. Int. 2009, 51, 321–325. [Google Scholar] [CrossRef] [PubMed]
  21. Yang, W.W.; Thakkar, R.N.; Gehrie, E.A.; Chen, W.; Frank, S.M. Single-unit transfusions and hemoglobin trigger: Relative impact on red cell utilization. Transfusion 2017, 57, 1163–1170. [Google Scholar] [CrossRef]
  22. Borkent-Raven, B.A.; Janssen, M.P.; van der Poel, C.L.; Schaasberg, W.P.; Bonsel, G.J.; van Hout, B.A. Survival after transfusion in the Netherlands. Vox Sang. 2011, 100, 196–203. [Google Scholar] [CrossRef]
  23. Borkent-Raven, B.A.; Janssen, M.P.; van der Poel, C.L.; Schaasberg, W.P.; Bonsel, G.J.; van Hout, B.A. The PROTON study: Profiles of blood product transfusion recipients in the Netherlands. Vox Sang. 2010, 99, 54–64. [Google Scholar] [CrossRef]
  24. Díaz, M.Q.; Borobia, A.M.; García Erce, J.A.; Maroun-Eid, C.; Fabra, S.; Carcas, A.; Frías, J.; Muñoz, M.; USEES-URG Research Group. Appropriate use of red blood cell transfusion in emergency departments: A study in five emergency departments. Blood Transfus. 2017, 15, 199–206. [Google Scholar] [CrossRef] [PubMed]
  25. Shander, A.; Fink, A.; Javidroozi, M.; Erhard, J.; Farmer, S.L.; Corwin, H.; Goodnough, L.T.; Hofmann, A.; Isbister, J.; Ozawa, S.; et al. Appropriateness of allogeneic red blood cell transfusion: The international consensus conference on transfusion outcomes. Transfus. Med. Rev. 2011, 25, 232–246.e53. [Google Scholar] [CrossRef] [PubMed]
  26. Hebert, P.C.; Wells, G.; Martin, C.; Tweeddale, M.; Marshall, J.; Blajchman, M.; Pagliarello, G.; Sandham, D.; Schweitzer, I.I.; Boisvert, D.; et al. Variation in red cell transfusion practice in the intensive care unit: A multicentre cohort study. Crit. Care 1999, 3, 57–63. [Google Scholar] [CrossRef]
  27. Hajjar, L.A.; Vincent, J.; Galas, F.R.; Nakamura, R.E.; Silva, C.M.; Santos, M.H.; Fukushima, J.; Kalil Filho, R.; Sierra, D.B.; Lopes, N.H.; et al. Transfusion Requirements After Cardiac Surgery: The TRACS Randomized Controlled Trial. JAMA 2010, 304, 1559–1567. [Google Scholar] [CrossRef] [PubMed]
  28. Mazer, C.D.; Whitlock, R.P.; Fergusson, D.A.; Hall, J.; Belley-Cote, E.; Connolly, K.; Khanykin, B.; Gregory, A.J.; de Médicis, É.; McGuinness, S.; et al. Restrictive or Liberal Red-Cell Transfusion for Cardiac Surgery. N. Engl. J. Med. 2017, 377, 2133–2144. [Google Scholar] [CrossRef] [PubMed]
  29. Carson, J.L.; Terrin, M.L.; Noveck, H.; Sanders, D.W.; Chaitman, B.R.; Rhoads, G.G.; Nemo, G.; Dragert, K.; Beaupre, L.; Hildebrand, K.; et al. Liberal or Restrictive Transfusion in High-Risk Patients after Hip Surgery. N. Engl. J. Med. 2011, 365, 2453–2462. [Google Scholar] [CrossRef] [PubMed]
  30. Holst, L.B.; Haase, N.; Wetterslev, J.; Wernerman, J.; Aneman, A.; Guttormsen, A.B.; Johansson, P.I.; Karlsson, S.; Klemenzson, G.; Winding, R.; et al. Transfusion requirements in septic shock (TRISS) trial—Comparing the effects and safety of liberal versus restrictive red blood cell transfusion in septic shock patients in the ICU: Protocol for a randomised controlled trial. Trials 2013, 14, 150. [Google Scholar] [CrossRef] [Green Version]
  31. Yang, X.X.; Dai, X.C.; Liu, C.X.; Lu, J.H.; Lin, S.Y. Restrictive versus liberal transfusion strategies in patients with malignant neoplasm—A meta-analysis of randomized controlled trials. Transfus. Apher. Sci. 2020, 59, 102825. [Google Scholar] [CrossRef]
  32. Sutton, D.H.; Raines, D.A. The Risks Associated with Red Blood Cell Transfusion: Implications for Critical Care Practice. Crit. Care Nurs. Clin. N. Am. 2017, 29, 305–314. [Google Scholar] [CrossRef] [PubMed]
  33. Frietsch, T.; Shander, A.; Faraoni, D.; Hardy, J.F. Patient Blood Management is not about blood transfusion: It is about patients’ outcomes. Blood Transfus. 2019, 17, 331–333. [Google Scholar] [CrossRef]
  34. Carson, J.L.; Stanworth, S.J.; Dennis, J.A.; Fergusson, D.A.; Triulzi, D.; Doree, C.; Hebert, P.C. Transfusion thresholds for guiding red blood cell transfusion. Cochrane Database Syst. Rev. 2021, 12, CD002042. [Google Scholar] [CrossRef]
  35. Wilde, L.; Pan, J. Restrictive Versus Liberal Transfusion Strategies in Myelodysplastic Syndrome and Beyond. Clin. Lymphoma Myeloma Leuk. 2019, 19, 758–762. [Google Scholar] [CrossRef]
  36. Wang, Y.; Shi, X.; Wen, M.; Chen, Y.; Zhang, Q. Restrictive versus liberal blood transfusion in patients with coronary artery disease: A meta-analysis. Curr. Med. Res. Opin. 2017, 33, 761–768. [Google Scholar] [CrossRef] [PubMed]
  37. Hernandez, G.; Bellomo, R.; Bakker, J. The ten pitfalls of lactate clearance in sepsis. Intensive Care Med. 2019, 45, 82–85. [Google Scholar] [CrossRef]
  38. Czempik, P.F.; Gierczak, D.; Wilczek, D.; Krzych, Ł.J. The Impact of Red Blood Cell Transfusion on Blood Lactate in Non-Bleeding Critically Ill Patients-A Retrospective Cohort Study. J. Clin. Med. 2022, 11, 1037. [Google Scholar] [CrossRef] [PubMed]
  39. Kim, H.B.; Park, B.; Shim, J.Y. Anemia in Association with Cognitive Impairment: A Systematic Review and Meta-Analysis. J. Alzheimers Dis. 2019, 72, 803–814. [Google Scholar] [CrossRef] [PubMed]
  40. Kung, W.M.; Yuan, S.P.; Lin, M.S.; Wu, C.C.; Islam, M.M.; Atique, S.; Touray, M.; Huang, C.Y.; Wang, Y.C. Anemia and the Risk of Cognitive Impairment: An Updated Systematic Review and Meta-Analysis. Brain Sci. 2021, 11, 777. [Google Scholar] [CrossRef] [PubMed]
  41. Valladao, J.B.R.; Suemoto, C.K.; Goulart, A.C.; Schmidt, M.I.; Passos, V.M.A.; Barreto, S.M.; Lotufo, P.A.; Bensenor, I.M.; Santos, I.S. Anemia and Cognitive Performance in the ELSA-Brasil Cohort Baseline. J. Neuropsychiatry Clin. Neurosci. 2020, 32, 227–234. [Google Scholar] [CrossRef] [PubMed]
  42. Edwards, J.; Morrison, C.; Mohiuddin, M.; Tchatalbachev, V.; Patel, C.; Schwickerath, V.L.; Menitove, J.E.; Singh, G. Patient blood transfusion management: Discharge hemoglobin level as a surrogate marker for red blood cell utilization appropriateness. Transfusion 2012, 52, 2445–2451. [Google Scholar] [CrossRef] [PubMed]
  43. Francis, J.J.; Stockton, C.; Eccles, M.P.; Johnston, M.; Cuthbertson, B.H.; Grimshaw, J.M.; Hyde, C.; Tinmouth, A.; Stanworth, S.J. Evidence-based selection of theories for designing behaviour change interventions: Using methods based on theoretical construct domains to understand clinicians’ blood transfusion behaviour. Br. J. Health Psychol. 2009, 14 (Pt 4), 625–646. [Google Scholar] [CrossRef] [PubMed]
  44. Islam, R.; Tinmouth, A.T.; Francis, J.J.; Brehaut, J.C.; Born, J.; Stockton, C.; Stanworth, S.J.; Eccles, M.P.; Cuthbertson, B.H.; Hyde, C.; et al. A cross-country comparison of intensive care physicians’ beliefs about their transfusion behaviour: A qualitative study using the Theoretical Domains Framework. Implement Sci. 2012, 7, 93. [Google Scholar] [CrossRef] [PubMed]
  45. Barr, P.J.; Donnelly, M.; Cardwell, C.R.; Parker, M.; Morris, K.; Bailie, K.E. The appropriateness of red blood cell use and the extent of overtransfusion: Right decision? Right amount? Transfusion 2011, 51, 1684–1694. [Google Scholar] [CrossRef]
  46. Kron, A.T.; Collins, A.; Cserti-Gazdewich, C.; Pendergrast, J.; Webert, K.; Lieberman, L.; Zeller, M.P.; Harding, S.R.; Nahirniak, S.; Prokopchuk-Gauk, O.; et al. A prospective multi-faceted interventional study of blood bank technologist screening of red blood cell transfusion orders: The START study. Transfusion 2021, 61, 410–422. [Google Scholar] [CrossRef] [PubMed]
  47. Leal-Noval, S.R.; Arellano-Orden, V.; Maestre-Romero, A.; Muñoz-Gómez, M.; Fernández-Cisneros, V.; Ferrándiz-Millón, C.; Corcia, Y. Impact of national transfusion indicators on appropriate blood usage in critically ill patients. Transfusion 2011, 51, 1957–1965. [Google Scholar] [CrossRef] [PubMed]
  48. Goodnough, L.T.; Shah, N. The next chapter in patient blood management: Real-time clinical decision support. Am J Clin Pathol 2014, 142, 741–747. [Google Scholar] [CrossRef] [PubMed]
  49. Tavares, M.M.; Diquattro, P.J.; Sweeney, J.D. Reduction in red blood cell transfusion associated with engagement of the ordering physician. Transfusion 2014, 54 (Pt 2), 2625–2630. [Google Scholar] [CrossRef]
  50. Borgert, M.; Binnekade, J.; Paulus, F.; Vroom, M.; Vlaar, A.; Goossens, A.; Dongelmans, D. Implementation of a transfusion bundle reduces inappropriate red blood cell transfusions in intensive care—A before and after study. Transfus. Med. 2016, 26, 432–439. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  51. Franchini, M.; Marano, G.; Veropalumbo, E.; Masiello, F.; Pati, I.; Candura, F.; Profili, S.; Catalano, L.; Piccinini, V.; Pupella, S.; et al. Patient Blood Management: A revolutionary approach to transfusion medicine. Blood Transfus. 2019, 17, 191–195. [Google Scholar] [CrossRef]
  52. Shin, H.J.; Kim, J.H.; Park, Y.; Ahn, K.H.; Jung, J.S.; Park, J.H.; Korea University Bloodless Medicine Center Scientific Committee. Effect of patient blood management system and feedback programme on appropriateness of transfusion: An experience of Asia’s first Bloodless Medicine Center on a hospital basis. Transfus. Med. 2021, 31, 55–62. [Google Scholar] [CrossRef] [PubMed]
  53. Chen, J.H.; Fang, D.Z.; Goodnough, L.T.; Evans, K.H.; Lee Porter, M.; Shieh, L. Why providers transfuse blood products outside recommended guidelines in spite of integrated electronic best practice alerts. J. Hosp. Med. 2015, 10, 1–7. [Google Scholar] [CrossRef] [PubMed]
  54. Soril, L.J.J.; Noseworthy, T.W.; Stelfox, H.T.; Zygun, D.A.; Clement, F.M. A retrospective observational analysis of red blood cell transfusion practices in stable, non-bleeding adult patients admitted to nine medical-surgical intensive care units. J. Intensive Care 2019, 7, 19. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Number of appropriate RBC transfusions (percentage of all RBC transfusions) in various clinical scenarios classified as appropriate indications for RBC transfusion (Table 1). RBC, red blood cell.
Figure 1. Number of appropriate RBC transfusions (percentage of all RBC transfusions) in various clinical scenarios classified as appropriate indications for RBC transfusion (Table 1). RBC, red blood cell.
Jcm 12 01293 g001
Table 1. Appropriate red blood cell transfusion clinical scenarios.
Table 1. Appropriate red blood cell transfusion clinical scenarios.
Clinical Scenarios
Hb 1 < 60 g/L;
Hb < 70 g/L plus tachycardia and/or hypotension despite normal blood volume;
Hb < 70 g/L plus dyspnea and/or tachypnea despite oxygen therapy (aimed at SpO2 2 100%);
Hb < 70 g/L plus problems with concentration/attention and/or headache and/or dizziness;
Hb < 70 g/L plus Scv2O 3/SvO2 4 < 55% and/or lactate > 1.8 mmol/L;
Hb < 80 g/L plus coronary artery disease plus any sign/symptom of anemia;
Hb < 80 g/L plus acute coronary syndrome;
Hb < 80 g/L plus acute cerebral ischemia.
1 Hemoglobin; 2 peripheral oxygen saturation; 3 central venous oxygen saturation; 4 mixed venous oxygen saturation.
Table 2. Incidence of red blood cell transfusions and percentage of transfused patients.
Table 2. Incidence of red blood cell transfusions and percentage of transfused patients.
Hospital DepartmentIncidence of RBC 1
Transfusions
(Unit/1000 Patient-Days)
RBC-Transfused Patients
(%)
Autoimmune and Metabolic Diseases41.88.8
Intensive Care Unit27.68.9
Clinical Pharmacology25.67.4
Gastroenterology and Hepatology18.72.9
Gastrointestinal Surgery17.13.8
Gynecology and Obstetrics14.51.9
Oncologic Surgery7.70.7
Radiotherapy5.20.8
Medical Oncology (2 units)4.60.3
Neurosurgery3.80.9
Stroke Unit3.61.6
Endocrinology1.60.2
Allergology and Immunology1.10.1
Neurology0.80.2
Neurologic Rehabilitation0.50.9
Ophthalmology0.2<0.1
All departments10.21.2
1 Red blood cell.
Table 3. Characteristics of patients transfused with red blood cell units.
Table 3. Characteristics of patients transfused with red blood cell units.
Patient CharacteristicValue
Age, median, IQR 1 (years)65 (47–75)
Sex, male/female (n; %)120 (42.0)/166 (58.0)
Coronary artery disease (n; %)42 (14.7)
Hb 2 concentration pre RBC 3 transfusion, median, IQR (g/L)75 (65–80)
Hb concentration post RBC transfusion, median, IQR (g/L)85 (77–95)
Patients with pre RBC transfusion Hb < 70 g/L, number, %173 (20.9)
Lactate concentration pre RBC transfusion, median, IQR (mmol/L)2.0 (1.5–2.6)
Lactate concentration post RBC transfusion, median, IQR (mmol/L)1.8 (1.4–2.4)
Patients with pre RBC transfusion lactate > 1.8 mmol/L, number,%27 (3.3)
1 Interquartile range; 2 hemoglobin; 3 red blood cell.
Table 4. Incidence, number, and volume of appropriate and inappropriate red blood cell transfusions per hospital department.
Table 4. Incidence, number, and volume of appropriate and inappropriate red blood cell transfusions per hospital department.
Hospital DepartmentAppropriate RBC TransfusionsInappropriate RBC Transfusions
Incidence
(n/1000 Patient-Days)
RBC *
(%/n)
Incidence
(n/1000 Patient-Days)
RBC
(%/n)
Neurology0.8100/30.00/0
Intensive Care Unit23.183.7/414.516.3/8
Stroke Unit2.983.3/100.616.7/2
Endocrinology0.533.3/21.166.7/4
Clinical Pharmacology8.131.6/3017.568.4/65
Gastrointestinal Surgery4.727.5/2812.472.5/74
Gastroenterology and Hepatology4.423.6/3914.376.4/126
Medical Oncology (2 units)1.122.9/83.677.1/27
Neurosurgery0.820.0/43.080.0/16
Autoimmune and Metabolic Diseases8.219.5/3433.780.5/140
Gynecology and Obstetrics1.711.5/1512.888.5/115
Oncologic Surgery0.911.1/26.888.9/16
Neurologic Rehabilitation0.00/00.5100/2
Ophthalmology0.00/00.2100/2
Allergology and Immunology0.00/01.1100/2
Radiotherapy0.00/05.2100/13
All departments2.626.1/2167.573.9/612
* Red blood cell.
Table 5. Characteristics of recipients of appropriate and inappropriate RBC transfusions.
Table 5. Characteristics of recipients of appropriate and inappropriate RBC transfusions.
CharacteristicAppropriate
RBC 1 Transfusion
Inappropriate
RBC Transfusion
p
Age, median, IQR 2 (years)66.5 (50–78)64.5 (45.5–74.0)0.50
Sex, male/female (n)31/3589/1310.35
Coronary artery disease (n; %)14 (20.6)28 (79.4)0.09
Hb 3 concentration pre RBC, median, IQR (g/L)64 (58–68)75 (70–80)<0.01
Hb concentration post RBC, median, IQR (g/L)80 (73–90)95 (87–10)<0.01
Lactate concentration pre RBC, median, IQR (mmol/L)2.0 (1.5–2.7)1.7 (1.2–2.2)0.28
Lactate concentration post RBC, median, IQR (mmol/L)1.9 (1.4–2.5)2.0 (1.3–2.3)0.73
1 Red blood cell; 2 interquartile range; 3 hemoglobin. In bold: statistically significant values.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Czempik, P.F.; Wilczek, D.; Herzyk, J.; Krzych, Ł.J. Appropriateness of Allogeneic Red Blood Cell Transfusions in Non-Bleeding Patients in a Large Teaching Hospital: A Retrospective Study. J. Clin. Med. 2023, 12, 1293. https://doi.org/10.3390/jcm12041293

AMA Style

Czempik PF, Wilczek D, Herzyk J, Krzych ŁJ. Appropriateness of Allogeneic Red Blood Cell Transfusions in Non-Bleeding Patients in a Large Teaching Hospital: A Retrospective Study. Journal of Clinical Medicine. 2023; 12(4):1293. https://doi.org/10.3390/jcm12041293

Chicago/Turabian Style

Czempik, Piotr F., Dawid Wilczek, Jan Herzyk, and Łukasz J. Krzych. 2023. "Appropriateness of Allogeneic Red Blood Cell Transfusions in Non-Bleeding Patients in a Large Teaching Hospital: A Retrospective Study" Journal of Clinical Medicine 12, no. 4: 1293. https://doi.org/10.3390/jcm12041293

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop