Next Article in Journal
The Role of the Liquid Biopsy in Decision-Making for Patients with Non-Small Cell Lung Cancer
Next Article in Special Issue
Area-under-the-Curve-Based Mycophenolate Mofetil Dosage May Contribute to Decrease the Incidence of Graft-versus-Host Disease after Allogeneic Hematopoietic Cell Transplantation in Pediatric Patients
Previous Article in Journal
The New ELN Recommendations for Treating CML
Previous Article in Special Issue
Haploidentical Stem Cell Transplantation in Lymphomas—Expectations and Pitfalls
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Risk Factors and Outcome of C. difficile Infection after Hematopoietic Stem Cell Transplantation

1
Clinica Ematologica ed Unità di Terapie Cellulari, Azienda Sanitaria Universitaria Friuli Centrale, Piazzale S. Maria della Misericordia 10, 33100 Udine, Italy
2
Istituto di Statistica, Dipartimento di Area Medica, Università di Udine, 33100 Udine, Italy
3
SOC Microbiologia, Azienda Sanitaria Friuli Centrale, 33100 Udine, Italy
4
Dipartimento di Area Medica, Università di Udine, 33100 Udine, Italy
5
SOC Malattie Infettive, Azienda Sanitaria Universitaria Friuli Centrale, 33100 Udine, Italy
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2020, 9(11), 3673; https://doi.org/10.3390/jcm9113673
Submission received: 17 October 2020 / Revised: 7 November 2020 / Accepted: 11 November 2020 / Published: 16 November 2020
(This article belongs to the Special Issue Clinical Outcomes of Stem Cell Transplants in Cancer Treatment)

Abstract

:
Patients who undergo hematopoietic stem cell transplants (HSCT) are at major risk of C. difficile (CD) infection (CDI), the most common cause of nosocomial diarrhea. We conducted a retrospective study, which enrolled 481 patients who underwent autologous (220) or allogeneic HSCT (261) in a 5-year period, with the aim of identifying the incidence, risk factors and outcome of CDI between the start of conditioning and 100 days after HSCT. The overall cumulative incidence of CDI based upon clinical evidence was 5.4% (95% CI, 3.7% to 7.8%), without any significant difference between the two types of procedures. The median time between HSCT and CDI diagnosis was 12 days. Out of 26 patients, 19 (73%) with clinical and symptomatic evidence of CDI were positive also for enzymatic or molecular detection of toxigenic CD; in particular, in 5 out of 26 patients (19%) CD binary toxin was also detected. CDI diagnoses significantly increased in the period 2018–2019, since the introduction in the microbiology lab unit of the two-step diagnostic test based on GDH immunoenzymatic detection and toxin B/binary toxin/027 ribotype detection by real-time PCR. Via multivariate analysis, abdominal surgery within 10 years before HSCT (p = 0.002), antibiotic therapy within two months before HSCT (p = 0.000), HCV infection (p = 0.023) and occurrence of bacterial or fungal infections up to 100 days after HSCT (p = 0.003) were significantly associated with a higher risk of CDI development. The 26 patients were treated with first-line vancomycin (24) or fidaxomicine (2) and only 2 patients needed a second-line treatment, due to the persistence of stool positivity. No significant relationship was identified between CDI and the development of acute graft versus host disease (GVHD) after allogeneic HSCT. At a median follow-up of 25 months (range 1–65), the cumulative incidence of transplant related mortality (TRM) was 16.6% (95% CI 11.7% to 22.4%) and the 3-year overall survival (OS) was 67.0% (95% CI 61.9% to 71.6%). The development of CDI had no significant impact on TRM and OS, which were significantly impaired in the multivariate analysis by gastrointestinal and urogenital comorbidities, severe GVHD, previous infections or hospitalization within two months before HSCT, active disease at transplant and occurrence of infections after HSCT. We conclude that 20% of all episodes of diarrhea occurring up to 100 days after HSCT were related to toxigenic CD infection. Patients with a history of previous abdominal surgery or HCV infection, or those who had received broad spectrum parenteral antibacterial therapy were at major risk for CDI development. CDIs were successfully treated with vancomycin or fidaxomicin after auto-HSCT as well as after allo-HSCT.

1. Introduction

Clostridium difficile is a Gram-positive, anaerobic, spore-forming, toxin-producing bacillus, that represents the most common cause of nosocomial diarrhea [1,2]. Clinical manifestations range from moderate diarrhea to life-threatening pseudomembranous colitis.
The bacterium is present in the environment and its spores are transmitted by the fecal–oral route. Common risk factors for CD infection (CDI) are antibiotic exposure, older age and hospitalization. Patients who undergo hematopoietic stem cell transplants (HSCT) are at a more major risk of CDI than other subjects, due to prolonged hospitalization, multiple infections with massive usage of antibiotic therapy [3], alteration of the intestinal mucosa caused by chemotherapy during conditioning regimens, and immunosuppressive treatment [4,5]. The role of CDI during HSCT remains unclear due to studies with heterogeneous patient cohorts and conflicting results [6,7,8,9,10,11,12,13,14,15,16] (Table 1). The risk for CDI among these patients is reported to be frequently higher than in the general population [9,16]. However, serious and life-threatening disease courses seem to be rare [8,11]. Another possibly severe complication in patients undergoing allogeneic HSCT is acute graft versus host disease (GVHD), which appears closely related to the infection through a bidirectional cause–effect link [6,17].
In order to identify the incidence, risk factors and outcome of CDI after HSCT we conducted a retrospective study, which enrolled 481 patients who underwent autologous or allogeneic HSCT in a 5-year period in a single Transplant Center.

2. Methods

2.1. Patients

This retrospective study included 481 patients who underwent HSCT at the Transplant Center of Udine between 1 January 2015 and 31 December 2019; 261 received allogeneic HSCT (allo-HSCT) and 220 underwent autologous HSCT (auto-HSCT). The patient and transplant features are summarized in Table 2. Upon the admission to the transplant center, all patients signed a consent form where they expressed their consent to the collection of their medical data for scientific studies. This consent form was approved by our Ethics Committee. Median age at the time of the procedure was 55 years (range 15–75). The most common underlying hematological diseases were acute leukemias (41%), followed by multiple myeloma (30%) and lymphomas (24%). The stem cell source was peripheral blood for 96% of patients. A reduced-intensity conditioning regimen (RIC) was chosen in 13% of patients [6]. A high-resolution HLA-typing for all major histocompatibility complex (MHC) Class I loci (HLA-A, HLA-B, HLA-C) and for the MHC Class II HLA-DRB1 locus was required. Stem cells came from an HLA-matched sibling donor, haploidentical donors, matched unrelated and mismatched unrelated donors in 19%, 18%, 40% and 23% of allo-HSCTs, respectively. For allo-HSCT patients, GVHD prophylaxis consisted of cyclosporine or tacrolimus plus 3 to 4 methotrexate courses for HLA-matched sibling transplants, with the addition of antithymocyte globulin for unrelated transplants; tacrolimus, mycophenolate mofetil and post-transplant cyclophosphamide was the GVHD prophylaxis for HSCT from haploidentical donors. The median length of hospitalization was 45 days (range 21–146) after allo-HSCT, and 34 days (range 18–51) after auto-HSCT. Among the patients undergoing allo-HSCT, acute GVHD was graded according to the 1991 Consensus Conference on Acute GVHD Grading criteria [18].
We examined the two months prior to the admission to the Transplant Unit and we recorded the occurrences of infections, hospitalizations and the need of broad-spectrum parenteral antibiotic therapy. Thirty-seven per cent of patients had developed one or more infections within two months before HSCT diagnosed by bacterial and mycotic isolates in blood, broncholavage liquid or other fluids and/or by radiological findings. Mycotic infections were included if they could be categorized as probable or proven mycoses according EORTC classification [19]. Fourteen per cent of patients had a history of previous infections caused by multidrug-resistant (MDR) bacteria, which included methicillin-resistant Staphylococcus aureus, carbapenemase-resistant Klebsiella pneumoniae, carbapenemase-resistant Enterobacteriacae, vancomycin-resistant Enterococcus faecium/faecalis and carbapenemase-resistant P. aeruginosa. Thirty-two per cent of patients needed hospitalization within two months before HSCT, because of treatment for the underlying hematological disease or clinical complications. Forty per cent of patients were treated with broad spectrum parenteral antibacterial therapy according to the clinical guidelines exposed in the following paragraph.
At transplant, two hundred and four patients (42%) had gastrointestinal and/or urogenital comorbidities, which included gallbladder stones, diverticulosis, haemorrhoids, colon adenomas or cancer, intraductal papillary mucinous neoplasms (IPMN) of pancreas, bladder prolapse, chronic gastritis, perianal abscesses or fistulae, gastrointestinal reflux, prostatic hypertrophy and prostatitis. The hematopoietic cell transplantation–comorbidity Iindex (HCT-CI) was equal or greater than 3 in 228 patients (47%). Previous abdominal surgery within 10 years before HSCT was reported in 172 patients (36%) and was represented by appendicectomy, bowel resections, gallbladder resections, surgery of any type of intestinal herniation, nephrectomy, annexectomy and hysterectomy, prostatic resections, laparoscopic or laparotomic explorations.

2.2. Monitoring and Management of Infections

Before admission to the Transplant Unit, and therefore starting conditioning, all patients performed throat, nasal and rectal swabs, and C. difficile detection in stool as a screening test, in order to detect colonization by MDR bacteria and by CD, respectively. The microbiological method for CD detection was changed during the 5-year study; between 2015 and 2017, GDH and direct detection of CD toxin A and B in stools by enzyme linked immune assay (Premier toxins A&B, Meridian Bioscience, Cincinnati, OH, USA) was applied as diagnostic tests, but from January 2018, a two-step algorithm was applied, based on GDH detection by enzyme linked chemiluminescent assay (CLIA) (LIAISON C. difficile GDH, Diasorin, I) as a reflex test, and a real-time polymerase chain reaction (PCR) for the detection of toxin B, binary toxin and 027 ribotype test (Xpert C. difficile, Cepheid, Sunnyvale, USA) as a confirmatory test for the identification of toxigenic CD.
All patients had individual rooms with high efficiency particulate air (HEPA) filtration and positive pressure flow. The conditioning regimen was administered through a central venous catheter. The patients received proton pump inhibitors. During the aplasia phase anti-infective prophylaxis consisted of Levofloxacine and Valaciclovir/Acyclovir for all patients, with the addiction of an azole or liposomial Amfotericine B after allo-HSCTs. After engraftment, the prevention of Pneumocystis jirovecii infection was based on trimetoprim-sulfamethoxazole or pentamidine aerosol in case of allergy to the sulphonamides. Neutropenic fever was treated with piperacillin-tazobactam plus vancomicin followed by meropenem as second-line antibiotic therapy, while waiting for results of blood and urine cultures. Drug dosage was driven by therapeutic drug monitoring in the blood and according to renal and hepatic functions and drug interactions.

2.3. Monitoring and Management of CDI

All patients with three or more episodes of unformed stools with or without abdominal pain, nausea and vomiting or fever between start of conditioning and +100 days after transplant were tested for the presence of C. difficile in stools and underwent three sets of blood cultures by peripheral veins and central catheters in case of fever. Stool samples were also evaluated for other bacterial, fungal and viral pathogens. A case of CDI was defined as a patient showing the above mentioned signs and symptoms of the infection supported by a C. difficile positivity test in stool [20,21]. The frequency and severity of diarrhea were retrospectively evaluated with physician and nurse notes. The severity of the gastrointestinal symptoms was graded according to National Cancer Institute Common Terminology Criteria for Adverse Event (CTCAE 3.0) [22].

2.4. CDI Treatment

CDI was treated in accordance with international guidelines [20,21]. In addition to the patient being isolation in a single room with HEPA filtration, all the hospital staff and visitors had to use additional contact precautions (gloves and coat). Oral vancomycin was used as first-line treatment. A course of fidaxomicin was reserved to patients who had received highly immunosuppressant GVHD prophylaxis for mismatched unrelated or haploidentical donors. Negativization of CD was evaluated on a stool sample collected after clinical improvement and at least seven days of therapy. In the case of persistence of stool positivity, a course of fidaxomicin was administered.

2.5. Statistical Analyses

Data were collected in an XLS Database (Microsoft office 2016; Microsoft Corporation, Redmond, WA, USA) and subsequently imported into STATA16 for Windows 10. The close-out for data collection was 31 December 2019. Transplant-related mortality (TRM) was defined as death due to all causes not related to the underlying hematological disease, while overall survival (OS) was defined as the time in months from transplantation to either death or last follow-up of the patients. OS was described using the Kaplan–Meier method, and a log-rank test was used to compare different groups. The cumulative incidence method was used to estimate TRM and CDI incidence accounting for the presence of competing risks. The competing event for TRM was relapse of disease, while the competing event for CDI was death from any cause. We analyzed patient-related and transplant-related variables and their possible relationships with incidence of CDI, TRM and OS. The patient variables are: age (as continuous variable), underlying hematological disease, gastrointestinal and urogenital comorbidities, history of infections, history of infections from MDR bacteria, HCT-CI, history of previous abdominal surgery, HBV and HCV infections, hospitalization up to two months before transplant, IgG value less than 700 mg/dL, administration of antibiotic therapy up to two months before transplants, CD infection or colonization before HSCT, and disease status at HSCT. The transplant-related variables are type of HSCT, type of conditioning (total body irradiation-containing regimens or Busulfan-containing regimens or RIC regimens or other miscellaneous conditioning mainly applied for auto-HSCT), number of antibiotic lines used during hospitalization, mucositis development and grading, use of total parenteral nutrition (TPN), incidence of acute GVHD and grading, CMV-DNAemia occurrence, and other main infections after HSCT. A univariate and a multivariate backward stepwise competing risk regression were used to identify which variables were associated with incidence of CDI, TRM and OS. This model is based on the hazard of the sub-distribution and provides a simple relationship between covariates and cumulative incidence. Multivariate analyses considered all variables significant at p ≤ 0.10 in the univariate analysis.

3. Results

3.1. Clinical Characteristics of CD Infections

Upon admission at the Transplant Unit, screening for CD and MDR bacteria was negative in all patients. Twenty-five patients had a history of previous CDI within 12 months before HSCT. Of 481 patients who underwent HSCT, 127 (26%) presented diarrhea during the hospitalization, and in 26 of the symptomatic patients (20%) CDI was diagnosed (Table 3). None of them were recurrences of a previous CDI. The overall cumulative incidence of CDI was 5.4% (95% CI, 3.7% to 7.8%) (Figure 1). CDI diagnoses increased over time; in fact, 4 out of 265 patients (1.5%) developed CDI between 2015 and 2017, in comparison with 22 out of 216 patients (10.2%) in the period 2018–2019 (p = 0.000) (Figure 2).
In total, 11 patients had received auto-HSCT and 15 had undergone allo-HSCT. The cumulative incidence of CDI was 5.4% (95% CI 3.67% to 7.77%) after allo-HSCT, and 4.2 (95% CI 2.6% to 6.3%) after auto-HSCT, with no significant difference between the two types of procedures. Out of 26 patients, 19 (73%) were also positive for toxigenic C. difficile. In particular, 5 out of 26 patients (19%) appeared to be infected by toxin B and binary toxin positive CD strains, as detected by real-time PCR. All patients presented diarrhea with abdominal pain, and eight of them (30%) showed concomitant fever; no cases of ileus were observed. The median time between HSCT and CDI diagnosis was 12 days after HSCT (range −5 to +100). Fourteen CDIs (57%) occurred during severe neutropenia (neutrophil count < 1 × 109/L). Gallbladder stones were the most common gastrointestinal or urogenital comorbidity among patients with CDI (23%), followed by benign prostatic hypertrophy (19%), chronic gastritis and gastro-esophageal reflux (15%), history of perianal infections (11%), benign and malignant cancer of female reproductive system (11%), adenomas or cancer of colon (7%), inguinal hernia (7%), bladder prolapse (3%) and kidney cancer (3%). The most frequent previous abdominal surgery was cholecystectomy (15%), followed by appendectomy (11%), annexectomy and hysterectomy (11%), perianal surgery (11%), inguinal reduction (7%), bowel surgery (7%), nephrectomy (3%), emergency laparotomy (3%) and transurethral resection of the prostate (3%).

3.2. Risk Factors for CDI Development

Table 4 reports the univariate analysis of the factors associated with CDI incidence. Among patient-related factors, age > 60 years (p = 0.03), gastrointestinal and urogenital comorbidities (p = 0.01), infections diagnosed within two months before HSCT (p = 0.03), previous abdominal surgery (p = 0.007), HCV infection (p = 0.003), hospitalization before HSCT (p = 0.02) and antibiotic therapy before HSCT (p = 0.000) are closely associated with CDI development after HSCT. About transplant-related factors, TPN use (p = 0.09), CMV reactivation (p = 0.05) and incidence of other infections after HSCT (p = 0.08) were significantly linked to CDI occurrence. However, transplant type (allogeneic or autologous), conditioning regimen or donor did not have any significant impact on CDI incidence. Moreover, no significant relationship was identified between CDI and development of acute GVHD. In fact, neither acute gastro-intestinal GVHD, nor grade III–IV acute GVHD were identified among allo-HSCT cases infected by CD. In the multivariate analysis (Table 5), previous abdominal surgery (p = 0.002), antibiotic therapy before SCT (p = 0.000), HCV infection (p = 0.023) and occurrence of other bacterial or fungal infections after HSCT (p = 0.003) were significantly associated with a higher risk of CDI development.

3.3. Outcome

The first-line treatment for CDI was vancomycin for 24 patients and fidaxomicin for 2 patients. Only two patients (8%), who had previously received vancomycin, needed a second-line treatment with fidaxomicin. Median time of stool negativization was 17 days (5–56). No CD recurrence was observed.
At a median follow-up of 25 months (range 1–65) after HSCT, 334 out of 481 patients (69%) were alive, while 147 patients (31%) died; 57 from transplant-related complications and 90 due to relapse of the underlying hematological disease. Cumulative incidence of TRM was 16.6% (95% CI 11.7% to 22.4%) (Figure 3b). The one-year TRM was 10.2% (95% CI 7.7% to 13.1%) after allo-HSCT and 6.5% (95% CI 4.5% to 8.9%) after auto-HSCT. The most common causes of death were infections (75%), followed by GVHD (16%), hemorrhages (4%), organ toxicities (3%) and unknown causes (2%). In the allo-HSCT group, 118 of 261 patients (45%) developed acute GVHD, which was grade I–II in 106 patients (40%) and grade III–IV in 12 patients (5%). Of these 12 patients, 7 died because of GVHD. In the univariate analysis the factors that significantly increased TRM were history of leukemia in comparison with myeloma or lymphoma (p = 0.007), allo-HSCT in comparison with auto-HSCT (p = 0.000), gastrointestinal and urogenital comorbidities (p = 0.004), history of infections before HSCT (p = 0.012), history of MDR infections before HSCT (p = 0.013), previous hospitalization (p = 0.007), active disease at transplant (p = 0.019), mismatched unrelated donor (p = 0.008), more than two antibiotic therapy lines after HSCT (p = 0.030), use of TPN (p = 0.030), grade IV acute GVHD (p = 0.000), and other infection after HSCT (p = 0.000). However, the development of CDI had no significant impact on TRM (p = 0.181). In the multivariate analysis, gastrointestinal and urogenital comorbidities (p = 0.008) and severe GVHD (p = 0.001) were significantly associated with TRM increase.
The 3- and 5-year OS were 67.0% (95% CI 61.9% to 71.6%) and 58.5% (95% CI 50.9% to 65.4%), respectively. As expected, patients who underwent auto-HSCT showed a significantly longer OS [3-year OS of 85.3% (95% CI 78.9% to 89.8%)] in comparison to those who received allo-HSCT (3-year OS 51.4% (95% CI 44.1% to 58.2%)) (p = 0.000) (Figure 3a).
In the univariate analysis, the significant factors for OS impairment were history of previous infections (p = 0.000), history of MDR infections (p = 0.001), abdominal surgery (p = 0.011), previous hospitalization (p = 0.000), antibiotic therapy before HSCT (p = 0.000), active disease at transplant (p = 0.000), HCT-CI ≥ 3 (p = 0.000), antibiotic therapy post-HSCT (p = 0.033), and other infections post-HSCT (p = 0.000). Female sex (p = 0.009), auto-HSCT procedure (p = 0.000) and diagnosis of myeloma (p = 0.000) were all variables significantly associated with longer OS. The development of CDI was not associated with a significant impairment of OS (p = 0.23). The multivariate analysis for OS showed that previous infections (p = 0.024), previous hospitalization (p = 0.003), active disease at transplant (p = 0.000) and infections post-HSCT (p = 0.043) are significant risk factors impairing OS. Multivariate analysis for TRM and OS is summarized in Table 6.

4. Discussion

CDI is a well-known major cause of diarrhea in transplanted patients [23]. In our study, 20% of all patients who complained of diarrhea during hospitalization showed C. difficile positivity in stool samples with an overall cumulative incidence of 5.4%, which is lower than the range between 9% and 24% previously reported (Table 1).
Moreover, we observed no significant difference in the CDI incidence between patients who had received auto-HSCT or allo-HSCT, confirming what was reported by Bruminhent et al. [10], while in other studies CDI was more frequent after allo-HSCT [6,9]. Most of our cases of CDI were diagnosed in the 2018–2019 period, since the diagnostic two-step algorithm, including screening by GDH followed by confirmatory testing for toxins with real-time PCR, was applied. Therefore, the lower CDI incidence observed in our case-series in comparison with previous studies could be related to the employment of a less sensitive method in the first three years of the study, together with a less stringent selection of samples for testing. Moreover, our study confirmed that a two-stage algorithm is a reliable method for CDI diagnosis in symptomatic patients [20,21]. As expected, in our study CDI occurred in the early post-transplant period at a median time of 12 days after HSCT, similarly to the median range between 8 and 38 days previously reported in the literature [6,9]. These data underline the fact that the bacterium is probably presents in the fecal microbiota of patients at admission to the Transplant Unit, and its growth can be promoted by bowel dysbiosis caused by previous prolonged hospitalizations, treatments with chemotherapy or antibiotics, bowel infections and unbalanced diet. Jain et al. [12] identified previous toxigenic CD colonization as a risk factor for CDI development after transplants; as in our experience we did not identify any CD carriers at the time of admission, this risk factor cannot be compared between our data and previous studies. In our study the main risk factors for CDI development were antibiotic therapy before HSCT, previous abdominal surgery, HCV infection, and other bacterial and fungal infections identified before or concomitantly with CDI during hospitalization for HSCT. Therefore, the use of antibiotics before and during HSCT hospitalization remains the leading risk factor in our analysis as well as in previous studies [6,7,15]. Broad spectrum antibiotics, such as cephalosporines, penicillines and fluoroquinolones, are associated with gut dysbiosis, development of bacterial resistance, malabsorption and alteration of the gut–liver axis [3]. In fact, antibiotic administration might cause the overall reduction of gut microbiota, particularly the obligate anaerobic species; it is interesting to report that Clostridium scindens could be capable of inhibiting CD growth [3,24] by decreasing the metabolism of primary bile acids to secondary bile acids. In our study, previous abdominal surgery was a significant risk factor for CD development. Even if this clinical association was observed by other authors [25], the pathogenesis is still unclear. In our study, the most common gastrointestinal surgery was cholecystectomy after history of gallbladder stones, suggesting that the increase in primary bile acids production and the alteration in metabolism might facilitate the germination of CD spores in the bowel [26]. Moreover, any type of abdominal surgery could modify the gut microbiota [27,28], changing anatomy and creating a new microbiological microenvironment. It has to be highlighted that in our study all the significant risk factors for CDI were patient-related and were strictly linked to medical history, comorbidities, complications of chemotherapy and infections, while all the transplant-related variables, such as conditioning and choice of donors for allo-HSCT recipients, had no significant impact on the risk of CDI development. Another controversial point is the link between GVHD and CDI. In our analysis, the frequency of CDI was similar in patients with or without acute GVHD, as reported by other authors [15,19]. However, other studies [6,9,16] observed that CD was a significant risk factor for acute GVHD development, in particular for the cases involving the gastro-intestinal system, suggesting that gut dysbiosis and disruption of mucosal barriers might promote CDI as well as GVHD. Moreover, GVHD itself was reported as a risk factor for CDI, since some patients with severe acute GVHD showed concomitant CDI, with could complicate the clinical course further.
In our study all CDIs successfully responded to first- or second-line treatments, and there were no recurrences. As most studies show, CDI has no significant impact on TRM and OS. However, it is interesting to note that events occurring within two months before HSCT, such as hospitalization, infections and need of broad spectrum parenteral antibacterial therapy, increased the risk for CDI development, as well as impaired the overall outcome after HSCT, suggesting that C. difficile growth was a hallmark of microbiota alteration capable of influencing the success of HSCT.
The main limitation of our study was the use of two different methods of C. difficile detection during the 5-year period of our analysis. However, data collection over this long time allowed us to clearly assess the major sensitivity of the two-step algorithm based on GDH followed by PCR for toxin detection.
Our study might prompt future clinical research aimed at minimizing microbial alterations through the use of narrow spectrum antibiotics, reduction of the duration of antibiotic administration and restoring of microbiota diversity with the addition of fiber prebiotics [29] or probiotics [30] to the diet of patients at major risk of CD development.

Author Contributions

C.R. and G.P. collected the data, analyzed the data and wrote the paper, F.P. and R.F. designed the research and edited the paper, A.A. performed the diagnostic tests, M.I. analyzed data, V.R., G.F., M.G., R.S., M.B., A.S., M.C., A.G., P.D. and C.T. participated in data interpretation and writing of the article. All authors have read and agreed to the published version of the manuscript.

Funding

PRIN 2017 n.20178S4EK9—“Innovative Statistical methods in biomedical research on biomarkers: from their identification to their use in clinical practice”.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Simor, A.E. Diagnosis, management, and prevention of clostridium difficile infection in long-term care facilities: A review. J. Am. Geriatr. Soc. 2010. [Google Scholar] [CrossRef] [PubMed]
  2. Czepiel, J.; Dróżdż, M.; Pituch, H.; Kuijper, E.J.; Perucki, W.; Mielimonka, A.; Goldman, S.; Wultańska, D.; Garlicki, A.; Biesiada, G. Clostridium difficile infection: Review. Eur. J. Clin. Microbiol. Infect. Dis. 2019. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Rizzatti, G.; Ianiro, G.; Gasbarrini, A. Antibiotic and Modulation of Microbiota A New Paradigm? J. Clin. Gastroenterol. 2018. [Google Scholar] [CrossRef]
  4. Anand, A.; Glatt, A.E. Clostridium difficile infection associated with antineoplastic chemotherapy: A review. Clin. Infect. Dis. 1993, 17, 109–113. [Google Scholar] [CrossRef] [PubMed]
  5. Willems, L.; Porcher, R.; Lafaurie, M.; Casin, I.; Robin, M.; Xhaard, A.; Andreoli, A.L.; Rodriguez-Otero, P.; Dhedin, N.; Socié, G.; et al. Clostridium difficile infection after allogeneic hematopoietic stem cell transplantation: Incidence, risk factors, and outcome. Biol. Blood Marrow Transplant. 2012. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Alonso, C.D.; Treadway, S.B.; Hanna, D.B.; Huff, C.A.; Neofytos, D.; Carroll, K.C.; Marr, K.A. Epidemiology and outcomes of clostridium difficile infections in hematopoietic stem cell transplant recipients. Clin. Infect. Dis. 2012, 54, 1053–1063. [Google Scholar] [CrossRef] [PubMed]
  7. Alonso, C.D.; Braun, D.A.; Patel, I.; Akbari, M.; Oh, D.J.; Jun, T.; McMasters, M.; Hammond, S.P.; Glotzbecker, B.; Cutler, C.; et al. A multicenter, retrospective, case-cohort study of the epidemiology and risk factors for Clostridium difficile infection among cord blood transplant recipients. Int. J. Lab. Hematol. 2017, 19. [Google Scholar] [CrossRef]
  8. Trifilio, S.M.; Pi, J.; Mehta, J. Changing epidemiology of clostridium difficile-associated disease during stem cell transplantation. Biol. Blood Marrow Transplant. 2013, 19, 405–409. [Google Scholar] [CrossRef] [Green Version]
  9. Bruminhent, J.; Wang, Z.X.; Hu, C.; Wagner, J.; Sunday, R.; Bobik, B.; Hegarty, S.; Keith, S.; Alpdogan, S.; Carabasi, M.; et al. Clostridium difficile colonization and disease in patients undergoing hematopoietic stem cell transplantation. Biol. Blood Marrow Transplant. 2014, 20, 1329–1334. [Google Scholar] [CrossRef] [Green Version]
  10. Hosokawa, K.; Takami, A.; Tsuji, M.; Araoka, H.; Ishiwata, K.; Takagi, S.; Yamamoto, H.; Asano-Mori, Y.; Matsuno, N.; Uchida, N.; et al. Relative incidences and outcomes of Clostridium difficile infection following transplantation of unrelated cord blood, unrelated bone marrow, and related peripheral blood in adult patients: A single institute study. Transpl. Infect. Dis. 2014, 16, 412–420. [Google Scholar] [CrossRef]
  11. Kamboj, M.; Xiao, K.; Kaltsas, A.; Huang, Y.-T.; Sun, J.; Chung, D.; Wu, S.; Sheahan, A.; Sepkowitz, K.; Jakubowski, A.A.; et al. Clostridium difficile infection after allogeneic hematopoietic stem cell transplant: Strain diversity and outcomes associated with NAP-1/027. Biol. Blood Marrow Transplant. 2014, 20, 1626–1633. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Jain, T.; Croswell, C.; Urday-Cornejo, V.; Awali, R.; Cutright, J.; Salimnia, H.; Reddy Banavasi, H.V.; Liubakka, A.; Lephart, P.; Chopra, T.; et al. Clostridium difficile colonization in hematopoietic stem cell transplant recipients: A prospective study of the epidemiology and outcomes involving toxigenic and nontoxigenic strains. Biol. Blood Marrow Transplant. 2016, 22, 157–163. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Aldrete, S.d.M.; Kraft, C.S.; Magee, M.J.; Chan, A.; Hutcherson, D.; Langston, A.A.; Greenwell, B.I.; Burd, E.M.; Friedman-Moraco, R. Risk factors and epidemiology of Clostridium difficile infection in hematopoietic stem cell transplant recipients during the peritransplant period. Transpl. Infect. Dis. 2017, 19, e12649. [Google Scholar] [CrossRef] [PubMed]
  14. Scardina, T.L.; Martinez, E.K.; Balasubramanian, N.; Fox-Geiman, M.; Smith, S.E.; Parada, J.P. Evaluation of risk factors for Clostridium difficile Infection in Hematopoietic Stem Cell Transplant Recipients. Int. J. Lab. Hematol. 2017, 37, 420–428. [Google Scholar]
  15. Ford, C.D.; Lopansri, B.K.; Coombs, J.; Webb, B.J.; Nguyen, A.; Asch, J.; Hoda, D. Clostridioides difficile colonization and infection in patients admitted for a first autologous transplantation: Incidence, risk factors, and patient outcomes. Clin. Transplant. 2019, 33, e13712. [Google Scholar] [CrossRef]
  16. Amberge, S.; Kramer, M.; Schröttner, P.; Heidrich, K.; Schmelz, R.; Middeke, J.M.; Gunzer, F.; Hampe, J.; Schetelig, J.; Bornhäuser, M.; et al. Clostridium Difficile infections in patients with AML or MDS undergoing allogeneic hematopoietic stem cell transplantation identify high risk for adverse outcome. Bone Marrow Transplant. 2020, 55, 367–375. [Google Scholar] [CrossRef] [PubMed]
  17. Guddati, A.K.; Kumar, G.; Ahmed, S.; Ali, M.; Kumar, N.; Hari, P.; Venu, N. Incidence and outcomes of Clostridium difficile-associated disease in hematopoietic cell transplant recipients. Int. J. Hematol. 2014. [Google Scholar] [CrossRef] [PubMed]
  18. Przepiorka, D.; Weisdorf, D.; Martin, P.; Klingemann, H.G.; Beatty, P.; Hows, J.; Thomas, E.D. Consensus conference on acute GVHD grading. Bone Marrow Transplant. 1995, 15, 825–828. [Google Scholar] [PubMed]
  19. De Pauw, B.; Walsh, T.J.; Donnelly, J.P.; Stevens, D.A.; Edwards, J.E.; Calandra, T.; Pappas, P.G.; Maertens, J.; Lortholary, O.; Kauffman, C.A.; et al. Revised definitions of invasive fungal disease from the European Organization for Research and Treatment of Cancer/Invasive Fungal Infections Cooperative Group and the National Institute of Allergy and Infectious Diseases Mycoses Study Group (EORTC/MSG) C. Clin. Infect. Dis. 2008. [Google Scholar] [CrossRef]
  20. Debast, S.B.; Bauer, M.P.; Kuijper, E.J.; Allerberger, F.; Bouza, E.; Coia, J.E.; Cornely, O.A.; Fitzpatrick, F.; Guery, B.; Wilcox, M.; et al. European society of clinical microbiology and infectious diseases: Update of the treatment guidance document for Clostridium difficile infection. Clin. Microbiol. Infect. 2014. [Google Scholar] [CrossRef] [Green Version]
  21. McDonald, L.C.; Gerding, D.N.; Johnson, S.; Bakken, J.S.; Carroll, K.C.; Coffin, S.E.; Dubberke, E.R.; Garey, K.W.; Gould, C.V.; Kelly, C.; et al. Clinical Practice Guidelines for Clostridium difficile Infection in Adults and Children: 2017 Update by the Infectious Diseases Society of America (IDSA) and Society for Healthcare Epidemiology of America (SHEA). Clin. Infect. Dis. 2018. [Google Scholar] [CrossRef] [PubMed]
  22. National Institute of Cancer. Common Terminology Criteria for Adverse Events (CTCAE); NIH Publication; 2009; ISBN # 09-7473. Available online: https://evs.nci.nih.gov/ftp1/CTCAE/CTCAE_4.03/Archive/CTCAE_4.0_2009-05-29_QuickReference_8.5x11.pdf (accessed on 16 November 2020).
  23. Robak, K.; Zambonelli, J.; Bilinski, J.; Basak, G.W. Diarrhea after allogeneic stem cell transplantation: Beyond graft-versus-host disease. Eur. J. Gastroenterol. Hepatol. 2017. [Google Scholar] [CrossRef] [PubMed]
  24. Dubberke, E.R.; Reske, K.A.; Olsen, M.A.; Bommarito, K.; Cleveland, A.A.; Silveira, F.P.; Schuster, M.G.; Kauffman, C.A.; Avery, R.K.; Pappas, P.G.; et al. Epidemiology and outcomes of Clostridium difficile infection in allogeneic hematopoietic cell and lung transplant recipients. Transpl. Infect. Dis. 2018, 20, e12855. [Google Scholar] [CrossRef] [PubMed]
  25. Mu, C.; Zhu, W. Antibiotic effects on gut microbiota, metabolism, and beyond. Appl. Microbiol. Biotechnol. 2019. [Google Scholar] [CrossRef]
  26. Staley, C.; Weingarden, A.R.; Khoruts, A.; Sadowsky, M.J. Interaction of gut microbiota with bile acid metabolism and its influence on disease states. Appl. Microbiol. Biotechnol. 2017. [Google Scholar] [CrossRef] [Green Version]
  27. Ohigashi, S.; Sudo, K.; Kobayashi, D.; Takahashi, T.; Nomoto, K.; Onodera, H. Significant changes in the intestinal environment after surgery in patients with colorectal cancer. J. Gastrointest. Surg. 2013. [Google Scholar] [CrossRef]
  28. Tong, J.; Zhang, X.; Fan, Y.; Chen, L.; Ma, X.; Yu, H.; Li, J.; Guan, X.; Zhao, P.; Yang, J. Changes of intestinal microbiota in ovarian cancer patients treated with surgery and chemotherapy. Cancer Manag. Res. 2020. [Google Scholar] [CrossRef]
  29. Childs, C.E.; Röytiö, H.; Alhoniemi, E.; Fekete, A.A.; Forssten, S.D.; Hudjec, N.; Lim, Y.N.; Steger, C.J.; Yaqoob, P.; Tuohy, K.M.; et al. Xylo-oligosaccharides alone or in synbiotic combination with Bifidobacterium animalis subsp. lactis induce bifidogenesis and modulate markers of immune function in healthy adults: A double-blind, placebo-controlled, randomised, factorial cross-over study. Br. J. Nutr. 2014. [Google Scholar] [CrossRef] [Green Version]
  30. Gerbitz, A.; Schultz, M.; Wilke, A.; Linde, H.J.; Schölmerich, J.; Andreesen, R.; Holler, E. Probiotic effects on experimental graft-versus-host disease: Let them eat yogurt. Blood 2004. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Cumulative incidence of CDI after HSCT. CDI = clostridium difficile infection; HSCT = hematopoietic stem cell transplantation.
Figure 1. Cumulative incidence of CDI after HSCT. CDI = clostridium difficile infection; HSCT = hematopoietic stem cell transplantation.
Jcm 09 03673 g001
Figure 2. CDI cases for years. CDI = clostridium difficile infection; SCT = stem cell transplantation.
Figure 2. CDI cases for years. CDI = clostridium difficile infection; SCT = stem cell transplantation.
Jcm 09 03673 g002
Figure 3. (a) Overall survival according to procedure; (b) Transplant-related mortality in all study population.
Figure 3. (a) Overall survival according to procedure; (b) Transplant-related mortality in all study population.
Jcm 09 03673 g003aJcm 09 03673 g003b
Table 1. Clinical results reported in previously published studies.
Table 1. Clinical results reported in previously published studies.
AuthorYear of PublicationStudy PeriodTransplant TypeNo. of PatientsPatient FeaturesIncidence of CDIDiagnostic MethodsGVHDOS/TRM
Alonso CD [6]20122003–2008Allo-HSCT, Auto-HSCT999Adults92 (9.2%)GDH
Culture
RelatedNo difference
Willems L [5]20122004–2007Allo-HSCT414Pediatrics and Adults (4–59)53 (13%)EIA toxin A/B
GDH
Culture
RelatedNo difference
Trifilio SM [8]20132004–2008Allo-HSCT, Auto-HSCT822Adults85 (10.3%)EIA toxin A/B
Culture
RelatedIncreased non-relapse mortality rates in CDI + aGVHD
Bruminhent J [9]20142011–2012Allo-HSCT, Auto-HSCT150Adults37 (24.7%)EIA toxin A/B
GDH
Not relatedNo difference
Hosokawa K [10]20142007–2008Allo-HSCT167Adults17 (10.2%)EIA toxin ANot relatedNo difference
Kamboj M [11]20142005–2010Allo-HSCT793598 Adults, 195 Pediatrics94 (11.9%)EIA toxin A/B
GDH
Not relatedNot indicated
Jain T [12]20152010–2012Allo-HSCT150Adults25 (16.7%)Culture
PCR
Not relatedNo difference
Aldrete SdM [13]20172010–2013Allo-HSCT, Auto-HSCT650Adults86 (13.2%)PCRNot relatedHigher TRM
Alonso CD [6]20172003–2012Allo-HSCT (only UCBT)226Adults30 (13.3%)EIA toxin A/B
PCR
Not relatedNo difference
Scardina T [14]20172009–2014Allo-HSCT, Auto-HSCT550Adults35 (6%)EIA toxin A/B
PCR
Not RelatedNo difference
Ford C [15]20192005–2018Auto-HSCT472Adults33 (7%)EIA toxin A/B
GDH
PCR
/No difference
Amberge S [16]20202004–2015Allo-HSCT727Adults96 (13%) + 103 (14%) asymptomaticEIA toxin A/B
GDH
Not RelatedNo difference
aGVHD = acute graft versus host disease; CDI = clostridium difficile infection; EIA = enzyme immunoassays; GDH = Glutamate dehydrogenase; HSCT = hematopoietic stem cell transplantation; PCR = polymerase chain reaction; OS = overall survival; TRM = transplant-related mortality; UCBT = unrelated cord blood transplant.
Table 2. Characteristic of patients.
Table 2. Characteristic of patients.
Characteristicn (=481)
Median Age55 (15–75)
Sex (male/female)273/208
Diagnosis
Leukemia and MDS196 (41%)
Lymphoma118 (24%)
Multiple myeloma145 (30%)
Other disease22 (5%)
Previous infections177 (37%)
MDR infections70 (14%)
Gastrointestinal and/or urogenital comorbidities HCT-CI204 (42%)
071 (15%)
1–2182 (38%)
≥3228 (47%)
Previous abdominal surgery172 (36%)
HCV infection6 (1%)
HBV infection49 (10%)
Previous Hospitalization152 (32%)
IgG < 700 mg/dL207 (43%)
Antibiotic therapy before HSCT194 (40%)
State disease before HSCT
Response287 (60%)
Active194 (40%)
Type of HSCT
Autologous HSCT220 (46%)
Allogeneic HSCT261 (54%)
HLA identical sibling48 (19%)
Matched unrelated donor105 (40%)
Haploidentical donor47 (18%)
Mismatched unrelated donor61 (23%)
Stem cell source: PB462 (96%)
Conditioning regimen
TBI-based regimen32 (7%)
Busulfan-based regimen152 (32%)
RIC62 (13%)
Other myeloablative regimen235 (49%)
Antibiotic therapy post-HSCT (n. lines)
0107 (22%)
1–2215 (45%)
≥3159 (33%)
Mucositis (grade)
045 (9%)
1–2193 (40%)
3–4142 (22%)
TPN use314 (29%)
aGVHD (grade) *
0143/261 (55%)
1–2106/261 (41%)
3–412/261 (4%)
CMV reactivation *147/261 (56%)
Other infections post-HSCT151 (31%)
aGVHD = acute graft versus host disease; CDI = clostridium difficile infection; CI = confidence interval; HCT-CI = hematopoietic cell transplantation–comorbidity index; HLA = human leukocyte antigen; HSCT = hematopoietic stem cell transplantation; MDS = myelodysplasia; MDR = multidrug-resistant germs; RIC= reduced intensity conditioning; SHR = sub-distribution hazard ratio; TBI = total body irradiation; TPN= total parenteral nutrition. * Calculated on allo-SCT cases.
Table 3. Characteristic of patients with CDI.
Table 3. Characteristic of patients with CDI.
20152016201720182019
Patients with CDI after HSCT (tot = 26)
Auto-HSCT01055
Allo-HSCT11139
Toxigenic CD021511
CDI presentation (median of days)6111010.58
Grade of diarrhea
<411-24
4–6---67
>6--1-1
Fever > 37.5 °C11114
ANC < 1 × 109/L at the time of CDI diagnosis)12038
≥grade II acute GVHD (grade 2)01113
Gastrointestinal and urogenital comorbidities112712
Abdominal surgery001510
CD negativization (median of days)NR681020.211.7
Laboratory test used for CD diagnosisEIA for toxinEIA for toxinEIA for toxinGDH; PCR for toxinGDH; PCR for toxin
ANC = absolute neutrophilic count; CD = clostridium difficile; CDI = clostridium difficile infection; EIA = enzyme immunoassays; GDH = glutamate dehydrogenase; HSCT = hematopoietic stem cell transplantation; NR = not reached; PCR = polymerase chain reaction.
Table 4. Univariate analysis of risk factors for incidence of CDI.
Table 4. Univariate analysis of risk factors for incidence of CDI.
Risk FactorSHR95% CIp
Sex
Male1
Female1.130.526–2.4530.74
Age (yr)1.010.983–1.0570.30
≤601
>602.391.089–5.2570.03
Diagnosis
Leukemia and MDS1
Lymphomas0.440.147–1.3510.15
Myeloma0.530.205–1.3680.19
Other diagnosis0.600.818–4.5180.62
Gastrointestinal and urogenital comorbidities1.890.874–4.1080.01
Previous infections2.361.085–5.1370.03
Previous MDR infection1.040.362–2.9970.93
HCT-CI
HCT-CI 01
HCT-CI 1–21.190.244–5.8410.82
HCT-CI ≥ 32.870.677–12.2130.15
Previous abdominal surgery2.961.35–6.5110.007
HCV infection6.631.912–22.8420.003
HBV infection1.570.552–4.4930.396
Hospitalization before HSCT2.551.185–5.5260.017
IgG value pre-HSCT1.1410.528–2.4660.73
Antibiotic therapy before HSCT8.383.868–18.1790.000
Disease status
Responsive1
Active0.530.224–1.2650.15
Type of HSCT
HLA identical donor1
Matched unrelated donor0.950.292–3.0900.93
Haploidentical donor0.760.177–3.3380.72
Mismatched unrelated donor0.190.022–1.7651.76
Autologous HSCT0.550.178–1.7490.31
Conditioning regimen
TBI-based1
Busulfan-based1.660.210–13.1040.63
Reduced intensity2.110.237–18.8220.50
Other myeloablative regimen1.760.233–13.3510.58
Antibiotic therapy post-HSCT (n. lines)
No lines1
1–2 lines0.660.232–1.9140.45
≥3 lines1.400.531–3.7330.49
Mucositis (grades)
0–1–21
3–40.680.278–1.6950.41
TPN use0.510.238−1.1080.09
aGVHD (grades)
0–1–21
3–41.520.545–4.280.41
CMV reactivation0.360.132–1.0060.051
Other infections post-HSCT0.390.137–1.1340.08
aGVHD = acute graft versus host disease; CDI = clostridium difficile infection; CI = confidence interval; HCT-CI = hematopoietic cell transplantation–comorbidity Index; HLA = human leukocyte antigen; HSCT = hematopoietic stem cell transplantation; MDS = myelodysplasia; MDR = multidrug-resistant germs; SHR = sub-distribution hazard ratio; TBI = total body irradiation; TPN= total parenteral nutrition.
Table 5. Multivariate analysis of risk factors for CDI.
Table 5. Multivariate analysis of risk factors for CDI.
FactorSHR95% CIp
Previous abdominal surgery3.691.614–8.4580.002
Antibiotic therapy before HSCT15.096.491–35.0780.000
Previous HCV infection6.531.295–33.0160.023
Other infections post-HSCT2.150.044–0.5290.003
CI = confidence interval; HSCT = hematopoietic stem cell transplantation; SHR = sub-distribution hazard ratio.
Table 6. Multivariate analysis of risk factors for TRM and OS.
Table 6. Multivariate analysis of risk factors for TRM and OS.
TRM OS
FactorSHRp95% CISHRp95% CI
Gastrointestinal comorbidity1.980.0081.193–3.2991.500.0171.076–2.096
Previous infections 1.5330.0241.058–2.222
Previous Hospitalization 1.840.0031.230–2.757
Disease status 2.230.0001.581–3.170
aGVHD (grades)
0–31
44.070.0011.764–9.392
Other infections post-HSCT 1.420.0431.011–1.998
aGVHD = acute graft versus host disease; HSCT = hematopoietic stem cell transplantation; OS = overall survival; TRM = transplant-related mortality.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Rosignoli, C.; Petruzzellis, G.; Radici, V.; Facchin, G.; Girgenti, M.; Stella, R.; Isola, M.; Battista, M.; Sperotto, A.; Geromin, A.; et al. Risk Factors and Outcome of C. difficile Infection after Hematopoietic Stem Cell Transplantation. J. Clin. Med. 2020, 9, 3673. https://doi.org/10.3390/jcm9113673

AMA Style

Rosignoli C, Petruzzellis G, Radici V, Facchin G, Girgenti M, Stella R, Isola M, Battista M, Sperotto A, Geromin A, et al. Risk Factors and Outcome of C. difficile Infection after Hematopoietic Stem Cell Transplantation. Journal of Clinical Medicine. 2020; 9(11):3673. https://doi.org/10.3390/jcm9113673

Chicago/Turabian Style

Rosignoli, Chiara, Giuseppe Petruzzellis, Vera Radici, Gabriele Facchin, Marco Girgenti, Rossella Stella, Miriam Isola, Martalisa Battista, Alessandra Sperotto, Antonella Geromin, and et al. 2020. "Risk Factors and Outcome of C. difficile Infection after Hematopoietic Stem Cell Transplantation" Journal of Clinical Medicine 9, no. 11: 3673. https://doi.org/10.3390/jcm9113673

APA Style

Rosignoli, C., Petruzzellis, G., Radici, V., Facchin, G., Girgenti, M., Stella, R., Isola, M., Battista, M., Sperotto, A., Geromin, A., Cerno, M., Arzese, A., Deias, P., Tascini, C., Fanin, R., & Patriarca, F. (2020). Risk Factors and Outcome of C. difficile Infection after Hematopoietic Stem Cell Transplantation. Journal of Clinical Medicine, 9(11), 3673. https://doi.org/10.3390/jcm9113673

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop