Next Article in Journal
The Feasibility of Prenatal Ultrasonic Screening for Developmental Dysplasia of the Hip
Previous Article in Journal
Therapeutic Effects of Semaglutide on Nonalcoholic Fatty Liver Disease with Type 2 Diabetes Mellitus and Obesity: An Open-Label Controlled Trial
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Systematic Review

Association between Glycosylated Hemoglobin Levels and Vaccine Preventable Diseases: A Systematic Review

1
Clinic of Infectious Diseases, Department of Precision and Regenerative Medicine and Ionian Area (DiMePRe-J), University of Bari Aldo Moro, 70124 Bari, Italy
2
Aging Branch, CNR Institute of Neuroscience, 35127 Padua, Italy
3
Department of Internal Medicine and Geriatrics, University of Palermo, Via del Vespro 141, 90127 Palermo, Italy
*
Author to whom correspondence should be addressed.
Diseases 2024, 12(8), 187; https://doi.org/10.3390/diseases12080187
Submission received: 15 June 2024 / Revised: 14 August 2024 / Accepted: 16 August 2024 / Published: 17 August 2024

Abstract

:
People with diabetes are at higher risk of serious complications from many vaccine-preventable diseases (VPDs). Some studies have highlighted the potential impact of glycosylated hemoglobin levels (HbA1c), but no systematic review has synthesized these findings. Of the 823 identified studies, 3 were included, for a total of 705,349 participants. Regarding the incidence of herpes zoster (HZ), one study found that higher HbA1c levels at the baseline (>10.3%) were associated with a significantly higher risk of HZ of 44%, compared to those with a good HbA1c control (6.7%). On the contrary, the second one reported that when compared to the reference group (HbA1c of 5.0–6.4%), participants with a HbA1c less than 5.0% were at higher risk of HZ of 63%, whilst participants with a HBA1c more than 9.5% had a similar risk. Finally, the third study observed that diabetes, defined using a value of HbA1c more than 7.5%, was associated with an increased risk of mortality in men with COVID-19. In conclusion, both high and low HBA1c levels appear to be associated with a higher risk of HZ. Regarding COVID-19, a value of HbA1c more than 7.5% was associated with a higher risk of death in COVID-19, but only in men.

1. Introduction

According to the Global Burden of Disease, there were 529 million people with diabetes in the world in 2021. This figure is projected to reach approximately 1.31 billion by 2050 [1]. Diabetes, which represents one of the principal causes of morbidity and death in the world [1], is associated with a higher risk of developing various types of infections [2], as well as of hospitalization and infection-related mortality [3]. A review of 13 population-based studies and 1 randomized controlled study reported a strong association between higher glycosylated hemoglobin (HbA1c) levels and infectious diseases (IDs) in both type 1 and type 2 diabetes (T1DM and T2DM) [4]. Furthermore, a high HbA1c level (>8.5%) has been identified as a predictor of rates of skin and soft tissue infections, pneumonia, and urinary tract infections in older people with diabetes [5]. A recent cohort study of 33,829 people with type 1 diabetes found an association between high mean HbA1c level and their variability with an increased risk of infections, particularly in those who required hospitalization; younger age and non-white ethnicity were associated with a higher infection risk, likely due to higher mean HbA1c level and variations observed in these subgroups [6]. Moreover, a systematic review and meta-analysis suggested an association between higher HbA1C levels and increased risk of surgical site infections (SSIs) after total joint arthroplasty, highlighting that optimizing glycemic control preoperatively and during the postoperative period is crucial for reducing the incidence of SSIs and improving overall surgical outcomes [7]. However, some studies have also reported the impact of low HbA1c levels on infection risk. A population-based cohort study found an increased risk of infection at both high and low HbA1c levels in patients with T2DM [8]. A large primary care cohort study reported that compared with people without diabetes, those with diabetes and poor glycemic control (HbA1c ≥ 11%), but also those with optimal glycemic control (mean HbA1c 6–7%), exhibited elevated hospitalization risks due to infection [9]. Similarly, a prospective cohort study of Chinese adults with T2DM found a U-shaped association between glycaemia and hospitalization for infection, such that HbA1c below 6.0% (42 mmol/mol) and above 8.0% (64 mmol/mol) were both associated with an excess of hospitalization for IDs [10].
Due to the increased risk of infections in diabetic patients, it is important to consider in particular the burden of Vaccine Preventable diseases (VPDs), such as influenza, pneumococcal disease, tetanus, pertussis, herpes zoster, Human papillomavirus (HPV) infection, and COVID-19, that could be prevented in terms of incidence rates and severity through vaccination. People affected by diabetes are at higher risk of developing serious complications from several VPDs when compared to the general population. Previous studies registered an increased mortality rate due to pneumococcal infections among diabetic patients, but whether this is due to a weakened host defense mechanisms against pneumococcus, metabolic decompensation brought on by infection, or other unknown aspects of their multisystem disease is still not clear [11]. Although studies conducted in the past years among patients with DM found impaired or weak antibody response to pneumococcal antigens [12], more recent studies reported normal concentrations of serum antibodies with comparable responses to pneumococcal vaccination between people affected by diabetes and nondiabetic controls [11], as well as the absence of a disparity in the immune response to intramuscular hepatitis B vaccination between children with T1DM and control groups [13]. Conversely, research has shown that compared to people without diabetes, patients with diabetes, particularly those with uncontrolled blood glucose levels, typically have a much weaker antibody response to COVID-19 vaccinations. According to a study by Boroumand et al., patients with T2DM had significantly lower positive rates and titers of specific antibodies (anti-N/S IgG and anti-RBD IgG) than controls. Compared to diabetic individuals with uncontrolled glycemia, those with regulated glycemia showed improved antibody responses [14]. Interestingly, the antibody response to influenza vaccines in diabetic individuals does not appear to be significantly impaired, indicating a different immune response depending on the type of vaccine and the underlying mechanisms of the disease being vaccinated against [15].
The tendency to be more prone to infection, indeed, has a myriad of causes other than defects in immunity. In individuals affected by diabetes, an increased adherence of microorganisms to diabetic cells, the presence of micro- and macroangiopathy or neuropathy, and the elevated frequency of medical interventions may contribute to the pathogenesis of infections, in addition to the tendency toward ketoacidosis, which in itself is complicated by an infection in 75% of cases [16]. A recent meta-analysis of 38 observational studies reported that people with diabetes exhibited significantly higher rates of mortality and hospitalization for influenza compared to the general population. However, lack of data on glycemic control did not make it possible to identify people at higher risk of adverse outcomes among those with diabetes [17]. Moreover, people with diabetes are at higher risk of developing invasive pneumococcal disease, community-acquired pneumonia (CAP) [18,19], as well as of hospitalization due to pneumonia, a longer hospital stay, and higher mortality [20]. Compared with nondiabetic people, those with diabetes and a HbA1 level <7% and those with a HbA1 level ≥9% both had a higher risk of pneumonia-related hospitalization [21]. A multicentric study reported an association between an increased HbA1c level at admission and the development of severe CAP in patients with diabetes [22]. In contrast, a retrospective study on diabetic patients admitted to hospital with CAP found that only those with good glycemic control had an increased risk for adverse outcomes and longer intensive care unit and hospital stays [23]. Diabetes represents an established risk factor for developing severe COVID-19, as well as for hospitalization and mortality from COVID-19 [24]. People with diabetes also are also at increased risk for Hepatitis B (HBV) infection compared to those without diabetes due to their frequent percutaneous exposure to infected blood [25]. The co-presence of T2DM and chronic HBV infection is associated with a higher incidence of hepatocellular carcinoma (HCC), as well as an increased risk of cirrhosis, liver fibrosis, decompensation, non-liver cancers, and all-cause mortality [26]. As such, HZ incidence data and population figures estimate up to 1 million new cases of HZ each year in the United States, with more than half occurring in individuals aged 60 and older [27]. Most countries anticipate an increase in HZ incidence in the ensuing decades as a result of aging populations and the emergence of immunocompromising illnesses (and their treatments) linked to aging [27]. One of the most common complications of HZ is the postherpetic neuralgia (PHN), defined as any pain after the rash heals or any pain at 1 month, 3 months, 4 months, or 6 months after the rash onset. Most experts agree that pain persisting 90–120 days after the onset of the rash defines a group of patients with true chronic neuropathic pain [28]. The prevalence of PHN in the United States is estimated to range from 500,000 to 1 million cases, and people with diabetes are at a higher risk of developing HZ as well as PHN [29]. Despite some studies having highlighted the impact of glycosylated hemoglobin levels on some VPDs, no systematic review has yet analyzed and synthesized these findings.
Therefore, this systematic review aims to evaluate the association between glycosylated hemoglobin levels and VPDs in the adult population.

2. Materials and Methods

This systematic review and meta-analysis was conducted in accordance with the updated 2020 Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines [30]. The protocol has been registered in Open Science Framework (https://osf.io/8kxcv/) on 1 November 2023.

2.1. Search Strategy

Two independent reviewers (F.L. and E.D.V.) searched PubMed and Embase from inception until 16 November 2023. The complete search strategy is reported in Supplementary Table S1. For these datasets, we used the concept of VPDs for HbA1c and the outcomes of interest. Any discrepancies in the literature search were resolved by a third independent investigator (N.V.).

2.2. Inclusion and Exclusion Criteria

The PICOS question with which we based our inclusion and exclusion criteria was:
  • P: Adult population (≥18 years) with or without vaccine-preventable diseases (VPDs) at the baseline;
  • I: Higher HbA1c values;
  • C: lower HbA1c values;
  • O: Mortality and hospitalization rates in patients with VPDs and incidence of VPDs in people without VPDs at the baseline;
  • S: Both prospective and retrospective observational studies.

2.3. Data Extraction and Risk of Bias

Two authors (F.L. and E.D.V.) independently extracted the following data: name of the first author, date of publication, country of origin, study design, participant age, sample size, gender, VPD considered, follow-up (reported in months), outcome, and confounders used in the multivariate analyses. Any disagreements between reviewers were resolved by a third independent reviewer (N.V.).
The risk of bias was assessed using the Newcastle–Ottawa Scale (NOS) [31]. NOS assigns a maximum of 9 points based on three quality parameters: selection, comparability, and outcome. This evaluation was carried out by two investigators (F.L. and E.D.V.). The risk of bias was classified as high (<5 points), moderate (6–7 points), or low (8–9 points) [32].

2.4. Statistical Analysis

Due to the limited number of studies included, we reported the data only descriptively.

3. Results

3.1. Literature Search

The preliminary literature search yielded 823 non-duplicate publications. After excluding duplicates and abstracts, three full texts were deemed eligible for inclusion in the systematic review. The complete PRISMA flow diagram is shown in Figure 1. At full-text level, the main reasons of exclusion were the lack of the outcome of interest, as well as the lack of population and study design, as detailed in Supplementary Table S2.

3.2. Descriptive Data

Table 1 shows the descriptive characteristics of the three studies included [33,34]. Overall, the three studies included a total of 705,349 participants without VPDs at the baseline, followed-up for a mean of 113 months. The mean age was less than 65 years in all of the studies included, and the participants were prevalently females (54%). Two studies explored the incidence of HZ infection as outcome, whilst the last one explored the mortality rate according to different HbA1c levels in patients with COVID-19 at the baseline. In the multivariable analyses, as reported in Table 1, the mean number of covariates used was eight, usually considering demographic factors, comorbidities, and medications in exploring the association between basal HbA1c levels and the outcomes of interest.

3.3. Main Findings

Table 2 summarizes the main findings of the three studies included in this systematic review. In the study of Bo-Lin Pan et al. [35], in more than 120,000 Chinese participants followed-up for six years, the authors found that higher HbA1c levels at the baseline (>10.3%) were associated with a significantly higher risk of HZ of 44% compared to those with a good HbA1c control (6.7%).
On the contrary, in the study of Kobayashi et al. [33], when compared to the reference group (HbA1c of 5.0–6.4%), participants with a HbA1c less than 5.0% were at significantly higher risk of HZ of 63% after considering the role of 13 potential confounders, whilst participants with a HBA1c more than 9.5% had a similar risk.
Finally, in the UK Biobank dataset, De Jong et al. [34] observed that diabetes, defined using a value of HbA1c more than 7.5%, was associated with a higher risk of death in COVID-19 or influenza/pneumonia only in men, suggesting a potential gender difference.

3.4. Risk of Bias

The risk of bias is fully reported in Supplementary Table S3. The overall quality of the studies was fair. In all of the three studies, the representativeness of the exposed cohort was poorly described, as was the description about participants lost at follow-up.

4. Discussion

In our systematic review examining the relationship between glycosylated hemoglobin levels and VPDs, we identified three full texts eligible for inclusion, encompassing a total of 705,349 participants without VPDs at baseline followed-up for a mean of 113 months. Two studies evaluated the incidence of herpes zoster and one the mortality rate according to different HbA1c levels in patients with COVID-19 at the baseline. Of all of the participants included in our review, 54% were females, with the mean age across the three studies being below 65 years.
To the best of our knowledge, this review is the first to explore the relationship between diabetes and VPDs in terms of mortality and hospitalization rates. The two studies under review evaluating the incidence of HZ were conducted in Asia, specifically in China and Japan. The incidence of T2DM in Japan presents with high heterogeneity and uncertain data, as highlighted by a systematic review and meta-analysis by Goto et al. [36]. Conversely, China ranks among the top three countries worldwide for the highest estimated number of incident diabetes cases, followed by India and the United States of America [37].
The study with the oldest participant cohort, conducted in China by Bo-Lin Pan, reported an increased risk of HZ in patients with poor diabetes control, after adjusting for age, sex, and comorbidities [35]. A systematic review and metanalysis conducted in Taiwan in 2021 found a similar result; nevertheless, in addition to the higher incidence of shingles among diabetic patients compared to the general population, the study found that the substantial difference in risk of occurrence of HZ between diabetics and general population was seen especially in younger patients. In particular, when the cutoff was lowered to 40 years old, there still was an increased risk of diabetic patients compared to the group of non-diabetic peers. However, a limitation of this review was the inclusion of studies that exclusively enrolled patients with TDM1, narrowing the generalizability of the findings and limiting the applicability of the conclusions to the broader diabetic population, particularly those with type 2 diabetes mellitus [38]. A similar result was previously experienced in research conducted in Israel by Heymann et al. [39], in which the risk of HZ in people with a high level (>8% or >64 mmol/mol) of glycated hemoglobin was higher in the population under 45 years old, while such a trend was not found in people of older ages; however, this could be explained by the evidence that younger patients included in that study had more immunodeficiency factors and were less vaccinated. Similarly, a study by Kobayashi et al. in Japan found a significantly higher adjusted odds ratio for developing HZ in the lowest HbA1c group compared to the reference group, while the group with HbA1c ≥ 9.5% showed a higher but not statistically significant odds ratio [33]. The age difference between groups (mean age 39.7 vs. 52.2) and the Japanese vaccination recommendations for individuals over 50 could account for these findings.
Studies provide conflicting data on whether the age-adjusted incidence of HZ in the general population is changing over time [27]. In studies published before the year 2000, the incidence of HZ in people of all ages was 1.2–4.8 cases per 1000 inhabitants per year, and the incidence of HZ in persons over 60 years of age was 7.2–11.8 cases per 1000 inhabitants per year [40]. Numerous research indicates a significant increase in the risk of HZ beginning at 50–60 years of age and continuing to grow into later life [41].
The impact of HZ in diabetic populations has been widely studied globally, although the specific roles of hypo- or hyperglycaemia remain under debate [42,43]. In fact, while the role of hyperglycaemia in the occurrence of infectious diseases has been widely demonstrated, a determining role as a risk factor for infectious events such as HZ is also played by hypoglycaemia, exacerbating immune dysfunctions in diabetic patients inducing stress responses and inflammatory patterns [44]. Studies on post-herpetic neuralgia, which is one of the most common complications of the HZ, have been largely conducted, and a relationship with poor glycaemic control has been hypothesized; however, up to this point, direct research focused on this topic is limited. As such, a large study in the USA involving 4.5 million diabetic patients found an 18% adjusted risk of post-zoster pain, underscoring the strong link between diabetes and persistent post-zoster pain [45]. Conversely, in a cross-sectional study conducted in Canada, the 1-year prevalence was higher in patients aged 65 and older (0.67%), and females had a higher 1-year prevalence compared to males (0.35% vs. 0.28%, respectively); however, this analysis did not identify any statistically significant associations between HbA1c levels and subsequent HZ infections in patients with diabetes. The limitations of the study were associated with wide confidence intervals due to the small number of patients with HZ, reducing the statistical power to detect any significant differences. Furthermore, in this study, there was no differentiation between T1DM and T2DM; this increased incidence by age group and female sex has been observed in other studies [27,46]. A retrospective study conducted by Chen P found that when diabetic patients with CAP have an elevated glycemic gap, they are more likely to experience poor outcomes such as acute renal damage (AKI), septic shock, ICU admission, prolonged hospital and ICU stays, and more days spent on a ventilator. The glycemic gap between admission glucose levels and A1c-derived average glucose levels can predict these unfavorable outcomes, performing better than acute hyperglycemia. Clinical scoring systems including PSI, CURB-65, and SMART-COP showed higher predictive accuracy when the glycemic gap was added. This suggests that the glycemic gap could be a useful addition to future clinical scoring systems for enhanced risk assessment and management [23].
Furthermore, the importance of maintaining constant blood sugar levels for a successful immune response has been extensively shown by the fact that diabetic individuals with regulated glycemia showed considerably better antibody responses than those with uncontrolled glycemia. The aforementioned discovery highlights the crucial function of glucose control in enhancing the body’s ability to fight infections and respond to vaccinations, implying that well-managed diabetes can lead to improved health outcomes [14]. The recent literature has increasingly focused on exploring a potential correlation between viral infections and diabetes. However, despite this heightened attention, epidemiological data continue to present significant inconsistencies and challenges [47].
A study by Lutz P. Breitling et al. reported a non-linear association between HbA1c levels and mortality from influenza, pneumonia, or other acute lower respiratory infections, but it was excluded from our meta-analysis due to its lack of differentiation in the results analysis between influenza and non-viral pneumonia patterns [48]. In terms of VPDs, a higher risk of HBV infection in diabetic populations has been well documented, with more severe outcomes than in the general population [49] and a higher incidence of diabetes in individuals infected with HBV [50]. A recent study by T. Cai et al. found that diabetic patients with HBV had significantly worse glycemic control than those with T2DM alone; HBV infection was indeed linked to a 33% increased risk of developing diabetes, making it a potential diabetes-related risk factor and suggesting that HBV treatment could mitigate this effect. However, the study by Cai initially selected for our meta-analysis was later excluded due to the lack of relevant outcomes [48]. Moreover, elevated HbA1c levels were positively related to the risk of HCC in diabetic patients [51]. However, some studies indicates that this increased risk is more related to liver cirrhosis resulting from chronic hepatitis B rather than the HBV infection itself [52]. However, the relationship between T2DM and HBV is still controversial, due to a potential protective effect of HBV infection against T2DM [53]. Among viral VPD an important role is played by HPV; in this regard, many studies have focused on understanding a potential correlation between HPV and diabetes, founding a higher prevalence of HPV infection in people with diabetes compared to the general population [54] and proving the association between diabetes and increased risk of developing cervical cancer, even if a direct correlation with HPV was not proved [55]. None of the studies on HPV were included in our meta-analysis, as they did not meet the inclusion criteria.
The last included study found that diabetes, defined using a value of HbA1c more than 7.5%, was associated with a higher risk of death in COVID-19 only in men, suggesting a potential gender difference [34].
Large-scale studies from China and Italy have shown that diabetic patients have a similar risk of SARS-CoV-2 infection as those with optimal glycaemic control [56,57]. Yet, once hospitalized, diabetic patients exhibit higher morbidity and mortality rates, indicating that diabetes is an independent predictor of poor prognosis in COVID-19 patients. As stated by Tabrizi et al. in a recent study, diabetic individuals infected with SARS-CoV-2 had over twice the risk of ICU admission and more than three times the risk of death compared to non-diabetic patients [58]. Conversely, a study in England by Barron et al. on 61 million individuals found that 33% of in-hospital COVID-19 deaths between 1 March 2020 and 11 May 2020 occurred in people with diabetes, with diabetic women having higher odds ratios for in-hospital mortality than men [59]. A recent systematic review and meta-analysis of 22 studies reported an association between lower HbA1c prior to hospitalization and lower in-hospital mortality in patients with COVID-19 [60]. Thus, the increased vulnerability of people affected by diabetes compared to the general population can lead to more severe illness, longer recovery times, and an increased likelihood of hospitalization. Consequently, it is crucial for individuals with diabetes to maintain up-to-date vaccinations to protect themselves against preventable diseases such as influenza, pneumonia, and hepatitis. Public health initiatives and healthcare providers should emphasize the importance of immunizations in this high-risk group to reduce morbidity and mortality rates.
However, studies on the relationship between diabetes and VPDs are still grappling with diverse findings and interpretations, which highlight the complexity of establishing clear associations between infections and specific health conditions like diabetes. The evolving landscape of research underscores the need for further investigation and comprehensive analysis to elucidate the nuanced relationships between infections and health outcomes across different populations and contexts.
To the best of our knowledge, this review represents a pioneering effort in investigating the relationship between HbA1c levels and VPDs, examining both their incidence in individuals without VPDs and the impact on mortality and hospitalization rates among patients with VPDs. While this study marks significant progress in understanding these correlations, several limitations must be acknowledged and addressed.
The primary limitation of this study is the reliance on only two databases, Embase and PubMed, for sourcing the data. This constraint may still impact the comprehensiveness and generalizability although these databases are among the most comprehensive and widely used in the biomedical field. Furthermore, the review includes only three cohort studies, which may not fully capture the breadth and diversity of potential associations between HbA1c levels and various VPDs. The limited number of studies also restricts the generalizability of findings across different populations and settings. Moreover, case–control studies may have provided limited insights into causal relationships between high HbA1c levels and the outcomes of our interest.
The focus of the review is predominantly on HZ and COVID-19, with a notable exclusion of other VPDs. While HZ and COVID-19 are significant illnesses, broader inclusion of other VPDs could have enriched the review’s scope and implications for public health policies and clinical practices.
Regarding study quality, the included studies generally exhibited low risk of bias. However, concerns were raised about population representativeness, inadequate follow-up rates, and the retrospective nature of some studies. These methodological limitations may introduce biases and affect the reliability and applicability of the findings. Notably, only one of the studies reviewed was prospective, emphasizing the need for more longitudinal research to establish robust conclusions about the impact of HbA1c levels on VPD outcomes over time.
Moving forward, there is a clear imperative for further research in this field to address these limitations and expand our understanding. Future studies should aim for greater diversity in study populations to enhance the generalizability of findings across different demographic and geographic contexts. Longitudinal studies with adequate follow-up periods are crucial to capture the long-term effects of HbA1c levels on VPD incidence, mortality, and hospitalization rates. Additionally, incorporating case–control designs would enable better control of confounding variables and strengthen causal inference.
Furthermore, expanding the scope of research to include a wider range of vaccine-preventable diseases beyond HZ and COVID-19 would provide a more comprehensive picture of how HbA1c levels influence susceptibility and outcomes across different infectious diseases.

5. Conclusions

Our systematic review, while limited to a small number of studies, demonstrates a significant association between high HbA1c levels and increased risk of death from COVID-19 in men, suggesting a potential gender difference. For HZ, discrepancies exist due to the significant impact of both hyperglycemia and hypoglycemia on the development of infectious diseases in diabetic populations. As such, emerging evidence indicates that hypoglycemia also plays a crucial role by inducing stress responses and inflammatory patterns that exacerbate immune dysfunctions. Therefore, maintaining stable blood glucose levels is essential to reduce the susceptibility to infections and improve overall health outcomes in diabetic patients, and further prospective studies are needed to explore this correlation more thoroughly. Diabetic individuals are more vulnerable to severe illness, longer recovery times, and higher hospitalization rates compared to the general population. Hence, it is crucial for these individuals to maintain up-to-date vaccinations against preventable diseases like influenza, pneumonia, and hepatitis. By addressing these challenges and expanding the scope and rigor of studies, we can better inform preventive strategies, clinical management, and public health interventions aimed at reducing the burden of VPDs in diabetic populations and beyond. Moreover, the aging population and high prevalence of diabetes in older adults, more vulnerable to infectious diseases and their complications, highlight the need for more research into this high-risk age group.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/diseases12080187/s1, Table S1: search strategies; Table S2: Excluded references, with reason; Table S3: Evaluation of the risk of bias.

Author Contributions

Methodology, N.V.; formal analysis, F.L.; data curation, E.D.V. and F.L.; writing—original draft preparation, E.D.V., F.L. and F.D.G.; writing—review and editing, A.S. and S.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

Data are available upon request to the corresponding author.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Ong, K.L.; Stafford, L.K.; McLaughlin, S.A.; Boyko, E.J.; Vollset, S.E.; Smith, A.E.; Dalton, B.E.; Duprey, J.; Cruz, J.A.; Hagins, H.; et al. Global, regional, and national burden of diabetes from 1990 to 2021, with projections of prevalence to 2050: A systematic analysis for the Global Burden of Disease Study 2021. Lancet 2023, 402, 203–234. [Google Scholar] [CrossRef]
  2. Abu-Ashour, W.; Twells, L.; Valcour, J.; Randell, A.; Donnan, J.; Howse, P.; Gamble, J.-M. The association between diabetes mellitus and incident infections: A systematic review and meta-analysis of observational studies. BMJ Open Diabetes Res. Care 2017, 5, e000336. [Google Scholar] [CrossRef]
  3. Magliano, D.J.; Harding, J.L.; Cohen, K.; Huxley, R.R.; Davis, W.A.; Shaw, J.E. Excess Risk of Dying from Infectious Causes in Those with Type 1 and Type 2 Diabetes. Diabetes Care 2015, 38, 1274–1280. [Google Scholar] [CrossRef] [PubMed]
  4. Pearson-Stuttard, J.; Blundell, S.; Harris, T.; Cook, D.G.; Critchley, J. Diabetes and infection: Assessing the association with glycaemic control in population-based studies. Lancet Diabetes Endocrinol. 2016, 4, 148–158. [Google Scholar] [CrossRef] [PubMed]
  5. McGovern, A.P.; Hine, J.; de Lusignan, S. Infection risk in elderly people with reduced glycaemic control. Lancet Diabetes Endocrinol. 2016, 4, 303–304. [Google Scholar] [CrossRef] [PubMed]
  6. Chaudhry, U.A.; Carey, I.M.; Critchley, J.A.; DeWilde, S.; Limb, E.S.; Bowen, L.; Panahloo, A.; Cook, D.G.; Whincup, P.H.; Harris, T. A matched cohort study evaluating the risks of infections in people with type 1 diabetes and their associations with glycated haemoglobin. Diabetes Res. Clin. Pract. 2024, 207, 111023. [Google Scholar] [CrossRef] [PubMed]
  7. Shohat, N.; Muhsen, K.; Gilat, R.; Rondon, A.J.; Chen, A.F.; Parvizi, J. Inadequate Glycemic Control Is Associated with Increased Surgical Site Infection in Total Joint Arthroplasty: A Systematic Review and Meta-Analysis. J. Arthroplast. 2018, 33, 2312–2321.e3. [Google Scholar] [CrossRef] [PubMed]
  8. Mor, A.; Dekkers, O.M.; Nielsen, J.S.; Beck-Nielsen, H.; Sørensen, H.T.; Thomsen, R.W. Impact of Glycemic Control on Risk of Infections in Patients with Type 2 Diabetes: A Population-Based Cohort Study. Am. J. Epidemiol. 2017, 186, 227–236. [Google Scholar] [CrossRef] [PubMed]
  9. Critchley, J.A.; Carey, I.M.; Harris, T.; DeWilde, S.; Hosking, F.J.; Cook, D.G. Glycemic Control and Risk of Infections Among People with Type 1 or Type 2 Diabetes in a Large Primary Care Cohort Study. Diabetes Care 2018, 41, 2127–2135. [Google Scholar] [CrossRef] [PubMed]
  10. Luk, A.O.; Lau, E.S.; Cheung, K.K.; Kong, A.P.; Ma, R.C.; Ozaki, R.; Chow, F.C.; So, W.Y.; Chan, J.C. Glycaemia control and the risk of hospitalisation for infection in patients with type 2 diabetes: Hong Kong Diabetes Registry. Diabetes/Metab. Res. Rev. 2017, 33, e2923. [Google Scholar] [CrossRef]
  11. Lederman, M.M.; Schiffman, G.; Rodman, H.M. Pneumococcal Immunization in Adult Diabetics. Diabetes 1981, 30, 119–121. [Google Scholar] [CrossRef] [PubMed]
  12. Marble, A.; White, H.J.; Fernald, A.T. THE Nature of the Lowered Resistance to Infection in Diabetes Mellitus 1. J. Clin. Investig. 1938, 17, 423–430. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
  13. Volti, S.L.; Caruso-Nicoletti, M.; Biazzo, F.; Sciacca, A.; Mandarà, G.; Mancuso, M.; Mollica, F. Hyporesponsiveness to intradermal administration of hepatitis B vaccine in insulin dependent diabetes mellitus. Arch. Dis. Child. 1998, 78, 54–57. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
  14. Boroumand, A.B.; Forouhi, M.; Karimi, F.; Moghadam, A.S.; Naeini, L.G.; Kokabian, P.; Naderi, D. Immunogenicity of COVID-19 vaccines in patients with diabetes mellitus: A systematic review. Front. Immunol. 2022, 13, 940357. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
  15. Cheng, Y.; Shen, P.; Tao, Y.; Zhang, W.; Xu, B.; Bi, Y.; Han, Z.; Zhou, Y.-H. Reduced antibody response to COVID-19 vaccine composed of inactivated SARS-CoV-2 in diabetic individuals. Front. Public Health 2022, 10, 1025901. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
  16. E Geerlings, S.; Hoepelman, A.I. Immune dysfunction in patients with diabetes mellitus (DM). FEMS Immunol. Med. Microbiol. 1999, 26, 259–265. [Google Scholar] [CrossRef] [PubMed]
  17. Dicembrini, I.; Silverii, G.A.; Clerico, A.; Fornengo, R.; Gabutti, G.; Sordi, V.; Tafuri, S.; Peruzzi, O.; Mannucci, E. Influenza: Diabetes as a risk factor for severe related-outcomes and the effectiveness of vaccination in diabetic population. A meta-analysis of observational studies. Nutr. Metab. Cardiovasc. Dis. 2023, 33, 1099–1110. [Google Scholar] [CrossRef] [PubMed]
  18. Torres, A.; Blasi, F.; Dartois, N.; Akova, M. Which individuals are at increased risk of pneumococcal disease and why? Impact of COPD, asthma, smoking, diabetes, and/or chronic heart disease on community-acquired pneumonia and invasive pneumococcal disease. Thorax 2015, 70, 984–989. [Google Scholar] [CrossRef]
  19. Brunetti, V.C.; Ayele, H.T.; Yu, O.H.Y.; Ernst, P.; Filion, K.B. Type 2 diabetes mellitus and risk of community-acquired pneumonia: A systematic review and meta-analysis of observational studies. CMAJ Open 2021, 9, E62–E70. [Google Scholar] [CrossRef] [PubMed]
  20. Zoppini, G.; Fedeli, U.; Schievano, E.; Dauriz, M.; Targher, G.; Bonora, E.; Corti, M.C. Mortality from infectious diseases in diabetes. Nutr. Metab. Cardiovasc. Dis. 2018, 28, 444–450. [Google Scholar] [CrossRef]
  21. Kornum, J.B.; Thomsen, R.W.; Riis, A.; Lervang, H.-H.; Schønheyder, H.C.; Sørensen, H.T. Diabetes, glycemic control, and risk of hospitalization with pneumonia: A population-based case-control study. Diabetes Care 2008, 31, 1541–1545. [Google Scholar] [CrossRef] [PubMed]
  22. Tan, R.; Liu, B.; Zhao, C.; Yan, J.; Pan, T.; Zhou, M.; Qu, H. Nomogram for prediction of severe community-acquired pneumonia development in diabetic patients: A multicenter study. BMC Pulm. Med. 2022, 22, 40. [Google Scholar] [CrossRef] [PubMed]
  23. Chen, P.-C.; Liao, W.-I.; Wang, Y.-C.; Chang, W.-C.; Hsu, C.-W.; Chen, Y.-H.; Tsai, S.-H. An Elevated Glycemic Gap is Associated with Adverse Outcomes in Diabetic Patients with Community-Acquired Pneumonia. Medicine 2015, 94, e1456. [Google Scholar] [CrossRef] [PubMed]
  24. Hartmann-Boyce, J.; Rees, K.; Perring, J.C.; Kerneis, S.A.; Morris, E.M.; Goyder, C.; Otunla, A.A.; James, O.E.; Syam, N.R.; Seidu, S. Risks of and from SARS-CoV-2 infection and COVID-19 in people with diabetes: A systematic review of reviews. Diabetes Care 2021, 44, 2790–2811. [Google Scholar] [CrossRef]
  25. Cai, C.; Zeng, J.; Wu, H.; Shi, R.; Wei, M.; Gao, Y.; Ma, W. Association between hepatitis B virus infection and diabetes mellitus: A meta-analysis. Exp. Ther. Med. 2015, 10, 693–698. [Google Scholar] [CrossRef]
  26. Huang, S.; Kao, J. The interplay between chronic hepatitis B and diabetes mellitus: A narrative and concise review. Kaohsiung J. Med. Sci. 2024, 40, 6–10. [Google Scholar] [CrossRef]
  27. Schmader, K.; Gnann, J.J.W.; Watson, C.P. The Epidemiological, Clinical, and Pathological Rationale for the Herpes Zoster Vaccine. J. Infect. Dis. 2008, 197 (Suppl. 2), S207–S215. [Google Scholar] [CrossRef] [PubMed]
  28. Cunningham, A.L.; Dworkin, R.H. The management of post-herpetic neuralgia. BMJ 2000, 321, 778–779. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
  29. Saadatian-Elahi, M.; Bauduceau, B.; Del-Signore, C.; Vanhems, P. Diabetes as a risk factor for herpes zoster in adults: A synthetic literature review. Diabetes Res. Clin. Pract. 2019, 159, 107983. [Google Scholar] [CrossRef] [PubMed]
  30. Page, M.J.; McKenzie, J.E.; Bossuyt, P.M.; Boutron, I.; Hoffmann, T.C.; Mulrow, C.D.; Shamseer, L.; Tetzlaff, J.M.; Akl, E.A.; Brennan, S.E. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. Int. J. Surg. 2021, 88, 105906. [Google Scholar] [CrossRef]
  31. Luchini, C.; Stubbs, B.; Solmi, M.; Veronese, N. Assessing the quality of studies in meta-analyses: Advantages and limitations of the Newcastle Ottawa Scale. World J. Meta-Anal. 2017, 5, 80–84. [Google Scholar] [CrossRef]
  32. Luchini, C.; Veronese, N.; Nottegar, A.; Shin, J.I.; Gentile, G.; Granziol, U.; Soysal, P.; Alexinschi, O.; Smith, L.; Solmi, M. Assessing the quality of studies in meta-research: Review/guidelines on the most important quality assessment tools. Pharm. Stat. 2021, 20, 185–195. [Google Scholar] [CrossRef] [PubMed]
  33. Kobayashi, D.; Shimbo, T.; Noto, H.; Eto, H.; Takahashi, O.; Higuchi, T. Low level of hemoglobin A1c and the increased incidence of herpes zoster: Longitudinal study. Eur. J. Clin. Microbiol. Infect. Dis. 2019, 38, 1539–1545. [Google Scholar] [CrossRef]
  34. De Jong, M.; Woodward, M.; Peters, S.A. Diabetes and COVID-19–Related Mortality in Women and Men in the UK Biobank: Comparisons with Influenza/Pneumonia and Coronary Heart Disease. Diabetes Care 2020, 44, e22–e24. [Google Scholar] [CrossRef]
  35. Pan, B.-L.; Chou, C.-P.; Huang, K.-S.; Bin, P.-J.; Luo, K.-H.; Chuang, H.-Y. The Pattern of Hemoglobin A1C Trajectories and Risk of Herpes Zoster Infection: A Follow-Up Study. Int. J. Environ. Res. Public Health 2022, 19, 2646. [Google Scholar] [CrossRef] [PubMed]
  36. Goto, A.; Goto, M.; Noda, M.; Tsugane, S. Incidence of Type 2 Diabetes in Japan: A Systematic Review and Meta-Analysis. PLoS ONE 2013, 8, e74699. [Google Scholar] [CrossRef]
  37. Wu, H.; Patterson, C.C.; Zhang, X.; Ghani, R.B.A.; Magliano, D.J.; Boyko, E.J.; Ogle, G.D.; Luk, A.O. Worldwide estimates of incidence of type 2 diabetes in children and adolescents in 2021. Diabetes Res. Clin. Pract. 2022, 185, 109785. [Google Scholar] [CrossRef]
  38. Huang, C.-T.; Lee, C.-Y.; Sung, H.-Y.; Liu, S.-J.; Liang, P.-C.; Tsai, M.-C. Association Between Diabetes Mellitus and the Risk of Herpes Zoster: A Systematic Review and Meta-analysis. J. Clin. Endocrinol. Metab. 2021, 107, 586–597. [Google Scholar] [CrossRef] [PubMed]
  39. Heymann, A.D.; Chodick, G.; Karpati, T.; Kamer, L.; Kremer, E.; Green, M.S.; Kokia, E.; Shalev, V. Diabetes as a Risk Factor for Herpes Zoster Infection: Results of a Population-Based Study in Israel. Infection 2008, 36, 226–230. [Google Scholar] [CrossRef] [PubMed]
  40. Schmader, K.E.; Dworkin, R.H. The Epidemiology and Natural History of Herpes Zoster and Postherpetic Neuralgia. In Herpes Zoster: Postherpetic Neuralgia and Other Complications; Watson, C., Gershon, A., Oxman, M., Eds.; Adis: Cham, Switzerland, 2017. [Google Scholar] [CrossRef]
  41. Czernichow, S.; Dupuy, A.; Flahault, A.; Chosidow, O. Herpes zoster: Incidence study among “sentinel” general practitioners. Ann. Dermatol. Venereol. 2001, 128, 497–501. [Google Scholar]
  42. Dungan, K.M.; Braithwaite, S.S.; Preiser, J.-C. Stress hyperglycaemia. Lancet 2009, 373, 1798–1807. [Google Scholar] [CrossRef]
  43. Suaya, J.A.; Chen, S.-Y.; Li, Q.; Burstin, S.J.; Levin, M.J. Incidence of Herpes Zoster and Persistent Post-Zoster Pain in Adults with or Without Diabetes in the United States. Open Forum Infect. Dis. 2014, 1, ofu049. [Google Scholar] [CrossRef] [PubMed]
  44. Ke, C.-C.; Lai, H.-C.; Lin, C.-H.; Hung, C.-J.; Chen, D.-Y.; Sheu, W.H.-H.; Lui, P.-W. Increased Risk of Herpes Zoster in Diabetic Patients Comorbid with Coronary Artery Disease and Microvascular Disorders: A Population-Based Study in Taiwan. PLoS ONE 2016, 11, e0146750. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
  45. Polk, C.; Sampson, M.M.; Roshdy, D.; Davidson, L.E. Skin and Soft Tissue Infections in Patients with Diabetes Mellitus. Infect. Dis. Clin. N. Am. 2020, 35, 183–197. [Google Scholar] [CrossRef] [PubMed]
  46. Queenan, J.A.; Farahani, P.; Ehsani-Moghadam, B.; Birtwhistle, R.V. The Prevalence and Risk for Herpes Zoster Infection in Adult Patients with Diabetes Mellitus in the Canadian Primary Care Sentinel Surveillance Network. Can. J. Diabetes 2018, 42, 465–469. [Google Scholar] [CrossRef] [PubMed]
  47. Pizzol, D.; Di Gennaro, F.; Chhaganlal, K.D.; Fabrizio, C.; Monno, L.; Putoto, G.; Saracino, A. Prevalence of diabetes mellitus in newly diagnosed pulmonary tuberculosis in Beira, Mozambique. Afr. Health Sci. 2017, 17, 773–779. [Google Scholar] [CrossRef] [PubMed]
  48. Cai, T.; Yue, T.; Xu, M.; Zhang, P.; Wang, Y.; Liu, Q.; Huang, J.; Shen, T.; Yin, Q.; Sheng, Z.; et al. Poor glycemic control in type-2 diabetic patients infected with hepatitis B: A retrospective propensity-matched study. J. Med. Virol. 2023, 95, e28635. [Google Scholar] [CrossRef] [PubMed]
  49. Schillie, S.F.; Xing, J.; Murphy, T.V.; Hu, D.J. Prevalence of hepatitis B virus infection among persons with diagnosed diabetes mellitus in the United States, 1999–2010*. J. Viral Hepat. 2012, 19, 674–676. [Google Scholar] [CrossRef]
  50. Han, B.; Liu, W.; Yang, S.; Wang, S.; Du, J.; Liu, Y.; Cui, F. Association between self-monitoring of blood glucose and hepatitis B virus infection among people with diabetes mellitus: A cross-sectional study in Gansu Province, China. BMJ Open 2021, 11, e048463. [Google Scholar] [CrossRef]
  51. Donadon, V.; Balbi, M.; Valent, F.; Avogaro, A. Glycated hemoglobin and antidiabetic strategies as risk factors for hepatocellular carcinoma. World J. Gastroenterol. WJG 2010, 16, 3025. [Google Scholar] [CrossRef]
  52. Zhang, J.; Shen, Y.; Cai, H.; Liu, Y.; Qin, G. Hepatitis B virus infection status and risk of type 2 diabetes mellitus: A meta-analysis. Hepatol. Res. 2015, 45, 1100–1109. [Google Scholar] [CrossRef] [PubMed]
  53. Li, M.; Zhou, H.; Guan, Y.; Peng, H.; Wang, S.; Zhang, P.; Su, B. Positive hepatitis B surface antibody is associated with reduced risk of diabetes mellitus in retired female Chinese workers. J. Diabetes 2015, 8, 158–161. [Google Scholar] [CrossRef] [PubMed]
  54. Bell, M.C.; Schmidtgrimminger, D.; Patrick, S.; Ryschon, T.; Linz, L.; Chauhan, S.C. There is a high prevalence of human papillomavirus infection in American Indian women of the Northern Plains. Gynecol. Oncol. 2007, 107, 236–241. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
  55. García-Esquinas, E.; Guinó, E.; Castaño-Vinyals, G.; Pérez-Gómez, B.; Llorca, J.; Altzibar, J.M.; Peiró-Pérez, R.; Martín, V.; Moreno-Iribas, C.; Tardón, A.; et al. Association of diabetes and diabetes treatment with incidence of breast cancer. Acta Diabetol. 2015, 53, 99–107. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
  56. Fang, L.; Karakiulakis, G.; Roth, M. Are patients with hypertension and diabetes mellitus at increased risk for COVID-19 infection? Lancet Respir. Med. 2020, 8, e21. [Google Scholar] [CrossRef]
  57. Onder, G.; Rezza, G.; Brusaferro, S. Case-Fatality Rate and Characteristics of Patients Dying in Relation to COVID-19 in Italy. JAMA 2020, 323, 1775–1776. [Google Scholar] [CrossRef]
  58. Moghaddam Tabrizi, F.; Rasmi, Y.; Hosseinzadeh, E.; Rezaei, S.; Balvardi, M.; Kouchari, M.R.; Ebrahimi, G. Diabetes is associated with higher mortality and severity in hospitalized patients with COVID-19. EXCLI J. 2021, 20, 444–453. [Google Scholar] [PubMed]
  59. Barron, E.; Bakhai, C.; Kar, P.; Weaver, A.; Bradley, D.; Ismail, H.; Knighton, P.; Holman, N.; Khunti, K.; Sattar, N.; et al. Associations of type 1 and type 2 diabetes with COVID-19-related mortality in England: A whole-population study. Lancet Diabetes Endocrinol. 2020, 8, 813–822. [Google Scholar] [CrossRef] [PubMed]
  60. Vafea, M.T.; Traboulsi, C.; Stefanovic-Racic, M. Lower HbA1c is associated with lower in-hospital mortality in patients with COVID-19: A systematic review of the literature and meta-analysis. Endocr. Pract. 2023, 30, 70–77. [Google Scholar] [CrossRef]
Figure 1. PRISMA flow diagram showing the process of study selection.
Figure 1. PRISMA flow diagram showing the process of study selection.
Diseases 12 00187 g001
Table 1. Descriptive characteristics of the studies included.
Table 1. Descriptive characteristics of the studies included.
AuthorYearCountryType of StudyVPD ConsideredFollow-Up (Months)Total Sample Size% of FemalesMean AgeOutcomeConfounders Mentioned in the Multivariate Analysis (Number)
Bo-Lin Pan [35]2022ChinaProspective cohort studyHZ 72121,99946.360.4Incidence of HZAge, sex, comorbidities
(3)
Kobayashi D [33]2019JapanRetrospective longitudinal studyHZ13281,46651.346.5Incidence of HZAge, sex, time variable; social histories, including smoking status, alcohol consumption, BMI, and exercise habits; history of diabetes and its pharmacological treatment status, medical histories, including cancer, autoimmune disease, hemodialysis, and chronic hepatitis/cirrhosis
(13)
De Jong M [34]2021UKProspective cohort studyCOVID-19134501,88454Aged 40–69 years at baselineDeath from COVID-19Age, BMI, socioeconomic status, smoking, systolic blood pressure, total cholesterol, antihypertensivemedication, glucose-loweringmedication, lipid lowering medication
(9)
TOTAL Two prospective; one retrospective 113705,34954 Two: HZ; one: COVID-198
Table 2. Main findings of the studies included.
Table 2. Main findings of the studies included.
AuthorYearMain Findings
Bo-Lin Pan et al. [35]2022Four HbA1C trajectories were identified: ‘good control’ (mean HbA1C of 6.7% or 50 mmol/mol), ‘high decreasing’ (mean HbA1C of 7.9% or 63 mmol/mol), ‘moderate control’ (mean HbA1C of 8.4% or 68 mmol/mol), and ‘poor control’ (mean HbA1C of 10.7% or 93 mmol/mol). A significantly higher risk of HZ was observed in the ‘poor control’ trajectory with an HR = 1.44 (95% CI 1.26–1.64) after adjusting for confounders and comorbidities.
Kobayashi D [33]2019Individuals in the lowest HbA1c group (HbA1c of <5.0%) exhibited a significantly higher risk of developing HZ (OR 1.63; 95%CI: 1.07–2.48) compared with the reference group (HbA1c of 5.0–6.4%). Individuals in the highest HbA1c group (HbA1cof ≥ 9.5%) had a higher but nonsignificant risk than the reference group (OR 2.15; 95% CI, 0.67–6.94).
De Jong M [34]2021There was no association between higher levels of HbA1c and increased risk of COVID-19 or influenza/pneumonia death in women. On the contrary, compared with no diabetes, an HbA1c > 7.5% (58 mmol/mol) was associated with an increased risk of COVID-19 or influenza/pneumonia death in men.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

De Vita, E.; Limongi, F.; Veronese, N.; Di Gennaro, F.; Saracino, A.; Maggi, S. Association between Glycosylated Hemoglobin Levels and Vaccine Preventable Diseases: A Systematic Review. Diseases 2024, 12, 187. https://doi.org/10.3390/diseases12080187

AMA Style

De Vita E, Limongi F, Veronese N, Di Gennaro F, Saracino A, Maggi S. Association between Glycosylated Hemoglobin Levels and Vaccine Preventable Diseases: A Systematic Review. Diseases. 2024; 12(8):187. https://doi.org/10.3390/diseases12080187

Chicago/Turabian Style

De Vita, Elda, Federica Limongi, Nicola Veronese, Francesco Di Gennaro, Annalisa Saracino, and Stefania Maggi. 2024. "Association between Glycosylated Hemoglobin Levels and Vaccine Preventable Diseases: A Systematic Review" Diseases 12, no. 8: 187. https://doi.org/10.3390/diseases12080187

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop