Next Article in Journal
Mapping the Implementation Determinants of Second Dose Measles Vaccination in the World Health Organization African Region: A Rapid Review
Previous Article in Journal
Longitudinal Screening for Oral High-Risk Non-HPV16 and Non-HPV18 Strains of Human Papillomavirus Reveals Increasing Prevalence among Adult and Pediatric Biorepository Samples: A Pilot Study
Previous Article in Special Issue
Acceptance of the COVID-19 Vaccine by Prisoners and Staff in Spanish Prisons
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Vaccination Coverage of People Living with HIV: Before and after Interventional Action

by
Larissa Gerin
1,*,
Elucir Gir
2,
Lis Aparecida de Souza Neves
1,
Luzia Márcia Romanholi Passos
1,
Renato de Ávila Kfouri
3,
Bruno Spire
4 and
Renata Karina Reis
2
1
Epidemiological Surveillance Division, Ribeirão Preto Municipal Health Department, Ribeirão Preto 14015100, São Paulo, Brazil
2
Ribeirão Preto School of Nursing, University of São Paulo, Ribeirão Preto 14040902, São Paulo, Brazil
3
Brazilian Society of Immunization, São Paulo 01309902, São Paulo, Brazil
4
Inserm, IRD, SESSTIM, Sciences Economiques & Sociales de la Santé & Traitement de l’Information Médicale, ISSPAM, Aix Marseille University, 13385 Marseille, France
*
Author to whom correspondence should be addressed.
Vaccines 2024, 12(8), 897; https://doi.org/10.3390/vaccines12080897
Submission received: 5 July 2024 / Revised: 30 July 2024 / Accepted: 1 August 2024 / Published: 8 August 2024
(This article belongs to the Special Issue Vaccines and Vaccination: Feature Papers)

Abstract

:
This is a quasi-experimental study that assessed PLHIV vaccination coverage before and after health professionals participated in a training course on PLHIV immunization. The vaccination coverage of 645 PLHIV was assessed in the pre-intervention phase. The vaccine with the best coverage was diphtheria and tetanus (82.64%) and the one with the lowest rate of adequately vaccinated was measles, mumps, and rubella (38.27%). Individuals aged between 30 and 39 years had a 74.00% (1–0.26) lower chance of having the full vaccination schedule when compared to those aged between 10 and 19 years, and among those over 40 years, the chance was 87.00% (1–0.13) lower. Those who were vaccinated in Specialized Care Services (SCS) were 5.77 times more likely to be adequately vaccinated when compared to those who were vaccinated in other health services. Regarding the entire vaccination schedule evaluated, the number of adequately vaccinated increased from 47 (7.29%) to 76 (11.78%). Interventions targeting health professionals were effective in increasing vaccination coverage among PLHIV; however, the achieved coverage remained below the desired level. It is necessary to act on health professionals’ knowledge and other aspects to effectively increase vaccination coverage.

1. Introduction

With advances in immunization and improved hygiene and health conditions, a decrease in the number of infectious diseases has been observed; however, the reduction in vaccination coverage and population displacement in the globalized world pose a risk of the resurgence of diseases that have already been eliminated [1].
People living with HIV (PLHIV) have an increased risk of acquiring infectious diseases and, if they do, have a greater chance of developing into more severe forms [2,3,4,5,6,7].
On the other hand, with increased survival and reduced mortality due to adequate adherence to Antiretroviral Therapy (ART), they end up exposing themselves more to risk scenarios as they maintain work, travel, and leisure activities that put them in contact with potential pathogenic infectious agents. In addition, these individuals end up being more exposed as they are in frequent contact with health services [3,8,9,10].
Thus, preventing the occurrence of infectious diseases in PLHIV is a strategy to improve the quality of life and life expectancy. In this regard, immunization stands out, and a special vaccination schedule is recommended for these individuals [1,3,10,11,12].
In Brazil, the Unified Health System (UHS) offers 12 immunobiological agents to PLHIV free of charge through the National Immunization Program (NPI). The vaccination schedule for this group is broader than that offered to the general population. In addition, it is recommended that the vaccination schedule of household contacts of PLHIV and health professionals who provide care for this population be updated, which constitutes extra protection, especially for those with some contraindications to vaccination for having lower CD4 T-lymphocyte (TL) counts. It is recommended that the vaccination schedule be updated as early as possible before the disease progresses and the immune system becomes deficient [3,4,8,10,13,14,15,16].
Despite the importance of immunization, few studies have presented vaccination coverage for PLHIV. The majority of studies focus on the vaccination rate for a single vaccine type [2,6,17,18] or inactivated vaccines indicated for this population [1,5,7,9,12,13,19,20], rather than providing a comprehensive overview of vaccination coverage, including attenuated vaccines [3,15].
In a survey conducted in Germany on PLHIV aged at least 50 years, only 20% of the participants reported a completed schedule for the inactivated vaccines evaluated [9]. In an investigation conducted in Brazil regarding attenuated vaccines, it identified coverage of 14.14% [3]. In a retrospective cohort study conducted in the USA in which the schedule of eight vaccines indicated for PLHIV was evaluated, it was found that 41% of the participants were adequately vaccinated [19].
The data show that vaccination coverage among PLHIV is low and that there is no effective assessment of vaccination status in the services where these individuals are monitored. The main determinants of non-vaccination are failure to receive a recommendation from a health professional, lack of knowledge about the indicated vaccines and their schedules, difficulties in accessing immunizers, or simply forgetting appointment dates [1,2,3,4,5,6,7,9,11,12,13,15,21].
The set of aspects exposed reinforces the essential role of health professionals in the indication of immunizers, deconstruction of false contraindications, expansion of vaccine acceptance, and search for unvaccinated individuals to improve adequately vaccinated rates. In addition, the importance of medical professionals in vaccine indication and prescription is highlighted, which would significantly increase the search of individuals for immunobiological agents [3,4,6,7,9,12,13,21].
Given this scenario, this study aimed to evaluate the effectiveness of an interventional action in the vaccination coverage of PLHIV, considering the vaccines recommended by the Brazilian NIP.

2. Materials and Methods

2.1. Study Design and Site

The study was conducted in a Brazilian municipality with a population of about 711,000 inhabitants and a Human Development Index (HDI) of 0.800, which is considered high relative to the whole country. The municipality has a wide network, with 47 Primary Health Care Units (PHCU) (37 of them with vaccine rooms) and five Specialized Care Services (SCS), for outpatient clinical follow-up of PLHIV [22].
This is a quasi-experimental study conducted in three stages:
-
Pre-intervention phase—was developed using data obtained from the Information System for Notifiable Diseases (ISND), which is the national country’s HIV case notification system. These cases were then identified in the municipal outpatient follow-up system (Hygiaweb) in order to assess the records of vaccines administered and calculate vaccination coverage.
-
Intervention phase—a training course on immunization of PLHIV was offered to health professionals involved in vaccination actions in the public services of the municipality of the study and to SCS health professionals.
-
Post-intervention phase—one year after the start date of the training course in the intervention phase, data on vaccines administered to PLHIV were collected again, updating the information collected in the pre-intervention phase regarding vaccination coverage rates.

2.2. Population and Sample

In the pre-and post-intervention phases, the population consisted of all cases notified in the ISND between 2015 and 2020 of people aged at least 13 years who met the following inclusion criteria: being followed up at the SCS of the municipality with the last medical consultation less than 12 months before the start of data collection, residing in the municipality of the study, and having a diagnosis of HIV status up to 180 days from the date of notification. Individuals who died or were transferred to other services or municipalities were excluded.
In the intervention phase, the population consisted of 77 health professionals (nursing assistants, technicians, and nurses) who were working in the 38 public vaccine rooms of the municipality and the health professionals (nursing assistants, technicians, nurses, and doctors) of the five SCS. The professionals completed an online training course, with four modules and a total workload of 3 h, on issues related to PLHIV immunization.
The course was developed by the researcher, and before it was made available to the research subjects, it underwent a pilot evaluation by six professionals who tested its functionality.

2.3. Data Collection

In the pre-and post-intervention phases, data collection was performed on the REDCap platform using a form developed for this study. The form contained sociodemographic variables (sex, age, pregnancy, skin color, education, occupation, and health district of residence) and clinical-epidemiological variables (date and unit of notification, date of diagnosis of HIV infection, follow-up status, date of first and last medical consultation at the service, number of medical consultations, service that performs the follow-up, exposure category, social vulnerabilities, presence of other diseases, CD4 TL count, viral load quantification, use of ART, registered vaccines, and anti-HAV IgG and anti-HBs serology results), and was validated by four specialists and modified according to suggestions received.
Assessing the vaccination schedule is complex, as it requires verification of each vaccine received throughout life, and the schedules can be different if started before or after the diagnosis of HIV infection. In addition, it is necessary to assess susceptibility status in some cases in order to verify whether immunobiological agents are indicated. To ensure an accurate assessment of each individual’s vaccination status, data were collected by a professional with over 20 years of experience in the field.

2.4. Data Analysis

In the pre-and post-intervention phases, data were extracted from the REDCap (https://redcap.eerp.usp.br/, accessed on 26 July 2022) platform using a Microsoft Office Excel v. 2406 spreadsheet. After evaluation and correction of possible typing errors, the data were transported to the IBM® Statistical Package for the Social Sciences (SPSS®) Statistics version 25 and R i386 v.3.4.0 programs where the database was structured [23]. Data analysis was performed using descriptive statistics (mean and standard deviation for continuous variables) and proportions for categorical variables.
The comparison between the pre-and post-intervention phases was evaluated using McNemar’s test, with p-values < 0.05 considered statistically significant. A logistic regression model, using the Generalized Estimating Equations (GEE) method, was used to estimate the variables associated with an adequate vaccination schedule in the post-intervention phase, and the crude and adjusted odds ratio was calculated with 95% intervals for each variable and a significance level of 5%.
The outcome variable was the complete vaccination schedule according to the vaccination schedule recommended by the NIP (Table 1).

2.5. Ethical Aspects

The research project was submitted to the Research Project Evaluation Committee (RPEC) of the Municipal Health Department of the studied municipality and later to the Research Ethics Committee (REC) of the Ribeirão Preto Nursing School (RPNS) of the University of São Paulo (USP), obtaining a favorable opinion (REC consolidated opinion No. 4.782.341).

3. Results

In the pre-intervention phase, the records of 1688 PLHIV were evaluated. After analyzing the inclusion and exclusion criteria, the sample consisted of 645 individuals in the pre- and post-intervention phases, most of whom were male (83.41%), white (59.84%), and with education above high school (55.97%). The mean age was 32.06 years (SD ± 11.14), with the minimum age being 14 years and the maximum 72 years. The age group with the highest frequency was 20–29 years (45.89%) (Table 2).
For diphtheria and tetanus, hepatitis B, and hepatitis A vaccines, although the number of adequately vaccinated increased in the post-intervention phase, the increase was not statistically significant. In the pre-intervention phase, 533 (82.64%) PLHIV were adequately vaccinated against diphtheria and tetanus, 445 (75.30% of those with vaccination indications) against hepatitis B, and 143 (42.43% of those with vaccination indications) against hepatitis A. They were adequately vaccinated in the post-intervention phase: 539 (83.57%) against diphtheria and tetanus, 453 (76.65% of those with vaccine indications) against hepatitis B, and 151 (44.81% of those with vaccine indications) against hepatitis A. Individuals who were not susceptible to the disease were not considered for assessment of adequately vaccinated against hepatitis A and B (Table 3, Figure 1).
In the post-intervention evaluation where the information regarding the tests was updated, 471 (73.02%) individuals had reactive anti-HBs serology; however, for 32 (4.96%), there was no result of this test in the electronic medical record, despite being a recommended test for PLHIV. Regarding hepatitis A, 308 (47.75%) had reactive anti-HAV IgG and were, therefore, not susceptible to the disease without an indication for vaccination. For 112 (17.36%), there was no record of this test in the electronic medical record.
As for the 13-valent pneumococcal vaccine, in the post-intervention phase, 59 (22.43%) of the inadequately vaccinated became adequately vaccinated, and the coverage increased from 59.22% to 68.37%. For the 23-valent pneumococcal vaccine, the number of adequately vaccinated increased from 349 (54.11%) to 376 (58.29%). The number of adequately vaccinated with meningococcal C increased from 451 (69.92%) to 493 (76.43%). For the HPV vaccine, among those with an indication for vaccination according to the recommendation at the time of data collection, coverage increased from 57.02% to 62.55% (Table 3, Figure 1).
For attenuated vaccines, which are contraindicated in the presence of severe immunodepression, coverage of the measles/mumps/rubella vaccine (triple viral) increased from 38.27% to 39.69%, and for the yellow fever vaccine, coverage increased from 82.66% to 84.22% (Table 3, Figure 1). Individuals who had a last CD4 LT count of <200 cells/mm3 were excluded from the analysis in the post-intervention phase because they had contraindications for these vaccines.
Regarding the entire vaccination schedule evaluated according to the study proposal, the number of adequately vaccinated increased from 47 (7.29%) to 76 (11.78%) (Table 3, Figure 1).
In the multivariate analysis of factors associated with vaccination rates, the model results indicate that as age increases, the chance of having a complete vaccination schedule decreases. Individuals aged between 30 and 39 years had a 74.00% lower chance (adjusted OR 0.26 95% CI 0.09–0.74) of having a complete vaccination schedule when compared to those aged between 10 and 19 years, and among those over 40 years, this rate was 87.00% lower (adjusted OR 0.13 95% CI 0.03–0.50) (Table 4).
Individuals who were followed up at SCS 3 had a 67.00% (adjusted OR 0.32, 95% CI 0.11–0.91) lower chance of being adequately vaccinated when compared to individuals who were followed up at SCS 2. Those with good adherence to ART were 5.17 times (95% CI 1.16–22.97) more likely to have a complete vaccination schedule when compared to individuals who did not have good adherence. Those who were vaccinated in SCS were 5.76 (95% CI 1.65–20.19) times more likely to be adequately vaccinated when compared to those who were vaccinated in other health services (Table 4).
Individuals with some social vulnerability were 2.3 times (95% CI 1.06–4.99) more likely to be adequately vaccinated when compared to those with no identified vulnerability. In the assessment performed after the intervention phase, individuals were 1.72 (95% CI 1.39–2.13) times more likely to have the complete vaccination schedule when compared to the pre-intervention phase. There was no association between the complete vaccination schedule and the variables sex, skin color, CD4 TL count, and exposure category (Table 4).

4. Discussion

In this study, a very small proportion of PLHIV had an appropriate vaccination schedule according to the proposed assessment, both pre- and post-intervention, which reinforces that there is no effective assessment of the vaccination situation in the services that accompany PLHIV [12]. After offering a training course for health professionals from vaccination rooms and health services that accompany PLHIV, there was an improvement in vaccination coverage, but it still remained low.
Studies that analyze predominantly inactivated vaccines in the evaluation of the vaccination schedule of PLHIV present a higher rate of adequately vaccinated individuals [9,12,19]. In a study that included yellow fever and measles-mumps-rubella vaccines among the vaccines evaluated, only 14.1% of PLHIV were adequately vaccinated, a coverage close to that found in the evaluation performed after this study’s intervention phase [3].
Despite the risk of exposure to vaccine-preventable diseases, there is fear among both health professionals and PLHIV themselves regarding the safety of vaccine administration and the effectiveness of immunobiological agents in this population [2,24].
The vaccine with the best coverage was diphtheria and tetanus, as in other studies [5,9,12]. This vaccine has been part of the Brazilian immunization schedule for many years, is available in all vaccine rooms, and presents the same vaccination schedule for the entire population, with few contraindications, which perhaps provides teams with greater safety in administrating this immunobiological agent [12].
The hepatitis B vaccine is administered to people who have never been exposed to the virus or have received the vaccine. In our study, around 25% of the individuals eligible to receive the hepatitis B vaccine were not adequately vaccinated. Our findings are similar to the vaccination rates identified in some studies [3,9,15,20], while the number of people adequately immunized with the hepatitis B vaccine was lower in other reports [5,7,12,13,25]. In Brazil, the hepatitis B vaccine has been part of the national calendar since 1998; therefore, because this study population is mostly young, the rate of individuals without any dose of this vaccine was 2.48% in the post-intervention phase.
The increase in the rate of adequately vaccinated for diphtheria/tetanus and hepatitis B vaccines in the post-intervention phase of this study was small and not statistically significant, which can be explained by the fact that most individuals had already received the full course of these vaccines when they were diagnosed with HIV.
Among the inactive vaccines, the hepatitis A vaccine demonstrated the poorest coverage, even in the post-intervention phase, with an increase of only 3% in the number of individuals adequately vaccinated. Some studies have identified better vaccination rates against hepatitis A than our findings [7,9,20]. However, our coverage was higher than that reported in previous studies on PLHIV, in which vaccine hesitancy was identified as one of the factors for non-adherence to vaccination, in addition to low schooling and immunodepression [5,12,25].
Vaccine hesitancy is a complex and dynamic behavioral phenomenon that has been advancing worldwide. It is influenced by confidence in the safety and efficacy of vaccines, the low-risk perception of the population, and because the vaccine is often not available or affordable [26,27,28].
The vaccination coverage of the 13-valent pneumococcal vaccine was around 68% in the post-intervention phase, while that of the 23-valent was around 58%. Some studies identified higher coverage [9,13,20,29], while others identified lower coverage [3,12,15,25]. A study conducted in Germany revealed that 58.5% of the population had received both the 13-valent and 23-valent pneumococcal vaccines, while 11% had received only the 23-valent vaccine [1].
For the two pneumococcal vaccines indicated for PLHIV, there was a significant increase in the number of adequately vaccinated in the post-intervention phase, with 13-valent showing the greatest increase among the vaccines evaluated.
In an intervention carried out through the implementation of a hospital consultation to assess vaccination status in Spain, the coverage of the 13-valent pneumococcal vaccine increased from 2.9% to 88.0%, and the coverage of the 23-valent pneumococcal vaccine increased from 16.3% to 83.7% [18]. These data reinforce that actions aimed at increasing knowledge and, consequently, confidence in immunizers, targeting both health professionals and patients, have a positive impact on vaccination coverage.
Pneumococcal vaccines and hepatitis A vaccines are not available in vaccination rooms in the studied municipality and need to be requested by filling out a specific form addressed to the Special Immunobiological Agents Reference Center (SIARC). For some months during the study period, pneumococcal vaccines were available in vaccination rooms due to a temporary expansion of indications, which may have contributed to the increase in the number of adequately vaccinated.
The meningococcal C vaccine was the vaccine with a special indication that showed the best coverage in this study, with an increase of 6.51% of adequately vaccinated in the post-intervention phase. One of the factors that contributed to this rate is the fact that the immunobiological agent is available in vaccination rooms. Lower coverage of the meningococcal vaccine has been identified in other studies [9,12]. Vaccine hesitancy and the unavailability of the immunobiological agent in vaccination rooms contribute to low coverage [2,12,16,21,25,29].
Regarding the HPV vaccine, our study exhibited the most comprehensive coverage among the evaluated studies. Given the recent introduction of the vaccine in the medical landscape, vaccination coverage varies considerably across studies, contingent on the timeframe in which they were conducted. The importance of publicizing the necessity of this vaccine for PLHIV has been reinforced by researchers, given that the transmission route of HPV is the same as that of HIV. This publicizing is of particular significance to the population of men who have sex with men (MSM), given their elevated susceptibility to both acquiring the virus and developing persistent infections and malignant lesions [1,14,30,31,32].
On the other hand, the indication of different schemes for different age groups and constant changes in the vaccination scheme can be a factor that confuses teams and contributes to missed vaccination opportunities. Despite this, in the post-intervention phase, the number of adequately vaccinated showed an increase of about 6.00%, which reinforces that more trained teams regarding the indicated schemes favor the improvement in vaccination rates [6].
In order to assess the indication of attenuated vaccines for PLHIV, it is necessary to evaluate the value of the CD4 TL count since severely immunosuppressed individuals are temporarily contraindicated to receive these vaccines [4,14]. As this is a complex assessment and is not always possible, most studies assessing vaccination coverage do not include the evaluation of attenuated vaccines.
Studies have shown that a large number of PLHIV lack immunity against measles, mumps, and rubella and have reinforced the risk of immunity loss over the years [33,34,35,36,37].
In this study, the measles-mumps-rubella vaccine was the one with the worst coverage among the vaccines evaluated, with a small increase in adequately vaccinated individuals in the post-intervention phase despite the low number of individuals with contraindications. In another study conducted in Brazil, 83.8% of PLHIV had not received any dose of measles, mumps, or rubella vaccine [3]. It is important to ensure a complete vaccination schedule to correct possible vaccine failures and maintain seroconversion.
As the yellow fever vaccine has been part of the vaccination schedule of the studied municipality for many years, due to the fact that it is considered a risk area for the disease, this vaccine coverage was around 84% in the post-intervention phase. Most likely, most of these individuals were already adequately vaccinated before the diagnosis of HIV infection. In addition, the yellow fever vaccination schedule for PLHIV without severe immunodepression does not differ from the schedule indicated for the general population, which is not the case for measles, mumps, and rubella vaccines.
Some authors suggest that vaccination with PLHIV be delayed until the immune system is rebuilt, which would ensure a better response and lower the risk of events supposedly attributable to vaccination or immunization (ESAVI). Although the administration of some vaccines may generate a transient increase in viral load, these events do not present clinical significance, and their risk cannot prevent vaccination [4,9,11,12,15,19,28,38,39].
In this study, individuals with good adherence to ART had a greater chance of being adequately vaccinated, which may indicate better self-care and, in addition, greater confidence on the part of the team in indicating and administering vaccines in this population.
Even if the response to vaccination is reduced for individuals with uncontrolled viral replication or lower CD4 TL counts, it is recommended that the vaccination schedule be updated as soon as possible, taking into account contraindications to attenuated vaccines, without the need for intervals between vaccine administration and test collection [4,9,11,14,38]. A positive approach by the healthcare team in this regard would reduce the number of non-vaccinated [35].
Most of the individuals evaluated in this study were vaccinated in the SCS, which reinforces that having a vaccine room in the services where the individual performs the follow-up facilitates access and increases adherence, and the teams that work in the vaccine rooms of the SCS may be more prepared and safer to administer vaccines to PLHIV [12,15,21].
The assessment of vaccination status and guidance on immunization should be part of the medical consultation, with the prescription of vaccines included in the routine of care, and, in addition, be the practice of various health professionals who assist PLHIV in different services [2,3,6,7,12,13,21,24,40,41].
It is necessary to verify that the individuals referred for vaccination have actually carried out the procedure, and if they do not appear in the vaccination room or delay the completion of the vaccination schedule, it is extremely important to actively search for these individuals.
For PLHIV, the evolution of vaccine-preventable diseases may be more severe, and vaccine immunogenicity may be lower, with shorter protection time when compared to people not living with HIV. For this reason, active surveillance of vaccination status is important. In addition, managers need to know the reasons for non-vaccination and develop strategies to combat vaccine hesitancy and improve vaccination rates [6,16,42,43,44,45,46,47,48].
Some limitations should be considered when analyzing these findings, as this study evaluated secondary data through information systems. Without access to individuals, it was not possible to evaluate their vaccination records. Despite the guidance that all vaccination history should be recorded in the system, it is possible that for some individuals, the doses received in other municipalities have not been recorded. The importance of future studies that perform this evaluation with subjects is reinforced. Despite this limitation, this study makes an important contribution to understanding the low vaccination coverage in PLHIV.

5. Conclusions

In recent years, Brazil has experienced a drop in vaccination coverage, the causes of which are multifactorial. Intervening in the knowledge of health professionals regarding issues related to the vaccination of PLHIV has enabled an increase in vaccination coverage among this population, but coverage has still remained low.
This study’s findings demonstrate the need to develop measures to improve vaccination rates in populations at a higher risk for vaccine-preventable diseases. Health professionals play a key role in identifying unvaccinated individuals. By recommending vaccination and combating false contraindications, they increase the likelihood that individuals will seek immunization services.
In order to achieve the desired vaccination coverage rates, in addition to the knowledge of health professionals, it is necessary to act on other factors, such as immunobiological agent availability in the services where PLHIV is monitored. It is also necessary for health managers to invest in addressing vaccine hesitancy.
Improvements in the completeness of vaccination schedules would be enhanced by the introduction of an immunization program in the place where clinical follow-up is carried out. This program could adopt an individualized approach, with doctors and nurses assessing vaccination status, providing advice on the vaccines indicated, prescribing the necessary vaccines, and administering them in the same facility.

Author Contributions

Conceptualization, L.G. and R.K.R.; methodology, L.G. and R.K.R.; formal analysis, L.G., E.G., L.A.d.S.N., L.M.R.P., R.d.Á.K., B.S. and R.K.R.; investigation, L.G.; resources, L.G.; data curation, L.G.; writing—original draft preparation L.G., E.G., L.A.d.S.N., L.M.R.P., R.d.Á.K., B.S. and R.K.R.; writing—review and editing, L.G., E.G., L.A.d.S.N., L.M.R.P., R.d.Á.K., B.S. and R.K.R. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Research Ethics Committee (REC) of Ribeirão Preto Nursing School (RPNS) of the USP (REC substantiated opinion no. 4.782.341 approved in 15 June 2021).

Informed Consent Statement

Patient consent was waived because data collection took place in information systems without direct contact with patients and was authorized by the Research Ethics Committee.

Data Availability Statement

Data from this study can be made available upon request.

Acknowledgments

We thank Miyeko Hayashida and Jonas Bodini Alonso for their advice on the statistical analysis.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Breitschwerdt, S.; Schwarze-Zander, C.; Tayy, A.A.; Mutevelli, J.; Wasmuth, J.C.; Rockstroh, J.K.; Boesecke, C. Implementation of EACS vaccination recommendations among people living with HIV. Infection 2022, 50, 1491–1497. [Google Scholar] [CrossRef] [PubMed]
  2. Harrison, N.; Poeppl, W.; Herkner, H.; Tillhof, K.D.; Grabmeier-Pfistershammer, K.; Rieger, A.; Forstner, C.; Burgmann, H.; Lagler, H. Predictors for and coverage of influenza vaccination among HIV-positive patients: A cross-sectional survey. HIV Med. 2017, 18, 500–506. [Google Scholar] [CrossRef] [PubMed]
  3. Cunha, G.H.; Galvão, M.T.G.; Medeiros, C.M.; Rocha, R.P.; Lima, M.A.C.; Fechine, F.V. Vaccination status of people living with HIV/AIDS in outpatient care in Fortaleza, Ceará, Brazil. Braz. J. Infect. Dis. 2016, 20, 487–493. [Google Scholar] [CrossRef] [PubMed]
  4. Imaz, A.; Masuet, C. Vaccination coverage for people living with HIV: A key intervention that should be improved. Enfermedades Infecc. Y Microbiol. Clin. 2023, 41, 141–143. [Google Scholar] [CrossRef]
  5. Jilich, D.; Malý, M.; Fleischhans, L.; Kulířová, V.; Machala, L. Cross-sectional study on vaccination coverage in newly diagnosed HIV-infected persons in the Czech Republic. Cent. Eur. J. Public Health 2019, 27, 217–222. [Google Scholar] [CrossRef] [PubMed]
  6. Kojic, E.M.; Rana, A.I.; Cu-Uvin, S. Human papillomavirus vaccination in HIV-infected women: Need for increased coverage. Expert Rev. Vaccines 2016, 15, 105–117. [Google Scholar] [CrossRef] [PubMed]
  7. Valour, F.; Cotte, L.; Voirin, N.; Godinot, M.; Ader, F.; Ferry, T.; Vanhems, P.; Chidiac, C. Vaccination coverage against hepatitis A and B viruses, Streptococcus pneumoniae, seasonal flu, and A(H1N1)2009 pandemic influenza in HIV-infected patients. Vaccine 2014, 32, 4558–4564. [Google Scholar] [CrossRef] [PubMed]
  8. Brasil Ministério da Saúde; Secretaria de Vigilância em Saúde; Departamento de Vigilância, Prevenção e Controle das Infecções Sexualmente Transmissíveis, do HIV/Aids e das Hepatites Virais. Protocolo Clínico e Diretrizes Terapêuticas para Manejo da Infecção pelo HIV em Adultos. Brazil. 2018. Available online: http://www.aids.gov.br/pt-br/pub/2013/protocolo-clinico-e-diretrizes-terapeuticas-para-manejo-da-infeccao-pelo-hiv-em-adultos (accessed on 4 September 2019).
  9. Drewes, J.; Langer, P.C.; Ebert, J.; Kleiber, D.; Guys, B. Sociodemographic, HIV-Related Characteristics, and Health Care Factors as Predictors of Self-Reported Vaccination Coverage in a Nationwide Sample of People Aging with HIV in Germany. Int. J. Environ. Res. Public Health 2021, 18, 4901. [Google Scholar] [CrossRef] [PubMed]
  10. Sociedade Brasileira de Imunizações/Sociedade Brasileira de Infectologia. HIV/AIDS—Guia de Imunização SBIm/SBI. Brazil. 2016. Available online: https://sbim.org.br/publicacoes/guias/567-guia-de-imunizacao-sbim-sbi-hiv-aids-2016-2017 (accessed on 8 July 2022).
  11. Chaer, F.; Sahly, H.M. Vaccination in the adult patient infected with HIV: A review of vaccine efficacy and immunogenicity. Am. J. Med. 2019, 132, 437–446. [Google Scholar] [CrossRef]
  12. Neto, L.F.S.P.; Vieira, J.V.; Ronchi, N.R. Vaccination coverage in a cohort of HIV—Infected patients receiving a care at an AIDS outpatient clinic in Espírito Santo, Brazil. Braz. J. Infect. Dis. 2017, 21, 515–519. [Google Scholar] [CrossRef]
  13. Boey, L.; Bosmans, E.; Ferreira, L.B.; Heyvaert, N.; Nelen, M.; Smans, L.; Tuerlinckx, H.; Roelants, M.; Claes, K.; Derdelinckx, I.; et al. Vaccination coverage of recommended vaccines and determinants of vaccination in at-risk groups. Hum. Vaccin. Immunother. 2020, 16, 2136–2143. [Google Scholar] [CrossRef]
  14. Brasil Ministério da Saúde; Secretaria de Vigilância em Saúde. Departamento de Imunização e Doenças Transmissíveis. Manual dos Centros de Referência para Imunobiológicos Especiais. Brazil. 2019. Available online: https://bvsms.saude.gov.br/bvs/publicacoes/manual_centros_imunobiologicos_especiais_5ed.pdf (accessed on 2 May 2018).
  15. Ho, Y.L.; Enohata, T.; Lopes, M.H.; Santos, S.S. Vaccination in Brazilian HIV-Infected Adults: A Cross-Sectional Study. AIDS Patient Care STDs 2008, 22, 65–70. [Google Scholar] [CrossRef]
  16. Crum-Cianflone, N.F.; Wallace, M.R. Vaccination in HIV-infected adults. AIDS Patient Care STDS 2014, 28, 397–410. [Google Scholar] [CrossRef] [PubMed]
  17. Burns, C.M.; Banks, R.E.; Wilson, B.M.; Carter, R.R.; Jump, R.L.P.; Perez, F. A virtual clinic improves pneumococcal vaccination coverage among patients living with HIV at a Veterans Affairs Medical Center. AIDS Care 2018, 30, 146–149. [Google Scholar] [CrossRef]
  18. Hernández-García, I.; Román-Calderón, F.; López-Mendoza, H.; Aibar-Remón, C.; Grupo de Trabajo en vacunas HCULB. Evaluación del impacto de una intervención para mejorar las coberturas de vacunación frente a neumococo en pacientes con VIH [Impact of an intervention to improve the vaccination coverage against Streptococcus pneumoniae in HIV patients]. Rev. Esp. Salud Publica 2019, 93, e201912114. [Google Scholar]
  19. Johnson, T.M.; Klepser, D.G.; Bares, S.H.; Scarsi, K.K. Predictors of vaccination rates in people living with HIV followed at a specialty care clinic. Hum. Vaccin. Immunother. 2021, 17, 791–796. [Google Scholar] [CrossRef]
  20. Tsachouridou, O.; Georgeou, A.; Naoum, S.; Vasdeki, D.; Papagianni, M.; Kotoreni, G.; Forozidou, E.; Tsoukra, P.; Gogou, C.; Chatzidimitriou, D.; et al. Factors associated with poor adherence to vaccination against hepatitis viruses, Streptococcus pneumoniae and seasonal influenza in HIV-infected adults. Hum. Vaccin. Immunother. 2019, 15, 295–304. [Google Scholar] [CrossRef]
  21. Parmejani, P.D.S.S.; Picone, C.M.; Alves, A.P.P.D.S.; Sartori, A.M.C.; Ibrahim, K.Y. Facilitating access to pneumococcal vaccine for people living with HIV: An experience report. Rev. Esc. Enferm. USP 2023, 56, e20210563. [Google Scholar] [CrossRef]
  22. Preto, R.; Secretaria Municipal da Saúde de Ribeirão Preto. Plano Municipal de Saúde de Ribeirão Preto 2022–2025. Ribeirão Preto, São Paulo, Brazil. 2021. Available online: https://www.ribeiraopreto.sp.gov.br/portal/pdf/saude171202306.pdf (accessed on 6 July 2022).
  23. R Core Team. R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2022; Available online: http://www.R-project.org/ (accessed on 23 December 2022).
  24. Gerin, L.; Antonini, M.; Santos, K.S.; Gir, E.; Reis, R.K. O conhecimento dos profissionais de saúde sobre vacinação de pessoas vivendo com HIV—Uma revisão integrativa. Esc. Anna. Nery 2022, 26, e20210210. [Google Scholar] [CrossRef]
  25. Gagneux-Brunon, A.; Fresard, A.; Lucht, F.; Botelho-Nevers, E. Vaccine coverage in PLWH: Disparities and potential impact of vaccine hesitancy. Hum. Vaccin. Immunother. 2019, 15, 305–306. [Google Scholar] [CrossRef]
  26. Brewer, N.T. What Works to Increase Vaccination Uptake. Acad. Pediatr. 2021, 21, S9–S16. [Google Scholar] [CrossRef] [PubMed]
  27. Oduwole, E.O.; Pienaar, E.D.; Mahomed, H.; Wiysonge, C.S. Overview of Tools and Measures Investigating Vaccine Hesitancy in a Ten Year Period: A Scoping Review. Vaccines 2022, 10, 1198. [Google Scholar] [CrossRef] [PubMed]
  28. Sato, A.P.S.S. What is the importance of vaccine hesitancy in the drop of vaccination coverage in Brazil? Rev. Saúde Pública 2018, 52, 96. [Google Scholar] [CrossRef] [PubMed]
  29. Kopp, A.; Mangin, O.; Gantzer, L.; Lekens, B.; Simoneau, G.; Ravelomanantsoa, M.; Evans, J.; Bergmann, J.F.; Sellier, P. Pneumococcal vaccination coverage in France by general practitioners in adults with a high risk of pneumococcal disease. Hum. Vaccin. Immunother. 2021, 17, 162–169. [Google Scholar] [CrossRef] [PubMed]
  30. McClung, N.; Burnett, J.; Wejnert, C.; Markowitz, L.E.; Meites, E.; Study Group NHBS. Human papillomavirus vaccination coverage among men who have sex with men-National HIV Behavioral Surveillance, United States, 2017. Vaccine 2020, 38, 7417–7421. [Google Scholar] [CrossRef] [PubMed]
  31. Pimenta, P.C.; Bani, G.M.A.C.; Júlio, R.S. Cobertura Vacinal de HPV em Pessoas Vivendo com HIV/Aids. 2020. Trabalho de Conclusão de Curso (Biomedicina)—Centro Universitário do Sul de Minas, Varginha, Minas Gerais, Brazil. 2020. Available online: http://repositorio.unis.edu.br/bitstream/prefix/1438/1/poliana.pdf (accessed on 30 July 2022).
  32. Santos, J.G.C.; Dias, J.M.G. Vacinação pública contra o papilomavírus humano no Brasil. Rev. Med. Minas Gerais 2018, 28, e-1982. [Google Scholar] [CrossRef]
  33. Crum, N.F.; Ahmad, A. Immunity against measles in people with HIV: The need for more research and surveillance. AIDS 2022, 36, 1305–1306. [Google Scholar] [CrossRef] [PubMed]
  34. Dauby, N.; Martin, C.; Hainaut, M.; Grammens, T.; Van den Wijngaert, S.; Delforge, M.; De Wilt, S. Prevalence and risk factors of measles seronegativity in a cohort of HIV-positive subjects: A retrospective study. HIV Med. 2018, 19, 426–429. [Google Scholar] [CrossRef]
  35. Grabmeier-Pfistershammer, K.; Poeppl, W.; Herkner, H.; Touzeau-Roemer, V.; Huschka, E.; Rieger, A.; Burgmann, H. High need for MMR vaccination in HIV infected adults in Austria. Vaccine 2014, 32, 6020–6023. [Google Scholar] [CrossRef] [PubMed]
  36. Lefebvre, M.; Secher, S.; Bouchez, S.; Vandamme, Y.M.; Fialaire, P.; Leautez, S.; Blanchi, S.; Michau, C.; Coste-Burel, M.; Brunet-Cartier, C.; et al. Measles seroprevalence in human immunodeficiency virus-infected adults born in the era of measles vaccination. AIDS 2022, 36, 1273–1278. [Google Scholar] [CrossRef]
  37. Rearigh, L.; O’Neill, J.; Kubat, M.; Sayles, H.; Swindells, S.; Bares, S.H. Surprisingly Low Levels of Measles Immunity in Persons With HIV: A Seroprevalence Survey in a United States HIV Clinic. Open Forum Infect. Dis. 2020, 7, ofaa428. [Google Scholar] [CrossRef] [PubMed]
  38. Frésard, A.; Gagneux-Brunon, A.; Lucht, F.; Botelho-Nevers, E.; Launay, O. Immunization of HIV-infected adult patients—French recommendations. Hum. Vaccin. Immunother. 2016, 12, 2729–2741. [Google Scholar] [CrossRef] [PubMed]
  39. Sweileh, W.M. Bibliometric analysis of global scientific literature on vaccine hesitancy in peer-reviewed journals (1990–2019). BMC Public Health 2020, 20, 1252. [Google Scholar] [CrossRef] [PubMed]
  40. Blackwell, C.W. Knowledge of Vaccination Needs of HIV-Infected Men Who Have Sex with Men in a National Sample of “Gay Friendly” Health care Providers. Public Health Nurs. 2016, 33, 403–411. [Google Scholar] [CrossRef] [PubMed]
  41. Grace, D.; Gaspar, M.; Paquette, R.; Rosenes, R.; Burchell, A.N.; Grennan, T.; Salit, I.E. HIV-positive gay men’s knowledge and perceptions of Human Papillomavirus (HPV) and HPV vaccination: A qualitative study. PLoS ONE 2018, 13, e0207953. [Google Scholar] [CrossRef] [PubMed]
  42. Bertolini, D.V.; Costa, L.S.; Heijden, I.M.; Sato, H.K.; Marques, H.S. Immunogenicity of a meningococcal serogroup C conjugate vaccine in HIV-infected children, adolescents, and young adults. Vaccine 2012, 30, 5482–5486. [Google Scholar] [CrossRef] [PubMed]
  43. Dubey, H.; Oster, P.; Fazeli, M.S.; Guedes, S.; Serafini, P.; Leung, L.; Amiche, A. Risk Factors for Contracting Invasive Meningococcal Disease and Related Mortality: A Systematic Literature Review and Meta-analysis. Int. J. Infect. Dis. 2022, 119, 1–9. [Google Scholar] [CrossRef] [PubMed]
  44. Nichols, J.; Eppes, S. Meningococcal Vaccination: An Update on Meningococcal Vaccine Recommendations for the Primary Care Physician. Dela J. Public Health 2022, 8, 76–78. [Google Scholar] [CrossRef] [PubMed]
  45. Nolte, F.; Pacchiotti, A.; Castellano, V.; Lamy, P.; Gentile, A. Reticencia a la vacunación: Abordaje de su complejidad. Rev. Hosp. Niños B Aires 2018, 60, 16–22. Available online: https://pesquisa.bvsalud.org/portal/resource/pt/biblio-1103478 (accessed on 15 January 2021).
  46. Thornton, A.C.; Jose, S.; Bhagani, S.; Chadwick, D.; Dunn, D.; Gilson, R.; Main, J.; Nelson, M.; Rodger, A.; Taylor, C.; et al. Hepatitis B, hepatitis C, and mortality among HIV-positive individuals. AIDS 2017, 31, 2525–2532. [Google Scholar] [CrossRef]
  47. Umutesi, J.; Simmons, B.; Makuza, J.D.; Dushimiyimana, D.; Mbituyumuremyi, A.; Uwimana, J.M.; Ford, N.; Mills, E.J.; Nsanzimana, S. Prevalence of hepatitis B and C infection in persons living with HIV enrolled in care in Rwanda. BMC Infect. Dis. 2017, 17, 315. [Google Scholar] [CrossRef] [PubMed]
  48. Vargas, J.I.; Jensen, D.; Martínez, F.; Sarmiento, V.; Peirano, F.; Acuña, P.; Provoste, F.; Bustos, V.; Cornejo, F.; Fuster, A.; et al. Comparative Efficacy of a High-Dose vs Standard-Dose Hepatitis B Revaccination Schedule Among Patients WITH HIV: A Randomized Clinical Trial. JAMA Netw. Open 2021, 4, e2120929. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Vaccination coverage by vaccine and schedule were evaluated before and after the intervention. * p < 0.005; Adult double vaccine (diphtheria and tetanus); HPV—human papilloma virus; MenC—meningococcal C; P23—23-valent pneumococcal; P13—13-valent pneumococcal; YF—yellow fever; MMR—measles/mumps/rubella.
Figure 1. Vaccination coverage by vaccine and schedule were evaluated before and after the intervention. * p < 0.005; Adult double vaccine (diphtheria and tetanus); HPV—human papilloma virus; MenC—meningococcal C; P23—23-valent pneumococcal; P13—13-valent pneumococcal; YF—yellow fever; MMR—measles/mumps/rubella.
Vaccines 12 00897 g001
Table 1. Vaccines included in the evaluation of the complete vaccination schedule according to the recommendations of the National Immunization Program (NIP) at the time of the study.
Table 1. Vaccines included in the evaluation of the complete vaccination schedule according to the recommendations of the National Immunization Program (NIP) at the time of the study.
VaccineRecommended Schedule Schedule Considered
Adult double (diphtheria/tetanus)Three doses and boosters every 10 yearsComplete or in progress without delays
Hepatitis BThree doses (before diagnosis)
Four doses with double dose (after diagnosis)
(for susceptibles)
Complete or in progress without delay
Hepatitis ATwo doses
(for susceptible)
Complete or in progress without delay
Viral triple (measles, mumps, rubella)Two dosesComplete or in progress without delay
Yellow feverSingle dose from 5 years of age or two dosesComplete or in progress without delay
Pneumococcal 23-valentTwo doses1 dose
Pneumococcal 13-valentSingle dose1 dose
Meningococcal CTwo doses and booster every 5 yearsComplete or in progress without delay
HPVThree doses (men aged 9–26 and women aged 9–45) Complete or in progress without delay
Source: [15]. The pre-intervention phase started on 1 August 2021, and the vaccination schedule indicated by the NIP until this date was considered in the evaluation, without incorporating subsequent updates.
Table 2. Distribution of people living with HIV/AIDS according to sociodemographic variables.
Table 2. Distribution of people living with HIV/AIDS according to sociodemographic variables.
Sociodemographic VariablesParticipants
n%
Sex
Male53883.41
Female10716.59
Skin color
White38659.84
Black6510.08
Yellow30.47
Brown16926.20
Ignored223.41
Level of education
Illiterate or incomplete primary education132.02
Complete primary school6910.70
Complete elementary school9715.04
Complete high school27843.10
Complete higher education8312.87
Ignored10516.28
Age group (years)
13 to 19396.05
20 to 2929645.89
30 to 3917326.82
40 to 497411.47
50 to 59456.98
60 or more182.79
Table 3. Registered vaccination schedules for people living with HIV/AIDS in the pre- and post-intervention phases.
Table 3. Registered vaccination schedules for people living with HIV/AIDS in the pre- and post-intervention phases.
Study VariablesNumber of Participants with an Indication for the VaccinePre-InterventionPost-Interventionp-Value
n%CompleteIncompleteCompleteIncomplete
Adult double vaccine6451005331125391060.480
Hepatitis B59091.474451454531370.341
Hepatitis A 33551.941421931501850.118
13-valent pneumococcal645100382263441204<0.001
23-valent pneumococcal6451003492963762690.040
Meningococcal C645100451194493452<0.001
HPV23436.28134100147870.002
MMR63598.452433922523830.016
Yellow Fever 64099.225291115391010.004
Vaccination schedule6451004859775570<0.001
Adult double vaccine (diphtheria and tetanus); HPV—human papillomavirus; MMR—measles/mumps/rubella. Bolded values are significant at 0.05 level.
Table 4. Multivariate analysis of factors associated with vaccination coverage of people living with HIV/AIDS.
Table 4. Multivariate analysis of factors associated with vaccination coverage of people living with HIV/AIDS.
Study VariablesNumber of ParticipantsCrude OR
(95% CI)
p-ValueAdjusted OR
(95% CI)
p-Value
n%
Sex
Male53883.41REF REF
Female10716.590.16 (0.05–0.55)0.0040.44 (0.12–1.55)0.201
Skin color
White38659.84REF REF
Black6510.080.36 (0.1–1.23)0.1030.47 (0.14–1.65)0.241
Mixed race/Asian17226.670.99 (0.56–1.73)0.9631.03 (0.56–1.89)0.927
Age group (years)
13 to 19396.05REF REF
20 to 2929645.890.67 (0.31–1.45)0.3070.56 (0.23–1.34)0.193
30 to 3917326.820.27 (0.11–0.69)0.0060.26 (0.09–0.74)0.011
40 and over13721.240.1 (0.003–0.37)0.0010.13 (0.03–0.51)0.003
Exposure category
Non-heterosexual39761.55REF REF
Heterossexual22334.570.22 (0.1–0.47)0.0010.53 (0.23–1.22)0.134
Unit where follow-up is carried out
Specialized Care Service 2 §19029.46REF REF
Specialized Care Service 1 12419.220.47 (0.2–1.08)0.0750.44(0.19–1.01)0.052
Specialized Care Service 3 9815.200.29 (0.11–0.82)0.0190.33 (0.12–0.91)0.033
Specialized Care Service 4 10916.901.12 (0.57–2.2)0.7461.24 (0.62–2.51)0.542
Specialized Care Service 5 12419.220.86 (0.43–1.73)0.6761.23 (0.58–2.59)0.591
CD4 T-lymphocyte count (cells/mm3)
All > 35011517.83REF REF
Some < 2009614.880.34 (0.14–0.78)0.0110.64 (0.27–1.49)0.296
Some between 200 and 350 (none < 200)43367.130.71 (0.33–1.52)0.3730.86 (0.41–1.84)0.704
Use of Antiretroviral Therapy
No10416.2REF REF
Yes53983.27.64 (1.72–34.02)0.0085.17 (1.17–22.97)0.031
Vaccine room where patients received the last dose of vaccine
Other units10516.28REF REF
Specialized Care Service54083.726.59 (1.92–22.68)0.0035.77 (1.65–20.19)0.006
Social Vulnerability
No48975.81REF REF
Yes15624.192.3 (1.09–4.85)0.0292.3 (1.06–4.99)0.034
Complete vaccination schedule
Pre-intervention phase477.29REF REF
Post-intervention phase7611.781.62 (1.33–1.96)0.0011.72 (1.39–2.13)0.001
Reference group; Data such as “unknown”, “examination not available”, “no information” were not taken into account for statistical processing; § Specialized Care Service, which had a vaccine room; Specialized Care Services, which operated in the same facility of basic units with vaccine rooms; Specialized Care Service, which did not have a vaccine room in the facility. Bolded values are significant at 0.05 level.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Gerin, L.; Gir, E.; Neves, L.A.d.S.; Passos, L.M.R.; Kfouri, R.d.Á.; Spire, B.; Reis, R.K. Vaccination Coverage of People Living with HIV: Before and after Interventional Action. Vaccines 2024, 12, 897. https://doi.org/10.3390/vaccines12080897

AMA Style

Gerin L, Gir E, Neves LAdS, Passos LMR, Kfouri RdÁ, Spire B, Reis RK. Vaccination Coverage of People Living with HIV: Before and after Interventional Action. Vaccines. 2024; 12(8):897. https://doi.org/10.3390/vaccines12080897

Chicago/Turabian Style

Gerin, Larissa, Elucir Gir, Lis Aparecida de Souza Neves, Luzia Márcia Romanholi Passos, Renato de Ávila Kfouri, Bruno Spire, and Renata Karina Reis. 2024. "Vaccination Coverage of People Living with HIV: Before and after Interventional Action" Vaccines 12, no. 8: 897. https://doi.org/10.3390/vaccines12080897

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop