Next Article in Journal
Exploring Sea Lice Vaccines against Early Stages of Infestation in Atlantic Salmon (Salmo salar)
Next Article in Special Issue
Assessment of Crosslinkers between Peptide Antigen and Carrier Protein for Fusion Peptide-Directed Vaccines against HIV-1
Previous Article in Journal
Predictors of Willingness of the General Public to Receive a Second COVID-19 Booster Dose or a New COVID-19 Vaccine: A Cross-Sectional Study in Greece
Previous Article in Special Issue
Antiviral Activities of HIV-1-Specific Human Broadly Neutralizing Antibodies Are Isotype-Dependent
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Vaccine-Induced Seroreactivity Impacts the Accuracy of HIV Testing Algorithms in Sub-Saharan Africa: An Exploratory Study

1
Department of Microbiology and Immunology, Muhimbili University of Health and Allied Sciences, Dar es Salaam P.O. Box 65001, Tanzania
2
Division of Clinical Microbiology, Department of Laboratory Medicine, Karolinska Institutet, 17177 Stockholm, Sweden
3
Faculdade de Medicina, Universidade Eduardo Mondlane, Maputo P.O. Box 257, Mozambique
4
School of Medical Sciences, Örebro University, 70182 Örebro, Sweden
5
Instituto Nacional de Saúde, Maputo P.O. Box 3943, Mozambique
6
Public Health Agency of Sweden, 17182 Solna, Sweden
*
Author to whom correspondence should be addressed.
Vaccines 2022, 10(7), 1062; https://doi.org/10.3390/vaccines10071062
Submission received: 19 May 2022 / Revised: 21 June 2022 / Accepted: 22 June 2022 / Published: 1 July 2022

Abstract

:
The detection of vaccine-induced HIV antibody responses by rapid diagnostic tests (RDTs) may confound the interpretation of HIV testing results. We assessed the impact of vaccine-induced seroreactivity (VISR) on the diagnosis of HIV in sub-Saharan Africa. Samples collected from healthy participants of HIVIS and TaMoVac HIV vaccine trials after the final vaccination were analyzed for VISR using HIV testing algorithms used in Mozambique and Tanzania that employ two sequential RDTs. The samples were also tested for VISR using Enzygnost HIV Integral 4 ELISA and HIV western blot assays. Antibody titers to subtype C gp140 were determined using an in-house enzyme-linked immunosorbent assay (ELISA). The frequency of VISR was 93.4% (128/137) by Enzygnost HIV Integral 4 ELISA, and 66.4% (91/137) by western blot assay (WHO interpretation). The proportion of vaccine recipients that would have been misdiagnosed as HIV-positive in Mozambique was half of that in Tanzania: 26.3% (36/137) and 54.0% (74/137), respectively, p < 0.0001. In conclusion, the HIV RDTs and algorithms assessed here will potentially misclassify a large proportion of the HIV vaccine recipients if no other test is used. Increased efforts are needed to develop differential serological or molecular tools for use at the point of care.

1. Introduction

Substantial gains have been made in the fight against human immunodeficiency virus (HIV) infection. At the end of 2020, more people living with HIV than ever before were aware of their HIV status (84%), were accessing treatment (73%), and were virally suppressed (66%). Additionally, the number of new HIV infections and AIDS-related deaths worldwide fell by 31% and 47%, respectively, since 2010 [1]. In spite of this remarkable progress, the number of people who acquired HIV in 2020 was three times higher than the global target of having less than 500,000 new HIV infections by the end of 2020. A majority of the new infections occurred in sub-Saharan Africa, where HIV-1 subtype C is predominant [1].
A vaccine is needed to halt HIV transmission [2]. However, after more than 30 years of rigorous research, a safe and effective vaccine against HIV still eludes us [3]. The RV144 regimen remains the only HIV vaccine candidate to demonstrate evidence of protection against HIV. A modest vaccine efficacy of 31.2% was seen three and a half years after vaccination in low-risk volunteers primed with a canarypox vector, ALVAC-HIV (vCP1521) expressing gag, pro, envelope (Env) gp41 and gp120, and boosted with alum-adjuvanted bivalent HIV gp120 [4]. However, this efficacy was not replicated when the RV144 regimen was adapted to subtype C [5]. Additionally, mosaic immunogens that are expressed in adenovirus vectors and boosted with clade C gp140 (the HVTN 705 study) also failed to generate sufficient efficacy to protect high-risk women in sub-Saharan Africa from HIV infection. The HVTN 705 regimen had an efficacy of 25.2% (95% confidence interval; −10.5% to 49.3%) at two years after the first vaccination [6]. Despite the unsatisfactory results, the search for an effective vaccine against HIV continues. New vaccine concepts are being evaluated for efficacy in Europe, America, and Africa [7].
The majority of vaccine recipients in HIV vaccine efficacy trials will develop antibodies to HIV. The detection of these vaccine-induced antibodies in the absence of actual HIV infection is known as vaccine-induced seroreactivity (VISR) [8]. The duration of VISR is unknown, but is greatly influenced by the immunogenicity of the candidate HIV vaccine. In some participants, vaccine-induced HIV antibodies have been detected for more than 23 years after vaccination [9].
A series of HIV vaccine clinical trials were conducted in Sweden, Tanzania, and Mozambique to assess the safety and immunogenicity of a multigene, multi-subtype DNA vaccine candidate (HIV-DNA) boosted with heterologous HIV-1 modified vaccinia virus Ankara-Chiang Mai double recombinant vaccine (HIV-MVA) with or without adjuvanted envelope gp140 protein. The majority of those vaccinated (90–100%) developed detectable antibody responses after completion of the vaccinations [10,11]. Furthermore, anti-Env antibody responses were shown to persist for up to three years [12]. The vaccine recipients frequently reacted in enzyme-linked immunosorbent assays (ELISAs) and western blots used for HIV diagnosis, and infection was therefore ruled out by use of HIV DNA/RNA testing [13].
In order to differentiate between antibodies induced by HIV infection and antibodies induced by an HIV vaccine, it is necessary to know which antigens were included in the vaccine(s) and to have assays set up to allow for this distinction. This is often not the case in routine diagnostic settings. In sub-Saharan Africa, HIV diagnosis relies mainly on the detection of antibodies to HIV using rapid diagnostic tests (RDTs). To improve the accuracy of HIV diagnostic algorithms, two to three RDTs are used in series or in parallel as screening, confirmatory, or tiebreaker tests [14]. The HIV RDTs that are utilized in sub-Saharan Africa include; DetermineTM HIV-1/2, SD Bioline HIV1/2, Uni-GoldTM HIV-1/2, ImmunoFlow HIV 1–HIV 2, HIV 1/2 Stat-Pak, Clearview COMPLETE HIV-1/2, Genie II HIV1/HIV-2, First Response HIV 1-2, INSTI HIV-1/HIV-2, and ImmunoComb II HIV 1&2 BiSpot [15,16]. Considering the emotional trauma and social harms caused by HIV misdiagnosis, it is imperative that the RDT-based diagnostic strategies are able to discriminate HIV antibodies elicited by vaccination from those generated in response to an infection [17].
In the present study, given the lack of a licensed differential HIV RDT and the long-term persistence of vaccine-induced HIV antibodies, we explored the impact of VISR on the HIV rapid test algorithms in sub-Saharan Africa and evaluated the diagnostic algorithms used in Mozambique and Tanzania.

2. Materials and Methods

2.1. Study Design

The HIVIS/TaMoVac consortium conducted a series of phase I/IIa HIV vaccine trials that evaluated the safety and immunogenicity of an HIV-DNA prime HIV-MVA/Env protein boost strategy. The HIV-1 DNA vaccine was composed of seven plasmids encoding gp160 of HIV-1 subtypes A, B, and C, Rev subtype B, p17/p24 gag subtypes A and B, and RTmut subtype B, whereas, the HIV-MVA vaccine was genetically engineered to express gp150 of HIV-1 subtype E and Gag and Pol of subtype A [18]. The vaccinees had received three HIV-DNA priming immunizations followed by two HIV-MVA boosts given with or without envelope gp140 protein. We evaluated the impact of VISR on the accuracy of HIV diagnostic algorithms using serum and plasma samples (n = 180) collected from HIVIS/TaMoVac clinical trial vaccinees between 2009 and 2014. The samples were collected four weeks after the final vaccination from participants of HIVIS01/02/05 (n = 23) [13], HIVIS07 (n = 14) [19], HIVIS03 (n = 29) [11], TaMoVac01 (n = 14) [20], and TaMoVac02 (n = 57) [10] HIV vaccine trials. Additionally, samples collected during the follow up of HIVIS03 vaccinees were used to assess the durability of VISR. Samples collected from vaccinees 16 months (n = 23) and three years (n = 20) after their final vaccination in the HIVIS03 trial were tested. All of the samples were stored at −80 °C and those tested were selected based on availability. HIV infection in vaccinees was ruled out using HIV RNA PCR.

2.2. Evaluation of HIV Rapid Test Algorithms

We assessed the impact of VISR on rapid point-of-care tests used for HIV diagnosis in Mozambique and Tanzania, namely Alere DetermineTM HIV-1/2 (Alere Medical Co., Ltd., Tokyo, Japan) and SD Bioline HIV1/2 (Standard Diagnostics Inc., Samcheok Si, Korea), as screening assays, respectively, and Uni-GoldTM HIV-1/2 (Trinity Biotech, Bray, Ireland) as a confirmatory test when the first assay was reactive. Alere DetermineTM HIV-1/2 detects antibodies against envelope proteins HIV-1 gp41 and HIV-2 gp36, while SD Bioline HIV1/2 contains three recombinant proteins corresponding to HIV-1 gp41, HIV-1 p24, and HIV-2 gp36. Uni-GoldTM HIV-1/2 detects antibodies to gp41 (HIV-1), gp120 (HIV-1), and gp36 (HIV-2) [21]. All rapid tests were performed according to the manufacturers’ instructions. When the Mozambican HIV testing algorithm was applied, the samples were first screened for VISR using Alere DetermineTM HIV-1/2 and reactivity was confirmed using Uni-GoldTM HIV-1/2. When using the Tanzanian algorithm, samples were first tested for VISR using SD Bioline HIV1/2 and reactive samples were retested using Uni-GoldTM HIV-1/2. In both countries, patients were considered HIV-infected if both assays were reactive. The results were read and interpreted independently by two laboratory technologists.

2.3. Evaluation of HIV ELISA

The extent to which VISR would affect the performance of HIV ELISA was assessed using Enzygnost® HIV Integral 4 ELISA (Siemens Healthcare Diagnostics Products GmbH, Marburg, Germany). Enzygnost® HIV Integral 4 ELISA detects the HIV-1 p24 antigen and antibodies to HIV-1 gp41 and HIV-2 gp36. HIV testing was performed in accordance with the manufacturer’s instructions.

2.4. Assessment of HIV Western Blot

Western blots are used as supplemental assays in HIV diagnosis [22]. The effect of VISR on the performance of HIV western blots was evaluated using the MP Diagnostics™ HIV Blot 2.2 western blot assay (Eschwege, Germany). The criteria established by the American Center for Disease Control and Prevention (CDC), the World Health Organization (WHO), the Consortium for Retrovirus Serology Standardization (CRSS), and the American Red Cross (ARC) were used to interpret the results. Samples were considered VISR-positive when they fulfilled the criteria for positivity, as shown in Table 1 below. Results were VISR-negative when no band other than the serum control was present and were indeterminate in the presence of any other band that did not fulfill the criteria for positive or negative results.

2.5. Assessment of Anti-Env Antibody Responses

IgG antibodies binding to subtype C (CN54) gp140 recombinant protein were determined using a standardized in-house ELISA as described previously [13]. Briefly, U96 MaxiSorp Nunc-Immuno ELISA plates (Thermo Scientific, Roskilde, Denmark) were coated with Env proteins at a concentration of 0.5 μg/mL and were incubated overnight at +4–+8 °C. After washing, the plates were blocked with 10% fetal calf serum in phosphate buffered saline. The diluted plasma samples, titrated using two-fold dilutions beginning at 1:100, were then added in duplicates and were incubated overnight at +4–+8 °C. Protein–antibody complexes were detected using rabbit antihuman immunoglobulin G conjugated to horseradish peroxidase, and were visualized by adding O-phenylenediamine peroxidase substrate. The reaction was stopped using 2 M H2SO4, and the optical density was read using dual wavelengths 492 nm and 630 nm. The cutoff was based on each volunteers’ baseline reactivity. The mean of the duplicate optical density values was calculated for both preimmunization and postimmunization samples. A sample was considered positive in a dilution of 1:100 if the absorbance value was more than twice the mean of the preimmunization sample run at a 1:100 dilution. The results were reported as reciprocal values of the highest dilutions giving positive signals.

2.6. Statistical Analysis

Data were analyzed using GraphPad PRISM version 9. Fisher’s exact test was used to compare the frequency of VISR in different HIV diagnostic tests and the subsequent proportion of vaccinees who would be misclassified as HIV-infected by the two HIV testing algorithms. The Mann–Whitney U test was used to compare the magnitude of antibody responses to HIV-1 subtype C gp140 between vaccinees with VISR and those without VISR. A p-value of <0.05 was considered statistically significant.

3. Results

3.1. The HIV Diagnostic Algorithms Misclassified a Large Proportion of HIV-Uninfected Vaccine Recipients

The extent by which rapid point-of-care tests, ELISA, and western blot assays would detect vaccine-induced antibodies to HIV in healthy, HIV-uninfected vaccine recipients was evaluated using samples (n = 137) collected from vaccinees who had participated in phase I/IIa HIVIS and TaMoVac HIV vaccine trials. Four weeks after the last vaccination, the proportion of HIV-uninfected vaccine recipients that were reactive in SD Bioline HIV-1/2 3.0, Uni-Gold™, and Alere DetermineTM HIV-1/2 HIV was 85.4% (117/137), 54.0% (74/137), and 36.5% (50/137), respectively (Figure 1A). When Enzygnost HIV Integral 4 ELISA was used, 93.4% (128/137) of the vaccine recipients were reactive (Figure 1A). Additionally, depending on the interpretation criteria, 22% to 99% of the vaccinees were classified as HIV-positive using the western blot assay (Figure 1B). Applying the HIV diagnostic algorithm used in Mozambique (sequential testing using Determine and Uni-Gold), 26.3% (36/137) of the vaccinees were scored HIV-positive, whereas when applying the algorithm used in Tanzania (sequential testing using Bioline and Uni-Gold), more than half of the vaccinees, 54.0% (74/137), scored HIV-positive and would have received an incorrect HIV diagnosis (Figure 2).

3.2. Antigen Reactivity Patterns as Determined by Western Blot

Western blot was performed to define the antigen recognition pattern in the vaccinees’ samples. High antibody reactivity was seen for HIV-1 p24 (100% (137/137), gp160 (99.3% (136/137), and gp120 (66.4% (91/137). Around half of the vaccinees had antibodies to p17 (51.1% (70/137), and low antibody reactivity was observed to pol antigens p31 (19% (26/137) and p51 (5.1% (07/137), as well as to env protein gp41 (3.7% (5/137). Additionally, few vaccinees generated antibody responses to p66 (4.4% (06/137) and p55 (2.2% (03/137). The rate of VISR varied based on the interpretation criteria used: CDC (99.3% (136/137), CRSS (99.3% (136/137), WHO (66.4% (91/137), and ARC (22% (30/137).

3.3. Antibody Levels Influenced Misclassification of HIV Status

To further understand the reactivity seen in the HIV diagnostic algorithms, we compared the antibody titers to HIV-1 subtype C envelope between vaccinees exhibiting reactivity and those who were non-reactive. The magnitude of antibody responses to HIV-1 envelope protein gp140 was significantly higher among vaccinees who were misclassified as HIV-positive than in those identified as HIV-negative. Applying the Mozambican HIV diagnostic algorithm, the median anti-Env titer was 12,800 (IQR; 3200–60750) in vaccinees incorrectly diagnosed as HIV-infected compared to 1600 (IQR; 800–3200) in vaccinees that were correctly identified as HIV-uninfected, p < 0.0001 (Figure 3A). Similarly, using the Tanzanian algorithm, vaccinees with false-positive HIV results had a median anti-Env titer of 8100 (IQR; 2700–24300) compared to 800 (IQR; 400–1600) in those identified as HIV-negative, p < 0.0001 (Figure 3B).

3.4. Vaccinees Received Correct HIV Diagnosis Results Three Years after the Last Vaccination

The durability of reactivity in HIV rapid tests was explored using stored samples collected from participants who were vaccinated in the HIVIS03 trial [11] and followed up in the HIVIS06 trial [23]. The samples that were tested for VISR durability were collected at three time points; one month after the second HIV-MVA (n = 29), sixteen months after the second HIV-MVA immunization (n = 23) and three years after the second HIV-MVA boost (n = 20). One month after the final HIV-MVA vaccination, 89.7% (26/29) of the vaccinees were reactive in SD Bioline HIV-1/2 3.0, 41.4% (12/29) in Alere DetermineTM HIV-1/2, and 48.3% (14/29) in Uni-GoldTM HIV-1/2 tests. According to the HIV diagnostic algorithms used in Mozambique and Tanzania, 24.1% (7/29) and 48.3% (14/29) of the vaccinees, respectively, would have been classified as HIV-infected (Table 2).
Sixteen months after the last HIV-MVA vaccination, 43.5% (10/23) of the vaccinees were still reactive in SD Bioline HIV-1/2 3.0, 47.8% (11/23) in Alere DetermineTM HIV-1/2, and 8.7% (2/23) in Uni-GoldTM HIV-1/2 tests. This meant that fewer vaccinees would have been misclassified as HIV-infected at this time point compared to four weeks after the final vaccination. According to the diagnostic algorithms, only 8.7% (2/23) of the vaccinees would have received false HIV-positive results in either of the algorithms used in Mozambique and Tanzania (Table 2).
Three years after the second HIV-MVA immunization, 30% (6/20) of the vaccinees were reactive in SD Bioline HIV-1/2 3.0, 5% (1/20) in Alere DetermineTM HIV-1/2, and none in Uni-GoldTM HIV-1/2 tests. Thus, three years after the receipt of three HIV-DNA and two HIV-MVA vaccinations, none of the vaccinees would have been misclassified as HIV-infected using either of the two HIV diagnostic algorithms (Table 2).

4. Discussion

Rapid tests are the primary tools for HIV diagnosis in sub-Saharan Africa [14]. We assessed the frequency of VISR by the RDTs used for HIV diagnosis in Tanzania and Mozambique and applied the two countries’ HIV diagnostic algorithms. Stored serum and plasma samples collected from Tanzanian, Mozambican, and Swedish participants of phase I/IIa HIV vaccine trials were used. The vaccinees had been primed three times with a multigene, multiclade HIV-DNA vaccine and boosted twice with heterologous HIV-MVA vaccine given either alone or together with a subtype C recombinant gp140 protein. We found a high frequency of VISR by the RDTs that would potentially impact HIV diagnosis.
To our knowledge, this is the first study investigating the impact of VISR using RDTs that includes a strategy for confirmatory HIV diagnosis that is used in routine diagnostics in the African region. Earlier VISR reports have come from the monitoring of immunogenicity among candidate HIV vaccines using ELISA, western blots, and line immunoassays. Depending on the vaccine products, delivery technology, and sensitivity of the diagnostic test used, the proportion of vaccinees with detectable antibody responses at the end of HIV vaccine clinical studies has varied extensively, ranging from 0.4% to 100%, with higher VISR rates being seen in immunoassays detecting both HIV antibodies and p24 antigens [24]. Despite raising concerns on the personal and social harms that may be caused by VISR, previous studies have not evaluated the actual performance of HIV diagnostic algorithms in the presence of VISR [8,17,24].
In the present study, at peak immunogenicity (four weeks after the last vaccination), 85.4%, 54%, and 36.5% of vaccinees were reactive in SD Bioline HIV-1/2 3.0, Uni-Gold™ HIV-1/2, and Alere DetermineTM HIV-1/2, respectively. The difference in seroreactivity was probably due to the antigens used in the diagnostic assays, reflecting the immunogens used in the vaccine studies. The analysis of antibody responses using western blots showed that all (100%) vaccine recipients generated antibodies to HIV-1 p24 core protein, 99.3% of vaccinees had antibodies to HIV gp160, nearly two-thirds (66.4%) had antibodies to HIV-1 gp120, and very few (3.7%) had antibodies to HIV-1 gp41. All RDTs in this study contain HIV-1 gp41 as an antigen. In addition to the detection of antibodies against HIV-1 gp41, Uni-Gold™ HIV and SD Bioline HIV1/2 3.0 also detect antibodies against HIV-1 gp120 and HIV-1 p24, respectively [21]. Therefore, the high reactivity in SD Bioline HIV-1/2 3.0 is likely to have been driven by the presence of HIV-1 p24 recombinant proteins in the diagnostic assay. Likewise, the incorporation of HIV-1 gp120 antigens in Uni-Gold™ HIV-1/2 would have contributed to the detection of more than half of the participants with vaccine-induced antibodies. Alere DetermineTM HIV-1/2, which contains recombinant proteins corresponding to HIV-1 gp41 and HIV-2 gp36, generated a lower VISR rate than other HIV rapid assays.
Vaccine-induced antibodies may confound the accuracy of HIV testing algorithms to correctly identify individuals with true HIV infection [25]. The diagnosis of HIV in Mozambique and Tanzania is based on sequential testing with two different HIV RDTs. As a result of VISR, a significant proportion of vaccinees would have been incorrectly identified as HIV-infected in both countries, with misclassification being twice as frequent when SD Bioline HIV-1/2 3.0 and Uni-Gold™ HIV-1/2 (the Tanzanian HIV testing algorithm) were used for the diagnosis of HIV infection (54%) than when the Alere DetermineTM HIV-1/2 and Uni-Gold™ HIV-1/2 (the Mozambican HIV testing algorithm) combination was used (26.3%). This type of diagnostic strategy is common in many countries today, especially in low-income settings. The difference in the accuracy of HIV testing algorithms in preventing the misdiagnosis of vaccine recipients shows the importance of keeping VISR in mind when selecting a diagnostic strategy in areas where HIV vaccine trials have been performed.
The confounding effect of VISR on HIV diagnostics in sub-Saharan Africa is due to the fact that the rapid serological assays detect antibodies [8]. The molecular detection of HIV-RNA can distinguish VISR from true HIV infection. However, the routine use of quantitative PCR for HIV diagnosis in resource-limited settings is not feasible due to a lack of laboratory infrastructure, the complexity of the procedure, and the high cost of the instruments [8,26,27,28]. Since most of the HIV testing in resource-limited settings takes place in clinics with little infrastructure, the availability of simple, low-cost, molecular diagnostic tools that require little or no equipment at the point of care (POC) would avert the misdiagnosis of HIV vaccine recipients. Unfortunately, the available portable detection platforms are semi-automated benchtop instruments that rely on expensive processors and a reagent cold chain, making them incompatible with POC needs in sub-Saharan Africa [27,28].
The failure of the current HIV testing algorithms to discriminate true HIV infection from VISR is a public health concern as thousands of healthy, uninfected volunteers being recruited into phase IIb/III prophylactic HIV vaccine trials in sub-Saharan Africa (and elsewhere) are at risk of being mistakenly identified as HIV-infected after vaccination. A wrong HIV diagnosis can have devastating consequences on individuals and their families. They risk being stigmatized, discriminated against, and criminalized. Some will be abandoned by their spouses, prevented from donating blood, and denied employment, travel opportunities, and health insurance [8,29]. In the era of the “test and treat approach”, the unnecessary initiation of life-long antiretroviral therapy may result in the wastage of scarce resources such as medicines, laboratory reagents for measuring viral load and CD4+ T cell counts, and valuable clinic and staff time. Additionally, misdiagnosed individuals may be unnecessarily subjected to the adverse effects of antiretroviral drugs [30]. Unless a rapid point-of-care differential test is developed, false-positive HIV diagnoses will become more prevalent in sub-Saharan Africa once an effective HIV-1 vaccine becomes available and is approved for mass immunization.
In the present study, vaccine recipients with false-positive HIV results had higher levels of vaccine-induced antibody responses to HIV-1 Env than those with HIV-negative test results. The median antibody titers to subtype C gp140 were eight to ten times higher in vaccinees with an incorrect HIV diagnosis. The induction of potent, durable antibody responses to HIV is the main goal for any HIV vaccine candidate [8]. VISR will become more common as combinations of HIV vaccine regimens being evaluated in efficacy trials will elicit stronger and long-lasting antibody responses to HIV.
The durability of VISR is unpredictable, but is influenced by the immunogenicity of the vaccine, the dose administered, the interval between vaccination doses, the number of doses given, and the sensitivity of the diagnostic test [31]. In this study, a three-year durability of VISR was assessed, at which time VISR was still detectable in a few vaccine recipients. However, none of them were considered HIV-infected when HIV diagnostic testing algorithms were applied. The durability of VISR has been reported to increase with the administration of Env-based vaccines [31]. A long-term follow up of healthy volunteers from multiple HIV vaccine trials revealed that VISR persisted for more than 23 years in volunteers who received rgp160 [9].
The present study has limitations. First, a comparatively limited number of samples from recipients of one type of vaccine regimen (the HIV-DNA prime, HIV-MVA with or without the rgp140 boost) was evaluated. Second, the frequency and persistence of VISR are known to be influenced by HIV vaccine constructs. An increased availability of samples from participants vaccinated with diverse vaccine constructs and using different doses and vaccination strategies would have improved our understanding of the impact of HIV gene inserts on the accuracy of HIV RDTs. Third, commercial RDTs contain different HIV antigens, resulting in different VISR rates. The evaluation of more than three HIV RDTs would have increased the amount of evidence regarding the extent to which HIV diagnosis in different countries will be affected by seroconversion after vaccination. However, the RDTs studied here are those most frequently used in the African region. Additionally, prospective field evaluation was not done. Studies have shown that the specificity of some HIV RDTs may vary depending on the type of specimen used for HIV testing [32]. Differences in specificity may alter the frequency of VISR and the subsequent interpretation of HIV testing results. Finally, despite the fact that Env immunogens are associated with the long-term persistence of VISR, we could not assess the longevity of VISR in the vaccinees who received the rgp140 boost. This was due to a lack of post-vaccination follow up requirements in the HIV vaccine trial in which the rgp140 boost was administered.

5. Conclusions

In summary, the HIV RDTs and algorithms assessed here will potentially misclassify a large proportion of HIV vaccine recipients if no other test is used. Health care providers in sub-Saharan Africa must be made aware of the confounding effects of VISR on the performance of HIV testing algorithms. Increased efforts are needed to develop simple, affordable, serological or molecular tools that can discriminate VISR from true HIV infection at the point of care.

Author Contributions

Conceptualization, F.M., S.A. (Soren Andersson) and C.N.; data curation, F.M., A.M. and S.L.; formal analysis, F.M., A.M., S.L., S.A. (Soren Andersson) and C.N.; funding acquisition, C.N.; investigation, F.M., A.M., S.L., S.A. (Soren Andersson) and C.N.; methodology, F.M., A.M., S.L., S.A. (Soren Andersson) and C.N.; project administration, F.M., A.M., S.A. (Soren Andersson) and C.N.; resources, C.N.; supervision, S.A. (Soren Andersson) and C.N.; validation, F.M. and A.M.; writing—original draft, F.M. and S.L.; writing—review & editing, F.M., A.M., S.L., N.T., R.M.C., V.C., I.J., S.A. (Said Aboud), E.L., S.A. (Soren Andersson) and C.N. All authors had full access to all study data and accept final responsibility for the decision to submit for publication. All authors have read and agreed to the published version of the manuscript.

Funding

This study was funded by the Swedish International Development Coorporation Agency (Sida), grant numbers 75000516 and 51170072.

Institutional Review Board Statement

The protocols and products from the HIVIS01/02/05 and HIVIS07 trials were approved by the Regional Ethics Committees in Stockholm and the Swedish Medical Products Agency. The HIVIS03 and HIVIS06 trial protocols were approved by Tanzania’s National Health Research Ethics Committee (NatHREC) of the National Institute of Medical Research, the Senate Research and Publications Committee of the Muhimbili University of Health and Allied Sciences, the Mbeya Medical Research Ethics Committee, and the Tanzania Food and Drugs Authority (TFDA). The TaMoVac01 and TaMoVac02 trial protocols and products were approved by Tanzania’s NatHREC, the MUHAS Senate Research and Publications Committee, the Mbeya Medical Research Ethics Committee, TFDA, the National Health Bioethics Committee of Mozambique, the Pharmaceutical Department of the Ministry of Health in Mozambique, and the Regional Ethics Committee in Stockholm, Sweden. The ethical approvals for each trial are: HIVIS01/02/05 (2008/1168-32), HIVIS07 (2008/1970-31/2), HIVIS03 (NIMR/HQ/R.8c/Vol.I/55, MU/DRP/PA/Vol.I/37 and 2005/1398-31/4), HIVIS06 (NIMR/HQ/R.8a/Vol.IX/1227, MU/RP/AEC/Vol.XIII, 2017-01-24/AEC/Vol.XII/105, 2017-01-24/AEC/Vol.XII/106, 2017-01-24/AEC/Vol.XII/107, 2017-01-24/AEC/Vol.XII/108, 2017-01-24/AEC/Vol.XII/109, DA.282/298/01, DA.282/298/01, DA.282/298/01 and 2012/436-31/3), TaMoVac01 (76/CNBS/11 and 2011/1684-31/4), and TaMoVac02 (NIMR/HQ/R.8c/Vol.I/262, NIMR/HQ/R.8c/Vol.II/267, NIMR/HQ/R.8c/Vol.II/394, MU/DRP/AEC/Vol.XIV/153, 2016-06-06/AEC/Vol.XI/14, 2017-05-27/AEC/Vol.XII/102, 2018-07-09/AEC/Vol.XII/91, DA.282/298/01.C and 2013/471-31/1). The current study was covered by the original ethical approvals from Sweden and Tanzania. However, a new ethical clearance was needed for the assessment of the impact of VISR on HIV diagnosis in Mozambique. An ethical permit with ref No: 509/CNBS/18 was obtained from the National Health Bioethics Committee of Mozambique.

Informed Consent Statement

Informed consent was obtained from all participants involved in the study.

Data Availability Statement

Our data came from the testing of stored samples that were collected from the recipients of the HIV-DNA and HIV-MVA/Env vaccines. The study protocol, the statistical analysis plan, de-identified participant data, and the data dictionary will be made available to others upon request. The data will be available from the date of publication and can be shared with investigator support after submission of a data request form, study proposal, a copy of ethical clearance certificate from Muhimbili University of Health and Allied Sciences (https://www.muhas.ac.tz), and a signed data transfer agreement with MUHAS, the primary custodian of this data.

Acknowledgments

We are thankful to all volunteers who participated in the HIVIS/TaMoVac clinical trials, without whom we would not have been able to conduct this study. We also thank the clinical and laboratory personnel for their efforts in sample collection and storage. We are grateful to the Swedish International Development Coorporation Agency (Sida) for funding this study. We also acknowledge the funders of the various HIVIS/TaMoVac clinical trials; the European Union, Sida, the European Developing Countries Clinical Trials Partnership (EDCTP), the Swedish Embassy in Tanzania, the Regional HIV/AIDS Team for Africa, the Embassy of Sweden in Lusaka, and the Walter Reed Army Institute of Research (WRAIR).

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

References

  1. UNAIDS. Global HIV Statistics; UNAIDS: Geneva, Switzerland, 2021; Available online: https://www.unaids.org/en/resources/fact-sheet (accessed on 30 October 2021).
  2. Fauci, A.S. An HIV Vaccine Is Essential for Ending the HIV/AIDS Pandemic. JAMA 2017, 318, 1535–1536. [Google Scholar] [CrossRef] [PubMed]
  3. Lee, J.H.; Crotty, S. HIV vaccinology: 2021 update. Semin. Immunol. 2021, 51, 101470. [Google Scholar] [CrossRef] [PubMed]
  4. Rerks-Ngarm, S.; Pitisuttithum, P.; Nitayaphan, S.; Kaewkungwal, J.; Chiu, J.; Paris, R.; Premsri, N.; Namwat, N.; de Souza, M.; Adams, E.; et al. Vaccination with ALVAC and AIDSVAX to prevent HIV-1 infection in Thailand. N. Engl. J. Med. 2009, 361, 2209–2220. [Google Scholar] [CrossRef] [PubMed]
  5. Gray, G.E.; Bekker, L.G.; Laher, F.; Malahleha, M.; Allen, M.; Moodie, Z.; Grunenberg, N.; Huang, Y.; Grove, D.; Prigmore, B.; et al. Vaccine Efficacy of ALVAC-HIV and Bivalent Subtype C gp120-MF59 in Adults. N. Engl. J. Med. 2021, 384, 1089–1100. [Google Scholar] [CrossRef] [PubMed]
  6. Johnson, J. Johnson & Johnson and Global Partners Announce Results from Phase 2b Imbokodo HIV Vaccine Clinical Trial in Young Women in Sub-Saharan Africa. 2021. Available online: https://www.prnewswire.com/news-releases/johnson--johnson-and-global-partners-announce-results-from-phase-2b-imbokodo-hiv-vaccine-clinical-trial-in-young-women-in-sub-saharan-africa-301365918.html (accessed on 27 February 2022).
  7. Ng’uni, T.; Chasara, C.; Ndhlovu, Z.M. Major Scientific Hurdles in HIV Vaccine Development: Historical Perspective and Future Directions. Front. Immunol. 2020, 11, 590780. [Google Scholar] [CrossRef]
  8. Voronin, Y.; Zinszner, H.; Karg, C.; Brooks, K.; Coombs, R.; Hural, J.; Holt, R.; Fast, P.; Allen, M.; Busch, M.; et al. HIV vaccine-induced sero-reactivity: A challenge for trial participants, researchers, and physicians. Vaccine 2015, 33, 1243–1249. [Google Scholar] [CrossRef] [Green Version]
  9. Durier, C.; Desaint, C.; Lelièvre, J.D.; Silbermann, B.; Pialoux, G.; Cuzin, L.; Bonnet, B.; Poizot-Martin, I.; Bouakane, A.; Paul, C.; et al. Long-term safety and vaccine-induced seropositivity in healthy volunteers from HIV vaccine trials. AIDS 2019, 33, 2061–2071. [Google Scholar] [CrossRef]
  10. Viegas, E.O.; Kroidl, A.; Munseri, P.J.; Missanga, M.; Nilsson, C.; Tembe, N.; Bauer, A.; Joachim, A.; Joseph, S.; Mann, P.; et al. Optimizing the immunogenicity of HIV prime-boost DNA-MVA-rgp140/GLA vaccines in a phase II randomized factorial trial design. PLoS ONE 2018, 13, e0206838. [Google Scholar] [CrossRef]
  11. Bakari, M.; Aboud, S.; Nilsson, C.; Francis, J.; Buma, D.; Moshiro, C.; Aris, E.A.; Lyamuya, E.F.; Janabi, M.; Godoy-Ramirez, K.; et al. Broad and potent immune responses to a low dose intradermal HIV-1 DNA boosted with HIV-1 recombinant MVA among healthy adults in Tanzania. Vaccine 2011, 29, 8417–8428. [Google Scholar] [CrossRef] [Green Version]
  12. Joachim, A.; Msafiri, F.; Onkar, S.; Munseri, P.; Aboud, S.; Lyamuya, E.F.; Bakari, M.; Billings, E.; Robb, M.L.; Wahren, B.; et al. Frequent and Durable Anti-HIV Envelope VIV2 IgG Responses Induced by HIV-1 DNA Priming and HIV-MVA Boosting in Healthy Tanzanian Volunteers. Vaccines 2020, 8, 681. [Google Scholar] [CrossRef]
  13. Nilsson, C.; Godoy-Ramirez, K.; Hejdeman, B.; Bråve, A.; Gudmundsdotter, L.; Hallengärd, D.; Currier, J.R.; Wieczorek, L.; Hasselrot, K.; Earl, P.L.; et al. Broad and potent cellular and humoral immune responses after a second late HIV-modified vaccinia virus ankara vaccination in HIV-DNA-primed and HIV-modified vaccinia virus Ankara-boosted Swedish vaccinees. AIDS Res. Hum. Retrovir. 2014, 30, 299–311. [Google Scholar] [CrossRef] [Green Version]
  14. World Health Organization. Consolidated Guidelines on HIV Testing Services 2019; World Health Organization: Geneva, Switzerland, 2020; Available online: https://www.who.int/publications/i/item/978-92-4-155058-1 (accessed on 10 October 2021).
  15. Armstrong-Mensah, E.; Tetteh, A.K.; Choi, S. Utilization of Rapid Diagnostic Testing in sub-Saharan Africa: Challenges and Effects on HIV Prevention. Int. J. MCH AIDS 2021, 10, 1–6. [Google Scholar] [CrossRef]
  16. Kosack, C.S.; Shanks, L.; Beelaert, G.; Benson, T.; Savane, A.; Ng’ang’a, A.; Andre, B.; Zahinda, J.-P.B.; Fransen, K.; Page, A.-L. HIV misdiagnosis in sub-Saharan Africa: Performance of diagnostic algorithms at six testing sites. J. Int. AIDS Soc. 2017, 20, 21419. [Google Scholar] [CrossRef] [Green Version]
  17. Penezina, O.; Krueger, N.X.; Rodriguez-Chavez, I.R.; Busch, M.P.; Hural, J.; Kim, J.H.; O’Connell, R.J.; Hunter, E.; Aboud, S.; Higgins, K.; et al. Performance of a redesigned HIV Selectest enzyme-linked immunosorbent assay optimized to minimize vaccine-induced seropositivity in HIV vaccine trial participants. Clin. Vaccine Immunol. 2014, 21, 391–398. [Google Scholar] [CrossRef] [Green Version]
  18. Munseri, P.J.; Kroidl, A.; Nilsson, C.; Joachim, A.; Geldmacher, C.; Mann, P.; Moshiro, C.; Aboud, S.; Lyamuya, E.; Maboko, L.; et al. Priming with a simplified intradermal HIV-1 DNA vaccine regimen followed by boosting with recombinant HIV-1 MVA vaccine is safe and immunogenic: A phase IIa randomized clinical trial. PLoS ONE 2015, 10, e0119629. [Google Scholar] [CrossRef]
  19. Nilsson, C.; Hejdeman, B.; Godoy-Ramirez, K.; Tecleab, T.; Scarlatti, G.; Bråve, A.; Earl, P.L.; Stout, R.R.; Robb, M.L.; Shattock, R.J.; et al. HIV-DNA Given with or without Intradermal Electroporation Is Safe and Highly Immunogenic in Healthy Swedish HIV-1 DNA/MVA Vaccinees: A Phase I Randomized Trial. PLoS ONE 2015, 10, e0131748. [Google Scholar] [CrossRef] [Green Version]
  20. Viegas, E.O.; Tembe, N.; Nilsson, C.; Meggi, B.; Maueia, C.; Augusto, O.; Stout, R.; Scarlatti, G.; Ferrari, G.; Earl, P.L.; et al. Intradermal HIV-1 DNA Immunization Using Needle-Free Zetajet Injection Followed by HIV-Modified Vaccinia Virus Ankara Vaccination Is Safe and Immunogenic in Mozambican Young Adults: A Phase I Randomized Controlled Trial. AIDS Res. Hum. Retrovir. 2018, 34, 193–205. [Google Scholar] [CrossRef]
  21. World Health Organization. HIV Assays: Laboratory Performance and Other Operational Characteristics, Report 18; WHO: Geneva, Switzerland, 2015; Available online: https://www.who.int/diagnostics_laboratory/publications/15032_hiv_assay_report18.pdf?ua=1 (accessed on 15 September 2021).
  22. Masciotra, S.; McDougal, J.S.; Feldman, J.; Sprinkle, P.; Wesolowski, L.; Owen, S.M. Evaluation of an alternative HIV diagnostic algorithm using specimens from seroconversion panels and persons with established HIV infections. J. Clin. Virol. Off. Publ. Pan Am. Soc. Clin. Virol. 2011, 52 (Suppl. S1), S17–S22. [Google Scholar] [CrossRef]
  23. Joachim, A.; Munseri, P.J.; Nilsson, C.; Bakari, M.; Aboud, S.; Lyamuya, E.F.; Tecleab, T.; Liakina, V.; Scarlatti, G.; Robb, M.L.; et al. Three-Year Durability of Immune Responses Induced by HIV-DNA and HIV-Modified Vaccinia Virus Ankara and Effect of a Late HIV-Modified Vaccinia Virus Ankara Boost in Tanzanian Volunteers. AIDS Res. Hum. Retrovir. 2017, 33, 880–888. [Google Scholar] [CrossRef]
  24. Pitisuttithum, P.; Marovich, M.A. Prophylactic HIV vaccine: Vaccine regimens in clinical trials and potential challenges. Expert Rev. Vaccines 2020, 19, 133–142. [Google Scholar] [CrossRef] [Green Version]
  25. Cooper, C.J.; Metch, B.; Dragavon, J.; Coombs, R.W.; Baden, L.R. Vaccine-induced HIV seropositivity/reactivity in noninfected HIV vaccine recipients. JAMA 2010, 304, 275–283. [Google Scholar] [CrossRef] [Green Version]
  26. Quirk, E.K.; Mogg, R.; Brown, D.D.; Lally, M.A.; Mehrotra, D.V.; DiNubile, M.J.; Robertson, M.N. HIV seroconversion without infection after receipt of adenovirus-vectored HIV type 1 vaccine. Clin. Infect. Dis. Off. Publ. Infect. Dis. Soc. Am. 2008, 47, 1593–1599. [Google Scholar] [CrossRef] [Green Version]
  27. Mauk, M.; Song, J.; Bau, H.H.; Gross, R.; Bushman, F.D.; Collman, R.G.; Liu, C. Miniaturized devices for point of care molecular detection of HIV. Lab Chip 2017, 17, 382–394. [Google Scholar] [CrossRef] [Green Version]
  28. Manoto, S.L.; Lugongolo, M.; Govender, U.; Mthunzi-Kufa, P. Point of Care Diagnostics for HIV in Resource Limited Settings: An Overview. Medicina 2018, 54, 3. [Google Scholar] [CrossRef] [Green Version]
  29. Iseselo, M.K.; Tarimo, E.A.M.; Sandstrom, E.; Kulane, A. Sexual Behaviours and Practices before and after Phase I/II HIV Vaccine Trial: A Qualitative Study among Volunteers in Dar es Salaam Tanzania. Int. J. Environ. Res. Public Health 2020, 17, 7193. [Google Scholar] [CrossRef]
  30. Ackers, M.L.; Parekh, B.; Evans, T.G.; Berman, P.; Phillips, S.; Allen, M.; McDougal, J.S. Human immunodeficiency virus (HIV) seropositivity among uninfected HIV vaccine recipients. J. Infect. Dis. 2003, 187, 879–886. [Google Scholar] [CrossRef] [Green Version]
  31. Silbermann, B.; Tod, M.; Desaint, C.; Pialoux, G.; Petitprez, K.; Slama, L.; Poncelet, H.; Moreau, C.; Mazarin, V.; Heshmati, F.; et al. Short communication: Long-term persistence of vaccine-induced HIV seropositivity among healthy volunteers. AIDS Res. Hum. Retrovir. 2008, 24, 1445–1448. [Google Scholar] [CrossRef] [Green Version]
  32. Kroidl, I.; Clowes, P.; Mwalongo, W.; Maganga, L.; Maboko, L.; Kroidl, A.L.; Geldmacher, C.; Machibya, H.; Hoelscher, M.; Saathoff, E. Low specificity of determine HIV1/2 RDT using whole blood in south west Tanzania. PLoS ONE 2012, 7, e39529. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Frequency of VISR. Samples collected four weeks after the final vaccination were evaluated for VISR using rapid point-of-care tests and ELISA (A). The highest rates of VISR were seen when using Enzygnost HIV Integral 4 ELISA and SD Bioline HIV-1/2 3.0. HIV misdiagnosis according to western blot interpretation criteria (B). The VISR results were interpreted using the criteria detailed in Table 1 (CDC, CRSS, WHO, and ARC criteria). The majority of the vaccinees would have been misclassified as HIV-infected using the CDC and CRSS interpretation criteria.
Figure 1. Frequency of VISR. Samples collected four weeks after the final vaccination were evaluated for VISR using rapid point-of-care tests and ELISA (A). The highest rates of VISR were seen when using Enzygnost HIV Integral 4 ELISA and SD Bioline HIV-1/2 3.0. HIV misdiagnosis according to western blot interpretation criteria (B). The VISR results were interpreted using the criteria detailed in Table 1 (CDC, CRSS, WHO, and ARC criteria). The majority of the vaccinees would have been misclassified as HIV-infected using the CDC and CRSS interpretation criteria.
Vaccines 10 01062 g001
Figure 2. Proportion of vaccinees misdiagnosed as HIV-infected. Samples were tested for VISR using HIV testing algorithms used in Mozambique and Tanzania that use two sequential rapid diagnostic tests: Alere DetermineTM HIV-1/2 and Uni-GoldTM HIV-1/2 in Mozambique, SD Bioline HIV1/2 3.0 and Uni-GoldTM HIV-1/2 in Tanzania. Patients were considered HIV-negative if the screening assay was negative and HIV-infected if both assays were reactive. Fisher’s exact test was used to compare the frequency of VISR between the two HIV testing algorithms. The proportion of vaccine recipients who would have been misclassified using the Mozambican HIV testing algorithm was half of that misclassified by the Tanzanian algorithm.
Figure 2. Proportion of vaccinees misdiagnosed as HIV-infected. Samples were tested for VISR using HIV testing algorithms used in Mozambique and Tanzania that use two sequential rapid diagnostic tests: Alere DetermineTM HIV-1/2 and Uni-GoldTM HIV-1/2 in Mozambique, SD Bioline HIV1/2 3.0 and Uni-GoldTM HIV-1/2 in Tanzania. Patients were considered HIV-negative if the screening assay was negative and HIV-infected if both assays were reactive. Fisher’s exact test was used to compare the frequency of VISR between the two HIV testing algorithms. The proportion of vaccine recipients who would have been misclassified using the Mozambican HIV testing algorithm was half of that misclassified by the Tanzanian algorithm.
Vaccines 10 01062 g002
Figure 3. Magnitude of antibody responses among vaccinees. Mann-Whitney U test was used to compare the level of antibody responses between vaccine recipients incorrectly identified as HIV-positive and those who were HIV-negative. In both HIV testing algorithms (A,B), significantly higher antibody titers were found in vaccinees who were misclassified as HIV-positive than in those classified as HIV-negative. The red and blue circles represent reactive and non-reactive vaccine recipients, respectively.
Figure 3. Magnitude of antibody responses among vaccinees. Mann-Whitney U test was used to compare the level of antibody responses between vaccine recipients incorrectly identified as HIV-positive and those who were HIV-negative. In both HIV testing algorithms (A,B), significantly higher antibody titers were found in vaccinees who were misclassified as HIV-positive than in those classified as HIV-negative. The red and blue circles represent reactive and non-reactive vaccine recipients, respectively.
Vaccines 10 01062 g003
Table 1. Criteria for positive interpretation of HIV western blot results.
Table 1. Criteria for positive interpretation of HIV western blot results.
OrganizationHIV-Positive
CDC and Association of State and Territorial Public Health Laboratory Directors (ASTPHLD *), 1989 USA Presence of any two of p24, gp41, gp120/160 bands
WHO, 1990Presence of two ENV bands with or without GAG or POL
CRSS, 1988 USAPresence of one ENV band with p24 or p31
ARC, 1988 USAPresence of one band each of GAG, POL, and ENV
Table adapted from manufacturer’s (MP Biomedicals) product insert. * ASTPHLD was renamed Association of Public Health Laboratories (APHL) in 1998.
Table 2. Frequency of VISR and HIV status misclassifications at one month, sixteen months and three years after the last HIV-MVA immunization.
Table 2. Frequency of VISR and HIV status misclassifications at one month, sixteen months and three years after the last HIV-MVA immunization.
Diagnostic AssayNumber of Reactive/Number of Tested (%)
1 Month after the Second HIV-MVA Vaccination16 Months after the Second HIV-MVA Vaccination3 Years after the Second HIV-MVA Vaccination
Alere DetermineTM HIV-1/212/29 (41.4)11/23 (47.8)1/20 (5)
SD Bioline HIV1/2 26/29 (89.7)10/23 (43.5)6/20 (30)
Uni-GoldTM HIV-1/214/29 (48.3)2/23 (8.7)0/20
HIV misdiagnosis using Mozambican algorithm7/29 (24.1)2/23 (8.7)0/20
HIV misdiagnosis using Tanzanian algorithm14/29 (48.3)2/23 (8.7)0/20
In Mozambique, individuals are considered HIV-infected if they are reactive in both Alere DetermineTM HIV-1/2 and Uni-GoldTM HIV-1/2, while in Tanzania, they are considered HIV-infected if reactive in both SD Bioline HIV-1/2 3.0 and Uni-GoldTM HIV-1/2.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Msafiri, F.; Manjate, A.; Lindroth, S.; Tembe, N.; Chissumba, R.M.; Cumbane, V.; Jani, I.; Aboud, S.; Lyamuya, E.; Andersson, S.; et al. Vaccine-Induced Seroreactivity Impacts the Accuracy of HIV Testing Algorithms in Sub-Saharan Africa: An Exploratory Study. Vaccines 2022, 10, 1062. https://doi.org/10.3390/vaccines10071062

AMA Style

Msafiri F, Manjate A, Lindroth S, Tembe N, Chissumba RM, Cumbane V, Jani I, Aboud S, Lyamuya E, Andersson S, et al. Vaccine-Induced Seroreactivity Impacts the Accuracy of HIV Testing Algorithms in Sub-Saharan Africa: An Exploratory Study. Vaccines. 2022; 10(7):1062. https://doi.org/10.3390/vaccines10071062

Chicago/Turabian Style

Msafiri, Frank, Alice Manjate, Sarah Lindroth, Nelson Tembe, Raquel Matavele Chissumba, Victoria Cumbane, Ilesh Jani, Said Aboud, Eligius Lyamuya, Sören Andersson, and et al. 2022. "Vaccine-Induced Seroreactivity Impacts the Accuracy of HIV Testing Algorithms in Sub-Saharan Africa: An Exploratory Study" Vaccines 10, no. 7: 1062. https://doi.org/10.3390/vaccines10071062

APA Style

Msafiri, F., Manjate, A., Lindroth, S., Tembe, N., Chissumba, R. M., Cumbane, V., Jani, I., Aboud, S., Lyamuya, E., Andersson, S., & Nilsson, C. (2022). Vaccine-Induced Seroreactivity Impacts the Accuracy of HIV Testing Algorithms in Sub-Saharan Africa: An Exploratory Study. Vaccines, 10(7), 1062. https://doi.org/10.3390/vaccines10071062

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop