Next Article in Journal
ELOVL2, PRKG2, and EDARADD DNA Methylation Strongly Estimate Indonesian Adolescents
Previous Article in Journal
Real-Time Dosimetry in Endourology: Tracking Staff Radiation Risks
Previous Article in Special Issue
Liquid Biopsies Based on Cell-Free DNA Integrity as a Biomarker for Cancer Diagnosis: A Meta-Analysis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Enhancing Precision in HIV Treatment: Validation of a Robust Next-Generation Sequencing System for Drug Resistance Mutation Analysis

1
Georgia Esoteric and Molecular Biology Laboratory, Department of Pathology, Augusta University, Augusta, GA 30912, USA
2
Reagent Sciences Department, Research and Development, Illumina, San Diego, CA 92122, USA
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Diagnostics 2024, 14(16), 1766; https://doi.org/10.3390/diagnostics14161766
Submission received: 30 May 2024 / Revised: 30 July 2024 / Accepted: 2 August 2024 / Published: 14 August 2024
(This article belongs to the Special Issue Emerging Biomarkers of Clinical Diagnosis)

Abstract

:
Background: Multidrug-resistant HIV strains challenge treatment efficacy and increase mortality rates. Next-generation sequencing (NGS) technology swiftly detects variants, facilitating personalized antiretroviral therapy. Aim: This study aimed to validate the Vela Diagnostics NGS platform for HIV drug resistance mutation analysis, rigorously assessed with clinical samples and CAP proficiency testing controls previously analyzed by Sanger sequencing. Method: The experimental approach involved the following: RNA extraction from clinical specimens, reverse transcription polymerase chain reaction (RT-PCR) utilizing the Sentosa SX 101 platform, library preparation with the Sentosa SQ HIV Genotyping Assay, template preparation, sequencing using the Sentosa SQ301 instrument, and subsequent data analysis employing the Sentosa SQ Suite and SQ Reporter software. Drug resistance profiles were interpreted using the Stanford HIV Drug Resistance Database (HIVdb) with the HXB2 reference sequence. Results: The Vela NGS system successfully identified a comprehensive array of drug resistance mutations across the tested samples: 28 nucleoside reverse transcriptase inhibitors (NRTI), 25 non-nucleoside reverse transcriptase inhibitors (NNRTI), 25 protease inhibitors (PI), and 10 integrase gene-specific variants. Dilution experiments further validated the system’s sensitivity, detecting drug resistance mutations even at viral loads lower than the recommended threshold (1000 copies/mL) set by Vela Diagnostics. Scope: This study underscores the validation and clinical applicability of the Vela NGS system, and its implementation may offer clinicians enhanced precision in therapeutic decision-making for individuals living with HIV.

1. Introduction

The advent of combined antiretroviral therapy (cART) revolutionized human immunodeficiency virus (HIV) management by effectively suppressing viral replication, restoring immune function, and enhancing patients’ quality of life. Despite this advancement, the Joint United Nations Program on HIV and acquired immunodeficiency syndrome (AIDS) and the World Health Organization (WHO) present a very challenging global HIV landscape: in 2022, 39 million individuals were living with HIV infections, 1.3 million newly acquired the virus, and an estimated 630 thousand were facing mortality due to HIV-related issues [1,2]. The juxtaposition of these staggering statistics against the backdrop of therapeutic innovation underscores both the progress made in HIV management and the persistent challenges that demand our attention [3].
Presently, HIV treatment encompasses a diverse arsenal of antiretroviral medications spanning five distinct classes. These medications target various stages of the HIV life cycle: entry inhibitors, such as maraviroc and enfuvirtide, disrupt viral attachment and fusion; nucleoside and non-nucleoside reverse transcriptase inhibitors (NRTIs and NNRTIs) impede viral RNA conversion to cDNA; integrase strand transfer inhibitors (INSTIs) prevent viral DNA integration into the host genome; and protease inhibitors (PIs) hinder viral protein cleavage, thus inhibiting virion maturation [4].
However, despite these therapeutic advancements, the emergence of drug-resistant and multidrug-resistant HIV strains remains a formidable challenge. As highlighted in the latest WHO HIV Drug Resistance Report, an exponential rise in acquired and transmitted drug resistance among antiretroviral treatment-naive individuals has been observed, resulting in cART failure, disease progression, and increased mortality [5]. The emergence of such resistant strains poses a significant barrier to achieving the goal of ending the HIV-1 epidemic as a public health threat by 2030 [6], hence the urgency highlighted by the WHO to combat emerging HIV drug resistance, advocating for novel interventions to counter this emerging threat to global public health. This includes implementing routine viral load monitoring, enhancing treatment adherence, conducting drug resistance genotyping, timely regimen adjustments, and selecting optimal antiretroviral combinations to ensure sustained treatment efficacy and favorable outcomes in the long term.
Next-generation sequencing (NGS) has emerged as a pivotal tool for clinical, research, and public health applications, supplanting Sanger sequencing (SS) as the primary method for gene identification and characterization across diverse organisms and viruses, including HIV [7]. While the SS can detect drug resistance mutations (DRMs) in 20–30% of the viral population, NGS technologies offer superior sensitivity and reproducibility, identifying low-frequency variants down to 5% of the total virus population [8]. NGS HIV drug resistance (HIVDR) assays offer flexibility, allowing the simultaneous sequencing of multiple HIV genes through the use of longer PCR amplicons or the combination of different amplicons before fragmentation and tagmentation during library preparation, facilitating the high-resolution analysis of HIVDR variants [9]. The affordability and accessibility of NGS technology, facilitated by commercial kits and analysis pipelines, have enabled high-throughput, massively parallel sequencing to identify low-abundance variants in various applications, including HIVDR testing [7,10]. However, the majority of NGS platforms available, such as Illumina and Roche, are certified for research use only and, thus, not yet suitable for clinical diagnostic applications. In 2019, the Vela Diagnostics NGS platform achieved Food and Drug Administration (FDA) approval for HIV genotyping and resistance testing for in vitro diagnostic purposes [11]. This Ion Torrent technology-based Sentosa® platform allows for the sequencing of HIVDR-relevant genes with sensitivity for minor variant detection at 10% when the viral load (VL) is ≥5000 copies/mL or 20% when VL is lower [9]. Several independent studies have assessed the performance of the Vela Diagnostics NGS platform in research contexts, often with a limited number of selected patients or only with reference materials [12,13].
In this study, we present the results of a comprehensive validation of the Vela Diagnostics NGS system in conjunction with the Sentosa SQ HIV1 genotyping assay, focusing on technical parameters such as the success rate, accuracy, repeatability, and reproducibility of results. The analytical assessment of the Vela NGS platform was conducted in a real-world clinical setting using 35 patient samples and 5 reference samples recommended by College of American Pathologists (CAP). Further, the clinical utility of the assay was underscored by comparative analysis with the current gold standard orthogonal methods—Abbott ViroSeq and Integrase. Our findings demonstrate that the Vela Diagnostics system provides essential insights into the diversity of HIVDR variants, showcasing the transformative potential of NGS methodologies in optimizing clinical management and advancing the collective objective of curtailing the HIV epidemic.

2. Materials and Methods

2.1. Sample Collection and Processing

The study assessment was guided by the joint consensus recommendation for the validation of NGS assays by the Association of Molecular Pathologists (AMP) and CAP. This retrospective study included 35 unique patient samples with known DRMs on follow-up at the Augusta University Hospital under IRB#611298, approved by the Augusta University Institutional Review Board. All patient identifiers were removed, and all data were anonymized before processing the samples. The blood samples were collected in EDTA tubes (BD Vacutainer®, Milan, Italy); plasma fractions were separated with a Cobas p630 pre-analytical instrument (Roche Diagnostics S.p.A., Monza, Italy) and stored at −80 °C until testing. Five CAP-PT (proficiency testing) samples having known DRMs were included as reference samples to evaluate the precision performance of the Sentosa® SQ HIV Genotyping Assay. All these unique 35 samples (run in replicates) were previously analyzed on the Sanger sequencing-based Abbott ViroSeq™ IVD platform for clinical diagnosis. The data were retrieved retrospectively from the patients’ results repository. The samples with a sufficient volume of 750 µL of plasma for testing by NGS and around 500 µL for Sanger sequencing were included in the study. This volume contained sufficient amplifiable RNA for conventional reverse transcription polymerase chain reaction (RT-PCR) and SS in the clinical laboratory.

2.2. Dideoxynucleoside Sanger Sequencing

HIV RNA was extracted from plasma specimens utilizing the HIV ViroSeq module, including the provided positive and negative controls inherent in the kit (Celera Diagnostics, Alameda, CA, USA). The genomic segments of interest, encompassing the entirety of the protease gene (codons 1 to 99) and a substantial portion of the RT gene (codons 1 to 335), were selectively amplified to yield a 1.8 kb amplicon. This amplification process was facilitated using the ViroSeq™ HIV-1 genotyping kit (Celera Diagnostics, Alameda, CA, USA) as per the manufacturer’s specifications. The resulting amplicon served as the template for subsequent sequencing, employing seven primers, comprising four forward and three reverse primers. This orchestrated primer design amplified distinct regions of the viral genome in a single step, generating an approximately 1.3 kb consensus sequence. A gel-based, semi-quantitative method was used to determine the quality and concentration of the PCR products by comparing the band intensities to known quantities of standard markers. Notably, 6 and 3 µL of the PCR product were utilized for quantification, with band intensity and PCR product dilution calibrated to ensure accuracy.
After quantification, the PCR product was diluted and subjected to cycle sequencing, employing dideoxy nucleotide triphosphates (dNTPs). The dideoxy products were purified and sequenced on the ABI 3130 genetic analyzer (Applied Biosystems, Carlsbad, CA, USA). The generated consensus sequence was then aligned against a well-established reference sequence, Human Immunodeficiency Virus Type 1 (HXB2), to discern any mutations present within the sample. To streamline this process, the ViroSeq® HIV-1 Genotyping System Software was employed, employing a proprietary algorithm developed by Abbott Molecular Inc. The sophisticated software analyzed the identified mutations, generating a comprehensive drug resistance report for each sample.
The integrase region was reverse-transcribed and amplified following an Integrase sequencing module kit (Celera Diagnostics, Alameda, CA, USA). The entire integrase gene was amplified to generate a 1.1 kb amplicon. The amplicon was used as a sequencing template for four primers (two forward and two reverse primers) that generated an approximately 0.9 kb consensus sequence. The ViroSeq™ Integrase Software (v1.0.1) then assembled, edited, and identified mutations within this 0.9 kb sequence. The software compares the consensus sequence with HXB2 to determine mutations present in the sample and generates a drug report.

2.3. NGS and Data Analysis

The NGS assay simultaneously processes 15 samples, with a positive control in each run. A detailed stepwise procedure is shown in Figure 1. Briefly, RNA extraction from the plasma samples was performed using the Sentosa® SX101 instrument (Vela Diagnostics, Hamburg, Germany), followed by an off-board RT-PCR step using the Veriti® Dx 96-Well Thermal Cycler (Thermo Fisher Scientific, Waltham, MA, USA). Subsequently, the fully automated Sentosa® SX101 instrument constructed a pooled library, which underwent a template preparation on the Sentosa® ST401 system (Vela Diagnostics, Hamburg, Germany). Following an enrichment procedure performed with the Sentosa® ST401e instrument (Vela Diagnostics, Hamburg, Germany), sequencing occurred on the Sentosa® SQ301 (Vela Diagnostics, Hamburg, Germany), based upon the Ion Torrent™ system (Thermo Fisher Scientific, Waltham, MA, USA) for ultra-deep sequencing. An extraction control (EC) was used to monitor RNA extraction and the library preparation steps, while a system control (SC) was analyzed as a sample and provided a check for the entire analysis run. The quality of the SC assembly, i.e., its run throughput (40,000,000 bp), median coverage (200), completeness (95%) and error rate (<1%), is essential to validate the sample results. The integrated workflow includes the automated Sentosa NGS platform (robotic systems and instruments for sequencing) and the Sentosa SQ HIV genotyping assay comprising all the kits for the sequencing of the HIV1 genotyping panel targets protease gene (Codon 1–99), RT gene (Codon 1–376), and Integrase gene (Codon 1–288). HXB2 was used as a reference sequence. The raw signal data, approximately 230 GB per sequencing run, were generated by the sequencer and transferred to the SQ Suite server during the sequencing process. The raw sequencing data were then processed by the SQ Suite server to produce the demultiplexed sequencing data and intermediate files, around 20 GB per run.

2.4. Post NGS Drug Susceptibility Reporting Workflow

The Sentosa® SQ Suite and SQ Reporter software packages (v2.5.0005, Vela Diagnostics, Hamburg, Germany) were used for primary and secondary data analysis. The entire workflow generated FASTA files with consensus sequences relevant to the INT region (codons 1–288) and the PRO region (codons 1–99), concatenated with the RT region (codons 1–386). Nucleotide variants > 5% were reported using the International Union of Pure and Applied Chemistry–International Union of Biochemistry and Molecular Biology (IUPAC-IUBMB) system. Beyond raw FASTA files, the assessed subtype based on PRO and RT sequences was provided within a drug susceptibility report. The latter was automatically generated using Sentosa® SQ Reporter software, exploiting the Stanford HIVdb software (v9.0) and Stanford HIVdb 8.2 HIV algorithms. The demultiplexed data from the SQ Suite server were forwarded to the SQ Reporter software for secondary analysis. The SQ Reporter data, totaling about 10 GB per run, are the output of the SQ Reporter analysis pipeline and include sequencing data copies, mapping results, intermediate outputs, and final outputs such as PDF reports, Contigs, and VCF files. Finally, the results dataset, approximately 30 MB per run, comprises the conclusive reportable outputs downloadable via the SQ Reporter interface, encompassing PDF reports, Contigs, VCF files, and various textual formats.

2.5. Statistical Analysis

The data obtained were saved in Microsoft Excel and were analyzed using GraphPad Prism 8 (version 8.0.2, San Diego, CA, USA). A Bland–Altman analysis was performed to measure the agreement between the Vela NGS and Abbott ViroSeq systems by plotting the difference in the number of samples in which drug resistance was detected using each assay versus the average of the total number of samples in which mutations were detected using both the assays.

3. Results

3.1. Patient Characteristics

The general characteristics of the 35 infected patients were as follows: 27 men and 8 women (sex ratio: 0.3), aged from 7 to 64 years (median: 42 years). The HIV subtype found in the samples was mainly B, with a median HIV-1 viral load of 3000 cp/mL and a range of 199,728 cp/mL. In the analysis, we investigated a total of 28 NRTI, 25 NNRTI, 25 PI, and 10 integrase gene unique DRM variants across the 40 (35 test samples and 5 CAP-PT) samples in multiple runs.

3.2. Performance Metrics of Vela NGS Sequencing

To compare the outcomes of the Sentosa® SQ HIV Genotyping Assay with the gold standard Abbott ViroSeq, 40 samples were tested with both the technologies. All samples passed quality controls on the Sentosa® NGS platform. The Sentosa® SQ HIV Genotyping Assay identified the presence of several drug resistance mutations (DRMs) in the reverse transcriptase, protease, and integrase regions. Figure 2 provides a detailed breakdown of the most prevalent DRMs identified by the Sentosa® assay. In the NRTI region, the M184V (30%) mutation was the most frequently observed, followed by the M41L (18.33%) mutation, within the tested samples, leading to reduced susceptibility to 3TC, FTC, AZT, TDF, and D4T. In the NNRTI region, the K103N mutation was most common (28%), followed by Y181C (11.67%), resulting in resistance to the NPV, EFV, ETR, and RPV drugs. However, all mutations exhibited similar frequencies in the protease region except for L10FI and L76V, which confer resistance to ATV, DRV, FPV, IDV, LPV, NFV, and TPV. In the integrase region, the highest frequency of occurrence was associated with the S147G mutation (6.67%), followed by E138G (5%). S147G is known to cause resistance to the EVG drug, while E148G reduces the effectiveness of the ETR, RPV, NPV, and EFV drugs.

3.3. Comparison of Vela NGS System and Sanger Sequencing

Complete concordance (100%) was observed between the two sequencing methods for the detection of these 43 DRMs (Table 1). Specifically, 7 DRMs were identified in the PI gene region, 16 in NNRTI, 12 in NRTI, and 8 in the integrase gene region. The proportion of DRMs varied by gene region, with 16.6% of PI variants, 35.7% of NNRTI, 28.57% of NRTI, and 19.04% of integrase variants. Notably, certain mutations were exclusively detected by Vela NGS and not by Abbott. Within the NRTI region, E44D and K70EG were identified, within the NNRTI region, H22Y1, N348I, and V179I were found, and within the integrase region, E92Q was observed solely through NGS and not detected by Abbott.
In order to assess the comparative performance of the two systems, a Bland–Altman analysis was conducted as presented in Table 1 (Figure 3). The analysis revealed a negligible bias of 0.06, with upper and lower limits of agreement at 2.11 and −1.986, respectively. These findings indicate a high level of agreement between the Vela NGS platform and the Abbott ViroSeq system in detecting drug resistance mutations.

3.4. Precision Analysis of Vela NGS System

Intra-assay evaluations were conducted through repeated runs within the same assay to assess reproducibility, and inter-assay evaluations between different runs to evaluate repeatability, using the Sentosa® SQ301 sequencing instrument.

3.4.1. Determination of Limit of Detection (LOD) and Intra-Assay Reproducibility

The plasma of a patient sample (viral load 18,860 cp/mL) was diluted with 0.9% NaCl to six concentrations (2000 cp/mL, 1000 cp/mL, 750 cp/mL, 500 cp/mL, 250 cp/mL, and 100 cp/mL) which were tested in a run to evaluate LOD and intra-assay repeatability performance (Table 2). In the intra-run analysis, sample 17_5913 was used. Since the Sentosa system requires unique sample codes for adding samples to the run sheet, this sample was assigned different sample IDs for the analysis, as shown in the table. The viral load requirements suggested by the supplier (HIV-1 RNA > 1000 cp/mL) were fulfilled for two out of six samples. However, all samples passed quality control criteria and the Sentosa® NGS platform reported no warning messages. Sequencing analysis of the diluted samples revealed no change in assay sensitivity with sample dilution. It is worth noting that all samples provided overlapping results, with no mismatches in variant detection. The result suggested that drug resistance mutation was reliably detected with a sample input concentration 10-fold lower than that recommended by Vela Dx (1000 copies/mL). A total of nine variants were detected; six were DRMs observed in RT regions.

3.4.2. Inter-Assay Accuracy

To assess the Sentosa® SQ HIV Genotyping inter-assay repeatability, four clinical samples were tested in triplicate (Table 3). In the inter-run analysis, samples 5913, 6049, 6050, and 7072 were used. As explained above, these samples were assigned different names for the analysis, as shown in the table. The patients had a viral load range of 2000–10,000 cp/mL. Overall, 11 DRMs were identified (7 NNRTI and 5 NRTI in the RT region) and 12 minor variants were found, mostly in the protease region. More significantly, no mismatches were detected for all the patients. A complete concordance in inter-assay variant frequencies was observed for each region.
Also, the overall accuracy of the assay was determined by calculating the percentage positive agreement (PPA), negative percentage agreement (NPA), positive predictive value (PPV), and negative predictive value (NPV) for each variant type (Table 4).

4. Discussion

In the present study, we conducted a comprehensive validation of the analytical capabilities of the Vela NGS platform, designed for automated HIV genotyping from plasma samples, encompassing the identification and quantification of resistance mutations. We compared the performance of the NGS system against the prevailing gold standard method, the Abbott ViroSeq Sanger sequencing, coupled with the Integrase software. Our evaluation included the technical proficiency of the NGS assay and the potential ramifications of adopting the Sanger sequencing approach on clinical patient management. The technical appraisal revealed the robustness of the Vela HIV-1 genotyping assay, showcasing performance parity with the established Sanger sequencing method in detecting various variants of the viral population. Furthermore, the NGS methodology exhibited an exceptional capability in uncovering additional variants compared to Sanger sequencing. These observations resonate with previous studies, notably Weber et al., whose investigations similarly highlighted the concordance between Sanger and Vela NGS sequencing in detecting DRMs, albeit with the NGS method detecting a higher proportion thereof [14].
The Vela NGS system demonstrated robust detection capabilities, particularly in identifying the majority variants within subtype B at a 100–2000 copies/mL viral load range. In contrast, the Abbott Viroseq HIV-1 Integrase Genotyping kit fails to provide reliable results when the viral load is below 500 copies/mL [15], highlighting a limitation in its detection capability. For instance, while the Genotyping System typically requires a viral load surpassing 2000 copies/mL for effective mutation detection [16], here, we show that the Vela NGS system successfully identified mutations in samples with viral loads as low as 100 copies/mL. By surpassing the limitations of conventional methods, we demonstrate the reliability of the Vela NGS system even in cases when HIV-1 viremia falls below the threshold specified by the manufacturer’s package insert (1000 copies/mL). This underscores its utility in clinical settings for accurate and sensitive HIV-1 mutation detection, facilitating more effective patient management and treatment strategies. The mutations detected at lower levels can help in early detection and thus initiation of therapy for better patient outcomes.
The Vela NGS system also exhibits higher sensitivity in detecting drug resistance mutations (DRMs) compared to Abbott, even when tested in duplicate and triplicate. As shown in Table 1, Vela NGS revealed specific mutations that were not identified by the Abbott assay. Notable mutations within the NRTI region included E44D and K70EG. In the NNRTI region, H22Y1, N348I, and V179I were observed. Additionally, within the integrase region, E92Q was solely identified through NGS, eluding detection by Abbott. The E44D/A are accessory mutations that generally occur with type I TAM (Thymidine analog mutations). These mutations occur in about 1% of viruses from untreated patients and in a significantly higher proportion of viruses from patients receiving NRTI [17]. In the Neubert et al. (2017) study, a patient diagnosed at age 13 harbored a virus carrying the NRTI mutation K70EG along with M184V and the NNRTI mutation K103N [18]. In the NNRTI region, H22Y1 was found to be rare as there was a paucity of data in the literature; however, N348I is a well-established amino acid mutation in connection with the subdomain of HIV1 RT which confers multiclass resistance to NRTI and NNRTI [19]. In the case of V179I, a study found it to be significantly higher in subtype C patients treated with either efavirenz or nevirapine [20]. However, in our study, it was higher in subtype B patients. N155H emerged as a major resistance pathway to first-generation integrase strand transfer inhibitors (INSTIs) within the integrase region, often accompanied by secondary mutations. Anstett et al. demonstrated that while certain mutations like T97A, E157Q, or G163R improved affinity, compensatory mutations such as L74M or E92Q negatively affected enzyme efficiency and viral infectivity in an N155H-R263K background under continued second-generation INSTI pressure [21].
Also, the Bland–Altman analysis revealed a minimal bias of 0.06, with narrow limits of agreement (2.11 and −1.986), indicating a high consistency between Vela NGS and Abbott ViroSeq in detecting drug resistance mutations. This suggests that Vela NGS can serve as a reliable alternative to Abbott ViroSeq. Furthermore, ViroSeq employs distinct kits and software algorithms for HIV and Integrase analysis, necessitating additional procedural steps and potentially elevating error rates. In contrast, the Vela NGS system offers a streamlined workflow encompassing comprehensive analysis within a singular platform. Leveraging automated RNA extraction, precise PCR reagent distribution, seamless library preparation, and advanced bioinformatics analysis, Vela’s solution markedly reduces operational time and minimizes the likelihood of human error. Furthermore, in contrast to other studies comprising Vela NGS system validation [11,12,13], our study successfully obtained genotyping results from all the samples (40/40) with a 100% success rate. Most importantly, we utilized CAP material as the reference material, which is crucial in clinical settings for effectively validating an in vitro diagnostic (IVD) test.
Our analysis reveals specific mutations exclusively detected by Vela NGS, notably within the NRTI, NNRTI, and integrase regions, highlighting its efficacy in identifying diverse mutations critical for treatment selection and patient management. These findings underscore the clinical utility of the Vela NGS system in advancing HIV care, offering enhanced detection sensitivity and a streamlined workflow for improved patient outcomes.

5. Limitations and Suggestions

Despite the rigorous methodology employed in this study, there are several limitations which need to be acknowledged.

5.1. Sample Size Considerations

Despite the rigorous methodology employed in this study, the sample size used for validation could have been expanded. Future studies should aim to validate findings on a larger, more diverse cohort to enhance statistical power and generalizability.

5.2. Focus on Subtype B

This study primarily discusses drug resistance in HIV subtype B, limiting insights into other HIV subtypes. To broaden applicability, research should encompass additional HIV subtypes beyond subtype B, such as A, C, and recombinant forms.

5.3. Generalizability Issues

The findings may be limited by specific cohort characteristics, such as demographics and geographic location. Efforts to replicate findings in diverse populations will validate the robustness of the NGS system across varied contexts.

6. Conclusions

The study unequivocally validates the efficacy of the Vela Diagnostics Ion Torrent-based NGS platform for HIV-1 genotyping. Demonstrating comparable performance to the established Sanger sequencing method, the Vela system offers an additional advantage by detecting additional DRMs and has a streamlined workflow, thereby enhancing HIV-1 patient management strategies. Furthermore, the system’s integrated data analysis represents significant advancements, rendering the technology more accessible to laboratories lacking in-house expertise for laborious workflows or intricate bioinformatics analyses typically associated with NGS methodologies. This accessibility democratizes advanced NGS genotyping techniques, promising to broaden their application and impact across diverse clinical settings.

Author Contributions

Conceptualization, A.V., A.K.M. and R.K.; methodology, A.V., A.K.M., S.A., A.A. and K.J.; software, A.K.M., V.V., S.A. and A.A.; validation, A.V., A.K.M. and V.V.; formal analysis, A.V., A.K.M. and V.V.; investigation, A.V. and A.K.M.; resources, R.K.; data curation, A.K.M. and V.V.; writing—A.V. and A.K.M.; writing—review and editing, V.V. and J.K.F.; visualization, A.K.M. and V.V.; supervision, R.K.; project administration, R.K.; funding acquisition, R.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Ethical review and approval for this study was provided by the Augusta University IRB under protocol 611298 (4 April 2018). These were banked leftover samples after clinical diagnosis at the CLIA lab, which were de-identified and coded prior to use for research.

Informed Consent Statement

Patient consent was waived due to the fact that these were banked leftover samples after clinical diagnosis at the CLIA lab.

Data Availability Statement

The original contributions presented in the study are included in the article, further inquiries can be directed to the corresponding author.

Conflicts of Interest

Sudha Ananth was employed by the company Illumina. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

  1. World Health Organization. Global Health Sector Strategies on, Respectively, HIV, Viral Hepatitis and Sexually Transmitted Infections for the Period 2022–2030. 2022. Available online: https://apps.who.int/iris/handle/10665/360348 (accessed on 1 March 2024).
  2. UNAIDS Fact Sheet. Available online: https://www.unaids.org/en/resources/fact-sheet (accessed on 10 January 2024).
  3. Gutiérrez-Sevilla, J.E.; Cárdenas-Bedoya, J.; Escoto-Delgadillo, M.; Zúñiga-González, G.M.; Pérez-Ríos, A.M.; Gómez-Meda, B.C.; González-Enríquez, G.C.; Figarola-Centurión, I.; Chavarría-Avila, E.; Torres-Mendoza, B.M. Genomic instability in people living with HIV. Mutat. Res. Genet. Toxicol. Environ. Mutagenes. 2021, 865, 503336. [Google Scholar] [CrossRef] [PubMed]
  4. De Clercq, E.; Li, G. Approved antiviral drugs over the past 50 years. Clin. Microbiol. Rev. 2016, 29, 695–747. [Google Scholar] [CrossRef] [PubMed]
  5. Galli, L.; Parisi, M.R.; Poli, A.; Menozzi, M.; Fiscon, M.; Garlassi, E.; Francisci, D.; Di Biagio, A.; Sterrantino, G.; Fornabaio, C.; et al. Burden of disease in PWH harboring a multidrug-resistant virus: Data from the PRESTIGIO registry. Open Forum Infect. Dis. 2020, 7, ofaa456. [Google Scholar] [CrossRef] [PubMed]
  6. HIV Drug Resistance Report 2021. 24 November 2021. Available online: https://www.who.int/publications/i/item/9789240038608 (accessed on 2 January 2024).
  7. Dessilly, G.; Goeminne, L.; Vandenbroucke, A.T.; Dufrasne, F.E.; Martin, A.; Kabamba-Mukadi, B. First evaluation of the Next-Generation Sequencing platform for the detection of HIV-1 drug resistance mutations in Belgium. PLoS ONE 2018, 13, e0209561. [Google Scholar] [CrossRef] [PubMed]
  8. Alidjinou, E.K.; Coulon, P.; Hallaert, C.; Robineau, O.; Meybeck, A.; Huleux, T.; Ajana, F.; Hober, D.; Bocket, L. Routine drug resistance testing in HIV-1 proviral DNA, using an automated next- generation sequencing assay. J. Clin. Virol. 2019, 121, 104207. [Google Scholar] [CrossRef] [PubMed]
  9. Ji, H.; Sandstrom, P.; Paredes, R.; Harrigan, P.R.; Brumme, C.J.; Avila Rios, S.; Noguera-Julian, M.; Parkin, N.; Kantor, R. Are we ready for NGS HIV drug resistance testing? The second “winnipeg consensus” symposium. Viruses 2020, 12, 586. [Google Scholar] [CrossRef] [PubMed]
  10. Ávila-Ríos, S.; Parkin, N.; Swanstrom, R.; Paredes, R.; Shafer, R.; Ji, H.; Kantor, R. Next-generation sequencing for HIV drug resistance testing: Laboratory, clinical, and implementation considerations. Viruses 2020, 12, 617. [Google Scholar] [CrossRef] [PubMed]
  11. May, S.; Adamska, E.; Tang, J. Evaluation of Vela Diagnostics HIV-1 genotyping assay on an automated next generation sequencing platform. J. Clin. Virol. 2020, 127, 104376. [Google Scholar] [CrossRef] [PubMed]
  12. Gholami, M.; Rouzbahani, N.; Samiee, S.; Tayeri, K.; Ghorban, K.; Dehkharghani, A.D.; Gholami, A.A.; Moshiri, F.; Sattari, A.; Dadmanesh, M.; et al. HIV-1 drug resistance mutations detection and HIV-1 subtype G report by using next-generation sequencing platform. Microb. Pathog. 2020, 146, 104221. [Google Scholar] [CrossRef] [PubMed]
  13. Raymond, S.; Nicot, F.; Abravanel, F.; Minier, L.; Carcenac, R.; Lefebvre, C.; Harter, A.; Martin-Blondel, G.; Delobel, P.; Izopet, J. Performance evaluation of the Vela Dx Sentosa next-generation sequencing system for HIV-1 DNA genotypic resistance. J. Clin. Virol. 2020, 122, 104229. [Google Scholar] [CrossRef] [PubMed]
  14. Weber, J.; Volkova, I.; Sahoo, M.K.; Tzou, P.L.; Shafer, R.W.; Pinsky, B.A. Prospective evaluation of the Vela Diagnostics next-generation sequencing platform for HIV-1 genotypic resistance testing. J. Mol. Diagn. 2019, 21, 961–970. [Google Scholar] [CrossRef] [PubMed]
  15. ViroSeq TM HIV-1 Integrase Genotyping Kit Product Inserts; Abbott Molecular Inc.: Des Plaines, IL, USA. Available online: www.abbottmolecular.com (accessed on 20 April 2018).
  16. ViroSeq TM HIV-1 Genotyping System v2.0 Product Insert; Abbott Molecular Inc.: Des Plaines, IL, USA. Available online: www.abbottmolecular.com (accessed on 20 April 2018).
  17. Delaugerre, C.; Mouroux, M.; Yvon-Groussin, A.; Simon, A.; Angleraud, F.; Huraux, J.M.; Agut, H.; Katlama, C.; Calvez, V. Prevalence and conditions of selection of E44D/A and V118I human immunodeficiency virus type 1 reverse transcriptase mutations in clinical practice. Antimicrob. Agents Chemother. 2001, 45, 946–948. [Google Scholar] [CrossRef] [PubMed]
  18. Neubert, J.; Michalsky, N.; Laws, H.J.; Borkhardt, A.; Jensen, B.; Lübke, N. HIV-1 Subtype diversity and prevalence of primary drug resistance in a single-center pediatric cohort in Germany. Intervirology 2017, 59, 301–306. [Google Scholar] [CrossRef] [PubMed]
  19. Hachiya, A.; Kodama, E.N.; Sarafianos, S.G.; Schuckmann, M.M.; Sakagami, Y.; Matsuoka, M.; Takiguchi, M.; Gatanaga, H.; Oka, S. Amino acid mutation N348I in the connection subdomain of human immunodeficiency virus type 1 reverse transcriptase confers multiclass resistance to nucleoside and nonnucleoside reverse transcriptase inhibitors. J. Virol. 2008, 82, 3261–3270. [Google Scholar] [CrossRef] [PubMed]
  20. Grossman, Z.; Istomin, V.; Averbuch, D.; Lorber, M.; Risenberg, K.; Levi, I.; Chowers, M.; Burke, M.; Bar Yaacov, N.; Schapiro, J.M.; et al. Genetic variation at NNRTI resistance-associated positions in patients infected with HIV-1 subtype C. AIDS 2004, 18, 909–915. [Google Scholar] [CrossRef] [PubMed]
  21. Singhroy, D.N.; Wainberg, M.A.; Mesplède, T. Combination of the R263K and M184I/V resistance substitutions against dolutegravir and lamivudine decreases HIV replicative capacity. Antimicrob. Agents Chemother. 2015, 59, 2882–2885. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Schematic representation of the steps involved in the workflow of Vela NGS sample preparation, sequencing, and reporting.
Figure 1. Schematic representation of the steps involved in the workflow of Vela NGS sample preparation, sequencing, and reporting.
Diagnostics 14 01766 g001
Figure 2. Frequency of the occurrence of DRMs in the (a) NRTI, (b) NNRTI, (c) PI, and (d) IN regions among the 40 samples.
Figure 2. Frequency of the occurrence of DRMs in the (a) NRTI, (b) NNRTI, (c) PI, and (d) IN regions among the 40 samples.
Diagnostics 14 01766 g002
Figure 3. A Bland–Altman plot was used to assess the agreement (how closely the measurements obtained from the two different methods or systems align with each other) between the Vela NGS and Abbott ViroSeq systems by plotting the differences between them against their average. Individual data points, depicted as black dots, represent differences in values obtained from both techniques for identical mutations. The central thick line represents the zero bias, while the dotted lines above and below denote the resulting bias (depicting that one method consistently measures higher or lower values compared to the other method). The clustering of these dots around the zero-difference line indicates an overall statistically significant agreement between the systems. The upper (UL) and lower limits (LL) of agreement are shown by a colored area representing the range within which 95% of the differences between measurements from the two systems fall.
Figure 3. A Bland–Altman plot was used to assess the agreement (how closely the measurements obtained from the two different methods or systems align with each other) between the Vela NGS and Abbott ViroSeq systems by plotting the differences between them against their average. Individual data points, depicted as black dots, represent differences in values obtained from both techniques for identical mutations. The central thick line represents the zero bias, while the dotted lines above and below denote the resulting bias (depicting that one method consistently measures higher or lower values compared to the other method). The clustering of these dots around the zero-difference line indicates an overall statistically significant agreement between the systems. The upper (UL) and lower limits (LL) of agreement are shown by a colored area representing the range within which 95% of the differences between measurements from the two systems fall.
Diagnostics 14 01766 g003
Table 1. Summary of all drug resistance mutations detected in patient samples by Vela NGS and Abbott ViroSeq.
Table 1. Summary of all drug resistance mutations detected in patient samples by Vela NGS and Abbott ViroSeq.
MutationNo. of Patient Samples Positive for the Mutation Gene Regions
Vela NGSAbbott ViroSeq
E138G/Q44IN
E157Q22IN
E92Q10IN
G140A23IN
K156N11IN
L74M11IN
N155H22IN
Q148K23IN
S147G44IN
T66I11IN
T97A11IN
A98G22NNRTI
E138A/K22NNRTI
G190A35NNRTI
H221Y20NNRTI
K101E11NNRTI
K103N/S1821NNRTI
K238T11NNRTI
L100I12NNRTI
M230L11NNRTI
N348I30NNRTI
P225H53NNRTI
V106I34NNRTI
V108I11NNRTI
V179D/F44NNRTI
V179I20NNRTI
V90I44NNRTI
Y181C75NNRTI
Y188L33NNRTI
Y318F11NNRTI
A62V11NRTI
D67N87NRTI
E44D20NRTI
F116Y11NRTI
F77L11NRTI
K219E/Q76NRTI
K65R11NRTI
K70EG10NRTI
K70R54NRTI
L210S10NRTI
L210W55NRTI
L74I34NRTI
M184I44NRTI
M184V1718NRTI
M41L1111NRTI
Q151M11NRTI
T215C/E/F77NRTI
T69D45NRTI
T69N33NRTI
T69S23NRTI
V75I11NRTI
Y115F22NRTI
I147V43PI
I54L44PI
I84V55PI
L10FI14PI
L90M11PI
M46I44PI
N88S11PI
V32I44PI
V82A44PI
Table 2. Evaluation of limit of detection (LOD) and intra-assay repeatability performance for various viral load concentrations.
Table 2. Evaluation of limit of detection (LOD) and intra-assay repeatability performance for various viral load concentrations.
Run IDSample IDViral Load (cp/mL)NRTINNRTIPIINT
1_ENEWL18-16282000K65R, Y115FK101E, E138Q, V179F, Y181COther: M36I, L63POther: K156N
1_ENEWL18-16291000K65R, Y115FK101E, E138Q, V179F, Y181COther: M36I, L63PK156N
1_ENEWL18-1630750K65R, Y115FK101E, E138Q, V179F, Y181COther: M36I, L63PK156N
1_ENEWL18-1631500K65R, Y115FK101E, E138Q, V179F, Y181COther: M36I, L63PK156N
1_ENEWL18-1632250K65R, Y115FK101E, E138Q, V179F, Y181COther: M36I, L63PK156N
1_ENEWL18-1633100K65R, Y115FK101E, E138Q, V179F, Y181COther: M36I, L63PK156N
Table 3. Inter-assay accuracy for various viral load concentrations in replicates.
Table 3. Inter-assay accuracy for various viral load concentrations in replicates.
Run IDSample ID Viral Load NRTI NNRTIPIINT
1_ENEWL 18-1628
(17-5913)
2000K65R, Y115FK101E, E138Q, V179F, Y181COthers: M36I, L63P, I62VOther: K156N
2_LKED2 18-4707
(17-5913)
2000K65R, Y115FK101E, E138Q, V179F, Y181COthers: M36I, L63P, I62VOther: K156N
3_QPWOE 18-4757
(17-5913)
2000K65R, Y115FK101E, E138Q, V179F, Y181COthers: M36I, L63POther: K156N
1_ENEWL 18-1635
(17-6049)
4000M184VOther: V901I, V118IOther: V77IE92Q
Other: K156N
2_LKED2 18-4708
(17-6049)
8277M184VOther: V901I, V118IOther: V77IK156N
3_QPWOE 18-4758
(17-6049)
8277M184VOther: V901I, V118IOther: V77IK156N
1_ENEWL 18-1636
(17-6050)
10,000-V179D, G190A, Y318F Other: V90I, V106IOther: M36I, L63POther: T206S
2_LKED2 18-4709
(17-6050)
10,000-V179D, G190A, Y318F Other: V90I, V106IOther: M36I, L63POther: G193E, T206S
3_QPWOE 18-4759
(17-6050)
10,000-V179D, G190A, Y318F Other: V90I, V106IOther: M36I, L63POther: T206S
1_ENEWL 18-1639
(17-7072)
10,000M41L, T215E-Others: M36I, L63P, I64LM, I93L-
2_LKED2 18-4710
(17-7072)
10,000M41L, T215E-Others: M36I, L63P, I64LM, I93L-
3_QPWOE 18-4760
(17-7072)
10,000M41L, T215E-Others: M36I, L63P, I64LM, I93L-
Table 4. Overall accuracy (sensitivity and specificity) determination of the assay by calculating positive and negative agreement and predictive values (n = 35 samples).
Table 4. Overall accuracy (sensitivity and specificity) determination of the assay by calculating positive and negative agreement and predictive values (n = 35 samples).
PPA = TP/(TP + FN) (Sensitivity)NPA = TN/(TN + FP) (Specificity)PPV = TP/(TP + FP)NPV = TN/(TN + FN)
NRTI DR Mutation100%100%100%100%
NNRTI DR Mutation100%100%100%100%
PI DR Mutation100%100%100%100%
Integrase100%100%100%100%
TP = True Positive (positive outcome when the mutation is indeed present); TN = True Negative (negative outcome when the mutation is indeed absent); FP = False Positive (incorrectly indicates the presence of a mutation when it is absent); FN = False Negative (incorrectly indicates the absence of a mutation when it is present); PPV = Positive Predictive Value (the likelihood that a positive mutation detection result accurately indicates the presence of that mutation); NPV = Negative Predictive Value (the likelihood that a negative mutation detection result accurately indicates the absence of that mutation).
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Vashisht, A.; Mondal, A.K.; Vashisht, V.; Ananth, S.; Alptekin, A.; Jones, K.; Farmaha, J.K.; Kolhe, R. Enhancing Precision in HIV Treatment: Validation of a Robust Next-Generation Sequencing System for Drug Resistance Mutation Analysis. Diagnostics 2024, 14, 1766. https://doi.org/10.3390/diagnostics14161766

AMA Style

Vashisht A, Mondal AK, Vashisht V, Ananth S, Alptekin A, Jones K, Farmaha JK, Kolhe R. Enhancing Precision in HIV Treatment: Validation of a Robust Next-Generation Sequencing System for Drug Resistance Mutation Analysis. Diagnostics. 2024; 14(16):1766. https://doi.org/10.3390/diagnostics14161766

Chicago/Turabian Style

Vashisht, Ashutosh, Ashis K. Mondal, Vishakha Vashisht, Sudha Ananth, Ahmet Alptekin, Kimya Jones, Jaspreet K. Farmaha, and Ravindra Kolhe. 2024. "Enhancing Precision in HIV Treatment: Validation of a Robust Next-Generation Sequencing System for Drug Resistance Mutation Analysis" Diagnostics 14, no. 16: 1766. https://doi.org/10.3390/diagnostics14161766

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Article metric data becomes available approximately 24 hours after publication online.
Back to TopTop