Next Article in Journal
Clinical Presentations, Pathogenesis, and Therapy of Sarcoidosis: State of the Art
Next Article in Special Issue
Attenuated Total Reflectance Fourier Transform Infrared Spectroscopy (FTIR) and Artificial Neural Networks Applied to Investigate Quantitative Changes of Selected Soluble Biomarkers, Correlated with H. pylori Infection in Children and Presumable Consequent Delayed Growth
Previous Article in Journal
Platelet Functions During Extracorporeal Membrane Oxygenation. Platelet–Leukocyte Aggregates Analyzed by Flow Cytometry as a Promising Tool to Monitor Platelet Activation
Previous Article in Special Issue
A Proteomics-Based Analysis Reveals Predictive Biological Patterns in Fabry Disease
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Rapid Phenotype-Driven Gene Sequencing with the NeoSeq Panel: A Diagnostic Tool for Critically Ill Newborns with Suspected Genetic Disease

by
María José de Castro
1,2,3,4,
Emiliano González-Vioque
1,2,3,
Sofía Barbosa-Gouveia
1,2,
Enrique Salguero
5,
Segundo Rite
6,
Olalla López-Suárez
1,4,
Alejandro Pérez-Muñuzuri
1,4 and
María-Luz Couce
1,2,3,4,*
1
Diagnosis and Treatment of Congenital Metabolic Diseases Unit (UDyTEMC), Neonatology Division, Department of Pediatrics, Clinical University Hospital of Santiago de Compostela, IDIS-Health Research Institute of Santiago de Compostela, 15706 Santiago de Compostela, Spain
2
Centro de Investigación Biomédica en Red (CIBER)—CIBER DE ENFERMEDADES RARAS (CIBERER),, Pabellón 11, 28029 Madrid, Spain
3
MetabERN, Via Pozzuolo, 330, 33100 Udine, Italy
4
Faculty of Medicine, University of Santiago de Compostela, 15706 Santiago de Compostela, Spain
5
Neonatology Department, Malaga Regional Hospital, Malaga Biomedical Research Institute-IBIMA, 29011 Malaga, Spain
6
Neonatology Unit, Miguel Servet University Hospital, 50009 Zaragoza, Spain
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2020, 9(8), 2362; https://doi.org/10.3390/jcm9082362
Submission received: 27 June 2020 / Revised: 20 July 2020 / Accepted: 21 July 2020 / Published: 23 July 2020
(This article belongs to the Special Issue Advanced Analytical Methods in Clinical Diagnosis and Therapy 2.0)

Abstract

:
New genomic sequencing techniques have shown considerable promise in the field of neonatology, increasing the diagnostic rate and reducing time to diagnosis. However, several obstacles have hindered the incorporation of this technology into routine clinical practice. We prospectively evaluated the diagnostic rate and diagnostic turnaround time achieved in newborns with suspected genetic diseases using a rapid phenotype-driven gene panel (NeoSeq) containing 1870 genes implicated in congenital malformations and neurological and metabolic disorders of early onset (<2 months of age). Of the 33 newborns recruited, a genomic diagnosis was established for 13 (39.4%) patients (median diagnostic turnaround time, 7.5 days), resulting in clinical management changes in 10 (76.9%) patients. An analysis of 12 previous prospective massive sequencing studies (whole genome (WGS), whole exome (WES), and clinical exome (CES) sequencing) in newborns admitted to neonatal intensive care units (NICUs) with suspected genetic disorders revealed a comparable median diagnostic rate (37.2%), but a higher median diagnostic turnaround time (22.3 days) than that obtained with NeoSeq. Our phenotype-driven gene panel, which is specific for genetic diseases in critically ill newborns is an affordable alternative to WGS and WES that offers comparable diagnostic efficacy, supporting its implementation as a first-tier genetic test in NICUs.

1. Introduction

While genetic disease is suspected in over 50% of the children who are admitted to neonatal intensive care units (NICUs) and die during the first year of life, diagnosis is confirmed in only 20%–30% of cases, often post-mortem [1,2]. Multiple factors hinder genetic diagnosis in neonates, including genetic heterogeneity, there are over 5587 known genetic diseases [3], clinical heterogeneity (e.g., the appearance of formes frustes of classical phenotypes) [4,5], and comorbidity due to the increased fragility of neonates [6,7]. Moreover, disease tends to progress faster in neonates than in other stages of life.
Technological advances in gene sequencing have enabled rapid reading of any part of the genome at an affordable price [8,9]. NICUs are a key target for the implementation of genomic tools [10,11]. Timely and specific diagnosis of newborns can have critical implications for health and wellbeing for the remainder of an infant’s life. The few pilot studies focused on the use of this technology that have been conducted in NICU settings [12,13,14,15,16,17,18,19,20,21,22,23] have yielded highly promising results. Nonetheless, further advances in this field will be required to make precision, personalized, and predictive medicine a reality. In particular, integration and interpretation of the data produced by genomic sequencing is a key obstacle to the incorporation of these strategies into clinical routine practice [24,25]. However, phenotype-based filtering and prioritization could greatly facilitate the interpretation of genetic variants detected by genome sequencing [26,27].
In this pilot study, we evaluated the utility of rapid selective gene panel trio sequencing in critically ill newborns with suspected genetic disorders. We created a specific gene panel, NeoSeq, consisting of 1870 human genes associated with neurological or metabolic disorders and congenital malformations of early onset (i.e., during the first two months of life). We hypothesized that a rapid gene panel consisting of genes of known function, with established associations with diseases of early onset, could simplify data interpretation while offering diagnostic rates comparable to those achieved using whole genome sequencing (WGS), whole exome sequencing (WES), or clinical exome sequencing (CES). Here, we describe the diagnostic rate and turnaround time achieved using this approach, the prevalence and inheritance patterns of the diagnosed diseases, and the effect of a positive molecular diagnosis on patient clinical management. Furthermore, we compare our results with those of similar prospective studies using next generation sequencing (NGS) technologies in cohorts of critically ill newborns.

2. Methods

2.1. Study Design

This multicenter prospective study included consecutive patients who were admitted to a level IIIB/C NICU in three Spanish reference hospitals during a 24 months period. Patients underwent selective genetic screening for early diagnosis. Participants for this study were recruited through the Clinical University Hospital of Santiago, Malaga Regional Hospital, and the Miguel Servet Clinical University Hospital, with the approval of the Santiago-Lugo Research Ethics Committee (2018/366). Written informed consent was obtained from the legal guardians of all participating patients upon enrolment in the study. Participants for this study were recruited through the Clinical University Hospital of Santiago de Compostela, Malaga Regional Hospital, and the Miguel Servet Clinical University Hospital, with the approval of the Santiago-Lugo Research Ethics Committee (2018/366).

2.2. Study Population

Critically ill patients of less than two months of age who met one or more of the following criteria were considered eligible for inclusion: (i) Congenital malformations not obviously related to a clinically identifiable genetic syndrome, (ii) metabolic decompensation not associated with biochemical parameters and/or neonatal screening indicating suspected hereditary metabolic disease, (iii) epilepsy or neurodevelopmental diseases of probable genetic origin. Individuals with clear indications of a specific syndrome that could be tested by targeted analysis of known genes or structural variations were excluded from the study.

2.3. Study Variables

For each patient, the following variables were evaluated: Family history, consanguinity data, maternal obstetric history, sex, anthropometric parameters, age of symptom onset, clinical signs and symptoms presented, laboratory test parameters, imaging variables and additional tests carried out to identify the underlying disease, treatments administered (pharmacological, nutritional, respiratory support, dialysis, or other invasive measures), genetic analyses of patient and parents. A list of possible differential diagnoses was generated based on the clinical findings obtained using the Phenomizer clinical diagnostics application (compbio.charite.de/phenomizer/) [28]. Upon obtaining the results of the genetic study, the clinical and molecular variables were correlated.

2.4. Statistical Analysis

The Chi-squared test was used to compare diagnostic rates between groups. Phenomizer was used to identify candidate diseases based on the clinical features of each patient. p-values were estimated by Monte Carlo random sampling and corrected for multiple testing using the Benjamini and Hochberg method. A p-value < 0.05 was considered statistically significant.

2.5. Procedures

Blood sample collection from patient and parents. A 3-mL sample of blood per individual from the trio (patient and parents) to be analyzed was collected in an ethylenediaminetetraacetic (EDTA) tube (BD. Franklin Lakes, NJ, US) and transported by express courier from the patient’s reference hospital at room temperature in a padded, hermetically sealed envelope.
Genetic testing. DNA was isolated from 400 μL of fresh blood in EDTA following standard procedures. Enrichment for focused exome analysis covering the exons and flanking introns (±10 pb) of 1870 genes associated with metabolic, neurological, and dysmorphic diseases of infants (NeoSeq, Table S1) was carried out using the SureDesign tool (Agilent Technologies Inc., Santa Clara, CA, USA). Candidate genes were selected by a multidisciplinary team meeting (MDT), which included research bioinformatics analysts, clinical geneticists, neonatal intensivists, neurologists and pediatricians specialized in inborn errors of metabolism. Enriched libraries were sequenced on the NextSeq platform (Illumina Inc., San Diego, CA, USA) following the manufacturer recommendations to achieve an average coverage of 100X using the NextSeq 500/550 Mid Output V2 kit, (Illumina Inc., San Diego, CA, USA), (150 cycles), which provides 18 Gb of sequence data. For each NextSeq run, a single trio was sequenced.
Variant annotation and filtering were performed using pipelines developed in-house (see Appendix A for detailed description).

3. Results

Between the period of January 2018 and December 2019, 51 newborns were admitted to the NICU with a suspected diagnosis of genetic disease. Of the identified newborns, 10 of them were excluded due to clear indications of a specific syndrome that could be tested by targeted analysis of known genes or structural variations. A total of 41 families were approached and offered genomic analysis with NeoSeq. Of them, 37 families consented to join the study. Of the recruited patients, four newborns were not sequenced because the genetic study of the parents was not available. Finally, 33 newborns (16 females and 17 males) met our inclusion criteria and were included in the study (Supplementary Figure S1). The median age at inclusion was 26 days (range, four days to two months). Two patients died before conclusion of the study, one prior to diagnosis and the other after diagnosis was established and palliative care initiated. For all patients, DNA was obtained from both parents. All probands were phenotyped using human phenotype ontology (HPO) terms extracted manually from electronic health records. The median number of HPO terms per proband was four, and 58% of patients had at least four terms. Based on the predominant presenting clinical symptoms, patients were classified into the following groups: Congenital anomalies (n = 8), neurological symptoms, including encephalopathy, developmental regression, seizures, and hypotonia (n = 17), suspected metabolic diseases (n = 7), and severe intrauterine growth retardation (n = 1). We observed no significant differences in rates of diagnosis between groups (p = 0.572). For each of the 33 patients included in this study, demographic data, clinical presentation, and standardized phenotypes using HPO terms are shown in Supplementary Table S2. Median diagnostic turnaround time was 7.5 days (range, 4–11 days).
A genetic diagnosis was established for 39.4% (n = 13) of our 33 patients (Table 1). Analysis of inheritance patterns revealed compound heterozygous variants in six patients for the following genes (associated autosomal recessive disorders are shown in parentheses): GFM1 (combined oxidative phosphorylation deficiency 1), SUCLA2 (mitochondrial DNA depletion syndrome 5), PNPT1 (combined oxidative phosphorylation deficiency 13), CPS1 (Carbamoyl-phosphate synthetase 1[CPS1] deficiency), COQ4 (primary coenzyme Q10 deficiency), and ERBB3 (lethal congenital contracture syndrome type 3). We identified seven patients with heterozygous variants in the following genes (associated autosomal dominant disorders are shown in parentheses): KCNQ2 (early infantile epileptic encephalopathy 7, three patients), CHD2 (nemaline myopathy), COL4A1 (cerebral small vessel disease), and SOX10 (Waardenburg syndrome-Hirschsprung’s disease). Of these seven patients, five carried de novo variants and two had inherited the variant from a single parent, who presented a less severe phenotype. Only in 38.4% of cases was the phenotype of the newborn predicted based on the molecular diagnosis returned by Phenomizer (p < 0.05).
Likely pathogenic variants were identified in three patients but were ruled out owing to their presence in a healthy parent. These cases are presented in detail in Table 2.
Diagnoses of Prader–Willi syndrome and Steinert dystrophy were not detected in patients #20 and #21, respectively, but were established based on specific tests performed later in life as the respective diseases progressed. Patient #20 carried a deletion in the paternal allele in 15q11-q13 and patient #21 harbored a pathological expansion of 2333 CTG copies in the DMPK gene.
We next evaluated the impact of genetic diagnosis on four distinct aspects of medical management for a period of three months: (a) Redirection of care (towards withdrawal of intensive care or initiation of palliative care), (b) initiation of new subspecialist care, including additional extension/follow up studies, and (c) changes in medication or diet. We found that establishing a genomic diagnosis directly affected medical management in 12 of the 13 patients (Table 3), resulting in changes in medication or diet (10 patients), initiation of new subspecialist care (six patients), or withdrawal of intensive care treatment /initiation of palliative care (six patients). Moreover, all patients and families benefited from timely genetic counseling based on a concrete diagnosis.
Finally, we compared our results with those of previously published in prospective studies in which massive sequencing techniques (WGS, WES, CES) were applied to newborns admitted to NICUs with a suspected genetic disorder (Table 4). Our comparison included 12 studies published between 2016 and 2020. Nine were cohort studies, and three were randomized clinical trials. The selected studies applied the following sequencing techniques: CES (three studies) [12,13,17], WES (four studies) [16,18,19,23], WGS with subsequent filtering by CES (1 study) [14], WGS (three studies) [15,20,22], and WES + WGS (one study) [21]. The total number of patients included was 1073. The median diagnostic rate was 37.2% (range, 13.2%–58%). After adjusting for the NGS technology employed, the following diagnostic rates were obtained: CES, 43.2% (range, 32.4%–50.8%), WES, 40.4% (15.6%–56%), WGS with subsequent filtering by CES, 30.4%, and WGS, 32.8% (range, 13.2%–47.7%). The median diagnostic turnaround time was 22.3 days.

4. Discussion

Genomic sequencing has emerged as one of the most promising diagnostic tools in the field of neonatology. Studies have demonstrated that the adoption of this technology as a first-tier test for genetic diagnosis of severely ill newborns increases the diagnostic rate and reduces the time to diagnosis, improving outcomes while reducing health costs [29,30]. In the present study, we evaluated the diagnostic efficacy and clinical impact of NeoSeq, a gene panel that consists of 1870 genes and is specifically designed to facilitate the diagnosis of critically ill newborns with suspected genetic disorders. In total, 33 newborns and their parents underwent trio sequencing using the NeoSeq panel. Newborns with neurological symptoms comprised the largest group (n = 17), followed by those with multiple congenital anomalies (n = 8) and suspected metabolic diseases (n = 7). These phenotypic groupings corresponded to those previously described in other studies that used rapid NGS strategies to diagnose NICU patients [12,23].
The resulting diagnostic rate (13/33 patients [39.4%]) was comparable to that previously described for more extensive trio or singleton sequencing approaches, such as WES [16,21] and WGS [14,15,21,22], and even higher than that reported for WGS in NICU patients [20]. While higher diagnostic rates should be expected from WGS than WES, and from WES than CES or targeted panels, we found that the diagnostic rate does not correlate with the size of genome portion interrogated (Figure 1): NeoSeq provided diagnostic rates similar to those obtained with WGS and WES approaches, despite interrogating 10 times (WES) and 500 times (WGS) fewer bases.
Two factors may help explain these discrepancies. First, variants are usually excluded if they have no predicted or known functional consequences [31,32,33,34]. This limits the analysis to exonic or intronic variants in known disease-associated genes or variants with demonstrated pathogenicity located in noncoding regions. Consequently, the phenotype of the newborn guides the analysis to a small group of candidate genes. Therefore, regardless of how extensive the genomic analysis, genetic diagnosis is limited to a shortlist of genes [14,21] and variant types [22]. Our results, and those of others using a similar approach [17], demonstrate that a simpler approach, based in the analysis of panels of genes with known functions and disease associations, can be a useful and more cost-effective alternative to WGS or WES approaches, yielding comparable diagnostic rates. The second factor to consider is the association between the diagnostic rate and the severity of the clinical phenotype of the study participants. All patients recruited in our study were critically ill newborns that required intensive care. In two previous studies in which patients with severe and less severe disease were assigned to distinct cohorts, better outcomes were observed for the severely ill group in terms of diagnostic rate and the impact on clinical management. In the NSIGHT2 trial [21], patients were randomized into two groups, which were analyzed using rapid WES (rWES) or rapid WGS (rWGS), except for severely ill patients, who were screened using ultra-rapid WGS (urWGS). The resulting diagnostic rate was 46% in the urWGS group, as compared with 19% and 20% in the rWGS in rWES groups, respectively. Meng et al. [13] used WES to perform proband exome, trio exome, and critical trio exome sequencing (a rapid genomic assay for seriously ill infants) in three groups of infants within the first 100 days of life. The diagnostic rate in the critical trio exome group was higher than that obtained for the proband and trio exome groups. Moreover, molecular diagnoses directly affected medical management in 76.9% of patients in the critical trio exome group, as compared with 42.9% in the other groups. These results suggest that a diagnosis strategy based on the sequencing of a panel of genes associated with severe neonatal phenotypes yields better outcomes because those patients likely have a genetic disorder and can greatly benefit from accurate and early diagnosis.
In our study, we applied a family trio analysis approach (testing newborns and both parents), as this is an effective strategy to manage the wealth of genetic variants identified by NGS. This approach can be used to easily identify de novo variants, filter out rare benign familial variants, and establish inheritance patterns in recessive disorders [18,34]. We identified five de novo causative variants among our patients and, most importantly, in three cases, we ruled out potential phenotype-associated variants after detecting them in a single asymptomatic parent (see Table 2). In our cohort, two patients for whom NeoSeq failed to establish a molecular diagnosis were later diagnosed with Prader–Willi syndrome and Steinert dystrophy, respectively. This is a common limitation of current NGS technologies, including WGS and WES, which lack the capacity to identify repetitive sequences, homologous genes, and epigenetic modifications [35,36].
In addition to the diagnostic rate of 39.4% (13/33 patients), the rapid molecular diagnosis achieved with NeoSeq (mean diagnostic turnaround time, 7.5 days) impacted medical management in 92.3% of patients, as reflected in changes in medication or diet (10/13 patients), initiation of new subspecialist care (6/13 patients), or withdrawal of intensive care treatment/redirection to palliative care (6/13 patients). In two patients, NeoSeq enabled diagnosis of inborn errors of metabolism: CPS1 deficiency and primary coenzyme Q10 deficiency, allowing the early initiation of ammonia scavenger therapy combined with a protein-restricted diet [37] and coenzyme Q10 supplementation [38], respectively. In CPS1 deficiency treatment can prevent hyperammonemic crisis and adverse neurological outcomes, while in primary forms of coenzyme Q10 deficiency treatment can prevent the progression of both steroid-resistant nephrotic syndrome and encephalopathy, hence the critical importance of a prompt diagnosis. In three other patients who presented primarily with epilepsy, gene sequencing identified de novo KCNQ2 variants, for which anticonvulsant treatment with sodium channel blockers is highly recommended [39] and reduces the neurodevelopmental impairment associated with the disease. Although some of the established diagnoses did not lead to institution of effective treatments, they provided important information regarding prognosis and disease management, putting an end to a potentially lengthy diagnostic odyssey. Furthermore, a genetic diagnosis allows for testing of other at-risk family members and provision of reproductive counseling where necessary [24,40].
Analysis of diagnostic rate according to phenotype shows that neonates with neurological symptoms and suspected inborn errors of metabolism benefited most from the NeoSeq panel (diagnostic yield, 47.1% and 42.9%, respectively). By contrast, only in two patients with congenital anomalies was a definitive causative variant identified (28.6%). Phenomizer predicted a genetic diagnosis based on phenotype with statistical significance (p < 0.05) in only five patients. This rate of diagnosis prediction is similar to that reported by Brunelli et al. [17] using a targeted gene panel (40%), and higher than that reported by French et al. [20] (10%) using WGS. Based on their data, French et al. proposed agnostic analysis of genomic data, as opposed to phenotype-driven analysis. However, analyses using WGS or WES cannot be completely agnostic owing to the aforementioned limitations affecting variant interpretation.

5. Conclusions

In summary, rapid trio sequencing with our phenotype-driven gene panel specific for genetic diseases in critically ill newborns is an affordable alternative to WGS and WES that offers comparable diagnostic efficacy, supporting its implementation in routine clinical practice as a first-tier genetic test in NICUs.

Supplementary Materials

The following are available online at https://www.mdpi.com/2077-0383/9/8/2362/s1, Figure S1: Flow chart depicting recruitment summary of cohort, Table S1: List of genes included in NeoSeq; Table S2: Patient demographic and clinical data.

Author Contributions

M.-L.C., E.G.-V. and M.J.d.C. conceptualized and designed the study. E.S., S.R., O.L.-S. and A.P.-M. participated in data collection and clinical evaluation. E.G.-V. and M.-L.C. coordinated and supervised data collection. M.J.d.C., S.B.-G., E.G.-V. drafted the initial manuscript. M.-L.C. critically reviewed the manuscript for important intellectual content. All authors have read and agreed to the published version of the manuscript.

Funding

This study was supported by the Spanish Ministry of Science and Innovation, and the Instituto de Salud Carlos III (PI17/01294). Sofia Gouveia was supported by a Health Research Institute of Santiago (IDIS) pre-doctoral grant.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A. Bioinformatic Analysis

Primary: alignment, filtering quality readings, variant detection and annotation. Illumina SCS 2.6.26 / RTA 1.8.70 + CASAVA 1.8.2, FastQC v0.11.5 software were used for quality control. The alignment software used was BWA v0.7. Statistical analyses were performed suing the R statistical package. TEQC v3.18 was used for pre-variant detection control, BEDTools v2.25 and Picard v2.17.10 for intermediate steps, SAMtools v0.1.19, GATK v3.7, Scalpel v0.5.4 and Varscan v2.3 for detection of variants, and SnpEff v4.3 software for variant annotation against dbSNP and RefSeq, in addition to other programs developed by the Bioinformatics Unit of our Center (including the PattREC program for CNV detection).
Secondary: variant filtering by frequency. R scripts designed in house were used to filter variants in each individual based on their frequency in known databases (1000 genomes, ExAC, ClinVar, EVS, dbSNP) and in our own database in order to rule out polymorphisms.
Secondary: variant filtering according to different inheritance hypotheses. Filtering programs (R-based programming) were also used to analyze data from exomes for members of the same family according to the different inheritance hypotheses. Finally, the variants considered most likely to cause the pathological phenotype were prioritized for each family and categorized according to the recommendations of the American College of Medical Genetics (ACMG). Once variants were prioritized according to frequency and the different inheritance hypotheses, a theoretical evaluation of their possible implications and functional effects was conducted using the in-silico prediction programs CONDEL and Human Splicing Finder.

References

  1. Wojcik, M.H.; Schwartz, T.S.; Thiele, K.E.; Paterson, H.; Stadelmaier, R.; Mullen, T.E.; Vannoy, G.E.; Genetti, C.A.; Madden, J.A.; Gubbels, C.S.; et al. Infant mortality: The contribution of genetic disorders. J. Perinatol. 2019, 39, 1611–1619. [Google Scholar] [CrossRef] [PubMed]
  2. Wojcik, M.H.; Schwartz, T.S.; Yamin, I.; Edward, H.L.; Genetti, C.A.; Towne, M.C.; Agrawal, P.B. Genetic disorders and mortality in infancy and early childhood: Delayed diagnoses and missed opportunities. Genet. Med. 2018, 20, 1396–1404. [Google Scholar] [CrossRef] [PubMed]
  3. Online Mendelian Inheritance in Man. Available online: https://omim.org/ (accessed on 20 February 2020).
  4. Arya, V.B.; Guemes, M.; Nessa, A.; Alam, S.; Shah, P.; Gilbert, C.; Senniappan, S.; Flanagan, S.E.; Ellard, S.; Hussain, K. Clinical and histological heterogeneity of congenital hyperinsulinism due to paternally inherited heterozygous ABCC8/KCNJ11 mutations. Eur. J. Endocrinol. 2014, 171, 685–695. [Google Scholar] [CrossRef] [PubMed]
  5. Inoue, S.; Mangat, C.; Rafe’E, Y.; Sharman, M. Forme Fruste of HLH (haemophagocytic lymphohistiocytosis): Diagnostic and therapeutic challenges. BMJ Case Rep. 2015, 29. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Kieran, E.; Sara, R.; Claydon, J.; Hait, V.; De Salaberry, J.; Osiovich, H.; Shivananda, S. Outcomes of Neonates With Complex Medical Needs. Adv. Neonatal Care 2019, 19, 275–284. [Google Scholar] [CrossRef] [PubMed]
  7. Knijnenburg, T.A.; Vockley, J.G.; Chambwe, N.; Gibbs, D.L.; Humphries, C.; Huddleston, K.C.; Klein, E.; Kothiyal, P.; Tasseff, R.; Dhankani, V.; et al. Genomic and molecular characterization of preterm birth. Proc. Natl. Acad. Sci. USA 2019, 116, 5819–5827. [Google Scholar] [CrossRef] [Green Version]
  8. Reuter, J.A.; Spacek, D.V.; Snyder, M.P. High-Throughput Sequencing Technologies. Mol. Cell 2015, 58, 586–597. [Google Scholar] [CrossRef] [Green Version]
  9. Gaff, C.L.; Winship, I.M.; Forrest, S.M.; Hansen, D.; Clark, J.; Waring, P.M.; South, M.; Sinclair, A.H. Preparing for genomic medicine: A real world demonstration of health system change. NPJ Genom. Med. 2017, 2, 16. [Google Scholar] [CrossRef]
  10. Holm, I.A.; Agrawal, P.B.; Ceyhan-Birsoy, O.; Christensen, K.D.; Fayer, S.; Frankel, L.A.; Genetti, C.A.; Krier, J.B.; LaMay, R.C.; Levy, H.L.; et al. The BabySeq project: Implementing genomic sequencing in newborns. BMC Pediatr. 2018, 18, 225. [Google Scholar] [CrossRef] [Green Version]
  11. Friedman, J.M.; Bombard, Y.; Cornel, M.C.; Fernandez, C.V.; Junker, A.K.; Plon, S.E.; Stark, Z.; Knoppers, B.M. Genome-wide sequencing in acutely ill infants: Genomic medicine’s critical application? Genet. Med. 2019, 21, 498–504. [Google Scholar] [CrossRef] [Green Version]
  12. Daoud, H.; Luco, S.M.; Li, R.; Bareke, E.; Beaulieu, C.; Jarinova, O.; Carson, N.; Nikkel, S.M.; Graham, G.E.; Richer, J.; et al. Next-generation sequencing for diagnosis of rare diseases in the neonatal intensive care unit. Can. Med. Assoc. J. 2016, 188, E254–E260. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Meng, L.; Pammi, M.; Saronwala, A.; Magoulas, P.; Ghazi, A.R.; Vetrini, F.; Zhang, J.; He, W.; Dharmadhikari, A.; Qu, C.; et al. Use of Exome Sequencing for Infants in Intensive Care Units: Ascertainment of Severe Single-Gene Disorders and Effect on Medical Management. JAMA Pediatr. 2017, 171, e173438. [Google Scholar] [CrossRef] [PubMed]
  14. Van Diemen, C.C.; Kerstjens-Frederikse, W.S.; Bergman, K.A.; De Koning, T.J.; Sikkema-Raddatz, B.; Van Der Velde, J.K.; Abbott, K.M.; Herkert, J.C.; Löhner, K.; Rump, P.; et al. Rapid Targeted Genomics in Critically Ill Newborns. Pediatrie 2017, 140, e20162854. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Petrikin, J.E.; Cakici, J.A.; Clark, M.M.; Willig, L.K.; Sweeney, N.M.; Farrow, E.; Saunders, C.J.; Thiffault, I.; Miller, N.A.; Zellmer, L.; et al. The NSIGHT1-randomized controlled trial: Rapid whole-genome sequencing for accelerated etiologic diagnosis in critically ill infants. NPJ Genom. Med. 2018, 3, 6. [Google Scholar] [CrossRef] [Green Version]
  16. Stark, Z.; Tan, T.Y.; Chong, B.; Brett, G.R.; Yap, P.; Walsh, M.; Yeung, A.; Peters, H.; A Mordaunt, D.; Cowie, S.; et al. A prospective evaluation of whole-exome sequencing as a first-tier molecular test in infants with suspected monogenic disorders. Genet. Med. 2016, 18, 1090–1096. [Google Scholar] [CrossRef] [Green Version]
  17. Brunelli, L.; Jenkins, S.M.; Gudgeon, J.M.; Bleyl, S.B.; Miller, C.E.; Tvrdik, T.; Dames, S.A.; Ostrander, B.; Daboub, J.A.F.; Zielinski, B.A.; et al. Targeted gene panel sequencing for the rapid diagnosis of acutely ill infants. Mol. Genet. Genom. Med. 2019, 7, e00796. [Google Scholar] [CrossRef] [Green Version]
  18. Ceyhan-Birsoy, O.; Murry, J.B.; Machini, K.; Lebo, M.S.; Yu, T.W.; Fayer, S.; Genetti, C.A.; Schwartz, T.S.; Agrawal, P.B.; Parad, R.B.; et al. Interpretation of Genomic Sequencing Results in Healthy and Ill Newborns: Results from the BabySeq Project. Am. J. Hum. Genet. 2019, 104, 76–93. [Google Scholar] [CrossRef] [Green Version]
  19. Elliott, A.M.; du Souich, C.; Lehman, A.; Guella, I.; Evans, D.M.; Candido, T.; Tooman, L.; Armstrong, L.; Clarke, L.A.; Gibson, W.; et al. RAPIDOMICS: Rapid genome-wide sequencing in a neonatal intensive care unit-successes and challenges. Eur. J. Pediatr. 2019, 178, 1207–1218. [Google Scholar] [CrossRef]
  20. French, C.E.; Disease, N.B.; Delon, I.; Dolling, H.; Sanchis-Juan, A.; Shamardina, O.; Mégy, K.; Abbs, S.; Austin, T.; Bowdin, S.; et al. Whole genome sequencing reveals that genetic conditions are frequent in intensively ill children. Intensiv. Care Med. 2019, 45, 627–636. [Google Scholar] [CrossRef] [Green Version]
  21. Kingsmore, S.F.; Cakici, J.A.; Clark, M.M.; Gaughran, M.; Feddock, M.; Batalov, S.; Bainbridge, M.N.; Carroll, J.; Caylor, S.A.; Clarke, C.; et al. A Randomized, Controlled Trial of the Analytic and Diagnostic Performance of Singleton and Trio, Rapid Genome and Exome Sequencing in Ill Infants. Am. J. Hum. Genet. 2019, 105, 719–733. [Google Scholar] [CrossRef]
  22. Wang, H.; Lu, Y.; Dong, X.; Lu, G.; Cheng, G.; Qian, Y.; Ni, Q.; Zhang, P.; Yang, L.; Wu, B.; et al. Optimized trio genome sequencing (OTGS) as a first-tier genetic test in critically ill infants: Practice in China. Hum. Genet. 2020, 139, 473–482. [Google Scholar] [CrossRef]
  23. Gubbels, C.S.; VanNoy, G.E.; Madden, J.A.; Copenheaver, D.; Yang, S.; Wojcik, M.H.; Gold, N.B.; Genetti, C.A.; Stoler, J.; Parad, R.B.; et al. Prospective, phenotype-driven selection of critically ill neonates for rapid exome sequencing is associated with high diagnostic yield. Genet. Med. 2020, 22, 736–744. [Google Scholar] [CrossRef] [PubMed]
  24. Ross, L.F.; Clayton, E.W. Ethical Issues in Newborn Sequencing Research: The Case Study of BabySeq. Pediatrics 2019, 144, e20191031. [Google Scholar] [CrossRef] [PubMed]
  25. Yang, H.; Robinson, P.N.; Wang, K. Phenolyzer: Phenotype-based prioritization of candidate genes for human diseases. Nat. Methods 2015, 12, 841–843. [Google Scholar] [CrossRef] [PubMed]
  26. Wise, A.L.; A Manolio, T.; A Mensah, G.; Peterson, J.F.; Roden, D.M.; Tamburro, C.; Williams, M.S.; Green, E.D. Genomic medicine for undiagnosed diseases. Lancet 2019, 394, 533–540. [Google Scholar] [CrossRef]
  27. Smith, L.D.; Willig, L.K.; Kingsmore, S.F. Whole-Exome Sequencing and Whole-Genome Sequencing in Critically Ill Neonates Suspected to Have Single-Gene Disorders. Cold Spring Harb. Perspect. Med. 2015, 6, a023168. [Google Scholar] [CrossRef] [Green Version]
  28. Köhler, S.; Schulz, M.H.; Krawitz, P.; Bauer, S.; Dölken, S.; Ott, C.E.; Mundlos, C.; Horn, D.; Mundlos, S.; Robinson, P.N. Clinical diagnostics in human genetics with semantic similarity searches in ontologies. Am. J. Hum. Genet. 2009, 85, 457–464. [Google Scholar] [CrossRef] [Green Version]
  29. Farnaes, L.; Hildreth, A.; Sweeney, N.M.; Clark, M.M.; Chowdhury, S.; Nahas, S.; Cakici, J.; Benson, W.; Kaplan, R.H.; Kronick, R.; et al. Rapid whole-genome sequencing decreases infant morbidity and cost of hospitalization. NPJ Genom. Med. 2018, 3, 10. [Google Scholar] [CrossRef] [Green Version]
  30. Clark, M.M.; Stark, Z.; Farnaes, L.; Tan, T.Y.; White, S.M.; Dimmock, D.; Kingsmore, S.F. Meta-analysis of the diagnostic and clinical utility of genome and exome sequencing and chromosomal microarray in children with suspected genetic diseases. NPJ Genom. Med. 2018, 3, 16. [Google Scholar] [CrossRef] [Green Version]
  31. Wright, C.F.; FitzPatrick, D.R.; Firth, H.V. Paediatric genomics: Diagnosing rare disease in children. Nat. Rev. Genet. 2018, 19, 253–268. [Google Scholar] [CrossRef]
  32. Worthey, E.A. Analysis and Annotation of Whole-Genome or Whole-Exome Sequencing Derived Variants for Clinical Diagnosis. Curr. Protoc. Hum. Genet. 2017, 95, 9.24.1–9.24.28. [Google Scholar] [CrossRef] [PubMed]
  33. Bacchelli, C.; Williams, H.J. Opportunities and technical challenges in next-generation sequencing for diagnosis of rare pediatric diseases. Expert Rev. Mol. Diagn. 2016, 16, 1073–1082. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Petrikin, J.E.; Willig, L.K.; Smith, L.D.; Kingsmore, S.F. Rapid whole genome sequencing and precision neonatology. Semin. Perinatol. 2015, 39, 623–631. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Mantere, T.; Kersten, S.; Hoischen, A. Long-Read Sequencing Emerging in Medical Genetics. Front. Genet. 2019, 10, 426. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Neu, M.B.; Bowling, K.M.; Cooper, G.M. Clinical utility of genomic sequencing. Curr. Opin. Pediatr. 2019, 31, 732–738. [Google Scholar] [CrossRef] [PubMed]
  37. Häberle, J.; Burlina, A.; Chakrapani, A.; Dixon, M.; Karall, D.; Lindner, M.; Mandel, H.; Martinelli, D.; Pintos-Morell, G.; Santer, R.; et al. Suggested guidelines for the diagnosis and management of urea cycle disorders: First revision. J. Inherit. Metab. Dis. 2019, 42, 1192–1230. [Google Scholar] [CrossRef]
  38. Desbats, M.A.; Lunardi, G.; Doimo, M.; Trevisson, E.; Salviati, L. Genetic bases and clinical manifestations of coenzyme Q10 (CoQ10) deficiency. J. Inherit. Metab. Dis. 2014, 38, 145–156. [Google Scholar] [CrossRef]
  39. Pisano, T.; Numis, A.L.; Heavin, S.B.; Weckhuysen, S.; Angriman, M.; Suls, A.; Podestà, B.; Thibert, R.L.; Shapiro, K.A.; Guerrini, R.; et al. Early and effective treatment ofKCNQ2encephalopathy. Epilepsia 2015, 56, 685–691. [Google Scholar] [CrossRef]
  40. Vannoy, G.E.; Genetti, C.A.; McGuire, A.L.; Green, R.C.; Beggs, A.H.; Holm, I.A.; BabySeq Project Group. Challenging the Current Recommendations for Carrier Testing in Children. Pediatrie 2019, 143, S27–S32. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Schematic comparing NeoSeq and other diagnostic genome sequencing strategies (WGS14,15,20,22, WES16,18,19,23, and CES12,13,17) showing the size of the genomic portion interrogated, the amount of data generated, and the median diagnostic rates achieved for each approach. To facilitate visual comparison, data are represented as the relative area of each circle. For WGS and WES, information on the genomic portion interrogated and data generated data were extracted from www.illumina.com/wes-wgs. For CES, information on the genomic portion interrogated and data generated was estimated for 6000 genes. Diagnostic rates were calculated as the mean of the results of the cited studies. Total number of patients for each genome sequencing strategy: CES, n = 306; WES, n = 242; WGS, n = 395.
Figure 1. Schematic comparing NeoSeq and other diagnostic genome sequencing strategies (WGS14,15,20,22, WES16,18,19,23, and CES12,13,17) showing the size of the genomic portion interrogated, the amount of data generated, and the median diagnostic rates achieved for each approach. To facilitate visual comparison, data are represented as the relative area of each circle. For WGS and WES, information on the genomic portion interrogated and data generated data were extracted from www.illumina.com/wes-wgs. For CES, information on the genomic portion interrogated and data generated was estimated for 6000 genes. Diagnostic rates were calculated as the mean of the results of the cited studies. Total number of patients for each genome sequencing strategy: CES, n = 306; WES, n = 242; WGS, n = 395.
Jcm 09 02362 g001
Table 1. Demographic and clinical data and genetic findings in patients with definitive/probable causative variants.
Table 1. Demographic and clinical data and genetic findings in patients with definitive/probable causative variants.
CasesAgeSexHPOTATGeneVariantsPhenomizerDisorderMIMParents/Inheritance
125 dMIntrauterine growth retardation
Neonatal respiratory distress
Congenital microcephaly
Unilateral cryptorchidism
Neonatal hypoglycemia
Chronic metabolic acidosis
Lactic acidosis
7 dGFM1c.[640A>T];[ 1199G>C]
(p.[Ile214Phe];[Arg400Pro])
p = 0.0343Combined oxidative phosphorylation deficiency 1 #609060 Carriers
Autosomal recessive
21 m 15 dMMethylmalonic aciduria
Abnormality of myocardium
Chronic metabolic acidosis
Lactic acidosis
7 dSUCLA2c.[850C>T];[ 850C>T]
(p.[Arg284Cys];[Arg284Cys])
p = 0.0271Mitochondrial DNA depletion syndrome 5 #612073Carriers
Autosomal recessive
32 mFFailure to thrive
Weight loss
Irritability
Infantile axial hypotonia
Developmental regression
Hyperglycinemia
4 dPNPT1c.[1495+55_1495+80del]; [1495+55_1495+80del]n.s.
p = 0.119
Combined oxidative phosphorylation deficiency 13 #614932Carriers
Autosomal recessive
420 dFSeizures
Epileptic encephalopathy
6 dKCNQ2c.778C>T
(p.His260Tyr)
p = 0.04Epileptic encephalopathy, early infantile 7#613720De novo
Autosomal dominant
518 dMSeizures
Epileptic encephalopathy
7 dKCNQ2c.1016 T>A
(p.Leu339Gln)
p = 0.04Epileptic encephalopathy, early infantile 7#613720Father, epilepsy in infancy
Autosomal dominant
625 dFSeizures
Epileptic encephalopathy
6 dCDKL5c.616G>T
(p.Asp206Tyr)
n.s.
p = 0.1386
Epileptic encephalopathy, early infantile 2#300672Mother, epilepsy
Autosomal dominant X-linked
76 dMNeonatal respiratory distress Seizures
Epileptic encephalopathy
Chronic metabolic acidosis
7 dKCNQ2c.1658G>A
(p.Arg553Gln)
n.s
p = 0.471
Familiar neonatal seizures 1#613720De novo
Autosomal dominant
810 dMVomiting
Hyperammonemia
Hypoketotic hypoglycemia
Fetal pyelectasis
Thyroid-stimulating hormone excess
8 dCPS1c.[1201G>C];[2810T>A]
(p.[Gly401Arg];[Ile937Asn])
n.s.
p = 0.0624
CPS1 deficiency#608307Carriers
Autosomal recessive
91 mMGeneralized neonatal hypotonia
Seizures
Lethargy
Cerebellar atrophy
10 dCOQ4c.[202G>C];[718C>T]
(p.[Asp68His];[Arg240Cys])
n.d.Primary coenzyme Q10 deficiency 7#616276Carriers
Autosomal recessive
103 dFPremature birth
Respiratory insufficiency due to muscle weakness
Generalized hypotonia,
Encephalopathy
10 dACTA1c.614C>A
(p.Thr205Lys)
n.s.
p = 0.582
Nemaline myopathy 3#161800De novo
Autosomal dominant
119 dFLeukoencephalopathy
Cataracts
Renal cysts
Bleeding digestive
5 dCOL4A1c.2906 G>A
(p.Gly969Glu)
n.s.
p = 0.5810
Small vessel vascular brain disease #175780De novo
Autosomal dominant
1212 dMJoint contractures
Microretrognathia
Microtia
Micropenis
Hypotonia
Hearing loss
6 dERBB3c.[1184-9A>G];[1184-9A>G]n.s.
p = 0.4243
Lethal contracture syndrome type 2#607598Carriers
Autosomal recessive
13 15 dFHirschsprung disease
Congenital hearing loss
Opsoclonus
7 dSOX10c.850G>T
(p.Glu284Ter)
p = 0.0323Waardenburg–Shah syndrome#142623De novo
Autosomal dominant
Abbreviations: d, day; HPO, human phenotype ontology; F, female; m, month; M, male; MIM, Mendelian Inheritance in Man; n.d., not detected; n.s, not significant; TAT, turnaround time to diagnosis.
Table 2. Demographic and clinical data and genetic findings in patients with non-definitive/non probable causative variants.
Table 2. Demographic and clinical data and genetic findings in patients with non-definitive/non probable causative variants.
CasesAgeSexHPOTATGeneMutationsPhenomizerDisorderMIMParents/Inheritance
1422 dFPreeclampsia
Neonatal respiratory distress
Hypoglycemia
7 dMTORc.126G>T
(p.Lys42Asn)
n.d.-Focal cortical dysplasia type II
- Smith-Kingsmore Syndrome
#607341
#616638
Father asymptomatic carrier
1529 dFIntrauterine growth retardation
Meconium ileus
Neonatal respiratory distress
Generalized neonatal hypotonia
Congenital hip dislocation
10 pairs of ribs
10 dNALCNc.2507C>G
(p.Pro836Arg)
n.d.Congenital contractures of the limbs and face, hypotonia and
developmental delay
#616266Father asymptomatic carrier
164 dMFocal seizures9 dTSC2c.1724T>C
(p.Leu575Pro)
n.d.Tuberous sclerosis complex#613254Father asymptomatic carrier
d, day; F, female; HPO, human phenotype ontology; M, male; MIM, Mendelian Inheritance in Man; n.d., not detected; TAT, turnaround time.
Table 3. Impact of molecular diagnosis on medical management.
Table 3. Impact of molecular diagnosis on medical management.
CasesDisorderChanges in Medication or DietInitiation of New Subspecialist Care Withdrawal of Intensive Care Treatment/Initiation of Palliative CareGenetic Counseling
1Combined oxidative phosphorylation deficiency 1 Mitochondrial cocktail
Avoid valproate
Neurologist
Hepatologist
Audiologist
Ophthalmologist
YesYes
2Mitochondrial DNA depletion syndrome 5 Mitochondrial cocktailNeurologist
Audiologist
Ophthalmologist
YesYes
3Combined oxidative phosphorylation deficiency 13Mitochondrial cocktail
Avoid valproate
Cardiologist
Audiologist
Ophthalmologist
YesYes
4Epileptic encephalopathy, early infantile 7Sodium channel blocker (phenytoin)
Avoid retigabine and ezogabine
NoNoYes
5Epileptic encephalopathy, early infantile 7Sodium channel blocker (carbamazepine)
Avoid retigabine and ezogabine
NoNoYes
6 Epileptic encephalopathy, early infantile 2Ketogenic dietGastroenterologistNoYes
7Familiar neonatal seizures 1Sodium channel blocker (phenobarbital)
Avoid retigabine and ezogabine
NoNoYes
8CPS1 deficiency Protein restricted diet
Arginine/citrulline
Specialist in inborn errors of metabolismNoYes
9Primary coenzyme Q10 deficiency 7CoQ10Cardiologist
Ophthalmologist
Audiologist
NoYes
10Nemaline myopathyPyridostigmine
Carnitine
NoYesYes
11Small vessel brain disease- (exitus)- (exitus)- (exitus)Yes
12Lethal contracture syndrome type 2NoNoYesYes
13Waardenburg–Shah syndromeNoNoYes (exitus)Yes
Table 4. Previous prospective studies of the diagnostic performance of WES, WGS, and CES in newborns with a suspected genetic disorder.
Table 4. Previous prospective studies of the diagnostic performance of WES, WGS, and CES in newborns with a suspected genetic disorder.
ReferenceDateStudy TypeSequencing TypeStudy PopulationRate of DiagnosisDiagnostic Turnaround Time
Daoud, et al. [12]2016CohortCESn = 84/8 (50%)15.2 w
Meng, et al. [13]2017CohortCES
Trio CES
Critical trio CES
n = 178
n = 37
n = 63
58/178 (33%)
12/37 (32%)
32/63 (51%)
95 d
51 d
13 d
van Diemen, et al. [14]2017CohortWGS filtered by CESn = 237/23 (30%)12 d
Petrikin, et al. [15]2018RCTTrio rWGSn = 6421/64 (33%)13 d
Stark, et al. [16]2018CohortrWESn = 4021/40 (52%)16 d
Brunelli, et al. [17]2019CohortrCESn = 2010/20 (50%)9.6 d
Ceynah-Birsoy, et al. [18]2019CohortWESn = 325/32 (16%)-
Elliot, et al. [19]2019CohortWESn = 2514/25 (56%)7.2 d
French, et al. [20] 2019CohortTrio WGSn = 10614/106 (13%)21 d
Kingsmore, et al. [21]2019RCTrWGS
rWES
urWGS
n = 94
n = 95
n = 24
18/94 (19%)
19/95 (20%)
11/24 (46%)
11 d
11.2 d
4.6 d
Wang, et al. [22]2020RCTTrio WGSn = 8432/84 (38%)4 d
Gubbels, et al. [23]2020CohortTrio WESn = 5029/50 (56%)4.9 d
Abbreviations: CES, clinical exome sequencing; RCT, randomized clinical trial; r, rapid; ur, ultrarapid; WES, whole exome sequencing; WGS, whole genome sequencing.

Share and Cite

MDPI and ACS Style

de Castro, M.J.; González-Vioque, E.; Barbosa-Gouveia, S.; Salguero, E.; Rite, S.; López-Suárez, O.; Pérez-Muñuzuri, A.; Couce, M.-L. Rapid Phenotype-Driven Gene Sequencing with the NeoSeq Panel: A Diagnostic Tool for Critically Ill Newborns with Suspected Genetic Disease. J. Clin. Med. 2020, 9, 2362. https://doi.org/10.3390/jcm9082362

AMA Style

de Castro MJ, González-Vioque E, Barbosa-Gouveia S, Salguero E, Rite S, López-Suárez O, Pérez-Muñuzuri A, Couce M-L. Rapid Phenotype-Driven Gene Sequencing with the NeoSeq Panel: A Diagnostic Tool for Critically Ill Newborns with Suspected Genetic Disease. Journal of Clinical Medicine. 2020; 9(8):2362. https://doi.org/10.3390/jcm9082362

Chicago/Turabian Style

de Castro, María José, Emiliano González-Vioque, Sofía Barbosa-Gouveia, Enrique Salguero, Segundo Rite, Olalla López-Suárez, Alejandro Pérez-Muñuzuri, and María-Luz Couce. 2020. "Rapid Phenotype-Driven Gene Sequencing with the NeoSeq Panel: A Diagnostic Tool for Critically Ill Newborns with Suspected Genetic Disease" Journal of Clinical Medicine 9, no. 8: 2362. https://doi.org/10.3390/jcm9082362

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop