You are currently viewing a new version of our website. To view the old version click .
International Journal of Molecular Sciences
  • Review
  • Open Access

26 October 2022

Exploration of Tools for the Interpretation of Human Non-Coding Variants

,
,
,
,
,
,
,
,
and
1
Computational and Chemical Biology, Italian Institute of Technology, 16163 Genoa, Italy
2
Department of Medical and Surgical Sciences, University of Bologna, 40138 Bologna, Italy
3
Clinical Bioinformatics, IRCCS Istituto Giannina Gaslini, 16147 Genoa, Italy
4
Medical Genetics Unit, IRCCS Sant’Orsola-Malpighi University Hospital, 40138 Bologna, Italy
This article belongs to the Special Issue Recent Advances in Molecular Diagnostics and Molecular Genomics

Abstract

The advent of Whole Genome Sequencing (WGS) broadened the genetic variation detection range, revealing the presence of variants even in non-coding regions of the genome, which would have been missed using targeted approaches. One of the most challenging issues in WGS analysis regards the interpretation of annotated variants. This review focuses on tools suitable for the functional annotation of variants falling into non-coding regions. It couples the description of non-coding genomic areas with the results and performance of existing tools for a functional interpretation of the effect of variants in these regions. Tools were tested in a controlled genomic scenario, representing the ground-truth and allowing us to determine software performance.

1. Introduction

The sequencing of the whole human genome, completed in 2003, carried the belief of easily solving the genetic ground of many diseases. If this has been proved to be true for genetic disorders caused by mutations in coding sequences, it took many years and efforts to understand the importance and the large involvement in diseases of the non-coding regions, long referred to as ‘junk DNA’. Currently, it is known that around 80% of the human genome contains functional elements [], that up to 5–10% is under purifying selection [,], that non-coding elements are crucial to controlling the expression of protein-coding genes [], and that variants in non-coding portions (non-coding variants, NCVs) of the genome can have a critical impact on perturbing gene regulation, thus potentially causing a variety of diseases. Moreover, recent studies have revealed an implication of non-coding variants in regulating DNA replication timing [], suggesting an indirect link between DNA synthesis and transcription []. In this complex scenario, deciphering the roles of non-coding variants in disease etiology remains nontrivial [].
Whole Genome Sequencing (WGS) is potentially able to reveal single-nucleotide variants (SNVs), insertion/deletions (InDels), as well as structural variants (SVs) and copy-number variants (CNVs) throughout the whole genome [], thus allowing the detection of causative disease variants which could be missed by targeted approaches. However, the potential of WGS is not fully exploited because the current knowledge of non-coding regions is still lagging behind coding ones. Ellingford et al. [] report that 63.4% of untranslated region (UTR) variants in the ClinVar database are categorized as ‘variants of uncertain significance’ (VUS), thus demonstrating that non-coding regions are still widely under-ascertained in clinical databases, even when representing quite well-studied areas. In this context, novel algorithms are continuously being proposed to predict the pathogenicity of variants in such critical regions, and reviews are constantly published trying to shed light on the selection of best practices and methods to maximize successful results. For example, Wang et al. [] compared 24 existing methods to predict the effects of variants in the human non-coding sequences, showing that current methods provide better concordance in results when analyzing somatic variants than when dealing with germinal ones. On the other hand, they demonstrate that existing computational methods show acceptable performance only for germline variants, and that their predictive ability should be improved for different types of non-coding variants. Even Rojano et al. [] worked on a promising set of tools for predicting the potential impact of variants falling in regulatory regions of the genome, showing the advantages and limitations of tools dedicated to variant annotation more than to variant effect interpretation. Although imperfect and in-progress, prediction tools currently represent the unique recognized way and necessary step for rapid and massive interpretation of ‘non-coding variants’. Nevertheless, they could hide pitfalls and issues and often require functional tests, such as RNA sequencing or targeted approaches, multiplexed assays of variant effects, chromatin interaction assays, and reporter gene assays to validate predictions []. Several other reviews have been published describing the limits and strengths of different tools [,], focusing on those currently available to visualize and functionally annotate WGS variants without performing comparative evaluation and benchmarking. In this review, we provide an updated critical overview of the currently available bioinformatics tools for interpreting SNP/indel falling in non-coding regions (NCVs from now on), grouping selected methods based on the non-coding regions they can target. For each of them, we: quantitatively assess and compare the performance of the algorithms at computational and information levels, also evaluating computational resources required for the execution; provide knowledge on their usability and effectiveness in different genomic contexts; critically highlight limitations and advantages, when additional to those intrinsically residing in our inclusion criteria (described in the following). To group tools depending on their target region, recent suggestions for functional element identification were followed [].

2. Methods

2.1. Inclusion Criteria

For each considered tool, specific features such as input requirements, output format, supported reference genome, and the genomic context suitable for the tool are reported. According to these criteria, methods were classified into three main categories: aggregators, integrators, and investigators. In particular, software solutions that collect information on variants’ annotation from other tools to propose a comprehensive overview of the knowledge related to variants in non-coding regions were defined as ‘aggregators’. Tools that combine variant properties (e.g., regulatory features, conservation metrics, genic context) to provide refined scores for classifying or prioritizing the potential impact of such variants were named ‘integrators’. Tools that develop ex-novo algorithms to investigate and explain the functional consequences of variants in non-coding regulatory elements were referred to as ‘investigators’. The ‘investigator’ tools, which not only annotate the predicted impact of the variants in non-coding regions but can also provide information concerning the functional effects of the variants, represent the focus of this review. Among them, we identified 10 methods suitable for being included in bioinformatics pipelines for WGS data analysis. Selection was performed based on the following criteria: (i) being freely available; (ii) accepting VCF files as input; (iii) being fully accessible, including all additional datasets necessary for running the tool. Selected programs were benchmarked based on their intended usage in a controlled scenario, enabling the assessment of quantitative performance. Programs were executed using hg19 as the reference genome.

2.2. The Controlled Scenario: Knowledge-Based and Computational Performance

A set of manually curated known pathogenic and benign NCVs was obtained from ncVarDB []. ncVarDB includes 721 certainly pathogenic and 7228 certainly benign NCVs, spread over the whole human genome. Since it relies on the hg38 reference genome, coordinates were converted to hg19 using the liftOver tool []. After conversion, three benign variants (rs412762, rs878890367, and rs3208965) were lost. The number of SNPs in each class (intronic, intergenic, ncRNA, 3′UTR, and 5′UTR) is reported in Table 1.
Table 1. Number of variants available in ncVarDB after conversion to hg19.
To evaluate the computational resources required by the tools, we in silico merged the set of known variants with the variants in chromosome 20 from a sample of Han Chinese ancestry [] (HG005-NA24631) retrieved from the Genome In A Bottle (GIAB) project []. Chromosome 20 (64,444,167 bp) contained 78,186 variants distributed as follows: 88.34% single nucleotide variants (SNVs), 11.2% small insertions/deletions (InDels), and 0.46% larger sequence alterations; the set of non-coding variants (99.37%) overcame by far the coding and splicing ones (0.52% and 0.11%, respectively).
The merged dataset contained 86,132 mutations and allowed us to benchmark the performance in pathogenicity prediction and computational efficiency in a reasonable time-frame.
All variants were annotated with VEP to identify the genomic region where they are mapped []. For each tool, a set of performance metrics was retrieved including: (i) the number of variants they could annotate; (ii) the computational time, calculated by running jobs on a single node, with 2 12-cores CPUs (24 total cores); (iii) the availability of parallel paradigm in the software; (iv) specificity = TN/[TN + FP]; (v) precision = TP/[TP + FP]; when allowed, (vi) sensitivity = TP/[TP + FN]; (vii) accuracy = [TP + TN]/[TP + TN + FP + FN]. The last 4 metrics rely on the confusion matrices obtained comparing predicted results to the ncVarDB knowledge base. In detail, (i) true positives (TP) correspond to variants labeled as pathogenic by the tool under analysis AND by ncVarDB, (ii) true negatives (TN) refer to variants labeled as benign by the tool AND by ncVarDB, (iii) false positives (FP) represent variants labeled as pathogenic by the tool BUT as benign by ncVarDB, and (iv) false negatives (FN) are variants that, although pathogenic for ncVarDB, are not called pathogenic by the tool. In all the cases, except for the UTRs-related tools, it was not possible to calculate FN, as the ability of the studied tool to evaluate the biological function responsible for pathogenicity could not be clearly assessed. For example, if a deep intronic variant has not been classified as pathogenic by splicing tools, it should not be considered a false negative since its pathogenicity could still be attributed to a function other than splicing.

3. Results

3.1. Method Selection

A total of 40 tools for NCV interpretation were initially considered (Table 2). Of these, 10 ‘investigator’ tools passed our inclusion criteria (see ‘Inclusion criteria’ section for details) and were retained for in-depth evaluation: Basenji, DeepSEA, Genomiser, LINSIGHT, MORFEE, Orion, SPIDEX, SpliceAI, 5utr, UTRannotator (Figure 1). Their performance (Table 3) was evaluated and described in the genomic context specific to each tool, except for Genomiser, which was considered separately.
Table 2. List of the tools considered for non-coding variant analysis.
Figure 1. Graph of the approach followed in defining, grouping, and analyzing selected tools. A first literature screening was performed to retrieve the most promising existing methods for NCVs analysis. They belong to ‘Annotators’, ‘Integrators’, or ‘Investigators’ groups. Focusing on components of the ‘Investigators’ group, inclusion criteria were applied to select a set of best-hits. They were clustered relying on the genomic region they targeted, and several features were critically evaluated.
Table 3. Performance for each selected tool, grouped by category.

3.2. Tools for Identifying NCV Affecting UTRs

Messenger RNA (mRNA) is surrounded by transcribed but untranslated regions (UTRs), namely 5′ (upstream) and 3′ (downstream) UTRs. These intervene in the post-transcriptional phase contributing to the regulation of mRNA stability, secondary structure, localization, and translation. Notably, 3.7% of the genetic variants detected in GWAS studies are located in UTRs [,]. Moreover, 3′UTRs usually carry polymorphisms (MAF > 1%), whereas mutations (MAF < 1%) predominate in 5′UTR []. The 3′UTR is characterized by binding sites for RNA-binding proteins (RBPs) and microRNAs (miRNA); thus, variants in this region may lead to unstable mRNAs by creating or abolishing critical binding sites for long non-coding RNAs, miRNAs, or proteins involved in the regulation of translation. 5′UTR should possess a Kozak consensus sequence (ACCAUGG), which contains the translation initiation codon and other regulatory elements like CpG sites, uORFs (upstream Open Reading Frame), IRESs (internal ribosome entry sites), and RBP binding sites. Moreover, it could house secondary structures, such as hairpins, which are important in translational regulation []. Variations in length and sequence in 5′UTR could have a significant impact on the overall production of the protein, mainly causing: (i) the establishment of upstream start sites (uAUGs); (ii) the disruption of the pre-existing start or stop codons of uORFs which are crucial tissue-specific cis regulators of translation and are present in around half of all gene 5′UTRs; (iii) a frameshift in an existing uORF. A recent study demonstrated that variants in 5′UTRs creating new upstream start codons or disrupting stop codons of existing uORFs are under strong negative selection [].
Currently, no tool is available specifically for NCV in 3′UTRs, while three ‘investigator’ tools for 5′UTR variants were identified as representative of the pool of methods targeting this region: UTRannotator, 5utr, MORFEE.
UTRannotator [] is a comprehensive tool for studying variants impacting uORFs in eukaryotes. For each 5′UTR variant provided in the VCF input file, UTRannotator evaluates whether it could lead to any of the effects listed in the previous paragraph, assigning the number of overlapping ORFs within the 5′UTR, both in-frame and out-of-frame, and counting 5′UTR-uORFs with a stop codon in the reference sequence. For each of these variants, transcript-specific annotation is provided, leading to multiple annotation consequences. As output, UTRannotator supports default VEP output, tab-delimited, and VCF formats. For each of the five different conditions (uAUG gained/lost, uSTOP gained/lost, uFrameShift), the tool evaluates the type of uORF disrupted and/or created (e.g., inframe, OutOfFrame), the Kozak consensus sequence [] and strength, as well as other features []. UTRannotator is available as a VEP plugin, which represents an advantage to VEP users.
In the reference dataset, UTRannotator could recognize 718 variants, resulting in 727 annotations (some variants were located in the 5′UTR of multiple genes, e.g., rs12974606). Considering the 74 variants predicted to have a pathogenic effect on 5′UTR, ‘uAUG gained’ was the most represented class of uORF-perturbing consequence (26 variants), followed by ‘uAUG lost’ (18 variants), ‘uFrameShift’ (11 variants), ‘uSTOP gained’ (7 variants), and ‘uSTOP lost’ (7 variants). Peculiar effects were highlighted for 5 specific variants, such as ‘uAUG gained & uAUG lost’. The main limitations of UTRannotator are the constraint to work on variants shorter than 5 bps, and the consideration of only canonical AUG start sites.
5utr [], also available as a VEP plugin, making it easy to run for VEP users, retrieves the distance of the variant from the main start codon of the coding sequence (CDS), the information about AUG and STOP loss/gain/change and auxiliary fields (e.g., in/out of frame and Kozak sequence and strength) noteworthy for the interpretation of variant effects. In particular, TE_log2fold [] indicates the change in predicted translational efficiency caused by the variant. Delta_dsRNA and Delta_G4 [] parameters indicate the change in minimum free energy of the double-stranded RNA (secondary structure) and quadruplex structures, respectively, representing their stability. The increased stability of secondary structures due to the variants is indicated by Delta_dsRNA negative values, which are associated with reduced translation. The VEP-based annotation resulted in 718 variants falling in 5′UTRs (727 annotations, considering variants located in the 5′UTR of multiple genes), where 151 were identified with a pathogenic effect. Among these, 5utr recognised 14 ‘STOP_change’, 33 ‘STOP_loss’, 57 ‘STOP_gain’, 1 ‘AUG_change’, 21 ‘AUG_gain’, 12 ‘AUG_loss’, 3 ‘AUG_loss & STOP_change’, 2 ‘AUG_gain & STOP_change’, 2 ‘AUG_loss & STOP_loss’, 4 ‘AUG_gain & STOP_gain’, and 2 ‘AUG_loss & STOP_gain’ events.
A ‘delta_G4’ score (ΔG4) = 0 was assigned to 260 variants (94.2%), 6 variants had a ΔG4 < 0, two had 0 < ΔG4 < 1 and 2 variants obtained a ΔG4 = 1. Of the remaining 6 variants presenting a ΔG4 > 1, the highest ΔG4 value was 12.5. Concerning ‘delta_dsRNA’ (ΔRNA), 41 variants were assigned a ΔRNA = 0; 126 were attributed a ΔRNA > 0; and 109 a ΔRNA < 0, showing increased stability of RNA secondary structure. For both values, whenever a single variant was located on multiple transcripts, the extreme value was considered.
5utr main limitations are that it works only on single nucleotide substitutions (SNVs), and that some annotations are available only for the nearest 100 bp to CDS.
MORFEE (Mutated upstream ORF dEtEction) [] is an R package that detects and annotates SNVs leading to the formation of upstream translation initiation codons (AUG). This can result in a longer protein (in the case of uAUG in frame with the main CDS with no associated premature stop codon) or in an entirely upstream or overlapping uORF (in the case of a 5′UTR variant associated with a stop codon prior to the main CDS or within it, respectively). After annotation with ANNOVAR [], 5′UTR variants are filtered, and the GENCODE database is exploited to extract transcripts information and generate the complementary DNA sequences. On this basis, MORFEE can determine whether an SNV causes the formation of a new upstream ATG sequence and annotates (i) the distance between the reference ATG and the newly created ATG (uORF-CDS distance), (ii) the reading frame shift (0, 1, 2), and (iii) the predicted uORF length (the distance separating the new ATG from the first stop codon in frame). Overall, MORFEE recognized 22 pathogenic events (14 uATG events and 8 uSTOP events) in the 591 variants annotated by Annovar as 5′UTR variants.
Comparing the three tools, MORFEE is limited to annotating variants that create uAUGs only, whereas 5utr and UTRannotator also report the disruption of the existing stop codon of uORFs, the creation of new ones and whether the variant makes the Kozak consensus sequence weaker or stronger. In addition, 5utr annotates the change in predicted translational efficiency [] and minimum free energy of the secondary structure [].
The computational performance of the three tools is reported in Table 3. Knowledge-based performance (confusion matrix and related indexes) were similar for the three methods, which show quite high specificity and accuracy, whereas insufficient sensitivity and precision. The distribution and overlap of results related to the correct identification of pathogenic variants (referred to ncVarDB data, excluding chrM) are reported in Figure 2. On this basis, 5utr and UTRannotator show overlapping results and a higher number of correctly classified NCV and higher sensitivity than Morfee. In total, 19 pathogenic variants in 5′UTR were correctly detected, 17 being detected by multiple tools, while only 2 were specifically discovered by 5′UTR dedicated tools (Figure 2B).
Figure 2. Pathogenic ncVarDB variants (excluding those on chrM) correctly marked as pathogenic by the listed tools. (A) The heatmap shows the pathogenic variants (y-axis) detected by each tool (x-axis). A cell is colored whenever a variant is correctly identified as pathogenic. The color scale represents the genomic feature considered by the tools: green, NCVs affecting chromatin structures; orange, variants in 5′UTRs; purple, variants affecting the splicing. (B) Upset plot showing the co-occurrence of pathogenic non-coding variants from ncVarDB identified by each tool. The horizontal bars show the total number of pathogenic non-coding variants detected by each tool. The vertical bars show the occurrence or co-occurrence of pathogenic non-coding variants identified through every combination of tools, and the number at the top identifies the cardinality of the set. The black dots and lines show the combination of tools that make up each set.

3.3. Tools for Identifying NCV Affecting Splicing Sites

The precursor mRNA obtained during transcription has to be spliced into mRNA. During the splicing process, exons are joined together after removing introns. This complex procedure is performed by the spliceosome in eukaryotes and driven by specific sequences and auxiliary splicing of cis elements, namely ss-recognition promoting ‘intronic/exonic splicing enhancers’ (ISEs/ESEs) and ss-recognition repressing ‘intronic/exonic splicing silencers’ (ISSs/ESSs). Canonical splice sites (CSSs) are usually marked, at either exons’ sides, by the canonical sequences ‘AG’ (upstream acceptor sites, 3′ splice site) and ‘GT’ (downstream donor sites, 5′ splice site). These motifs are embedded within consensus splice site recognition sequences (mainly ‘CAG’ and ‘AGGTAAGT’, respectively) still under purifying selection []. Regions surrounding canonical splice-sites show constraints similar to protein-truncating and missense variants []. Variants affecting the essential sequences GT (at position D+1 and D+2) or AG (at position A-1 and A-2) will lead to the disruption of the consensus sequence, thus resulting in the impaired recognition of the splice site by the splicing machinery. Many mutations not directly affecting the canonical sequences would lead to the same result. Splicing defects within genes are estimated to cause at least 10% of rare pathogenic genetic variants [] and have been identified as a major source of Mendelian diseases [,]. They can be found in CSSs and splice motifs within deep intronic regions (>50 nt from exon-intron boundaries). For example, substitutions within introns may create novel acceptor or donor splice sites recognized by the spliceosome, leading to the inclusion of a portion of the intron in the mature transcript. Less common variants result in the establishment of either new exons within the intron or novel regulatory elements, such as splicing enhancers []. Other variants may cause exon skipping, extension, or truncation, leading to the alteration of reading frames or even driving nonsense-mediated decay.
Variants within modulating sequences of alternatively spliced genes may abolish gene function or alter the balance of distinct isoforms, wiping out those depending on the disrupted site [].
Two of the most commonly used tools for annotating NCV in splicing regions were reviewed here, one leaning on VEP (SpliceAI) and one on ANNOVAR (SPIDEX).
SpliceAI [] is an open-source, artificial intelligence-based software freely released by Illumina, which enables the prediction of non-coding variants that disrupt the conventional patterning of exons and introns. It relies on a 32-layer deep neural network exploiting a 10,000-nucleotide window, thus allowing it to use both short-range characteristics (i.e., GT and AG dinucleotides, etc.) as well as long-range features (i.e., exon–intron length, nucleosome positioning, etc.) for exon definition [,,]. The model analyzes the impact of input variants on the splicing, considering all bases within 50 bp from the variant on the pre-mRNA transcript, and returns the surrounding residue with the most significant predicted splicing alteration caused by the variant. In particular, SpliceAI outputs the score difference (Delta score, DS) between the predicted exon-intron boundaries in the reference and the alternative pre-mRNA transcript sequence. The output prediction score reflects the splicing-altering probability of a genetic variant (from 0 to 1), which is higher for variants affecting the splicing patterns of a large fraction of gene transcripts and is correlated to the validation rates in the RNA-seq data. For each input variant, SpliceAI retrieves the associated gene symbol, DS and delta positions (DP), acceptor gain (AG), acceptor loss (AL), donor gain (DG), and donor loss (DL), specifying the location where splicing differs from the reference (positive values result for the downstream region of the variant, and negative ones for the upstream region). SpliceAI authors suggest using 0.5 as the cutoff to distinguish true predicted splice-altering variants; 0.2 would lead to a high recall, while 0.8 is recommended to achieve higher precision values. SpliceAI can be run in a standalone mode or with the available pre-scored list for the VEP plugin, which could represent an advantage for VEP users. The pre-computed set contains scores greater than 0.1 for all possible SNVs and 1–4 bases indels within genes defined by GENCODE. Due to the time-consumption of the standalone SpliceAI software (analysis of Chr20 took 38 h using a single core and 14.5 h using parallel execution on multiple cores), performance analyses were run exploiting the pre-scored dataset. Out of the 86,132 variants provided, SpliceAI scored 34,122 variants affecting the splicing process. Most of these were scored for only 1 gene (27,694 variants, which represent 81.16% of the total scored variants). Moreover, 5279 variants were scored for 2 genes, 867 for 3 genes, 202 for 4 genes, 44 for 5 genes, 16 for 6 genes, 15 for 7 genes, 2 for 8 genes, and 3 for 9 genes. Focusing on the scores provided in default mode, the computation of DS for (i) acceptor gain resulted in 269 variants with 0.5 < DS < 0.8 and 534 variants showing 0.2 < DS < 0.5, (ii) acceptor loss resulted in 349 with 0.5 < DS < 0.8 and 420 with 0.2 < DS < 0.5, and (iii) donor gain resulted in 541 with 0.5 < DS < 0.8 and 739 with 0.2 < DS < 0.5; (iv) donor loss in 667 with 0.5 < DS < 0.8 and 730 with 0.2 < DS < 0.5.
Major limits of SpliceAI are the exclusion of variants within 5 kb from the chromosome ends and the focus on SNPs within 50 bp from a canonical exon.
SPIDEX [] is a database of pre-computed scores generated by a machine-learning approach that evaluates how strongly genetic variants potentially affect an RNA splicing event. This is measured using the Percentage of Spliced-In (PSI) metric, which evaluates whether a splicing isoform is enriched in the presence of a variant. Scores cover all synonymous, missense, and nonsense exonic SNVs, as well as intronic SNVs that are in proximity of splice junctions. SPIDEX annotation is available through the ANNOVAR framework []. The software returns the gene supposedly affected by the variant, together with two scores: dpsi_max_tissue, a percentage indicating the maximum value, across tissues, of delta PSI (i.e., the predicted change of PSI due to the variant), and dpsi_zscore, the z-score of the former, relative to the distribution of delta PSI due to common SNPs.
The choice of thresholds useful to determine when a variant is predicted to alter splicing is problem-dependent. Nevertheless, Butkiewicz et al. [] hypothesized that a |z-score| > 2 could indicate a high likelihood of splicing disruption. Over the 86,132 variants in the reference VCF, 3317 were annotated with a SPIDEX score, and 537 had a |z-score| > 2.
A possible limitation of the tool is its ability to analyze only intronic SNVs located up to 300 nt from the splice junctions.
Apart from using different algorithms, the main difference between the two programs lies in the width of the region flanking the variant used for training the model. SpliceAI uses a large window of 10,000 nucleotides to identify long-range features that may affect the spliceosome, whereas SPIDEX is trained on sequence features extracted from each exon and its neighboring introns and exons.
The performance of tools for interpreting variants in splicing regions is reported in Table 3. They are similar both in specificity and precision. Spidex appears faster than SpliceAI, although the latter can detect a major number of variants. A total of 44 variants located in splicing regions were specifically identified by dedicated tools (35 by SpliceAI, 8 by Spidex, and 1 by both), while the other 348 were effectively detected also by the other tools (Figure 2).

3.4. Tools for Identifying NCV Affecting Genome Accessibility and Mutation Intolerance

Accessible chromatin loci across the genome are called ‘open chromatin regions’ (OCRs). These nucleosome-depleted regions can be bound by protein factors and change dynamically [] in response to external stimuli and developmental cues, playing crucial roles, among the others, in gene transcription []. OCRs containing cis-elements able to be bound by transcription factors are well conserved among eukaryotes. Genetic lesions in these loci can contribute to complex human diseases by re-modulating gene expression and disrupting finely tuned transcriptional networks []. Two interesting aspects of the higher-order structures are the so-called ‘topologically associating domains’ (TADs) and the high number of intra-domain interactions. Mutations at TAD boundaries could lead to the rewiring of cis interactions causing genes ectopic expression [,,]. It has been shown that, in patients with presumed genetic diseases, regions intolerant to mutations are enriched for non-coding de-novo pathogenic variants []. It has also been highlighted that conservation, indicating that a sequence has been maintained by natural selection, and intolerance seem tightly connected concepts, since ultra-conserved non-coding elements appeared as the most intolerant regions in the human genome [].
A set of software programs have been developed to deal with higher-order structures, that are becoming crucial for interpreting WGS data.
An example is DeepSEA [], a deep-learning-based algorithm that aims at predicting the functional impact of non-coding variants on transcription factor binding sites, DNase I hypersensitivity domains (DHSs), and histone marks, using sequence information alone and with single-nucleotide sensitivity. This represents a challenging task, requiring the accurate modeling of the complex interactions between sequence context, TF binding, and histone modifications. To compute reliable sequence-based predictions, DeepSEA uses three main levels of information: (i) a 1 kb genomic region surrounding the variant position; (ii) flexible modeling of the complex interactions between sequences, TFs, DHSs, and histone marks; (iii) joint learning of chromatin factors sharing the same predictive features to increase the computational efficiency. For each input variant, DeepSEA computes a functional significance score based on chromatin effect predictions and evolutionary information-derived scores. A functional significance score < 0.01 was considered to define pathogenic variants, as it was the most stringent threshold in the summary output file. Multiallelic variants must be removed before running DeepSEA.
Another selected tool is Orion [], which detects non-coding regions depleted of variations, suggesting them as intolerant to mutations and subject to purifying selection in the human lineage. Orion scans the whole genome and, for each position, it calculates a score as the difference between the observed and expected site-frequency spectrum (SFS) in a window of 501 bp, where SFS is a statistic measure used in population genetics to describe the distribution of allele frequencies across loci in a population. A higher score indicates a more intolerant region and, consequently, a potentially more pathogenic variant. In addition to the software to calculate the score [], Orion provides a pre-computed set of scores, available to directly annotate the variants file through Vcfanno annotation software []. Among the 86,132 input variants, 41,269 were annotated with an Orion score, ranging from a maximum of 0.11607 (rs2979626) to a minimum of −8.87495 (rs561980359). Since a threshold for assuming pathogenicity is not provided, an empirical approach was applied, considering that exons (which tend to be intolerant) typically have a mean score value of −0.174, introns of −0.325, and protein-coding regions of −0.262. Therefore, damaging variants were considered when the score > −0.174. Orion’s major limit consists in the absence of pre-computed scores, which can greatly reduce computational time for repetitive regions and sex chromosomes, disabling any chance of finding possible pathogenic variants in those genomic locations.
LINSIGHT [], the updated version of fitCons [], provides the ‘fitness consequence’ scores, used as evolution-based measures of potential genomic function. In particular, fitCons aggregates information on natural selection obtained from the INSIGHT (Inference of Natural Selection from Interspersed Genomically coHerent elemenTs) evolutionary model [,]. For sites under negative selection, thus less likely to experience a variation in the human lineage, the presence of an SNV will be associated with a low frequency of segregation due to selection. Based on the same concept, LINSIGHT (Linear INSIGHT) improved speed, scalability, genomic resolution, and prediction power by coupling the probabilistic INSIGHT model to a generalized linear model for genomic features, avoiding the need for discretization. The tool provides pre-computed LINSIGHT scores, which can be employed to estimate negative selection regions in the human genome. The tool could annotate 7252 variants out of the 86,132 in the input VCF. According to the related publication, a score >0.8 should be associated with a strong selection; therefore, variants localized in regions with such scores have been considered pathogenic. Of note, the tool is based on the assumption that natural selection occurred in the past and provides useful information about phenotypic importance in the present time. This approach leads to some limitations, as, in this light, variants influencing clinical traits that do not show signs of historical purifying selection (e.g., those influencing phenotypes dependent on the modern human environment) could be difficult to study. Moreover, traits related to highly epistatic loci or the contribution of numerous loci could be difficult to attribute to single nucleotides.
Basenji [], the successor of Basset, is a deep convolutional neural network (CNN)-based approach. Basenji allows: (i) training deep CNN to predict regulatory activity along very long chromosome-scale DNA sequences; (ii) score variants according to their predicted influence on regulatory activity; (iii) annotating the distal regulatory elements that influence gene activity and the specific nucleotides that drive regulatory element function. For each variant, two scores are retrieved: SAD (SNP Activity Difference) and SED (SNP expression difference, which requires additional file input). SAD represents the difference between the predicted accessibility of the alternative and the reference alleles. Thus, higher positive SAD indicates higher predicted chromatin accessibility on the alternative allele than on the reference one [], and the higher the absolute value, the higher the impact of the considered variant on accessibility. For Basenji, the pre-trained model offered by developers (downloadable from GitHub) was used. Basenji annotated all 86,132 variants contained in the VCF input file. It is relevant to note that, for each variant, 5313 SAD scores were computed, referring to different types of cell and experimental techniques (CAGE, DNase, and chip) []. The gold standard for analyzing results is to focus on SAD scores from training datasets relevant to the cell type or tissue of interest. However, since tests carried out in this review are general purpose, human embryonic stem cells (hESC) were considered. Since the resulting values were highly variable, a predefined threshold to identify relevant variants was difficult to detect. Thus, z-scores were computed for all variants, and |z-score| > 1.96 was considered relevant, allowing the identification of the elements belonging to the extreme 5% of the area under the normal curve. Overall, 1610 variants exceeding the fixed threshold were detected. A recognized approach for threshold definition represents the main disadvantage of Basenji and could easily lead to unreliable results.
The methodologies applied by the tools in this category are quite diverse. Basenji and DeepSEA are sequence-based methods. Basenji is trained on chromatin accessibility profiles to predict the impact of genomic variants on gene expression, while DeepSEA is based on a wide range of chromatin profiles to estimate the effects of sequence alterations on chromatin accessibility. LINSIGHT belongs instead to the class of evolutionary-based methods. It combines functional and comparative genomic data to predict the effects of non-coding variants on fitness. Finally, Orion uses population genetics-based methodologies to identify genomic regions that are intolerant to variation and are therefore more likely to be pathogenic when mutated. These approaches, albeit different, are interconnected because chromatin accessibility, evolutionary conservation, and mutation intolerance are highly correlated features [,].
The performance of the considered tools for interpreting variants affecting genome accessibility and conserved regions is reported in Table 3. All the considered tools showed good specificity, while only LINSIGHT reported acceptable precision, as well as being the fastest. Conversely, Basenji could detect the smallest number of TP, resulting to be the slower and less precise tool (Table 3 and Figure 2). Interestingly, LINSIGHT and DeepSEA show quite a high overlap in variant detection (277 variants commonly detected, of which 27 were specifically identified by these two tools) although their aims in principle are quite different, LINSIGHT being focused on the evolutionary context, and DeepSEA on chromatin structure aspects. A minor overlap is identifiable between the results of LINSIGHT and Orion, although dedicated to similar aspects (respectively, regions that are conserved and intolerant to variations).

3.5. Phenotype-Based Functional Prediction Tool

Among the general purpose “investigator” tools, Genomiser [] is the only one able to interpret and associate non-coding variants to specific Mendelian disorders. It is an Exomiser-based [] whole–genome analysis framework able to score the relevance of variations in the non-coding genome and associate them with specific Mendelian diseases while exploiting the Human Phenotype Ontology [] as input data. It relies on a customizable configuration file containing all the steps to be performed, the input VCF file, the pedigree (for multiple samples), the patient’s HPO terms (advised), and the inheritance model (if known). Each variant is scored according to CADD or ReMM score [,] (from 0 for non-deleterious to 1 for deleterious), allele frequency, regulatory sequences, chromosomal topological domains, and its phenotypic relevance in relation to the disease. Scores can be prioritized through phenotype similarity algorithms, assessing variants’ likelihood to contribute to the pathological phenotype. Genomiser can be run with or without HPO terms. In this latter case, results are based on ReMM-predicted pathogenicity and the allele frequency of the variant in reference databases, their rank relying on their likelihood of pathogenicity.
The output includes the associated genes and, for each variant, (i) the available pathogenicity scores (i.e., CADD, Polyphen, Mutationtaster, Sift, ReMM), (ii) the Exomiser variant score, which predicts a measure of rarity and pathogenicity of the variant (0 for probably benign, 1 for probably pathogenic), (iii) the Exomiser gene-phenotype score, based on the phenotypic similarity between the given HPO terms and rare diseases known to be associated with the gene in OMIM or Orphanet (from 0, if no phenotype information is provided, to 1), (iv) the Exomiser gene-variant score, which states how likely the considered variant acts on the predicted gene, and (v) the Exomiser gene combined score, used for the prioritization process, ranging from 0 to 1 [,]. Initial tests were performed on Chr20 variants, without relying on HPO terms since data belonged to a healthy individual, to evaluate the tool’s performance in the simplest conditions. In this case, 380 out of 78,186 variants contained in the considered VCF file were marked as relevant, 364 of which lay in non-coding regions. To exploit Genomiser’s ability to detect the variants’ impact on the provided HPO phenotype, it was also run after enriching the Chr20 VCF file with 6 variants (two in splice regions, two upstream a gene, one in 5′UTR, and one in an intron) selected from ncVarDB pathogenic set, causing independent pathologies. Associated HPO terms were also provided to detect the ability of the tool to correctly identify the additional variants as the cause of the disease. Genomiser was run 6 times (1 for each variant and associated pathology), and, in all cases, it was able to detect the variant of interest as contributing to the HPO term-related pathology, ranking it on top of the list (1st or 2nd position). Overall, Genomiser took less than 10 min to provide the output.

4. Discussion

Bioinformatics tools currently available to predict the effect of genetic variants in the human genome are heavily biased towards the protein-coding regions due to the wider knowledge related to genes and protein function. Despite the scarce attention gained in the past, non-coding variants may affect gene function, thus playing a role in human diseases. Interpreting the effects of NCVs is a new and difficult challenge, which needs to be afforded with the support of advanced bioinformatics software programs. In this review, tools for non-coding variants’ effect interpretation were evaluated, and their performance was tested on a computational and information basis. In particular, tools for interpreting variants falling in UTRs, splicing, and intolerant regions, other than those affecting the genome accessibility, were taken into account, tested, and compared.
Other non-coding regions of the human genome could be modified by variants potentially affecting the system’s physiology. Among them, non-coding RNAs (ncRNAs) and proximal/distal cis-regulatory elements are of particular interest. From a process regulation perspective, housekeeping and regulatory ncRNAs exist. The first are abundant and ubiquitous in cells and primarily regulate generic cellular functions, whereas the second ones act as regulators of gene expression at epigenetic, transcriptional, and post-transcriptional levels [,,,]. Gene expression regulation is also strictly monitored by proximal and distal cis-regulatory elements, characterized by defined histone marks to enable their identification and to regulate transcription activation based on timing, tissue, and associated genes. Proximal elements mainly include gene promoters, whereas distal elements refer to enhancers, typically found in DNaseI hypersensitive sites surrounded by nucleosomes marked by H3K4me1 and H3K27ac, and transcription factors [,]. Promoters and enhancers include specific motifs in their sequence, which are recognized and bound by distinct transcription factors, and, probably, other non-coding elements. This should be considered when investigating the pathogenicity of variants on such elements [,,]. Other elements in non-coding regions are CpG islands, regions of at least 200 bp, with a GC amount greater than 50%, and an observed-to-expected CpG ratio greater than 60% []. Mutations at CpG islands could affect promoter activity, causing, for example, stable silencing or, conversely, the constitutive expression of genes [].
It should be noted that, at the moment, variants at these sites cannot be functionally annotated by specific tools but only by general-purpose ones that are potentially able to deal with variants over the entire genome.
To carry out quantitative analysis, a controlled scenario was identified, exploiting variants identified in Chr20 of a healthy individual, enriched by the set of known benign and pathogenic variants available through ncVarDB. The full dataset was helpful when determining computational performance, while the ncVarDB subset was crucial for calculating specificity, precision, sensitivity, and accuracy (Table 3). Specificity, which defines how good a test is in identifying true negatives, was >0.8 for all tools, whereas the other performance features spanned from extremely low to extremely high values. Overall, the entire group of examined tools contributed to the functional annotation of most of the 721 pathogenic variants provided by ncVarDB (Figure 2). Among them, 596 (82.66%) were correctly annotated as pathogenic by at least one tool. Regarding the 125 pathogenic variants not annotated correctly, 57 belonged to the mitochondrial chromosome (not considered by the majority of tools), whereas 11, although annotated as pathogenic by ncvarDB, are reported in ClinVar [] with conflicting or uncertain interpretations. The remaining 57 (7.9%) pathogenic variants were not correctly classified by any tool considered in this review. Relying on the fact that each evaluated software contributed to the variant identification with a set of uniquely detected variants, the overall approach we could suggest when dealing with the analysis of non-coding regions consists of the integration of outputs from multiple methods, as also reported by Liu et al. []. Figure 2 is highly representative, from both qualitative (Figure 2A) and quantitative (Figure 2B) points of this concept view, underlying the need to combine more than one tool to both functionally annotate the vast majority of variants and to strengthen the reliability of prediction. However, most variants are correctly detected by wide-spectrum programs such as DeepSea, LINSIGHT, and SpliceAI, and their combination may constitute a good compromise.
Another consideration concerns the computational efforts: the present study was carried out on a single chromosome of a single individual. Nevertheless, in WGS, 23 chromosome couples should be analyzed, often in trios. This implies that high-performance computing will be necessary for WGS analysis, and available software should enable the parallel computational paradigm.
Hopefully, in the near future, advances in both molecular biology (some regions of the genome deserve additional research to evaluate the consequences of variants in those sequences) and computational domains (novel bioinformatics algorithms are expected, exploiting cutting-edge technologies) will significantly improve the understanding of non-coding variants, whose impact is still an open challenge in current human genetics.

Author Contributions

N.T., E.B.: data curation, analysis, investigation, writing—review and editing. P.U.: conceptualization, data curation, writing—review and editing. E.I., T.P.: visualization, writing—review and editing. M.S., A.C., I.C.: funding acquisition, writing—review and editing. F.V.: funding acquisition, conceptualization, data curation, supervision, writing—original draft, writing—review and editing. M.R.: supervision, conceptualization, data curation, writing—original draft, writing—review and editing. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Italian Ministry of Health by “Ricerca Finalizzata” (grant number RF-2018-12366314) and by “Ricerca Corrente” and “5 × mille” at the Gaslini Institute. A.C. acknowledges the Center for Precision, Preventive, and Predictive Medicine in Aosta (CMP3VdA), 5000genomi@vda project, and Regione Valle D’Aosta for the financial support.

Data Availability Statement

Variants in chromosome 20 were extracted from the VCF file of a sample of Han Chinese ancestry [] (HG005-NA24631) retrieved from the Genome In A Bottle (GIAB) project []. The set of known pathogenic and benign NCVs was obtained from the manually curated ncVarDB [] database.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Rands, C.M.; Meader, S.; Ponting, C.P.; Lunter, G. 8.2% of the Human Genome Is Constrained: Variation in Rates of Turnover across Functional Element Classes in the Human Lineage. PLoS Genet. 2014, 10, e1004525. [Google Scholar] [CrossRef]
  2. Kellis, M.; Wold, B.; Snyder, M.P.; Bernstein, B.E.; Kundaje, A.; Marinov, G.K.; Ward, L.D.; Birney, E.; Crawford, G.E.; Dekker, J.; et al. Defining functional DNA elements in the human genome. Proc. Natl. Acad. Sci. USA 2014, 111, 6131–6138. [Google Scholar] [CrossRef] [PubMed]
  3. Song, M.; Yang, X.; Ren, X.; Maliskova, L.; Li, B.; Jones, I.R.; Wang, C.; Jacob, F.; Wu, K.; Traglia, M.; et al. Mapping cis -regulatory chromatin contacts in neural cells links neuropsychiatric disorder risk variants to target genes. Nat. Genet. 2019, 51, 1252–1262. [Google Scholar] [CrossRef]
  4. Rhind, N.; Gilbert, D.M. DNA replication timing. Cold Spring Harb. Perspect. Biol. 2013, 5, a010132. [Google Scholar] [CrossRef] [PubMed]
  5. Koren, A.; Handsaker, R.E.; Kamitaki, N.; Karlić, R.; Ghosh, S.; Polak, P.; Eggan, K.; McCarroll, S.A. Genetic variation in human DNA replication timing. Cell 2014, 159, 1015–1026. [Google Scholar] [CrossRef] [PubMed]
  6. McInerney-Leo, A.M.; Duncan, E.L. Massively Parallel Sequencing for Rare Genetic Disorders: Potential and Pitfalls. Front. Endocrinol. 2020, 11, 628946. [Google Scholar] [CrossRef]
  7. Ellingford, J.M.; Ahn, J.W.; Bagnall, R.D.; Baralle, D.; Barton, S.; Campbell, C.; Downes, K.; Ellard, S.; Duff-Farrier, C.; FitzPatrick, D.R.; et al. Recommendations for clinical interpretation of variants found in non-coding regions of the genome. Genome Med. 2022, 14, 73. [Google Scholar] [CrossRef]
  8. Wang, Z.; Zhao, G.; Li, B.; Fang, Z.; Chen, Q.; Wang, X.; Luo, T.; Wang, Y.; Zhou, Q.; Li, K.; et al. Performance comparison of computational methods for the prediction of the function and pathogenicity of non-coding variants. Genom. Proteom. Bioinform. 2022; in press. [Google Scholar] [CrossRef]
  9. Rojano, E.; Seoane, P.; Ranea, J.A.G.; Perkins, J.R. Regulatory variants: From detection to predicting impact. Brief. Bioinform. 2019, 20, 1639–1654. [Google Scholar] [CrossRef]
  10. Pabinger, S.; Dander, A.; Fischer, M.; Snajder, R.; Sperk, M.; Efremova, M.; Krabichler, B.; Speicher, M.R.; Zschocke, J.; Trajanoski, Z. A survey of tools for variant analysis of next-generation genome sequencing data. Brief. Bioinform. 2014, 15, 256–278. [Google Scholar] [CrossRef]
  11. Gloss, B.S.; Dinger, M.E. Realizing the significance of noncoding functionality in clinical genomics. Exp. Mol. Med. 2018, 50, 1–8. [Google Scholar] [CrossRef]
  12. French, J.D.; Edwards, S.L. The Role of Noncoding Variants in Heritable Disease. Trends Genet. 2020, 36, 880–891. [Google Scholar] [CrossRef] [PubMed]
  13. Biggs, H.; Parthasarathy, P.; Gavryushkina, A.; Gardner, P.P. ncVarDB: A manually curated database for pathogenic non-coding variants and benign controls. Database 2020, 2020, baaa105. [Google Scholar] [CrossRef] [PubMed]
  14. Kuhn, R.M.; Haussler, D.; Kent, W.J. The UCSC genome browser and associated tools. Brief. Bioinform. 2013, 14, 144–161. [Google Scholar] [CrossRef]
  15. Zook, J.M.; McDaniel, J.; Olson, N.D.; Wagner, J.; Parikh, H.; Heaton, H.; Irvine, S.A.; Trigg, L.; Truty, R.; McLean, C.Y.; et al. An open resource for accurately benchmarking small variant and reference calls. Nat. Biotechnol. 2019, 37, 561–566. [Google Scholar] [CrossRef] [PubMed]
  16. Genome in a Bottle, NIST. 2012. Available online: https://www.nist.gov/programs-projects/genome-bottle (accessed on 7 June 2021).
  17. McLaren, W.; Gil, L.; Hunt, S.E.; Riat, H.S.; Ritchie, G.R.S.; Thormann, A.; Flicek, P.; Cunningham, F. The Ensembl Variant Effect Predictor. Genome Biol. 2016, 17, 122. [Google Scholar] [CrossRef]
  18. Gao, L.; Uzun, Y.; Gao, P.; He, B.; Ma, X.; Wang, J.; Han, S.; Tan, K. Identifying noncoding risk variants using disease-relevant gene regulatory networks. Nat. Commun. 2018, 9, 702. [Google Scholar] [CrossRef]
  19. Kelley, D.R.; Reshef, Y.A.; Bileschi, M.; Belanger, D.; McLean, C.Y.; Snoek, J. Sequential regulatory activity prediction across chromosomes with convolutional neural networks. Genome Res. 2018, 28, 739–750. [Google Scholar] [CrossRef]
  20. Alipanahi, B.; Delong, A.; Weirauch, M.T.; Frey, B.J. Predicting the sequence specificities of DNA- and RNA-binding proteins by deep learning. Nat. Biotechnol. 2015, 33, 831–838. [Google Scholar] [CrossRef]
  21. Zhou, J.; Troyanskaya, O.G. Predicting effects of noncoding variants with deep learning-based sequence model. Nat. Methods 2015, 12, 931–934. [Google Scholar] [CrossRef]
  22. Lee, D.; Gorkin, D.U.; Baker, M.; Strober, B.J.; Asoni, A.L.; McCallion, A.S.; Beer, M.A. A method to predict the impact of regulatory variants from DNA sequence. Nat. Genet. 2015, 47, 955–961. [Google Scholar] [CrossRef]
  23. Backenroth, D.; He, Z.; Kiryluk, K.; Boeva, V.; Pethukova, L.; Khurana, E.; Christiano, A.; Buxbaum, J.D.; Ionita-Laza, I. FUN-LDA: A Latent Dirichlet Allocation Model for Predicting Tissue-Specific Functional Effects of Noncoding Variation: Methods and Applications. Am. J. Hum. Genet. 2018, 102, 920–942. [Google Scholar] [CrossRef] [PubMed]
  24. Dahary, D.; Golan, Y.; Mazor, Y.; Zelig, O.; Barshir, R.; Twik, M.; Stein, T.I.; Rosner, G.; Kariv, R.; Chen, F.; et al. Genome analysis and knowledge-driven variant interpretation with TGex. BMC Med. Genom. 2019, 12, 200. [Google Scholar] [CrossRef] [PubMed]
  25. Lu, Q.; Hu, Y.; Sun, J.; Cheng, Y.; Cheung, K.-H.; Zhao, H. A Statistical Framework to Predict Functional Non-Coding Regions in the Human Genome Through Integrated Analysis of Annotation Data. Sci. Rep. 2015, 5, 10576. [Google Scholar] [CrossRef] [PubMed]
  26. Smedley, D.; Schubach, M.; Jacobsen, J.O.B.; Köhler, S.; Zemojtel, T.; Spielmann, M.; Jäger, M.; Hochheiser, H.; Washington, N.L.; McMurry, J.A.; et al. A Whole-Genome Analysis Framework for Effective Identification of Pathogenic Regulatory Variants in Mendelian Disease. Am. J. Hum. Genet. 2016, 99, 595–606. [Google Scholar] [CrossRef] [PubMed]
  27. Desmet, F.-O.; Hamroun, D.; Lalande, M.; Collod-Béroud, G.; Claustres, M.; Béroud, C. Human Splicing Finder: An online bioinformatics tool to predict splicing signals. Nucleic Acids Res. 2009, 37, e67. [Google Scholar] [CrossRef]
  28. Amlie-Wolf, A.; Tang, M.; Mlynarski, E.E.; Kuksa, P.P.; Valladares, O.; Katanic, Z.; Tsuang, D.; Brown, C.D.; Schellenberg, G.D.; Wang, L.-S. INFERNO: Inferring the molecular mechanisms of noncoding genetic variants. Nucleic Acids Res. 2018, 46, 8740–8753. [Google Scholar] [CrossRef]
  29. Vitsios, D.; Dhindsa, R.S.; Middleton, L.; Gussow, A.B.; Petrovski, S. Prioritizing non-coding regions based on human genomic constraint and sequence context with deep learning. Nat. Commun. 2021, 12, 1504. [Google Scholar] [CrossRef]
  30. Huang, Y.-F.; Gulko, B.; Siepel, A. Fast, scalable prediction of deleterious noncoding variants from functional and population genomic data. Nat. Genet. 2017, 49, 618–624. [Google Scholar] [CrossRef]
  31. Aïssi, D.; Soukarieh, O.; Proust, C.; Jaspard-Vinassa, B.; Fautrad, P.; Ibrahim-Kosta, M.; Leal-Valentim, F.; Roux, M.; Bacq-Daian, D.; Olaso, R.; et al. MORFEE: A new tool for detecting and annotating single nucleotide variants creating premature ATG codons from VCF files. bioRxiv 2020. [Google Scholar] [CrossRef]
  32. Gussow, A.B.; Copeland, B.R.; Dhindsa, R.S.; Wang, Q.; Petrovski, S.; Majoros, W.H.; Allen, A.S.; Goldstein, D.B. Orion: Detecting regions of the human non-coding genome that are intolerant to variation using population genetics. PLoS ONE 2017, 12, e0181604. [Google Scholar] [CrossRef]
  33. Boyle, A.P.; Hong, E.L.; Hariharan, M.; Cheng, Y.; Schaub, M.A.; Kasowski, M.; Karczewski, K.J.; Park, J.; Hitz, B.C.; Weng, S.; et al. Annotation of functional variation in personal genomes using RegulomeDB. Genome Res. 2012, 22, 1790–1797. [Google Scholar] [CrossRef] [PubMed]
  34. Xiong, H.Y.; Alipanahi, B.; Lee, L.J.; Bretschneider, H.; Merico, D.; Yuen, R.K.C.; Hua, Y.; Gueroussov, S.; Najafabadi, H.S.; Hughes, T.R.; et al. The human splicing code reveals new insights into the genetic determinants of disease. Science 2015, 347, 1254806. [Google Scholar] [CrossRef] [PubMed]
  35. Jaganathan, K.; Panagiotopoulou, S.K.; McRae, J.F.; Darbandi, S.F.; Knowles, D.; Li, Y.I.; Kosmicki, J.A.; Arbelaez, J.; Cui, W.; Schwartz, G.B.; et al. Predicting Splicing from Primary Sequence with Deep Learning. Cell 2019, 176, 535–548.e24. [Google Scholar] [CrossRef] [PubMed]
  36. Zhang, X.; Wakeling, M.; Ware, J.; Whiffin, N. Annotating high-impact 5′untranslated region variants with the UTRannotator. Bioinformatics 2021, 37, 1171–1173. [Google Scholar] [CrossRef] [PubMed]
  37. Stelzer, G.; Plaschkes, I.; Oz-Levi, D.; Alkelai, A.; Olender, T.; Zimmerman, S.; Twik, M.; Belinky, F.; Fishilevich, S.; Nudel, R.; et al. VarElect: The phenotype-based variation prioritizer of the GeneCards Suite. BMC Genom. 2016, 17, 444. [Google Scholar] [CrossRef]
  38. Fishilevich, S.; Nudel, R.; Rappaport, N.; Hadar, R.; Plaschkes, I.; Stein, T.I.; Rosen, N.; Kohn, A.; Twik, M.; Safran, M.; et al. GeneHancer: Genome-wide integration of enhancers and target genes in GeneCards. Database 2017, 2017, bax028. [Google Scholar] [CrossRef]
  39. Kircher, M.; Witten, D.M.; Jain, P.; O’Roak, B.J.; Cooper, G.M.; Shendure, J. A general framework for estimating the relative pathogenicity of human genetic variants. Nat. Genet. 2014, 46, 310–315. [Google Scholar] [CrossRef]
  40. Quang, D.; Chen, Y.; Xie, X. DANN: A deep learning approach for annotating the pathogenicity of genetic variants. Bioinformatics 2015, 31, 761–763. [Google Scholar] [CrossRef]
  41. Yang, H.; Chen, R.; Wang, Q.; Wei, Q.; Ji, Y.; Zheng, G.; Zhong, X.; Cox, N.J.; Li, B. De novo pattern discovery enables robust assessment of functional consequences of non-coding variants. Bioinformatics 2019, 35, 1453–1460. [Google Scholar] [CrossRef]
  42. Ionita-Laza, I.; McCallum, K.; Xu, B.; Buxbaum, J.D. A spectral approach integrating functional genomic annotations for coding and noncoding variants. Nat. Genet. 2016, 48, 214–220. [Google Scholar] [CrossRef]
  43. Rogers, M.F.; Shihab, H.A.; Mort, M.; Cooper, D.N.; Gaunt, T.R.; Campbell, C. FATHMM-XF: Accurate prediction of pathogenic point mutations via extended features. Bioinformatics 2018, 34, 511–513. [Google Scholar] [CrossRef] [PubMed]
  44. Ritchie, G.R.S.; Dunham, I.; Zeggini, E.; Flicek, P. Functional annotation of non-coding sequence variants. Nat. Methods 2014, 11, 294–296. [Google Scholar] [CrossRef] [PubMed]
  45. Wang, J.; Ullah, A.Z.D.; Chelala, C. IW-Scoring: An Integrative Weighted Scoring framework for annotating and prioritizing genetic variations in the noncoding genome. Nucleic Acids Res. 2018, 46, e47. [Google Scholar] [CrossRef] [PubMed]
  46. Zhou, L.; Zhao, F. Prioritization and functional assessment of noncoding variants associated with complex diseases. Genome Med. 2018, 10, 53. [Google Scholar] [CrossRef]
  47. Bodea, C.A.; Mitchell, A.A.; Bloemendal, A.; Day-Williams, A.G.; Runz, H.; Sunyaev, S.R. PINES: Phenotype-informed tissue weighting improves prediction of pathogenic noncoding variants. Genome Biol. 2018, 19, 173. [Google Scholar] [CrossRef]
  48. Schwarz, J.M.; Hombach, D.; Köhler, S.; Cooper, D.N.; Schuelke, M.; Seelow, D. Regulation Spotter: Annotation and interpretation of extratranscriptic DNA variants. Nucleic Acids Res. 2019, 47, W106–W113. [Google Scholar] [CrossRef]
  49. Sophia Genetics, Sophia Genetics. (n.d.). Available online: https://www.interactive-biosoftware.com/ (accessed on 1 July 2021).
  50. Wang, K.; Li, M.; Hakonarson, H. ANNOVAR: Functional annotation of genetic variants from high-throughput sequencing data. Nucleic Acids Res. 2010, 38, e164. [Google Scholar] [CrossRef]
  51. Katainen, R.; Donner, I.; Cajuso, T.; Kaasinen, E.; Palin, K.; Mäkinen, V.; Aaltonen, L.A.; Pitkänen, E. Discovery of potential causative mutations in human coding and noncoding genome with the interactive software BasePlayer. Nat. Protoc. 2018, 13, 2580–2600. [Google Scholar] [CrossRef]
  52. Zhang, S.; He, Y.; Liu, H.; Zhai, H.; Huang, D.; Yi, X.; Dong, X.; Wang, Z.; Zhao, K.; Zhou, Y.; et al. regBase: Whole genome base-wise aggregation and functional prediction for human non-coding regulatory variants. Nucleic Acids Res. 2019, 47, e134. [Google Scholar] [CrossRef]
  53. Cingolani, P.; Platts, A.; Wang, L.L.; Coon, M.; Nguyen, T.; Wang, L.; Land, S.J.; Lu, X.; Ruden, D.M. A program for annotating and predicting the effects of single nucleotide polymorphisms, SnpEff: SNPs in the genome of Drosophila melanogaster strain w1118; iso-2; iso-3. Fly 2012, 6, 80–92. [Google Scholar] [CrossRef]
  54. SNPnexus: A Web Server for Functional Annotation of Human Genome Sequence Variation (2020 Update)|Nucleic Acids Research|Oxford Academic, (n.d.). Available online: https://academic.oup.com/nar/article/48/W1/W185/5851388 (accessed on 1 July 2021).
  55. Desvignes, J.-P.; Bartoli, M.; Delague, V.; Krahn, M.; Miltgen, M.; Béroud, C.; Salgado, D. VarAFT: A variant annotation and filtration system for human next generation sequencing data. Nucleic Acids Res. 2018, 46, W545–W553. [Google Scholar] [CrossRef] [PubMed]
  56. Hindorff, L.A.; Sethupathy, P.; Junkins, H.A.; Ramos, E.M.; Mehta, J.P.; Collins, F.S.; Manolio, T.A. Potential etiologic and functional implications of genome-wide association loci for human diseases and traits. Proc. Natl. Acad. Sci. USA 2009, 106, 9362–9367. [Google Scholar] [CrossRef]
  57. MacArthur, J.; Bowler, E.; Cerezo, M.; Gil, L.; Hall, P.; Hastings, E.; Junkins, H.; McMahon, A.; Milano, A.; Morales, J.; et al. The new NHGRI-EBI Catalog of published genome-wide association studies (GWAS Catalog). Nucleic Acids Res. 2017, 45, D896–D901. [Google Scholar] [CrossRef]
  58. Condit, C.M.; Achter, P.J.; Lauer, I.; Sefcovic, E. The changing meanings of “mutation”: A contextualized study of public discourse. Hum. Mutation 2002, 19, 69–75. [Google Scholar] [CrossRef] [PubMed]
  59. Mignone, F.; Gissi, C.; Liuni, S.; Pesole, G. Untranslated regions of mRNAs. Genome Biol. 2002, 3, REVIEWS0004. [Google Scholar] [CrossRef] [PubMed]
  60. Whiffin, N.; Karczewski, K.J.; Zhang, X.; Chothani, S.; Smith, M.J.; Evans, D.G.; Roberts, A.M.; Quaife, N.M.; Schafer, S.; Rackham, O.; et al. Characterising the loss-of-function impact of 5′ untranslated region variants in 15,708 individuals. Nat. Commun. 2020, 11, 2523. [Google Scholar] [CrossRef] [PubMed]
  61. Kozak, M. The scanning model for translation: An update. J. Cell Biol. 1989, 108, 229–241. [Google Scholar] [CrossRef]
  62. ImperialCardioGenetics/UTRannotator, ImperialCardioGenetics. 2021. Available online: https://github.com/ImperialCardioGenetics/UTRannotator/blob/40e30db003d72435eb3744ee747029294abbcf3a/Supplementary_Information.pdf (accessed on 11 June 2021).
  63. Leklab/5utr, Leklab. 2020. Available online: https://github.com/leklab/5utr (accessed on 21 January 2021).
  64. Human 5′ UTR Design and Variant Effect Prediction from a Massively Parallel Translation Assay|Nature Biotechnology, (n.d.). Available online: https://www.nature.com/articles/s41587-019-0164-5 (accessed on 11 June 2021).
  65. Murat, P.; Marsico, G.; Herdy, B.; Ghanbarian, A.; Portella, G.; Balasubramanian, S. RNA G-quadruplexes at upstream open reading frames cause DHX36- and DHX9-dependent translation of human mRNAs. Genome Biol. 2018, 19, 229. [Google Scholar] [CrossRef]
  66. Anna, A.; Monika, G. Splicing mutations in human genetic disorders: Examples, detection, and confirmation. J. Appl. Genet. 2018, 59, 253–268. [Google Scholar] [CrossRef]
  67. Lord, J.; Gallone, G.; Short, P.J.; McRae, J.F.; Ironfield, H.; Wynn, E.H.; Gerety, S.S.; He, L.; Kerr, B.; Johnson, D.S.; et al. Deciphering Developmental Disorders study, Pathogenicity and selective constraint on variation near splice sites. Genome Res. 2019, 29, 159–170. [Google Scholar] [CrossRef]
  68. Soemedi, R.; Cygan, K.J.; Rhine, C.L.; Wang, J.; Bulacan, C.; Yang, J.; Bayrak-Toydemir, P.; McDonald, J.; Fairbrother, W.G. Pathogenic variants that alter protein code often disrupt splicing. Nat. Genet. 2017, 49, 848–855. [Google Scholar] [CrossRef] [PubMed]
  69. Tazi, J.; Bakkour, N.; Stamm, S. Alternative splicing and disease. Biochim. Biophys. Acta 2009, 1792, 14–26. [Google Scholar] [CrossRef] [PubMed]
  70. Singh, R.K.; Cooper, T.A. Pre-mRNA splicing in disease and therapeutics. Trends Mol. Med. 2012, 18, 472–482. [Google Scholar] [CrossRef] [PubMed]
  71. Vaz-Drago, R.; Custódio, N.; Carmo-Fonseca, M. Deep intronic mutations and human disease. Hum. Genet. 2017, 136, 1093–1111. [Google Scholar] [CrossRef] [PubMed]
  72. Wang, Z.; Burge, C.B. Splicing regulation: From a parts list of regulatory elements to an integrated splicing code. RNA 2008, 14, 802–813. [Google Scholar] [CrossRef]
  73. Butkiewicz, M.; Blue, E.E.; Leung, Y.Y.; Jian, X.; Marcora, E.; Renton, A.E.; Kuzma, A.; Wang, L.-S.; Koboldt, D.C.; Haines, J.L.; et al. Functional annotation of genomic variants in studies of late-onset Alzheimer’s disease. Bioinformatics 2018, 34, 2724–2731. [Google Scholar] [CrossRef]
  74. Zhang, Q.; Cheng, T.; Jin, S.; Guo, Y.; Wu, Y.; Liu, D.; Xu, X.; Sun, Y.; Li, Z.; He, H.; et al. Genome-wide open chromatin regions and their effects on the regulation of silk protein genes in Bombyx mori. Sci. Rep. 2017, 7, 12919. [Google Scholar] [CrossRef]
  75. Gronau, I.; Arbiza, L.; Mohammed, J.; Siepel, A. Inference of natural selection from interspersed genomic elements based on polymorphism and divergence. Mol. Biol. Evol. 2013, 30, 1159–1171. [Google Scholar] [CrossRef]
  76. Arbiza, L.; Gronau, I.; Aksoy, B.A.; Hubisz, M.J.; Gulko, B.; Keinan, A.; Siepel, A. Genome-wide inference of natural selection on human transcription factor binding sites. Nat. Genet. 2013, 45, 723–729. [Google Scholar] [CrossRef]
  77. Symmons, O.; Uslu, V.V.; Tsujimura, T.; Ruf, S.; Nassari, S.; Schwarzer, W.; Ettwiller, L.; Spitz, F. Functional and topological characteristics of mammalian regulatory domains. Genome Res. 2014, 24, 390–400. [Google Scholar] [CrossRef]
  78. Pedersen, B.S.; Layer, R.M.; Quinlan, A.R. Vcfanno: Fast, flexible annotation of genetic variants. Genome Biol. 2016, 17, 118. [Google Scholar] [CrossRef] [PubMed]
  79. Gulko, B.; Hubisz, M.J.; Gronau, I.; Siepel, A. A method for calculating probabilities of fitness consequences for point mutations across the human genome. Nat. Genet. 2015, 47, 276–283. [Google Scholar] [CrossRef] [PubMed]
  80. Pei, G.; Hu, R.; Dai, Y.; Manuel, A.M.; Zhao, Z.; Jia, P. Predicting regulatory variants using a dense epigenomic mapped CNN model elucidated the molecular basis of trait-tissue associations. Nucleic Acids Res. 2020, 49, 53–66. [Google Scholar] [CrossRef] [PubMed]
  81. Dey, K.K.; van de Geijn, B.; Kim, S.S.; Hormozdiari, F.; Kelley, D.R.; Price, A.L. Evaluating the informativeness of deep learning annotations for human complex diseases. Nat. Commun. 2020, 11, 4703. [Google Scholar] [CrossRef] [PubMed]
  82. Peng, P.-C.; Khoueiry, P.; Girardot, C.; Reddington, J.P.; Garfield, D.A.; Furlong, E.E.M.; Sinha, S. The Role of Chromatin Accessibility in cis-Regulatory Evolution. Genome Biol. Evol. 2019, 11, 1813–1828. [Google Scholar] [CrossRef]
  83. Gao, L.; Wu, K.; Liu, Z.; Yao, X.; Yuan, S.; Tao, W.; Yi, L.; Yu, G.; Hou, Z.; Fan, D.; et al. Chromatin Accessibility Landscape in Human Early Embryos and Its Association with Evolution. Cell 2018, 173, 248–259.e15. [Google Scholar] [CrossRef]
  84. Cipriani, V.; Pontikos, N.; Arno, G.; Sergouniotis, P.I.; Lenassi, E.; Thawong, P.; Danis, D.; Michaelides, M.; Webster, A.R.; Moore, A.T.; et al. An Improved Phenotype-Driven Tool for Rare Mendelian Variant Prioritization: Benchmarking Exomiser on Real Patient Whole-Exome Data. Genes 2020, 11, 460. [Google Scholar] [CrossRef]
  85. Köhler, S.; Gargano, M.; Matentzoglu, N.; Carmody, L.C.; Lewis-Smith, D.; Vasilevsky, N.A.; Danis, D.; Balagura, G.; Baynam, G.; Brower, A.M.; et al. The Human Phenotype Ontology in 2021. Nucleic Acids Res. 2021, 49, D1207–D1217. [Google Scholar] [CrossRef]
  86. Rentzsch, P.; Witten, D.; Cooper, G.M.; Shendure, J.; Kircher, M. CADD: Predicting the deleteriousness of variants throughout the human genome. Nucleic Acids Res. 2019, 47, D886–D894. [Google Scholar] [CrossRef]
  87. Schubach, M. Remm Score. 2016. Available online: https://zenodo.org/record/1197579 (accessed on 1 July 2021).
  88. Smedley, D.; Jacobsen, J.O.B.; Jäger, M.; Köhler, S.; Holtgrewe, M.; Schubach, M.; Siragusa, E.; Zemojtel, T.; Buske, O.J.; Washington, N.L.; et al. Next-generation diagnostics and disease-gene discovery with the Exomiser. Nat. Protoc. 2015, 10, 2004–2015. [Google Scholar] [CrossRef]
  89. Cech, T.R.; Steitz, J.A. The noncoding RNA revolution-trashing old rules to forge new ones. Cell 2014, 157, 77–94. [Google Scholar] [CrossRef] [PubMed]
  90. Peschansky, V.J.; Wahlestedt, C. Non-coding RNAs as direct and indirect modulators of epigenetic regulation. Epigenetics 2014, 9, 3–12. [Google Scholar] [CrossRef]
  91. Zhang, P.; Wu, W.; Chen, Q.; Chen, M. Non-Coding RNAs and their Integrated Networks. J. Integr. Bioinform. 2019, 16, 20190027. [Google Scholar] [CrossRef] [PubMed]
  92. Klemm, S.L.; Shipony, Z.; Greenleaf, W.J. Chromatin accessibility and the regulatory epigenome. Nat. Rev. Genet. 2019, 20, 207–220. [Google Scholar] [CrossRef] [PubMed]
  93. Calo, E.; Wysocka, J. Modification of enhancer chromatin: What, how and why? Mol. Cell 2013, 49, 825–837. [Google Scholar] [CrossRef]
  94. Whyte, W.A.; Orlando, D.A.; Hnisz, D.; Abraham, B.J.; Lin, C.Y.; Kagey, M.H.; Rahl, P.B.; Lee, T.I.; Young, R.A. Master transcription factors and mediator establish super-enhancers at key cell identity genes. Cell 2013, 153, 307–319. [Google Scholar] [CrossRef]
  95. Parker, S.C.J.; Stitzel, M.L.; Taylor, D.L.; Orozco, J.M.; Erdos, M.R.; Akiyama, J.A.; van Bueren, K.L.; Chines, P.S.; Narisu, N.; Black, B.L.; et al. Chromatin stretch enhancer states drive cell-specific gene regulation and harbor human disease risk variants. Proc. Natl. Acad. Sci. USA 2013, 110, 17921–17926. [Google Scholar] [CrossRef]
  96. Hnisz, D.; Abraham, B.J.; Lee, T.I.; Lau, A.; Saint-André, V.; Sigova, A.A.; Hoke, H.A.; Young, R.A. Super-enhancers in the control of cell identity and disease. Cell 2013, 155, 934–947. [Google Scholar] [CrossRef]
  97. Deaton, A.M.; Bird, A. CpG islands and the regulation of transcription. Genes Dev. 2011, 25, 1010–1022. [Google Scholar] [CrossRef]
  98. Bird, A. DNA methylation patterns and epigenetic memory. Genes Dev. 2002, 16, 6–21. [Google Scholar] [CrossRef]
  99. Landrum, M.J.; Chitipiralla, S.; Brown, G.R.; Chen, C.; Gu, B.; Hart, J.; Hoffman, D.; Jang, W.; Kaur, K.; Liu, C.; et al. ClinVar: Improvements to accessing data. Nucleic Acids Res. 2020, 48, D835–D844. [Google Scholar] [CrossRef] [PubMed]
  100. Liu, L.; Sanderford, M.D.; Patel, R.; Chandrashekar, P.; Gibson, G.; Kumar, S. Biological relevance of computationally predicted pathogenicity of noncoding variants. Nat. Commun. 2019, 10, 330. [Google Scholar] [CrossRef] [PubMed]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.