Next Article in Journal
Targeted Approaches for In Situ Gut Microbiome Manipulation
Next Article in Special Issue
Application of Whole Exome and Targeted Panel Sequencing in the Clinical Molecular Diagnosis of 319 Chinese Families with Inherited Retinal Dystrophy and Comparison Study
Previous Article in Journal
Description of Genetic Variants in BRCA Genes in Mexican Patients with Ovarian Cancer: A First Step towards Implementing Personalized Medicine
Previous Article in Special Issue
A Novel Probability Model for LncRNA–Disease Association Prediction Based on the Naïve Bayesian Classifier
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Ensemble Consensus-Guided Unsupervised Feature Selection to Identify Huntington’s Disease-Associated Genes

College of Computer and Control Engineering, Nankai University, Tianjin 300350, China
*
Author to whom correspondence should be addressed.
Genes 2018, 9(7), 350; https://doi.org/10.3390/genes9070350
Submission received: 30 May 2018 / Revised: 6 July 2018 / Accepted: 9 July 2018 / Published: 12 July 2018

Abstract

:
Due to the complexity of the pathological mechanisms of neurodegenerative diseases, traditional differentially-expressed gene selection methods cannot detect disease-associated genes accurately. Recent studies have shown that consensus-guided unsupervised feature selection (CGUFS) performs well in feature selection for identifying disease-associated genes. Since the random initialization of the feature selection matrix in CGUFS results in instability of the final disease-associated gene set, for the purposes of this study we proposed an ensemble method based on CGUFS—namely, ensemble consensus-guided unsupervised feature selection (ECGUFS) in order to further improve the accuracy of disease-associated genes and the stability of feature gene sets. We also proposed a bagging integration strategy to integrate the results of CGUFS. Lastly, we conducted experiments with Huntington’s disease RNA sequencing (RNA-Seq) data and obtained the final feature gene set, where we detected 287 disease-associated genes. Enrichment analysis on these genes has shown that postsynaptic density and the postsynaptic membrane, synapse, and cell junction are all affected during the disease’s progression. However, ECGUFS greatly improved the accuracy of disease-associated gene prediction and the stability of the disease-associated gene set. We conducted a classification of samples with labels based on the linear support vector machine with 10-fold cross-validation. The average accuracy is 0.9, which suggests the effectiveness of the feature gene set.

1. Introduction

Neurodegenerative diseases seriously affect human health and quality of life. It is reported that half of the population aged seventy and over suffer from Alzheimer’s disease [1]. Neurodegenerative diseases are usually the result of one or more genes combined with one or more environmental factors. They are a kind of chronic disease characterized with complex symptoms. Alzheimer’s disease (AD) [2,3], Parkinson’s disease (PD) [4], and Huntington’s disease (HD) are some of the most common neurodegenerative diseases. Due to the complexity of neurodegenerative diseases, there are still many unknown parts of molecular mechanisms. It has been shown that the pathogenic gene of HD is IT15, and although it is widely expressed in various tissues within the body, only the neurons of specific tissues are damaged. Additionally, HD results from the misfolding of the protein Htt, and the symptoms of this disease usually develop after the age of 40 [5,6]. Due to the complexity of these diseases [7], identifying disease-associated genes is helpful for revealing the pathogenesis of the diseases.
With the rapid development of high-throughput sequencing technologies, working to identify disease-associated genes using statistic-based and machine learning methods to deal with gene expression data is a valuable endeavor. There are mainly three kinds of methods which can be used to identify disease-associated genes. Firstly, there are statistic-based methods, including the t-test method [8] and the fold change (FC) rank product method [8], which select differentially-expressed genes according to the statistically significant p-value by comparing the gene expression between disease samples and normal samples. Because the interaction between genes is not considered in these methods, the results have low accuracy. Secondly, there are machine learning methods, such as the flexible non-negative matrix factorization method (FNMF) [9], which works by sorting the genes according to a l 2 -norm by using a disease-driven relative gene expression matrix, whereby you can then select the top-ranking genes as disease-associated genes. Due to the random initialization of FNMF, the final gene rankings are somewhat unstable, which may result in some noise. Thirdly, network-based methods [10,11], such as the multi-label propagation (LP) clustering algorithm [12], are used to detect disease-associated gene modules. However, LP only relies on the similarity between gene expression data and lacks a feature gene selection process, which makes the selected disease-associated gene set imprecise. Consequently, the above methods have some limitations in accurately identifying disease-associated genes to some extent.
Disease-associated gene identification can be seen as a feature selection problem in the machine learning field. Due to the sample labels being unknown and the acquisition of label information being costly in many cases [13], unsupervised machine learning methods are more promising when dealing with biological data [14]. Due to the importance of consensus-clustering in feature gene selection, we used the consensus-guided unsupervised feature selection (CGUFS) [15] method to identify disease-associated genes. The random initialization of the feature selection matrix in CGUFS results in instability of the final feature gene set. Ensemble methods have been used effectively in bioinformatics [16,17] in recent years. For example, ensemble classifiers are applied in Zou et al. [18] to improve tRNAscan-SE annotation results. Since Zou et al. [19] also uses ensemble support vector machines to detect N6–methyladenosine sites from RNA transcriptomes, we designed the ensemble strategy using bagging [20] to improve the accuracy of the disease-associated gene prediction.
Based on the above analysis, we proposed an ensemble method based on CGUFS, or namely, ensemble consensus-guided unsupervised feature selection (ECGUFS), to help identify disease-associated genes. Firstly, we used bootstrap aggregation to generate multiple bags from the RNA sequencing (RNA-Seq) data. For each bag, the gene weights and gene-ranked list were obtained. Secondly, the area under the receiver operating characteristic (ROC) curve of the ranked list was calculated to measure the accuracy of the disease-associated gene prediction. Finally, we obtained ensemble gene weights through a linear combination of all the gene weights. The genes were sorted in descending order according to these ensemble gene weights, and the higher the ranking, the more disease-associated was the gene. The experimental results showed that ECGUFS improved both the accuracy of the disease-associated gene prediction and the stability of the feature set. Compared with other methods for predicting disease-associated genes, ECGUFS has proved superior in the analysis of gene expression data for diseases with complex pathologies and also in the identification of disease-associated genes. Finally, we conducted a classification of disease samples from normal samples using the support vector machine. The experimental results further verified the effectiveness of the feature gene set.

2. Materials and Methods

In this section, we will first introduce the CGUFS method [15]; second, describe the evaluation criteria of disease-associated gene prediction accuracy; and finally, use a bagging integration strategy to integrate the results of CGUFS, or namely, ECGUFS, to obtain a more unified disease-associated gene set.

2.1. Consensus-Guided Unsupervised Feature Selection

Let X = [ x i j ] g × s denote the gene expression matrix. x i j represents the expression level of gene i in sample j . A clustering result of s samples is represented by an indicator matrix H { 0 , 1 } s × K , where h j k = 1 denotes that sample j belongs to the k th cluster, and K is the number of clusters. H = { H ( 1 ) , H ( 2 ) , H ( r ) } are the r basic clustering results of X in consensus clustering.
Part of CGUFS is the design of the following objective function, Equation (1). When the objective function is minimized to get the feature selection matrix Z and the consensus indicator matrix H , the l 2 -norm of each row of the feature selection matrix Z is used as the weight of each feature gene. In order to identify the disease-associated genes, the genes need to be sorted into descending order according to weight. The highly-ranked genes are the disease-associated genes.
min H , G , Z   α i = 1 r U c ( H , H ( i ) ) + X T Z H G F 2 + β Z 2 , 1 ,
where H is the consensus indicator matrix of the consensus clustering, U c is a function that measures the similarity of two basic clustering results to obtain the consensus clustering result [21]. Z R g × K is the feature selection matrix, G is a mapping matrix between X T Z and H , and both α and β are parameters that control consensus clustering and sparse learning.
Specifically, CGUFS is an unsupervised feature selection method that does not require label information. As CGUFS adopts consensus clustering for pseudo-label learning, it can greatly improve clustering accuracy. CGUFS performs sparse regularization constraint on the feature selection matrix, which reduces the model’s complexity and improves its operation rate. The optimization solution of the objective function is as follows [15]:
Firstly, when given Z , update H and G . A part of Equation (1) can be converted to Equation (2) in order to simplify the optimization process [22]:
i = 1 r U c ( H , H ( i ) ) = B H C F 2 + c o n s tan t ,
where B = [ H ( 1 ) , H ( 2 ) , H ( r ) ] is a matrix of the r basic clustering results of consensus clustering, and C = [ C ( 1 ) , C ( 2 ) , C ( r ) ] is the center of B . Thus, H and G can be updated through the optimization of Equation (3).
min H , G , C , Z   α B H C F 2 + X T Z H G F 2 .
Secondly, an optimization approach similar to K-means clustering is used to update H and G [15]. Let U = [ α B   X T Z ] , where u l is the i t h row of U . Update H , G , and C in the following way.
min H , C , G , Z   α B H C F 2 + X T Z H G F 2 min H k = 1 K u l C k f ( u l , m k ) ,
where m k is the k t h center of matrix U , and G is the last K row of center U .
Finally, update Z by giving H and G . Since Z only appears in the last two terms of Equation (1), update Z by optimizing the last two items. Let L = X T Z H G F 2 + β Z 2 , 1 , and let the derivative of L to Z be 0. The updated equation of Z is:
Z = ( X X T + β F ) 1 X H G ,
where F = d i a g ( 1 2 Z 1 · 2 , 1 2 Z g · 2 ) .
In our proposed method, the weight of the gene can be calculated by using Equation (6). w i represents the weight of gene i , and W represents a vector of the weights for all genes.
w i = Z i · 2 ,
W = [ w 1 , , w g ] .

2.2. Evaluation

We used the true positive rate (TPR), false positive rate (FPR), precision (P), and recall (R) to assess the accuracy of disease-associated gene prediction. The ROC curve was plotted using TPR and FPR, the precision-recall (PR) curve was plotted using P and R, and the area under the ROC curve (AUC) and the area under the PR curve (AUPR) were used as measures of prediction accuracy [23].

2.3. Ensemble Consensus-Guided Unsupervised Feature Selection

Since the random initialization of the feature selection matrix in CGUFS caused instability in the final gene ranking, this work proposed a bagging integration strategy to integrate the results of CGUFS, or namely, ECGUFS, to obtain a more unified disease-associated gene set and also to improve the accuracy of the final gene set.
Firstly, we used bootstrap aggregation to generate b bags from X = [ x i j ] g × s . Each bag had c samples, where c is generally equal to the number of samples. For the i t h bag, the gene weights were calculated based on CGUFS and denoted as W i . The gene-ranked list was obtained through W i . Secondly, we calculated the area under the ROC of the gene-ranked list, which is denoted by a i . Finally, we used Equation (8) to calculate the ensemble gene weights.
W f i n a l = i = 1 b a i W i .
The genes were sorted in descending order according to W f i n a l . Highly-ranked genes indicated that they played an important role in the discrimination between disease samples and normal ones.
Figure 1 shows the flow chart of ECGUFS. After these processes, the final feature gene set is obtained.
The algorithm of ECGUFS can be described as follows in (Table 1).

3. Results

3.1. Gene Expression Data

The data used in this study was obtained from HDinHD (http://www.hdinhd.org), which is the gene expression data of HD mice obtained by RNA-Seq technology. The dataset contained mouse liver tissue, cortex tissue, and striatum tissue, and the genotypes of the mice were poly Q20, poly Q80, poly Q92, poly Q111, poly Q140, and poly Q175. There were 8 samples for each genotype [24]. The mice whose genotype was poly Q20 were normal mice, whereas mice with all other genotypes were diseased mice. The longer the poly Q, the heavier was the phenotype of the diseased mice. There were 23,351 genes in the dataset, and most of the calculation methods used for data analysis were based on differential expression genes to identify disease-associated genes. As it was difficult to identify the genes whose expression levels did not change during the disease’s progression, we preprocessed the gene expression data in order to reduce computational complexity. Firstly, the gene whose expression value was zero in any sample was deleted according to the l 0 -norm. Then, we normalized the gene expression data for each sample. We ranked the genes into descending order according to the gene variance in different samples, and only the top 4000 genes were selected. We then got the union set of 4000 genes in the three tissues and added the modifier gene set [24]. Finally, 6723 genes were selected from the entire genome. As it has been reported that striatum tissue can be seriously affected by the length of poly Q, we used striatum tissue data as experimental data in this study.
The modifier genes are from [24], including 520 genes, 89 of which are disease-associated genes and the rest of which are non-disease-associated genes. It should be noted that we normalized the gene expression data by each gene to ensure the convergence of the ECGUFS.

3.2. Parameter Setting

In ECGUFS, we set the number of clusters to K = 6 as the number of mouse genotypes was six. We set the number of basic clustering results to r = 100 to ensure the robustness of consensus clustering [15]. We set the parameter that controlled the consensus clustering to α = 10 4 , and the parameter that controlled the sparse regularization to β = 1 . The higher α and β were, the better the performance of ECGUFS. When β was larger than 1 , the results stabilized and were unaffected by α , according to [15]. The number of bags was set to b = 20 , and the number of samples in a bag to c = 48 .

3.3. Performance Comparison between Ensemble Consensus-Guided Unsupervised Feature Selection and Other Methods

To further verify the prediction accuracy of ECGUFS, we conducted comparative experiments using statistic-based methods, machine learning methods, and network-based methods on the above data set. The t-test method [8], FC [8], edgeR tool [25], limma [26], FNMF [9], the joint non-negative matrix factorization meta-analysis method (jNMFMA) [27], LP [12], and CGUFS [15] were used as comparison methods. For non-parametric methods, such as the t-test, FC, edgeR, limma, and LP, only one experiment was conducted. The experimental results of parametric methods, such as CGUFS, FNMF, jNMFMA, and ECGUFS were unstable due to the random initialization. Consequently, this work conducted 10 experiments for each parametric method. The mean and standard deviation of the prediction accuracy of the 10 experiments were calculated to evaluate the performance of the corresponding method.
The experimental results of FNMF, jNMFMA, CGUFS, and ECGUFS are shown in Table 2. From Table 2, we can see that the average AUC and AUPR of ECGUFS are better than FNMF, jNMFMA, and CGUFS, which shows that ECGUFS improved the accuracy of the disease-associated gene prediction. To analyze the performance of the nine methods in detail, a set of best-performing experiments were selected for further comparison.
Figure 2 shows the ROC curves for the prediction accuracy of the t-test, FC, edgeR, limma, LP, FNMF, jNMFMA, CGUFS, and ECGUFS. It can be seen from Figure 2 that the AUC of ECGUFS is better than the other eight methods. However, the above methods could not effectively distinguish the disease-associated genes from the non-disease-associated genes in the modifier gene set. Possible reasons for this may be that the expression levels of the disease-associated genes did not change significantly during the disease’s progression, or that a large number of gene expression levels had changed during the disease’s progression, thereby making it difficult to identify the disease-associated genes [28].
Figure 3 shows the PR curves of the nine methods. It can be seen from Figure 3 that the AUPR of ECGUFS is better than the other eight methods. As ECGUFS has a higher prediction accuracy for highly-ranked genes, it indicates that ECGUFS can better distinguish disease-associated genes from non-disease-associated genes for highly-ranked genes.
Briefly, it can be seen from Table 2, and Figure 2 and Figure 3 that the performance of ECGUFS is better than CGUFS. The AUC and AURP standard deviation of the 10 experiments by ECGUFS is small, indicating the stability of ECGUFS. Experimental results show that ECGUFS is more suitable for identifying disease-associated genes than the other eight methods.
From Figure 3, we can see that when the recall rate is less than 0.2, ECGUFS has high prediction accuracy. Since there are 89 disease-associated genes in the modifier gene set, the top 18 ( 0.2 × 89 ) disease-associated genes have higher prediction accuracy. As the last of the 18 genes ranked roughly at about 1000 in the overall ranking, this work further calculates the coincidence degree of the top 1000 genes in the ranked lists of any two experiments. The results are shown in Table 3, where we can see that the coincidence degree is greater than 60%. The results also show that when ECGUFS is used to identify disease-associated genes, many overlapped genes can be identified under the condition of changes in sample size. Through the integration analysis we found that of the top 1000 genes, there were 287 overlapped ones of the ten experiment-ranked lists. In addition, we also calculated the coincidence degree of the top 2000 genes in different ranked lists. The results are shown in Table 4. There are 962 overlapped genes in the top 2000 genes. The high coincidence degree indicates that ECGUFS can improve the stability of a disease-associated gene set.
To verify the effectiveness of the overlapped 287 genes, we conducted a classification of disease samples from normal samples based on the support vector machine (SVM) [29], using ten-fold cross-validation. The average accuracy is 0.9, suggesting the effectiveness of the 287 feature genes.

3.4. Enrichment Analysis

We used the functional clustering tool DAVID [30] to perform enrichment analysis on 287 overlapped genes to further understand the functional annotation of these genes. Table 5 shows the functional annotation results. In the first clustering module, the cellular component (CC) annotations include postsynaptic density and the postsynaptic membrane, synapse, and cell junctions, indicating that the morphology of the cells has undergone major changes during the progression of HD. In fact, the connection between neurons of the striatum tissue gradually became sparse and the nerve cells slowly died during the progression of the disease [31,32]. In the second clustering module, the biological process (BP) annotations include a fatty acid metabolic process and a fatty acid biosynthetic process. The Molecular Function (MF) annotation includes transferase activity, transferring acyl groups other than amino-acyl groups. The Kyoto encyclopedia of genes and genomes (KEGG) pathway annotation includes fatty acid metabolism. In the third clustering module, the MF annotations include transferase activity, kinase activity, nucleotide binding, ATP (adenosine triphosphate) binding, protein kinase activity, and protein serine/threonine kinase activity. The BP annotations include phosphorylation and protein phosphorylation. In the fourth clustering module, the BP annotations include learning or memory, regulation of synaptic plasticity, and embryo development. Studies have shown that HD is related to mental disorders and cognitive decline. In the fifth clustering module, the MF annotation includes cadherin binding involved in cell–cell adhesion. The BP annotation includes cell–cell adhesion. The above molecular functions and biological processes are most likely to be affected during the disease’s progression. Studies have shown that Huntington’s disease is caused by excessive repetition of the CAG sequence of the huntingtin gene on the fourth chromosome. It leads to a misfolding of the Htt protein, which affects protein transport, gene regulation, and other biological processes. It eventually leads to sparse cell connections, neuronal apoptosis, and the formation of amyloid plaques in the striatum of the brain [33,34,35].

4. Discussion

In this work we proposed ECGUFS based on CGUFS. The main goal is that we proposed a bagging integration strategy to integrate the results of CGUFS. ECGUFS can effectively select disease-associated genes when the labels are unknown. Experimental results verify the better feasibility and stability of ECGUFS. In addition, we conducted an enrichment analysis of the overlapped 287 genes to further explore the molecular pathogenesis of HD, as well as to provide guidance for subsequent biological validation.

Author Contributions

Conceptualization, X.G., J.X., X.Q. and H.Z.; Methodology, X.G., J.X., and X.J.; Validation, X.G., X.J.; Formal Analysis, X.G., J.X.; Writing-Original Draft Preparation, X.G., X.J., X.Q. and H.Z; Writing-Review & Editing, X.G., M.W.; Supervision, X.Q.; Project Administration, H.Z.

Funding

This research was funded by the National Natural Science Foundation of China grant No. 31728013.

Acknowledgments

The authors would like to thank the editor and the reviewers for their comments and suggestions, which helped improve the manuscript greatly.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Barchet, T.M.; Amiji, M.M. Challenges and opportunities in CNS delivery of therapeutics for neurodegenerative diseases. Expert Opin. Drug Deliv. 2009, 6, 211–225. [Google Scholar] [CrossRef] [PubMed]
  2. Bateman, R. Alzheimer’s disease and other dementias: Advances in 2014. Lancet Neurol. 2015, 14, 4–6. [Google Scholar] [CrossRef]
  3. Wurtman, R. Biomarkers in the diagnosis and management of Alzheimer’s disease. Metab. Clin. Exp. 2014, 64, S47–S50. [Google Scholar] [CrossRef] [PubMed]
  4. Miller, D.B.; O’Callaghan, J.P. Biomarkers of Parkinson’s disease: Present and future. Metab. Clin. Exp. 2015, 64, S40–S46. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Luthi-Carter, R.; Apostol, B.L.; Dunah, A.W.; Dejohn, M.M.; Farrell, L.A.; Bates, G.P.; Young, A.B.; Standaert, D.G.; Thompson, L.M.; Cha, J.H. Complex alteration of NMDA receptors in transgenic Huntington’s disease mouse brain: Analysis of mRNA and protein expression, plasma membrane association, interacting proteins, and phosphorylation. Neurobiol. Dis. 2003, 14, 624–636. [Google Scholar] [CrossRef] [PubMed]
  6. Luthi-Carter, R.; Strand, A.; Peters, N.L.; Solano, S.M.; Hollingsworth, Z.R.; Menon, A.S.; Frey, A.S.; Spektor, B.S.; Penney, E.B.; Schilling, G. Decreased expression of striatal signaling genes in a mouse model of Huntington’s disease. Hum. Mol. Genet. 2000, 9, 1259–1271. [Google Scholar] [CrossRef] [PubMed]
  7. Romanoski, C.E.; Lee, S.; Kim, M.J.; Ingram-Drake, L.; Plaisier, C.L.; Yordanova, R.; Tilford, C.; Guan, B.; He, A.; Gargalovic, P.S. Systems Genetics Analysis of Gene-by-Environment Interactions in Human Cells. Am. J. Hum. Genet. 2010, 86, 399–410. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. Hong, F.; Breitling, R. A comparison of meta-analysis methods for detecting differentially expressed genes in microarray experiments. Bioinformatics 2008, 24, 374–382. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  9. Jiang, X.; Zhang, H.; Zhang, Z.; Quan, X. Flexible non-negative matrix factorization to unravel disease-related genes. IEEE/ACM Trans. Comput. Biol. Bioinform. 2018. [Google Scholar] [CrossRef] [PubMed]
  10. Xulvibrunet, R.; Li, H. Co-expression networks: Graph properties and topological comparisons. Bioinformatics 2010, 26, 205–214. [Google Scholar] [CrossRef] [PubMed]
  11. Iancu, O.D.; Kawane, S.; Bottomly, D.; Searles, R.; Hitzemann, R.; Mcweeney, S. Utilizing RNA-Seq data for de novo coexpression network inference. Bioinformatics 2012, 28, 1592–1597. [Google Scholar] [CrossRef] [PubMed]
  12. Jiang, X.; Zhang, H.; Quan, X.; Liu, Z. Disease-related gene module detection based on a multi-label propagation clustering algorithm. PLoS ONE 2017, 12, e178006. [Google Scholar] [CrossRef] [PubMed]
  13. Saeys, Y.; Abeel, T.; Peer, Y. Robust Feature Selection Using Ensemble Feature Selection Techniques. In Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases, Antwerp, Belgium, 14–18 September 2008; pp. 313–325. [Google Scholar] [CrossRef]
  14. Wolf, L.; Shashua, A. Feature Selection for Unsupervised and Supervised Inference: The Emergence of Sparsity in a Weighted-based Approach. In Proceedings of the IEEE International Conference on Computer Vision, Nice, France, 13–16 October 2003; p. 378. [Google Scholar]
  15. Liu, H.; Shao, M.; Fu, Y. Consensus Guided Unsupervised Feature Selection. In Proceedings of the Association for the Advancement of Artificial Intelligence, Phoenix, AZ, USA, 12–17 February 2016. [Google Scholar]
  16. Wan, S.; Duan, Y.; Zou, Q. HPSLPred: An ensemble multi-label classifier for human protein subcellular location prediction with imbalanced source. Proteomics 2017, 17, 1700262. [Google Scholar] [CrossRef] [PubMed]
  17. Chen, L.; Ying, Z.; Ji, Q.; Liu, X.; Jiang, Y.; Ke, C.; Zou, Q. Hierarchical classification of protein folds using a novel ensemble classifier. PLoS ONE 2013, 8, e56499. [Google Scholar] [CrossRef]
  18. Zou, Q.; Guo, J.; Ju, Y.; Wu, M.; Zeng, X.; Hong, Z. Improving tRNAscan-SE annotation results via ensemble classifiers. QSAR Comb. Sci. 2015, 34, 761–770. [Google Scholar] [CrossRef] [PubMed]
  19. Chen, W.; Xing, P.; Zou, Q. Detecting N6-methyladenosine sites from RNA transcriptomes using ensemble Support Vector Machines. Sci. Rep. 2017, 7, 40242. [Google Scholar] [CrossRef] [PubMed]
  20. Breiman, L. Bagging predictors. Mach. Learn. 1996, 24, 123–140. [Google Scholar] [CrossRef] [Green Version]
  21. Mirkin, B. Reinterpreting the category utility function. Mach. Learn. 2001, 45, 219–228. [Google Scholar] [CrossRef]
  22. Wu, J.; Liu, H.; Xiong, H.; Cao, J. A Theoretic Framework of K-Means-Based Consensus Clustering. In Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence, Beijing, China, 3–9 August 2013; pp. 1799–1805. [Google Scholar]
  23. Bradley, A.P. The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recognit. 1997, 30, 1145–1159. [Google Scholar] [CrossRef] [Green Version]
  24. Langfelder, P.; Cantle, J.P.; Chatzopoulou, D.; Wang, N.; Gao, F.; Alramahi, I.; Lu, X.H.; Ramos, E.M.; Elzein, K.; Zhao, Y. Integrated genomics and proteomics define huntingtin CAG length-dependent networks in mice. Nat. Neurosci. 2016, 19, 623–633. [Google Scholar] [CrossRef] [PubMed]
  25. Robinson, M.D.; McCarthy, D.J.; Smyth, G.K. EdgeR: A Bioconductor package for differential expression analysis of digital gene expression data. Bioinformatics 2009, 26, 139–140. [Google Scholar] [CrossRef] [PubMed]
  26. Smyth, G.K. Limma: Linear Models for Microarray Data. In Bioinformatics & Computational Biology Solutions Using R & Bioconductor; Springer Science & Business Media: New York, NY, USA, 2005; pp. 397–420. [Google Scholar]
  27. Wang, H.Q.; Zheng, C.H.; Zhao, X.M. jNMFMA: A joint non-negative matrix factorization meta-analysis of transcriptomics data. Bioinformatics 2015, 31, 572–580. [Google Scholar] [CrossRef] [PubMed]
  28. Jiang, X.; Zhang, H.; Duan, F.; Quan, X. Identify Huntington’s disease associated genes based on restricted Boltzmann machine with RNA-seq data. BMC Bioinform. 2017, 18, 447. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Schuldt, C. Recognizing Human Action: A Local SVM Approach. In Proceedings of the 17th International Conference on Pattern Recognition, Cambridge, UK, 23–26 August 2004. [Google Scholar]
  30. Huang, D.W.; Sherman, B.T.; Lempicki, R.A. Systematic and integrative analysis of large gene lists using DAVID bioinformatics resources. Nat. Protoc. 2009, 4, 44–57. [Google Scholar] [CrossRef] [PubMed]
  31. Waldvogel, H.J.; Kim, E.H.; Thu, D.C.; Tippett, L.J.; Faull, R.L. New perspectives on the neuropathology in Huntington’s Disease in the human brain and its relation to symptom variation. J. Huntingt. Dis. 2012, 1, 143–153. [Google Scholar]
  32. Difiglia, M.; Sapp, E.; Chase, K.O.; Davies, S.W.; Bates, G.P.; Vonsattel, J.P.; Aronin, N. Aggregation of huntingtin in neuronal intranuclear inclusions and dystrophic neurites in brain. Science 1997, 277, 1990–1993. [Google Scholar] [CrossRef] [PubMed]
  33. Lee, S.; Kim, H.J. Prion-like mechanism in Amyotrophic Lateral Sclerosis: Are protein aggregates the key? Exp. Neurobiol. 2015, 24, 1–7. [Google Scholar] [CrossRef] [PubMed]
  34. Lim, J.; Yue, Z. Neuronal aggregates: Formation, clearance, and spreading. Dev. Cell. 2015, 32, 491–501. [Google Scholar] [CrossRef] [PubMed]
  35. Wang, X.; Huang, T.; Bu, G.; Xu, H. Dysregulation of protein trafficking in neurodegeneration. Mol. Neurodegener. 2014, 9, 1–9. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Flow chart of the ensemble consensus-guided unsupervised feature selection (ECGUFS) algorithm. Consensus-guided unsupervised feature selection (CGUFS); W i : a vector of weights for all genes; a i : the area under the receiver operating characteristic (ROC) curve of the gene-ranked list.
Figure 1. Flow chart of the ensemble consensus-guided unsupervised feature selection (ECGUFS) algorithm. Consensus-guided unsupervised feature selection (CGUFS); W i : a vector of weights for all genes; a i : the area under the receiver operating characteristic (ROC) curve of the gene-ranked list.
Genes 09 00350 g001
Figure 2. ROC curves of the t-test, fold change (FC), multi-label propagation clustering algorithm (LP), FNMF, jNMFMA, CGUFS, limma, edgeR, and ECGUFS prediction results.
Figure 2. ROC curves of the t-test, fold change (FC), multi-label propagation clustering algorithm (LP), FNMF, jNMFMA, CGUFS, limma, edgeR, and ECGUFS prediction results.
Genes 09 00350 g002
Figure 3. PR curves of the t-test, FC, LP, FNMF, jNMFMA, CGUFS, limma, edgeR, and ECGUFS prediction results.
Figure 3. PR curves of the t-test, FC, LP, FNMF, jNMFMA, CGUFS, limma, edgeR, and ECGUFS prediction results.
Genes 09 00350 g003
Table 1. Ensemble consensus-guided unsupervised feature selection.
Table 1. Ensemble consensus-guided unsupervised feature selection.
Input:
   X : The gene expression matrix;
   B : The matrix of r basic clustering results;
   α , β : Parameters;
   b : The number of bags;
   c : The number of samples in one bag.
  Initialize W f i n a l = 0 ;
1: For i = 1 , 2 , b
  Initialize H , Z , F ;
2:  repeat;
3:    build the matrix U = [ α B   X T Z ] ;
4:   run K-means on U to update H and G ;
5:   update Z = ( X X T + β F ) 1 X H G ;
6:   update F ;
7:  until the value of the objective function remains unchanged.
8:  Obtain the gene weights W i according to Equation (7);
    sort genes according to W i to get the gene-ranked list;
9:  get the area under the ROC of the gene-ranked list a i ;
10: End
11: Calculate the ensemble gene weights according to Equation (8).
   W f i n a l + = a i W i
12: Output: W f i n a l
Note: Initialize the elements of Z between 0 and 1, F = d i a g ( 1 2 Z 1 · 2 , 1 2 Z g · 2 ) . Initialize H through consensus clustering.
Table 2. Performance mean ± standard deviation of FNMF, jNMFMA, CGUFS, and ECGUFS.
Table 2. Performance mean ± standard deviation of FNMF, jNMFMA, CGUFS, and ECGUFS.
FNMFjNMFMACGUFSECGUFS
AUC56.0 ± 1.956.7 ± 1.654.3 ± 1.559.2 ± 0.8
AUPR20.4 ± 1.920.7 ± 1.622.5 ± 1.829.4 ± 1.9
FNMF: Flexible non-negative matrix factorization method; jNMFMA: Joint non-negative matrix factorization meta-analysis method; AUC: Area under the ROC curve; AUPR: Area under the precision-recall (PR) curve.
Table 3. The number of overlapped genes between the top 1000 genes of any two ranked lists obtained by ECGUFS.
Table 3. The number of overlapped genes between the top 1000 genes of any two ranked lists obtained by ECGUFS.
E2E3E4E5E6E7E8E9E10
E1710
(71%)
705
(70.5%)
686
(68.6%)
677
(67.7%)
695
(69.5%)
679
(67.9%)
663
(66.3%)
691
(69.1%)
666
(66.6%)
E2 697
(69.7%)
686
(68.6%)
657
(65.7%)
686
(68.6%)
721
(72.1%)
676
(67.6%)
737
(73.7%)
682
(68.2%)
E3 689
(68.9%)
677
(67.7%)
691
(69.1%)
683
(68.3%)
655
(65.5%)
678
(67.8%)
665
(66.5%)
E4 684
(68.4%)
704
(70.4%)
696
(69.6%)
681
(68.1%)
715
(71.5%)
668
(66.8%)
E5 659
(65.9%)
657
(65.7%)
674
(67.4%)
665
(66.5%)
664
(66.4%)
E6 670
(67.0%)
670
(67.0%)
691
(69.1%)
690
(69.0%)
E7 666
(66.6%)
707
(70.7%)
669
(66.9%)
E8 678
(67.8%)
649
(64.9%)
E9 682
(68.2%)
Note: E1 represents experiment 1 using ECGUFS.
Table 4. The number of overlapped genes between the top 2000 genes of any two ranked lists obtained by ECGUFS.
Table 4. The number of overlapped genes between the top 2000 genes of any two ranked lists obtained by ECGUFS.
E2E3E4E5E6E7E8E9E10
E11593
(79.7%)
1598
(79.9%)
1565
(78.3%)
1570
(78.5%)
1603
(80.2%)
1569
(78.5%)
1547
(77.4%)
1589
(79.5%)
1564
(78.2%)
E2 1623
(69.7%)
1589
(79.5%)
1550
(77.5%)
1621
(81.1%)
1618
(80.9%)
1534
(76.7%)
1621
(81.1%)
1595
(79.8%)
E3 1582
(79.1%)
1589
(79.5%)
1610
(80.5%)
1603
(80.2%)
1559
(78.0%)
1599
(80.0%)
1590
(79.5%)
E4 1573
(78.7%)
1605
(80.3%)
1563
(78.2%)
1570
(78.5%)
1592
(79.6%)
1567
(78.4%)
E5 1569
(78.5%)
1545
(77.3%)
1575
(78.8%)
1572
(78.6%)
1567
(78.4%)
E6 1597
(79.9%)
1570
(78.5%)
1607
(80.4%)
1619
(81.0%)
E7 1557
(77.9%)
1615
(80.8%)
1584
(79.2%)
E8 1561
(78.1%)
1550
(77.5%)
E9 1596
(79.8%)
Table 5. The functional annotation clusterings of the 287 overlapped genes.
Table 5. The functional annotation clusterings of the 287 overlapped genes.
Annotation ClusterCategoryAnnotationCountp ValueBenjamini
1
Enrichment Score: 3.02
GOTERM_CC_DIRECTPostsynaptic density164.2 × 10−71.3 × 10−4
GOTERM_CC_DIRECTPostsynaptic membrane102.2 × 10−39.1 × 10−2
GOTERM_CC_DIRECTSynapse141.3 × 10−22.4 × 10−1
GOTERM_CC_DIRECTCell junction157.4 × 10−24.9 × 10−1
2
Enrichment Score: 1.93
GOTERM_BP_DIRECTFatty acid metabolic process99.3 × 10−44.8 × 10−1
GOTERM_BP_DIRECTFatty acid biosynthetic process51.5 × 10−28.4 × 10−1
KEGG_PATHWAYFatty acid metabolism43.6 × 10−28.7 × 10−1
GOTERM_MF_DIRECTTransferase activity, transferring acyl groups other than amino-acyl groups33.7 × 10−27.6 × 10−1
3
Enrichment Score: 1.81
GOTERM_MF_DIRECTTransferase activity372.4 × 10−41.1 × 10−1
GOTERM_BP_DIRECTPhosphorylation175.7 × 10−36.4 × 10−1
GOTERM_MF_DIRECTkinase activity188.5 × 10−35.7 × 10−1
GOTERM_MF_DIRECTNucleotide binding381.4 × 10−26.3 × 10−1
GOTERM_MF_DIRECTATP binding302.6 × 10−27.3 × 10−1
GOTERM_BP_DIRECTProtein phosphorylation143.5 × 10−29.6 × 10−1
GOTERM_MF_DIRECTProtein kinase activity129.6 × 10−28.6 × 10−1
GOTERM_MF_DIRECTProtein serine/threonine kinase activity92.1 × 10−19.4 × 10−1
4
Enrichment Score: 1.58
GOTERM_BP_DIRECTLearning or memory54.1 × 10−36.9 × 10−1
GOTERM_BP_DIRECTRegulation of synaptic plasticity41.7 × 10−28.4 × 10−1
GOTERM_BP_DIRECTEmbryo development32.7 × 10−19.9 × 10−1
5
Enrichment Score: 1.40
GOTERM_CC_DIRECTCell–cell adherens junction102.0 × 10−22.9 × 10−1
GOTERM_MF_DIRECTCadherin binding involved in cell–cell adhesion93.3 × 10−27.7 × 10−1
GOTERM_BP_DIRECTCell­–cell adhesion69.7 × 10−29.9 × 10−1

Share and Cite

MDPI and ACS Style

Guo, X.; Jiang, X.; Xu, J.; Quan, X.; Wu, M.; Zhang, H. Ensemble Consensus-Guided Unsupervised Feature Selection to Identify Huntington’s Disease-Associated Genes. Genes 2018, 9, 350. https://doi.org/10.3390/genes9070350

AMA Style

Guo X, Jiang X, Xu J, Quan X, Wu M, Zhang H. Ensemble Consensus-Guided Unsupervised Feature Selection to Identify Huntington’s Disease-Associated Genes. Genes. 2018; 9(7):350. https://doi.org/10.3390/genes9070350

Chicago/Turabian Style

Guo, Xia, Xue Jiang, Jing Xu, Xiongwen Quan, Min Wu, and Han Zhang. 2018. "Ensemble Consensus-Guided Unsupervised Feature Selection to Identify Huntington’s Disease-Associated Genes" Genes 9, no. 7: 350. https://doi.org/10.3390/genes9070350

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop