Next Article in Journal
The Benefits and Hazards of Intravitreal Mesenchymal Stem Cell (MSC) Based-Therapies in the Experimental Ischemic Optic Neuropathy
Next Article in Special Issue
Dissecting Response to Cancer Immunotherapy by Applying Bayesian Network Analysis to Flow Cytometry Data
Previous Article in Journal
Innate Receptor Activation Patterns Involving TLR and NLR Synergisms in COVID-19, ALI/ARDS and Sepsis Cytokine Storms: A Review and Model Making Novel Predictions and Therapeutic Suggestions
Previous Article in Special Issue
A Computational Framework Based on Ensemble Deep Neural Networks for Essential Genes Identification
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

PUP-Fuse: Prediction of Protein Pupylation Sites by Integrating Multiple Sequence Representations

by
Firda Nurul Auliah
1,
Andi Nur Nilamyani
1,
Watshara Shoombuatong
2,
Md Ashad Alam
3,
Md Mehedi Hasan
1,4 and
Hiroyuki Kurata
1,*
1
Department of Bioscience and Bioinformatics, Kyushu Institute of Technology, 680-4 Kawazu, Iizuka, Fukuoka 820-8502, Japan
2
Center of Data Mining and Biomedical Informatics, Faculty of Medical Technology, Mahidol University, Bangkok 10700, Thailand
3
Tulane Center for Biomedical Informatics and Genomics, Division of Biomedical Informatics and Genomics, John W. Deming Department of Medicine, School of Medicine, Tulane University, New Orleans, LA 70112, USA
4
Japan Society for the Promotion of Science, 5-3-1 Kojimachi, Chiyoda-ku, Tokyo 102-0083, Japan
*
Author to whom correspondence should be addressed.
Int. J. Mol. Sci. 2021, 22(4), 2120; https://doi.org/10.3390/ijms22042120
Submission received: 16 January 2021 / Revised: 12 February 2021 / Accepted: 18 February 2021 / Published: 20 February 2021
(This article belongs to the Special Issue Deep Learning and Machine Learning in Bioinformatics)

Abstract

:
Pupylation is a type of reversible post-translational modification of proteins, which plays a key role in the cellular function of microbial organisms. Several proteomics methods have been developed for the prediction and analysis of pupylated proteins and pupylation sites. However, the traditional experimental methods are laborious and time-consuming. Hence, computational algorithms are highly needed that can predict potential pupylation sites using sequence features. In this research, a new prediction model, PUP-Fuse, has been developed for pupylation site prediction by integrating multiple sequence representations. Meanwhile, we explored the five types of feature encoding approaches and three machine learning (ML) algorithms. In the final model, we integrated the successive ML scores using a linear regression model. The PUP-Fuse achieved a Mathew correlation value of 0.768 by a 10-fold cross-validation test. It also outperformed existing predictors in an independent test. The web server of the PUP-Fuse with curated datasets is freely available.

1. Introduction

Pupylation is a type of prokaryotic ubiquitin-like protein (Pup), which contributes to many cellular processes [1,2]. The Pup process connects the lysine residue with isopeptide bonds, called pupylation, which plays an important role in controlling signal transduction and protein degradation in prokaryotic cells [3,4]. Pup proteins tag intrinsically disordered and misfolded proteins to be degraded [3,5]. While pupylation and ubiquitylation are analogs in terms of function, they have different enzymologies [6]. Unlike ubiquitylation, pupylation involves two types of enzymes: deamidase of Pup (DOP) and proteasome accessory factor A (PafA) [3,7,8,9,10]. On the other hand, enzymes of pupylation are initiated from microbial species and exhibit no homology to ubiquitylation enzymes [7,11].
To know the molecular mechanisms of pupylation, it is necessary to define the substrates of pupylation and its sites precisely. Typically, this task is labor-intensive and time-consuming because of the large-scale analysis of proteomics; thus, a few computational methods of predicting pupylation sites have been proposed [12,13,14,15,16]. Liu et al. first developed the GPS-PUP predictor for the prediction of pupylation sites by the group-based prediction system (GPS) method [17]. Tung et al. presented the iPUP predictor that implemented the support vector machine (SVM) algorithm with the composition of pairs of k-space amino acids (CKSAAP) [18]. Chen et al. developed the PupPred predictor based on SVM [19], where the pairing of amino acids was used to encode the lysine-centered peptides. Recently, Hasan et al. proposed a web server, called pbPUP, to predict the pupylation sites using the profile-based features [20]. The predictors of GPS-PUP, iPUP, and pbPUP showed reasonable performance of population site prediction. However, when they were given higher specificity, their sensitivity score was low.
In this study, we developed the PUP-Fuse as a machine learning (ML)-based predictor, as shown in Figure 1. In brief, we employed the PupDB database [21] to compile the positive and negative samples with a full sequence, encoded the sequence windows into numerical feature vectors by using multiple sequence encoding schemes, selected informative features, and inputted them to ML models. The PUP-Fuse integrated the multiple ML scores generated by the different, single encoding-employing ML methods to enhance the prediction performance.

2. Results and Discussion

2.1. Sequence Preference Analysis

To extract the local sequence around prediction sites, we used a local sliding window consisting of 57 residues (−28~K~28). We used the two-sample logo [22] to display every 28 residues located upstream and downstream in the protein sequence with the pupylation site, as shown in Figure 2. Significant variances in the nearby pupylated sequences were found between the pupylation and non-non-pupylation sites. Particularly, residues “R, Y, and L” were more frequently observed in the enriched positions. In the depleted position residues, “P and K” were more frequently observed. On the other hand, no amino acid residues are stacked at some over- or under-represented positions of the surrounding sequences. For instance, at the enriched positions of −28, −27, −26, −25, −23, −22, −21, −17, −15, −13, −11, −10, −8, −5, −3, +2, +5, +6, +9, +11, +13, +17, +19, and +28 no stacked residues were found. Similarly, in the depleted position of −27, −24, −23, −22, −20, −19, −18, −17, −15, −14, −9, −6, −5, −3, −1, +1, +3, +6, +8, +9, +11, +13, +17, +18, +20, +21, +23, +24 and +27 no stacked residues were identified, suggesting significant information between the positive and negative samples. The above results indicate that a combination of the frequency- and position-based sequence encoding schemes is effective in identifying pupylation sites.

2.2. Performance Results on Training Dataset

We have developed the five single encoding-employing random forest (RF) models and the combined model (PUP-Fuse) by linearly combining them. The PUP-Fuse optimized the five weight coefficients for the AAI, Binary, tripeptide composition (TPC), Profile-Based Composition of K-Spaced Amino Acid Pairs (pbCKSAAP), and CKSAAP-employing RF models as 0.01, 0.1, 0.3, and 0.3, 0.2, respectively. We evaluated the Sens, Spec, Acc, MCC, AUC values of the single encoding-employing RF models and the PUP-Fuse without any feature selection by 10-fold CV test, as shown in Table 1. The ROC and corresponding auPRC curves are shown in Figure 3A,C. The five measures of the PUP-Fuse were higher than those of any single encoding-employing RF model. The PUP-Fuse achieved a very high AUC of 0.913 and outperformed all the single encoding-employing models, which significantly outperformed all the single encoding-employing models with a two-sample t-test at p-value < 0.05 (Table 1).
The PUP-Fuse predictor was developed based on the PupDB database, where a positive-to-negative ratio of ~1:12 was highly imbalanced. Since the prediction accuracy of ML algorithms is seriously impaired by such unbalanced datasets [19,20], many site predictors of PTM use a fairly balanced ratio of positive to negative samples to train classification models [20,23,24]. On the training dataset, we compared the prediction performance (AUC) between 1:1, 1:2, and 1:all ratios of positive to negative samples (Figure S1). Since a 1:1 ratio provided a higher AUC value, we determined a 1:1 ratio as the optimal one. The size of the window is also an important factor to discriminate the positive sites from the negative ones. Based on AUC values, the window size was searched from 25 to 61 (Figure S2). An optimal window size of 57 was obtained because the AUC increasing rate from 45 to 57 was very low.
To investigate the validity of a high cutoff similarity of 80%, employed by CD-HIT [25], we compared the prediction performance with a cutoff of 80% to that with an ordinary cutoff of 30%. A cutoff of 30% produced the training dataset that contained 129 proteins with 141 pupylation and 141 non-pupylation sites (with a 1:1 positive-to-negative ratio). The overall performance of PUP-Fuse with a cutoff similarity of 30% a little decreased (AUC = 0.903) (Table S1) by the 10-fold cross-validation, but a cutoff similarity of 80% presented almost similar performance with a cutoff similarity of 30%.

2.3. Performance Optimization by Chi-Square Test

The proposed method describes some sniping sequence patterns for a pupylation site in a comprehensive way, while it results in a high-dimensional vector. Some redundant or irrelevant attributes may be present that affect accuracy reduction. Thus, we selected the informative features out of many features using a well-established chi-squared test. For each employed scheme, different feature subsets were selected, which contained the top-ranked features ranging from the top 20 to the top 500 with an interval of 20. All these curated feature subcategories were inputted to RF separately, and their respective performances were evaluated using 10-fold cross-validation (Figure S3). To end, the feature subset that reached the highest AUC was selected as the optimal one. In this approach, we selected the 260-, 100-, 200-, 240-, and 350-dimensional features from pbCKSAAP, AAI, Binary, CKSAAP, and TPC encodings, respectively. In the PUP-Fuse, the weight coefficients for the AAI, Binary, TPC, and pbCKSAAP-employing RF models were optimized as 0.1, 0.1, 0.3, 0.3, and 0.2, respectively. As shown in Figure 3B,D, the PUP-Fuse with the chi-squared test achieved higher AUC and auPRC values than that without the feature selection. The PUP-Fuse with feature selection achieved an accuracy of 88.4% (Sn = 88.1% and MCC = 0.768) at a specificity control of 88.1% on the training data (Table 2). The PUP-Fuse reached a remarkable AUC value of 0.956, which significantly outperformed all the single-employing-based models with a two-sample t-test at the level of p-value < 0.05 (Table 2).

2.4. Comparison among Different ML Methods on Training Dataset

Selecting an optimal ML method is an essential step. Therefore, to verify the effectiveness and superiority of the RF algorithm employed by the PUP-Fuse, we compared it with the KNN and SVM algorithms on the same training dataset by a 10-fold CV test. In order to make a fair comparison, the KNN and SVM models implemented the same encoding schemes as the PUP-Fuse. As shown in Figure 4, the RF model yielded a higher AUC than the other two ML models, which was approximately 2–5% higher than the AUCs of the other models.

2.5. Comparison of PUP-Fuse with Existing Methods on Independent Dataset

Several computational methods had been proposed for the prediction of pupylation sites. In order to compare the PUP-Fuse with the four existing methods (GPS-PUP, iPUP, PUPS, and PbPUP), an independent dataset of 86 pupylation sites from 71 pupylated proteins and 1136 non-pupylation putative sites was used. Even though the PUP-Fuse and these existing methods did not use the same training dataset, we used the same independent dataset for a fair comparison of performances. We submitted the independent dataset directly to the web servers to obtain the prediction performances. The PUP-Fuse achieved the highest performance, as shown in Table 3, with a Sens of 0.59, a Spec of 0.91, an Acc of 0.82, and an MCC of 0.55. The PUP-Fuse provided 10–20% higher MCC than the other existing models, demonstrating the superiority of the PUP-Fuse over the existing predictors. The superiority of PUP-Fuse could result from a linear combination of the five ML probability scores evaluated by the five different encodings. Note that all the encodings contribute to prediction performance.

3. Materials and Methods

3.1. Data Collection and Processing

The datasets were retrieved and taken from the publication of the PupDB database [21]. The experimentally identified lysine pupylation sites were treated as positive samples, while all existing lysine residues that were not experimentally confirmed as the sites of pupylation in those proteins were treated as non-pupylation sites or negative samples. After deleting 80% similar sequences using CD-HIT [25], we preserved 233 pupylated proteins with 273 positive and 3280 negative sites. In the PupDB dataset, the ratio of the positive to negative samples (~1:12) is very unbalanced, which would obstruct the training model. Thus, a balanced dataset with a positive-to-negative ratio of 1:1 (186 of positive sites and negative 186 sites) was composed by randomly excluding the negative samples. The independent dataset consisting of 87 experimentally verified pupylation sites and 191 putative non-pupylation sites was randomly extracted from the dataset to test the various predictors. The curated datasets are summarized in Table 4.

3.2. Encoding Scheme

3.2.1. pbCKSAAP

The pbCKSAAP method is widely investigated in previous studies [20,26,27,28]. The k -spaced residue pair could be defined as p a   { k }   p b ( a ,   b   =   1 , 2 , , 20 ) , where p a and p b show two residues of 20 types of amino acids. While k   =   0 , p a   { k }   p b   represents a dipeptide and considers a number of 400   ( = 20 × 20 )   dipeptides. In this study   k   =   0 , 1 , 2 , 3 , 4 were considered ( i . e . ,   k m a x   =   4 ). Accordingly, the feature vector from each positive/negative sample has a dimension of 200   ( = 400 × 5   ) . In this process, PSI-BLAST searched each protein sequence to produce a profile (i.e., PSSM matrix) with respect to the NCBI NR90 database (December 2010 version). For the inclusion of new sequences, the iteration time and e-value limit were set, respectively, to 3 and 1.0 × 10 4 .
If residue pair p a   { k }   p b performs between the positions t   a n d   t + k + 1 in the PSSM matrix, the frequency scores could be generated as follows:
S a , b =   i = 1 N m a x { m i n { PSSM ( t , p a ) ,   PSSM   ( t + k + 1 , p b ) } , 0 }
where PSSM ( t , p a )   denotes the amino acid score p a at the t t h of PSSM in a row position, PSSM ( t + k + 1 , p b ) exists for an amino acid score of p b at ( t + k + 1 ) t h   of PSSM in a row position. The pupylation/non-pupylation site appears N times. Moreover, we normalize S a , b using the formulation below:
S a , b = S a , b L     k 1
where L stands for the total sequence fragment length, i.e., the size of a window is L. We have used the pbCKSAAP encoding scheme to create a 2000-dimensional feature vector for any positive/negative sample.

3.2.2. CKSAAP Encoding

The CKSAAP encoding is widely used for representing sequence motifs [26,27,29]. If a sequence fragment is composed of 57 windows and 20 types of residues, it contains 400 (=20 × 20) types of residue pairs (i.e., AA, AC, AD, …) for every single k, where k signifies the space between two amino acids. In this work, the optimal kmax was set to 4 to generate 2000 (=20 × (kmax + 1) × 20)-dimensional feature vectors for a single sequence.

3.2.3. Binary Encoding

Twenty types of amino acids can encode with the sequence window to generate the binary feature vectors [30,31]. By binary encoding, a 1140 (=20 × 57)-dimensional feature vector was calculated for a window sequence.

3.2.4. TPC Encoding

The TPC encoding scheme implements a three-amino acid-fixed length of composition [29] to generate tri-amino acids composition with 8000 (=20 × 20 × 20)-dimensional feature vectors.

3.2.5. AAI Encoding

The AAI encoding scheme uses the amino acid properties [32]. We selected the top 15 instructive amino acid indices after assessing different physicochemical and biological properties of amino acids (Table S2). The AAI encoding generates 855 (=57 × 15)-dimensional feature vectors.

3.2.6. Feature Selection

Feature selection is a key step to eliminate unrelated features and to improve predictive performance. All the features are not equally important, or even some of them are noisy and have adverse effects on performance [15,20]. We used ChiSquaredAttributeEval and Ranker evaluation tools of WEKA [33] to select the features that are relevant to pupylation sites.
The chi-squared (χ2) test is a standard statistical test that analyzes the variance of the expected distribution, assuming that the presence of a given function is independent of the class value. Details in the χ2 feature selection process can be found elsewhere [20].

3.2.7. Classification Method

Random forest algorithms are based on the classification and regression trees (CART) techniques [26,31,34]. It raises numerous trees of classification or regression that are called “forests”. Each tree is constructed using a deterministic algorithm, and due to two factors, the trees are different. The best separation is initially chosen from a random subset of the predictors at each node. In addition, a bootstrap observation sample is used to construct each tree. The overall prediction is then calculated as the average of all the trees.
We used KNN and SVM to compare with the RF classifier employed by PUP-Fuse. SVM is being widely used in protein bioinformatics [35,36,37]. For making a proper binary prediction, a kernel radial basis function (RBF) with the LIBSVM 2019 package (http://www.csie.ntu.edu.tw/~cjlin/libsvm/ (accessed date: 11 September 2019)) was applied to the training and independent datasets [38]. For tuning parameters, C and γ were maximized based on the training dataset by using the LIBSVM grid search strategy. The grid search strategy was carried based on 10-fold cross-validation tests to find the optimal C and γ ∈ [2−7, 2−6, …, 28]. The KNN is a supervised ML algorithm that solves both classification and regression problems. We used the KNN algorithm of the R package to classify positive and negative samples at (https://cran.r-project.org (accessed date: 11 September 2019)).

3.2.8. Feature Integration

Features were typically integrated to improve the prediction performance. We linearly combined the ML scores evaluated by the five encoding schemes: AAI, Binary, TPC, CKSAAP, and pbCKSAAP, with the formula as follows:
  C l =   i = 1 n ( w i     s i )
where Cl is the linear combination of the ML scores, w i   and s i are the weight coefficient and score for each encoding scheme i. The total of w i   equals to 1. The linear combination model of the ML scores calculated by the five encoding schemes is named the PUP-Fuse. The above feature integration model is widely used in different bioinformatics tasks [27,39,40,41].

3.2.9. Model Evaluation

In this analysis, 10-fold cross-validation was chosen to test the predictor proposed [31,42,43,44,45,46,47,48,49,50,51,52,53,54,55]. Seven measures were used to evaluate the proposed predictor: sensitivity (Sens), specificity (Spec), accuracy (Acc), Matthews coefficient of correlation (MCC) [30,46,56,57,58,59,60,61,62,63], precision and recall. The formulas are defined as follows:
Sens   =   TP TP   +   FN
Spec   =   TN TN   +   FP
Acc   =   TP   +   TN TP   +   TN   +   FP   +   FN
MCC   =   TP   ×   TN     FP   ×   FN ( TP   +   FN ) × ( TN   +   FP ) × ( TP   +   FP ) × ( TN   +   FN )
Precision = TP TP + FP
Recall = TP TP + FN
where TP, FP, TN, and FN represent, respectively, the numbers of true positive, false-positive, true negative, and false-negative samples. Moreover, the area under the curve value (AUC) is evaluated from the receiver operating characteristic (ROC) curve by pROC package at https://cran.r-project.org/web/packages/pROC/ (accessed date: 11 September 2019), and the area under the precision curve (auPRC) is calculated to access the overall predictive performance.

4. Conclusions

The PUP-Fuse was developed for better prediction of pupylation sites. The PUP-Fuse was the RF model that integrated the five types of encoding schemes to consider various sequence patterns around protein pupylation sites. Then, the chi-squared test was used as the feature selection method. Performance evaluated by the training and independent tests clearly demonstrated the advantage of the PUP-Fuse over the existing models. The performances of PUP-Fuse are assessed based on the independent test dataset and compared with other existing methods, concluding that the predictive performance of PUP-Fuse is better than other existing methods. The comparison between different classifiers shows that the chi-squared feature selection algorithm optimized the curated feature vectors and RF-based model superior to other classifiers in predicting pupylation sites. Additionally, we found that the integration of successive ML scores by using a linear regression model advances the prediction performances. The web implementation of the PUP-Fuse with curated datasets are freely available for users at http://kurata14.bio.kyutech.ac.jp/PUP-Fuse/ (accessed date: 11 September 2019).

Supplementary Materials

Supplementary materials can be found at https://www.mdpi.com/1422-0067/22/4/2120/s1. Figure S1: Comparison of 1:1, 1:2, and 1:all ratios of positive-to-negative samples on training dataset; Figure S2: AUC values for different window sizes based on 10-fold cross-validation tests; Figure S3: AUC value with respect to selected features for the five encoding schemes; Table S1: Prediction performance after the removal of 30% sequence redundancy on the training dataset; Table S2: Fifteen types of AAI properties used in this study.

Author Contributions

Conceptualization, M.M.H. and H.K.; for analysis F.N.A., A.N.N., M.M.H.; methodology, F.N.A. and M.M.H.; writing—original draft, F.N.A., M.M.H. and H.K.; writing—review and editing, F.N.A., W.S., M.A.A., M.M.H. and H.K. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the Grant-in-Aid for Scientific Research (B) (19H04208) and partially supported by the Grant-in-Aid for JSPS Research Fellow (19F19377) from Japan Society for the Promotion of Science (JSPS) and by the developing key technologies for discovering and manufacturing pharmaceuticals used for next-generation treatments and diagnoses both from the Ministry of Economy, Trade and Industry, Japan (METI) and from Japan Agency for Medical Research and Development (AMED).

Informed Consent Statement

Not applicable.

Data Availability Statement

All the data is available at http://kurata14.bio.kyutech.ac.jp/PUP-Fuse/ (accessed date: 11 September 2019).

Conflicts of Interest

The authors declare that they have no conflicts of interest.

References

  1. Li, T.; Chen, Y.; Li, T.; Jia, C. Recognition of Protein Pupylation Sites by Adopting Resampling Approach. Molecules 2018, 23, 3097. [Google Scholar] [CrossRef] [Green Version]
  2. Alhuwaider, A.A.H.; Truscott, K.N.; Dougan, D.A. Pupylation of PafA or Pup inhibits components of the Pup-Proteasome System. FEBS Lett. 2018, 592, 15–23. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Delley, C.L.; Striebel, F.; Heydenreich, F.M.; Ozcelik, D.; Weber-Ban, E. Activity of the mycobacterial proteasomal ATPase Mpa is reversibly regulated by pupylation. J. Biol. Chem. 2012, 287, 7907–7914. [Google Scholar] [CrossRef] [Green Version]
  4. Burns, K.E.; Darwin, K.H. Pupylation: Proteasomal targeting by a protein modifier in bacteria. Methods Mol. Biol. 2012, 832, 151–160. [Google Scholar] [CrossRef] [Green Version]
  5. Striebel, F.; Imkamp, F.; Ozcelik, D.; Weber-Ban, E. Pupylation as a signal for proteasomal degradation in bacteria. Biochim. Biophys. Acta 2014, 1843, 103–113. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Burns, K.E.; Darwin, K.H. Pupylation versus ubiquitylation: Tagging for proteasome-dependent degradation. Cell Microbiol. 2010, 12, 424–431. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. Barandun, J.; Delley, C.L.; Weber-Ban, E. The pupylation pathway and its role in mycobacteria. BMC Biol. 2012, 10, 95. [Google Scholar] [CrossRef] [Green Version]
  8. Poulsen, C.; Akhter, Y.; Jeon, A.H.; Schmitt-Ulms, G.; Meyer, H.E.; Stefanski, A.; Stuhler, K.; Wilmanns, M.; Song, Y.H. Proteome-wide identification of mycobacterial pupylation targets. Mol. Syst. Biol. 2010, 6, 386. [Google Scholar] [CrossRef]
  9. Imkamp, F.; Rosenberger, T.; Striebel, F.; Keller, P.M.; Amstutz, B.; Sander, P.; Weber-Ban, E. Deletion of dop in Mycobacterium smegmatis abolishes pupylation of protein substrates in vivo. Mol. Microbiol. 2010, 75, 744–754. [Google Scholar] [CrossRef]
  10. Mukherjee, S.; Orth, K. Microbiology. A protein pupylation paradigm. Science 2008, 322, 1062–1063. [Google Scholar] [CrossRef]
  11. Hecht, N.; Gur, E. Development of a fluorescence anisotropy-based assay for Dop, the first enzyme in the pupylation pathway. Anal. Biochem. 2015, 485, 97–101. [Google Scholar] [CrossRef]
  12. Xu, X.; Niu, Y.; Liang, K.; Shen, G.; Cao, Q.; Yang, Y. Analysis of pupylation of Streptomyces hygroscopicus 5008 in vitro. Biochem. Biophys. Res. Commun. 2016, 474, 126–130. [Google Scholar] [CrossRef]
  13. Fascellaro, G.; Petrera, A.; Lai, Z.W.; Nanni, P.; Grossmann, J.; Burger, S.; Biniossek, M.L.; Gomez-Auli, A.; Schilling, O.; Imkamp, F. Comprehensive Proteomic Analysis of Nitrogen-Starved Mycobacterium smegmatis Deltapup Reveals the Impact of Pupylation on Nitrogen Stress Response. J. Proteome Res. 2016, 15, 2812–2825. [Google Scholar] [CrossRef]
  14. Chen, X.; Li, C.; Wang, L.; Liu, Y.; Li, C.; Zhang, J. The Mechanism of Mycobacterium smegmatis PafA Self-Pupylation. PLoS ONE 2016, 11, e0151021. [Google Scholar] [CrossRef]
  15. Nan, X.; Bao, L.; Zhao, X.; Zhao, X.; Sangaiah, A.K.; Wang, G.G.; Ma, Z. EPuL: An Enhanced Positive-Unlabeled Learning Algorithm for the Prediction of Pupylation Sites. Molecules 2017, 22, 1463. [Google Scholar] [CrossRef] [Green Version]
  16. Singh, V.; Sharma, A.; Dehzangi, A.; Tsunoda, T. PupStruct: Prediction of Pupylated Lysine Residues Using Structural Properties of Amino Acids. Genes 2020, 11, 1431. [Google Scholar] [CrossRef]
  17. Liu, Z.; Ma, Q.; Cao, J.; Gao, X.; Ren, J.; Xue, Y. GPS-PUP: Computational prediction of pupylation sites in prokaryotic proteins. Mol. Biosyst. 2011, 7, 2737–2740. [Google Scholar] [CrossRef] [PubMed]
  18. Tung, C.W. Prediction of pupylation sites using the composition of k-spaced amino acid pairs. J. Theor. Biol. 2013, 336, 11–17. [Google Scholar] [CrossRef] [PubMed]
  19. Chen, X.; Qiu, J.D.; Shi, S.P.; Suo, S.B.; Liang, R.P. Systematic analysis and prediction of pupylation sites in prokaryotic proteins. PLoS ONE 2013, 8, e74002. [Google Scholar] [CrossRef]
  20. Hasan, M.M.; Zhou, Y.; Lu, X.; Li, J.; Song, J.; Zhang, Z. Computational Identification of Protein Pupylation Sites by Using Profile-Based Composition of k-Spaced Amino Acid Pairs. PLoS ONE 2015, 10, e0129635. [Google Scholar] [CrossRef] [Green Version]
  21. Tung, C.W. PupDB: A database of pupylated proteins. BMC Bioinform. 2012, 13, 40. [Google Scholar] [CrossRef] [Green Version]
  22. Vacic, V.; Iakoucheva, L.M.; Radivojac, P. Two Sample Logo: A graphical representation of the differences between two sets of sequence alignments. Bioinformatics 2006, 22, 1536–1537. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Hasan, M.M.; Rashid, M.M.; Khatun, M.S.; Kurata, H. Computational identification of microbial phosphorylation sites by the enhanced characteristics of sequence information. Sci. Rep. 2019, 9, 8258. [Google Scholar] [CrossRef] [Green Version]
  24. Hasan, M.M.; Yang, S.; Zhou, Y.; Mollah, M.N. SuccinSite: A computational tool for the prediction of protein succinylation sites by exploiting the amino acid patterns and properties. Mol. Biosyst. 2016, 12, 786–795. [Google Scholar] [CrossRef]
  25. Huang, Y.; Niu, B.; Gao, Y.; Fu, L.; Li, W. CD-HIT Suite: A web server for clustering and comparing biological sequences. Bioinform. 2010, 26, 680–682. [Google Scholar] [CrossRef] [PubMed]
  26. Hasan, M.M.; Khatun, M.S.; Kurata, H. iLBE for Computational Identification of Linear B-cell Epitopes by Integrating Sequence and Evolutionary Features. Genom. Proteom. Bioinform. 2020. [Google Scholar] [CrossRef] [PubMed]
  27. Khatun, M.S.; Hasan, M.M.; Kurata, H. PreAIP: Computational Prediction of Anti-inflammatory Peptides by Integrating Multiple Complementary Features. Front. Genet. 2019, 10, 129. [Google Scholar] [CrossRef]
  28. Hasan, M.M.; Khatun, M.S.; Mollah, M.N.H.; Yong, C.; Guo, D. A systematic identification of species-specific protein succinylation sites using joint element features information. Int. J. Nanomed. 2017, 12, 6303–6315. [Google Scholar] [CrossRef] [Green Version]
  29. Chen, Y.Z.; Tang, Y.R.; Sheng, Z.Y.; Zhang, Z. Prediction of mucin-type O-glycosylation sites in mammalian proteins using the composition of k-spaced amino acid pairs. BMC Bioinform. 2008, 9, 101. [Google Scholar] [CrossRef] [Green Version]
  30. Charoenkwan, P.; Yana, J.; Nantasenamat, C.; Hasan, M.M.; Shoombuatong, W. iUmami-SCM: A Novel Sequence-Based Predictor for Prediction and Analysis of Umami Peptides Using a Scoring Card Method with Propensity Scores of Dipeptides. J. Chem. Inf. Model. 2020, 60, 6666–6678. [Google Scholar] [CrossRef] [PubMed]
  31. Charoenkwan, P.; Nantasenamat, C.; Hasan, M.M.; Shoombuatong, W. Meta-iPVP: A sequence-based meta-predictor for improving the prediction of phage virion proteins using effective feature representation. J. Comput. Aided Mol. Des. 2020, 34, 1105–1116. [Google Scholar] [CrossRef] [PubMed]
  32. Kawashima, S.; Pokarowski, P.; Pokarowska, M.; Kolinski, A.; Katayama, T.; Kanehisa, M. AAindex: Amino acid index database, progress report 2008. Nucleic Acids Res. 2008, 36, D202–D205. [Google Scholar] [CrossRef] [Green Version]
  33. Frank, E.; Hall, M.; Trigg, L.; Holmes, G.; Witten, I.H. Data mining in bioinformatics using Weka. Bioinformatics 2004, 20, 2479–2481. [Google Scholar] [CrossRef] [Green Version]
  34. Khatun, S.; Hasan, M.; Kurata, H. Efficient computational model for identification of antitubercular peptides by integrating amino acid patterns and properties. FEBS Lett. 2019, 593, 3029–3039. [Google Scholar] [CrossRef]
  35. Khatun, M.S.; Hasan, M.M.; Shoombuatong, W.; Kurata, H. ProIn-Fuse: Improved and robust prediction of proinflammatory peptides by fusing of multiple feature representations. J. Comput. Aided Mol. Des. 2020, 34, 1229–1236. [Google Scholar] [CrossRef]
  36. Manavalan, B.; Basith, S.; Shin, T.H.; Wei, L.; Lee, G. AtbPpred: A Robust Sequence-Based Prediction of Anti-Tubercular Peptides Using Extremely Randomized Trees. Comput. Struct. Biotechnol. J. 2019, 17, 972–981. [Google Scholar] [CrossRef]
  37. Zhang, D.; Xu, Z.C.; Su, W.; Yang, Y.H.; Lv, H.; Yang, H.; Lin, H. iCarPS: A computational tool for identifying protein carbonylation sites by novel encoded features. Bioinformatics 2020, btaa702. [Google Scholar] [CrossRef] [PubMed]
  38. Chang, C.C.; Lin, C.J. LIBSVM: A Library for Support Vector Machines. Acm. Trans. Intel. Syst. Tec. 2011, 2, 1–27. [Google Scholar] [CrossRef]
  39. Hasan, M.M.; Alam, M.A.; Shoombuatong, W.; Kurata, H. IRC-Fuse: Improved and robust prediction of redox-sensitive cysteine by fusing of multiple feature representations. J. Comput. Aided Mol. Des. 2021, 1–9. [Google Scholar] [CrossRef]
  40. Hasan, M.M.; Manavalan, B.; Khatun, M.S.; Kurata, H. i4mC-ROSE, a bioinformatics tool for the identification of DNA N4-methylcytosine sites in the Rosaceae genome. Int. J. Biol. Macromol. 2020, 157, 752–758. [Google Scholar] [CrossRef]
  41. Hasan, M.M.; Khatun, M.S.; Kurata, H. Large-Scale Assessment of Bioinformatics Tools for Lysine Succinylation Sites. Cells 2019, 8, 95. [Google Scholar] [CrossRef] [Green Version]
  42. Ho Thanh Lam, L.; Le, N.H.; Van Tuan, L.; Tran Ban, H.; Nguyen Khanh Hung, T.; Nguyen, N.T.K.; Huu Dang, L.; Le, N.Q.K. Machine Learning Model for Identifying Antioxidant Proteins Using Features Calculated from Primary Sequences. Biology 2020, 9, 325. [Google Scholar] [CrossRef]
  43. Hasan, M.M.; Kurata, H. GPSuc: Global Prediction of Generic and Species-specific Succinylation Sites by aggregating multiple sequence features. PLoS ONE 2018, 13, e0200283. [Google Scholar] [CrossRef]
  44. Khatun, M.S.; Shoombuatong, W.; Hasan, M.M.; Kurata, H. Evolution of Sequence-based Bioinformatics Tools for Protein-protein Interaction Prediction. Curr. Genom. 2020, 21, 454–463. [Google Scholar] [CrossRef]
  45. Le, N.Q.K.; Do, D.T.; Hung, T.N.K.; Lam, L.H.T.; Huynh, T.T.; Nguyen, N.T.K. A Computational Framework Based on Ensemble Deep Neural Networks for Essential Genes Identification. Int. J. Mol. Sci. 2020, 21, 9070. [Google Scholar] [CrossRef]
  46. Manavalan, B.; Hasan, M.M.; Basith, S.; Gosu, V.; Shin, T.H.; Lee, G. Empirical Comparison and Analysis of Web-Based DNA N (4)-Methylcytosine Site Prediction Tools. Mol. Ther. Nucleic Acids 2020, 22, 406–420. [Google Scholar] [CrossRef] [PubMed]
  47. Charoenkwan, P.; Yana, J.; Schaduangrat, N.; Nantasenamat, C.; Hasan, M.M.; Shoombuatong, W. iBitter-SCM: Identification and characterization of bitter peptides using a scoring card method with propensity scores of dipeptides. Genomics 2020, 112, 2813–2822. [Google Scholar] [CrossRef]
  48. Charoenkwan, P.; Nantasenamat, C.; Hasan, M.M.; Shoombuatong, W. iTTCA-Hybrid: Improved and robust identification of tumor T cell antigens by utilizing hybrid feature representation. Anal. Biochem. 2020, 599, 113747. [Google Scholar] [CrossRef] [PubMed]
  49. Charoenkwan, P.; Kanthawong, S.; Nantasenamat, C.; Hasan, M.M.; Shoombuatong, W. iDPPIV-SCM: A Sequence-Based Predictor for Identifying and Analyzing Dipeptidyl Peptidase IV (DPP-IV) Inhibitory Peptides Using a Scoring Card Method. J. Proteome. Res. 2020, 19, 4125–4136. [Google Scholar] [CrossRef] [PubMed]
  50. Charoenkwan, P.; Kanthawong, S.; Nantasenamat, C.; Hasan, M.M.; Shoombuatong, W. iAMY-SCM: Improved prediction and analysis of amyloid proteins using a scoring card method with propensity scores of dipeptides. Genomics 2020, 113, 689–698. [Google Scholar] [CrossRef]
  51. Charoenkwan, P.; Anuwongcharoen, N.; Nantasenamat, C.; Hasan, M.M.; Shoombuatong, W. In silico approaches for the prediction and analysis of antiviral peptides: A review. Curr. Pharm. Des. 2020, 26, 1–11. [Google Scholar] [CrossRef]
  52. Manavalan, B.; Basith, S.; Shin, T.H.; Lee, G. Computational prediction of species-specific yeast DNA replication origin via iterative feature representation. Brief. Bioinform. 2020, bbaa304. [Google Scholar] [CrossRef] [PubMed]
  53. Basith, S.; Manavalan, B.; Shin, T.H.; Lee, G. SDM6A: A Web-Based Integrative Machine-Learning Framework for Predicting 6mA Sites in the Rice Genome. Mol. Ther. Nucleic Acids 2019, 18, 131–141. [Google Scholar] [CrossRef] [Green Version]
  54. Basith, S.; Manavalan, B.; Shin, T.H.; Lee, G. iGHBP: Computational identification of growth hormone binding proteins from sequences using extremely randomised tree. Comput. Struct. Biotechnol. J. 2018, 16, 412–420. [Google Scholar] [CrossRef]
  55. Hasan, M.M.; Shoombuatong, W.; Kurata, H.; Manavalan, B. Critical evaluation of web-based DNA N6-methyladenine site prediction tools. Brief. Funct. Genom. 2021, elaa028. [Google Scholar] [CrossRef] [PubMed]
  56. Basith, S.; Manavalan, B.; Hwan Shin, T.; Lee, G. Machine intelligence in peptide therapeutics: A next-generation tool for rapid disease screening. Med. Res. Rev. 2020, 40, 1276–1314. [Google Scholar] [CrossRef] [PubMed]
  57. Manavalan, B.; Basith, S.; Shin, T.H.; Wei, L.; Lee, G. mAHTPred: A sequence-based meta-predictor for improving the prediction of anti-hypertensive peptides using effective feature representation. Bioinformatics 2019, 35, 2757–2765. [Google Scholar] [CrossRef]
  58. Wei, L.; He, W.; Malik, A.; Su, R.; Cui, L.; Manavalan, B. Computational prediction and interpretation of cell-specific replication origin sites from multiple eukaryotes by exploiting stacking framework. Brief. Bioinform. 2020, bbaa275. [Google Scholar] [CrossRef] [PubMed]
  59. Su, R.; He, L.; Liu, T.; Liu, X.; Wei, L. Protein subcellular localization based on deep image features and criterion learning strategy. Brief. Bioinform. 2020, bbaa313. [Google Scholar] [CrossRef]
  60. Ning, Q.; Ma, Z.; Zhao, X.; Yin, M. SSKM_Succ: A novel succinylation sites prediction method incorprating K-means clustering with a new semi-supervised learning algorithm. IEEE/ACM Trans. Comput. Biol. Bioinform. 2020, 1. [Google Scholar] [CrossRef]
  61. Ning, Q.; Yu, M.; Ji, J.; Ma, Z.; Zhao, X. Analysis and prediction of human acetylation using a cascade classifier based on support vector machine. BMC Bioinform. 2019, 20, 346. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  62. Hasan, M.M.; Basith, S.; Khatun, M.S.; Lee, G.; Manavalan, B.; Kurata, H. Meta-i6mA: An interspecies predictor for identifying DNA N6-methyladenine sites of plant genomes by exploiting informative features in an integrative machine-learning framework. Brief. Bioinform. 2020, bbaa202. [Google Scholar] [CrossRef] [PubMed]
  63. Hasan, M.M.; Schaduangrat, N.; Basith, S.; Lee, G.; Shoombuatong, W.; Manavalan, B. HLPpred-Fuse: Improved and robust prediction of hemolytic peptide and its activity by fusing multiple feature representation. Bioinformatics 2020, 36, 3350–3356. [Google Scholar] [CrossRef] [PubMed]
Figure 1. An overview of the proposed PUP-Fuse predictor.
Figure 1. An overview of the proposed PUP-Fuse predictor.
Ijms 22 02120 g001
Figure 2. Two sample logo of the pupylation sites.
Figure 2. Two sample logo of the pupylation sites.
Ijms 22 02120 g002
Figure 3. Prediction performance of the single encoding-employing models and their combined model (PUP-Fuse) on the training datasets. (A) No feature selection is employed. (B) Feature selection is used. (C) Precision vs. recall curve without feature selection. (D) Precision vs. recall curve with feature selection.
Figure 3. Prediction performance of the single encoding-employing models and their combined model (PUP-Fuse) on the training datasets. (A) No feature selection is employed. (B) Feature selection is used. (C) Precision vs. recall curve without feature selection. (D) Precision vs. recall curve with feature selection.
Ijms 22 02120 g003
Figure 4. Performance comparison among three different machine learning (ML) methods of RF, SVM and KNN.
Figure 4. Performance comparison among three different machine learning (ML) methods of RF, SVM and KNN.
Ijms 22 02120 g004
Table 1. Prediction performance comparison among the single encoding-employing models and their combined models without any feature selection on the training dataset.
Table 1. Prediction performance comparison among the single encoding-employing models and their combined models without any feature selection on the training dataset.
Encoding MethodSensSpecAccMCCAUCp-Value
AAI0.4820.8110.6510.3130.697<0.01
Binary0.5100.8100.6610.3310.703<0.01
pbCKSAAP0.7820.8000.8000.5900.9080.034
TPC0.7700.8010.7910.5740.8770.021
CKSAAP0.7730.8050.7890.5830.8950.038
PUP-Fuse0.8020.8200.8110.6230.912
The PUP-Fuse is the linear combination of the RF score estimated by AAI, Binary, pbCKSAAP, CKSAAP, and TPC encodings and their weight coefficient are 0.1, 0.1, 0.3, 0.3, and 0.2, respectively.
Table 2. Performance comparison among the single encoding-employing models and their combined models with feature selection on the training dataset.
Table 2. Performance comparison among the single encoding-employing models and their combined models with feature selection on the training dataset.
Encoding MethodSensSpecAccMCCAUCp-Value
AAI0.4100.8540.6260.2940.724<0.01
Binary0.4170.8550.6290.3050.731<0.01
pbCKSAAP0.8310.8270.8290.6580.9290.031
TPC0.7540.8270.7890.5820.878<0.01
CKSAAP0.8220.8250.8240.6460.911<0.026
PUP-Fuse0.8860.8810.8840.7680.956
The PUP-Fuse is the linear combination of the RF score estimated by AAI, Binary, pbCKSAAP, CKSAAP, and TPC encodings and their weight coefficient are 0.1, 0.1, 0.3, 0.3, and 0.2, respectively.
Table 3. Performance comparison of the PUP-Fuse with the four existing methods on the independent dataset.
Table 3. Performance comparison of the PUP-Fuse with the four existing methods on the independent dataset.
MethodsSensSpecAccMCC
iPUP0.400.880.730.32
GPS-PUP0.210.890.680.13
PUPS0.170.890.670.08
pbPUP0.480.820.790.45
PUP-Fuse0.590.910.820.55
The threshold values of iPUP, GPS-PUP, PUPS, and pbPUP were set to show high specificity (90%) in their corresponding webservers.
Table 4. The number of pupylated proteins and pupylation sites.
Table 4. The number of pupylated proteins and pupylation sites.
TrainingIndependent
Pupylated protein 16271
Pupylated lysine 18687
Non-pupylated lysine186191
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Auliah, F.N.; Nilamyani, A.N.; Shoombuatong, W.; Alam, M.A.; Hasan, M.M.; Kurata, H. PUP-Fuse: Prediction of Protein Pupylation Sites by Integrating Multiple Sequence Representations. Int. J. Mol. Sci. 2021, 22, 2120. https://doi.org/10.3390/ijms22042120

AMA Style

Auliah FN, Nilamyani AN, Shoombuatong W, Alam MA, Hasan MM, Kurata H. PUP-Fuse: Prediction of Protein Pupylation Sites by Integrating Multiple Sequence Representations. International Journal of Molecular Sciences. 2021; 22(4):2120. https://doi.org/10.3390/ijms22042120

Chicago/Turabian Style

Auliah, Firda Nurul, Andi Nur Nilamyani, Watshara Shoombuatong, Md Ashad Alam, Md Mehedi Hasan, and Hiroyuki Kurata. 2021. "PUP-Fuse: Prediction of Protein Pupylation Sites by Integrating Multiple Sequence Representations" International Journal of Molecular Sciences 22, no. 4: 2120. https://doi.org/10.3390/ijms22042120

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop