Next Article in Journal
Transcriptional Profiles of Secondary Metabolite Biosynthesis Genes and Cytochromes in the Leaves of Four Papaver Species
Next Article in Special Issue
Gaussian Mixture and Kernel Density-Based Hybrid Model for Volatility Behavior Extraction From Public Financial Data
Previous Article in Journal
Towards the Construction of a Gold Standard Biomedical Corpus for the Romanian Language
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Performance Analysis of Statistical and Supervised Learning Techniques in Stock Data Mining

1
Department of Computer Science and Applications, DAV University, Jalandhar 144401, India
2
Department of Computer Science, Guru Nanak Dev University, Amritar 143001, India
*
Author to whom correspondence should be addressed.
Submission received: 30 September 2018 / Revised: 11 November 2018 / Accepted: 19 November 2018 / Published: 24 November 2018
(This article belongs to the Special Issue Data Analysis for Financial Markets)

Abstract

:
Nowadays, overwhelming stock data is available, which areonly of use if it is properly examined and mined. In this paper, the last twelve years of ICICI Bank’s stock data have been extensively examined using statistical and supervised learning techniques. This study may be of great interest for those who wish to mine or study the stock data of banks or any financial organization. Different statistical measures have been computed to explore the nature, range, distribution, and deviation of data. The different descriptive statistical measures assist in finding different valuable metrics such as mean, variance, skewness, kurtosis, p-value, a-squared, and 95% confidence mean interval level of ICICI Bank’s stock data. Moreover, daily percentage changes occurring over the last 12 years have also been recorded and examined. Additionally, the intraday stock status has been mined using ten different classifiers. The performance of different classifiers has been evaluated on the basis of various parameters such as accuracy, misclassification rate, precision, recall, specificity, and sensitivity. Based upon different parameters, the predictive results obtained using logistic regression are more acceptable than the outcomes of other classifiers, whereas naïve Bayes, C4.5, random forest, linear discriminant, and cubic support vector machine (SVM) merely act as a random guessing machine. The outstanding performance of logistic regression has been validated using TOPSIS (technique for order preference by similarity to ideal solution) and WSA (weighted sum approach).

1. Introduction

The deep statistical analytics of a bank’s stock data, along with the performance analysis of different classifiers, can significantly assist a financial analyst and data scientist in predicting intraday, weekly, monthly, and future values of the stock. In this manuscript, the stock data of ICICI bank has been examined using several statistical and supervised learning techniques. ICICI Bank is one of the important leading Indian private banks, comprised of more than 4000 branches that operate in 19 different countries [1]. The bank offers a range of financial services related to savings, current, and fixed deposit accounts. It also offers a different range of loans to rural and urban customers. In the last few years, ICICI bank has gained a lot of faith and confidence from its customers. This statement can be verified from the TRA brand trust report 2018, which declared ICICI to be top of the private Indian banks [2]. Figure 1 represents some of the key figures of the ICICI Banks. It is observed that when compared with the financial year (FY) of 2016, the year of 2017 has a good rate of net interest margins. Growth of 0.71% has been observed in 2017. For the same period, net NPA’s stood at 4.89% (2.67% for FY 2016), which is slightly higher than the industry average for private banks.
Nowadays, the momentous volume of data has been produced daily by different commercial, administrative, and scientific organizations that are tremendously expanding the sizes of the databases. Devices based on social media, the Internet, and the Internet of Things (IoT) further assist in fueling the growth of these databases [3]. Therefore, data are not an issue now. However, the real challenge lies in transforming this mountain of data into useful information. The use of statistics and data mining techniques assists in the automatic extraction of veiled data patterns that are otherwise buried in unprocessed data [4]. Data mining is a systematic data processing approach that collects, cleans, processes, examines, and extracts substantial qualities and hidden patterns in data [5,6]. In other words, the use of data mining techniques assists in extracting precise and significant insights from the deluge of data that have been collected from several manual and digital data sources [4,7]. Data mining has been used in several domains such as agriculture [7,8,9], finance [4,10,11,12], medical science [13,14,15,16,17], and bio-informatics [18,19].
Chandralekha and Shenbagavadivu have examined the performance of different machine learning techniques used to predict cardiovascular disorders. The study has been carried to compare and contrast the performances of both supervised and unsupervised learning techniques based upon three different metrics, namely, accuracy, recall, and precision. Authors found that the results obtained using decision trees are more accurate than those using other machine learning techniques [20]. Belavagi and B. Muniyal have evaluated the performance of different machine learning techniques employed for intrusion detection. Authors found that the results obtained in identifying intrusion using random forest outperform other those using machine learning techniques [21].
Previously, different authors have tried to examine the financial and multivariate analysis of ICICI Bank [22,23]. However, no significant work has been carried out to rigorously analyze ICICI Bank’s stock using a combination of descriptive statistics and supervised learning techniques. The aggregated motive of this study is to extensively mine and analyze the data of one of the leading private Indian banks (ICICI, Mumbai, India) using descriptive and supervised learning techniques. Statistical techniques have been employed to examine the nature, trend, variation, and distribution of data. The last five years’ key figures of ICICI Bank’s stock have been examined to assess the economic status of ICICI Bank. Different descriptive statistical measuressuch as mean, standard deviation, variance, skewness, and kurtosis, along with p-values and A-squared values, have been computed for the major attributes of ICICI Bank’s stock data. The last twelve years’ daily deviation in the opening value of the stock has been recorded and analyzed to examine the intraday status of ICICI Bank’s stock. Moreover, ten different classifiers, namely, naïve Bayes; C4.5; random forest; logistic regression; linear discriminant; and linear, quadratic, cubic, fine, and medium Gaussian support vector machines, have been used to classify the intraday status of ICICI Bank’s stock data. The performances of the different classifiers have been computed using eight different performance metrics. Additionally, the rate of misclassification, as well as of sensitivity along the F1-score, has also been computed and examined.
This study will be beneficial for financial analysts and researchers who wish to extensively mine the financial data of different leading Indian private or government banks. Moreover, it can be of potential interest to quantitative traders.

2. Related Work

Numerous researchers have strived to classify and forecast the future value of stocks using different statistical, data mining, and soft computing techniques. The stock and stock index has been predicted by trend deterministic data and machine learning by J. Patel [24]. Authors compared and contrasted the performance of four different machine learning approaches, that is, SVM (support vector machine), RF (random forest), NB (naïve Bayes), and ANN (artificial neural network), in predicting the future value for Reliance and Infosys, and found that the predictive rate is increased if the different trading parameters are represented as deterministic trend data. Al-Radqidah et al. have predicted the stock price of three different enterprises of the Amman Stock Exchange using ID3 and C4.5 [25]. Özorhan MO et al. have employed a hybrid approach based on SVM and GA (Genetic Algorithm) to predict the best currency pair for exchange. Authors have used primary technical indicators for their analysis and found that by mixing the raw data with a technical financial indicator, one is able to achieve more accurate results [26]. Khedr et al. have predicted the stock value using news sentiment analysis. Authors classified the results of Yahoo, Microsoft, and Facebook using three different approaches, namely, K-NN, SVM, and naïve Bayes [27]. Desai and Gandhi have designed a natural language processing (NLP) module for stock forecasting that uses the online news to determine the future stock value. The NLP was employed to find the polarity of sentences [28]. Zhao and Wang have used an outlier data mining technique for stock forecasting. Authors tried to remove the anomalies of the time series approach. Authors found that their method generated better long-term forecasting results for the Chinesemarket [29]. Bini and Mathew have used clustering and multiple regression techniques for stock forecasting. The objective of clustering is to find a set of companies where a customer has to invest money in better results. Different indexes like Jaccard, C, Rand, and Silhouette were used to validate the results. In general, the focus was on technical analysis, classification, and prediction only [30]. Huang and Gang have devised a kernel manifold learning approach for financial dataset analysis. They found their approach to be useful in improving accuracy. Moreover, the objective criterions provided by the kernel manifold learning approach also assist in depicting and predicting the precise volatility of the stock market [31]. Ye and Li have reviewed literature related to the role of big data in the capital market. Authors concluded that internet big data plays a significant role in stock analysis using sentiment analysis. Authors did not found any clear evidence that explicitly supports that the capital market can be predicted using internet big data [32]. M. Khashei, Z. Hajirahimi has examined the performance of series and parallel strategies in forecasting financial time series. Authors found that the hybridization of a multilayer perceptron model along with ARIMA produces better results when compared with those of the individual models [33]. Nayak and Misra have employed a GA-weighted condensed polynomial neural network (GACPNN). Authors applied GACPNN for five different stock indexes, namely, BSE, DJIA, NASDAQ, FTSE, and TAIEX. The model was validated using the Deibold–Mariano test and found to produce more accurate results [34].

3. Methodology

Statistics represent a multidisciplinary data exploration approach that has been effectively used in various fields such as engineering, physics, chemistry, economics, finance, commerce, computer science, and so on [35,36,37,38,39]. The effective use of different statistical techniques can help in examining the nature, distribution, and trends of data. Descriptive and inferential techniques are significant classes of statistical techniques. Descriptive techniques are aimed at providing aggregated information, that is, they analyze the average and dispersion of data. However, they do not attempt to describe the nature of the population from which the sample has been taken. Rather, they examine the distribution of data. A measure of central tendency, dispersion, skewness, kurtosis, and correlation study are some of the conventional standards of descriptive statistics. Inferential statistics come into picture when one has to analyze the massive amount of data consisting of population size or an order of millions, billions, or even more. With this size of population, it is not feasible to acquire the data for each item of a population. Thus, inferential statistics are used to disclose the nature of the entire population using a sample from the population. Estimation statistics and hypothesis testing are common methods of inferential statistics [40].
Supervised learning (classification) is an important data mining technique that assists in categorizing data into important classes. Classification is a learning process in which a function Fn tries to map each instance of data set to tone specific classes. There are two types of classification techniques, namely descriptive and predictive. Descriptive modeling assists in finding a set of features that can effectively be used to recognize different classes, whereas predictive modeling is used to forecast the unknown category of data instances. These are more efficient for binary or nominal classes and are not fit for ordinal classes [41]. Preceding research observed that many supervised learning techniques have been used to solve different data mining problems [5,6,41]. Some of the dominant classification techniques are briefly introduced in the remaining part of this section.
Naïve Bayes is a conditional probability-based classifier that is highly scalable and gives equal importance to all attributes of the classification problem [42]. C4.5 is a decision tree-based technique that employs a top-down recursive divide and conquer approach for data classification [43,44]. Random forest is an ensemble-based classifier that can be used for enormous and multifaceted databases for exploration, classification, and prediction [45,46]. SVM is one of the discriminative classifiers in which classification is based on the decision planes (multidimensional or hyperplanes) and their boundaries, and is effectively used for both classification and regression. On the basis of the kernel function, SVM can be further categorized as linear, quadratic, cubic, fine Gaussian, and medium Gaussian SVM [47,48]. Logistic regression is a binary classification technique that cannot be applied to a problem where there are more than two classes to be classified. It can provide best fit for real-life issues like spam detection, banking, health, and marketing related applications. Unlike logistic regression, linear discriminant analysis (LDA) is a statistical classifier that can be used for data classification problems where data have to be categorized into two or more classes [49,50].
In spite of classification techniques, ICICI Bank’s stock data were also examined using distinct statistical measures of central tendency and dispersion. The skewness and kurtosis were analyzed to investigate the trend of different attributes of stock data along with the distribution of data. Additionally, A-squared values and p-values of different attributes of ICICI Bank’s stock were also investigated. Furthermore, the data were classified using different classifiers, such asnaïve Bayes; C4.5; random forest; logistic regression; linear discriminant; and linear, quadratic, cubic, fine, and medium Gaussian SVM.

Data Set

The last twelve years’ (2007 to 2018) ICICI Bank’s stock data extracted from Yahoo finance were extensively analyzed using several statistical and supervised learning techniques. There were 2714 distinct instances, along with seven different attributes. For a precise analysis, the cases comprising missing values were eliminated, and finally, 2706 instances were analyzed. Here, status represents the intraday investment analysis. In a day, if closing value is higher than the opening value of ICICI Bank’s stock, then it will be a profitable day for the investor. Otherwise, it will represent a loss for the investor. The data were examined from different statistical perspectives. Moreover, different classifiers have been employed to classify 2714 distinct instances, and their performance was examined on the basis of different parameters.

4. Results

Different descriptive statistical measures were examined to explore the nature of ICICI Bank’s stock data. Table 1 depicts four essential attributes of ICICI Bank’s stock data, along with the values of several descriptive statistical measures.
It was found that the average value of open, close, low, and high attributes of ICICI Bank’s stock lies between 198.43 to 204.79. As per statistical results, the 95% confidence interval range (mean) for open attribute reveals that the average value of open attribute lies between 199.50 to 204.13. From standard deviation, it was found that in the last twelve years, 68% of opening values lie between 140.47 and 263.17, 95% lie between 79.12 and 324.52, and 99.7% lie between 17.77 and 285.87. The negative kurtosis values of open, close, low, and high attributes represent that the distribution curve is platy curtic and more flat in nature.
Figure 2 depicts the brief and consolidated picture of the major attributes of ICICI Bank’s stock data. It is observed that over the last 12 years, the minimum and maximum values of opening and closing balance lie between 47.95 to 360.80 and 47.81 to 362.30, respectively. A significant variation (652.45%) in minimum and maximum opening values of ICICI Bank’s stock has been witnessed.
From the data, it is also clear that maximum and minimum low–high variations are recorded in 2008 and 2013, respectively. However, the common range of variation lies between 90 and 120. Figure 3 depicts the daily percentage change recorded over the last 12 years. It is observed that in the years 2008, 2011, 2015, 2016, and 2017, large numbers of negative daily percentage changes were witnessed.
Furthermore, in the last twelve years, the year 2009 seems to be very negative for the sellers as it had the lowest minimum and maximum opening values. However, the variation between minimum and maximum was found to be significant (264.2%). The year 2018 represents a sound state for investors who invested their money in previous years as the maximum opening value (Rs. 360.8) was achieved in this year. Additionally, the maximum and minimum variation in opening balance was recorded in the years 2008 and 2013, respectively. Figure 4 represents the summary of descriptive statistical measures for low–high variation of ICICI Bank’s stock. The mean, minimum, and maximum values of high–low variation were found to be 6.36, 0, and 42.4, respectively. This means the maximum intraday variation in ICICI Bank’s stock lies between 0 and 42.4 Indian rupees.

4.1. Evaluation Criterions and Analysis of Different Classifiers

The performance of predictive classification models is based upon the values of correctly and incorrectly classified instances. A confusion matrix represents the performance metrics of classifiers that highlight the number and types of errors made during data classification and are related to the following conditions:
  • Positive instances classified as positive (TP)
  • Positive instances classified as negative (FP)
  • Negative instances classified as negative (TN)
  • Negative instances classified as positive (FN)
Some metrics from the confusion matrix, such as accuracy, precision, recall, F1-score, specificity, and sensitivity, can be computed to determine the performance of classifiers from a different perspective.
Accuracy is the most instinctive performance metric that represents the ratio of correctly foretold observation to the total observations, that is,
Accuracy = (TP + TN)/TP + TN + FP + FN
The rate of misclassification is an important measure of classification techniques. The rate of misclassification is based upon three major parameters of classification matrix, namely, true positive, true negative, and a total number of instances. A classifier that has zero rates of misclassification would be perfect and preferred. However, because of the presence of noise in data, it is difficult to find such a type of classifier. Mathematically, the rate of misclassification, which is denoted as err, is computed as
Err = (FP + FN)/N
Here, TP, TN, and N represent true positive, true negative, and total number of instances, respectively.
Sensitivity and specificity are computed to examine the rate of true positive and true negative instances. Mathematically,
Sensitivity (TP Rate) = TP/N
Specificity (FP Rate) = FP/N
Additionally, the precision and recall can be computed to determine the exactness and completeness property of the classifier.
Precision = TP/(TP + FP)
Recall = TP/(TP + FN)
Mean absolute error (MAE) represents the magnitude of the average absolute error. Mathematically,
M A E = 1 n k = 0 n | e k |
F1 denotes the weighted average of recall and precision. It should be noted that a higher value of F1-score does not guarantee that the classifier is performing well. Rather, it depends upon the circumstances.
In this section, the performance of ten different classifiers has been examined in classifying the instance of ICICI Bank’s stock data. Table 2, Table 3, Table 4, Table 5, Table 6, Table 7, Table 8, Table 9, Table 10 and Table 11 representthe values of different metrics like FP, TP, TN, and FN, along with the number of correctly and incorrectly classified instances, accuracy, precision, recall, and an F1-score of different supervised classifiers in analyzing the data set of ICICI Bank’s stock. From Table 2, Table 3, Table 4, Table 5, Table 6, Table 7, Table 8, Table 9, Table 10 and Table 11, it is observed that rates of classification of naïve Bayes; C4.5; random forest; logistic regression; linear discriminant; and linear, quadratic, cubic, fine and medium Gaussian support vector machines lie between 47.6% and 48.9%, 53.6% and 53.6%, 53.0% and 53.6%, 99.7% and 99.8%, 53.6% and 53.6%, 98.7% and 99.8%, 91.0% and 93.9%, 75.0% and 91.7%, 78.2% and 79.9%, and 69.6% and 72.4%, respectively. To precisely examine the performance of different classifiers, the K-fold cross-validation mechanism was used. In K-fold validation, initially, the data have to be decomposed into K mutually exclusive equal sized folds or subsets. In 5-fold, the data are decomposed into giving subsets also known as folds (F1, F2, F3, F4, and F5). Testing and training are carried out five times. In the first iteration, the fold F1 acts as the test set and the remaining four subsets as training sets. Similarly, in the second iteration, F2 acts as testing and the remaining subgroups are used for drilling. The process is repeated five times. The data were mined by varying the folds from 5 to 10.
The experimental analysis shows that logistic regression, followed by linear SVM, was found to be best suited as a classifier for ICICI Bank’s stock analysis. NB, C4.5, RF, LD, and CSVM merely act as a random guessing machine. The rate of accuracy achieved using logistic regression lies in between 99.7% and 99.8%. Moreover, this classifier had a higher rate of precision, as well as recall. It was found that naïve Bayes seems to merely guessing machine, as it has the lowest rate of accuracy among all the classifiers. The rate of classification in classifying correct and incorrect instances using naïve Bayes was found to be 47.6% and 48.9%, respectively. In addition, when precision was considered, C4.5 seemed to be the best classifier.
The value of precision accomplished using six to ten cross-fold remained constant and, surprisingly, was 100%. However, this classifier utterly failed to classify true negative cases. Additionally, the rate of identifying false negative cases using naïve Bayes was extremely high. Like accuracy, logistic regression also showed outstanding performance as far as F1 values were concerned.
The rates of correctly and incorrectly classified instances achieved using different classifiers are depicted in Figure 5.
Figure 6 depicts the rate of misclassification of different classifiers. It is observed that naïve Bayes had the highest rate of misclassification, whereas logistic regression and linear SVM were found to have the lowest misclassification rate.
Additinally, the analysis of sensitivty, specificity, F1 score and recall has been presntedin Figure 7.

4.2. Ranking Using MCD Techniques

Table 12 represents the summarized performance of different classifiers in classifying ICICI Bank’s stock data. It represents a multi-criterion decision problem with ten different approaches having seven different performance criterions. This table has been created from Table 4 by taking the best possible value from different cross folds.
This MCD problem has been solved using two different statistical techniques, called TOPSIS (technique for order preference by similarity to ideal solution) and WSA (weighted sum approach) [51,52]. The ranking of different approaches based upon seven different criterions is presented in Table 13.
The working of the WSA method is based on the utility maximization principle. It helps in finding the ranks of the alternatives on the basis of their total utility by considering all the chosen criteria. In TOPSIS, di+ and di represent the distance of ideal and basal variants. Here, Hj and Dj are the maximum or minimum values corresponding to the ideal or basal distances.
di + = j = 1 r ( W i j H j ) 2
di = j = 1 r ( W i j D j ) 2
Finally, the relative closeness to the ideal solution Ci is calculated as mentioned below:
Ci = di/(di+) + (di)
In order to get the real picture of predicted rate of return, the ICICI stock data were also predicted using linear and multiple regression. Table 14 represents the difference between the rate of actual and predicted return value obtained using both linear and multiple regression. Here, the rate of return was computed for the month of February 2018. The buy-and-hold time was fixed at one month.
From Table 14, it was found that the results obtained using linear regression were more precise when compared with results obtained using multiple regression, as the difference between actual and predicted rate of return was very small for linear regression.

5. Conclusions

ICICI Bank’s stock was substantially examined using different statistical and supervised learning techniques. The large negative variation observed in five years (2008, 2011, 2015, 2016, and 2017) indicates that in these years, a momentous intraday loss was recorded. A negatively skewed representation indicates that the distribution curve is platy curtic and more flat in nature. The lowest minimum and maximum opening values were marked in 2009. Therefore, it seems that the long-term investors who invested their money in this year must have achieved a good rate of return. The year 2018 represented a sound state of ICICI Bank’s stock as the maximum opening value of Rs. 360.8 was achieved in this year. Therefore, this year should not be seen as a year of investment. This study can be extended to predict the daily, weekly, and monthly future values of ICICI Bank’s stock. Furthermore, it was observed that rates of classification of naïve Bayes; C4.5; random forest; logistic regression; linear discriminant; and linear, quadratic, cubic, fine, and medium Gaussian support vector machines lie between 47.6% and 48.9%, 53.6% and 53.6%, 53.0% and 53.6%, 99.7% and 99.8%, 53.6% and 53.6%, 98.7% and 99.8%, 91.0% and 93.9%, 75.0% and 91.7%, 78.2% and 79.9%, and 69.6% and 72.4%, respectively. The performance of logistic regression was outstanding when compared with other classifiers and this was validated using two different multi-criterion decision problem techniques, namely TOPSIS and WSA The rank generated using TOPSIS and WSA verified the outstanding performance of logistic regression. In addition to this, the average values of major attribute (open, close, low, and high) lie between 198.43 to 204.79. Moreover, based upon the performance of difference classifiers, an innovative and novel ensemble-based classifier can be designed. In linear and multiple regression, as far as the rate of return is concerned, the results produced using linear regression are better than the results obtained using multiple regression.

Author Contributions

Conceptualization, M.S. and S.S.; Methodology, M.S., S.S.; Software, M.S.; Validation, M.S., G.S.; Formal Analysis, M.S.; Investigation, M.S., S.S. and G.S.; Resources, M.S.; Data Curation, M.S.; Writing-Original Draft Preparation, M.S.; Writing-Review & Editing, M.S., S.S. and G.S; Visualization, M.S.; Supervision, G.S.; Project Administration, M.S., G.S.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Sharma, R. ICICI Bank Equity Research. 22 January 2016. Available online: https://www.sanasecurities.com/icici-bank-equity-research (accessed on 20 September 2018).
  2. IANS. SBI India’s Most Trusted Bank, ICICI Top in Private Sector: Report. 19 April 2018. Available online: https://economictimes.indiatimes.com/industry/banking/finance/banking/sbi-indias-most-trusted-bank-icici-tops-in-private-sector-report/articleshow/63818576.cms (accessed on 20 September 2018).
  3. Tsai, C.; Lai, C.; Chao, H.; Vasilakos, A.V. Big data analytics: A survey. J. Big Data 2015, 2, 1–32. [Google Scholar] [CrossRef]
  4. Kirkos, E.; Spathis, C.; Manolopoulos, Y. Data mining techniques for the detection of fraudulent financial statements. Expert Syst. Appl. 2007, 32, 995–1003. [Google Scholar] [CrossRef]
  5. Han, J.; Kamber, M.; Pei, J. Data Mining Concepts and Techniques; Morgan Kauffmann Publishers: Burlington, MA, USA, 2015. [Google Scholar]
  6. Kaur, P.; Sharma, M. Analysis of Data Mining and Soft Computing Techniques in Prospecting Diabetes Disorder in Human Beings: A Review. Int. J. Pharm. Sci. Res. 2018, 9, 2700–2719. [Google Scholar]
  7. Rajesh, D. Application of spatial data mining for agriculture. Int. J. Comput. Appl. 2011, 15, 7–9. [Google Scholar] [CrossRef]
  8. Bhargavi, P.; Jyothi, S. Applying naive Bayes data mining technique for classification of agricultural land soils. Int. J. Comput. Sci. Netw. Secur. 2009, 9, 117–122. [Google Scholar]
  9. Liao, S.-H.; Chu, P.-H.; Hsiao, P.-Y. Data mining techniques and applications—A decade review from 2000 to 2011. Expert Syst. Appl. 2012, 39, 11303–11311. [Google Scholar] [CrossRef]
  10. Kadam, S.; Raval, M. Data Mining in Finance. Int. J. Eng. Trends Technol. 2014, 16, 377–381. [Google Scholar] [CrossRef]
  11. Enke, D.; Thawornwong, S. The use of data mining and neural networks for forecasting stock market returns. Expert Syst. Appl. 2005, 29, 927–940. [Google Scholar] [CrossRef]
  12. Fu, T.-C. A review on time series data mining. Eng. Appl. Artif. Intell. 2011, 24, 164–181. [Google Scholar] [CrossRef]
  13. Yoo, I.; Alafaireet, P.; Marinov, M.; Pena-Hernandez, K.; Gopidi, R.; Chang, J.F.; Hua, L. Data mining in healthcare and biomedicine: A survey of the literature. J. Med. Syst. 2012, 36, 2431–2448. [Google Scholar] [CrossRef] [PubMed]
  14. Huang, M.-J.; Chen, M.-Y.; Lee, S.-C. Integrating data mining with the case-based reasoning for chronic diseases prognosis and diagnosis. Expert Syst. Appl. 2007, 32, 856–867. [Google Scholar] [CrossRef]
  15. Aljumah, A.A.; Ahamad, M.G.; Siddiqui, M.K. Application of data mining: Diabetes health care in young and old patients. J. King Saud Univ.-Comput. Inf. Sci. 2013, 25, 127–136. [Google Scholar] [CrossRef]
  16. Sharma, M.; Singh, G.; Singh, R. Stark Assessment of Lifestyle Based Human Disorders Using Data Mining Based Learning Techniques. IRBM 2017, 38, 305–324. [Google Scholar] [CrossRef]
  17. Sharma, M.; Singh, G.; Singh, R. An Advanced Conceptual Diagnostic Healthcare Framework for Diabetes and Cardiovascular Disorders. EAI Endorsed Trans. Scalable Inf. Syst. 2018, 5, 1–11. [Google Scholar] [CrossRef]
  18. Yang, Y.; Adelstein, S.J.; Kassis, A.I. Target discovery from data mining approaches. Drug Discov. Today 2012, 14, 147–154. [Google Scholar] [CrossRef] [PubMed]
  19. Ananiadou, S.; Kell, D.B.; Tsujii, J. Text mining and its potential applications in systems biology. Trends Biotechnol. 2006, 24, 571–579. [Google Scholar] [CrossRef] [PubMed]
  20. Chandralekha, M.; Shenbagavadivu, N. Performance Analysis of Various Machine Learning Techniques to Predict Cardiovascular Disease: An Emprical Study. Appl. Math. Inf. Sci. 2018, 12, 217–226. [Google Scholar] [CrossRef]
  21. Manjula, C.; Muniyal, B.B. Performance Evaluation of Supervised Machine Learning Algorithms for Intrusion Detection. Procedia Comput. Sci. 2016, 89, 117–123. [Google Scholar]
  22. Sangeeta, M. ICICI Bank: A Multivariate Analysis of Customer’s Acceptability. Glob. J. Manag. Bus. Res. 2011, 11, 1–9. [Google Scholar]
  23. Pooja, R. A Study of Financial Performance: A Comparative Analysis of AXIS and ICICI Bank. Int. J. Multidiscipl. Res. Dev. 2017, 4, 12–20. [Google Scholar]
  24. Patel, J.; Shah, S.; Thakkar, P.; Kotecha, K. Predicting stock and stock price index movement using Trend Deterministic Data Preparation and machine learning techniques. Expert Syst. Appl. 2015, 42, 259–268. [Google Scholar] [CrossRef]
  25. Al-Radaideh, Q.I.; Assaf, A.A.; Alnagi, E. Predicting Stock Price Using Data Mining Technique. In Proceedings of the International Arab Conference on Information Technology (ACIT’2013), Katumu, Sudan, 17–19 December 2013; pp. 1–8. [Google Scholar]
  26. Özorhan, M.O.; Toroslu, I.H.; Tolga, O.; Glu, S. A strength-biased prediction model for forecasting exchange rates using support vector machines and genetic algorithms. Soft Comput. 2017, 21, 6653–6671. [Google Scholar] [CrossRef]
  27. Khedr, A.E.; Salama, S.E.; Yaseen, N. Predicting Stock Market Behavior using Data Mining Technique and News Sentiment Analysis. Int. J. Intell. Syst. Appl. 2017, 7, 22–30. [Google Scholar]
  28. Desai, R.; Gandhi, S. Stock Market Prediction Using Data Mining. Int. J. Eng. Dev. Res. 2014, 2, 2780–2784. [Google Scholar]
  29. Zhao, L.; Wang, L. Price Trend Prediction of Stock Market Using Outlier Data Mining Algorithm. In Proceedings of the IEEE Fifth International Conference on Big Data and Cloud Computing, Dalian, China, 26–28 August 2015. [Google Scholar]
  30. Bini, B.S.; Mathew, T. Clustering and Regression Techniques for Stock Prediction. Procedia Technol. 2016, 24, 1248–1255. [Google Scholar] [CrossRef]
  31. Huang, Y.; Gang, K. A kernel entropy manifold learning approach for financial data analysis. Decis. Support Syst. 2014, 64, 31–42. [Google Scholar] [CrossRef]
  32. Ye, M.; Li, G. Internet big data and capital markets: A literature review. Financ. Innov. 2017, 3, 1–18. [Google Scholar] [CrossRef]
  33. Khashei, M.; Hajirahimi, Z. Performance evaluation of series and parallel strategies for financial time series forecasting. Financ. Innov. 2017, 3, 1–24. [Google Scholar] [CrossRef]
  34. Nayak, S.C.; Misra, B.B. Estimating stock closing indices using a GA-weighted condensed polynomial neural network. Financ. Innov. 2018, 4, 1–21. [Google Scholar] [CrossRef]
  35. Yan, F.; Robert, M.; Li, Y. Statistical methods and common problems in medical or biomedical science research. Int. J. Physiol. Pathophysiol. Pharmacol. 2017, 9, 157–163. [Google Scholar] [PubMed]
  36. Du Prel, J.-B.; Röhrig, B.; Blettner, M. Statistical Methods in Medical Research; Deutsches Ärzteblatt International: Berlin, Germany, 2009; Volume 106, p. 99. [Google Scholar]
  37. Zhan, W.; Fink, R.; Fang, A. Application of Statistics in Engineering Technology Programs. Am. J. Eng. Educ. 2010, 1, 65–78. [Google Scholar] [CrossRef]
  38. Hamada, R.; Patell, J.M.; Staelin, R.; Wecker, W.E. The Role of Statistics in Accounting, Marketing, Finance, and Production. J. Bus. Econ. Stat. 1988, 6, 261–272. [Google Scholar]
  39. Buenestado, P.; Acho, L. Image Segmentation Based on statistical confidence Intervals. Entropy 2018, 20, 46. [Google Scholar] [CrossRef]
  40. Gillian, B. A Statistical Primer: Understanding Descriptive and Inferential Statistics. Evid. Based Lib. Inf. Pract. 2007, 2, 32–47. [Google Scholar] [Green Version]
  41. Du, H. Data Mining Techniques and Applications—An Introduction, 1st ed.; Cengage Learning: Delhi, India, 2013. [Google Scholar]
  42. Angelo, G.D.; Rampone, S.; Palmieri, F. Developing a trust model for pervasive computing based on Apriori association rules learning and Bayesian classification. Soft Comput. 2017, 21, 6297–6315. [Google Scholar]
  43. Lin, S.W.; Chen, S.C. Parameter determination and feature selection for the C4.5 algorithm using scatter search approach. Soft Comput. 2011, 16, 63–75. [Google Scholar] [CrossRef]
  44. Sharma, S.; Aggarwal, J.; Sharma, S. Classification through Machine Learning Technique: C4.5 Algorithm based on Various Entropies. Int. J. Comput. Appl. 2013, 82, 20–27. [Google Scholar]
  45. Maragoudakis, M.; Serpanos, D. Towards Stock Market Data Mining Using Enriched Random Forests from Textual Resources and Technical Indicators. IFIP Adv. Inf. Commun. Technol. 2010, 339, 278–286. [Google Scholar] [Green Version]
  46. Chen, F.H.; Howard, H. An alternative model for the analysis of detecting electronic industries earnings management using stepwise regression, random forest, and decision tree. Soft Comput. 2015, 20, 1945–1960. [Google Scholar] [CrossRef]
  47. Huang, W.; Nakamori, Y.; Wang, S.Y. Forecasting stock market movement direction with support vector machine. Comput. Oper. Res. 2005, 32, 2513–2522. [Google Scholar] [CrossRef]
  48. Larose, D.T.; Larose, C.D. Discovering Knowledge in Data: An Introduction to Data Mining, 2nd ed.; Wiley Publishers: Delhi, India, 2016. [Google Scholar]
  49. Banu, G.R. Predicting Thyroid Disease using Linear Discriminant Analysis (LDA) Data Mining Technique. Commun. Appl. Electron. (CAE) 2016, 4, 4–6. [Google Scholar]
  50. Maroco, J.; Silva, D.; Rodrigues, A.; Guerreiro, M.; Santana, I.; de Mendonça, A. Data mining methods in the prediction of Dementia: A real-data comparison of the accuracy, sensitivity and specificity of LDA, logistic regression, neural networks, SVM, classification trees and random forests. BMC Res. Notes 2011, 4, 1–14. [Google Scholar] [CrossRef] [PubMed]
  51. Krohling, R.A.; Pacheco, A.G.C. A-TOPSIS—An Approach Based on TOPSIS for Ranking Evolutionary Algorithms. Procedia Comput. Sci. 2015, 55, 308–317. [Google Scholar] [CrossRef]
  52. Kolios, A.; Mytilinou, V.; Lozano-Minguez, E.; Salonitis, K.A. Comparative Study of Multiple-Criteria Decision-Making Methods under Stochastic Inputs. Energies 2016, 9, 566. [Google Scholar] [CrossRef]
Figure 1. Key figures of ICICI Bank’s stock. FY—financial year.
Figure 1. Key figures of ICICI Bank’s stock. FY—financial year.
Data 03 00054 g001
Figure 2. ICICI Bank’s stock attributes.
Figure 2. ICICI Bank’s stock attributes.
Data 03 00054 g002
Figure 3. Daily percentage change.
Figure 3. Daily percentage change.
Data 03 00054 g003
Figure 4. Summary of variation in high–low value of ICICI Bank’s stock.
Figure 4. Summary of variation in high–low value of ICICI Bank’s stock.
Data 03 00054 g004
Figure 5. Number of correctly classified instances using different classifiers.
Figure 5. Number of correctly classified instances using different classifiers.
Data 03 00054 g005
Figure 6. Number of correctly classified instances using different classifiers. NB—naïve bayes; RF—random forest; LR—logistic regression; LDA—linear discriminant analysis; LSVM—linear support vector machine; QSVM—quadratic SVM; CSVM—cubic SVM; FGSVM—fine Gaussian SVM; MGSVM—medium GSVM.
Figure 6. Number of correctly classified instances using different classifiers. NB—naïve bayes; RF—random forest; LR—logistic regression; LDA—linear discriminant analysis; LSVM—linear support vector machine; QSVM—quadratic SVM; CSVM—cubic SVM; FGSVM—fine Gaussian SVM; MGSVM—medium GSVM.
Data 03 00054 g006
Figure 7. Analysis of sensitivity, specificity, F1, and recall of different classifiers.
Figure 7. Analysis of sensitivity, specificity, F1, and recall of different classifiers.
Data 03 00054 g007
Table 1. Descriptive statistical measures of ICICI Bank’s Stock.
Table 1. Descriptive statistical measures of ICICI Bank’s Stock.
AttributesMeanStd. DevVarianceSkewnessKurtosisp-ValueA-Squared95% Confidence Interval (Mean)
Open201.8261.353763.330.09−0.320.00515.29199.50–204.13
Close201.5461.323760.470.09−0.310.00515.31199.23–203.85
Low198.4361.093731.520.08−0.310.00515.06196.12–200.73
High204.7961.573790.440.1−0.320.00515.43202.47–207.11
Table 2. Performance analysis of naïve Bayes.TP—true positive; TN—true negative; FP—false positive; FN—false negative.
Table 2. Performance analysis of naïve Bayes.TP—true positive; TN—true negative; FP—false positive; FN—false negative.
FoldsTPTNFPFNCorrectly ClassifiedIncorrectly ClassifiedAccuracyPrecision
543787210183871309140548.2330.03436
642886710273921295141947.7129.41581
74618639943961324139048.7831.68385
845586510003941320139448.6331.27148
944584910104101294142047.6730.58419
104578729983871329138548.9631.40893
Table 3. Performance analysis of C4.5.
Table 3. Performance analysis of C4.5.
FoldsTPTNFPFNCorrectly ClassifiedIncorrectly ClassifiedAccuracyPrecision
514550012591455125953.61091100
614550012591455125953.61091100
714550012591455125953.61091100
814550012591455125953.61091100
914550012591455125953.61091100
1014550012591455125953.61091100
Table 4. Performance analysis of random forest.
Table 4. Performance analysis of random forest.
FoldsTPTNFPFNCorrectly ClassifiedIncorrectly ClassifiedAccuracyPrecision
51410304512291440127453.0582296.90722
61407474812121454126053.5740696.70103
71413424212171455125953.6109197.1134
81424283112311452125953.5003797.86942
91425183012411443125953.1687597.93814
101413394212201452125953.5003797.1134
Table 5. Performance analysis of logistic regression.
Table 5. Performance analysis of logistic regression.
FoldsTPTNFPFNCorrectly ClassifiedIncorrectly ClassifiedAccuracyPrecision
514441256332700699.7782799.79267
614451258212703399.8891499.86178
714421258512700699.7782799.65446
814451257222702499.8521899.86178
914451258212703399.8891499.86178
1014441256332700699.7782799.79267
Table 6. Performanceanalysis of linear discriminant.
Table 6. Performanceanalysis of linear discriminant.
FoldsTPTNFPFNCorrectly ClassifiedIncorrectly ClassifiedAccuracyPrecision
510743813668931455127453.6109174.58333
610703853658941455127953.6109174.56446
710893663818781455124453.6109174.08163
810623933688911455128453.6109174.26573
910803753698901455126553.6109174.53416
1010723833758841455126753.6109174.08431
Table 7. Performance analysis of linear support vector machine (SVM).
Table 7. Performance analysis of linear support vector machine (SVM).
FoldsTPTNFPFNCorrectly ClassifiedIncorrectly ClassifiedAccuracyPrecision
51437125318626902499.115798.76289
61427125228726793598.7103998.0756
71436125319626892599.0788598.69416
81431125224726833198.8577798.35052
91437125018926872799.0051698.76289
101431125624326872799.0051698.35052
Table 8. Performance analysis of quadratic SVM.
Table 8. Performance analysis of quadratic SVM.
FoldsTPTNFPFNCorrectly ClassifiedIncorrectly ClassifiedAccuracyPrecision
5137711727887254916593.9204194.63918
61346116810991251420092.630892.50859
7136211849375254616893.8098793.60825
81403108252177248522991.5622796.42612
91360113395126249322191.8570493.47079
1013491121138106247024491.0095890.71957
Table 9. Performance analysis of cubic SVM.
Table 9. Performance analysis of cubic SVM.
FoldsTPTNFPFNCorrectly ClassifiedIncorrectly ClassifiedAccuracyPrecision
59671070488189203767775.0552766.46048
61247120120858244826690.1989785.70447
71383110672153248922591.7096595.05155
81182118727372236934587.2881481.23711
91245953210306219851680.9874785.56701
1012341127221132236135386.9933784.811
Table 10. Performance analysis of fine Gaussian SVM.
Table 10. Performance analysis of fine Gaussian SVM.
FoldsTPTNFPFNCorrectly ClassifiedIncorrectly ClassifiedAccuracyPrecision
51246877209382212359178.2240285.63574
61244907211352215156379.2557185.49828
71244892211367213657878.7030285.49828
81254917201342217154379.9926386.18557
91261909194350217054479.9557886.66667
101254913201346216754779.8452586.18557
Table 11. Performance analysis of medium Gaussian SVM.
Table 11. Performance analysis of medium Gaussian SVM.
FoldsTPTNFPFNCorrectly ClassifiedIncorrectly ClassifiedAccuracyPrecision
5138351572744189881669.9336895.05155
61353538102721189182369.6757692.98969
7136356392696192678870.9653693.67698
8137558280677195775772.1075994.50172
9137858777672196574972.4023694.7079
10137159384666196475072.3655194.2268
Table 12. Summarized results of Table 2, Table 3, Table 4, Table 5, Table 6, Table 7, Table 8, Table 9, Table 10 and Table 11. LOG REG—logistic regression; LD—linear discriminant; LSVM—linear SVM; QSVM—quadratic SVM; CSVM—cubic SVM; FGSVM—fine Gaussian SVM; MGSVM—medium GSVM.
Table 12. Summarized results of Table 2, Table 3, Table 4, Table 5, Table 6, Table 7, Table 8, Table 9, Table 10 and Table 11. LOG REG—logistic regression; LD—linear discriminant; LSVM—linear SVM; QSVM—quadratic SVM; CSVM—cubic SVM; FGSVM—fine Gaussian SVM; MGSVM—medium GSVM.
Mining ApproachAccuracyPrecisionMisclassification RateSensitivitySpecificityRecallF1 Score
Naïve bayes48.9683131.6838552.3216.9937.8454.1469239.87889
C4.553.6109110046.3953.61053.6109169.80091
Random Forest53.6109197.9381446.9452.511.7753.7262469.2944
LOG REG99.8891499.861780.2253.240.1899.9308499.8963
LD53.6109174.5833346.3940.1314.0455.363563.36922
LSVM99.115798.762891.2952.951.0399.7907999.17184
QSVM93.9204196.426128.9951.695.0894.7807994.34738
CSVM91.7096595.0515524.9450.9617.9895.5555692.47743
FGSVM79.9926386.6666721.7846.467.7778.5714382.25701
MGSVM72.4023695.0515530.3250.963.7667.3048678.63053
WEIGHT0.142860.142860.142860.142860.142860.142860.14286
Table 13. Ranking of different classification approaches using the weighted sum approach (WSA) and the technique for order preference by similarity to ideal solution (TOPSIS).
Table 13. Ranking of different classification approaches using the weighted sum approach (WSA) and the technique for order preference by similarity to ideal solution (TOPSIS).
ApproachWSATOPSIS
Logistic Regression11
Linear SVM22
Quadratic SVM33
Cubic SVM45
Fine Gaussian SVM54
Medium Gaussian SVM66
C4.577
Random Forest88
Linear Discriminant99
Naïve Bayes1010
Table 14. Difference between actual and predicted rate of return.
Table 14. Difference between actual and predicted rate of return.
Multiple RegressionLinear Regression
2.71−0.01
0.09−0.01
0.84−0.01
7.140.00
0.09−0.01
0.27−0.01
0.840.00
−0.03−0.01
0.24−0.01
0.020.00
−2.030.00
−3.270.00
−1.790.00
−0.340.01
−1.310.01
1.330.01
−2.850.01
−0.350.01
−2.550.01

Share and Cite

MDPI and ACS Style

Sharma, M.; Sharma, S.; Singh, G. Performance Analysis of Statistical and Supervised Learning Techniques in Stock Data Mining. Data 2018, 3, 54. https://doi.org/10.3390/data3040054

AMA Style

Sharma M, Sharma S, Singh G. Performance Analysis of Statistical and Supervised Learning Techniques in Stock Data Mining. Data. 2018; 3(4):54. https://doi.org/10.3390/data3040054

Chicago/Turabian Style

Sharma, Manik, Samriti Sharma, and Gurvinder Singh. 2018. "Performance Analysis of Statistical and Supervised Learning Techniques in Stock Data Mining" Data 3, no. 4: 54. https://doi.org/10.3390/data3040054

Article Metrics

Back to TopTop