Next Article in Journal
A Discrete Cramér–Von Mises Statistic Related to Hahn Polynomials with Application to Goodness-of-Fit Testing for Hypergeometric Distributions
Previous Article in Journal
Bivariate Random Coefficient Integer-Valued Autoregressive Model Based on a ρ-Thinning Operator
Previous Article in Special Issue
An Intuitionistic Fuzzy Multi-Criteria Approach for Prioritizing Failures That Cause Overproduction: A Case Study in Process Manufacturing
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A New Hybrid Approach for Clustering, Classification, and Prediction of World Development Indicators Combining General Type-2 Fuzzy Systems and Neural Networks

by
Martha Ramírez
,
Patricia Melin
and
Oscar Castillo
*
Tijuana Institute of Technology, Tecnologico Nacional de Mexico (TecNM), Calzada Tecnologico, S/N, Tijuana 22379, Mexico
*
Author to whom correspondence should be addressed.
Axioms 2024, 13(6), 368; https://doi.org/10.3390/axioms13060368
Submission received: 16 April 2024 / Revised: 23 May 2024 / Accepted: 27 May 2024 / Published: 30 May 2024

Abstract

:
Economic risk is a probability that measures the possible alterations, as well as the uncertainty, generated by multiple internal or external factors. Sometimes it could cause the impossibility of guaranteeing the level of compliance with organizational goals and objectives, which is why for their administration they are frequently divided into multiple categories according to their consequences and impact. Global indicators are dynamic and sometimes the correlation is uncertain because they depend largely on a combination of economic, social, and environmental factors. Thus, our proposal consists of a model for prediction and classification of multivariate risk factors such as birth rate and population growth, among others, using multiple neural networks and General Type-2 fuzzy systems. The contribution is the proposal to integrate multiple variables of several time series using both supervised and unsupervised neural networks, and a generalized Type-2 fuzzy integration. Results show the advantages of utilizing the method for the fuzzy integration of multiple time series attributes, with which the user can then prevent future threats from the global environment that impact the scheduled compliance process.

1. Introduction

For reasons of security and logical access to data, in organizations, users have access to the essential information to carry out work. Also, we face the challenge of integrating general information from different sources, of which the historical detail is protected by the owners of the corresponding information.
As regards the analysis of time series composed of indicators or criteria, we could point out that most of these data represent the integration of multiple variables and classifications made by experts in the field when it comes to analyzing multiple time series [1,2,3].
Related to the above, risk management contemplates economic, environmental, and human factors, among others, the latter being the one that has constantly attracted the attention of organizations in recent decades, given that a person has logical or physical access to an information system and may enter, alter, or share sensitive information with third parties, which may result in losses of various types [4,5,6].
Likewise, another approach contemplated by risk management around the human factor is decision making, since if the person responsible for deciding lacks complete, relevant, and timely information or is unfocused due to internal or external factors, it could cause an inappropriate decision to be made, which is reflected in losses of various types.
As part of the strategies for risk management, programs for risk prevention and response are carried out in organizations, investments are made in computer security tools and equipment, and institutional guidelines and policies are disseminated in the organization [7,8,9].
For example, as part of these continuous improvement programs, new models are constantly sought that adjust to these needs that arise from the growing uncertainty and changes in the environment, which provide a way to balance and share responsibility in decision making through the integration of indicators from different sources and adaptability in the midst of uncertainty.
Contemplating this aspect of risk management with a focus on the human factor, we present a model for clustering, classification, and prediction of indicators using intelligent computing methods that have proven to be effective in solving complex problems [10,11,12], primarily supervised [13,14] and unsupervised [15,16] neural networks (NNs) and Type-1 and Type-2 fuzzy inference systems [17,18].
One of the advantages of this method is that it is possible to combine artificial neural network models and use sets of fuzzy systems to perform classification, clustering, and time series prediction by working or forming segments of information grouped by similar attributes.
This approach differs from most existing intelligent computational methods [12,19] in that to carry out the clustering, classification, and time series prediction, it focuses on combining supervised and unsupervised algorithms to carry out the training of the neural networks.
In addition to the previous point, the model contemplates uncertainty management for decision making and the integration of results utilizing fuzzy systems to carry out the classification and integration of the obtained results. It allows us to obtain results for one or multiple variables.
Thus, the contribution of the model contemplates the combination of different types of NNs to perform clustering and prediction of multiple time series and subsequently use different levels of Type-1, Interval Type-2, and General Type-2 fuzzy systems as integrators of multiple results to finally obtain a general classification.
This paper is structured as follows. In Section 2, basic concepts are presented. The problem at hand is outlined in Section 3. The methodology used is outlined in Section 4. The experiments and results are contained in Section 5 and Section 6, respectively. Lastly, in Section 7, the conclusions are offered.

2. Basic Concepts

In this section, a theoretical summary of the methods used to design the proposed model, focusing on the general concepts of neural networks and fuzzy systems to address intelligent computing techniques as bioinspired methods is presented.

2.1. Neural Networks

The prediction of time series behavior using artificial neural networks (ANNs) has been extensively investigated because they learn based on non-linear relationships between the inputs available and the desired outputs and their great capacity for pattern recognition.
Although ANNs are a powerful tool for processing an infinity of data, their success has been demonstrated in applications from different areas of knowledge [20,21]. Today, we can find different applications that consider ANNs to solve different problems in which they have been proven to be effective and precise [22].
For the case where the algorithm uses input and output data as a way to carry out training, we can point out that it is a supervised neural network model [23,24,25], unlike unsupervised neural network models [26], where only input data are used to form clusters that represent characteristics of the data through classes [27].

2.2. Type-2 Fuzzy Systems

A fuzzy system is composed of a knowledge base represented by fuzzy rules, a database that stores the parameters and specifications of the membership functions, and a mechanism that simulates reasoning.
In general terms about the theory of fuzzy logic, we can point out that its basic definitions apply to Type-1 and Type-2 fuzzy sets. A Type-2 fuzzy system is integrated with fuzzy if–then rules and membership functions where the antecedent or consequent has Type-2 fuzzy sets that are composed of Type-1 fuzzy sets [27].
It is a generalization of Type-1 fuzzy logic since, in addition to considering the uncertainty in the linguistic variables, this uncertainty is also considered in the definition of the membership functions [28].
A General Type-2 fuzzy set A is formed by a primary variable x with domain X and a secondary variable u with domain Jx, and it can be formulated in (1):
A = x , u , u A x , u |   x X , u J x ,     J x ,   0,1  
The Footprint of Uncertainty (FOU) is mathematically expressed in (2):
F O U A = x , u |   x X   a n d   u μ ¯ A   x ,   μ ¯ A x  
where μ ¯ A   x   and   μ ¯ A x are the lower and upper membership functions, respectively.
Now, in an Interval Type-2 Mamdani Fuzzy Inference System, a process like that of a Type-1 is carried out; the main difference is the activation forces of the upper and lower rules, as mathematically expressed in (3):
R l   : I F   x 1     i s   F 1 l   a n d a n d   x p   i s   F p l   T H E N   y   i s   G l
where l = 1, …, M.

3. Problem Description

The World Development Indicators (WDI) are the World Bank’s compilation of cross-country indicators. It is a historical statistical set of significance and is focused on global development and monitoring the level of poverty. During its compilation, different internationally recognized sources are used. Therefore, they represent the most up-to-date and accurate global development data available.
The persistence and constant analysis of indicators and criteria worldwide seek to make improvements in institutional aspects, which, due to their origin, tend to change or modify slowly but their impact has broad coverage.
So, our approach is to achieve an integration of results derived from the use of neural networks and be able to compare each indicator evaluation process for the corresponding fuzzy classification. In addition, the management of uncertainty in decision making is based on the integration carried out and the combination of WDI variables [29,30].
Moreover, based on the behavior of multiple economic and non-economic variables during a given period, we will be able to identify key aspects in which improvement is viable.
Thus, to get the overview, the next thing is to combine the results of the neural networks by using several Type-1 and Type-2 Fuzzy Inference Systems (FIS) as integrators [18]. After, we make comparisons, with which it will be possible to analyze economic progress, stagnation, and setbacks on a given date.
In this case study, we are referring to a sample of 208 countries, which present similarities and contrasts. Also, we selected twelve datasets for each country. In Table 1, the list of the variables (time series) that were considered for clustering and prediction criteria in this work can be found, where the code, name, and period are shown for each variable. It should be noted that no preprocessing was carried out, and this is because it was a World Bank compilation of relevant, high-quality, and internationally comparable statistics about global development, which means that the data are ready to be used in this research.
For this case study, we use the classification of seven regions of the World Bank for the selected sample of countries (Table 2), where the code, name, and total countries are shown for each region.

4. Method

We propose a model for clustering, classification, and time series prediction that consists of two phases (Figure 1). In the first one, we use a non-linear autoregressive (NAR) neural network for prediction, a self-organizing map (SOM), and competitive neural networks for clustering into six classes.
Subsequently, in the second phase, we use different levels of Type-1, Interval Type-2, and General Type-2 fuzzy systems as integrators of multiple results to finally obtain a general classification.
So, we use six Type-1 fuzzy systems as integrators of each neural network’s results by task. After, we use seven Interval Type-2 fuzzy systems as an integrator of the results of Type-1 fuzzy systems.
Finally, we use a General Type-2 fuzzy inference system which operates as the final Interval Type-2 FIS integrator of the results with the idea of achieving the best global result when compared to Type-1 and Interval Type-2 FIS results.
Both Type-1 and Type-2 fuzzy inference systems employed to aggregate the artificial neural networks are formed by two to three inputs and one output. They are Mamdani type, from nine to twenty-seven rules, and centroid defuzzification.
For the Type-1, Interval Type-2, and General Type-2 fuzzy systems (Figure 2), the linguistic values of each variable are Low (LWW), Medium (MDD), and High (HGG).
The membership function (MF) parameters were manually obtained. The utilized MFs are Gaussian and triangular.
In general, the fuzzy rules used are shown in Table 3 for the FIS with two inputs–one output, and in Table 4 for the FIS with three inputs–one output. Manual tests were carried out until this set of fuzzy rules was obtained.

5. Experimental Results

In this work, we performed 30 executions for each NN. Firstly, we present the results obtained from the clustering carried out using competitive neural networks and, subsequently, the results obtained using a SOM for all the variables.
For all regions, results obtained by using competitive neural networks are shown in Table 5 and Figure 3, where the total countries by each class (RC1C, RC2C, RC3C, RC4C, RC5C, and RC6C) are described.
Also, the results by the SOM are shown in Table 6 and Figure 4, where the total countries by each class (RC1S, RC2S, RC3S, RC4S, RC5S, and RC6S) are presented.
In a similar way to the two previous figures corresponding to the clustering results, for each of the regions, the obtained results are shown below for illustrative purposes in Figure 5, Figure 6 and Figure 7, where, for each of them, on the left side are the results of the competitive NN results and on the right side are those of the SOM. Also, the total number of countries corresponding to each class is visually indicated.
With the results of the competitive neural networks and the SOM, we formed the two inputs of a Type-1 fuzzy system, where once these two results were integrated, the final class of each of the variables per country was obtained. The accumulated elements per region are presented in Table 7.
Now, with the purpose of integrating the 12 classes previously integrated with the Type-1 fuzzy systems into 5 classes, we prepared the inputs for 5 Type-1 fuzzy systems, where there were 2 to 3 inputs and 1 output, as shown in Table 8.
Afterward, we integrated the 12 classes previously integrated into 5 classes, but here we used 2 to 3 inputs and 1 output variable in an Interval Type-2 fuzzy system, as shown in Table 9.
Then, we integrated the five results obtained using two intervals and two Generalized Type-2 FIS, with the purpose of obtaining two criteria, as shown in Table 10.
Below, in Table 11, we present the comparison of the results obtained using the Type-1 FIS and Interval Type-2 FIS, where we noticed that for the five integrators when the Type-1 FIS was used, many countries were labeled with R3 compared to when we used the Interval Type-2 FIS.
So, it was possible to obtain a better classification of the regions by separating the countries belonging to R2 and, also for the integrators IT2_R1 and IT2_R3, the number of countries corresponding to R1 increased.
In Table 12, we summarize the comparison of results with the use of the Interval Type-2 FIS and a Generalized Type-2 FIS. We noticed that better results were obtained by using the Generalized Type-2 FIS since it was possible to obtain countries belonging to R3 and vary the number of elements belonging to R1 and R2, compared to the Interval Type-2 FIS.
In the case of supervised neural networks, because good results were obtained in previous experimentation, we divided the original sequence of the time series into 70% of the dataset for training, 15% for validation, and 15% for testing.
It should be noted that the sequential order of each time series remained. Also, the relative percentage of Root Mean Square Error (%RMSE) was used to measure the prediction performance of each NN.
The results of the prediction of the future values of each variable were obtained using a NAR neural network and are shown below in Table 13.
We separated the data corresponding to R1 classified using the Generalized Type-2 fuzzy system, and the results of the prediction of the future values of each variable were obtained using a NAR neural network, as shown in Table 14.

6. Discussion of Results

We should highlight that by combining intelligent methods, it is possible to focus on using an unsupervised model as the first phase to identify similarities or patterns in the data, seeking to highlight key variables and as a second phase focus on predicting the future values of these variables, as well as focusing on the segments of an attribute for a given range, period, or geographic location.
Clustering results were obtained to form six groups or classes using two types of unsupervised neural networks, which showed slight differences in the groups formed. A Type-1 fuzzy integration was used to obtain a final label or class, based on the results mentioned above.
We also note that one of the advantages of the method is that it is possible to combine artificial neural network models and use sets of fuzzy systems to perform classification, clustering, and prediction. By working or forming segments of information grouped by similar attributes, it allows us to obtain specific results for one or multiple variables. In addition, our model contemplates uncertainty management for decision making and the integration of results through several fuzzy systems.
We conclude that the results show that it is possible to use General and Interval Type-2 fuzzy systems to integrate country indicators in a better way than with Type-1 fuzzy systems. This is because in these types of systems, the coverage of the membership functions considers to a greater extent the crossing of the lower and upper limits of each indicator, so the proximity to the next range or class is considered at the time of integration of the linguistic values. In other words, these Type-2 FIS can better manage the implicit uncertainty in the historical values of the selected sample of countries.

7. Conclusions

Simulation results demonstrate that it is possible to use General Type-2 fuzzy systems to integrate the obtained results through neural networks or create nested structures of fuzzy systems to perform a level integration. Moreover, the Interval Type-2 fuzzy systems presented good results when considering two or more variables in comparison with Type-1 fuzzy systems.
Then, it was shown that General Type-2 fuzzy systems presented better results than Interval Type-2 and Type-1 fuzzy systems when they acted as integrators of results.
Also, we observe that by using multiple Type-1 and Type-2 fuzzy systems it is possible to classify countries or indicators and it is also possible to integrate the obtained results using neural networks, always aiming to serve as a support tool in decision making.
As future work, we first consider selecting global datasets consisting of well-being indicators, both qualitative and quantitative, to perform tests of multiple fuzzy integration techniques. We also contemplate developing new case studies that consider optimization methods applied to fuzzy systems, particularly to optimize fuzzy rules and membership function parameters. It is also intended to enhance prediction results by employing intelligent hybrid techniques to perform classification and prediction tests.
In addition to the last point, we are hoping that by separating the information used by organizations based on the responsibilities of the people or areas involved in the preparation of reports for decision making, we can prevent or reduce the risk of significant weaknesses or deficiencies in the relevant processes.

Author Contributions

Conceptualization, M.R. and P.M.; methodology, P.M. and O.C.; software, M.R.; validation, M.R. and P.M.; formal analysis, P.M. and O.C.; investigation, M.R.; writing—original draft preparation, M.R. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Data Availability Statement

Data are contained within the article.

Acknowledgments

We acknowledge the support given by Tecnologico Nacional de Mexico.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Azzabi, L.; Azzabi, D.; Kobi, A. The Multi-Criteria Approach Decision. In The Multi-Criteria Approach for Decision Support; International Series in Operations Research & Management Science; Springer: Cham, Switzerland, 2020; Volume 300, pp. 1–23. [Google Scholar] [CrossRef]
  2. Zhao, S.; Dong, Y.; Martíne, L.; Pedrycz, W. Analysis of Ranking Consistency in Linguistic Multiple Attribute Decision Making: The Roles of Granularity and Decision Rules. IEEE Trans. Fuzzy Syst. 2022, 30, 2266–2278. [Google Scholar] [CrossRef]
  3. Morente-Molinera, J.; Wang, Y.; Gong, Z.A. Morfeq; R. Al-Hmouz; E. Herrera-Viedma. Reducing Criteria in Multicriteria Group Decision-Making Methods Using Hierarchical Clustering Methods and Fuzzy Ontologies. IEEE Trans. Fuzzy Syst. 2022, 30, 1585–1598. [Google Scholar] [CrossRef]
  4. Yao, J.; Lu, B.; Zhang, J. Multi-Step-Ahead Tool State Monitoring Using Clustering Feature-Based Recurrent Fuzzy Neural Networks. IEEE Access 2021, 9, 113443–113453. [Google Scholar] [CrossRef]
  5. Ziro, A.; Toibayeva, S.; Gnatyuk, S.; Imanbayev, A.; Iavich, M.; Zhaybergenova, Z. Research of the Information Security Audit System in Organizations. In Proceedings of the 2023 IEEE International Conference on Smart Information Systems and Technologies (SIST), Astana, Kazakhstan, 4–6 May 2023; pp. 440–444. [Google Scholar] [CrossRef]
  6. Alenazy, S.M.; Alenazy, R.M.; Ishaque, M. Governance of Information Security and Its Role in Reducing the Risk of Electronic Accounting Information System. In Proceedings of the 2023 1st International Conference on Advanced Innovations in Smart Cities (ICAISC), Jeddah, Saudi Arabia, 23–25 January 2023; pp. 1–5. [Google Scholar] [CrossRef]
  7. Singh, K.; Richa, P.D.; Chaturvedi, V.M.; Kumar, P.; Malik, S. Application of Internet of Things and Machine Learning in Improving Supply Chain Financial Risk Management System. In Proceedings of the 2023 2nd International Conference on Automation, Computing and Renewable Systems (ICACRS), Pudukkottai, India, 11–13 December 2023; pp. 1115–1121. [Google Scholar] [CrossRef]
  8. Guo, B.; Zhao, W.; Chen, P.; Zhang, C.; Sun, Z.; Feng, W. Research on the Application Risk of Computer Network Security Technology. In Proceedings of the 2023 International Conference on Networking, Informatics and Computing (ICNETIC), Palermo, Italy, 29–31 May 2023; pp. 36–39. [Google Scholar] [CrossRef]
  9. Li, W.; Di, L.; Zheng, T.; Zhang, J.; Yi, B. Research on design and optimization of shared data privacy protection scheme based on multi-party security computing. In Proceedings of the 2023 IEEE 6th International Conference on Information Systems and Computer Aided Education (ICISCAE), Dalian, China, 23–25 September 2023; pp. 306–309. [Google Scholar] [CrossRef]
  10. Dombi, J.; Csiszár, O. Introduction—Aggregation and Intelligent Decision. In Explainable Neural Networks Based on Fuzzy Logic and Multi-Criteria Decision Tools. Studies in Fuzziness and Soft Computing; Springer: Cham, Switzerland, 2021; Volume 408, pp. ix–xi. [Google Scholar] [CrossRef]
  11. Rahman, M.M.; Shakeri, M.; Khatun, F.; Tiong, S.K.; Alkahtani, A.A.; Samsudin, N.A.; Amin, N.; Pasupuleti, J.; Hasan, M.K. A comprehensive study and performance analysis of deep neural network-based approaches in wind time-series forecasting. J. Reliab. Intell. Environ. 2022, 9, 183–200. [Google Scholar] [CrossRef]
  12. Wang, H.; Huang, X.; Gao, S.; Yang, Z.; Gao, T.; Zhao, Q.; Ding, H. Electric vehicle charging load clustering and load forecasting based on long short term memory neural network. In Proceedings of the 2022 IEEE 5th International Electrical and Energy Conference (CIEEC), Nangjing, China, 27–29 May 2022; pp. 3196–3200. [Google Scholar] [CrossRef]
  13. Siłka, J.; Wieczorek, M.; Woźniak, M. Recurrent neural network model for high-speed train vibration prediction from time series. Neural Comput. Appl. 2022, 34, 13305–13318. [Google Scholar] [CrossRef]
  14. Egrioglu, E.; Bas, E. A new hybrid recurrent artificial neural network for time series forecasting. Neural Comput. Appl. 2023, 35, 2855–2865. [Google Scholar] [CrossRef]
  15. Ding, X.; Hao, K.; Cai, X.; Tang, S.; Chen, L.; Zhang, H. A Novel Similarity Measurement and Clustering Framework for Time Series Based on Convolution Neural Networks. IEEE Access 2020, 8, 173158–173168. [Google Scholar] [CrossRef]
  16. Yan, J.; Zhang, C.; Li, Y. A clustering method for power time series curves based on improved self-organizing mapping algorithm. In Proceedings of the 2023 IEEE 3rd International Conference on Electronic Technology, Communication and Information, ICETCI, Changchun, China, 26–28 May 2023; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2023; pp. 451–455. [Google Scholar] [CrossRef]
  17. González, B.; Valdez, F.; Melin, P.; Prado-Arechiga, G. Fuzzy logic in the gravitational search algorithm for the optimization of modular neural networks in pattern recognition. Expert Syst. Appl. 2015, 42, 5839–5847. [Google Scholar] [CrossRef]
  18. Ramirez, M.; Melin, P. A New Interval Type-2 Fuzzy Aggregation Approach for Combining Multiple Neural Networks in Clustering and Prediction of Time Series. Int. J. Fuzzy Syst. 2023, 25, 1077–1104. [Google Scholar] [CrossRef]
  19. Xu, S.; Li, W.; Zhu, Y.; Xu, A. A novel hybrid model for six main pollutant concentrations forecasting based on improved LSTM neural networks. Sci. Rep. 2022, 12, 14434. [Google Scholar] [CrossRef] [PubMed]
  20. Kan, V.; Alsova, O. Forecasting Meteorological Indicators Based on Neural Networks. In Proceedings of the 2022 IEEE International Multi-Conference on Engineering, Computer and Information Sciences (SIBIRCON), Yekaterinburg, Russia, 11–13 November 2022; pp. 1620–1625. [Google Scholar] [CrossRef]
  21. Wu, J.L.; Lu, M.; Wang, C.Y. Forecasting metro rail transit passenger flow with multiple-attention deep neural networks and surrounding vehicle detection devices. Appl. Intell. 2023, 53, 18531–18546. [Google Scholar] [CrossRef] [PubMed]
  22. Soto, J.; Melin, P.; Castillo, O. Time series prediction using ensembles of ANFIS models with genetic optimization of interval type-2 and type-1 fuzzy integrators. Int. J. Hybrid. Intell. Syst. 2016, 11, 211–226. [Google Scholar] [CrossRef]
  23. Minrong, L.; Xuerong, X. TRNN: An efficient time-series recurrent neural network for stock price prediction. Inf. Sci. 2024, 657, 119951. [Google Scholar] [CrossRef]
  24. Ali, M.; Syed, M.A.; Khalid, M. NARX Recurrent Neural Network Based Short Term Residential Load Forecasting Considering the Effects of Multiple Weather Features. In Proceedings of the 2022 IEEE IAS Global Conference on Emerging Technologies (GlobConET), Arad, Romania, 20–22 May 2022; pp. 557–561. [Google Scholar] [CrossRef]
  25. Chacon, H.D.; Kesici, E.; Najafirad, P. Improving Financial Time Series Prediction Accuracy Using Ensemble Empirical Mode Decomposition and Recurrent Neural Networks. IEEE Access 2020, 8, 117133–117145. [Google Scholar] [CrossRef]
  26. Sohrabi, F.; Reza, M.; Mirabbasi, R.; Tahroudi, M. Daily solar radiation estimation in Belleville station, Illinois, using ensemble artificial intelligence approaches. Eng. Appl. Artif. Intell. 2023, 120, 105839. [Google Scholar] [CrossRef]
  27. Pan, X.; Wang, Y.; He, S.; Chin, K. A Dynamic Programming Algorithm Based Clustering Model and Its Application to Interval Type-2 Fuzzy Large-Scale Group Decision-Making Problem. IEEE Trans. Fuzzy Syst. 2022, 30, 108–120. [Google Scholar] [CrossRef]
  28. Mohammadzadeh, A.; Castillo, O.; Band, S.S.; Mosavi, A. A Novel Fractional-Order Multiple-Model Type-3 Fuzzy Control for Nonlinear Systems with Unmodeled Dynamics. Int. J. Fuzzy Syst. 2021, 23, 1633–1651. [Google Scholar] [CrossRef]
  29. Melin, P.; Sanchez, D.; Monica, J.C.; Castillo, O. A Optimization using the firefly algorithm of ensemble neural networks with type-2 fuzzy integration for COVID-19 time series prediction. Soft Comput. 2023, 27, 3245–3282. [Google Scholar] [CrossRef] [PubMed]
  30. Zhang, Z. Trapezoidal interval type-2 fuzzy aggregation operators and their application to multiple attribute group decision making. Neural Comput. Appl. 2018, 29, 1039–1054. [Google Scholar] [CrossRef]
Figure 1. Proposed model.
Figure 1. Proposed model.
Axioms 13 00368 g001
Figure 2. Fuzzy systems model.
Figure 2. Fuzzy systems model.
Axioms 13 00368 g002
Figure 3. Clustering by using competitive NN (WDI time series).
Figure 3. Clustering by using competitive NN (WDI time series).
Axioms 13 00368 g003
Figure 4. Clustering by using SOM (WDI time series).
Figure 4. Clustering by using SOM (WDI time series).
Axioms 13 00368 g004
Figure 5. Clustering by using neural networks (R1 and R2).
Figure 5. Clustering by using neural networks (R1 and R2).
Axioms 13 00368 g005
Figure 6. Clustering by using neural networks (R3 and R4).
Figure 6. Clustering by using neural networks (R3 and R4).
Axioms 13 00368 g006
Figure 7. Clustering by using neural networks (R5, R6, and R7).
Figure 7. Clustering by using neural networks (R5, R6, and R7).
Axioms 13 00368 g007
Table 1. List of time series dataset.
Table 1. List of time series dataset.
No.Variable CodeVariable NamePeriod
1TSS1Access to electricity2000–2021
2TSS2Birth rate1990–2021
3TSS3Death rate1990–2021
4TSS4Life expectancy at birth (female)2000–2021
5TSS5Life expectancy at birth1990–2021
6TSS6Life expectancy birth (male)1960–2021
7TSS7Population growth1960–2022
8TSS8Population1960–2022
9TSS9Population (female)1960–2022
10TSS10%Population (female)1960–2022
11TSS11Population (male)1960–2022
12TSS12%Population (male)1960–2022
Table 2. Total countries by region.
Table 2. Total countries by region.
No.Region CodeRegion NameTotal Countries
1R1East Asia and Pacific35
2R2Europe and Central Asia53
3R3Latin America and Caribbean41
4R4Middle East and North Africa20
5R5North America3
6R6South Asia8
7R7Sub-Saharan Africa48
Table 3. FIS Mamdani fuzzy rules (two inputs–one output).
Table 3. FIS Mamdani fuzzy rules (two inputs–one output).
Fuzzy RulesAntecedentsConsequent
Input_1Input_2Output_1
1LWWLWWLWW
2LWWMDDMDD
3LWWHGGMDD
4MDDLWWMDD
5MDDMDDMDD
6MDDHGGHGG
7HGGLWWMDD
8HGGMDDHGG
9HGGHGGHGG
Table 4. FIS Mamdani fuzzy rules (three inputs–one output).
Table 4. FIS Mamdani fuzzy rules (three inputs–one output).
Fuzzy RulesAntecedentsConsequent
Input_1Input_2Input_3Output_1
1LWWLWWLWWLWW
2LWWMDDLWWLWW
3LWWHGGLWWMDD
4LWWLWWMDDLWW
5LWWMDDMDDMDD
6LWWHGGMDDMDD
7LWWLWWHGGMDD
8LWWMDDHGGMDD
9LWWHGGHGGHGG
10MDDLWWLWWLWW
11MDDMDDLWWMDD
12MDDHGGLWWMDD
13MDDLWWMDDMDD
14MDDMDDMDDMDD
15MDDHGGMDDHGG
16MDDLWWHGGMDD
17MDDMDDHGGHGG
18MDDHGGHGGHGG
19HGGLWWLWWMDD
20HGGMDDLWWMDD
21HGGHGGLWWHGG
22HGGLWWMDDMDD
23HGGMDDMDDHGG
24HGGHGGMDDHGG
25HGGLWWHGGHGG
26HGGMDDHGGHGG
27HGGHGGHGGHGG
Table 5. Clustering of WDI time series by using competitive NN.
Table 5. Clustering of WDI time series by using competitive NN.
VariableRC1CRC2CRC3CRC4CRC5CRC6C
TSS11511118331417
TSS2313538324032
TSS3253638403831
TSS4285241423015
TSS5293941254034
TSS6294021404335
TSS7363637333630
TSS820620000
TSS9196102000
TSS10394134163840
TSS1120620000
TSS12384134173939
Table 6. Clustering of WDI time series by using SOM.
Table 6. Clustering of WDI time series by using SOM.
VariableRC1SRC2SRC3SRC4SRC5SRC6S
TSS11811221221718
TSS2262642213360
TSS321668226436
TSS432634030421
TSS527506625391
TSS632445044371
TSS76057285751
TSS835140118212
TSS93714772141
TSS109810754192
TSS1133140138212
TSS1210110724192
Table 7. Classification of WDI time series (Type-1 FIS).
Table 7. Classification of WDI time series (Type-1 FIS).
FISType-1
InputsTSS1TSS2TSS3TSS4TSS5TSS6TSS7TSS8TSS9TSS10TSS11TSS12
Outputs
(Subregion)
T1 FIS1T1 FIS2T1 FIS3T1 FIS4T1 FIS5T1 FIS6T1 FIS7T1 FIS8T1 FIS9T1 FIS10T1 FIS11T1 FIS12
R1_R12064711672929162916
R1_R231827191415155513513
R1_R312114910141311616
R2_R15134191110274746154715
R2_R201829103315236637637
R2_R32322024928301101
R3_R1241011221516113939203920
R3_R223025132019252121221
R3_R31515666501000
R4_R116411186318187187
R4_R211318787922626
R4_R3331247800707
R5_R1302100122222
R5_R2011030210111
R5_R3020203001000
R6_R1221322155454
R6_R2154514422221
R6_R3513052311213
R7_R110264111931304645174617
R7_R219112524414152331231
R7_R319111913253300000
Table 8. Classification of WDI time series (Type-1 FIS) for 12 classes.
Table 8. Classification of WDI time series (Type-1 FIS) for 12 classes.
FISType-1
InputsT1 FIS1
T1 FIS7
T1 FIS8
T1 FIS2
T1 FIS3
T1 FIS4
T1 FIS5
T1 FIS6
T1 FIS9
T1 FIS11
T1 FIS10
T1 FIS12
Outputs
(Subregion)
T1_IR1T1_IR2T1_IR3T1_IR4T1_IR5
R1_R100000
R1_R260020
R1_R32935353335
R2_R100000
R2_R240020
R2_R34953535153
R3_R100000
R3_R270120
R3_R33441403941
R4_R110000
R4_R230110
R4_R31620191920
R5_R100000
R5_R200010
R5_R333323
R6_R110100
R6_R200000
R6_R378788
R7_R140600
R7_R2134630
R7_R33144364548
Table 9. Classification of WDI time series (Interval Type-2 FIS).
Table 9. Classification of WDI time series (Interval Type-2 FIS).
FISInterval Type-2
InputsT1 FIS1
T1 FIS7
T1 FIS8
T1 FIS2
T1 FIS3
T1 FIS4
T1 FIS5
T1 FIS6
T1 FIS9
T1 FIS11
T1 FIS10
T1 FIS12
Outputs
(Subregion)
IT2_IR1IT2_IR2IT2_IR3IT2_IR4IT2_IR5
R1_R100000
R1_R2213161121
R1_R3144292414
R2_R100000
R2_R24934111341
R2_R3419424012
R3_R100100
R3_R2253716927
R3_R3164243214
R4_R110100
R4_R212198810
R4_R371111210
R5_R100000
R5_R221021
R5_R312312
R6_R110100
R6_R206154
R6_R372634
R7_R1701200
R7_R2163811837
R7_R32510353011
Table 10. Classification of WDI time series (Type-2 FIS).
Table 10. Classification of WDI time series (Type-2 FIS).
FISInterval Type-2Interval Type-2Interval Type-2Generalized Type-2
InputsT1_IR1
T1_IR2
T1_IR3
T1_IR4
T1_IR5
IT2_R1
IT2_R2
IT2_R1
IT2_R2
Outputs
(Subregion)
IT2_R1IT2_R2IT2_RGT2_RG
R1_R10121
R1_R235333333
R1_R30101
R2_R10030
R2_R253535053
R2_R30000
R3_R10030
R3_R241413841
R3_R30000
R4_R11221
R4_R218181818
R4_R31001
R5_R10000
R5_R23333
R5_R30000
R6_R11111
R6_R27777
R6_R30000
R7_R110958
R7_R234394337
R7_R34003
Table 11. Comparison of Type-1 and Type-2 FIS.
Table 11. Comparison of Type-1 and Type-2 FIS.
FISType-1 (T1)/Interval Type-2 (IT2)
InputsT1 FIS1
T1 FIS7
T1 FIS8
T1 FIS2
T1 FIS3
T1 FIS4
T1 FIS5
T1 FIS6
T1 FIS9
T1 FIS11
T1 FIS10
T1 FIS12
Outputs
(Regions)
T1_IR1IT2_IR1T1_IR2IT2_IR2T1_IR3IT2_IR3T1_IR4IT2_IR4T1_IR5IT2_IR5
R169007150000
R233125416684311660141
R3169742044219315019714220867
Table 12. Comparison of results of Type-2 FISs.
Table 12. Comparison of results of Type-2 FISs.
FISInterval Type-2Generalized Type-2
InputsIT2_R1
IT2_R2
IT2_R1
IT2_R2
Outputs
(Regions)
IT2_RGT2_RG
R11612
R2192191
R305
Table 13. Prediction of WDI time series (NAR).
Table 13. Prediction of WDI time series (NAR).
VariableAverage %RMSEBest %RMSEWorst %RMSE
TSS10.0000277980.0000139440.000048778
TSS20.0000267120.0000149120.000043324
TSS30.0000643010.0000382950.000111326
TSS40.0000161970.0000082870.000030772
TSS50.0000125260.0000067700.000020071
TSS60.0000149300.0000086800.000028881
TSS70.0001343830.0000845440.000201535
TSS80.0001057060.0000226700.000287229
TSS90.0000919640.0000257400.000286967
TSS100.0000020590.0000011690.000003839
TSS110.0001101600.0000242070.000252354
TSS120.0000021940.0000011900.000003500
Table 14. Prediction of WDI time series by class R1_T2_RG (NAR).
Table 14. Prediction of WDI time series by class R1_T2_RG (NAR).
VariableAverage %RMSEBest %RMSEWorst %RMSE
TSS10.0004208070.0000923400.000949776
TSS20.0001301950.0000528150.000245523
TSS30.0003324520.0001670220.000591463
TSS40.0000666020.0000199780.000165994
TSS50.0001373320.0000709740.000296870
TSS60.0001463270.0000711380.000393558
TSS70.0011086670.0005736690.002632906
TSS80.0008861380.0002156220.002840459
TSS90.0008512740.0001808020.003587455
TSS100.0000045220.0000026570.000008226
TSS110.0009607870.0001709070.002616553
TSS120.0000050420.0000025980.000007630
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Ramírez, M.; Melin, P.; Castillo, O. A New Hybrid Approach for Clustering, Classification, and Prediction of World Development Indicators Combining General Type-2 Fuzzy Systems and Neural Networks. Axioms 2024, 13, 368. https://doi.org/10.3390/axioms13060368

AMA Style

Ramírez M, Melin P, Castillo O. A New Hybrid Approach for Clustering, Classification, and Prediction of World Development Indicators Combining General Type-2 Fuzzy Systems and Neural Networks. Axioms. 2024; 13(6):368. https://doi.org/10.3390/axioms13060368

Chicago/Turabian Style

Ramírez, Martha, Patricia Melin, and Oscar Castillo. 2024. "A New Hybrid Approach for Clustering, Classification, and Prediction of World Development Indicators Combining General Type-2 Fuzzy Systems and Neural Networks" Axioms 13, no. 6: 368. https://doi.org/10.3390/axioms13060368

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop