1. Introduction
Nowadays, some institutions and companies share different types of information. This information is collected and shared by worldwide organizations related to the subject of information. Such data help analysts to understand their position against other organizations in the same sector. In terms of countries, there are many indicators to show their status against other countries. The values for these indicators are calculated by organizations in each country and these organizations share data for their activities in specific periods. Data from different countries’ organizations are collected by worldwide organizations to share with people all around the world.
The most known information resource for countries to compare them with other countries is the World Development Indicators database of the World Bank [
1]. There are values of many development indicators related to all countries for each year in this database. These data give people the opportunity to see a country’s position in terms of different indicators. Furthermore, these variables are categorized in this database for different subjects such as education, economy, security, healthcare, etc.
Among all the different types of indicators, indicators related to healthcare services should be considered separately. Because of their importance for human life, healthcare services’ quality is the most important among the other services [
2]. Nevertheless, the existence of a number of indicators requires the aggregation of different indicators to understand a country’s status against other countries. At this point, using multiple criteria decision making seems to be an efficient way to aggregate different indicators. Multiple criteria decision-making methods are utilized in different applications such as aircraft selection [
3], productivity evaluation [
4], third-party reverse logistics service provider selection [
5], and medical device selection [
6].
Studies on MCDM applications in healthcare systems are common in the literature. The procurement of healthcare technology processes was analyzed by Nobre et al. [
7]. An assessment of waste treatment alternatives in healthcare systems was made by MCDM approaches [
8]. The fuzzy extension of the Analytic Hierarchy Process (AHP) method was used to find the best location for a hospital [
9]. Fuzzy AHP and TOPSIS methods were combined to evaluate web-based service quality levels of 13 hospitals in Turkey [
10]. Hung et al. [
11] considered the fee schedule setting problem in orthopedic procedures in Taiwan by using both fuzzy and non-fuzzy MCDM methods. The priority of health interventions was set in Tromp and Baltussen’s study [
12] by utilizing MCDM methods. The service quality of public hospitals in Turkey was evaluated by using an AHP and Fuzzy Information Axiom-based hybrid model [
13]. The perceived value of the healthcare services of patients was evaluated by using the DEMATEL method in Efe and Efe’s study [
14]. Ghouschchi et al. [
15] evaluated alternative locations for medical waste landfills by using a spherical fuzzy set-based SWARA-WASPAS method. Al Awadh [
16] utilized a SERVQUAL-based AHP method to evaluate the quality of hospitals in Saudi Arabia. A PROMETHEE-based MCDM method was used by Pereira et al. [
17] to evaluate the feasibility of implementing a hospital information system for a military public institution. Wang et al. [
18] analyzed the efficiency of intervention strategies in response to the COVID-19 pandemic by using a group decision-making approach based on BWM.
In the literature, there are some studies on service quality evaluation in healthcare systems [
4,
7,
16]. However, there are no studies comparing countries in terms of healthcare services. To fill this gap in the literature, the main aim in this study was to develop an analytic approach to rank 28 European Union member countries in terms of healthcare indicators. To consider different healthcare indicators in an aggregated manner, a multiple criteria decision-making approach based on Hesitant Fuzzy Linguistic Terms Set (HFLTS) and Hesitant Fuzzy Technique of Order Preference by Similarity to Ideal Solution (HF-TOPSIS) is proposed. HFLTS is used to determine the importance degree of each healthcare indicator of healthcare service quality, and HF-TOPSIS is used to rank countries. The existence of uncertainty and hesitancy in ranking the criteria score of countries was taken into account by using hesitant fuzzy elements. The reason hesitant fuzzy sets are used in the study is the necessity to model uncertainty and hesitancy that decision makers face in the evaluation of healthcare indicators and country performances. Hesitant fuzzy elements have been proven to be useful in several studies such as [
19,
20] to model uncertainty. Moreover, the analysis of rankings obtained by using different hesitant fuzzy distance measures in HF-TOPSIS and rankings obtained by the deterministic TOPSIS method were also presented as comparative analyses of the proposed model. The main contributions of the study can be summarized as follows:
- -
Healthcare services in European countries compared by using a MCDM model.
- -
HFLTS-based group decision making is used to calculate the criteria weights.
- -
HF-TOPSIS is applied to determine the ranking of countries.
- -
A comparison of rankings for the utilization of different hesitant fuzzy distance measures is made.
- -
A comparison of HF-TOPSIS and deterministic TOPSIS is presented.
The rest of the paper is organized as follows.
Section 2 consists of a brief explanation of the methodology of the proposed approach. Healthcare indicators considered for the evaluation of healthcare services and data for countries are explained in
Section 3.
Section 4 consists of the application steps with the analysis of rankings obtained by using different distance measures. The paper concludes in
Section 5 with suggestions for further studies.
2. Methodology
In this study, a hybrid hesitant fuzzy group decision-making algorithm based on HFLTS and TOPSIS was proposed. Currently, the only study integrating these approaches was by Aktas and Kabak [
21], who used them to evaluate potential sites for solar energy plants. Using hesitant fuzzy sets provides the ability to handle the hesitancy of decision makers among possible linguistic terms used in the evaluation. After the definition of the decision problem, Yavuz et al.’s HFLTS-based group decision-making algorithm [
22] was used to determine criteria weights. The hierarchical structure modeling of the decision problem and using hesitant fuzzy linguistic representations for expressions make it possible for this algorithm to handle complex MCDM problems. Then, Xu and Zhang’s HF-TOPSIS method [
23] was used to evaluate alternatives. The construction of a hesitant fuzzy decision matrix makes it possible to handle different evaluation scores expressed by decision makers and enables us to obtain a decision combining different opinions. The flowchart for the proposed decision-making algorithm is given in
Figure 1.
The first phase of the proposed algorithm gives a definition of the problem. In this phase, the goal of the problem, decision criteria, and alternatives to be evaluated are defined. Then, a hesitant fuzzy decision matrix, which consists of experts’ opinions in terms of decision criteria for each alternative, is constructed.
The calculation of criteria weights is the second phase of this algorithm. Pairwise comparison matrices constructed using HFLTS which represent the opinions of experts on criteria are used to calculate the importance degree values of decision criteria.
The last phase of the algorithm is the ranking of countries. In this phase, alternatives are evaluated by using the hesitant fuzzy decision matrix and the criteria importance degree values calculated in phase 2. The relative closeness coefficient for each country is calculated by the HF-TOPSIS method, and the ranking of countries is determined.
The proposed model was developed in order to handle uncertainty in criteria evaluation by HFLTS and the vagueness of alternative evaluations by different experts via the HF-TOPSIS method. By using the model, the linguistic evaluation of experts on criteria can be expressed by more than one linguistic term, since the method uses a context-free grammar structure. Moreover, different thoughts of experts on alternative scores with respect to each criterion may have different membership values, which can be handled by hesitant fuzzy elements in the TOPSIS method.
TOPSIS is a well-known MCDM method. It can be used to obtain the ranking of alternatives, where the furthest alternative from the least desired solution is in the first order. Its ease of application and common utilization in a variety of decision-making applications are the main reasons for choosing the method.
3. Ranking of European Countries by Using the Proposed Approach
3.1. Hierarchical Structure of the Problem
In this phase, definitions of the goal, main criteria, and sub–criteria for site selection were determined, and the hierarchical structure of site selection procedure was constructed. The structure is given in
Figure 2.
The goal of the problem is ranking European countries in terms of healthcare development indicators. In this study, the rank of countries is determined by considering six regularly collected indicators related to healthcare services from the World Bank’s World Development Indicators database [
1]. These six indicators are health expenditure per capita (C
1), hospital beds per 1000 people (C
2), life expectancy at birth (C
3), number of under-five deaths (C
4), survival to age 65 for females (C
5), and survival to age 65 for males (C
6). Readers may have a look at the database for descriptions of criteria and other related criteria.
The decision matrix of the problem shows each alternative’s value based on available decision-making criteria. This matrix is constructed by asking three experts about their opinion on each alternative’s suitability as decision-making criteria in the interval [0, 1]. It means that for an expert, an alternative is suitable in terms of decision-making criteria when the expert’s opinion for that alternative is closer to 1, and the alternative is not suitable in terms of that criteria when the expert’s opinion is closer to 0. Since repeat times of values are not considered to be significant, if two or more experts have the same opinion for an alternative under the same criterion, this opinion is shown only once in the decision matrix. The decision matrix of the problem is given in
Table 1.
3.2. HFLTS for Criteria Weights Calculation
The hesitant fuzzy set concept was introduced by Torra [
24] to model hesitant situations on several values of an element. Rodriguez et al. [
25] extended the concept into Hesitant Fuzzy Linguistic Terms Set (HFLTS) to model the hesitant situations where the decision elements can be expressed by using various linguistic variables at the same time.
Within the proposed decision-making model, the determination of priority values for development indicators were determined by using the HFLTS-based group decision-making approach, which was proposed by Yavuz et al. [
22]. HFLTS is used in this study, because it is aimed at handling the hesitancy of decision makers in expressing their opinions on healthcare service quality indicators. The steps of the algorithm are given as follows:
Step 1: Definition of linguistic terms and context-free grammar.
Linguistic terms for importance degrees used in the study are presented in
Table 2. Linguistic terms are connected to the others by using an appropriate relation term from the set of “at most”, “at least”, “greater than”, “lower than”, “is”, and “between”. Readers may refer to Rodriguez et al. [
13] for a detailed description of the context-free grammar structure.
Step 2: Collecting preferences of experts for criteria.
Experts’ preferences are given in
Table 3,
Table 4 and
Table 5. An expert group of three people was formed to determine and evaluate indicators. The expert group consists of an expert from the Ministry of Health, an academician working on healthcare services quality, and the quality manager of a state hospital in Turkey.
Step 3: Converting the expert preferences to HFLTS.
According to the context-free grammar rules proposed by Rodriguez et al. [
25], linguistic expressions that represent the expert preferences are converted to HFLTS. HFLTS equivalents of linguistic expressions that can be used by experts are presented in
Table 6 with their HFLTS equivalents. In this table,
x and
y represent the linguistic terms corresponding to the preferences of experts.
x − 1 and
x + 1 show the linguistic term with the lower importance degree and higher importance degree than
x, respectively.
Step 4: Obtaining optimistic and pessimistic collective preferences by using a selected linguistic aggregation operator.
Optimistic and pessimistic collective preferences are determined by the arithmetic mean of importance degrees of linguistic terms in HFLTS. Optimistic and pessimistic collective preferences for criteria are given in
Table 7 and
Table 8, respectively.
Step 5: Building the vector of intervals for collective preferences.
The vector of intervals is built by the arithmetic mean of rows in pessimistic and optimistic aggregate preference matrices.
Step 6: Obtaining priority values by normalization of interval values.
Interval midpoints are calculated, and normalized interval midpoints show priority values. Calculations in Steps 5 and 6 gave the priority values of criteria in
Table 9.
It can be seen that according to the expert group’s aggregated opinions, the most important indicator for healthcare services of a country is the number of under-five deaths. This is followed by life expectancy at birth, survival to age 65 for females and males, hospital beds per 1000 people, and health expenditure per capita.
3.3. HF-TOPSIS for Ranking of Countries
TOPSIS method was first proposed by Hwang and Yoon [
26] to find solutions in MCDM problems. It aims to find the shortest alternative to the positive ideal solution and the furthest alternative to the negative ideal solution. In this study, the Hesitant fuzzy extension of the TOPSIS method proposed by Xu and Zhang [
25] was used. Hesitant fuzzy sets are used to cope with inherent hesitancy and uncertainty.
Since the decision matrix for this application given in
Table 1 contains hesitant fuzzy elements with different numbers of experts’ opinion values, it needed to be extended until all elements had the same length. The extension of hesitant fuzzy elements was made by adding the minimal value of element. The extension with minimal values added is the pessimistic case. The new decision matrix is given in
Table 10.
The positive ideal solution (
) and the negative ideal solution (
) for benefit-type criteria in Hesitant F-TOPSIS are defined by Xu and Zhang [
22] and given as follows:
For cost-type criteria, positive and negative ideal solutions are defined as follows:
Types of decision-making criteria are defined as benefit (B) and cost (C), and positive and negative ideal solutions are given in
Table 11.
Hwang and Yoon [
14] proposed to use the Euclidian distance measure in TOPSIS. The Euclidian distance measure for the hesitant fuzzy environment was proposed by Xu and Xia [
27]. In HF-TOPSIS, the distances of the
ith alternative from the positive ideal solution (PIS) (
) and from the negative ideal solution (NIS) (
) are presented in the following form:
After calculating distances of alternatives from positive and negative ideal solutions, the ranking of alternatives is executed by using relative closeness coefficients. The relative closeness coefficient is calculated by using the following formula:
By using this given formula, the distance of alternatives to positive and negative ideal solutions and relative closeness coefficients are calculated. Values of
,
, and
are given in
Table 12.
Since the best country is the furthest from the negative ideal solution, the higher value of the relative closeness coefficient positions a country in the best rank. Therefore, the first country in Europe in terms of healthcare indicators is Austria. Austria is followed by Sweden and Finland.
4. Comparative Analyses
4.1. Analysis of Using Different Distance Measures on HF-TOPSIS
Due to the type of problem data, measuring the distance to the ideal solution may require a different distance measure from Euclidian distance. In this section, this situation is analyzed. In addition to Euclidian distance, five other distance measures are introduced. These new measures are used for calculating the distance to the ideal solution of our application, and the obtained rankings of countries are compared. Readers who are interested in the details for these distance measures can refer to Liao et al.’s study [
28]. We only give formulations for these measures and the results for our application.
Hamming–Hausdorff distance:
Euclidian–Hausdorff distance:
Hybrid Euclidian distance:
The ranking of countries by using the distances for each measure is given in
Table 13.
There are some differences in rankings when different measures are used to calculate the distance to ideal solutions. The first country is not changed, but the results for some countries vary by using one measure over the other. Using different distance measures may lead to different results in HF-TOPSIS applications.
4.2. Comparison of Rankings Obtained by the Proposed Approach and Deterministic TOPSIS
The decision matrix for this application is constructed by 20-year-average values of countries’ scores in terms of the six healthcare indicators. The decision matrix is presented in
Table 14.
After the construction of the decision matrix, vector normalization was applied to obtain a normalized decision matrix. Weights obtained by the HFLTS method were applied to the normalized decision matrix to calculate the weighted normalized decision matrix. Positive and negative ideal solutions were determined, and the distances of alternatives to ideal solutions were calculated by the Euclidian distance formula. Distances to ideal solution values were used to compute the relative distance to the ideal solution value for alternatives. The resulting value of this step indicates the ranking of countries. Distance ideal solutions
and relative distance to ideal solution (
) values are given in
Table 15, along with the ranking of countries.
According to the TOPSIS method, Luxemburg seems to be the best country in terms of healthcare indicators in Europe. However, in the proposed methodology, Luxemburg’s ranking is fifth or sixth based on the distance measure. Austria has the first rank in the proposed methodology, but in deterministic TOPSIS, Austria has the second rank. Sweden obtained second and third ranks in HF-TOPSIS, but in deterministic TOPSIS, they had the ninth rank. The results vary between the hesitant fuzzy uncertain environment and certainty.
The ranking changes between HF-TOPSIS and deterministic TOPSIS are due to the difference in decision matrices. The decision matrix for HF-TOPSIS is constructed based on the opinions of experts in healthcare services, while deterministic TOPSIS utilizes a decision matrix of numerical values obtained from public databases. Since numerical values may be insufficient or misleading to show the real performance of an alternative, expert opinions can be more useful. This is the main advantage of the HF-TOPSIS approach over deterministic TOPSIS. On the other hand, decision matrices constructed based on experts’ opinions may have subjective contents. In case of selection of experts, who share subjective opinions may lead to wrong consequences and this is the main disadvantage of the method.
5. Conclusions
In this study, a hybrid decision-making approach based on HFLTS and TOPSIS is proposed to rank 28 EU countries in terms of healthcare development indicators. Hesitant Fuzzy Linguistic Terms Set was used to cope with the hesitancy of decision makers. Within the proposed methodology, HFLTS-based group decision making is used to determine selection criteria weights, and HF-TOPSIS is used to rank the countries. An application of different distance measures in HF-TOPSIS and a comparison of rankings between HF-TOPSIS and original TOPSIS with the certainty assumption are also presented. This approach can be used in decision problems with conflicting decision-making criteria and non-dominating alternatives under a hesitant fuzzy environment.
Healthcare services are essential for the well-being of people in countries. Governments and international organizations devote substantial efforts to the improvement of healthcare services. Therefore, the comparison of healthcare services between countries should be considered an important issue. Since the main aim of the EU is to eliminate differences between their member states and improve the economic and living standards throughout the community, ranking healthcare services among EU members would help with policy making in the region. By the presented case study, a ranking model which provides an analytical basis for these processes is proposed.
There are some ranking differences between HF-TOPSIS and deterministic TOPSIS. The differences are due to the utilization of different decision matrices for these applications. HF-TOPSIS takes the existence of vagueness and uncertainty in life into account, which is an important consideration that must be included in decision-making processes. Deterministic TOPSIS uses an average score for each country based on 20 years of data. We conclude that the proposed model is superior to deterministic TOPSIS.
This is the first study to present a multi-criteria ranking model for countries in terms of healthcare services. Since the aim of the EU is to eliminate differences between their member states, improvement policies for healthcare systems in countries at lower rankings can be developed based on the results of the study. Moreover, this study may lead the way for researchers to focus on the comparison of countries by using MCDM models.
Criteria taken into consideration for MCDM analyses may vary from one study to another. Thus, different applications on the same problem may provide different results. Since the study takes only six indicators into account, further studies may focus on the consideration of different and more criteria in the analysis. Furthermore, in the aggregation procedure of experts’ opinions on criteria, opinions of all the experts are assumed to be same. This assumption can be generalized by the application of weighting in the aggregation procedure. Moreover, since the criteria weights are effective in the ranking results, the changes in criteria weights can be analyzed as a sensitivity analysis. Finally, rankings obtained by different MCDM approaches such as MARCOS, MULTIMOORA, VIKOR, ELECTRE, and PROMETHEE can be compared with TOPSIS.