1. Introduction
Over the past 20 years, the effects of various viral diseases on humans have been documented, including the severe acute respiratory syndrome coronavirus (SARS-CoV) outbreak of 2002–2003, and the H1N1 influenza in 2009. In 2012, the Middle East respiratory syndrome coronavirus (MERS-CoV) was discovered for the first time in Saudi Arabia. However, the impact of the current COVID-19 pandemic has challenged humanity’s recent advances in epidemic prevention. The World Health Organization has classified COVID-19 as a major worldwide pandemic, posing a serious threat to humanity as it has spread around the world. For example, Fernandes [
1] showed that the pandemic’s continued spread will likely cause severe damage to the world economy, estimating that every additional month of the crisis could cause a 2.5–3% reduction in the global GDP. Consequently, how to quickly and effectively fight the epidemic is a critical decision for the countries affected.
Most efforts have focused on the development of treatments and a vaccination to fight the virus [
2,
3,
4]. Chinese researchers were the first to propose a non-medical solution, specifically the strategy of quarantine to control the spread of the infection [
5,
6,
7]. Requia et al. [
8] posited that a functional national healthcare system is an important fundamental to fight the epidemic. Many studies have shown that increasing the basic capacity and quality of the national health facilities is important in the fight against COVID-19, directly impacting the ability to control the infection and having some influence on the safety of the whole country [
8,
9,
10]. In other words, enhancing the national healthcare system has a big impact on ensuring a country’s competitive advantage and sustainability.
Today, in the face of the continued spread of the pandemic across the globe, the management of the national healthcare system has become extremely important. Factors commonly used to evaluate the quality of a national healthcare system have been detailed in past studies such as the global health observatory indicators (GHOS), Organization for Economic Co-Operation and Development (OCED), International Quality Indicators Project (IQIP), Agency for Healthcare Research and Quality (AHRQ), and Healthcare Quality Indicator Project (HCQI) [
11,
12,
13,
14,
15]. Some researchers have also used the number of hospital beds, composite measures (medical workers and ICU beds), and medical care spending as direct measures of the quality of bedside medical care [
16,
17]. It should be noted that some of these indicators are normally used to measure the quality of medical care within medical institutions, and some to measure quality on both the institutional and regional level. In addition, there are some indicators that are specifically used to measure the quality of an international healthcare system. Although the existing evaluation frameworks are all quite complete, and the areas they can be used to evaluate are quite wide, and using them to conduct a thorough evaluation often requires a complex process and a large amount of time. Other measures that can be taken into consideration include healthcare capacity, healthcare management, healthcare accessibility, interdisciplinary communication, infection control, and the difficulty of adopting new technology [
18,
19,
20]. This study proposes the six measures mentioned above to quickly assess the current state of a national healthcare system during the current severe epidemic [
19].
In the past, traditional analysis and the multiple criteria decision method (MCDM) have been used to analyze the healthcare system. However, questions remain related to the indicator weight settings (most of which are analyzed by the subjective weights of experts) and how to improve value in the former method [
18], while the latter method usually employs collective rankings for a comparison of the selected alternatives or solutions. In real-world management problems, it is often necessary to perform a collective evaluation using a limited number of methods, and then choose the most suitable solution from among a limited number of solutions. It is also often the case that this solution is most effective only in a given area, whereas in reality, decision makers need to understand the gap between the aspiration levels and actual performance in all areas, and then minimize this gap. The traditional MCDM is not suitable to find the rankings of these gaps, being designed to find the best solution among the various solutions, rather than comparing the difference between the real and the aspiration levels.
This study uses soft computation methods, namely the CRiteria Importance Through Intercriteria Correlation (CRITIC) and modified VlseKriterijumska Optimizacija I Kompromisno Resenje in Serbian, meaning multicriteria optimization and compromise solution (modified VIKOR) methods, to evaluate the national healthcare system. First, CRITIC is used to calculate the objective weights of all the related criteria for evaluating the national healthcare system (this differs from the expert weights used in the past). CRITIC can efficiently differentiate the characteristics of the individual criteria by examining their relative strengths, using the relations between them to evaluate criteria weights [
21,
22]. Then, a modified VIKOR method is used to analyze the medical and health systems of those countries in the world demonstrating superior epidemic prevention performance. The gap between the current performance level of the national medical and healthcare system and the desired level is confirmed, so that each country can clearly know how to achieve better results. This method can effectively remedy the limitations of the past evaluation methods by avoiding the dilemma of having to “select good apples from among the rotten apples” [
23,
24].
The results of this study can provide a comprehensive scientific method to help countries affected by the epidemic to identify problems with their national healthcare systems, with results that are closer to real needs. The contributions are as follows: First, a soft computing method is employed to quickly and accurately determine the priority rankings of the evaluation criteria, combined with a modified VIKOR method to allow countries that are already performing well to understand what aspects can be improved further, and to achieve the aspiration goals to improve upon already good performance. Second, the latest statistics obtained from an open database are used to quickly determine directions for improvement in the face of the spread of infection, and to propose strategies to improve the healthcare system.
The remainder of the paper is structured as follows:
Section 2 presents a systematic review of past literature on healthcare system assessment. An introduction of the basic concepts of soft computing is given in
Section 3, and a case study and discussion are presented in
Section 4. Finally, the conclusion and directions for future research are presented in
Section 5.
2. Healthcare System
The methods used for healthcare system evaluation in past studies can be roughly divided into three types, namely qualitative, quantitative, and hybrid methods [
25,
26,
27]. From the perspective of knowledge management, Karltun et al. [
26] used a qualitative approach to explore the improvement of healthcare system quality. Based on a combination of semi-structured interviews and non-participant observations, they found that national healthcare policies, hospital management, and medical professionals all affect the improvement of quality. Budiwan [
25] conducted an in-depth survey of 15 patients and recorded, transcribed, and then analyzed the contents of their responses. They found that, from the perspective of patients, technical, interpersonal, tangibles, and access, as well as responsiveness, value, and outcomes, are all important criteria for evaluating the quality of a healthcare service. Such qualitative methods can be helpful in clarifying the causes of problems, but they lack data and evaluation support.
Other studies have focused on the use of quantitative methods. There are various different methods used for quantitative analysis, including statistical models, economic models, multi-objective planning, optimization, etc. In a 2020 study of the Polish healthcare system, Zawisza et al. [
28] assessed the overall satisfaction of elderly patients and used probability regression models for overall analysis. The results showed that doctor–patient communication skills played an important role in improving patient satisfaction. They emphasized the necessity of overcoming social and psychological problems in the doctor–patient relationship. Numerous previous research studies have employed partial least squares structural equation modeling (PLS-SEM) to examine the National Health Service in Spain [
29,
30]. One of the studies argued that resource allocation, expenditures, safety, and life expectancy have positive effects on patient satisfaction. Furthermore, Valls Martínez et al. [
30] investigated health investment management and healthcare quality from a gender perspective and concluded that females are more sensitive about the public health investment than males; meanwhile, the expenditure level directly influenced patient satisfaction of both males and females. Based on the abovementioned findings, the following statements could be drawn. Firstly, PLS-SEM could be regarded as one of the proper methods to investigate healthcare system issues. Secondly, patient satisfaction could be considered as one of the crucial influencing factors of the hygiene system. In recent years, continuous innovations in science and technology, especially the growth of artificial intelligence and the development of chatbots, have led to changes that are affecting the healthcare system. These technologies can be applied to improve the effectiveness of the healthcare system. Artificial intelligence and chatbots are dependent on calculation technology and decision-making technology [
31]. Many recent studies have focused on these technological breakthroughs and applications. For example, Chen et al. [
32]. believe that, due to the multi-modality of medical data, traditional machine learning and data-mining methods cannot accurately discover the hidden value in the data, that edge computing technology should thus be used to carry out more comprehensive analysis, and that the power of science and technology can be applied to improve the healthcare system.
The multivariate linear models, because of their reliability, have been widely used to propose improvement strategies and to increase the efficiency of healthcare logistics. Hejazi et al. [
33] used this method to perform analysis with stress-strength reliability as a control variable (i.e., number of beds in the medical facility). Others have argued that price-based strategies are a more effective method for improving the healthcare system. These strategies employ multi-objective planning mathematical methods. It has been found that using a new contract policy, it is possible to achieve higher quality medical service with shorter waiting times [
34]. Likewise, Teymourifar et al. [
34] used multi-objective analysis models and a combination of strategies to perform an evaluation of a healthcare system from the perspective of patient spending and develop strategies for improvement. Their results show that the proposed strategies can achieve effective improvements and create a better medical system.
Many studies favor using data envelopment analysis (DEA), combining the concepts of input and output with different techniques for healthcare analysis. For example, Yaya et al. [
35] used weighted DEA along with a hybrid game theory model to develop a method for the improvement of healthcare system quality and management. Unlike the traditional DEA models, their decision-making unit-based method uses k-means and a canopy algorithm to group homogeneous units into a single group, then performs an evaluation on each individual group. The results of analysis by quantitative models are supported by data. However, gathering data can be difficult and time consuming, and the accuracy is uncertain. This has led to the development of hybrid quantitative and qualitative methods to improve the solutions. The various MCDM methods that are representative of this strategy can simultaneously consider quantitative and qualitative variables in the analysis process [
36,
37,
38]. In a review of over 200 papers focusing on healthcare analysis and healthcare problems, Mardani et al. [
36] found that the analytic hierarchy process (AHP) and fuzzy AHP were the most commonly used decision-making techniques.
Otay et al. [
39] used a mixed model to evaluate the efficiency of medical institutions. Their model, based on DEA, combined with AHP, and intuitionistic fuzzy sets (IFS), can be used to find the rankings in an uncertain environment. In addition, others have addressed the issue from the perspective of sustainability to establish a mixed sustainability-resilience framework with the goal of ultimately raising the quality, efficiency, and effectiveness of medical and healthcare services. The analysis was based primarily on DEA combined with the best-worst method (BWM), as well as the use of advantage-weakness-opportunity-threat (AWOT) analysis to provide appropriate suggestions [
40]. Si et al. [
41] used a decision-making trial and evaluation laboratory (DEMATEL)-based model to establish key performance indicators (KPI) for the healthcare system. That method uses interval 2-tuple linguistic variables to consider the semantics problems of the decision-makers. Others have integrated interval type-2 fuzzy sets (IT2FSs) with simulation methods to improve hospital room stay performance. This method combines the interval type-2 fuzzy AHP (IT2FAHP) and elimination and choice translating reality (ELECTRE) techniques, and the simulation results showed that the average length of stay (LOS) can be improved [
42]. Amiri et al. [
43] employed a new model for the evaluation of hospital performance. Their model is based on BWM fuzzy preference programming for the integration of the opinions of different experts. Integrated cross-domain models have been proposed for quality control of the healthcare system. Such models first use confirmatory factor analysis to confirm the variables affecting quality control, then apply the VIKOR grey relational analysis (VIKOR-GRA) to find the importance rankings of the influential factors, and finally the importance-performance analysis (IPA) technique to perform correction [
38].
Tuzkaya et al. [
44] carried out an overall assessment of the quality of medical service based on patient satisfaction. They proposed the interval-valued intuitionistic fuzzy preference ranking organization method for enrichment of evaluations (IVIF-PROMETHEE), a method that can be used for medical service quality assessment, which considers the hesitation of patients in the decision-making process. Chang [
45] studied the assessment of hospital service quality, believing that the expectations regarding service quality are greatly affected by subjective observations. Their results show that the five most important criteria for assessing hospital service quality are as follows: medical staff with professional capabilities, service staff with the capacity to quickly solve problems, the quality and cleanliness of the bedding, professionally competent and trustworthy medical staff, and the doctors’ ability to provide detailed descriptions of the patients’ conditions. Based on a similar concept, Baki and Peker [
46] established a comprehensive fuzzy evaluation model of hospital service quality. Their model combined the fuzzy AHP and fuzzy technique for order preference by similarity to an ideal solution (TOPSIS) techniques. The empirical results showed that, from the perspective of hospital service quality, “reliability” is the most important standard, while “empathy” is the least important one. In many past studies on healthcare assessment, the concept of ambiguity has been taken into account to assess and choose between different medical institutions [
47,
48,
49]. From the perspective of efficiency and consistency, it is even more important to perform analysis of the benchmarks. An integrated model has been proposed for this type of analysis, which uses ELECTRE III to rank the evaluated medical institutions, followed by IPA to find the best institution [
37].
While all the methods discussed above are effective, they suffer from two limitations. First, most of these methods still require expert opinions for determining criteria weights. Many studies have focused on the problems of linguistic expression, indecision, integrating the opinions of different experts, etc., related to the reliance upon expert opinions [
39,
43,
45]. Although these methods have attempted to address the uncertainty of expert opinions, the problem of subjectivity remains. The CRITIC technique can be used to overcome the limitation of needing to rely on expert opinions to support the decision-making system, and to establish accurate criteria rankings using the relationships between criteria. The objective weights are obtainable based on actual performance. In addition, the criteria for evaluating healthcare systems often have complex and conflicting characteristics, and are often closely related, making the CRITIC technique very useful in this area.
Secondly, past performance assessment methods have often been limited to setting the benchmark from the existing alternatives or solutions [
37,
45]. However, if comparisons are only made with this benchmark, and the number of alternatives to be compared is limited, the evaluation results can very easily fall into the regional best solution. However, in the real world, the concept of the aspiration exists [
23,
24]. Therefore, using the aspiration level as the basis for analysis, we can work towards these goals, to find the best solution. Among the many performance analysis techniques, the modified VIKOR is a suitable tool to fix the problem analyzed in this study.
3. Soft Computing Technology
This section describes in detail the characteristics and calculation steps of the proposed soft computing method. This soft computing method comprises both CRITIC and modified VIKOR models. The CRITIC model is used to determine the weights of the evaluation indicators (criteria), while the modified VIKOR model is used for evaluation and improvement of national healthcare systems. The complete process can be divided into three stages (see
Figure 1):
- (1)
Data collection (definition/normalization);
- (2)
Application of the CRITIC model to get the objective weights;
- (3)
Using the modified VIKOR model to evaluate each alternative.
3.1. Phase I: Collection and Collation of Data
Step 1. Establish an evaluation decision matrix.
Extract performance data from the database to obtain a performance evaluation matrix
O, where
Ai is alternative
and
Dj is criterion
. Therefore, the
stands for the performance of
alternatives in criterion
.
Step 2. Set the values of the benchmark.
First, define the ideal point. Ideal points are divided into positive and negative, where the positive ideal point has the maximum value and the negative ideal point has the minimum value.
Next, define the goals as the aspiration level and acceptable level, with the aspiration level being the highest and the tolerance level the lowest.
Using performance on a 0 to 100 scale as an example, ranging from very poor/unsatisfactory ← 0, 1, 2, …, 99, 100 → very good/satisfactory. Using this scale in an intuitive linguistic survey, the aspiration level would be set at 100 and the tolerance level as 0. Thus, the aspiration level in our study = 100, and the tolerance level = 0. This aspect is different from the traditional max-min method.
Step 3. Get the normalized matrix N.
Use Equation (2) to normalize the performance measures and get the normalized matrix
N, as shown in Equation (3).
3.2. Phase II: Derive the Objective Weights
Step 1. Calculate the standard deviation of each criterion.
Based on the normalized matrix
N, calculate the average values and standard gaps of all criteria, as shown in Equations (4) and (5).
Step 2. Calculate the correlation coefficient between the two criteria.
Use the normalized matrix
N to calculate the relationships between the criteria, and the correlation coefficients, as shown in Equation (6), where
is the correlation coefficient between the
kth and
kth criteria.
Step 3. Calculate the weights of each criterion.
Calculate the deviation and standard gaps of each criterion. Based on the deviation and standard gaps of all criteria we can obtain the final objective weights, as shown in Equations (7)–(9).
3.3. Phase III: Use the Modified VIKOR to Perform the Evaluation
The traditional VIKOR and modified VIKOR method are developed as an
Lp-metric.
Within the VIKOR method, the solution obtained considers both the maximum group utility (majority rule, shown as the average gap,) and the minimum individual regret (shown as the lowest performance between guidelines).
In the traditional VIKOR method the ideal point is used as the benchmark, whereas the modified VIKOR uses the aspiration level as the goal to propose the final weightings, as shown in
Figure 2.
Step 1. Calculate the maximal regret and mean of the group utility .
Obtain the maximal gap and calculation average gap, as shown in Equations (10) and (11).
Step 2. Compute the value.
Use strategy coefficients to calculate the total gap
. The strategy coefficient is set according to the degree of dependence on the mean of the group utility and maximal regret, where
,
, as shown in Equation (12). The
is a coefficient adjusted according to different situations. In this study, the default value is 0.5. This means that both distances are equally important.
5. Analysis Results and Discussions
In this section, we analyze examples according to the computation steps from the previous section. First, the objective weights of the six measures are described. Second, a soft computation technique is used to assess the healthcare systems of 195 regions around the world. Third, the difference between traditional and modified VIKOR is considered, and finally, we discuss the results of the soft computation technique.
5.1. Obtain Objective Weights
The proposed soft computation technique is combined with CRITIC operations and treats the entire world as one system to confirm the objective weights of the criteria. The objective weights are obtained based on the correlation coefficient and standard deviation, as in Equations (4)–(10). Based on
Table 3 and using the method outlined in Phase II in
Section 3, we first performed analysis using the proposed soft computing method CRITIC to calculate the relationships between the indicators.
Table 4 shows the relationships between the six indicators. It can be found that there was a stronger correlation between
D1,
D2, and
D6 with correlations of 0.539, 0.584, and 0.562, respectively. Similarly, there was a stronger correlation between
D5 and
D6 with a correlation of 0.578. In other words, there is a strong relationship between the three variables (i.e., healthcare capacity, healthcare management, and infection control). Similarly, there is a strong relationship between the two variables of infection control and difficulty of adopting new technology.
The standard deviations of each of the six evaluation criteria are shown in
Table 5. The weights calculated for the six indicators using CRITIC were
D4 >
D6 >
D5 >
D2 >
D1 >
D3. We can see that the final criterion weights depend upon the gaps and the standard deviation. The three highest weighted indicators were
D4 (interdisciplinary communication, 0.255),
D6 (difficulty of adopting new technology, 0.180), and
D5 (infection control, 0.175). This shows that interdisciplinary communication, difficulty of adopting new technology, and infection control are important measures for evaluating the national healthcare system. Accurate criteria weights are very important in multi-criteria decision evaluation problems. Past methods usually used expert opinions or assumed the weights to be identical, in order to perform a general assessment. This study uses objective weights to perform the final evaluation. This is different from past evaluation methods, and makes the evaluation results more convenient, accurate, and fast, while at the same time it allows us to avoid the problem of individual bias present in the expert judgements.
5.2. Soft Computing Evaluation of Healthcare Systems
Using the proposed soft computing technique, we can obtain the rankings of the healthcare systems for 195 regions. The complete rankings are as shown in the
Appendix A Table A1 and
Table A2. To save space, we used the top 10 ranked subjects as an example for explanation and discussion, as shown in
Figure 3. On the right side of the figure, the coefficients of group benefits and individual regrets are drawn as a schematic diagram. This diagram allows us to easily tell the differences in performance in each region, based on group benefits and individual regrets. The green star in the top right corner of the figure represents the aspiration level of the healthcare system performance. The left side of the figure shows the gap from the aspiration level for the 10 regions. It can be seen that the Netherlands, which had the highest ranking, still had a total gap of 0.407 to the aspiration level (green bar); the second one, Canada had a gap of 0.414; France, in third place, had a gap of 0.442; Belgium, in fourth place, had a gap of 0.452; the United Kingdom, which is ranked fifth, had a gap of 0.461. This trend continues for the other regions. These results show that the Netherlands’ healthcare system is already performing well in comparison to other countries. However, it still has room for improvement. This example shows that the new computation technique combined with modified VIKOR achieves analysis results that are much more accurate and effective, and closer to the requirements of the real world. The proposed soft computing technique not only has the functions of the traditional performance evaluation models (i.e., ranking), but can also provide decision makers with more managerial suggestions regarding how each region can work to raise the standards of its healthcare system in order to achieve the goal of continued improvement. We include a more detailed explanation in the following sections.
5.3. Comparison of Modified VIKOR with Traditional VIKOR and Other Methods
The biggest difference between traditional and modified VIKOR methods lies in the process for determining the benchmark, as in Phase 1, Step 2. The setting of the benchmark results in a major change to the evaluation results. We list the top 10 rankings according to the soft computation results as shown in
Table 6. The left side of
Table 6 shows the results obtained with the traditional model.
The best performance was achieved by the Netherlands (0.078), followed by Canada (0.101), France (0.135), Belgium (0.153), the United Kingdom (0.160), Argentina (0.169), Slovenia (0.175), South Korea (0.193), Thailand (0.217), and Denmark (0.233). The right side shows the results obtained with the modified model. Here the best performance was achieved by the Netherlands (0.407), followed by Canada (0.414), France (0.442), Belgium (0.452), the United Kingdom (0.461), Thailand (0.464), the United States (0.464), Denmark (0.480), Australia (0.481), and Slovenia (0.484).
It is worth noting that when the modified VIKOR is used for calculation, setting the aspiration level makes the changes of all variables much more apparent. We found that the rankings after the sixth changed, as shown in
Table 6. The United States, Australia, and Slovenia are now ranked among the top 10 countries; Thailand and Denmark’s rankings are higher, and Slovenia’s ranking is reduced.
This new soft computation method based on the traditional VIKOR method, incorporates the aspiration level and worst level into the analysis. Due to the incorporation of the concept of the aspiration level, this analysis method can achieve the goal of finding the best possible solution to pursue in the real world and avoids the problem of having to choose the best solution from among many inferior solutions [
24].
Table 7 shows the final results of the proposed soft calculation and the comparison with other methods. The top three alternatives ranked by the modified VIKOR method were: the Netherlands, Canada, and France. The top three alternatives ranked by TOPSIS were: Vanuatu, Japan, and Uzbekistan. The top three alternatives ranked by GRA were: Croatia, Cambodia, and Cabo. The top three alternatives ranked by Verde COPRAS were: the United States, Canada, and Switzerland.
In addition, in order to illustrate the differences between the methods, this study used Spearman’s rank correlation coefficient to compare the relationship between the modified VIKOR method and other methods. The results are shown in
Table 8. The correlation coefficients between modified VIKOR and other methods were between −0.034 and 0.098, but none of them reached the significant level. This means that the theoretical concept of the results obtained by the modified VIKOR method is different from other methods.
From this, it can be seen that the soft computation technique combined with the modified VIKOR enables the decision-making result to cover more decision information, and at the same time, it allows for the overall evaluation to be more objective and precise.
7. Conclusions
In this study, we discuss a method for the evaluation of a national healthcare system in the face of the global pandemic. This is key to epidemic prevention, creating a competitive advantage, and achieving sustainability on the national level. We propose a new type of soft computing technique. All of the data were retrieved from the international public database and mathematically calculated to acquire the weights of criteria. We then used a modified VIKOR method to find the gap to the aspiration level for each region, in order to avoid the limitations and disadvantages of the traditional methods. This computation technique can be used by countries to quickly assess their healthcare systems and obtain practical directions for improvement based on the gap to the aspiration level. In the case study, we used data from 195 regions around the world to prove the effectiveness of our model. From the results we can obtain the following findings. First, the three most important criteria for assessment of the national healthcare system during a global pandemic are interdisciplinary communication, difficulty of adopting new technology, and infection control. Second, faced with the serious COVID-19 epidemic, the healthcare systems of the Netherlands, Canada, France, Belgium, and the United Kingdom have shown superior performance. Third, the healthcare systems of all regions still have gaps that could be improved upon, and we must all work together for a common goal, to control the spread of the infection.
While this study is expected to make some contribution to national healthcare system evaluations, there are some suggestions for directions for future research. First, the framework for national healthcare system evaluation is quite varied when viewed from different angles; as such, conducting analysis with different assessment frameworks is a worthwhile subject of research. Various research institutes or organizations considered patient satisfaction as one of the criteria to assess the healthcare evaluation system. However, none of those could investigate this criterion worldwide. However, “patient satisfaction” is a useful instrument to value the healthcare process because it provides information about the perceived quality and, therefore, it can be incorporated in a program of valuation and quality improvement. The citizens’ opinions offer the necessary information to adequately manage health resources. For this reason, patient satisfaction has been used to measure the performance of the NHS, since it is an excellent indicator of its quality and effectiveness. A high degree of patient satisfaction is usually linked to advanced compliance of the treatments. Thus, the issue of patient satisfaction should be addressed. Second, the opinions of healthcare experts from different countries could be gathered for analysis, and the results could be compared with existing studies. Third, our data were obtained by transforming quantitative data, so the measures have upper and lower bounds. However, in some cases, assessment criteria do not have upper or lower limits. It would be worth discussing how to set a suitable aspiration level in these situations. Finally, using the healthcare system as an example, different epidemic prevention systems could be compared with our model.