1. Introduction
In the modern context of sustainability and environmental responsibility, railways play a crucial role in promoting environmentally friendly forms of transportation. Despite its significance, the railway sector faces challenges of decreasing market share regarding the other modes of transportation. Initiatives for liberalization and market competitiveness in the railway sector began with implementing Directive 91/440 [
1]. Since the 1990s, the revitalizing railways has become a key goal of EU transport policy. As stated in the European Commission’s White Paper of 2001, rail transport is a strategic sector, upon which the success of efforts to shift the balance between modes of transportation will depend [
2]. The White Paper published in 2011 set a target whereby 30% of road freight over 300 km should shift to other modes, such as rail or waterborne, by 2030, and more than 50% should transition to green freight corridors by 2050 [
3]. To enhance the competitiveness of the railway sector, improving performance is essential, with a particular focus on the key stakeholders—railway infrastructure managers (RIMs). In this context, RIMs emerge as pivotal figures in attaining sustainability objectives and bolstering competitiveness. Numerous countries have chosen to restructure the railway sector and achieve greater efficiency and service quality by delineating the responsibilities of infrastructure managers and operators. This transformation aims to establish a more transparent division of duties, fostering increased transparency and stimulating market competition [
4]. Therefore, analyzing the operational efficiency of RIMs and operators becomes necessary.
Effective management of railway infrastructure is crucial to ensure safe and reliable traffic, optimal capacity utilization, reduced delays, and improved passenger experience. In this context, analyzing RIM performance becomes imperative to understanding their effectiveness in achieving set goals. Assessing RIMs’ performance requires considering the diversity of managers’ operations in different countries, which results from factors such as the size of the railway network, restructuring models, and the number of operators. The European Commission launched the Platform for European Railway Infrastructure Managers (PRIME) in 2013 to create a standardized platform for performance monitoring. Through PRIME, a catalog of key performance indicators (KPIs) has been developed to systematize KPIs to cover all dimensions of infrastructure managers’ operations: the contextual framework, safety and environment, performance, delivery, finance, and growth [
5]. This study focuses on selecting the most important KPIs of RIMs to identify best practices and analyze results to gain a deeper understanding of RIM efficiency. A novel hybrid multi-criteria decision-making (MCDM) model has been developed in this study. The first part of the model determines the relative importance and weights of RIMs’ KPIs using the fuzzy Delphi method and the extended fuzzy analytic hierarchy process (AHP) method. The second part employs the axial distance-based aggregated measurement (ADAM) method for ranking RIMs. Expert opinions from the field of railway infrastructure management played a crucial role in determining the relative importance and weight of KPIs. This approach aims to enhance the understanding of RIM performances, providing a concrete model for selecting and weighting KPIs, and analyzing RIM performances. The ultimate goal of the research is to identify the RIM with the highest potential, providing a foundation for further improvement and development strategies in the sector. This research contributes to the growing area of performance monitoring in the railway sector and provides a basis for further development in this important domain.
The rest of the paper is structured as follows.
Section 2 provides an overview of the relevant literature, examining issues of efficiency and performance assessment in the railway sector, including the role of RIMs. A literature review of the methods used is also provided, contributing to a deeper understanding of the topics addressed in the research on efficiency in the railway sector.
Section 3 presents an overview of the dimensions of KPIs to be covered in the study.
Section 4 describes the hybrid model developed for evaluating RIMs.
Section 5 presents the results of applying the developed model to rank nine selected European RIMs according to defined KPIs. It also provides sensitivity analysis and validation of the obtained results and developed methodology.
Section 6 discusses the findings, explores their practical and theoretical implications, and highlights their limitations. The final section,
Section 7, concludes the paper and suggests directions for future research.
3. Key Performance Indicators for RIMs
In today’s dynamic environment of the European railway sector, performance evaluation has become a key determinant of success. The introduction of European sustainable and smart mobility strategies, such as the European Green Deal, sets ambitious goals for the railway sector by 2050. In this context, the performance evaluation of railway operators and infrastructure managers becomes essential to ensure the achievement of these goals, enhance sector efficiency, and lay the foundations for developing a sustainable, safe, and innovative railway system in Europe. Infrastructure managers are responsible for developing, maintaining, and managing all aspects of railway infrastructure. Their ability to achieve high performance is essential for sustainability and innovation in the European railway sector.
Performance is integrated into European railway regulation, encompassing various technical and market regulation aspects. According to the Fourth Railway Package [
81], RIMs are committed to collaborating in monitoring and comparing performance and participating in railway market monitoring. Evaluating the performance of IMs is essential for several reasons. First, it provides insight into the efficiency of their operations, which is crucial for ensuring the proper functioning of railway traffic. Through these evaluations, any potential shortcomings or areas for improvement can be identified [
32]. Second, performance research helps maintain high service standards for railway users. Timely problem resolution and improvement can be ensured by monitoring performance and addressing aspects such as schedule accuracy, infrastructure maintenance, and safety. Performance assessments also contribute significantly to the transparency of railway infrastructure managers’ operations, ensuring accountability to users, regulatory bodies, and the public. This transparency fosters trust within the railway sector. Furthermore, regular performance evaluations form the foundation for making well-informed decisions within the organizations of infrastructure managers and at regulatory and community levels. This is indispensable for maintaining safe, efficient, and sustainable railway systems.
Effective management of railway infrastructure and collaboration among infrastructure managers are pivotal for advancing the railway sector in Europe. These efforts aim to attract new operators and users and ensure the seamless functioning of the Single European Railway Area. The PRIME project, launched upon the European Commission’s recommendation, seeks to bolster collaboration among infrastructure managers, enhance the implementation of ERTMS, and achieve harmonization. PRIME has released a comprehensive catalog of KPIs, categorized into six dimensions, each delineating specific characteristics and objectives [
5]:
Dimension C: Contextual Framework encompasses a range of indicators aimed at providing a deeper understanding of the specific characteristics of each IM. This dimension comprises KPIs that shape each infrastructure manager and facilitate comparisons between different railways. The objective is to enhance comprehension of the specific attributes of each IM.
Dimension S: Safety and Environment focuses on ensuring safety in railway traffic and environmental protection. This involves monitoring and managing safety behavior and standards. The goal is to ensure that railway traffic is safe for passengers, freight, and the environment.
Dimension P: Performance analyzes the performance of assets and the railway network. This includes assessing speed, reliability, and the quality of services provided by IMs. The goal is to ensure that the railway system is efficient and meets the needs of operators and users.
Dimension D: Delivery assesses the effectiveness of internal processes within IMs, encompassing asset management, infrastructure maintenance, and enhancement, as well as service provision to contractors and suppliers. The objective is to guarantee efficient resource utilization and high-quality services.
Dimension F: Finance analyzes the financial performance of IMs, including cost tracking, revenue, and access charge collection for infrastructure. The aim is to ensure economic sustainability and efficient financial management.
Dimension G: Growth pertains to increasing the utilization of existing railway networks, improving infrastructure, expanding the network, and integrating with other modes of transportation. This dimension also promotes the use of new technologies to enhance service delivery. The goal is to stimulate the growth and development of the railway sector.
Each of these dimensions has its specific performance indicators and goals, and monitoring them enables a comprehensive understanding of the work of RIMs, a better grasp of their position in the railway industry, and the identification of areas requiring improvement. This study encompasses all the mentioned dimensions to gain insight into the overall efficiency of railway infrastructure management. The indicators selected are those characterized as high-priority by PRIME and those used for benchmarking RIM analyses.
Table A1 provides a list of selected performance indicators, offering a detailed overview of various aspects of RIM performance evaluation.
4. Proposed Hybrid MCDM Model
The hybrid model for evaluating RIMs is based on the integration of multicriteria decision-making methods, fuzzy Delphi, E-FAHP, and the ADAM method. Structurally, the model consists of three key parts. In the first part of the model, the fuzzy Delphi method is used to assess the importance of KPIs. This method engages a panel of experts to reach a consensus on the importance of indicators, using a fuzzy approach to account for uncertainty and ambiguity in expert assessments. The aim is to obtain a shared view of the importance of indicators and identify key indicators contributing to the success of RIMs. The second part of the model utilizes the extended fuzzy AHP method to determine the weights of KPIs. This method enables hierarchical evaluation and allocation of weights to different dimensions and KPIs within the hierarchy. It integrates a fuzzy approach to account for uncertainty in expert assessments, providing a more precise determination of the impact of different indicators on performance evaluation. The third part of the model uses the ADAM method to rank RIMs. The ADAM method uses the weights of indicators obtained from the extended fuzzy AHP method to assess and rank RIMs. This approach provides a final assessment and ranking based on defined indicators and their weights.
Figure 1 provides an overview of the hybrid model for evaluating RIMs, and the steps to implement this model are detailed in the following section.
Step 1: The initial phase includes forming a list of KPIs, with the selection of experts possessing relevant experience and knowledge to participate in the decision-making process.
Step 2: With the finalized list of KPIs and the chosen experts, surveys are distributed to the experts to assess the importance of each indicator. This assessment employs a five-point Likert scale, as depicted in
Table 2.
Step 3: Subsequently, the importance of KPIs is evaluated using the fuzzy Delphi method. This process involves the following sub-steps:
Step 3.1: Determination of the threshold value ‘
d’. The threshold value is crucial in determining the degree of consensus among experts. To achieve consensus among experts for each item, the threshold value (
) must not exceed 0.2 [
84]. The equation used to determine the threshold (
d) is:
where
are the minimum, reasonable, and maximum values of the fuzzy assessment grade
, and
represent the minimum, reasonable, and maximum values of the fuzzy number
, which signifies the average value of all grades from
Table 2.
Step 3.2: Verification of Expert Consensus. In this stage of the fuzzy Delphi method, we assess the fulfillment of the second prerequisite, which pertains to expert consensus, specifically whether it is ≥75% for each item. If the percentage of expert consensus is ≥75% for each item, then the item is regarded as having achieved expert consensus [
84]. The percentage of expert consensus can be calculated using the following equation:
Step 3.3: Defuzzification Process and Final Decision Making. In the fuzzy Delphi method, the defuzzification process involves assessing the third prerequisite, known as the α-cut threshold, which should be greater than or equal to 0.5. This threshold indicates the minimum level of agreement among experts required for accepting an item [
84]. To ascertain the acceptability of an item, the equation for calculating the fuzzy value
is used:
If the value
is greater than or equal to the α-cut value, set at 0.5, then the item is considered acceptable. Based on meeting the three prerequisites, an assessment is made regarding whether the items will be retained or discarded. The prerequisites for retaining items based on expert consensus are [
85]: threshold value
, percentage of expert consensus ≥75%, average fuzzy value (“
” value) ≥ 0.5. All three prerequisites must be met for the items to be retained.
Step 4. The next step involves obtaining indicator weights using the extended fuzzy AHP method, which includes the following sub-steps:
Step 4.1: Indicator Evaluation Matrices. After creating the hierarchical structure, an
n ×
n comparison matrix is formed (Equation (4)). Experts compare one indicator to another using linguistic values, considering the overall goal. The linguistic values are transformed into triangular fuzzy numbers (TFNs) by applying the relationships in
Table 3.
where
is the number of indicators to be evaluated and
is the importance of indicator
i compared to indicator
. If
in the comparison matrix, then the value will be (1, 1, 1).
Step 4.2: Geometric Mean of the Weights of Experts. After converting linguistic into fuzzy values, the method proposed by Buckley [
86] is used to aggregate responses from multiple experts. If we have a matrix of fuzzy numbers expressed using parameters
(smallest possible value),
(most promising value), and
i (largest possible value), the geometric mean
is calculated as follows:
where
krepresents the total number of decision-makers,
.
Step 4.3. Consistency Check. The consistency index (
) and consistency ratio (
) are used to assess measurable consistency within the AHP method [
87].
is the largest eigenvalue of the comparison matrix,
is the dimension of the matrix, and
is a random index depending on
. To calculate
, a transformation of comparison matrices, represented as triangular fuzzy numbers, into crisp matrices is performed [
88]. A triangular fuzzy number, denoted as
can be defuzzified into a crisp number using Equation (9), thereby obtaining a crisp matrix:
If the calculated of the comparison matrix for is less than 10%, the consistency of pairwise assessments can be considered acceptable. Otherwise, the assessments provided by the experts are considered inconsistent, and it is necessary to repeat the pairwise comparison matrix.
Step 4.4. Calculate Fuzzy Synthetic Extent Value. The extended method is utilized to evaluate the performance of each object concerning the established goal. The set of objects is denoted as while the set of goals is denoted as . Each object from set is individually analyzed concerning each goal from set . Once the analysis is completed, “” values of extended analysis are obtained for each object. These values are denoted as , , where () are triangular fuzzy numbers.
Let
be the values of extended analysis for the
-th object concerning
goals. Then, the value of the fuzzy synthetic range regarding the
-th object is defined as:
The value
is estimated by adding the fuzzy values for range analysis using the addition operation (Equations (11) and (12)).
After calculating the values of extended analysis and performing certain fuzzy operations with these values, the mathematical expression for calculating the inverse vector is used according to Equation (13):
Step 4.5. Determine the Comparative Superiority. In this step, the degree of possibility (
) is introduced, which measures the probability that one fuzzy number
is greater than another fuzzy number
When there exists a pair (x, y) such that
and
, then
Since
and
are convex fuzzy numbers, therefore
where
is the ordinate, the highest point of intersection
between
and
(
Figure 2).
When
and
, the ordinate of the point is determined by the following equation:
For comparing and , both values of the expressions and are needed.
Step 4.6. Select the Minimum Value of Superiority. In this step, the degree of possibility for a convex fuzzy number to be greater than k other convex fuzzy numbers
Mi, where
i varies from 1 to
k, is determined. The degree of possibility is determined by the minimum values of the degree of possibility for each condition
. In other words, the expression signifies the minimum probability that the convex fuzzy number
is greater than each of the
.
Step 4.7. Calculate the Weight Vector and Normalize it for Each Criterion. This procedure aims to determine the weight vector for each criterion, which is used in the analysis. Firstly, the relative superiority between every two fuzzy numbers is determined, and then the minimum superiority is selected for each criterion.
The weight vector
is calculated using the following equation:
represents the number of elements.
The obtained weight vector is normalized to the final normalized weight vector
W, which is utilized in further analysis.
where
W is a nonfuzzy number.
Step 5. In this step, the ADAM method is used for ranking alternatives after obtaining the relative weights of indicators using the E-FAHP method.
Step 5.1: Define the decision matrix
E, whose elements are evaluations
of alternative
according to criterion
, i.e., the magnitude of vectors corresponding to evaluations of alternatives according to the criterion.
where
is the total number of alternatives, and
is the total number of criteria.
Step 5.2: Define the sorted decision matrix
elements, which are
, indicating the sorted evaluations
eoj in descending order of importance (weight) of the criteria:
Each element represents the sorted evaluation in descending order of importance (weight) of a specific criterion.
Step 5.3: Define the elements of the normalized sorted matrix
, which are normalized evaluations
obtained as:
where
is the set of benefits, and
is the set of cost criteria.
Step 5.4: Find the coordinates
of reference points
and weighted reference points (
) defining the complex polyhedron as follows:
where
is the angle determining the direction of the vector defining the value of the alternative, obtained as:
Step 5.5: Find the volumes of complex polyhedra
as the sum of volumes of pyramids it is composed of, using the following equation:
where
is the volume of the pyramid obtained by applying the following equation:
where
is the surface of the base of the pyramid defined by the reference and weighted reference points of two consecutive criteria, obtained by applying the following equation:
where
is the Euclidean distance between the reference points of two consecutive criteria, obtained by applying the following equation:
where
and
are the magnitudes of vectors corresponding to the weights of two consecutive criteria:
where
is the height of the pyramid from the defined base to the apex located at the origin (
), obtained by applying the following equation:
where
is the semi-circumference of the triangle defined by the
and
coordinates of two consecutive criteria and the origin, obtained as:
where
and
are the Euclidean distances of the reference points of two consecutive criteria from the origin, obtained as:
Step 5.6: Ranking alternatives according to decreasing values of volumes of complex polyhedra (o = 1,…, m). The best alternative is the one with the highest volume value.
5. Application of a Hybrid MCDM Model for Evaluating RIMs
In this section, a hybrid MCDM model for the evaluation and ranking of RIMs is applied. An analysis of the research results, including sensitivity analysis, is presented. To evaluate KPIs, the process began with the definition of an initial list of indicators and the selection of experts to participate in the research (Step 1). Experts were chosen based on their specialization in railway infrastructure management, deep understanding of working conditions in the railway sector, significant authority in the field, and a minimum of five years of experience.
Table A2 provides an overview of the data on experts included in the research. The panel included representatives from the railway infrastructure management sector of the Republic of Serbia, Albania, Montenegro, and Bosnia and Herzegovina, as well as academic experts in railway infrastructure. Overall, fourteen experts were selected for this phase of the research.
The questionnaire with KPIs (
Table S1) and their explanations was distributed to the experts via email, accompanied by a request to rate the importance of the indicators using a five-point Likert scale from
Table 2 (Step 2). To boost response rates, targeted respondents were contacted through telephone calls and messages containing explanations, allowing ample time for their responses. Subsequent analyses were conducted based on the received feedback (
Table S2).
In the next step (Step 3), the fuzzy Delphi method was applied to assess the significance of KPIs. Linguistic expressions were converted into fuzzy numbers using the relationships outlined in
Table 2. The threshold value (
) was determined using Equation (1) (Step 3.1), while the percentage of expert consensus was calculated using Equation (2) (Step 3.2). Additionally, the average fuzzy value “
” was computed using Equation (3) (Step 3.3). All three prerequisites must be satisfied for the indicators to be retained. The results of the fuzzy Delphi method and the final decisions regarding the retained indicators are presented in
Table 4.
The expert ratings indicate the high importance of 45 KPIs in the context of railway infrastructure management, thus they were selected for analysis. The fuzzy Delphi method demonstrated satisfactory and good overall results in this research. The first condition of the fuzzy Delphi method, the threshold value
, was satisfied by 95.56% of the indicators. The second condition, the percentage of expert consensus ≥ 75%, was met by 77.78%. The third condition, the average fuzzy value A ≥ 0.5, was fulfilled by all indicators. Finally, a framework for evaluating the performance of RIMs was defined, consisting of 35 KPIs as shown in
Figure 3.
In the next step (Step 4), the E-FAHP method is applied to obtain the weights of the indicators. A hierarchical structure is defined, representing the relationships within the structure and enabling comparisons between each pair at each level within the hierarchy. The hierarchy consists of three levels: at the top is the level representing the research objective, which in the context of modeling involves determining the KPIs for evaluating the performance of RIMs; the second level consists of six performance dimensions; the third level encompasses the final KPIs within each dimension. After forming the hierarchical problem structure, a questionnaire for pairwise comparisons of KPIs within each dimension was composed (
Table S3). The same experts as in the first part of the model made the evaluations.
Linguistic expressions are transformed using relationships from
Table 3. to create a matrix for evaluating dimensions and KPIs, using Equations (4) and (5) (Step 4.1) (
Table S4). The geometric mean of fuzzy expert ratings is calculated using Equation (6) (Step 4.2), followed by checking the consistency of comparison matrices using Equations (7)–(9) (Step 4.3). Subsequently, the calculation of the fuzzy synthetic value range is performed using Equations (10)–(13) (Step 4.4), identification of comparative superiority using Equations (14)–(16) (Step 4.5), determination of the minimum value of superiority using Equations (17) (Step 4.6), and finally, calculation of weight vectors and their normalization for each criterion using Equations (18)–(20) (Step 4.7). The final weights of the KPIs are obtained through an iterative process where the described procedure is repeated for each group of KPI dimensions and the KPIs within them. After calculating the weights of all KPI dimensions and KPIs, the final values are obtained by multiplying the weights of KPI dimensions by the weights of KPIs within their respective dimensions. The results of the E-FAHP method are presented in
Table 5.
The indicator P4—Percentage of canceled passenger trains caused by RIM is ranked first. Its exceptionally high weight suggests that the reliability of passenger services is crucial, and cancellations represent the most significant challenge to address. The indicator P3—Number of minutes delay per kilometer caused by RIM is also highly ranked, indicating the importance of reducing delays caused by infrastructure issues. The indicators P1—Passenger train punctuality and P2—Freight trains punctuality hold high positions as well, emphasizing the importance of precision in adhering to schedules. S2—Fatalities and serious injuries and S1—Significant accidents are also highly ranked indicators, highlighting the necessity of improving safety standards and reducing injuries.
In the next step (Step 5), the ADAM method is applied to evaluate and rank RIMs by assigning weights to selected indicators. A dataset has been compiled for nine European RIMs based on data extracted from PRIME reports for the year 2021 [
89]. These RIMs include Bane NOR from Norway, DB Netz AG from Germany, Infraestruturas de Portugal S.A. from Portugal, PKP PLK from Poland, ProRail from the Netherlands, SBB CFF FFS from Switzerland, SNCF RÉSEAU from France, Správa železnic, s.o. from the Czech Republic, and Trafikverket from Sweden. For confidentiality purposes, the identities of the railway infrastructure managers are anonymized and referred to as RIMs in the presentation of results. The ranking of RIMs was conducted using the ADAM 1.2-beta software package developed by Krstić et al. [
76], which relies on the values of corresponding polyhedron volumes. The acquired volumes are presented in
Table 6. The top-ranked RIM according to the ADAM method is RIM2.
The ADAM method also allows for visual representation, namely a graphical depiction of the polyhedron surfaces defined by reference and weighted reference points (
Figure 4). The polyhedron volume of RIM2, obtained using the ADAM 1.2-beta software package, was the highest compared to other RIMs. On the other hand, RIM3 was the lowest ranked based on the values and weights of the selected KPIs. The ADAM method also enables visual representation or graphical depiction of polyhedron surfaces.
5.1. Sensitivity Analysis
The sensitivity analysis aims to evaluate the stability of the obtained solution by adjusting the weights of the KPIs. Twelve scenarios were defined for this purpose. In the initial four scenarios, the weight of the most crucial indicator (P4) was gradually decreased by specific percentages: 50%, 70%, 90%, and 100%, respectively. In these scenarios, the weights of the remaining KPIs were adjusted to ensure that their total sum remained constant at 1, despite any alterations in the weight of the primary indicator [
76]. Similarly, the eight subsequent scenarios adopted a comparable approach, where the weights of the second and third most important indicators (P3 and P1) were decreased by identical percentages, with proportional adjustments made to the remaining weights. Subsequently, these scenarios were compared against the rankings obtained in the baseline scenario (SC0).
Based on the results of the sensitivity analysis (
Table 7), it is observed that the rankings remained unchanged in all scenarios except for SC5. In this scenario, RIM3 and RIM4 changed positions, as did RIM9 and RIM7. Upon analyzing the rankings of RIMs in the defined scenarios, as shown in
Figure 5, it is evident that there are no significant variations in the results. Therefore, it can be concluded that the ranking obtained in the baseline scenario demonstrates satisfactory stability.
5.2. Validation of Results
The validation of the obtained results and the methodology used was performed by comparing them with the results obtained using other widely used MCDM methods such as TOPSIS, VIKOR, COBRA, SAW, COPRAS, and AHP. The final ranks of RIMs obtained by these methods are shown in
Table 8. The Spearman correlation coefficient (SCC) was used to assess the similarity of the obtained results. These values for each method are also shown in
Table 8. The mean SCC value of 0.908 indicates that the ranking obtained by the ADAM method has a very high degree of correlation with the results of other methods, which additionally emphasizes the stability and quality of the obtained solution. Compared to the TOPSIS, VIKOR, and COBRA methods, the ADAM method simplifies decision-making by visually highlighting the best alternative, making it easily identifiable. In contrast to methods such as SAW, COPRAS, and AHP, ADAM stands out for its efficiency, requiring significantly fewer resources, particularly time and human effort, for evaluation and implementation. A comparative view of the obtained results is shown in
Figure 6.
6. Discussion
The research results indicate the impressive performance of RIM2 across various dimensions of railway infrastructure management, reaffirming their high position in the ranking encompassing 35 KPIs. Through the analysis of six dimensions, including the contextual framework, safety and environment, performance, delivery, finances, and growth, RIM2 stands out as an outstanding example of excellence in the sector. Their commitment to quality and efficiency in service provision is reflected in the results, providing stakeholders and decision-makers with a comprehensive view of their leadership. Additionally, RIM2 can serve as an inspiration to other RIMs, offering a model for achieving high standards in this industry. Furthermore, these results not only provide insights into current performance but also prompt consideration of practices that could serve as a model for achieving high standards in the industry. The inspiration provided by RIM2 to others can stimulate performance improvement and the pursuit of excellence. Through an objective assessment of KPIs, this analysis aids decision-makers in informed planning, encouraging fact-based decision-making. Additionally, the results can foster competition within the industry, prompting other organizations to enhance their operations to remain competitive in the railway infrastructure market. This analysis provides a crucial framework for decision-makers to better understand the state of the railway industry and identify opportunities for improvement. The proposed hybrid MCDM model enables a comprehensive evaluation of RIMs, encompassing the assessment of KPIs’ importance, defining the weighted values of KPIs, and ranking RIMs. This approach represents a significant advancement compared to previous research, which primarily relied on benchmarking analyses of individual indicators across RIMs [
14], analysis of KPIs for two RIMs [
33], or benchmarking analyses of RIMs using KPIs [
89].
Using the fuzzy Delphi method for assessing the importance of indicators instead of the classical Delphi method brings advantages in situations where we face uncertainty, subjectivity, or different interpretations among experts. The classical Delphi method has its drawbacks, including imperfect interpretation of expert opinions due to a lack of consideration for uncertainty, lack of clear rules for achieving desired results, and loss of interest and data from experts due to the lengthy process that can result in re-surveys [
40]. The fuzzy Delphi method brings significant benefits, including reducing the time for evaluation in questionnaires/surveys and reducing the number of survey rounds. It allows experts to anonymously express their opinions without fear of ambiguity or bias, resulting in greater completeness and consistency of opinions. It also facilitates consensus among experts without compromising their initial views, allowing them to freely express their genuine reactions to questions or assessments of criteria, factors, and the like. The final decision is based on satisfying three prerequisites: the threshold value “
”, expert consensus, and defuzzification value “
”.
The ADAM method, used for ranking RIMs in this study, represents an innovative approach in this specific field. It is important to note that this method, utilized to achieve final results and rankings, has not been previously applied in the realm of railway infrastructure. This original application of the ADAM method contributes to new insights and expands the range of methodologies used in research related to the performance evaluation of RIMs. This approach further confirms the innovation of the research, standing out as a contribution to the development and application of new methods in this specific domain.
The proposed MCDM model represents another significant contribution of this study. The fuzzy Delphi method confirmed the importance of indicators and was used as a tool for pre-validation to select appropriate indicators before undergoing the validation process. The combination of the fuzzy Delphi, extended fuzzy AHP, and ADAM methods adds further value to the decision-making process as it covers different phases of analysis, from gathering expert opinions, and determining indicator weights, to final alternative ranking. This integrated approach enables decision-makers to better understand and quantify uncertainties and complexities in the decision-making process, thereby contributing to a more precise and comprehensive analytical framework.
Despite its significant advantages, the developed model for analyzing the performance of RMIs faces several challenges and limitations that require careful analysis. Firstly, reliance on subjective expert opinions implies that the quality of the results directly depends on the experience, expertise, and interpretations of individual experts. This can lead to potential variations in the final results and interpretations, which may affect the reliability and validity of the analysis. Secondly, the availability of experts and their willingness to participate in the analysis process, as well as the time required to collect their responses, pose challenges. Finally, the availability of relevant data, including the values of KPIs for RIMs, is also crucial. Therefore, it is necessary to carefully consider these limitations when applying the model and to develop strategies to overcome or mitigate them.
This study provides a wide range of potential applications. The theoretical contribution of the study lies in the fact that the results can benefit researchers and the academic community in further understanding the complexity of RIM performance, providing new insights into integrated analysis models. Additionally, this study can serve as a foundation for further research in the optimization and enhancement of performance in the railway sector. On a practical level, the results of this research can be valuable for policymakers, RIMs, and other relevant stakeholders in the industry in shaping policies and strategies for the development of the railway sector, as well as in identifying priorities for investments and improvements. Ultimately, this research can contribute to more efficient and sustainable functioning of railway infrastructure, which can have a positive impact on society as a whole through improved connectivity, economic development, and environmental protection. The developed MCDM model is not only a practical tool for addressing specific issues in the railway sector but also provides a basis for broader application in other industries and domains facing complex decision-making. Its flexibility and adaptability enable its use in various contexts, making it a contribution not only to MCDM theory but also to the broader field of decision-making.
7. Conclusions
Directive 91/440/EC initiated the reform of European railways, resulting in the creation of a new key player, the RIM, whose role is essential for the performance of the railway sector. As the sole provider of railway capacity to train operators, RIMs provide a crucial input to operators. In the conditions of an open market, high standards become imperative, requiring continuous alignment and improvement of performance in this sector. Infrastructure managers are faced with the need to meet high demands for transparency, efficiency, and service quality. Performance evaluation becomes a crucial activity in this context, providing deeper insights into efficiency, identifying areas for improvement, and supporting ongoing compliance with evolving standards.
The proposed hybrid MCDM model evaluates the performance of RIMs according to KPIs. A significant contribution of this research is the creation of a hybrid model that combines the ADAM method with the fuzzy Delphi and extended fuzzy AHP methods, thereby developing a universal decision-making tool in various fields. Other important contributions of this research focus on the analysis and resolution of the identification of KPIs of RIMs, assessing their importance, and assigning weight values. Finally, a significant contribution is the identification of the most efficient RIM. So far, there has been no research in the literature dealing with performance analysis based on performance indicators, or studies systematically analyzing, evaluating, and ranking different RIMs. Ultimately, the contribution of the proposed model lies in its comprehensiveness, innovativeness, and applicability in real-world conditions, providing a valuable tool for evaluating RIMs.
The proposed model for analyzing RIMs faces several challenges and limitations, including reliance on subjective expert opinions, the availability of experts, and response time, as well as the availability of relevant data on the values of KPIs of RIMs. The research has identified guidelines for future research in the context of evaluating the performance of RIMs. Future research in the field of evaluating RIMs could explore different methodologies to enrich the analysis and make comparisons between models. Additionally, future research could assess the effectiveness of the model on a larger sample of RIMs, providing a deeper understanding of its applicability and results. The analysis should also compare the results with other relevant studies in this area to confirm the consistency and generalization of the conclusions. Future research could deepen the analysis of the impact of external factors on the performance of RIMs. Research should also carefully consider changes in legislation, technological advancements, and the organizational model of the railway sector. A deeper understanding of these factors could contribute to the context of performance analysis, allowing for a better understanding of the impact of these elements on evaluation results. Additionally, research could analyze how the organizational model of the railway sector influences the performance of RIMs, contributing to a broader understanding of the complexity of factors shaping success in this industry.