1. Introduction
Urban mobility in Europe accounts for 23% of all road transportation CO
2 emissions and up to 70% of other pollutants from transportation. The question of how to enhance urban mobility while, at the same time, reducing congestion, accidents, and pollution is a universal challenge for all major cities [
1]. The city of Zadar, the fifth largest city in the Republic of Croatia and an important urban, tourist, cultural, and development center of the Adriatic region, also shares these challenges, as the personal car (PC) is the dominant mode of transportation in the Zadar urban area (ZUA) [
2].
Numerous strategies at the international, national, regional, and local (city) levels have been adopted to encourage rail travel as a measure to mitigate PC emissions [
3]. It is a common conclusion that people have less need to use PCs in urban areas with diverse land use and an efficient and integrated public transportation system and that the integration of a rail system in urban transportation is the most efficient way to minimize carbon emissions, improve property values and traffic safety, and reduce congestion [
4,
5]. However, a gradual but constant increase in private mobility (dating back to the second half of the last century) has caused the shutdown of many existing local and/or urban rail lines—rarely used and, therefore, leading to little or even no profit [
6]. Such is the case with the rail line for international, mixed traffic that runs through the coastal part of the ZUA and ends at the railway station in the Zadar city center. Namely, due to a lack of investment in maintaining the functional capacity, development, and modernization of the rail system, passenger rail transportation has become completely uncompetitive and was discontinued ten years ago. Rail freight transportation is also uncompetitive due to the lack of a logistics chain connecting different modes of transportation [
2].
Disused railways worldwide are viewed as a negative space in cities and are often an urban blight that results in a poor-quality urban environment causing many adverse effects. Perhaps the biggest negative effect is reflected through their impact on urban traffic flows and city development, as they block traffic and divide urban spaces. The renewal of these rail transportation facilities in urban areas has become increasingly important, considering their prime location (close to, or even within, the central districts of cities) and the growing requirements for mobility and connectivity [
7].
As finding a new use for disused railways provides an opportunity for low-carbon travel experiences, attracts new public transportation users, and arrests decay processes, disused railway sites are becoming a focus of redevelopment projects in many European cities [
8,
9]. Three common strategies for reusing disused railways include converting them into new rail transit systems, redeveloping the urban land around them for different purposes, or shaping new public spaces. Different reuse strategies have different positive effects on urban space, including the improvement of traffic conditions and the opportunities for land development [
7].
Zadar City’s officials recognized that the existing transportation system was limiting the development of the ZUA and that the increase of accessibility, mobility, and competitiveness of this area could be possible by improving the quality of its rail network while ensuring the physical, operational, and organizational integration of all forms of transportation [
2]. Investments in the ZUA rail infrastructure require significant financial resources that could be secured through the World Bank, the European Development Bank, or European Union funds. However, the possibility of using these funds must be preceded by a justification of the need for investment through the evaluation of planned projects.
Evaluation is a set of activities aimed at determining the justification and acceptability of a particular project, choosing the optimal variant of infrastructure development, and, at the same time, determining the level of investment priority in a specific project. Not so long ago, the choice of the optimal variant included only the analysis of financial criteria through least cost analysis. The step up was cost-effectiveness analysis, based on the identification of so-called benefit–cost ratios. It led to identifying the “value for money” of variants [
10]. On a strategic level, SWOT analysis and context analysis provide a qualitative description of the research subject and, as a rule, represent a valuable instrument for evaluating projects. Such analyses can successfully identify the drivers and barriers to resuming a service on an abandoned railway corridor [
11,
12]. Today, to choose a solution that enables the sustainable development of transportation infrastructure, it is necessary to take into account a large number of evaluation criteria: (1) environmental, including resource use and residuals production; (2) economic, including expenditures (capital, operation, and maintenance) and investment in innovation; (3) engineering, including performance; (4) social, including accessibility, acceptability, health; and (5) safety [
13]. That is why assessments are performed with cost–benefit analysis (CBA) and/or multi-criteria analysis (MCA).
The CBA approach translates Infrastructure project impacts into comparable monetary units, enabling the observation of incremental changes in welfare resulting from the implementation of a project relative to a counterfactual scenario (the economy without the project), to examine whether society is better off with the intervention [
14]. CBA is still widely used in the evaluation of major transportation investment projects [
15,
16], although it has been found that it has certain limitations when incorporating and assessing criteria such as environmental or social issues [
17].
The MCA approach consists of scoring and ranking the proposed infrastructure development variants by weighting predefined criteria imposed on sets of indicators as the measures of infrastructure performance [
18]. It provides the possibility of incorporating factors otherwise difficult to quantify or monetize, as it extends the decision-making process beyond the practical reach of CBA and complements the monetary, financial, and economic considerations with a wider range of criteria. Criteria such as the characteristics of city and region, infrastructure and technical parameters, existing connections, institutional circumstances, and capacity, are evaluated on a sliding scale. This is a rough analysis used by planners while evaluating whether a city is suitable for a chosen rail transportation system [
19], but it can be suitable for local-level projects where qualitative effects are highly relevant. One of the key advantages of an MCA is that it can easily include stakeholder participation, while experts, decision-makers, and public institutions can be involved in the performance scoring and weighting of criteria.
Recent research on the perceived strengths and weaknesses of CBA and MCA, and the ability of each method to support sustainable transportation decision processes, showed that, by adopting a more global and holistic perspective and by facilitating the inclusion of a participative process, MCA (or a combination of CBA and MCA), is a more promising appraisal method for sustainable transportation [
20]. On the other hand, this means that MCA can be very subjective, i.e., the outcomes can be biased [
21].
Although the discourse of sustainable mobility has led to new policies for managing urban and suburban mobility through the development of new and/or the rehabilitation of existing rail infrastructure, the literature review showed that there is no universal, directly applicable methodology for evaluating such projects, due to numerous site-specific conditions. To provide guidance for future urban rail infrastructure feasibility studies in similar conditions, this paper aims to contribute to the process of the evaluation of urban rail infrastructure projects through the presentation of the methodology and the results of a preliminary feasibility study (PFS) of the revitalization, development, and (re)integration of the rail with road, maritime, and air transportation in the ZUA. This contribution will be reflected in the following: (1) the proposal of sustainable urban rail project evaluation criteria (concerning environmental, economic, engineering, social, and safety aspects), (2) the proposal of evaluation criteria indicators, and (3) the proposal of an indicators evaluation criteria quantification process (concerning data availability and level of detail).
The investigation presented in this paper was performed in four steps. The first step was to define the vision of the future transportation system in the ZUA and then to define the goals to be achieved and measures to be performed to make it come to life. The second step was to design multiple variants of rail infrastructure required for achieving the identified vision. The third step was to evaluate the designed variants by multi-criteria analysis supplemented with partial cost–benefit analysis, prioritize them, and select the most preferable one, i.e., the one to be further pursued and elaborated in the ZUA’s transportation system development plans. Additionally, to reduce the influence of stakeholders’ bias, i.e., to ensure a high level of objectivity, auditability, and transparency in the evaluation process, and to assess how the PFS criteria prioritization influenced the results of a proposed decision-making model, a sensitivity analysis was performed where the criteria weights were systematically varied to observe how sensitive or responsive the PFS results are to such changes.
2. Materials and Methods
In this section, the proposed evaluation model is described in detail, while the evaluation methodology is presented in
Figure 1.
To define a vision of the ZUA’s transportation system development, a functional analysis of the existing transportation system was performed. This analysis of existing traffic demand was based on a set of data from secondary, publicly available sources and documents.
According to [
22], the ZUA, spreading over 790 km
2, consists of two cities (Zadar and Nin) and 13 municipalities. According to the population census conducted in 2021 [
23], the average population density is almost twice the national average, and 65% of 108,198 inhabitants live in the city of Zadar where most of the activities and services (social, administrative, health, educational, and recreational institutions) are concentrated. Considering the share of daily migrations to Zadar presented in [
24], the ZUA can be divided into four zones: (1) a continuous coastal urban and urbanized belt, which includes the municipalities that are functionally closely connected to Zadar, with more than 50% of daily migrants; (2) the first belt of landlocked municipalities with more than 50% of daily migrants; (3) the second belt of landlocked municipalities with 30 to 50% of daily migrants; and (4) municipalities on the islands with less than 30% of daily migrants.
According to [
25], the ZUA’s economy is dominated by trade, processing industry, maritime transportation, mariculture, and tourism. It accounts for approximately 3% of the national economy. The share in the national branch economy is very high for three specific sectors: maritime transportation (up to 40%), mariculture (over 70%), and the tourism sector (up to 14%). According to [
22,
24], the greatest potential for the ZUA’s further economic growth lies in tourism and complementary activities. The ZUA tourist sector development has been stimulated by the improvement of communal, tourist, and transportation infrastructure shown in
Figure 2, especially the connection with European transportation corridors via the A1 highway in 2005, the expansion of the passenger terminal building of Zadar Airport, together with the introduction of low-cost airlines connecting Zadar with Central and Western Europe in 2007, and the construction of Gaženica Port for domestic and international ferry transportation and cruisers in 2015.
The backbone of the road transportation system in the ZUA is the state road DC8. It connects the main settlements and Zadar with the A1 highway and other important settlements on the Croatian coast. Also, the four-lane expressway DC424 connects Zadar, Gaženica Port (passenger and freight), Zadar Airport, and the A1 highway.
According to [
26], 86 public buses maintain a schedule of a total of 37 lines with 485 departures per day. They transport around 8 million passengers annually, of which 75% are transported on urban, 20% on suburban, and 5% on island bus lines. The most frequent bus line passes through the central part of Zadar, and one line connects Zadar with Zadar Airport.
Zadar Airport is located 10 km east of Zadar. According to [
27], passenger air traffic is highly seasonal and constantly increasing, with 1.1 million passengers in 2022 (30% more than the record from 2019,
Figure 3). Traffic between the ZUA and Zadar Airport takes place on only one access road, and only 10% of the passengers use public bus transportation. Freight air traffic is occasional and almost negligible in quantities, as shown in
Figure 4.
The maritime transportation system in the ZUA consists of two ports. Zadar Port for national passenger ship transportation is situated in the Zadar City center (peninsula). It connects Zadar with the islands of the Zadar archipelago and Kvarner with nine national shipping lines. It is connected to DC8 through a dense urban fabric. Gaženica Port consists of a passenger, freight, and fishing port. The ferry port connects Zadar with the islands of the Zadar archipelago and Kvarner with five state ferry lines. Its launch in 2015 relieved the passenger port in the Zadar peninsula. The international ferry line Zadar–Ancona and cruisers operate there in the summer months. Today, the number of transported passengers and vehicles in international traffic is stagnating, while the number of passengers from ships on cruises is increasing significantly from year to year, as shown in
Figure 3. The cargo port of Gaženica enables the transshipment of liquid, bulk, and general cargo, and although there is no possibility of accepting container cargo, this is the only port on the Adriatic that can accept and deliver special cargo. It is the main generator of road freight transportation in the area, as shown in
Figure 4 [
28].
The Zadar railway station for international, national, and local rail transportation is situated in the center of the city next to the bus terminal. The rail line constructed in the 1960s continues via Knin through two of the ZUA’s most developed municipalities (Bibinje and Sukošan) and Gaženica Port. Due to years of neglect, i.e., lack of infrastructure development, modernization, and maintenance, it is in an unsatisfactory technical condition. In 2014, it was declared unprofitable for passenger transportation and closed for traffic. Today, passenger transportation between railway stations in the ZUA is carried out by buses, and freight traffic is negligible, as shown in
Figure 3 and
Figure 4 [
23].
According to [
29], PC is the dominant mean of transportation in the area, while public transportation is used to a greater extent only by students, as shown in
Figure 5. Despite the investments in tourist, communal, and transportation infrastructure, tourism in the ZUA is still extremely seasonal. Namely, over half of all tourist arrivals occur in just two summer months, with over 150,000 arrivals in the summer of 2022 [
30]. The large number of tourists in July and August significantly affects traffic demand and the traffic network load, as shown in
Figure 6 [
29].
Determining existing traffic demand and its impact on the ZUA’s traffic supply identified the area’s key transportation problems. After defining the PFS vision for solving these problems, an analysis of the priorities and the objectives given in strategic documents at the European [
31,
32,
33], national [
34,
35,
36], regional [
29,
37], and local levels [
22,
24,
38,
39] was carried out to define PFS objectives compliant with this legal framework. To identify rational measures for ensuring the defined objectives, spatial planning documents at regional, city, municipal, and local scales, masterplans for maritime freight and passenger air transportation infrastructure development, and available preliminary designs of railway infrastructure upgrades were analyzed.
The second step was to define multiple options for revitalization, development, and integration of the rail system with road, maritime, and air transportation in the ZUA. This included the preliminary design of six variants of the railway routes. The existing railway line is a conventional single-track railway line for mixed traffic and a part of the comprehensive EU TEN-T network. As it is potentially important for international traffic, its redesign followed interoperability conditions. The design had to satisfy the following three conditions:
New railway links were intended for local passenger traffic and mixed traffic.
Due to spatial constraints, the location of the rail cargo terminal for Gaženica Port defined in the preliminary design of the bypass of the settlement of Bibinje and the freight station Gaženica [
40] was non-negotiable.
The line from Gaženica Port to Zadar Station was to be for passenger traffic only, and, due to the high degree of urbanization, potential interventions in its route had to be minimal.
The six variants were designed in four realization phases, according to their basic, technological purpose. Phase I diverted the rail line from coastal municipalities, and was designed as a single-track railway for international mixed traffic, with speeds up to 120 km/h and grades up to 12.5 mm/m. Phase II enabled the separation of freight and international passenger transportation and was designed as a single-track railway for international passenger traffic, with speeds up to 80 km/h and grades up to 12.5 mm/m. Phase III enabled the link between Gaženica Port and a logistics center with storage and transshipment capacities in the vicinity of Zadar Airport, and was designed as a single-track railway for local mixed traffic, with speeds up to 100 km/h and grades up to 20 mm/m. Phase IV enabled the link between Gaženica Port and Zadar Airport, and was designed as a single-track railway for suburban and urban passenger traffic, with speeds up to 50 km/h and grades up to 35 mm/m.
The third step was to evaluate the designed six rail route variants. During the process of evaluation method selection, it was observed that variants’ design approached the ZUA’s transportation issues from different angles. This meant that variants could provide different benefits, and contribute differently to the area’s economic, social, and territorial issues. Also, already planned interventions in transportation systems and infrastructure, used as input for variant designs, were at different development stages, ranging from the ones that were only at the conceptual design stage to the partially built infrastructure. Therefore, it was decided that if the variants were to be evaluated by a standard CBA approach, the results could be misleading, i.e., they could lead to ineffective long-term infrastructure decisions. This specific situation called for the consideration of multidisciplinary and multidimensional aspects of the prioritization of the ZUA’s railway system revitalization, development, and integration options. For that purpose, the MCA approach seemed most suitable.
According to [
41], there are two basic approaches to MCA and CBA in the process of transportation infrastructure evaluation. The first involves conducting MCA instead of CBA. It is usually implemented if there are no sufficient or reliable data for the reasonable completion of CBA. Such use of MCA takes place when criteria other than economic and financial are critical, significantly impact project assessment, and reflect beneficiaries’ or investors’ preferences. The second approach treats CBA as a component of MCA. It involves conducting CBA to the level that is allowed by data availability, and the utilization of CBA results as inputs and elements of an MCA. Today, such an approach to MCA is frequently used for prioritizing public transportation infrastructure development variants, especially those that could be funded by international donors, as is the case in the ZUA.
The performance of MCA, i.e., the process of assigning scores to the developed variants of (re)integrating rail with road, maritime, and air transportation in the ZUA, involved defining the variants’ evaluation criteria and their indicators, defining the indicators’ values, their normalization, score calculation for each criterion, assigning weights to the criteria, and calculation of final, aggregated scores for each evaluated variant. Seven evaluation criteria (namely: transport, compliance, costs, environment, institutional analysis, implementation, and risk, each described by several indicators), were defined based on the literature review [
42,
43,
44] and previous experiences of the authors.
The “Transport” criterion was used to evaluate the impact of a particular variant on the existing transportation system based on the following indicators, expressed in track length:
Displacement of railway infrastructure from the coastal municipalities of Bibinje and Sukošan, i.e., from the areas with high potential for further urban and economic development,
Creation of the rail link between the Zadar railway station and Zadar Airport,
Separation of slow and heavy freight from fast and light passenger rail transportation.
The “Compliance” criterion was used to evaluate the compliance of a particular variant with current strategic and spatial planning documents. The criterion indicator was defined as the number of current documents the variant complies with.
The “Costs” criterion was used to evaluate the investment costs of a particular variant calculated based on [
45]. The indicators, i.e., direct investment costs of a particular variant including construction, land acquisition, design, supervision, and consulting, were defined as the eight following basic investment costs, expressed in currency:
Route (track superstructure and substructure) construction,
Facilities (bridges, viaducts, tunnels, underpasses, overpasses) construction,
Stations and stops (track structure, buildings, and platforms) construction,
Systems (electrification, signaling and safety, telecommunications, and central traffic management) construction and implementation,
Noise barrier construction,
Communal installations construction,
Land purchase,
Project design and management.
The “Environment” criterion was used to analyze and evaluate the impact of a particular variant on the environment within the area extending 250 m from the railway line, and environmental protection measures that should be applied given the identified impacts. The twelve indicators of the variants’ impact on the environment, expressed in track length, were the following:
Air quality, expressed as a moderate increase in the concentration of pollutants in the air along the new routes, outside tunnels, and in the vicinity of tunnel portals,
Pollution of surface, underground, and coastal water bodies, and sanitary protection zones due to the possible discharge of polluted water from trains, and in case of accidental situations or improper technical maintenance of the system, along the length of the new routes,
The required length of conversion of agricultural areas to infrastructural areas,
Required conversion of forests to infrastructural areas,
Length of fragmentation of hunting grounds,
Length of variant passing through endangered and rare habitats, and industrial habitats, thus affecting biodiversity,
Length of variant passing through protected nature areas,
Length of ecological network impacted by variant,
Landscape anthropogenicity along the variant route,
Cultural and historical heritage locations along the variant route in phase II,
Number of people with reduced quality of life along the variant route in phase II,
Risk of derailment of freight trains transporting substances harmful and dangerous to the environment along the variant route.
The “Institutional analysis” criterion was used to evaluate the impact of a particular variant regarding the following three indicators, expressed as a number:
Various institutions necessary to be involved in the project,
Necessary procedures when obtaining permits,
Different stakeholders required for the realization of a particular variant.
The “Implementation” criterion was used to evaluate the impact of a particular variant on project construction deadlines and construction dynamics. The measure that was chosen for the construction deadlines indicator was the length of the track, and, for the construction dynamics, the proportion of facilities along the variant route.
The “Risk” criterion was used to evaluate the sensitivity of a particular variant to financial and implementation risks, and climate risks. The measure that was chosen for the financial and implementation risks indicator was the average deviation, i.e., mean absolute deviation, of variant phase length. Generally, the average deviation is calculated similarly to the standard deviation, but it uses absolute values instead of squares to circumvent the issue of negative differences between the data points and their means. To calculate the average deviations of phases’ route lengths, the mean length of all four route phases was calculated for each variant. Then, the difference between the mean length and length of each phase was calculated. Finally, the average of the absolute values of those differences was determined. The measure that was chosen for the climate risk indicator was the proportion of tunnels along variant routes, calculated by dividing the length of the track route in tunnels by the total variant length.
To simplify the procedure, indicators of a criterium that were expressed in identical measure units (costs, environment, and institutional analysis criterion indicators) were summed up for each variant, and the single, total indicator value was defined.
After defining the indicator values for all six variants, scores from 1 to 5 were chosen for their normalization.
Table 1 shows the ranges of indicator values and associated scores. Score 5 was considered the highest score, and it was achievable for the design that could enable the shortest length of existing rail line displacement from two coastal municipalities, the shortest link between Zadar railway station and Zadar Airport, the total separation of passenger rail transportation from Zadar Station to Zadar Airport, full availability of planning documents, the smallest total investment costs, no impact on the environment, the involvement of the smallest number of procedures, institutions, and stakeholders, the shortest construction deadlines, i.e., shortest total track length, the easiest construction dynamics, i.e., no facilities (tunnels, bridges, etc.) along the route, the smallest financial and implementation risks, i.e., the most uniform length of track route phases, and the smallest climate risk, i.e., the placement of most of the tracks underground.
The normalized indicator scores for each variant were determined by linear interpolation. The scores of indicators that were expressed in different measurement units (transport, implementation, and risk criterion indicators) were averaged to obtain the criterium score. The criteria weight ratios presented in
Table 2 as weight combination A were determined through a consultation process in which key stakeholders took part. The individual evaluation criteria scores were weighted and the result of the evaluation of each variant was defined as the sum of the weighted evaluation criteria scores.
In the fourth step, the sensitivity analysis was performed to determine the robustness of the decision-making process. In general, sensitivity analysis is a method for analyzing the effect of uncertainty in the output of a system, subject to uncertainties in the inputs. To observe the effect of uncertainties, the inputs to the system are varied and their corresponding effect on the outputs is studied [
46]. In this case, the inputs were the weightings of the criteria, and the output was the ranking of development variants. This allowed the influence of changes in the weights of criteria (presented in
Table 2, as weight combinations B to F) on the variants’ evaluation scores to be tested. To simplify the procedure, the 30% weight was varied systematically between transportation, compliance, cost, environment, institutional analysis, and implementation criteria, and the risk criterion in all analyzed weight combinations remained unchanged, at 10%.
5. Conclusions
Today, the evaluation of planned rail infrastructure projects in the context of sustainable urban development is a fundamental requirement. Both the construction of new and the renewal of existing rail transportation facilities in urban areas has become increasingly important, considering the growing requirements for green mobility and connectivity. To choose an urban rail project solution that enables sustainable urban development, it is necessary to consider numerous quantitative and qualitative evaluation criteria: environmental, economic, engineering, social, and safety. Due to the sustainability criteria’s specificity, and the premise that there are no “bad projects”, but only wrong decisions when choosing the project evaluation procedure, the necessity to improve existing or create new complex rail infrastructure evaluation models that combine different methods is clear.
This paper presented the investigation of combining multi-criteria analysis with partial cost–benefit and sensitivity analyses for decision-making in the field of rail infrastructure in urban areas. The investigation was performed based on data obtained and created during the design of a pre-feasibility study for (re)integrating rail with road, maritime, and air transportation in the Zadar urban area. The investigation process was divided into four steps: (1) identification of vision, objectives, and measures for rail transportation system development, (2) design of six variants of railway route alignments, (3) evaluation of designed variants by performing multi-criteria analysis supplemented with partial cost–benefit analysis, and (4) sensitivity analysis of the evaluation results.
The results of the preliminary feasibility study showed that rail infrastructure revitalization, development, and integration present an opportunity to pursue a sustainable transportation system in the Zadar urban area by strengthening local public transportation and, consequently, reducing traffic congestion, increasing safety, and liberating space for environmentally friendly zero-emission mobility solutions. At the same time, the results provided the decision-makers with a sustainable approach for further elaboration of the spatial planning documents.
The results of the investigation showed that the use of multi-criteria analysis can contribute to the quality of decision-making in the field of urban rail infrastructure revitalization, development, and integration projects. The preconditions that must be met are well-defined project vision, objectives, and measures, the elaboration of the track design to the level of detail required to properly determine the indicator values of selected criteria, and a comprehensive selection of the criteria. If these are met, then the proposed model for project evaluation can ensure a high level of objectivity, auditability, and transparency of the urban rail infrastructure evaluation process, at least on the pre-feasibility study level.