Next Article in Journal
Corporate Power in the Bioeconomy Transition: The Policies and Politics of Conservative Ecological Modernization in Brazil
Previous Article in Journal
Budo in Physical Recreation as a Form of Rapprochement to Nature
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Evaluating Performance of Public Transport Networks by Using Public Transport Criteria Matrix Analytic Hierarchy Process Models—Case Study of Stonnington, Bayswater, and Cockburn Public Transport Network

1
School of Electrical Engineering, Computing and Mathematical Sciences, Curtin University, Perth, WA 6845, Australia
2
School of Architecture and Planning, Fujian University of Technology, Fuzhou 350118, China
*
Author to whom correspondence should be addressed.
Sustainability 2021, 13(12), 6949; https://doi.org/10.3390/su13126949
Submission received: 5 May 2021 / Revised: 16 June 2021 / Accepted: 16 June 2021 / Published: 21 June 2021

Abstract

:
To mitigate car traffic problems, the United Nations Human Settlements Programme (UN-Habitat) issued a document that provides guidelines for sustainable development and the promotion of public transport. The efficiency of the policies and strategies needs to be evaluated to improve the performance of public transportation networks. To assess the performance of a public transport network, it is first necessary to select evaluation criteria. Based on existing indicators, this research proposes a public transport criteria matrix that includes the basic public transport infrastructure level, public transport service level, economic benefit level, and sustainable development level. A public transport criteria matrix AHP model is established to assess the performance of public transport networks. The established model selects appropriate evaluation criteria based on existing performance standards. It is applied to study the Stonnington, Bayswater, and Cockburn public transport network, representing a series of land use and transport policy backgrounds. The local public transport authorities can apply the established transport criteria matrix AHP model to monitor the performance of a public transport network and provide guidance for its improvement.

1. Introduction

Worldwide, metropolitan areas of numerous countries are facing a set of urgent issues related to the growing trend of private car usage and the subsequent damage to the environment [1]. In response to these issues, one major approach is to use public transport [2]. In 2015, the United Nations Human Settlements Programme (UN-Habitat) issued a document giving guidance on urban and territorial sustainable development, especially regarding the promotion of public transport [3]. However, the effectiveness of these policies and strategies is difficult to define. Therefore, the accurate performance assessment of public transport is important.
There are three major methods for measuring the efficiency of public transport networks: stochastic frontier analysis (SFA), analytic hierarchy process (AHP), and data envelopment analysis (DEA) [4,5,6]. Both SFA and DEA focus only on measuring production efficiency related to economic theory [5]. The application areas of AHP include performance type issues, public policy, strategy, and planning [7]. AHP enables decision makers to deal with complex problems involving subjective criteria and multiple conflicts [8,9]. As for public transport, stakeholders are interested in direct and external effects [9], and AHP covers the economic benefit, quality and efficiency of the public transport service, the basic public transport infrastructure, and the sustainable development level [9]. Based on these, the AHP model can help governments monitor and improve the performance of public transportation networks in a more efficient way. Thus, this paper aims to use the AHP model to develop a criteria matrix AHP model to evaluate public transport networks and help decision makers assess and improve the performance of public transport networks.
The contributions of this research are threefold: first, the main contribution is the creation of a comprehensive evaluation model that considers both the direct and external effects of the use of public transportation; second, the model evaluates the performance of the public transport network, which is combined with the detail standards—the sub-criteria can then be evaluated according to the level scale; third, the government can improve performance based on the results of the model—improvement goals can be based on each level grade standard for the sub-criteria.
The paper is organized as follows: Section 2 presents a review of the previous studies on evaluation criteria related to public transport network performance. It also introduces the AHP model and establishes the public transport criteria matrix AHP model. The motivation and characteristics of the three case study areas are described in Section 3. Section 4 identifies the results of applying the established model to evaluate the public transport network performance of the three case study areas, and Section 5 demonstrates the contributions of the proposed model and offers suggestions for future research.

2. Materials and Methods

2.1. Evaluation Criteria

To evaluate the performance of a public transport network, researchers generally apply the six measurement systems listed in Table 1.
Table 1 shows that much of the research on public transport evaluation focuses on operations and services. It does not fully study the comprehensive impact of other key factors, such as development policies, energy/sustainability, and infrastructure/facilities, on the development of urban transportation systems. The research lacks a multi-standard framework for public transport network evaluation at multiple application levels, which requires the consideration of multiple subjective and conflicting criteria.

2.2. AHP Model

The AHP is a method of multiple-criteria decision-making (MCDM); it enables the decision maker to address complicated issues that involve multiple subjective and conflicting criteria [6]. The issue is deconstructed into various levels in the AHP [19]. The AHP offers an ordered framework of options from the most preferential to the least preferential [19]. Moreover, it is the most commonly used MCDM tool for solving problems that have multiple objectives [20]. It prioritizes alternatives into qualitative and quantitative terms based on a set of objectives [21]. The factors at each level are produced through pairwise comparisons, which requires the relative importance to be assigned between two criteria or two sub-criteria [19]. Moreover, the AHP also can be used to rank performance [22]. The three main processes of the AHP are shown as follows:
  • Priority: The element priority weight at each level is calculated using least square analysis or eigenvectors. Until the decision is achieved by using the global weight, this procedure will be repeated for each hierarchy level [23];
  • Issue decomposition: The issue is broken down into elements (the elements are grouped at different levels to form a hierarchy chain), and each factor is broken down further into sub-factors until the lowest hierarchy level [22];
  • Comparison analysis: Each factor’s relative importance at a particular level is measured by a pairwise comparison process [22]. The decision makers and policy makers use a rating scale to produce a numerical value for each factor’s priority [22].
The process of the AHP model calculation is shown in Figure 1.
(1)
Comparison of the importance between each pair:
The value (cig) is assigned to represent the importance (from 1 to 9) for attribute (i) and attribute (g); additionally, cig = 1/cgi. Next, a decision matrix is created, which is matrix C = (cig).
(2)
Normalization of pairwise comparison matrix:
The pairwise comparison matrix needs to be normalized using the normalized arithmetic averages method [24]. After the normalization, matrix C is transformed into matrix D = (dig). The formula of matrix D is shown as follows:
d i g = c i g i = 1 n   C i g
(3)
Obtaining the weighting vector (w):
The prioritization vector (w) is gained by calculating the arithmetic averages from the normalized comparison matrix (dig) row. The calculation of vector w is calculated as below:
w = g = 1 n   d i g n
(4)
Calculation of the highest matrix eigenvalue Tmax:
Next, the highest matrix eigenvalue is calculated. The highest eigenvalue Tmax is satisfied by:
Cw = T max   and   T max     T = i = 1 n   T i n
(5)
Calculation of the consistency index (CI) and consistency ratio (CR) for each comparison matrix C:
The researcher tests that the ratings given by the experts are consistent. Tmax is the highest eigenvalue of the matrix, n is the number of objects which are compared, RI (Table 2) is the random index, and n is the matrix dimension. The RI is shown as below:
Furthermore, the calculation details of CI and CR for each comparison matrix C are calculated as follows:
C I =   T m a x n n 1
C R = C I R I
When CR ≤ 10%, the comparisons are considered as internally coherent; otherwise, it would be considered that inconsistency was present during the comparison process.
This study uses the AHP model to develop a comprehensive multi-criteria public transport network performance evaluation model for various application levels.
The criteria and standards of the model are demonstrated in the following section.

2.3. Public Transport Criteria Matrix AHP Model

This study selects the criteria and standards of the proposed model based on four levels, which are the economic benefit level, the quality and efficiency of the public transport service level, the basic public transport infrastructure level, and the sustainable development level. Based on the above considerations, the criteria are selected from the Evaluation Index System of Public Transportation City Assessment [26], the Code for Transport Planning on Urban Road GB50220-1995 [27], the Passenger Transport Services for Bus/Trolleybus GB/T22484-2008 [28], GBT 22484-2016, the Passenger Transport Services Specifications for Urban Bus/Trolleybus [29], and the Urban Road Traffic Management Evaluation Index System (2012 edition) [30].
Following these criteria, the model divides the criteria into two levels, which are (1) the urban level, and (2) the company operation level. In particular, the model makes the following definitions:
(1) Urban level: Public transport is considered at the urban level to evaluate the urban public transport management and infrastructure establishment. The detailed expression of each criterion is described as follows:
  • The public transport network ratio refers to the proportion of the length of the public transportation network to the length of the urban road network, which reflects the service capacity and scope of urban public transportation;
  • The public transport coverage ratio reflects the convenience of using the public transportation system for residents. It refers to the ratio of the urban public transportation service area to the urban land area;
  • The arbor-type bus stop setting ratio indicates the capacity of buses and the government’s guarantees of bus priority. It considers the number of stations with bus stop bays on the expressways, main roads, and secondary roads in the city and accounts for the proportion of the total number of stops on the expressways, main roads, and secondary roads in the city;
  • The public transportation priority lane setting ratio shows the proportion of the road length of public transport priority lanes in relation to the total length of the urban main roads in the city. The length of the roads with public transport priority lanes refers to the length of the center line of the roads with public transport priority lanes in the city. This is an important indicator that needs to be monitored to improve the traffic conditions of urban public transportation vehicles, and it reflects the level of a city’s emphasis on public transportation priority policies;
  • The public transport land area per capita refers to the ratio of the area of public transport roads to the total urban population. This represents land use for public transportation;
  • The public transport utilization rate refers to the degree of coincidence between land used for public transportation and planned land use in the same period. This criterion is expressed as the ratio of the number of jobs in public transportation to the total number of jobs during the same period. It reflects the consistency of public transport with the city’s master plan;
  • The green public transport vehicle rate is the proportion of green public transport vehicles to total public transport vehicles during the statistical period. Green public transportation vehicles include subways, light rail vehicles, trams, new energy vehicles, trolleybuses, liquid petroleum gas (LPG) vehicles, etc. It reflects the important indicators of energy conservation and environmental protection of urban public transportation systems;
  • The public transport energy intensity is the ratio of the total energy consumption of urban public transport to the volume of passenger transport of urban public transport. It reflects the energy consumed to complete a unit of passenger turnover. This indicator reflects the energy conservation and environmental protection of an urban public transportation system. This indicator has a high correlation with the number and type of energy of vehicles employed.
(2) Company operation level: This level considers public transport from the company level to evaluate the public transport operators. The details are shown as follows:
  • The public transport on-time rate indicates the average of buses’ on-time rates and rail transit’s on-time rate. The departure time of a bus is the first departure time of the bus. If the actual departure time is less than 2 min later than the planned departure time, it will be recorded that the departure time is punctual. The arrival time at the last station means that the actual arrival time at the last station is within the range of being 2 min earlier than the planned schedule or less than 5 min late, which is recorded as the arrival time at the last station. This is recorded as a delay when a rail transit train leaves or arrives at the terminal at the departure station greater than or equal to 2 min later compared to the planned time of the train schedule;
  • The intersection blocking rate during peak hours is an indicator that measures the saturation of the entire road network. A periodically blocked intersection is frequently blocked for a certain period, such as in the AM and PM peaks (and the blocked intersections are not caused by accidents). This is also a basis for checking the effects of traffic management, the development of traffic demand management measures, and proposing intersection reconstruction planning;
  • The passenger freight rate is the ratio of the cost of public transportation paid by an ordinary passenger per month to the average city salary for that month. This index can reflect the rationality and affordability of ticket prices;
  • The public transport driving accident rate is the number of accidents per million kms travelled by public transport vehicles in a year. This is an important criterion to reflect the safety performance of the public transportation system and has a high correlation with the use and maintenance of public transportation vehicles;
  • The coverage rate refers to the rate of total commercial revenue of the last year to the total operating expenses of the last year. It shows the user financial contribution and the economic sustainability of the operators;
  • The bus ownership rate refers to the number of bus stations per 10,000 people in the statistical period. It reflects the distribution of traffic structure;
  • The intact car rate is the ratio of intact vehicle days to operating vehicle days during the statistical period. It shows the maintenance level of public transportation.
An overview of the formula for the sub-criteria and level grade for all sub-criteria can be found in Table A1 and Table A2. It can be seen from Table A2 that level A shows the best performance regarding the criteria, and level E means ordinary performance. The process for measuring the city score is indicated as follows:
  • First, data for each criterion need to be collected from the relevant planning and public transportation departments;
  • Second, the calculated data are ranked according to established performance standards;
  • Third, the global weight for each sub-criterion is calculated as the weight of the criteria (main criteria prioritization) multiplied by the sub-criteria weight (sub-criteria prioritization);
  • Finally, based on the established public transport network performance score levels, the public transport performance grade for a city can be measured.

3. Case Study

The evaluation model described in the previous section was applied to the three Australian case study areas—(1) the City of Stonnington, (2) the City of Bayswater, and (3) the City of Cockburn—to examine the public transport criteria matrix AHP model. Stonnington’s location is close to Melbourne’s Central Business District (CBD), and Bayswater’s location is adjacent to Perth’s CBD. Cockburn is in the southern part of the Perth CBD. The population densities of Bayswater, Cockburn, and Stonnington are 19.94 persons per hectare, 6.98 persons per hectare, and 46.27 persons per hectare, respectively. The main designation of these three cities is residential. The length of Bayswater’s public transport network is approximately 61.9117 km, Cockburn’s is 147.9874 km, and Stonnington’s is approximately 74.7598 km. The details of three case studies are concluded in Table 3.
All of the case study areas have a well-established public transport network. The main types of public transport in the three cities are buses and trains. As the population of the three case study cities continues to grow, the government requires an assessment of the existing public transport networks. All three governments have created new strategies and plans to promote public transportation, but car ownership in Melbourne and Perth continues to increase. This is the motivation for a comparison study of the three cities. The city boundaries of the three case study areas are shown in Figure 2.

4. Findings

In this section, the proposed model is applied to the public transport network performance of the case study areas in terms of the basic public transport infrastructure level, public transport service level, economic benefit level, and sustainable development level.
The pairwise comparison matrix was defined by studying the polices of the local councils in the case study areas. Table 4 presents the preference matrix of the four main criteria, taking the overall weight for the basic public transport infrastructure level as 41%, for the public transport service level as 19%, for the economic benefit level as 11%, and for the sustainable development level as 29%. The local weights for the sub-criteria (sub-criteria prioritization) are shown in Table 5, Table 6, Table 7 and Table 8. Based on the weights for the criteria and sub-criteria, the global weight for each sub-criterion is shown in Table 9.
Table 10 illustrates the original data and achieved grade of the public transportation network performance for Bayswater, Cockburn, and Stonnington. The results show that Stonnington has the highest level in terms of the public transport network ratio, public transport coverage ratio, public transportation priority lane setting ratio, intersection blocking rate during peak hours, and coverage rate. All of the cities achieve level A for the passenger freight rate, intact car rate, public transport utilization rate, and green public transport vehicle rate. Compared to Stonnington, both Bayswater and Cockburn achieve higher levels for the public transport on-time rate, public transport driving accident rate, public transport land area per capita, and public transport energy intensity. Moreover, all three case study areas only achieve level D for the bus ownership rate. Bayswater has the lowest level of public transport coverage ratio and intersection blocking rate during peak hours.
According to the standard scoring interval, we divided each city’s public transportation network performance into five levels (Table 11). We calculated the scores for public transportation performance for all of the criteria and summed the performance over all criteria, as indicated in Table 12. The results show that Stonnington’s public transportation network, at 82.45, scores higher than Cockburn and Bayswater, while Cockburn’s public transport network scores 66.61, which is higher than Bayswater’s score of 63.55. The analysis shows us that the area with the best practice in terms of public transportation is Stonnington.
According to the classification standard, the outcome of the city score (Table 12) shows that Stonnington is classified as level B, while Cockburn’s and Bayswater’s public transport networks’ performances are both rated as level D.

5. Discussion and Conclusions

In this study, we investigated the performance of public transport networks at the basic public transport infrastructure level, public transport service level, economic benefit level, and sustainable development level. The research established a new AHP-based model to provide weights for the criteria and sub-criteria. Based on the existing standards for each sub-standard, the new evaluation model gives a score for a city’s public transportation network performance, and the results show the aspects that the government should consider improving in the future.
Moreover, we collected a series of indicators across three sample cities, representing a series of land use and transport policy backgrounds, and these indicators can help researchers to determine many standards that can inspire any city that wants to improve the future performance of its public transportation network. Results of the model show that all three cities have high levels of sustainable development. By providing indicators that can be used to evaluate specific public transport policy issues, this research has made a significant contribution to public transport network performance evaluation. The findings of this research are as follows:
  • The public transport network ratio and public transport coverage ratio are the most important criteria for the basic public transport infrastructure level, whereas for the public transport service level, the public transport on-time rate has the highest weighting. For the economic benefit level, the coverage rate is the most important criterion. The green public transport vehicle rate and public transport energy intensity have the highest weighting in the area of sustainable development;
  • The results of the three case study areas indicate that both Bayswater and Cockburn should consider their public transport infrastructure level, public transport service level, and economic level more closely in their plans and strategies. Stonnington should improve its sustainable development level, public transport service level, and economic benefit level.
The results of this study can offer data for public transport planners to improve public transport in the future. More specifically, the established model and standards can be used as guidelines for optimizing the available resources. Furthermore, governments can use the results to propose strategies and policies to improve the performance of urban public transportation networks. In future work, more evaluation aspects and criteria can also be taken into consideration to adapt this model to various other cities.

Author Contributions

Conceptualization, G.L., S.W., L.B. and H.X.; methodology, G.L.; software, G.L.; validation, G.L.; formal analysis, G.L.; investigation, G.L.; writing—original draft preparation, G.L.; writing—review and editing, G.L., S.W., H.X. and C.L.; supervision, S.W. and C.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Australian Research Council, grant number LP160100528.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Formula for sub-criteria [26,27,28,29,30].
Table A1. Formula for sub-criteria [26,27,28,29,30].
CriteriaVariablesMode of ComputationUnit
Basic public transport infrastructure levelPublic transport network ratioA1: Length of public transport network
B1: Length of urban road network
(A1/B1) × 100%
Public transport coverage ratioA2: A 300 m radius of urban public transportation service area within an urban built area (for a circle with a radius of 300 m and a center of public transportation station, the intersection part shall not be counted twice)
B2: The area of urban built zone
(A2/B2) × 100%
Harbor type bus stop setting ratioA3: The number of bus stops of bay type
B3: Total number of stops
(A3/B3) × 100%
Public transportation priority lane setting ratioA4: The road length of the public transport priority lane is set on the main road of the city.
B4: Total main road length
(A4/B4) × 100%
Public transport service levelPublic transport on-time rateA5: Bus on-time rate
B5: Rail transport on-time rate
A5: ((∑(the number of departure on time + the number of arrive last station on time)/∑the number of schedule departure × 2) × 100%
B5: ((∑(the number of departure on time + the number of arrive last station on time)/∑the number of schedule departure × 2) × 100%
(A5 + B5)/2%
Intersection blocking rate during peak hoursA6: Number of periodically severely blocked intersections on arterial roads in built-up areas
B6: Total arterial road intersections
(A6/B6) × 100%
Passenger freight rateA7: The cost of public transportation paid by passengers per month
B7: The city’s monthly average salary
(A7/B7) × 100%
Public transport driving accident rateA8: The total number of public transport accidents in one year
B8: Total mileage of public transport vehicles operated in one year
A8/B8Times/million kilometers
Economic benefit levelCoverage rateA9: Last year’s total commercial revenue
B9: Last year’s total operating expenses
(A9/B9) × 100%
Bus ownership rateA10: The number of working buses in the statistical period
B10: The number of urban area population in case study city
A10/B10Car/ten thousand
Intact car rateA11: Intact car day
B11: Operating vehicle-days
(A11/B11) × 100%
Sustainable development levelPublic transport land area per capitaA12: The area of roads served by public transport
B12: Total urban population
A12/B12m2/person
Public transport utilization rateA13: The number of jobs in public transportation
B13: Total number of positions for the same period (the number of jobs in public transportation, urban planning and land use)
A13/B13Null
Green public transport vehicle rateA14: Number of green public transport vehicles
B14: Total number of public transport vehicle
(A14/B14) × 100%
Public transport energy intensityA15: Total public transport energy consumption
B15: Public transport passenger turnover
A15/B15g standard coal/person-km

Appendix B

Table A2. Level grade for all sub-criteria [26,27,28,29,30].
Table A2. Level grade for all sub-criteria [26,27,28,29,30].
Level GradeLevel ALevel BLevel CLevel DLevel E
Public transport network ratio (unit: %)Index value interval[60, 70][55, 60)[50, 55)[0, 50)
Score interval[90, 100][75, 90)[60, 75)[0, 60)
Public transport coverage ratio (unit: %)Index value interval≥55[50, 55)[45, 50)[35, 45)<35
Score interval[90, 100][80, 90)[70, 80)[60, 70)[0, 60)
Harbor type bus stop setting ratio (unit: %)Index value interval[35, 100)[25, 35)[15, 25)[0, 15)
Score interval[90, 100][75, 90)[60, 75)[0, 60)
Public transportation priority lane setting ratio (unit: %)Index value interval≥25[20, 25)[15, 20)[10, 15)[0, 10)
Score interval[90, 100][80, 90)[70, 80)[60, 70)[0, 60)
Public transport on-time rate (unit: %)Index value interval[95, 100][85, 95)[70, 85)[0, 70)
Score interval[90, 100][75, 90)[60, 75)[0, 60)
Intersection blocking rate during peak hours (unit: %)Index value interval[0, 2](2, 5](5, 8](8, 11]>11
Score interval[90, 100][80, 90)[70, 80)[60, 70)[0, 60)
Passenger freight rate (unit: %)Index value interval<3.5[3.5, 4.5)[4.5, 5.5)[5.5, 6.5)≥6.5
Score interval[90, 100][80, 90)[70, 80)[60, 70)[0, 60)
Public transport driving accident rate (unit: times/million kilometers)Index value interval[0, 1.5][1.5, 2)[2, 2.5)[2.5, 3)>3
Score interval[90, 100][80, 90)[70, 80)[60, 70)[0, 60)
Coverage rate (unit: %)Index value interval>150(100, 150]= 100[50, 100)<50
Score interval[90, 100][80, 90)[70, 80)[60, 70)[0, 60)
Bus ownership rate (unit: car/10,000)Index value interval[20, 25][19, 20)[18, 19)[0, 18)
Score interval[90, 100][75, 90)[60, 75)[0, 60)
Intact car rate (unit: %)Index value interval≥92[88, 92)[84, 88)[80, 84)<80
Score interval[90, 100][80, 90)[70, 80)[60, 70)[0, 60)
Public transport land area per capita (unit: m2/person)Index value interval≥11[8, 11)[6, 8)[4, 6)<4
Score interval[90, 100][80, 90)[70, 80)[60, 70)[0, 60)
Public transport utilization rate (unit: %)Index value interval[0.17, 2)[0.14, 0.17)[0.11, 0.14)[0.08, 0.11)<0.08
Score interval[90, 100][80, 90)[70, 80)[60, 70)[0, 60)
Green public transport vehicle rate (unit: %)Index value interval≥95[95, 92)[88, 92)[85, 88)<85
Score interval[90, 100][80, 90)[70, 80)[60, 70)[0, 60)
Public transport energy intensity (unit: g standard coal/person-km)Index value interval[0, 30)[30, 80)[80, 130)[130, 200)
Score interval[90, 100][75, 90)[60, 75)[0, 60)

References

  1. Loukopoulos, P.; Jakobsson, C.; Gärling, T.; Schneider, C.M.; Fujii, S. Public attitudes towards policy measures for reducing private car use: Evidence from a study in Sweden. Environ. Sci. Policy 2005, 8, 57–66. [Google Scholar] [CrossRef]
  2. Wang, S. The Function of Individual Factors on Travel Behaviour: Comparative Studies on Perth and Shanghai. In Proceedings of the State of Australian Cities Conference 2015, Gold Coast, Australia, 9–11 December 2015. [Google Scholar]
  3. United Nations Human Settlements Programme. International Guidelines on Urban and Territorial Planning. Available online: https://unhabitat.org/international-guidelines-on-urban-and-territorial-planning (accessed on 22 March 2021).
  4. Barnum, D.; McNeil, S.; Hart, J. Comparing the efficiency of public transportation subunits using data envelopment analysis. J. Public Transp. 2007, 10, 1–16. [Google Scholar] [CrossRef]
  5. Holmgren, J. The efficiency of public transport operations—An evaluation using stochastic frontier analysis. Res. Transp. Econ. 2013, 39, 50–57. [Google Scholar] [CrossRef] [Green Version]
  6. Boujelbene, Y.; Derbel, A. The performance analysis of public transport operators in Tunisia using AHP method. Procedia Comput. Sci. 2015, 73, 498–508. [Google Scholar] [CrossRef] [Green Version]
  7. Velasquez, M.; Hester, P.T. An analysis of multi-criteria decision making methods. Int. J. Oper. Res. 2013, 10, 56–66. Available online: https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.402.1308&rep=rep1&type=pdf (accessed on 22 March 2021).
  8. Nosal, K.; Solecka, K. Application of AHP method for multi-criteria evaluation of variants of the integration of urban public transport. Transp. Res. Proc. 2014, 2014, 269–278. [Google Scholar] [CrossRef] [Green Version]
  9. Daraio, C.; Diana, M.; Costa, F.D.; Leporelli, C.; Matteucci, G.; Alberto, N. Efficiency and effectiveness in the urban public transport sector: A critical review with directions for future research. Eur. J. Oper. Res. 2016, 248, 1–20. [Google Scholar] [CrossRef] [Green Version]
  10. Orth, H.; Weidmann, U.; Dorbritz, R. Development of measurement system for public transport performance. Transp. Res. Rec. 2012, 2274, 135–143. [Google Scholar] [CrossRef]
  11. Tiznado-Aitken, I.; Muñoz, J.C.; Hurtubia, R. Public transport accessibility accounting for level of service and competition for urban opportunities: An equity analysis for education in Santiago de Chile. J. Transp. Geogr. 2021, 90, 102919. [Google Scholar] [CrossRef]
  12. Fadaei, M.; Cats, O. Evaluating the impacts and benefits of public transport design and operational measures. Transp. Policy 2016, 48, 105–116. [Google Scholar] [CrossRef] [Green Version]
  13. Dragu, V.; Roman, E.A.; Roman, V.C. Quality assessment in urban public transport. Theor. Empir. Res. Urban Manag. 2013, 8, 32–43. Available online: https://www.jstor.org/stable/24873355 (accessed on 22 March 2021).
  14. Barabino, B.; Cabras, N.A.; Conversano, C.; Olivo, A. An integrated approach to select key quality indicators in transit services. Soc. Indic. Res. 2020, 149, 1045–1080. [Google Scholar] [CrossRef]
  15. Sezhian, M.V.; Muralidharan, C.; Nambirajan, T.; Deshmukh, S.G. Developing a performance importance matrix for a public sector bus transport company: A case study. Theor. Empir. Res. Urban Manag. 2011, 6, 5–14. Available online: https://www.jstor.org/stable/24873289 (accessed on 22 March 2021).
  16. Curtis, C.; Scheurer, J. Performance measures for public transport accessibility: Learning from international practice. J. Transp. Land Use 2017, 10, 93–118. Available online: https://www.jstor.org/stable/26211723 (accessed on 22 March 2021). [CrossRef]
  17. Curtis, C.; Scheurer, J. The SNAMUTS Accessibility Tool in Action. In Designing Accessibility Instruments: Lessons on Their Usability for Integrated Land Use and Transport Planning Practices; Silva, C., Bertolini, L., Pinto, N., Eds.; Routledge: New York, NY, USA, 2019; ISBN 978-131-546-361-2. [Google Scholar]
  18. Ona, J.D.; Oña, R.D.; Diez-Mesa, F.; Eboli, L.; Mazzulla, G. A composite index for evaluating transit service quality across different user profiles. J. Public Transp. 2016, 19, 128–153. [Google Scholar] [CrossRef] [Green Version]
  19. Jain, S.; Aggarwal, P.; Kumar, P.; Singhal, S.; Prateek, S. Identifying public preferences using multi-criteria decision making for assessing the shift of urban commuters from private to public transport: A case study of Delhi. Transp. Res. Part F Traffic Psychol. Behav. 2014, 24, 60–70. [Google Scholar] [CrossRef] [Green Version]
  20. Pohekar, S.D.; Ramachandran, M. Application of multi-criteria decision making to sustainable energy planning—A review. Renew. Sustain. Energy Rev. 2004, 8, 365–381. [Google Scholar] [CrossRef]
  21. Yedla, S.; Shrestha, R.M. Multi-criteria approach for the selection of alternative options for environmentally sustainable transport system in Delhi. Transp. Res. Part A Pol. Pract. 2003, 37, 717–729. [Google Scholar] [CrossRef]
  22. Sadeghi, M.; Ameli, A. An AHP decision making model for optimal allocation of energy subsidy among socio-economic subsectors in Iran. Energy Policy 2012, 45, 24–32. [Google Scholar] [CrossRef]
  23. Saaty, T.L. Highlights and critical points in the theory and application of the analytic hierarchy process. Eur. J. Oper. Res. 1994, 74, 426–447. [Google Scholar] [CrossRef]
  24. Saaty, T.L. A scaling method for priorities in hierarchical structures. J. Math. Psychol. 1977, 15, 234–281. [Google Scholar] [CrossRef]
  25. Saaty, T.L. The analytic hierarchy process—What it is and how it is used. Math. Model. 1987, 9, 161–176. [Google Scholar] [CrossRef] [Green Version]
  26. Passenger Transport Services for Bus/Trolleybus GB/T22484-2008. Available online: https://wenku.baidu.com/view/9c319528e2bd960590c677e6.html (accessed on 22 March 2021).
  27. GBT 22484-2016 Passenger Transport Services Specifications for Urban Bus/Trolleybus. Available online: https://pan.baidu.com/s/1eSeT2N4 (accessed on 22 March 2021).
  28. Urban Road Traffic Management Evaluation Index System 2012 Edition. Available online: https://wenku.baidu.com/view/20e4368f84868762caaed5a1.html (accessed on 22 March 2021).
  29. Evaluation Index System of Public Transportation City Assessment. Available online: https://wenku.baidu.com/view/1015f28a360cba1aa811dac1.html (accessed on 22 March 2021).
  30. Code for Transport Planning on Urban Road GB50220-1995. Available online: https://wenku.baidu.com/view/fa103f6b0b4c2e3f57276369.html (accessed on 22 March 2021).
Figure 1. AHP model calculation process [21,22].
Figure 1. AHP model calculation process [21,22].
Sustainability 13 06949 g001
Figure 2. (a) City boundary of Stonnington; (b) city boundary of Bayswater; (c) city boundary of Cockburn.
Figure 2. (a) City boundary of Stonnington; (b) city boundary of Bayswater; (c) city boundary of Cockburn.
Sustainability 13 06949 g002
Table 1. List of measurement systems to evaluate public transport [10,11,12,13,14,15,16,17,18].
Table 1. List of measurement systems to evaluate public transport [10,11,12,13,14,15,16,17,18].
Measurement SystemEvaluation CriteriaMethodReference
Public transport level-of-service (LOS)Travel speed, acceleration and braking, temporal spacing between vehicles, buffer times, space within vehicle, share of dedicated rights-of-way, type of road, type of transit stop, density within vehicle, on-time performance, headway adherence, service durationDetermines the score for public transport LOS for public transport elements. The score helps the decision makers to evaluate the public transport service.(Orth et al., 2012), (Tiznado-Aitken et al., 2021)
Buses with high level of service (BHLS)Vehicle running time and rest time, reliability, demand patterns, total vehicle trip time, layover and recovery times, passenger waiting time, passenger in-vehicle time, passenger travel time, monetary values, operator costsAnalyzes the influence of a series of public transport operational measures and design by assessing the impact of reliability on expenses associated with saving passenger travel time and fleet operations(Fadaei and Cats 2016)
Public transport quality indicatorsOffer of services, accessibility, information, time, attention given to passengers, comfort, safety and security, effects on the environmentEvaluates the public transportation service quality and sustainable level(Dragu et al., 2013)
(Barabino et al., 2020)
Performance importance matrixBus punctuality, bus condition, new fleet addition, seating for elderly, ticket system, service system, bus facility, stopping bus at correct place, driver behavior, information to passengersIdentifies the strong and weak areas and general public transport performance(Sezhian et al. 2011)
SNAMUTSMinimum service standard, activity nodes, travel impediment, weekday inter-peakAssesses the connectivity and centrality of urban public transportation networks in terms of land use and include its market level in the choice of multimodal transport.(Curtis and Scheurer 2017)
(Curtis and Scheurer 2019)
Transit service qualityAvailability, accessibility, customer care, time, safety and security, comfort and amenitiesEvaluates the transit system service quality(De Ona et al., 2016)
Table 2. Random Index (RI) [25].
Table 2. Random Index (RI) [25].
Matrix Size123456789
Random consistency index0.000.000.580.901.121.241.321.411.45
Table 3. Details of three case studies.
Table 3. Details of three case studies.
CityBayswaterCockburnStonnington
Population density19.94 persons per hectare6.98 persons per hectare46.27 persons per hectare
Length of public transport network61.9117 km147.9874 km74.7598 km
Predominant purpose of case study areaResidentialResidentialResidential
Main type of public transportBus and trainBus and trainBus and train
Table 4. Preference matrix, prioritization, CI, and CR for the four main criteria.
Table 4. Preference matrix, prioritization, CI, and CR for the four main criteria.
Basic Public Transport Infrastructure LevelPublic Transport Service LevelEconomic Benefit LevelSustainable Development LevelPrioritizationCICR
Basic public transport infrastructure level123241%2.72%3.02%
Public transport service level1/2121/219%
Economic benefit level1/31/211/311%
Sustainable development level1/223129%
Table 5. Preference matrix, prioritization, CI, and CR for basic public transport infrastructure level.
Table 5. Preference matrix, prioritization, CI, and CR for basic public transport infrastructure level.
Public Transport Network RatioPublic Transport Coverage RatioHarbor Type Bus Stop Setting RatioPublic Transportation Priority Lane Setting RatioPrioritizationCICR
Public transport network ratio113235%0.27%0.3%
Public transport coverage ratio113235%
Harbor type bus stop setting ratio1/21/211/211%
Public transportation priority lane setting ratio1/31/32119%
Table 6. Preference matrix, prioritization, CI, and CR for public transport service level.
Table 6. Preference matrix, prioritization, CI, and CR for public transport service level.
Public Transport On-Time RateIntersection Blocking Rate during Peak HoursPassenger Freight RatePublic Transport Driving Accident RatePrioritizationCICR
Public transport on-time rate121234%2.18%2.42%
Intersection blocking rate during peak hours1/211224%
Passenger freight rate111228%
Public transport driving accident rate1/21/21/2114%
Table 7. Preference matrix, prioritization, CI, and CR for economic benefit level.
Table 7. Preference matrix, prioritization, CI, and CR for economic benefit level.
Coverage RateBus Ownership RateIntact Car RatePrioritizationCICR
Coverage rate11344%0.91%1.57%
Bus ownership rate11239%
Intact car rate1/31/2117%
Table 8. Preference matrix, prioritization, CI, and CR for sustainable development level.
Table 8. Preference matrix, prioritization, CI, and CR for sustainable development level.
Public Transport Land Area per CapitaPublic Transport Utilization RateGreen Public Transport Vehicle RatePublic Transport Energy IntensityPrioritizationCICR
Public transport land area per capita121127%0.6%0.67%
Public transport utilization rate1/211/31/311%
Green public transport vehicle rate131131%
Public transport energy intensity131131%
Table 9. City score distribution matrix.
Table 9. City score distribution matrix.
CriteriaLocal Weight (%)Global Weight (%)
Basic public transport infrastructure level: 41%
Public transport network ratio3514.3
Public transport coverage ratio3514.3
Harbor type bus stop setting ratio114.5
Public transportation priority lane setting ratio197.9
Public transport service level: 19%
Public transport on-time rate346.5
Intersection blocking rate during peak hours244.6
Passenger freight rate285.3
Public transport driving accident rate142.6
Economic benefit level: 11%
Coverage rate444.8
Bus ownership rate394.3
Intact car rate171.9
Sustainable development level: 29%
Public transport land area per capita277.8
Public transport utilization rate113.2
Green public transport vehicle rate319
Public transport energy intensity319
Table 10. Original data and achieved grades for the public transportation network performance criteria for Stonnington, Bayswater, and Cockburn.
Table 10. Original data and achieved grades for the public transportation network performance criteria for Stonnington, Bayswater, and Cockburn.
CriteriaOriginal Data and Achieved Grade
BayswaterCockburnStonnington
Basic public transport infrastructure levelPublic transport network ratio17.64 = Level D19.21 = Level D60.78 = Level A
Public transport coverage ratio46.82 = Level C50.42 = Level B83.72 = Level A
Harbor-type bus stop setting ratio19.04 = Level C9.2 = Level D26.71 = Level B
Public transportation priority lane setting ratio0 = Level E0.31 = Level E25.38 = Level A
Public transport service levelPublic transport on-time rate91.03 = Level B91.03 = Level B84.68 = Level C
Intersection blocking rate during peak hours21 = Level E8.1 = Level D1.5 = Level A
Passenger freight rate1.75 = Level A1.75 = Level A2.33 = Level A
Public transport driving accident rate2.38 = Level C2.38 = Level C4.54 = Level E
Economic benefit levelCoverage rate98.8 = Level D98.8 = Level D101.5 = Level B
Bus ownership rate7 = Level D7 = Level D7.36 = Level D
Intact car rate100 = Level A100 = Level A100 = Level A
Sustainable development levelPublic transport land area per capita20.47 = Level A26.23 = Level A9.28 = Level B
Public transport utilization rate0.8 = Level A0.8 = Level A0.78 = Level A
Green public transport vehicle rate100 = Level A100 = Level A100 = Level A
Public transport energy intensity25.45 = Level A25.45 = Level A83.59 = Level C
Table 11. City public transportation evaluation result classification standard.
Table 11. City public transportation evaluation result classification standard.
Level ALevel BLevel CLevel DLevel E
Index value evaluation range90–10080–9070–8060–700–60
Table 12. Comparative analysis of Bayswater, Cockburn, and Stonnington.
Table 12. Comparative analysis of Bayswater, Cockburn, and Stonnington.
CriteriaGlobal Weight
BayswaterCockburnStonnington
Basic public transport infrastructure levelPublic transport network ratio3.033.312.98
Public transport coverage ratio10.5211.5614.3
Harbor-type bus stop setting ratio2.971.663.5
Public transportation priority lane setting ratio00.157.17
Public transport service levelPublic transport on-time rate5.465.464.99
Intersection blocking rate during peak hours02.914.26
Passenger freight rate5.35.35.3
Public transport driving accident rate2.012.010.76
Economic benefit levelCoverage rate3.343.343.86
Bus ownership rate111.06
Intact car rate1.91.91.9
Sustainable development levelPublic transport land area per capita7.87.86.62
Public transport utilization rate2.992.993
Green public transport vehicle rate999
Public transport energy intensity8.238.235.5
Total63.5566.6182.45
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Lin, G.; Wang, S.; Lin, C.; Bu, L.; Xu, H. Evaluating Performance of Public Transport Networks by Using Public Transport Criteria Matrix Analytic Hierarchy Process Models—Case Study of Stonnington, Bayswater, and Cockburn Public Transport Network. Sustainability 2021, 13, 6949. https://doi.org/10.3390/su13126949

AMA Style

Lin G, Wang S, Lin C, Bu L, Xu H. Evaluating Performance of Public Transport Networks by Using Public Transport Criteria Matrix Analytic Hierarchy Process Models—Case Study of Stonnington, Bayswater, and Cockburn Public Transport Network. Sustainability. 2021; 13(12):6949. https://doi.org/10.3390/su13126949

Chicago/Turabian Style

Lin, Gang, Shaoli Wang, Conghua Lin, Linshan Bu, and Honglei Xu. 2021. "Evaluating Performance of Public Transport Networks by Using Public Transport Criteria Matrix Analytic Hierarchy Process Models—Case Study of Stonnington, Bayswater, and Cockburn Public Transport Network" Sustainability 13, no. 12: 6949. https://doi.org/10.3390/su13126949

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop