The Comprehensive Benefit Evaluation of Urban Drainage Culverts and Pipes Based on Combination Weighting
Abstract
1. Introduction
2. Materials and Methods
- The security benefit is the most important part of a UDCP comprehensive benefit evaluation. The criterion layer includes 5 indexes, which are used to comprehensively measure the safe operation state of a UDCP;
- Environmental benefits reflect the impact of UDCPs on the ecological environment;
- Social benefits reflect the impact of UDCP rehabilitation on the city;
- Economic benefits evaluate the economic feasibility and long-term benefits of the rehabilitation projects.
2.1. Index System of a UDCP Comprehensive Benefit Evaluation
2.1.1. Importance Degree in the Overall Drainage System
2.1.2. Structural Conditions
2.1.3. Functional Status
2.1.4. Pipeline Network Density and the Proportion of Green Space Used for Storage
2.1.5. Waterlogging Points
2.1.6. Water Environmental Impact
2.1.7. Environmental Impact of Construction Projects
2.1.8. Accounting for Construction Carbon Emissions
2.1.9. Impact of Construction Traffic
2.1.10. Quality Level of the Construction and the Survey of Customer Satisfaction
2.1.11. Per Capita Gross Domestic Product (GDP) of the Region
2.1.12. Engineering Cost per Unit Pipeline Length
2.1.13. Designed Service Life of the Pipeline
2.1.14. Return on Investment (ROI)
2.2. Evaluation Model Building of the Comprehensive Benefits of UDCPs
2.2.1. Introduction to the Evaluation Algorithms
2.2.2. AHP Weight Calculation Method
2.2.3. Entropy Weight Calculation Method
2.2.4. Comprehensive Evaluation Method
3. Study Area and Data
3.1. Data Collection and Processing
3.1.1. Data Collection Based on a GIS System
- Point data, including the location information of waterlogging points, defect points, etc.
- Polyline data, which cover the detailed information of the pipeline, including the attributes of the pipe length, diameter, age, pipe importance, the importance of the district, and the designed service life, etc.
- Polygon data, including the drainage catchment and green space storage area. Data such as the pipe network density can be calculated automatically in a GIS.
3.1.2. Questionnaire Survey
3.2. Study Area Overview
3.3. Questionnaire Analysis and Scoring Method
- (1)
- Building scoring criteria and conversion rules
- We input the structured questionnaires and scoring criteria. We organized the structured questionnaire scoring criteria into a standardized document format and used it as the input for the pre-trained language model. It mainly contained the scoring details of each question in the questionnaire, the setting of scores, and the calculation method of the total score, etc.
- The next step was semantic understanding and knowledge graph building. We leveraged the powerful semantic understanding capabilities of LLM to conduct an in-depth analysis of the scoring criterion documents. We analyzed the text content in the document and extracted the key scoring concepts and logical relationships to construct a knowledge graph. We organized each scoring item into a structured knowledge network to clearly understand and process the scoring logic.
- We automatically extracted scores for each item. We identified the logical relationship between each survey question and the selected score item by item to understand the scoring logic of single-choice, multiple-choice, and other self-filled items.
- We established conversion rules for detailed items and the total score. Based on the score settings and logical relationships in the scoring criteria document, the model automatically established conversion rules for the detailed item scores and the total score.
- (2)
- Batch image recognition of questionnaires and automatic scoring
- The first step was optical character recognition (OCR) text recognition and checkbox selection determination [32]. The images of the collected questionnaires were scanned and retrieved. Then, OCR text recognition was conducted using a LLM. The LLM recognized the text information in the image and accurately identified the positions of the checked items in the questionnaire to determine the selection results for each question.
- Based on the deep learning model of the LLM, we checked whether the recognition results of the previous step conformed to the logical structure of the questionnaire and the common answering patterns.
- We scored each question and calculated the total score. On the basis of the trained scoring rules, we scored each question in the questionnaires that were logically verified. We matched the selection results of each question with the scoring rules to determine the score. Finally, the total score of each questionnaire was calculated according to the conversion rules between the detailed item scores and the total score established previously.
4. Results
4.1. Index Weight Calculation
4.1.1. AHP Weight Calculation
- We performed consistency tests on all the collected judgment matrices. Of the 115 from 23 questionnaires, those with passed the test and were retained; conversely, they were excluded. Values below 0.1 indicate that the inconsistency of the judgment matrix is within a tolerable range, ensuring that the derived weights can reasonably reflect the relative importance of the evaluated factors [33]. This standard has been widely adopted in AHP applications to balance the practicality of human judgment. Through the screening process, 73 matrices met the consistency requirement and were retained for subsequent analysis, whereas 42 matrices were eliminated due to failure to reach the acceptable consistency level.
- We normalized and calculated the arithmetic mean of the retained judgment matrices to convert them into weight vectors, thereby obtaining a set of values that could accurately reflect the relative weights of each index.
- We took the arithmetic average of multiple weight vectors of different experts under the same object to calculate the comprehensive weight vector of the criterion layer and the index layer. This was used as the final subjective weight of the AHP based on expert experience.
4.1.2. EWM and Comprehensive Weight Calculation
4.2. Comprehensive Evaluation Results
5. Discussion
5.1. Index Sensitivity Analysis
- The security benefit is the core criterion layer, and its weight value is 0.448, reflecting the basic status of safe operation. The importance degree in the overall drainage system, condition, status, etc. of the pipelines are directly related to the drainage system stability. At present, most of the related research has focused on the operation safety of UDCPs, such as failure models and criticality assessment [14,15].
- The comprehensive weights of the environmental benefits and social benefits are relatively close, at 0.222 and 0.202 respectively, reflecting the comprehensive consideration of ecological protection and public impact in a UDCP project. Among them, the weight of the impact of the construction environment is relatively high, reflecting that the multi-faceted impacts of the engineering construction process on the environment need to be a focus. Accounting for construction carbon emissions holds a certain weight, which highlights the need to adopt environmentally friendly materials and equipment in UDCP projects to decrease the impact on the environment. For the social benefits, the quality level of the construction and the survey of customer satisfaction are the highest, reflecting the public’s great concern for the quality and service of UDCP projects. This indicates that during the implementation of UDCP projects, the needs and interests of the public should be fully considered. Communication and coordination with the surrounding residents and enterprises should be strengthened, and the impact of construction on social life aspects such as traffic should be minimized as much as possible. User satisfaction should be improved to enhance the social recognition of and support for UDCP projects, ensure the completion of the project, and achieve good social benefits.
- The weight of economic benefits is the lowest; however, the indicators such as the return on investment and designed service life still provide an economic feasibility basis for the ranking of rehabilitation priorities.
5.2. Algorithm Applicability Analysis
5.3. Future Research Recommendations
6. Conclusions
- (1)
- We analyzed and evaluated the comprehensive benefits of UDCP renewal, based on the AHP and EWM, aiming at building a method that combines the subjective and objective. The indicators concern the security, environmental, social, and economic benefits. The system was developed on the basis of a GIS, and the topological analysis of the GIS was applied in the calculation of the indicators.
- (2)
- In this study, the evaluation system takes into account both the priority of security and comprehensive benefits on the basis of multi-dimensional indicators and a mixed weight algorithm. According to the approach of the AHP-entropy weight, security benefits were the core criterion layer with a comprehensive weight of 0.448, reflecting the fundamental position for the safe operation of UDCPs. The comprehensive weights of the environmental benefits and social benefits were 0.222 and 0.202, respectively, representing the comprehensive consideration of ecological protection and public impact in the rehabilitation of UDCPs. The weight of economic benefits was the lowest, at 0.128.
- (3)
- In applying the evaluation model to the study area, the results show that 5% of the pipelines need to be included in the renewal plan of these UDCPs.
- (4)
- The system provides a decision-making tool for UDCP projects, and a comprehensive analysis should be conducted, rather than focusing on a single benefit. For the questionnaire used in this study, an automatic questionnaire analysis and scoring method was proposed, which combined natural language processing and optical character recognition.
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- World Bank. Water Supply and Sanitation Policies, Institutions, and Regulation: Adapting to a Changing World—Synthesis Report; World Bank: Washington, DC, USA, 2022. [Google Scholar]
- World Bank. Is the UWWTD Implementation Delivering Results for the People, the Economy, and the Environment of the Danube Region?: A Wastewater Management Assessment Based on the World Bank’s Engagement; World Bank: Washington, DC, USA, 2018. [Google Scholar]
- Krause, M.; Cabrera, E.; Cubillo, F.; Díaz, C.; Ducci, J. An International Standard for Assessing Water and Wastewater Services; Inter-American Development Bank: Washington, DC, USA; The International Water Association: London, UK, 2018. [Google Scholar]
- Datta, R.K.; Alam, O.; Hossain, M.M. Current Status of Urban Drainage System and Its Problem in Netrokona Municipal, Dhaka. J. Inst. Sci. Technol. 2017, 22, 165–178. [Google Scholar] [CrossRef]
- Butler, D.; Davies, J. Urban Drainage, 2nd ed.; Spon Press: London, UK, 2004. [Google Scholar]
- Cherqui, F.; Clemens-Meyer, F.; Tscheikner-Gratl, F.; van Duin, B. Asset Management of Urban Drainage Systems; IWA Publishing: London, UK, 2024. [Google Scholar] [CrossRef]
- United States Environmental Protection Agency. Asset Management for Sewer Collection Systems; USEPA: Washington, DC, USA, 2002.
- Zhou, H.; Song, Z. Practices and thoughts on resilience building of water supply and drainage network system in megacities. Water Wastewater Eng. 2024, 50, 115–120. [Google Scholar] [CrossRef]
- Villez, K.; Aguado, D.; Alferes, J.; Plana, Q.; Ruano, M.V.; Samuelsson, O. Metadata Collection and Organization in Wastewater Treatment and Wastewater Resource Recovery Systems; IWA Publishing: London, UK, 2024. [Google Scholar]
- Yuan, Y.; Zhang, Q.; Chen, S.; Li, Y. Evaluation of comprehensive benefits of sponge cities using meta-analysis in different geographical environments in China. Sci. Total Environ. 2022, 836, 155755. [Google Scholar] [CrossRef]
- He, L.; Li, S.; Cui, C.; Yang, S.; Ding, J.; Wang, G.; Bai, S.; Zhao, L.; Cao, G.; Ren, N. Runoff control simulation and comprehensive benefit evaluation of low-impact development strategies in a typical cold climate area. Environ. Res. 2022, 206, 112630. [Google Scholar] [CrossRef]
- Leng, L.; Mao, X.; Jia, H.; Xu, T.; Chen, A.S.; Yin, D.; Fu, G. Performance assessment of coupled green-grey-blue systems for Sponge City construction. Sci. Total Environ. 2020, 728, 138608. [Google Scholar] [CrossRef]
- Liu, Z.; Xu, C.; Xu, T.; Jia, H.; Zhang, X.; Chen, Z.; Yin, D. Integrating socioecological indexes in multiobjective intelligent optimization of green-grey coupled infrastructures. Resour. Conserv. Recycl. 2021, 174, 105801. [Google Scholar] [CrossRef]
- Salman, B.; Salem, O. Risk Assessment of Wastewater Collection Lines Using Failure Models and Criticality Ratings. J. Pipeline Syst. Eng. Pract. 2012, 3, 68–76. [Google Scholar] [CrossRef]
- Syachrani, S.; Jeong, H.D.; Chung, C.S. Advanced criticality assessment method for sewer pipeline assets. Water Sci. Technol. 2013, 67, 1302–1309. [Google Scholar] [CrossRef]
- Wang, Y.; Li, J.; Zhang, G.; Li, Y.; Asare, M.H. Fuzzy evaluation of comprehensive benefit in urban renewal based on the perspective of core stakeholders. Habitat Int. 2017, 66, 163–170. [Google Scholar] [CrossRef]
- Timashev, S.; Bushinskaya, A. Diagnostics and Reliability of Pipeline Systems; Springer International Publishing: Cham, Switzerland, 2016. [Google Scholar]
- Wu, Y.; Tao, Y.; Deng, Z.; Zhou, J.; Xu, C.; Zhang, B. A fuzzy analysis framework for waste incineration power plant comprehensive benefit evaluation from refuse classification perspective. J. Clean. Prod. 2020, 258, 120734. [Google Scholar] [CrossRef]
- Xi, C.; Ding, J.; Wang, J.; Feng, Z.; Cao, S. Nature-based solution of greenery configuration design by comprehensive benefit evaluation of microclimate environment and carbon sequestration. Energy Build. 2022, 270, 112264. [Google Scholar] [CrossRef]
- Xu, C.; Liu, Z.; Chen, Z.; Zhu, Y.; Yin, D.; Leng, L.; Jia, H.; Zhang, X.; Xia, J.; Fu, G. Environmental and economic benefit comparison between coupled grey-green infrastructure system and traditional grey one through a life cycle perspective. Resour. Conserv. Recycl. 2021, 174, 105804. [Google Scholar] [CrossRef]
- DB31/T 444-2022; Technical Code of Practice for Inspection & Evaluation of Sewers with CCTV and Sonar. Shanghai Municipal Administration for Market Regulation: Shanghai, China, 2022.
- Zhang, L. Positioning, concept and strategy of China’s sponge city: Review and interpretation of document No. 75 [2015] of State Council. Water Wastewater Eng. 2021, 47, 1–8. [Google Scholar] [CrossRef]
- Liu, Z.; Tan, X.; Chen, Y. Quanlitative diagnosis of urban sewage network based on water balance analysis. Water Wastewater Eng. 2020, 46, 113–118. [Google Scholar] [CrossRef]
- GB/T 51366-2019; Standard for Building Carbon Emission Calculation. China Architecture And Building Press: Beijing, China, 2019.
- Ma, T.; Guo, Y.; Wang, W.; Cao, J. Carbon emission calculation and analysis for cured-in-place rehabilitation of urban drainage pipeline. Environ. Eng. 2023, 41, 54–58, 63. [Google Scholar] [CrossRef]
- Hammami, S.; Zouhri, L.; Souissi, D.; Souei, A.; Zghibi, A.; Marzougui, A.; Dlala, M. Application of the GIS based multi-criteria decision analysis and analytical hierarchy process (AHP) in the flood susceptibility mapping (Tunisia). Arab. J. Geosci. 2019, 12, 1–16. [Google Scholar] [CrossRef]
- Shao, L.; Suo, Z.; Song, S.; Lang, Y. Evaluation of the coordinated development of health resources, health service utilization, and the regional economy in China and analysis of influencing factors. BMC Health Serv. Res. 2025, 25, 335. [Google Scholar] [CrossRef]
- Bai, L.; Wang, H.; Huang, N.; Du, Q.; Huang, Y. An Environmental Management Maturity Model of Construction Programs Using the AHP-Entropy Approach. Int. J. Environ. Res. Public Health 2018, 15, 1317. [Google Scholar] [CrossRef]
- Chen, C. A Novel Multi-Criteria Decision-Making Model for Building Material Supplier Selection Based on Entropy-AHP Weighted TOPSIS. Entropy 2020, 22, 259. [Google Scholar] [CrossRef]
- Li, Z.; Fan, Z.; Shen, S. Urban Green Space Suitability Evaluation Based on the AHP-CV Combined Weight Method: A Case Study of Fuping County, China. Sustainability 2018, 10, 2656. [Google Scholar] [CrossRef]
- Liu, M. The “Environmental-Economic” Benefits Integrated Decision Making of Low Impact Development of Stormwater Measures; Central University of Finance and Economics: Beijing, China, 2022. [Google Scholar]
- Huang, Y.; Lv, T.; Cui, L.; Lu, Y.; Wei, F. LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking. arXiv 2022, arXiv:2204.08387v3. [Google Scholar]
- Saaty, T.L.; Vargas, L.G. Models, Methods, Concepts & Applications of the Analytic Hierarchy Process; Springer Science+Business Media: New York, NY, USA, 2012. [Google Scholar]
- Yang, Y.; Li, J.; Huang, Q.; Xia, J.; Li, J.; Liu, D.; Tan, Q. Performance assessment of sponge city infrastructure on stormwater outflows using isochrone and SWMM models. J. Hydrol. 2021, 597, 126151. [Google Scholar] [CrossRef]
Criterion Layer | Weight Value | Index Layer | Weight Value |
---|---|---|---|
Security benefits | 0.5612 | Importance degree in the overall drainage system | 0.2440 |
Structural condition | 0.2311 | ||
Functional status | 0.1988 | ||
Pipeline network density and the proportion of green space used for storage | 0.1407 | ||
Waterlogging points | 0.1854 | ||
Environmental benefits | 0.1772 | Water environmental impact | 0.2790 |
Environmental impact of construction projects | 0.4496 | ||
Accounting for construction carbon emission | 0.2714 | ||
Social benefits | 0.1821 | Impact of construction traffic | 0.3315 |
Quality level of the construction and the survey of customer satisfaction | 0.3954 | ||
Per capita GDP of the region | 0.2731 | ||
Economic benefits | 0.0795 | Engineering cost per unit pipeline length | 0.3597 |
Designed service life of pipeline | 0.4089 | ||
Return on investment | 0.2314 |
Evaluation Grade | Suggested Measures | Comprehensive Evaluation Range | Number of Pipes |
---|---|---|---|
Very poor | Rehabilitate immediately | E ≥ 0.25 | 17 |
Poor | Conduct regular inspections and formulate rehabilitation plans | 0.21 ≤ E < 0.25 | 47 |
General | Regular inspection | 0.18 ≤ E < 0.21 | 537 |
Good | Conduct evaluations regularly | 0.15 ≤ E < 0.18 | 271 |
Very good | Conduct evaluations regularly | E < 0.15 | 484 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Geng, W.; Cheng, Z. The Comprehensive Benefit Evaluation of Urban Drainage Culverts and Pipes Based on Combination Weighting. Water 2025, 17, 2233. https://doi.org/10.3390/w17152233
Geng W, Cheng Z. The Comprehensive Benefit Evaluation of Urban Drainage Culverts and Pipes Based on Combination Weighting. Water. 2025; 17(15):2233. https://doi.org/10.3390/w17152233
Chicago/Turabian StyleGeng, Weimin, and Zhixuan Cheng. 2025. "The Comprehensive Benefit Evaluation of Urban Drainage Culverts and Pipes Based on Combination Weighting" Water 17, no. 15: 2233. https://doi.org/10.3390/w17152233
APA StyleGeng, W., & Cheng, Z. (2025). The Comprehensive Benefit Evaluation of Urban Drainage Culverts and Pipes Based on Combination Weighting. Water, 17(15), 2233. https://doi.org/10.3390/w17152233