Next Article in Journal
Differential Hydrological Properties of Forest Litter Layers in Artificial Afforestation of Eroded Areas of Latosol in China
Next Article in Special Issue
Use of Zeolite (Chabazite) Supplemented with Effective Microorganisms for Wastewater Mitigation of a Marine Fish Farm
Previous Article in Journal
Spatial Analysis of Environmentally Sensitive Areas to Soil Degradation Using MEDALUS Model and GIS in Amazonas (Peru): An Alternative for Ecological Restoration
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Multi-Criteria Analysis for Evaluating Constructed Wetland as a Sustainable Sanitation Technology, Jordan Case Study

1
Department of Civil, Environmental, Architectural Engineering and Mathematics, University of Brescia, Via Branze, 43, 25123 Brescia, Italy
2
Land and Water Division, Food and Agriculture Organization of the United Nations, 00100 Rome, Italy
*
Author to whom correspondence should be addressed.
Sustainability 2022, 14(22), 14867; https://doi.org/10.3390/su142214867
Submission received: 3 October 2022 / Revised: 31 October 2022 / Accepted: 1 November 2022 / Published: 10 November 2022

Abstract

:
There is a growing demand for integrating an assessment tool to select wastewater treatment alternatives based on sustainability in the Jordanian wastewater sector. The sector in Jordan has a unique and critical situation that has raised concerns among stakeholders, including donors, and international and national organizations, to carefully select a sustainable treatment system for each case. The Jordanian government set a tool to distinguish between treatment systems, and this tool is mainly focused on financial criteria. However, the sector needs to integrate assessment tools with a wider consideration of other sustainability criteria. Usually, stakeholders are not equipped with a clear methodology to perform sustainability assessments. Therefore, this study proposes and develops a Multi-Criteria Analysis (MCA) tool to evaluate wastewater treatment alternatives from a sustainability perspective for a case study in Jordan—Al Azraq town. Firstly, the study explored the decision and organizational context of the wastewater sector through several interviews. Secondly, assessment criteria and indicators were proposed to compare three proposed treatment alternatives. Finally, the Analytical Hierarchy Process (AHP) was applied with composite scores to evaluate wastewater treatment alternatives. Finally, The results of the composite scores indicated that French Constructed Wetland (FCW) was the best option for this case study, with a score of 3.13, followed by Stabilization Pond (SP) as the second sustainable option, with a score of 2.67, and lastly, Activated Sludge (AS), with a score of 2.07. Several conclusions have been highlighted during the process development, such as the importance of selecting sustainability indicators carefully, and engaging stakeholders during the design and implementation of the assessment.

1. Introduction

In Jordan, the daily water share per capita is approximately 100 L, and this fact has ranked Jordan as the second poorest country for water availability per person [1]. The country has been suffering from water scarcity that is caused by rapid population growth, a huge influx of refugees, and hydro-political tensions in the Middle East [2]. This has led to a continuously increasing demand on water that is exceeding the potential of the country’s water resources [3]. The well-known climate change impacts have worsened the Jordanian water sector by adding more challenges to the availability and variability of precipitation, extreme events, and heats waves, and these facts have created an imbalance in water management and have enlarged the gap between the demand and the water supply [4].
According to the Ministry of Water and Irrigation’s (MWI’s) reports, the main sources of water in Jordan are (i) groundwater (59%), (ii) surface water (27%), (iii) treated wastewater (14%), and additional resources (desalination) [1,5]. The three main sectors that are competing for water resources are domestic, agriculture, and industry [1,5].
Although the Jordanian government is considering treated wastewater as a part of the annual water budget used in the agriculture sector, the sanitation sector still requires modifications and more sustainable solutions. To overcome this challenge and to enhance the reuse of wastewater, the Jordanian government has prepared the National Water Strategy 2016–2025. The strategy focuses on building a resilient sector based on a unified approach for a comprehensive social, economic, and environmentally viable water sector development. The national policy includes a (Decentralization Wastewater Management Policy), which aims to activate the decentralization concept in managing wastewater for small and scattered communities in order to serve them with sanitation services and to enhance the collection and the reuse of wastewater [5,6]. The MWI has established an inter-ministerial National Implementation Committee for Effective Integrated Wastewater Management (NICE) in order to develop regulatory and administrative tools for implementing and certifying decentralized wastewater management (DWWM) systems in Jordan [5,6,7]. At the centralization level, MWI has prepared a plan to upgrade, modify, and expand the existent wastewater treatment plants in order to increase the amount of treated wastewater [5]. However, 35% of Jordanians are still not connected to sewer networks and wastewater treatment plants, and they have onsite solutions such as septic tanks (mostly unsealed) which is not only causing environmental and health risks, but is also affecting the future potential for reusing treated wastewater [1,3,8].
Al Azraq town is one of the unserved towns with sanitation system. It is located in the eastern part of Jordan and it has a population of more than 15,000 people, who are not served with a treatment system or a sewer network. Residents in this town have onsite solutions at the household level, and their wastewater is assembled in a collection tank via gravity [8]. The collection tanks have no standard sizes, and they can be classified into (i) fully sealed septic tank, (ii) fully sealed septic tank with infiltration chamber, (iii) cesspits with rigid top-slab and walls, and not sealed, and (iv) cesspit with make-shift top slab and unsealed. According to the Azraq Municipality and based on the site assessments, the most commonly used ones are unsealed tanks, which cause the seepage of wastewater. The sewage is collected via desludging trucks and is disposed without further treatment to an illegal dumpsite, which contributes to pollution in the area and poses a very high risk for human health and for the environment.
On the other hand, Al Azraq town is located over a main groundwater basin called Al Azraq Basin, which is considered as a unique source of fresh water for the desert. The total area of Al Azraq basin is 12,414 km2 and it extends from the Syrian borders in the north to the Saudi borders in the south, where 94% of the Azraq basin area is located in Jordan and the rest in Syria. Nowadays, around 70 MCM/year of drinking water are being pumped to Amman and Zarqa from the basin, and this covers 10% of the groundwater yearly abstraction in Jordan [1,9,10]. The illegal disposal causes the infiltration of non-treated wastewater in the lowest point of the dumpsite area, which increases the risk of polluting the aquifer [11]. Al Azraq has also a wetland reserve in the heart of the basin, where millions of migratory birds rest in it every year during their travels from Siberia to Africa, and vice versa. This natural wetland needs to be protected from the contamination of water and the environment caused by the inappropriate sanitation system [10]. Even though the municipality knows its obligation to treat the wastewater in a centralized treatment plant, the cost of the sewage trucking is not feasible.
The critical situation of Al Azraq has caught the attention of many non-governmental organizations (NGOs) who are working in sanitation and who are willing to implement projects of wastewater treatment in Jordan. An international donor has allocated a certain budget to serve the town with a sustainable sanitation solution that can achieve the following benefits:
  • Reduction of the health risk related to water contamination,
  • Reduction of the existing environmental risk,
  • Provide a new source of water for the community,
  • Improvement of the resilience to climate change,
  • Development of a model that could be repeated in the future.
Although the funds have been allocated, the selection of the most appropriate and sustainable treatment technology that can be suitable for the Jordanian context in general and for Al Azraq town specifically is required. A sustainability assessment tool was needed to help the decision-makers with the selection of the most appropriate technology for this context.
The MWI has prepared a decision-support tool called the “Assessment of Local Lowest-Cost Wastewater Solutions” (ALLOWS) decision-support tool. The ALLOWS tool is used to identify most cost-efficient wastewater management solutions, and to determine whether a centralized or a decentralized approach is economically more appropriate for a specific case. The ALLOWS tool focuses on financial indicators for different wastewater scenarios, and accordingly enables planners and decision-makers to perform a comparative analysis to identify the best solutions for the wastewater management problem. The ALLOWS tool mainly considers the financial criteria and part of the technical criteria in comparing treatment scenarios without considering the other sustainability criteria such as the institutional, environmental, and the social; as a result, several sanitation projects have previously faced social rejections, and other projects have faced the overlapping of institutional responsibility, which has led to a change in the operation scenarios. Therefore, it is necessary to integrate a sufficient analysis tool that consider a wider vision of sustainability before making the asset decision and to carefully evaluate, assess, and select sustainable wastewater treatment processes or technologies [6,7].
The aim of this research is to present to the Jordanian water and wastewater sector a practical example of using MCA as a sustainability assessment tool, in order to integrate and to consider the tool in the decision-making process. The practical example considers the use of MCA to assess, compare, and evaluate the sustainability of different wastewater treatment options for Al Azraq town as a case study.
This paper covers a general background on the sanitation situation in Jordan and in the selected case study, and a general introduction on sustainability assessment tools, followed by a detailed methodology that has been used, the results and the main observations, and finally, the discussion and conclusions.

2. Sustainability Assessment Tools

Nowadays, decision-making processes are increasingly considering sustainability assessments [12,13]. Sustainability assessments contain several assessment tools and are basically linked with the long-term practice impact. In general, sustainability assessments evaluate the future impacts of current or planned interventions, and inform decision makers [14,15,16].
Several tools have been developed and studied to perform sustainability assessments. According to the literature, the sustainability assessment can be completed in three approaches. The first approach is the biophysical approach, which considers the flow of resources and environmental impacts for evaluations such as Life Cycle Assessment (LCA); the second approach is the monetary and economical approach, which aims to deliver valuations based on the subjective value preference of stakeholders such as the Cost–Benefit Analysis (CBA); the last approach is indicator-based tools that include the selection of indicators, calculations of weights, and scoring and aggregation, such as Multi-Criteria Analysis (MCA) [14,16,17]. MCA is a group of approaches that utilize multiple criteria and identify the best alternative based on the preference systems of stakeholders or decision makers [18]. MCA provides a rational and a coherent decision-making process through the application of a standardized method. There are several methods in MCA, for example, the Analytical Hierarchy Process (AHP) [16]. MCA has been usually used in the fields of environmental science and management. Comprehensive reviews on the detailed application of MCA were provided by Kiker et al. [19], Cegan et al. [20], Huang et al. [21], and Ling et al. [16].

3. Multi-Criteria Analysis (MCA)

Multi-criteria analysis (MCA) or multi-criteria decision making (MCDM) is a valuable and increasingly widely used tool to help decision making where there is a choice to be made between alternatives. It is particularly useful as a tool for sustainability assessment where a complex and inter-connected range of environmental, social, and economic issues must be considered, where objectives are often competing, and where doing the trade-offs is unavoidable. It provides a robust and transparent decision-making structure, making explicit the key considerations and the values assigned to them, and providing opportunities for not just stakeholders, but also the community’s participation. MCA can be applied at all levels of decision-making; from the consideration of project alternatives to the policy decisions, MCA is guiding an evolution towards selecting the most sustainable alternative. MCA has been widely applied in environmental management (water, air, energy, natural resources, and solid waste) or interventions/tools applications (stakeholders, strategies, sustainability, and GIS) [19,22]. In MCA, various approaches are used to classify, compare, and select the most appropriate alternatives with respect to the given criteria, such as the Analytical Hierarchy Process (AHP), Multi-Attribute Utility Theory (MAUT), Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS), Dominance-based Rough Set Approach (DRSA), and outranking methods such as Elimination and Choice Expressing the Reality (ELECTRE) [20,23]. These approaches are the most widely used MCDA tools in sustainability-related research, as reported in various publications. MAUT is a performance aggregation-based approach, which requires the identification of utility functions and weights for each attribute, which can then be aggregated in a unique synthesizing criterion. The AHP is another approach of the first performance aggregation-based approaches, and it was introduced by Saaty [24] with the aim of evaluating criteria based on an absolute scale. The main idea of the TOPSIS technique is that the preferred alternative is the one that is the closest to the positive ideal solution and the furthest from the negative ideal solution; the positive ideal solution is formed as a combination of the best points of each criterion, and the negative ideal solution is a combination of the worst points of each criterion [25]. This technique is only can be applied for the numerical dataset where the importance weights of the criterion are known or defined, based on the experts. The DRSA is a new technique that can classify choice and rank alternatives; it is based on an information distributed in a table whose rows are defined as alternatives, and where the columns are divided into conditions or criteria that are needed to assess the alternatives [20,26]. ELECTRE are preference aggregation-based methods, working on pairwise comparisons of the alternatives; they are known as outranking approaches because they purpose to assess whether alternative X is at least as good as (outranks) Y [20,23,26].
The most common MCA methods that appear to be widely used in the environmental management is the AHP, followed by MAUT, due to its simplicity, accessibility, and user-friendly nature, while the least commonly applied is TOPSIS [20,23,25].
Sustainability criteria are applied in MCA to deliver a measurement system, and they can indicate the requirements or standards for achieving sustainable services in a specific context. Indicators are measurements or assignments of values that indicate the accomplishment of sustainability criteria [27]. Most of the common environmental indicators include energy use, emissions, and pollutant removal. In terms of economical indicators, capital costs, operational costs, and resource recovery are frequently used. Despite the progressive development of both environmental and economical indicators, social indicators are usually ignored because of their difficulties in measurement and quantification [16,28,29,30]. However, social indicators can be translated into a quantitative format using a points-based scale [31,32], and using willingness to accept (WTA) and willingness to pay (WTP) indicators [33,34].
Previous studies have integrated all sustainability criteria when assessing wastewater treatment alternatives [29,30,31]. As a common multi-criterion issue, selecting among sustainability criteria is crucial to obtaining a final selection between alternatives [35]. As a result, the calculation of weights processes has been established to aggregate indicators into a composite index for each alternative. Gherghel et al. [36] have applied a Weighted Sum Model (WSM) to aggregate the performance of six criteria, in order to distinguish different wastewater treatment systems [36]. Molinos-Senante et al. [31] have used a ‘Global Sustainability Indicator’ to compare seven wastewater treatment alternatives according to environmental, social, and economic criteria [31]. These previous works illustrated that a composite indicator can be a practical and reliable method to integrate multiple sustainability criteria.
In general, sustainability assessment methods are widely applied and studied in the research and academic sector, but they are limitedly applied in the practical decision-making process, especially in the water and wastewater sectors.

4. Methodology

The methodology used in this research was adapted from Ling et al. [16] and divided into five steps, as described in Figure 1. Firstly, understanding the local context; secondly, the construction of decision hierarchy; thirdly, the calculation of weights; fourthly, score aggregation and ranking of the treatment alternatives, and finally, checking the sensitivity analysis and determining the critical indicators [16]. The development process was applied to compare three wastewater treatment alternatives that can be sustainable and suitable for the selected case study.

4.1. Understanding the Context and Identification of Stakeholders

As the first step, it is important to understand the context in detail from different aspects; the environmental, social, and economical conditions that are essential for the project development. Investigation into the town and the community has been initially performed in order to have a general view of the current situation, and also to identify the gaps and the required awareness among the population about the problem, in order to connect the community with the project, as well as preliminarily identifying some indicators.
The second step was the governance assessment aiming to understand the legal framework, the local legislation and policies, and the reuse standards. This step also identifies the governmental stakeholders, their level of importance, and their roles within the project. The next step was the socio-economic analysis with a main aim of tailoring the project and the strategy to the specific selected context. Then, a technical and economic feasibility study were done to identify the cost-effective solution of the plant, and the possible technical options. As a final step, preliminary environmental and social impact assessment analyses were investigated to identify the possible negative environmental and social impacts of the project.
Stakeholder analysis has been carried out to identify the main stakeholders in the project, and their role and impacts, the analysis step has been followed by semi-structured interviews that were conducted with the stakeholders as an initial step to understand the current practices and challenges of selecting the wastewater treatment technologies for the selected case study. The interviews also helped to engage with stakeholders during the development process of the MCA, and to collect their feedback about the tool.
Semi-structured interview guidelines prepared by Laforest et al. [37] were pursued with the selected stakeholders. The interviews were conducted anonymously; each interview lasted an hour, with complete confidentiality of the answers and of the gathered data and information; finally, a validation of the answers with the respondent and an authorization for using the collected data were collected.

4.2. Construction of a Decision Hierarchy

The construction of a decision hierarchy is critical for developing a representative and successful MCA assessment in order to achieve the objective of the MCA. The study firstly considered a literature review and desk study step to collect indicators that have been used to evaluate wastewater treatment technologies from previous similar studies. Table 1 below summarizes the main indicators used for similar analysis. This list was further reviewed and discussed with stakeholders, and then a final list of criteria and indicators was proposed based on the priorities mentioned in the interviews.

4.3. Calculations of Weights

4.3.1. Weighting Allocation Using the AHP

The AHP, developed by Thomas Saaty, R.W [24], was selected for this study because of its simplicity of application and its developed theoretical basis [24]. AHP is the most widely used in MCA approaches according to the number of its applications [66,67]. The procedure of AHP is based on three components: the anatomy of the problem as a hierarchical structure, pairwise comparisons, and calculation of weights [68]. Pairwise comparison is the main task of AHP. The main question to be asked is ‘how important is criteria X compared to criteria Y?’ Each comparison determines the direction and the degree of importance between two indicators, using a semantic scale, as described in Table 2. For example, a scale number of 5 referring to criteria X is strongly more important than criteria Y, whereas 1/5 refers to a reversed preference direction.
For opinions and ratings collection, stakeholders were invited to a semi-structured interview to complete pairwise comparisons between criteria and indicators. Each stakeholder provided his/her preference opinion through a series of pairwise comparisons questions.
The comparisons were carried out at the first level (criteria) of the hierarchy, and then at the second level (indicators) of the hierarchy under each criteria. A reciprocal matrix of m   X   m was created based on m number of criteria/indicators to be compared, as described in Equation (1).
a 1,m indicates the opinion made between criteria number 1 and the m-th criteria, etc. In total, an m (m − 1) number of comparisons are required per each matrix, given the property of reciprocity in AHP. An (m + 1) number of matrices is required to calculate the weights for each stakeholder (1 for comparisons between all criteria at the first level, and m for the comparisons between indicators within each criteria).
A = 1 a 12 a 13 a 21 = 1 / a 12 1 a 23 a 31 = 1 / a 13 a 32 = 1 / a 23 1
The comparison matrix must be normalized to obtain the weight of each indicator. The method starts with the summing of each column as:
  a c o l u m n j = a 1 j + a 2 j + a 3 j
and the normalized matrix is calculated by dividing each element by the sum of its column [16,24]
A = 1 / a c o l u m n 1 a 12 / a c o l u m n 2 a 13 /   a c o l u m n 3 a 21 / a c o l u m n 1 1 / a c o l u m n 2 a 23 /   a c o l u m n 3 a 31 / a c o l u m n 1 a 32 / a c o l u m n 2 1 /   a c o l u m n 3
Then, MATLAB was used to calculate the eigenvalues and eigenvectors for the normalized matrix. The principal eigenvectors that correspond to the highest eigenvalue have been considered to represent the final weights of the indicators. Mathematically, the eigenvectors are being calculated by averaging across the row of the normalized matrix, and the eigenvalue is obtained by summation of the products between each element of the eigenvector and the sum of the columns of the matrix. However, MATLAB has been used to calculate both eigenvectors and eigenvalues, in order to guarantee the accuracy of the calculations. At the end, the eigenvector obtained from MATLAB needs to be normalized to represent the final weights, and this is given by dividing individual value of the eigenvector in each row Ar by the summation of the eigenvector values, as in Equation (4) [16,69]:
w r = A r m = 1 j A r
The normalized eigenvector w r represents the weight of the indicator in a specific pairwise comparison [16,24,69].
To verify the correctness of the procedure, the consistency ratio (CR) was calculated for the entire comparison group to determine the consistency levels of judgements and opinions from stakeholders [24]. Responses with CR values of greater than 0.1 were revised, and when CR remained greater than 0.1, the responses were excluded from the further aggregation of the group weightings. The 10% is tolerated because the priority of consistency to obtain a coherent explanation of a set of facts must differ over an order of magnitude from the priority of inconsistency, which is an error in the measurement of consistency. Thus, on a scale ranging over 0–1, the consistency ratio should not exceed 0.10 [24]. The consistency ratio (CR) is given by:
C R = C I R I
where CI is the consistency index and RI is the random index.
The CI is determined by:
C I = λ n n 1
where n is the number of the parameters in the comparison, criteria, or indicators; and λ is the principal eigenvalue obtained from MATLAB, and represents the summation of the product between the sum of each column   a c o l u m n j and the corresponding eigenvector w r .
The random index (RI) is a fixed value related to the number of indicators or criteria present in the comparison. Table 3 below indicates the RI values according to the literature [16,24,70].
The value output of CR is compared to the fixed reference value 0.10, with this meaning:
i f   C R < 0.1  
Then the procedure is consistent, and the calculated weight can be used
i f   C R > 0.1
Then the procedure is inconsistent, the calculated weight can’t be used. The procedure needs to be rechecked.

4.3.2. Group Weightings

Every stakeholder made one set of responses and one weighting profile (normalized eigenvectors). A group of weightings is required to represent the overall responses on the importance of the selected criteria and the indicators. According to the literature, several ways of developing the group weighting can be used: (i) sharing, refers to the exchange of opinions and preferences among all stakeholders, and then the selection of one input for AHP calculation; (ii) comparing, refers to the comparison of weightings developed from individual preferences and deciding which set of weights is the most representative; or (iii) aggregating, means the mathematical aggregation and collection of individual weightings [16,71]. In this study, mathematical aggregation was considered as being more suitable due to the time limitation, the availability of the stakeholders, and the COVID-19 emergency situation, where social distancing conditions were still required when this study was conducted. The geometric mean was performed to aggregate individual weightings into a group weighting as:
w k q ¯ = n = 1 q w k q = w k 1 w k 2 w k q q
where w k q ¯ is the aggregated group weight for the k–th criteria or indicator, while q represents a number of stakeholders; similar to the normalization of weights from a reciprocal matrix using Equation (4), the aggregated group weights were normalized so that the sum of all criteria is equal to 1.

4.4. Score Aggregation and Options Ranking

Wastewater treatment alternatives have been selected for the application of the criteria hierarchy and group weightings. The name and location of the wastewater treatment plant (WWTP) was mentioned before in the study and was clearly explained to the stakeholders. The proposed WWTP was designed to serve a population of approximately 15,000. The following three treatment alternatives were considered for the selected case:
  • Activated Sludge Process (ASP),
  • Stabilization Ponds Process (SP),
  • Constructed wetlands— (French constructed wetlands) FCW.
The technologies have been selected based on the most commonly used technologies in Jordan. Jordan has 33 centralized WWTPs (27 WWTP used ASP, and six WWTP used SP) while the third option, FCW, was proposed by the donor and the implementation partner as they were willing to evaluate using FCW as an application of NBS in the country. Several aspects have led the implementation partners to propose FCW for Al Azraq, as they have previously implemented several types of CWs, including FCW, under the same environment and climate conditions in the Middle East, the availability of local materials, especially the tuff in Al Azraq town, the availability of the land area, and the simplicity of operating the FCW. The treated wastewater will be used in fodder crops and uneatable agriculture according to the Jordanian standards 839–2021 [72]; and the selected alternatives are able to treat the wastewater to the selected levels, and this is illustrated through different WWTPs using the same technologies in Jordan and in the neighboring countries. The stakeholders validated the suitability of the selected alternatives for the town.
Figure 2 below shows the basic treatment process outlines of the three alternatives to be compared. The proposed treatment processes started from pretreatment to sludge treatment and disposal. Detailed mechanical, chemical, and biological process designs are not included, as the technical aspect of each wastewater treatment process is not discussed in this study.
The criteria hierarchy and weightings developed in this study have been used to assess the overall scoring of each technology. The assessment of each indicator for each technology was provided in the format of performance ratings using a 5-point scale based on stakeholder’s opinions and judgments. Then, a Weighted Sum Model (WSM) was used to generate the performance ratings of indicators (v1, v2,…, vn) and their corresponding weights (w1, w2,…, wn) into a composite score Si for the i-th option, as:
S i = i = 1 n w n v n = w 1 v 1 + w 2 v 2 + ··· w n v n

4.5. Sensitivity Analysis Check

It is a common practice in AHP to analyze the sensitivity of the composite score and the ranking of options to potential changes in criteria weights. This study included two elements of sensitivity analysis. First, identifying the most critical indicator by calculating the minimum changes required in weights to cause a rank reversal. As the aim of this case study is to identify the best option, only the rank reversal between the top two options were considered. The steps for identifying the most critical indicator were based on the theory developed by Trianaphyllou and Sanchez [73], and were used and illustrated by Ling et al. [16]. The theory said that if the i-th option is the best and the j-th option is the second-best according to their composite scores (Si > Sj), then the minimum change δk.i.j in the weight of indicator Ck to cause a rank reversal between i and j can be calculated. If the performance of the j-th option is better than the i-th option with respect to the k-th indicator (vjk > vik), then
δ k , i , j < S j S i v jk v ik
If the performance v of the i-th option is better than the j-th option with respect to the k-th indicator (vjk < vik), then
δ k , i , j > S j S i v jk v ik
Additionally, the relative minimum change δk.i.j can also be expressed as:
δ k , i , j \ = δ k , i , j w k ×   100 %
δk.i.j may not have a feasible value. In other words, it may be impossible to reverse the existing ranking of the alternative i-th and j-th by making changes on the current weight of criterion. This situation occurs when the value of |δk.i.j| is greater than weight value of indicator k [73].
The second element used to check the sensitivity in this research is assume that the selected performance indicators have equal importance for all the stakeholders. Equally weighted criteria are a common situation, against which the sensitivity of the results is tested. In this case study, the selected performance indicators are 16, and thus, each one has a weight factor of 100%/16 = 6.25%; considering the unified weights for indicators and the composite scores from stakeholders, the final options ranking will be checked and compered to the ranking resulting from the MCA [74,75].

5. Results

5.1. Semi-Structured Interview and Thematic Analysis

Ten stakeholders from different sectors (government, academia, WWTP designers, WWTP operator donors, international NGOs, and local NGOs) participated in the study and the interview process. Table A1 in Appendix A provides more details about the stakeholders’ profiles. Firstly, the stakeholders evaluated and validated the suggested and proposed criteria and indicators, which is a summary of the thematic analysis and results from the stakeholders’ interviews. Secondly, the stakeholders validated and confirmed the selected technology alternatives, which have previously been illustrated in Figure 2.

5.2. Construction of a Decision Hierarchy

According to the indicators summarized from the literature and listed in Table 1, and from the results of the semi-structured interviews, the proposed criteria hierarchy for assessing and selecting wastewater treatment technology are illustrated in Figure 3, while the detailed definition of each indicator are summarized in Table A2 in Appendix A.
The hierarchy consists of two levels. The first level represents the five aspects of sustainability, and the second level illustrates the assessment indicators under each criteria.
Sustainability criteria were commonly used in the previous studies to assess treatment technologies, and the use of these criteria was validated by the stakeholders [16,28,39,44]. This is considering that climate change resilience under the technical sustainability was suggested by stakeholders in order to have a resilient technology that can provide the same treatment efficiency under different climate conditions. The management, treatment, and disposal of sludge created a problem in Jordan, and thus, “Amount of sludge and by-products—managing he generated sludge” has been selected as a technical indicator, besides the ease of implementation and operation. Resource recovery and the final reuse of the products have the priority according to the Jordanian situation to sustain the long-term operation under the financial sustainability criteria. The environmental sustainability has a special situation, since the project will be located within a Ramsar site where restoring the biodiversity has priority and carbon sequestration as well, in order to minimize the total emission while protecting the soil and the lands. For social sustainability and based on onsite evaluation, it was found that providing an aesthetic place and a green area are important indicators for the community, and will enhance the possibility of the willingness to accept and the willingness to pay to have the service. Finally, the institutional sustainability, as the selected technology, has to meet the local standards of operation and maintenance; it should be compatible with the framework of the responsible institute, and should be within their technical and financial capacities.

5.3. Weightings

The weights of each indicator that resulted from AHP from 10 stakeholders and the aggregated group weights are summarized in Table 4 below. According to the results of the group weights, ‘Public acceptance’ had the highest weight (0.204), reflecting the importance of social acceptance for similar projects and interventions. Several stakeholders have illustrated during the semi-structured interviews that meeting social sustainability and community acceptance play a main role in having sustainable wastewater technology, and it is always a priority when selecting the wastewater treatment system.
The operational cost has been ranked second, with a weight of (0.181). This was followed by the ease of implementation and operation (0.103), and of having aesthetic and green areas (0.080). Although the capital cost is also important, the capital costs were funded through an international donation for the Al Azraq project. It is worth mentioning that climate change resilience, local capabilities, and restoring biodiversity indicators have the least importance and have been ranked 14, 15, and 16, respectively. At the first level of the hierarchy, the weights for each sustainability criteria were obtained; the social criteria (0.341) had the highest weight, followed by the financial criteria (0.268), then the technical criteria (0.154) and environmental criteria (0.126), and finally, the institutional criteria (0.110), as summarized in Table 5.
Although previous studies and literature showed that financial and technical criteria could have the highest scores compared to other criteria, Ling et al. [16] highlighted that comparing weighting profiles across different studies does not make sense, because decision priorities and contexts vary among studies [16]. The final weights in this case study were presented to the participated stakeholders for their feedback. All stakeholders were satisfied with the results of the group weights.
The consistency ratios have been checked for all pairwise comparisons resulting from the AHP for the 10 stakeholders. The results showed that the pairwise comparisons are within the acceptable consistency ratio, as illustrated in Table 6 below.

5.4. Score Aggregation and Final Ranking

The group weights resulting from the previous step were applied to the performance ratings of indicators for a score aggregation (as described previously, each stakeholder scored the selected technologies on a scale from 1 to 5 to indicate its performance under each indicator). Table 7 below summarizes the average performance ratings of each indicator for each technology option, as provided by the stakeholders.
Firstly, the scores of the indicators were aggregated into each criteria according to the hierarchy in Figure 3. Secondly, further aggregation into a composite score for each technology option was described in Figure 4. Figure 4 allows decision makers and stakeholders to understand and to rank the options based on their total scores, and to identify the best sustainable technology under each sustainability criterion.
  • Overall: The FCW option was scored as the best option for this case study, and based on its composite score (3.13), followed by SP (2.67), and finally, the AS (2.07).
  • Institutional criteria: FCW has the highest scores for most of the criteria, except the institutional criteria, where SP and AS had higher scores (0.37), while FCW scored (0.32).
  • Social: FCW scored (0.75) followed by AS (0.67), and lastly, SP, with (0.6).
  • Environment: FCW scored (0.49), and that indicated the difference between the conventional treatment systems and the nature-based solutions, such as FCW.
  • Technical: FCW and SP had the same score (0.6), while the AS scored (0.41) due to the complexity of operating AS.
  • Financial: FCW scored (0.96), followed by SP (0.49), and then AS (0.46).

5.5. Sensitivity Analysis Check

The first element of the sensitivity analysis check was to calculate the minimum change in the group weight of each indicator to cause a rank reversal between the top two options, using Equations (10)–(12). Table 8 shows the calculated minimum weight change δ that is required to determine if the indicator is critical or not; the calculation shows that all indicators are robust and are not sensitive; in other words, any changes in the indicator’s weights will not change the overall options ranking. The absolute change and the relative change that all indicators can withstand for a value change in their weights without causing a rank reversal for this case study.
For the second check using equally weighted criteria, equal weights have been applied to test the sensitivities of the results. In this case study, the selected performance indicators are 16, and thus, each indicator has a weight factor of (1/16) × 100% = 6.25%, considering the unified weights for the indicators and the composite scores from the stakeholders. The results showed that while the overall scores for all the treatment options increased, the final options ranking was not affected. As illustrated in Figure 5 below, this method provided further illustration of the robustness of the selected indicators.

6. Discussion

In this study, sustainability criteria have been used for evaluating different treatment technologies. Each criteria has been divided into indicators that summarize the importance of the criteria. Although the sustainability criteria have been widely and effectively used for similar comparisons, the number of selected indicators is limited, due to the accuracy of the MCA process. Therefore, selecting indicators are crucial in MCA. In this study, the criteria and indicators have been selected after a deep understanding of the local context, conducting several site visits, and engaging stakeholders while implementing the MCA tool. From the local context, it was understood that for similar cases where the population count is moderate (5000 to 15000), the operators of the treatment plant are critical; usually, wastewater treatment plants are operated by the MWI or private companies, while the proposed operation scenario for this case study is to be operated by the local municipality. Due to that, the ease of implementation, maintenance, and management of the generated sludge are highly important technical indicators for selecting treatment technology. That operation scenario has highly affected the selecting process; not just the technical indicators, but also the financial and social indicators, such as the operation and maintenance costs, and resource recovery/reuse opportunities, in order to integrate suitable business models and socio-economic plans. The importance of environmental indicators has a higher level of importance; some indicators are matching the national climate change adaptation plan, such as carbon sequestration and total emissions indicators, while other indicators are linked with the social criteria, such as the provision of aesthetic places indicators. However, some indicators were not included in this study, such as odor problems and attracting insects and mosquitoes; these indicators might affect the social acceptance, but according to stakeholders, these problems can be avoided by selecting a proper location for the treatment plant.
Although including stakeholders is a key factor, this study found that introducing a new assessment method is challenging. Firstly, the availability of the stakeholders was an obstacle, and it should be considered carefully when developing the MCA. Ideally, engaging with as many stakeholders as possible would be useful for developing representative results. However, stakeholders were often occupied and not available. To overcome this challenge, stakeholders have been communicated through the implementing partners and the donor of the project. Secondly, meeting the stakeholders separately helped to overcome the authority segregation problem in the Jordanian wastewater sector, Thirdly, practicing AHP and pairwise comparison was confusing for some stakeholders, conducting MCA and pairwise comparison with stakeholders through face-to-face interviews helped in solving their confusion, and regular consistency ratio checks have been carried out immediately to avoid and to minimize the possible errors. Most of the stakeholders expressed their interest in AHP and the composite score approach after seeing the results and figures.

7. Limitations and Future Development

Although the sensitivity analysis for this research did not show any possibilities of reverse ranking, the pairwise comparisons can usually be sensitive to the number of alternatives to be compared, and the changes in weights, which might lead to rank reversal. Therefore, the sensitivity analysis is crucial to determining the critical criteria and its impact on the final ranking.
While the methodology for the MCA and AHP can be the same, the indicators and criteria can be different for another case study within the same country. This means that if we apply the same methodology and with the same indicators for another case study in Jordan, it might lead to different technology ranking. However, this can be considered as a benefit, since the flexibility of selecting indicators helps with obtaining better results for each specific case.
The Saaty scale in AHP (1–9 point) was difficult to use for stakeholders who were unfamiliar with the method. The scale can be considered as long scale; therefore, extreme values such as 9 or 8 were rarely used, and it was difficult for some stakeholders to understand the definition of the scale. For that, the reduced scale is recommended, and will be considered for future similar applications
While the mathematical part is relativity simple, achieving the consistency ratio limit was challenging. The consistency ratio was calculated since it is also linked with using the (0–9 point) scale; therefore, stakeholders were carefully scored for the indicators.
Further implementations of the sustainability assessment tools will provide accumulative knowledge and a database to support the decision-making process in the Jordanian wastewater sector.
Further research can consider different indicators listed in order to create a wider vision of the sustainability definitions in Jordan. Further research to assess the applicability of MCA and AHP tools in the surrounding region of Jordan could help the international donors and NGOs who are actively working in the wastewater sector in the region.
Further research will assess and evaluate using MCA and AHP to evaluate among the treatment options, rather than the indicators.

8. Conclusions

There is a great demand to serve the underserved community in Jordan with a sustainable sanitation solution. Parallel to that, there is also a great demand for an integrated sustainability assessment tool in the Jordanian water and wastewater sector, in order to support the decision makers in comparing, assessing, and selecting the best sustainable options. This study has used the MCA tool to compare and select wastewater treatment options for the case study of Al Azraq town in the eastern part of Jordan. The MCA tool provided a simple and wide approach for stakeholders to rank treatment alternatives by composite scores aggregated and adopted from the sustainability criteria and sub-indicators.
The study found that the AHP approach, combined with the semi-structured interviews with each stakeholder, can be a feasible and a practical approach to developing the weights. The results of composite and aggregated scores can be visualized easily and can be used to select between the alternative options. The study showed that FCW was identified as the best treatment technology for Al Azraq town, compared to the AS and SP.
Stakeholders’ engagement should also be included in the early stage of developing the methodology. The use of interviews and thematic analysis can develop a basic understanding of the current method for evaluating and selecting treatment technology; the collected data and information can be used to select the criteria and indicators that lead to having an assessment tool that is compatible with the stakeholder’s preference and decision-making context in the water and wastewater sector.
The development and optimization of the MCA tool will also help and support donors and international agencies who are working in the sectors in understanding the local context and selecting the appropriate and sustainable treatment options for each context while minimizing the risk potential.
The development of the MCA tool is basically an iterative process, and it can be reviewed and updated regularly. The criteria hierarchy and weights presented in this research were developed for a unique and specific case in Jordan. However, the methodology can be generalized to perform sustainability assessments for other cases or projects within the water and wastewater sector.

Author Contributions

Conceptualization, A.M.N.M. and M.B.; methodology, A.M.N.M. and M.B.; writing—original draft preparation, A.M.N.M.; data curation, A.M.N.M.; writing—review and editing, S.S. and A.A.; supervision, S.S. and A.A. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. Some data are not publicly available due to confidentiality and privacy agreement with the organization where the research was conducted.

Acknowledgments

The Italian Agency for Development Cooperation supported this study through the partnerships for knowledge (PFK) program.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Details of stakeholders, including job profile, organization, and years of experience.
Table A1. Details of stakeholders, including job profile, organization, and years of experience.
Stakeholders Job Profile Organization Years of Experiences
Stakeholder 1Wastewater engineer Ministry of water and irrigation 15
Stakeholder 2Head of wastewater department Ministry of water and irrigation 20
Stakeholder 3Head of operation and maintenance departmentMinistry of water and irrigation 18
Stakeholder 4Consultant in the field of wastewater University of Jordan 20
Stakeholder 5Country directorDonor10
Stakeholder 6Head or urban development engineering departmentAl Azraq municipality 15
Stakeholder 7Head of designing department Local wastewater design company 15
Stakeholder 8Wastewater engineer INGO10
Stakeholder 9Water and environmental engineer INGO10
Stakeholder 10Country directorDonor10
Table A2. The definition of each indicator used in this assessment, and its type of indication. Positive indication means that higher value of the indicator represents high preference, while negative indication represent the opposite direction of preference.
Table A2. The definition of each indicator used in this assessment, and its type of indication. Positive indication means that higher value of the indicator represents high preference, while negative indication represent the opposite direction of preference.
CriteriaIndicatorDefinitionsType of Value Indication
TechnicalEase of implementation and operationThe ease of implementing and designing the treatment facilities and the ease of operating the process, which is associated with the manpower resources, as well as the levels of skills and training required for operators.Positive
Climate change resilienceThe ability of technology/process to face different climate change impacts and its ability to adjust or upgrade to adapt to climate change while maintaining treatment efficiencyPositive
Amount of sludge and by-products (managing the generated sludge)The required treatment and disposal/reuse process related to the produced sludge and other by-products such as the harvested plantsNegative
FinancialCapital costReferee to the total implementation and starting of the treatment process or technologyNegative
Operation and maintenance costCost related to materials (consumables), staff cost (operators), power consumption, hired and contracted services (e.g., transport, service contract for specific treatment process)Negative
Resource/energy recovery and reuse opportunitiesThe opportunities to recover resources or energy the system can provide, including the treated wastewaterPositive
EnvironmentalTotal emissionTotal emission resulted from the treatment process and the WWTP daily operation (direct and indirect emission)Negative
Soil and land contaminationThe potential contamination of soil and land resulting from the construction and the daily operation processNegative
Biodiversity restorationThe ability of the technology to restore biodiversity, flora and faunaPositive
Carbon sequestrationThe ability of the technology to capture and store atmospheric carbon dioxide in carbon pools such as soil and plant tissuesPositive
SocialPublic acceptancePeople accepting of having this technology in their town (considering their perspectives regarding odor, land costs, etc.)Positive
Provision of aesthetic and green placesThe ability of the system to provide green areas and aesthetical places where people can enjoy and visit the treatment plant and its boundariesPositive
Willingness to payPeople’s willingness to pay tariffs or taxes to have the treatment plant, and to enjoy the main benefits and the co-benefits of the technologyPositive
InstitutionalLocal personnel capabilities and local technical capabilitiesHow the technology is familiar with the local technical capabilities, skills, and experiencesPositive
Compatibility with national strategies, standards, and common practicesThe ability of the technology to meet the national strategies, operation and disposal standards, and reuse/disposal practicesPositive
Organizational effort and financial management requiredThe required efforts and funds that are requested from the responsible institute to operate to and maintain the technologyNegative

References

  1. MWI. Jordan Water Sector—Facts and Figures; MWI: Amman, Jordan, 2017. [Google Scholar]
  2. Al-Bakri, J.T.; Alnaimat, M.J.; Al-Karablieh, E.; Qaryouti, E.A. Assessment of Combined Drought Index and Mapping of Drought Vulnerability in Jordan. Int. J. Engine Res. Appl. 2019, 9, 59–68. [Google Scholar] [CrossRef]
  3. Abu-Qdais, H.; Abdulla, F.; Kurbatova, A. Wastewater reuse in Jordan and its potential as an adaptation measure to climate change. J. Environ. Eng. Sci. 2019, 14, 203–211. [Google Scholar] [CrossRef]
  4. Hammouri, N.; Abdulla, F.; Qdais, H.A.; Freiwan, M. Assessing the impacts of climate change on water resources of Jordan assessing the impacts of climate change on water resources of Jordan. In Proceedings of the Climate Change, Impacts and Adaptations, IWRA, Edinburgh, Scotland, 25–29 May 2015. [Google Scholar]
  5. MWI. National Water Strategy 2016–2025; MWI: Amman, Jordan, 2016. [Google Scholar]
  6. MWI. Decentralized Wastewater Management Policy; MWI: Amman, Jordan, 2016. [Google Scholar]
  7. Breulmann, M.; van Afferden, M.; Al-Subeh, A.; al Mahamid, J.S.; Dorgeloh, E.; Müller, R.A. National Framework: The Certification of Wastewater Treatment Systems with Capacities up to 5.000 PE in Jordan; Helmholtz Centre for Environmental Research—UFZ with the Support of the Ministry of Water and Irrigation: Leipzig, Germany; Amman, Jordan, 2021. [Google Scholar]
  8. Breulmann, M.; Brückner, F.; Toll, M.; Afferden, M.; Becker, M.; Al-Subeh, A.; Subah, A.; Müller, R.A. Vulnerable Water Resources in Jordan: Hot Spots; Ministry of Water and Irrigation with Support from the Helmholtz Centre for Environmental Research–UFZ and the Federal Institute for Geosciences and Natural Resources (BGR): Amman, Jordan; Leipzig, Germany; Hannover, Germany, 2020. [Google Scholar]
  9. Ta’any, R.; Masalha, L.; Khresat, S.; Ammari, T.; Tahboub, A. Climate Change Adaptation: A Case Study in Azraq Basin, Jordan. Int. J. Curr. Microbiol. App. Sci. 2014, 3, 108–122. [Google Scholar]
  10. Al Qatarneh, G.N.; Al Smadi, B.; Al-Zboon, K.; Shatanawi, K.M. Impact of climate change on water resources in Jordan: A case study of Azraq basin. Appl. Water Sci. 2018, 8, 50. [Google Scholar] [CrossRef]
  11. Musa, E.S.; Marwan, S.; Raggad, A. Water Resources of Jordan; Springer: Berlin/Heidelberg, Germany, 2018; ISBN 978-3-319-77748-1. [Google Scholar]
  12. Waas, T.; Hugé, J.; Block, T.; Wright, T.; Benitez-Capistros, F.; Verbruggen, A. Sustainability Assessment and Indicators: Tools in a Decision-Making Strategy for Sustainable Development. Sustainability 2014, 6, 5512–5534. [Google Scholar] [CrossRef] [Green Version]
  13. Xue, X.; Schoen, M.E.; Ma, X.; Hawkins, T.R.; Ashbolt, N.J.; Cashdollar, J.; Garland, J. Critical insights for a sustainability framework to address integrated community water services: Technical metrics and approaches. Water Res. 2015, 77, 155–169. [Google Scholar] [CrossRef]
  14. Gasparatos, A.; El-Haram, M.; Horner, M. A critical review of reductionist approaches for assessing the progress towards sustainability. Environ. Impact Assess. Rev. 2008, 28, 286–311. [Google Scholar] [CrossRef]
  15. Pope, J.; Annandale, D.; Morrison-Saunders, A. Conceptualising sustainability assessment. Environ. Impact Assess. Rev. 2004, 24, 595–616. [Google Scholar] [CrossRef] [Green Version]
  16. Ling, J.; Germain, E.; Murphy, R.; Saroj, D. Designing a Sustainability Assessment Framework for Selecting Sustainable Wastewater Treatment Technologies in Corporate Asset Decisions. Sustainability 2021, 13, 3831. [Google Scholar] [CrossRef]
  17. Gasparatos, A.; Scolobig, A. Choosing the most appropriate sustainability assessment tool. Ecol. Econ. 2012, 80, 1–7. [Google Scholar] [CrossRef]
  18. Niekamp, S.; Bharadwaj, U.R.; Sadhukhan, J.; Chryssanthopoulos, M.K. A multi-criteria decision support framework for sustainable asset management and challenges in its application. J. Ind. Prod. Eng. 2015, 32, 23–36. [Google Scholar] [CrossRef]
  19. Kiker, G.A.; Todd, À.; Bridges, S.; Varghese, A.; Seager, T.P.; Linkovjj, I. Application of Multicriteria Decision Analysis in Environmental Decision Making. Integr. Environ. Assess. Manag. 2005, 1, 95–108. [Google Scholar] [CrossRef]
  20. Cegan, J.C.; Filion, A.M.; Keisler, J.; Linkov, I. Trends and applications of multi-criteria decision analysis in environmental sciences: Literature review. Environ. Syst. Decis. 2017, 37, 123–133. [Google Scholar] [CrossRef]
  21. Huang, I.B.; Keisler, J.; Linkov, I. Multi-criteria decision analysis in environmental sciences: Ten years of applications and trends. Sci. Total Environ. 2011, 409, 3578–3594. [Google Scholar] [CrossRef] [PubMed]
  22. Myšiak, J. Consistency of the Results of Different MCA Methods: A Critical Review. Environ. Plan. C Gov. Policy 2006, 24, 257–277. [Google Scholar] [CrossRef]
  23. Zhao, J.; Smith, T.; Lavigne, M.; Aenishaenslin, C.; Cox, R.; Fazil, A.; Johnson, A.; Sanchez, J.; Hermant, B. A Rapid Literature Review of Multi-Criteria Decision Support Methods in the Context of One Health for All-Hazards Threat Prioritization. Front. Public Health 2022, 10, 861594. [Google Scholar] [CrossRef]
  24. Saaty, R.W. The analytic hierarchy process—What it is and how it is used. Math. Model. 1987, 9, 161–176. [Google Scholar] [CrossRef] [Green Version]
  25. Uzun, B.; Taiwo, M.; Syidanova, A.; Uzun Ozsahin, D. The Technique For Order of Preference by Similarity to Ideal Solution (TOPSIS). In Application of Multi-Criteria Decision Analysis in Environmental and Civil Engineering; Uzun Ozsahin, D., Gökçekuş, H., Uzun, B., LaMoreaux, J., Eds.; Springer International Publishing: Cham, Switzerland, 2021; pp. 25–30. ISBN 978-3-030-64765-0. [Google Scholar]
  26. Cinelli, M.; Coles, S.R.; Kirwan, K. Analysis of the potentials of multi criteria decision analysis methods to conduct sustainability assessment. Ecol. Indic. 2014, 46, 138–148. [Google Scholar] [CrossRef] [Green Version]
  27. Pavlovskaia, E. Sustainability criteria: Their indicators, control, and monitoring (with examples from the biofuel sector). Environ. Sci. Eur. 2014, 26, 1–12. [Google Scholar] [CrossRef] [Green Version]
  28. Ahmed, Y.; Gendy, A.; Hagger, S. Sustainability Assessment of Municipal Wastewater Treatment. Int. J. Environ. Ecol. Eng. 2017, 11. [Google Scholar] [CrossRef]
  29. Balkema, A.J.; Preisig, H.A.; Otterpohl, R.; Lambert, F.J. Indicators for the sustainability assessment of wastewater treatment systems. Urban Water 2002, 4, 153–161. [Google Scholar] [CrossRef]
  30. Muga, H.E.; Mihelcic, J.R. Sustainability of wastewater treatment technologies. J. Environ. Manag. 2008, 88, 437–447. [Google Scholar] [CrossRef] [PubMed]
  31. Molinos-Senante, M.; Gómez, T.; Garrido-Baserba, M.; Caballero, R.; Sala-Garrido, R. Assessing the sustainability of small wastewater treatment systems: A composite indicator approach. Sci. Total Environ. 2014, 497–498, 607–617. [Google Scholar] [CrossRef] [PubMed]
  32. Popovic, T.; Kraslawski, A.; Avramenko, Y. Applicability of Sustainability Indicators to Wastewater Treatment Processes. Comput. Aided Chem. Eng. 2013, 32, 931–936. [Google Scholar] [CrossRef]
  33. Afroz, R.; Hanaki, K.; Hasegawa-Kurisu, K. Willingness to pay for waste management improvement in Dhaka city, Bangladesh. J. Environ. Manag. 2009, 90, 492–503. [Google Scholar] [CrossRef]
  34. Adaman, F.; Karalı, N.; Kumbaroğlu, G.; Or, I.; Özkaynak, B.; Zenginobuz, ü. What determines urban households’ willingness to pay for CO2 emission reductions in Turkey: A contingent valuation survey. Energy Policy 2011, 39, 689–698. [Google Scholar] [CrossRef]
  35. Finkbeiner, M.; Schau, E.M.; Lehmann, A.; Traverso, M. Towards Life Cycle Sustainability Assessment. Sustainability 2010, 2, 3309–3322. [Google Scholar] [CrossRef] [Green Version]
  36. Gherghel, A.; Teodosiu, C.; Notarnicola, M.; De Gisi, S. Sustainable design of large wastewater treatment plants considering multi-criteria decision analysis and stakeholders’ involvement. J. Environ. Manag. 2020, 261, 110158. [Google Scholar] [CrossRef]
  37. Laforest, J.; Bouchard, L.-M.; Maurice, P.; Institut National de Santé Publique du Québec; Ministère de la Sécurité Publique. Guide d’Organisation d’Entretiens Semi-Dirigés Avec Des Informateurs Clés: Trousse Diagnostique de Sécurité Ǻ l’intention Des Collectivités Locales; Institut National de Santé Publique Québec Avec la Collaboration de Ministère de la Sécurité Publique: Montreal, QC, Canada, 2011; ISBN 9782550626800. [Google Scholar]
  38. Sabia, G.; De Gisi, S.; Farina, R. Implementing a composite indicator approach for prioritizing activated sludge-based wastewater treatment plants at large spatial scale. Ecol. Indic. 2016, 71, 1–18. [Google Scholar] [CrossRef]
  39. Mustapha, M.A.; Manan, Z.A.; Alwi, S.R.W. A new quantitative overall environmental performance indicator for a wastewater treatment plant. J. Clean. Prod. 2017, 167, 815–823. [Google Scholar] [CrossRef]
  40. Kabir, G.; Sadiq, R.; Tesfamariam, S. A review of multi-criteria decision-making methods for infrastructure management. Struct. Infrastruct. Eng. 2013, 10, 1176–1210. [Google Scholar] [CrossRef]
  41. Shariat, R.; Roozbahani, A.; Ebrahimian, A. Risk analysis of urban stormwater infrastructure systems using fuzzy spatial multi-criteria decision making. Sci. Total Environ. 2018, 647, 1468–1477. [Google Scholar] [CrossRef] [PubMed]
  42. Stefanakis, A.; Akratos, C.S.; Tsihrintzis, V.A. Vertical Flow Constructed Wetlands: Eco-Engineering Systems for Wastewater and Sludge Treatment; Elsevier: Amsterdam, The Netherlands, 2014. [Google Scholar]
  43. Amorocho-Daza, H.; Cabrales, S.; Santos, R.; Saldarriaga, J. A New Multi-Criteria Decision Analysis Methodology for the Selection of New Water Supply Infrastructure. Water 2019, 11, 805. [Google Scholar] [CrossRef] [Green Version]
  44. Plakas, K.V.; Georgiadis, A.A.; Karabelas, A.J. Sustainability assessment of tertiary wastewater treatment technologies: A multi-criteria analysis. Water Sci. Technol. 2015, 73, 1532–1540. [Google Scholar] [CrossRef] [PubMed]
  45. Ren, J.; Liang, H. Multi-criteria group decision-making based sustainability measurement of wastewater treatment processes. Environ. Impact Assess. Rev. 2017, 65, 91–99. [Google Scholar] [CrossRef]
  46. Domínguez, I.; Oviedo-Ocaña, E.R.; Hurtado, K.; Barón, A.; Hall, R.P. Assessing Sustainability in Rural Water Supply Systems in Developing Countries Using a Novel Tool Based on Multi-Criteria Analysis. Sustainability 2019, 11, 5363. [Google Scholar] [CrossRef] [Green Version]
  47. Dotro, G.; Langergraber, G.; Molle, P.; Nivala, J.; Puigagut, J.; Stein, O.; von Sperling, M. Volume 7: Treatment Wetlands. In Biological Wastewater Treatment Series; IWA Publishing: London, UK, 2017; ISBN 9781780408774. [Google Scholar]
  48. Al-Wahaibi, B.M.; Jafary, T.; Al-Mamun, A.; Baawain, M.S.; Aghbashlo, M.; Tabatabaei, M.; Stefanakis, A.I. Operational modifications of a full-scale experimental vertical flow constructed wetland with effluent recirculation to optimize total nitrogen removal. J. Clean. Prod. 2021, 296, 126558. [Google Scholar] [CrossRef]
  49. Arias, C.A.; Amin, L.; Ananthatmula, R.; Andrews, L.; Baxpehler, H.; Behrends, L.L.; Bresciani, R.; Brodnik, U.; Buttiglier, G.; Castañares, L.; et al. Nature-Based Solutions for Wastewater Treatment; IWA Publishing: London, UK, 2021. [Google Scholar]
  50. Masi, F.; Bresciani, R.; Martinuzzi, N.; Cigarini, G.; Rizzo, A. Large scale application of French reed beds: Municipal wastewater treatment for a 20,000 inhabitant′s town in Moldova. Water Sci. Technol. 2017, 76, 134–146. [Google Scholar] [CrossRef]
  51. Stefanakis, A.I. The Role of Constructed Wetlands as Green Infrastructure for Sustainable Urban Water Management. Sustainability 2019, 11, 6981. [Google Scholar] [CrossRef] [Green Version]
  52. Stefanakis, A.I. Constructed wetlands: Description and benefits of an eco-tech water treatment system. In Impact of Water Pollution on Human Health and Environmental Sustainability; McKeown, A.E., Bugyi, G., Eds.; IGI Global: Hershey, PA, USA, 2016; pp. 281–303. ISBN 9781466695603. [Google Scholar]
  53. Oral, H.V.; Carvalho, P.; Gajewska, M.; Ursino, N.; Masi, F.; van Hullebusch, E.D.; Kazak, J.K.; Exposito, A.; Cipolletta, G.; Andersen, T.R.; et al. A review of nature-based solutions for urban water management in European circular cities: A critical assessment based on case studies and literature. Blue-Green Syst. 2020, 2, 112–136. [Google Scholar] [CrossRef] [Green Version]
  54. Abdelhay, A.; Abunaser, S.G. Modeling and Economic Analysis of Greywater Treatment in Rural Areas in Jordan Using a Novel Vertical-Flow Constructed Wetland. Environ. Manag. 2020, 67, 477–488. [Google Scholar] [CrossRef] [PubMed]
  55. Somarakis, G.; Stagakis, S.; Chrysoulakis, N. ThinkNature Nature-Based Solutions Handbook; ThinkNature Funded by the EU Horizon 2020 Research and Innovation under Grant Agreement No. 730338; European Union: Brussels, Belgium, 2020. [Google Scholar]
  56. Pedersen, E.; Weisner, S.E.; Johansson, M. Wetland areas′ direct contributions to residents′ well-being entitle them to high cultural ecosystem values. Sci. Total Environ. 2018, 646, 1315–1326. [Google Scholar] [CrossRef] [PubMed]
  57. Parde, D.; Patwa, A.; Shukla, A.; Vijay, R.; Killedar, D.J.; Kumar, R. A review of constructed wetland on type, treatment and technology of wastewater. Environ. Technol. Innov. 2020, 21, 101261. [Google Scholar] [CrossRef]
  58. Balzan, M.V.; Tomaskinova, J.; Collier, M.; Dicks, L.; Geneletti, D.; Grace, M.; Longato, D.; Sadula, R.; Stoev, P.; Sapundzhieva, A. Building capacity for mainstreaming nature-based solutions into environmental policy and landscape planning. Res. Ideas Outcomes 2020, 6, e58970. [Google Scholar] [CrossRef]
  59. Hugé, J.; Waas, T.; Eggermont, G.; Verbruggen, A. Impact assessment for a sustainable energy future—Reflections and practical experiences. Energy Policy 2011, 39, 6243–6253. [Google Scholar] [CrossRef]
  60. Boano, F.; Caruso, A.; Costamagna, E.; Ridolfi, L.; Fiore, S.; Demichelis, F.; Galvão, A.; Pisoeiro, J.; Rizzo, A.; Masi, F. A review of nature-based solutions for greywater treatment: Applications, hydraulic design, and environmental benefits. Sci. Total Environ. 2019, 711, 134731. [Google Scholar] [CrossRef]
  61. Karimi, A.R.; Mehrdadi, N.; Hashemian, S.J.; Bidhendi, G.R.; Moghaddam, R.T. Selection of Wastewater Treatment Process Based on the Analytical Process and Fuzzy Analytical Hierarchy Process Methods. Int. J. Environ. Sci. Technol. 2011, 8, 267–280. [Google Scholar] [CrossRef] [Green Version]
  62. Zidan, A.R.; Hady, M.A. Constructed Subsurface Wetlands Case Study and Modeling; CRC Press: Boca Raton, FL, USA, 2018; ISBN 9781315365893. [Google Scholar]
  63. Köbbing, J.F.; Thevs, N.; Zerbe, S. The Utilisation of Reed (Phragmites Australis): A Review. Mires Peat 2013, 13, 1–14. [Google Scholar]
  64. Masi, F.; Rizzo, A.; Regelsberger, M. The role of constructed wetlands in a new circular economy, resource oriented, and ecosystem services paradigm. J. Environ. Manag. 2018, 216, 275–284. [Google Scholar] [CrossRef]
  65. Hashemi, S. Sanitation Sustainability Index: A Pilot Approach to Develop a Community-Based Indicator for Evaluating Sustainability of Sanitation Systems. Sustainability 2020, 12, 6937. [Google Scholar] [CrossRef]
  66. Ossadnik, W.; Schinke, S.; Kaspar, R.H. Group Aggregation Techniques for Analytic Hierarchy Process and Analytic Network Process: A Comparative Analysis. Group Decis. Negot. 2015, 25, 421–457. [Google Scholar] [CrossRef] [Green Version]
  67. Sipahi, S.; Timor, M. The analytic hierarchy process and analytic network process: An overview of applications. Manag. Decis. 2010, 48, 775–808. [Google Scholar] [CrossRef]
  68. Bottero, M.; Comino, E.; Riggio, V. Application of the Analytic Hierarchy Process and the Analytic Network Process for the assessment of different wastewater treatment systems. Environ. Model. Softw. 2011, 26, 1211–1224. [Google Scholar] [CrossRef]
  69. Rezaeinia, N. Eigenvalue-UTilité Additive Approach for Evaluating Multi-Criteria Decision-Making Problem. J. Multi-Criteria Decis. Anal. 2022, 29, 431–445. [Google Scholar] [CrossRef]
  70. Lennartsson, M.; Kvarnström, E.; Lundberg, T.; Buenfil, J.; Sawyer, R. Comparing Sanitation Systems Using Sustainability Criteria. EcoSanRes Programme. 2009. Available online: http://www.ecosanres.org/pdf_files/ESR2009-1-ComparingSanitationSystems.pdf (accessed on 5 August 2022).
  71. Belton, V.; Pictet, J. A Framework for Group Decision Using a MCDA Model: Sharing, Aggregating or Comparing Individual Information? J. Decis. Syst. 1997, 6, 283–303. [Google Scholar] [CrossRef]
  72. JSMO Water-Reclaimed Domestic Wastewater 893/2021. Available online: http://www.jsmo.gov.jo/ (accessed on 3 July 2022).
  73. Triantaphyllou, E.; Sánchez, A. A Sensitivity Analysis Approach for Some Deterministic Multi-Criteria Decision-Making Methods. Decis. Sci. 1997, 28, 151–194. [Google Scholar] [CrossRef]
  74. Kokaraki, N.; Hopfe, C.J.; Robinson, E.; Nikolaidou, E. Testing the reliability of deterministic multi-criteria decision-making methods using building performance simulation. Renew. Sustain. Energy Rev. 2019, 112, 991–1007. [Google Scholar] [CrossRef]
  75. Kabassi, K.; Martinis, A. Sensitivity Analysis of PROMETHEE II for the Evaluation of Environmental Websites. Appl. Sci. 2021, 11, 9215. [Google Scholar] [CrossRef]
Figure 1. The steps of developing the MCA.
Figure 1. The steps of developing the MCA.
Sustainability 14 14867 g001
Figure 2. Basic process design for the three selected treatment alternatives. This study considered pretreatment, secondary and sludge treatment, and disposal, in order to meet the Jordanian standards for reuse, JS893–2021.
Figure 2. Basic process design for the three selected treatment alternatives. This study considered pretreatment, secondary and sludge treatment, and disposal, in order to meet the Jordanian standards for reuse, JS893–2021.
Sustainability 14 14867 g002
Figure 3. Proposed criteria and indicators hierarchy for the sustainability assessment of the wastewater technology for this study.
Figure 3. Proposed criteria and indicators hierarchy for the sustainability assessment of the wastewater technology for this study.
Sustainability 14 14867 g003
Figure 4. Scores of three treatment alternatives for each assessment criteria. A higher score means a greater performance.
Figure 4. Scores of three treatment alternatives for each assessment criteria. A higher score means a greater performance.
Sustainability 14 14867 g004
Figure 5. Scores of three treatment options after unifying the indicators weights. A higher score means a greater performance.
Figure 5. Scores of three treatment options after unifying the indicators weights. A higher score means a greater performance.
Sustainability 14 14867 g005
Table 1. Common criteria and indicators to assess wastewater treatment technologies from literature review and previous studies.
Table 1. Common criteria and indicators to assess wastewater treatment technologies from literature review and previous studies.
CriteriaIndicatorReferences
EnvironmentalSoil and land contamination *[16,38]
Greenhouse gas emission or carbon footprint *[16,38,39]
Environmental impacts[16,40,41]
Nonrenewable raw materials[16,40]
Biodiversity[42]
Durability[43,44,45]
Stability *[28,38,43,45]
InstitutionalAvailability of local capabilities and local technical capabilities within the institution *[40,42,46]
Compatibility with the local strategies, standards *[42]
TechnicalPollutant removal potentials[16,28,30,31,38,39,47]
Amount of sludge produced *[28,30,38,48]
Generated by-products *[16,28,38,48]
Ease of implementation[16,28,44]
Ease of operation* (ordinary and extraordinary maintenance)[28,44,48]
Availability of local materials[49,50,51]
Possibility for future expansion *[51,52,53]
Small scale technologies used[16,54]
SocialPublic acceptance—compatibility with general service level *[16,55]
Odor and noise impact *[16,28,44]
Provision of aesthetic and green places[42,55]
Community participation and job opportunities *[16,31]
Respect of local culture[16,28,39,56]
Health of the community[28,39,57,58]
Willingness to pay *[53,58,59,60]
Visual impact *[44,53,56,58,59,60]
EconomicConstruction/capital costs *[28,45,58,61,62]
Operation and maintenance costs *[28,31,39]
Land cost[28,31,39,42,47]
Local market incentive[52,53]
Treated WW reuse *[40,63,64]
Land requirement *[16,28,30,39]
Chemical requirements[16,65]
Energy requirements *[28,31,65]
* Also suggested by local stakeholders.
Table 2. The semantic scale for pairwise comparison in AHP, adopted from Saaty, R.W [24].
Table 2. The semantic scale for pairwise comparison in AHP, adopted from Saaty, R.W [24].
Intensity of ImportanceDefinitionExplanation
1Equal importanceTwo activities contribute equally to the objective
2Weak or slight
3Moderate importanceExperience and judgement slightly favor one activity over another
4Moderate plus
5Strong importanceExperience and judgement strongly favor one activity over another
6Strong plus
7Very strong or demonstrated importanceAn activity is favored very strongly over another; its dominance demonstrated in practice
8Very, very strong
9Extreme importanceThe evidence favoring one activity over another is of the highest possible order of affirmation
Reciprocals of aboveIf activity i has one of the above non-zero numbers assigned to it when compared with activity j, then j has the reciprocal value when compared with iA reasonable assumption
1.1–1.9If the activities are very closeMay be difficult to assign the best value, but when compared with other contrasting activities, the size of the small numbers would not be too noticeable, yet they can still indicate the relative importance of the activities
Reprinted from Mathematical Modelling, Vol 9, Saaty R. W, The analytic hierarchy process—what it is and how it is used, Pages 161-176., Copyright (1987), with permission from Elsevier.
Table 3. Random Index RI values.
Table 3. Random Index RI values.
N° of
Indicators
123456789101112131415
RI000.580.91.121.241.321.411.451.491.511.481.561.571.59
Table 4. Individual weightings of the 10 stakeholders, aggregated group weightings on the indicators, and the final ranking of group weights.
Table 4. Individual weightings of the 10 stakeholders, aggregated group weightings on the indicators, and the final ranking of group weights.
CriteriaIndicatorsStakeholdersGeom MeanWeightRank
12345678910
Technicaleasiness0.230.090.110.060.180.050.070.140.070.070.090.13
climate change0.050.020.040.030.040.010.020.020.010.010.020.0214
sludge0.060.030.020.010.040.020.020.050.030.030.030.0313
Financialcapex0.040.110.030.020.030.030.020.020.060.060.040.0410
opex0.120.320.110.20.180.160.160.10.150.250.160.182
recovery0.070.080.020.060.030.070.050.040.040.070.050.056
Environmentalemission0.020.020.040.050.020.040.080.050.060.020.040.049
contamination0.040.020.030.040.030.030.030.010.030.040.030.0312
biodiversity0.010.010.070.020.010.020.020.020.010.010.020.0216
carbon0.010.040.070.050.030.040.040.020.020.010.030.0311
Socialacceptance0.130.110.20.240.180.170.260.320.210.140.190.21
aesthetic0.050.020.120.090.10.140.060.080.120.050.070.084
willingness0.030.050.050.060.050.110.10.040.060.030.050.065
Institutionalcapability0.020.020.040.010.010.030.020.010.030.030.020.0215
compatibility0.080.030.030.030.040.050.020.030.060.070.040.047
management0.050.030.030.030.030.040.020.050.030.110.040.048
Table 5. Individual weightings of the 10 stakeholders, aggregated group weightings on the criteria, and the final rankings of group weights.
Table 5. Individual weightings of the 10 stakeholders, aggregated group weightings on the criteria, and the final rankings of group weights.
CriteriaStakeholdersGeom MeanWeightRank
12345678910
technical0.350.130.160.090.270.090.110.210.110.110.140.153
financial0.220.500.160.280.240.260.230.160.250.380.250.272
environmental0.080.100.210.160.090.130.170.100.120.080.120.1364
social0.210.190.370.390.320.420.420.430.390.220.320.341
institutional0.140.080.100.070.080.110.070.100.120.220.100.115
Table 6. Consistency ratios check for pairwise comparisons of the 10 stakeholders.
Table 6. Consistency ratios check for pairwise comparisons of the 10 stakeholders.
Stakeholders CR CheckCriteriaTechnicalFinancial EnvironmentalSocialInstitutional
1CR0.0890.0250.0020.0690.0030.008
Checkokokokokokok
2CR0.090.0210.0930.0570.0050.000
Checkokokokokokok
3CR0.080.0740.0810.0860.0460.046
Checkokokokokokok
4CR0.090.0740.0280.0570.0810.008
Checkokokokokokok
5CR0.0950.0050.0210.090.0080.046
Checkokokokokokok
6CR0.0780.0050.0300.0680.0460.046
Checkokokokokokok
7CR0.090.0930.0280.0820.0160.000
Checkokokokokokok
8CR0.060.0740.0030.0440.0560.046
Checkokokokokokok
9CR0.070.0630.0460.0320.0080.000
Checkokokokokokok
10CR0.0980.0020.0250.0570.0930.046
Checkokokokokokok
Table 7. The average performance ratings of each indicator among 10 stakeholders on a (1–5) scale; 1 refers to the poorest performance of that indicator, while 5 refers to the best.
Table 7. The average performance ratings of each indicator among 10 stakeholders on a (1–5) scale; 1 refers to the poorest performance of that indicator, while 5 refers to the best.
Criteria IndicatorsASSPFCW
Technical Ease of implementation and operation2.74.44.2
Climate change resilience3.52.83
Amount of sludge and by-products (Managing the generated sludge) 1.62.73.4
Financial Capital cost1.23.43.3
Operation and maintenance cost1.433.8
Resource/energy recovery and reuse opportunities 3.12.22.8
Environmental Total emission 13.24.2
Soil and land contamination1.82.72.9
Biodiversity restoration1.42.54.6
Carbon sequestration11.74.8
Social Public acceptance2.41.81.6
Provision of aesthetic and green places11.63.9
Willingness to pay1.71.81.9
Institutional Local personnel capabilities and local technical capabilities4.143.4
Compatibility with national strategies, standards, and common practices4.443.2
Organizational effort and financial management required2.12.62.4
Table 8. The minimum changes required in indicator weights to cause a rank shift between the best option (FCW) and the second-best option (SP).
Table 8. The minimum changes required in indicator weights to cause a rank shift between the best option (FCW) and the second-best option (SP).
IndicatorsGroup WeightAbsolute Change
δk.i.j
Relative Change
Ease of implementation and operation0.1032.32240%
Climate change resilience0.0232.310,092%
Amount of sludge and by-products (managing the generated sludge)0.0300.662180%
Capital cost0.0394.611,937%
Operation and maintenance cost0.1810.58318%
Resource/energy recovery and reuse opportunities0.0520.771465%
Total emission0.0400.461161%
Soil and land contamination0.0302.37564%
Biodiversity restoration0.0190.221140%
Carbon sequestration0.0310.15475%
Public acceptance0.2042.31126%
Provision of aesthetic and green places0.0800.2250%
Willingness to pay0.0584.67867%
Local personnel capabilities and local technical capabilities0.0220.773458%
Compatibility with national strategies, standards, and common practices0.0450.581289%
Organizational effort and financial management required0.0432.35399%
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Masoud, A.M.N.; Belotti, M.; Alfarra, A.; Sorlini, S. Multi-Criteria Analysis for Evaluating Constructed Wetland as a Sustainable Sanitation Technology, Jordan Case Study. Sustainability 2022, 14, 14867. https://doi.org/10.3390/su142214867

AMA Style

Masoud AMN, Belotti M, Alfarra A, Sorlini S. Multi-Criteria Analysis for Evaluating Constructed Wetland as a Sustainable Sanitation Technology, Jordan Case Study. Sustainability. 2022; 14(22):14867. https://doi.org/10.3390/su142214867

Chicago/Turabian Style

Masoud, Ahmed M. N., Marika Belotti, Amani Alfarra, and Sabrina Sorlini. 2022. "Multi-Criteria Analysis for Evaluating Constructed Wetland as a Sustainable Sanitation Technology, Jordan Case Study" Sustainability 14, no. 22: 14867. https://doi.org/10.3390/su142214867

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop