1. Introduction
In Jordan, the daily water share per capita is approximately 100 L, and this fact has ranked Jordan as the second poorest country for water availability per person [
1]. The country has been suffering from water scarcity that is caused by rapid population growth, a huge influx of refugees, and hydro-political tensions in the Middle East [
2]. This has led to a continuously increasing demand on water that is exceeding the potential of the country’s water resources [
3]. The well-known climate change impacts have worsened the Jordanian water sector by adding more challenges to the availability and variability of precipitation, extreme events, and heats waves, and these facts have created an imbalance in water management and have enlarged the gap between the demand and the water supply [
4].
According to the Ministry of Water and Irrigation’s (MWI’s) reports, the main sources of water in Jordan are (i) groundwater (59%), (ii) surface water (27%), (iii) treated wastewater (14%), and additional resources (desalination) [
1,
5]. The three main sectors that are competing for water resources are domestic, agriculture, and industry [
1,
5].
Although the Jordanian government is considering treated wastewater as a part of the annual water budget used in the agriculture sector, the sanitation sector still requires modifications and more sustainable solutions. To overcome this challenge and to enhance the reuse of wastewater, the Jordanian government has prepared the National Water Strategy 2016–2025. The strategy focuses on building a resilient sector based on a unified approach for a comprehensive social, economic, and environmentally viable water sector development. The national policy includes a (Decentralization Wastewater Management Policy), which aims to activate the decentralization concept in managing wastewater for small and scattered communities in order to serve them with sanitation services and to enhance the collection and the reuse of wastewater [
5,
6]. The MWI has established an inter-ministerial National Implementation Committee for Effective Integrated Wastewater Management (NICE) in order to develop regulatory and administrative tools for implementing and certifying decentralized wastewater management (DWWM) systems in Jordan [
5,
6,
7]. At the centralization level, MWI has prepared a plan to upgrade, modify, and expand the existent wastewater treatment plants in order to increase the amount of treated wastewater [
5]. However, 35% of Jordanians are still not connected to sewer networks and wastewater treatment plants, and they have onsite solutions such as septic tanks (mostly unsealed) which is not only causing environmental and health risks, but is also affecting the future potential for reusing treated wastewater [
1,
3,
8].
Al Azraq town is one of the unserved towns with sanitation system. It is located in the eastern part of Jordan and it has a population of more than 15,000 people, who are not served with a treatment system or a sewer network. Residents in this town have onsite solutions at the household level, and their wastewater is assembled in a collection tank via gravity [
8]. The collection tanks have no standard sizes, and they can be classified into (i) fully sealed septic tank, (ii) fully sealed septic tank with infiltration chamber, (iii) cesspits with rigid top-slab and walls, and not sealed, and (iv) cesspit with make-shift top slab and unsealed. According to the Azraq Municipality and based on the site assessments, the most commonly used ones are unsealed tanks, which cause the seepage of wastewater. The sewage is collected via desludging trucks and is disposed without further treatment to an illegal dumpsite, which contributes to pollution in the area and poses a very high risk for human health and for the environment.
On the other hand, Al Azraq town is located over a main groundwater basin called Al Azraq Basin, which is considered as a unique source of fresh water for the desert. The total area of Al Azraq basin is 12,414 km
2 and it extends from the Syrian borders in the north to the Saudi borders in the south, where 94% of the Azraq basin area is located in Jordan and the rest in Syria. Nowadays, around 70 MCM/year of drinking water are being pumped to Amman and Zarqa from the basin, and this covers 10% of the groundwater yearly abstraction in Jordan [
1,
9,
10]. The illegal disposal causes the infiltration of non-treated wastewater in the lowest point of the dumpsite area, which increases the risk of polluting the aquifer [
11]. Al Azraq has also a wetland reserve in the heart of the basin, where millions of migratory birds rest in it every year during their travels from Siberia to Africa, and vice versa. This natural wetland needs to be protected from the contamination of water and the environment caused by the inappropriate sanitation system [
10]. Even though the municipality knows its obligation to treat the wastewater in a centralized treatment plant, the cost of the sewage trucking is not feasible.
The critical situation of Al Azraq has caught the attention of many non-governmental organizations (NGOs) who are working in sanitation and who are willing to implement projects of wastewater treatment in Jordan. An international donor has allocated a certain budget to serve the town with a sustainable sanitation solution that can achieve the following benefits:
Reduction of the health risk related to water contamination,
Reduction of the existing environmental risk,
Provide a new source of water for the community,
Improvement of the resilience to climate change,
Development of a model that could be repeated in the future.
Although the funds have been allocated, the selection of the most appropriate and sustainable treatment technology that can be suitable for the Jordanian context in general and for Al Azraq town specifically is required. A sustainability assessment tool was needed to help the decision-makers with the selection of the most appropriate technology for this context.
The MWI has prepared a decision-support tool called the “Assessment of Local Lowest-Cost Wastewater Solutions” (ALLOWS) decision-support tool. The ALLOWS tool is used to identify most cost-efficient wastewater management solutions, and to determine whether a centralized or a decentralized approach is economically more appropriate for a specific case. The ALLOWS tool focuses on financial indicators for different wastewater scenarios, and accordingly enables planners and decision-makers to perform a comparative analysis to identify the best solutions for the wastewater management problem. The ALLOWS tool mainly considers the financial criteria and part of the technical criteria in comparing treatment scenarios without considering the other sustainability criteria such as the institutional, environmental, and the social; as a result, several sanitation projects have previously faced social rejections, and other projects have faced the overlapping of institutional responsibility, which has led to a change in the operation scenarios. Therefore, it is necessary to integrate a sufficient analysis tool that consider a wider vision of sustainability before making the asset decision and to carefully evaluate, assess, and select sustainable wastewater treatment processes or technologies [
6,
7].
The aim of this research is to present to the Jordanian water and wastewater sector a practical example of using MCA as a sustainability assessment tool, in order to integrate and to consider the tool in the decision-making process. The practical example considers the use of MCA to assess, compare, and evaluate the sustainability of different wastewater treatment options for Al Azraq town as a case study.
This paper covers a general background on the sanitation situation in Jordan and in the selected case study, and a general introduction on sustainability assessment tools, followed by a detailed methodology that has been used, the results and the main observations, and finally, the discussion and conclusions.
2. Sustainability Assessment Tools
Nowadays, decision-making processes are increasingly considering sustainability assessments [
12,
13]. Sustainability assessments contain several assessment tools and are basically linked with the long-term practice impact. In general, sustainability assessments evaluate the future impacts of current or planned interventions, and inform decision makers [
14,
15,
16].
Several tools have been developed and studied to perform sustainability assessments. According to the literature, the sustainability assessment can be completed in three approaches. The first approach is the biophysical approach, which considers the flow of resources and environmental impacts for evaluations such as Life Cycle Assessment (LCA); the second approach is the monetary and economical approach, which aims to deliver valuations based on the subjective value preference of stakeholders such as the Cost–Benefit Analysis (CBA); the last approach is indicator-based tools that include the selection of indicators, calculations of weights, and scoring and aggregation, such as Multi-Criteria Analysis (MCA) [
14,
16,
17]. MCA is a group of approaches that utilize multiple criteria and identify the best alternative based on the preference systems of stakeholders or decision makers [
18]. MCA provides a rational and a coherent decision-making process through the application of a standardized method. There are several methods in MCA, for example, the Analytical Hierarchy Process (AHP) [
16]. MCA has been usually used in the fields of environmental science and management. Comprehensive reviews on the detailed application of MCA were provided by Kiker et al. [
19], Cegan et al. [
20], Huang et al. [
21], and Ling et al. [
16].
3. Multi-Criteria Analysis (MCA)
Multi-criteria analysis (MCA) or multi-criteria decision making (MCDM) is a valuable and increasingly widely used tool to help decision making where there is a choice to be made between alternatives. It is particularly useful as a tool for sustainability assessment where a complex and inter-connected range of environmental, social, and economic issues must be considered, where objectives are often competing, and where doing the trade-offs is unavoidable. It provides a robust and transparent decision-making structure, making explicit the key considerations and the values assigned to them, and providing opportunities for not just stakeholders, but also the community’s participation. MCA can be applied at all levels of decision-making; from the consideration of project alternatives to the policy decisions, MCA is guiding an evolution towards selecting the most sustainable alternative. MCA has been widely applied in environmental management (water, air, energy, natural resources, and solid waste) or interventions/tools applications (stakeholders, strategies, sustainability, and GIS) [
19,
22]. In MCA, various approaches are used to classify, compare, and select the most appropriate alternatives with respect to the given criteria, such as the Analytical Hierarchy Process (AHP), Multi-Attribute Utility Theory (MAUT), Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS), Dominance-based Rough Set Approach (DRSA), and outranking methods such as Elimination and Choice Expressing the Reality (ELECTRE) [
20,
23]. These approaches are the most widely used MCDA tools in sustainability-related research, as reported in various publications. MAUT is a performance aggregation-based approach, which requires the identification of utility functions and weights for each attribute, which can then be aggregated in a unique synthesizing criterion. The AHP is another approach of the first performance aggregation-based approaches, and it was introduced by Saaty [
24] with the aim of evaluating criteria based on an absolute scale. The main idea of the TOPSIS technique is that the preferred alternative is the one that is the closest to the positive ideal solution and the furthest from the negative ideal solution; the positive ideal solution is formed as a combination of the best points of each criterion, and the negative ideal solution is a combination of the worst points of each criterion [
25]. This technique is only can be applied for the numerical dataset where the importance weights of the criterion are known or defined, based on the experts. The DRSA is a new technique that can classify choice and rank alternatives; it is based on an information distributed in a table whose rows are defined as alternatives, and where the columns are divided into conditions or criteria that are needed to assess the alternatives [
20,
26]. ELECTRE are preference aggregation-based methods, working on pairwise comparisons of the alternatives; they are known as outranking approaches because they purpose to assess whether alternative X is at least as good as (outranks) Y [
20,
23,
26].
The most common MCA methods that appear to be widely used in the environmental management is the AHP, followed by MAUT, due to its simplicity, accessibility, and user-friendly nature, while the least commonly applied is TOPSIS [
20,
23,
25].
Sustainability criteria are applied in MCA to deliver a measurement system, and they can indicate the requirements or standards for achieving sustainable services in a specific context. Indicators are measurements or assignments of values that indicate the accomplishment of sustainability criteria [
27]. Most of the common environmental indicators include energy use, emissions, and pollutant removal. In terms of economical indicators, capital costs, operational costs, and resource recovery are frequently used. Despite the progressive development of both environmental and economical indicators, social indicators are usually ignored because of their difficulties in measurement and quantification [
16,
28,
29,
30]. However, social indicators can be translated into a quantitative format using a points-based scale [
31,
32], and using willingness to accept (WTA) and willingness to pay (WTP) indicators [
33,
34].
Previous studies have integrated all sustainability criteria when assessing wastewater treatment alternatives [
29,
30,
31]. As a common multi-criterion issue, selecting among sustainability criteria is crucial to obtaining a final selection between alternatives [
35]. As a result, the calculation of weights processes has been established to aggregate indicators into a composite index for each alternative. Gherghel et al. [
36] have applied a Weighted Sum Model (WSM) to aggregate the performance of six criteria, in order to distinguish different wastewater treatment systems [
36]. Molinos-Senante et al. [
31] have used a ‘Global Sustainability Indicator’ to compare seven wastewater treatment alternatives according to environmental, social, and economic criteria [
31]. These previous works illustrated that a composite indicator can be a practical and reliable method to integrate multiple sustainability criteria.
In general, sustainability assessment methods are widely applied and studied in the research and academic sector, but they are limitedly applied in the practical decision-making process, especially in the water and wastewater sectors.
4. Methodology
The methodology used in this research was adapted from Ling et al. [
16] and divided into five steps, as described in
Figure 1. Firstly, understanding the local context; secondly, the construction of decision hierarchy; thirdly, the calculation of weights; fourthly, score aggregation and ranking of the treatment alternatives, and finally, checking the sensitivity analysis and determining the critical indicators [
16]. The development process was applied to compare three wastewater treatment alternatives that can be sustainable and suitable for the selected case study.
4.1. Understanding the Context and Identification of Stakeholders
As the first step, it is important to understand the context in detail from different aspects; the environmental, social, and economical conditions that are essential for the project development. Investigation into the town and the community has been initially performed in order to have a general view of the current situation, and also to identify the gaps and the required awareness among the population about the problem, in order to connect the community with the project, as well as preliminarily identifying some indicators.
The second step was the governance assessment aiming to understand the legal framework, the local legislation and policies, and the reuse standards. This step also identifies the governmental stakeholders, their level of importance, and their roles within the project. The next step was the socio-economic analysis with a main aim of tailoring the project and the strategy to the specific selected context. Then, a technical and economic feasibility study were done to identify the cost-effective solution of the plant, and the possible technical options. As a final step, preliminary environmental and social impact assessment analyses were investigated to identify the possible negative environmental and social impacts of the project.
Stakeholder analysis has been carried out to identify the main stakeholders in the project, and their role and impacts, the analysis step has been followed by semi-structured interviews that were conducted with the stakeholders as an initial step to understand the current practices and challenges of selecting the wastewater treatment technologies for the selected case study. The interviews also helped to engage with stakeholders during the development process of the MCA, and to collect their feedback about the tool.
Semi-structured interview guidelines prepared by Laforest et al. [
37] were pursued with the selected stakeholders. The interviews were conducted anonymously; each interview lasted an hour, with complete confidentiality of the answers and of the gathered data and information; finally, a validation of the answers with the respondent and an authorization for using the collected data were collected.
4.2. Construction of a Decision Hierarchy
The construction of a decision hierarchy is critical for developing a representative and successful MCA assessment in order to achieve the objective of the MCA. The study firstly considered a literature review and desk study step to collect indicators that have been used to evaluate wastewater treatment technologies from previous similar studies.
Table 1 below summarizes the main indicators used for similar analysis. This list was further reviewed and discussed with stakeholders, and then a final list of criteria and indicators was proposed based on the priorities mentioned in the interviews.
4.3. Calculations of Weights
4.3.1. Weighting Allocation Using the AHP
The AHP, developed by Thomas Saaty, R.W [
24], was selected for this study because of its simplicity of application and its developed theoretical basis [
24]. AHP is the most widely used in MCA approaches according to the number of its applications [
66,
67]. The procedure of AHP is based on three components: the anatomy of the problem as a hierarchical structure, pairwise comparisons, and calculation of weights [
68]. Pairwise comparison is the main task of AHP. The main question to be asked is ‘how important is criteria
X compared to criteria
Y?’ Each comparison determines the direction and the degree of importance between two indicators, using a semantic scale, as described in
Table 2. For example, a scale number of 5 referring to criteria
X is strongly more important than criteria
Y, whereas 1/5 refers to a reversed preference direction.
For opinions and ratings collection, stakeholders were invited to a semi-structured interview to complete pairwise comparisons between criteria and indicators. Each stakeholder provided his/her preference opinion through a series of pairwise comparisons questions.
The comparisons were carried out at the first level (criteria) of the hierarchy, and then at the second level (indicators) of the hierarchy under each criteria. A reciprocal matrix of was created based on m number of criteria/indicators to be compared, as described in Equation (1).
1,m indicates the opinion made between criteria number 1 and the
m-th criteria, etc. In total, an
m (
m − 1) number of comparisons are required per each matrix, given the property of reciprocity in AHP. An (
m + 1) number of matrices is required to calculate the weights for each stakeholder (1 for comparisons between all criteria at the first level, and m for the comparisons between indicators within each criteria).
The comparison matrix must be normalized to obtain the weight of each indicator. The method starts with the summing of each column as:
and the normalized matrix is calculated by dividing each element by the sum of its column [
16,
24]
Then, MATLAB was used to calculate the eigenvalues and eigenvectors for the normalized matrix. The principal eigenvectors that correspond to the highest eigenvalue have been considered to represent the final weights of the indicators. Mathematically, the eigenvectors are being calculated by averaging across the row of the normalized matrix, and the eigenvalue is obtained by summation of the products between each element of the eigenvector and the sum of the columns of the matrix. However, MATLAB has been used to calculate both eigenvectors and eigenvalues, in order to guarantee the accuracy of the calculations. At the end, the eigenvector obtained from MATLAB needs to be normalized to represent the final weights, and this is given by dividing individual value of the eigenvector in each row
Ar by the summation of the eigenvector values, as in Equation (4) [
16,
69]:
The normalized eigenvector
represents the weight of the indicator in a specific pairwise comparison [
16,
24,
69].
To verify the correctness of the procedure, the consistency ratio (
CR) was calculated for the entire comparison group to determine the consistency levels of judgements and opinions from stakeholders [
24]. Responses with
CR values of greater than 0.1 were revised, and when
CR remained greater than 0.1, the responses were excluded from the further aggregation of the group weightings. The 10% is tolerated because the priority of consistency to obtain a coherent explanation of a set of facts must differ over an order of magnitude from the priority of inconsistency, which is an error in the measurement of consistency. Thus, on a scale ranging over 0–1, the consistency ratio should not exceed 0.10 [
24]. The consistency ratio (
CR) is given by:
where
CI is the consistency index and
RI is the random index.
The
CI is determined by:
where
n is the number of the parameters in the comparison, criteria, or indicators; and
λ is the principal eigenvalue obtained from MATLAB, and represents the summation of the product between the sum of each column
and the corresponding eigenvector
.
The random index (
RI) is a fixed value related to the number of indicators or criteria present in the comparison.
Table 3 below indicates the
RI values according to the literature [
16,
24,
70].
The value output of CR is compared to the fixed reference value 0.10, with this meaning:
Then the procedure is consistent, and the calculated weight can be used
Then the procedure is inconsistent, the calculated weight can’t be used. The procedure needs to be rechecked.
4.3.2. Group Weightings
Every stakeholder made one set of responses and one weighting profile (normalized eigenvectors). A group of weightings is required to represent the overall responses on the importance of the selected criteria and the indicators. According to the literature, several ways of developing the group weighting can be used: (i) sharing, refers to the exchange of opinions and preferences among all stakeholders, and then the selection of one input for AHP calculation; (ii) comparing, refers to the comparison of weightings developed from individual preferences and deciding which set of weights is the most representative; or (iii) aggregating, means the mathematical aggregation and collection of individual weightings [
16,
71]. In this study, mathematical aggregation was considered as being more suitable due to the time limitation, the availability of the stakeholders, and the COVID-19 emergency situation, where social distancing conditions were still required when this study was conducted. The geometric mean was performed to aggregate individual weightings into a group weighting as:
where
is the aggregated group weight for the
k–th criteria or indicator, while
q represents a number of stakeholders; similar to the normalization of weights from a reciprocal matrix using Equation (4), the aggregated group weights were normalized so that the sum of all criteria is equal to 1.
4.4. Score Aggregation and Options Ranking
Wastewater treatment alternatives have been selected for the application of the criteria hierarchy and group weightings. The name and location of the wastewater treatment plant (WWTP) was mentioned before in the study and was clearly explained to the stakeholders. The proposed WWTP was designed to serve a population of approximately 15,000. The following three treatment alternatives were considered for the selected case:
Activated Sludge Process (ASP),
Stabilization Ponds Process (SP),
Constructed wetlands— (French constructed wetlands) FCW.
The technologies have been selected based on the most commonly used technologies in Jordan. Jordan has 33 centralized WWTPs (27 WWTP used ASP, and six WWTP used SP) while the third option, FCW, was proposed by the donor and the implementation partner as they were willing to evaluate using FCW as an application of NBS in the country. Several aspects have led the implementation partners to propose FCW for Al Azraq, as they have previously implemented several types of CWs, including FCW, under the same environment and climate conditions in the Middle East, the availability of local materials, especially the tuff in Al Azraq town, the availability of the land area, and the simplicity of operating the FCW. The treated wastewater will be used in fodder crops and uneatable agriculture according to the Jordanian standards 839–2021 [
72]; and the selected alternatives are able to treat the wastewater to the selected levels, and this is illustrated through different WWTPs using the same technologies in Jordan and in the neighboring countries. The stakeholders validated the suitability of the selected alternatives for the town.
Figure 2 below shows the basic treatment process outlines of the three alternatives to be compared. The proposed treatment processes started from pretreatment to sludge treatment and disposal. Detailed mechanical, chemical, and biological process designs are not included, as the technical aspect of each wastewater treatment process is not discussed in this study.
The criteria hierarchy and weightings developed in this study have been used to assess the overall scoring of each technology. The assessment of each indicator for each technology was provided in the format of performance ratings using a 5-point scale based on stakeholder’s opinions and judgments. Then, a Weighted Sum Model (WSM) was used to generate the performance ratings of indicators (
v1,
v2,…,
vn) and their corresponding weights (
w1,
w2,…,
wn) into a composite score
Si for the
i-th option, as:
4.5. Sensitivity Analysis Check
It is a common practice in AHP to analyze the sensitivity of the composite score and the ranking of options to potential changes in criteria weights. This study included two elements of sensitivity analysis. First, identifying the most critical indicator by calculating the minimum changes required in weights to cause a rank reversal. As the aim of this case study is to identify the best option, only the rank reversal between the top two options were considered. The steps for identifying the most critical indicator were based on the theory developed by Trianaphyllou and Sanchez [
73], and were used and illustrated by Ling et al. [
16]. The theory said that if the
i-th option is the best and the
j-th option is the second-best according to their composite scores (
Si > Sj), then the minimum change
δk.i.j in the weight of indicator
Ck to cause a rank reversal between
i and
j can be calculated. If the performance of the
j-th option is better than the
i-th option with respect to the
k-th indicator (
vjk > vik), then
If the performance v of the
i-th option is better than the
j-th option with respect to the
k-th indicator (
vjk < vik), then
Additionally, the relative minimum change
δk.i.j can also be expressed as:
δk.i.j may not have a feasible value. In other words, it may be impossible to reverse the existing ranking of the alternative
i-th and
j-th by making changes on the current weight of criterion. This situation occurs when the value of |
δk.i.j| is greater than weight value of indicator
k [
73].
The second element used to check the sensitivity in this research is assume that the selected performance indicators have equal importance for all the stakeholders. Equally weighted criteria are a common situation, against which the sensitivity of the results is tested. In this case study, the selected performance indicators are 16, and thus, each one has a weight factor of 100%/16 = 6.25%; considering the unified weights for indicators and the composite scores from stakeholders, the final options ranking will be checked and compered to the ranking resulting from the MCA [
74,
75].
5. Results
5.1. Semi-Structured Interview and Thematic Analysis
Ten stakeholders from different sectors (government, academia, WWTP designers, WWTP operator donors, international NGOs, and local NGOs) participated in the study and the interview process.
Table A1 in
Appendix A provides more details about the stakeholders’ profiles. Firstly, the stakeholders evaluated and validated the suggested and proposed criteria and indicators, which is a summary of the thematic analysis and results from the stakeholders’ interviews. Secondly, the stakeholders validated and confirmed the selected technology alternatives, which have previously been illustrated in
Figure 2.
5.2. Construction of a Decision Hierarchy
According to the indicators summarized from the literature and listed in
Table 1, and from the results of the semi-structured interviews, the proposed criteria hierarchy for assessing and selecting wastewater treatment technology are illustrated in
Figure 3, while the detailed definition of each indicator are summarized in
Table A2 in
Appendix A.
The hierarchy consists of two levels. The first level represents the five aspects of sustainability, and the second level illustrates the assessment indicators under each criteria.
Sustainability criteria were commonly used in the previous studies to assess treatment technologies, and the use of these criteria was validated by the stakeholders [
16,
28,
39,
44]. This is considering that climate change resilience under the technical sustainability was suggested by stakeholders in order to have a resilient technology that can provide the same treatment efficiency under different climate conditions. The management, treatment, and disposal of sludge created a problem in Jordan, and thus, “Amount of sludge and by-products—managing he generated sludge” has been selected as a technical indicator, besides the ease of implementation and operation. Resource recovery and the final reuse of the products have the priority according to the Jordanian situation to sustain the long-term operation under the financial sustainability criteria. The environmental sustainability has a special situation, since the project will be located within a Ramsar site where restoring the biodiversity has priority and carbon sequestration as well, in order to minimize the total emission while protecting the soil and the lands. For social sustainability and based on onsite evaluation, it was found that providing an aesthetic place and a green area are important indicators for the community, and will enhance the possibility of the willingness to accept and the willingness to pay to have the service. Finally, the institutional sustainability, as the selected technology, has to meet the local standards of operation and maintenance; it should be compatible with the framework of the responsible institute, and should be within their technical and financial capacities.
5.3. Weightings
The weights of each indicator that resulted from AHP from 10 stakeholders and the aggregated group weights are summarized in
Table 4 below. According to the results of the group weights, ‘Public acceptance’ had the highest weight (0.204), reflecting the importance of social acceptance for similar projects and interventions. Several stakeholders have illustrated during the semi-structured interviews that meeting social sustainability and community acceptance play a main role in having sustainable wastewater technology, and it is always a priority when selecting the wastewater treatment system.
The operational cost has been ranked second, with a weight of (0.181). This was followed by the ease of implementation and operation (0.103), and of having aesthetic and green areas (0.080). Although the capital cost is also important, the capital costs were funded through an international donation for the Al Azraq project. It is worth mentioning that climate change resilience, local capabilities, and restoring biodiversity indicators have the least importance and have been ranked 14, 15, and 16, respectively. At the first level of the hierarchy, the weights for each sustainability criteria were obtained; the social criteria (0.341) had the highest weight, followed by the financial criteria (0.268), then the technical criteria (0.154) and environmental criteria (0.126), and finally, the institutional criteria (0.110), as summarized in
Table 5.
Although previous studies and literature showed that financial and technical criteria could have the highest scores compared to other criteria, Ling et al. [
16] highlighted that comparing weighting profiles across different studies does not make sense, because decision priorities and contexts vary among studies [
16]. The final weights in this case study were presented to the participated stakeholders for their feedback. All stakeholders were satisfied with the results of the group weights.
The consistency ratios have been checked for all pairwise comparisons resulting from the AHP for the 10 stakeholders. The results showed that the pairwise comparisons are within the acceptable consistency ratio, as illustrated in
Table 6 below.
5.4. Score Aggregation and Final Ranking
The group weights resulting from the previous step were applied to the performance ratings of indicators for a score aggregation (as described previously, each stakeholder scored the selected technologies on a scale from 1 to 5 to indicate its performance under each indicator).
Table 7 below summarizes the average performance ratings of each indicator for each technology option, as provided by the stakeholders.
Firstly, the scores of the indicators were aggregated into each criteria according to the hierarchy in
Figure 3. Secondly, further aggregation into a composite score for each technology option was described in
Figure 4.
Figure 4 allows decision makers and stakeholders to understand and to rank the options based on their total scores, and to identify the best sustainable technology under each sustainability criterion.
Overall: The FCW option was scored as the best option for this case study, and based on its composite score (3.13), followed by SP (2.67), and finally, the AS (2.07).
Institutional criteria: FCW has the highest scores for most of the criteria, except the institutional criteria, where SP and AS had higher scores (0.37), while FCW scored (0.32).
Social: FCW scored (0.75) followed by AS (0.67), and lastly, SP, with (0.6).
Environment: FCW scored (0.49), and that indicated the difference between the conventional treatment systems and the nature-based solutions, such as FCW.
Technical: FCW and SP had the same score (0.6), while the AS scored (0.41) due to the complexity of operating AS.
Financial: FCW scored (0.96), followed by SP (0.49), and then AS (0.46).
5.5. Sensitivity Analysis Check
The first element of the sensitivity analysis check was to calculate the minimum change in the group weight of each indicator to cause a rank reversal between the top two options, using Equations (10)–(12).
Table 8 shows the calculated minimum weight change
δ that is required to determine if the indicator is critical or not; the calculation shows that all indicators are robust and are not sensitive; in other words, any changes in the indicator’s weights will not change the overall options ranking. The absolute change and the relative change that all indicators can withstand for a value change in their weights without causing a rank reversal for this case study.
For the second check using equally weighted criteria, equal weights have been applied to test the sensitivities of the results. In this case study, the selected performance indicators are 16, and thus, each indicator has a weight factor of (1/16) × 100% = 6.25%, considering the unified weights for the indicators and the composite scores from the stakeholders. The results showed that while the overall scores for all the treatment options increased, the final options ranking was not affected. As illustrated in
Figure 5 below, this method provided further illustration of the robustness of the selected indicators.
6. Discussion
In this study, sustainability criteria have been used for evaluating different treatment technologies. Each criteria has been divided into indicators that summarize the importance of the criteria. Although the sustainability criteria have been widely and effectively used for similar comparisons, the number of selected indicators is limited, due to the accuracy of the MCA process. Therefore, selecting indicators are crucial in MCA. In this study, the criteria and indicators have been selected after a deep understanding of the local context, conducting several site visits, and engaging stakeholders while implementing the MCA tool. From the local context, it was understood that for similar cases where the population count is moderate (5000 to 15000), the operators of the treatment plant are critical; usually, wastewater treatment plants are operated by the MWI or private companies, while the proposed operation scenario for this case study is to be operated by the local municipality. Due to that, the ease of implementation, maintenance, and management of the generated sludge are highly important technical indicators for selecting treatment technology. That operation scenario has highly affected the selecting process; not just the technical indicators, but also the financial and social indicators, such as the operation and maintenance costs, and resource recovery/reuse opportunities, in order to integrate suitable business models and socio-economic plans. The importance of environmental indicators has a higher level of importance; some indicators are matching the national climate change adaptation plan, such as carbon sequestration and total emissions indicators, while other indicators are linked with the social criteria, such as the provision of aesthetic places indicators. However, some indicators were not included in this study, such as odor problems and attracting insects and mosquitoes; these indicators might affect the social acceptance, but according to stakeholders, these problems can be avoided by selecting a proper location for the treatment plant.
Although including stakeholders is a key factor, this study found that introducing a new assessment method is challenging. Firstly, the availability of the stakeholders was an obstacle, and it should be considered carefully when developing the MCA. Ideally, engaging with as many stakeholders as possible would be useful for developing representative results. However, stakeholders were often occupied and not available. To overcome this challenge, stakeholders have been communicated through the implementing partners and the donor of the project. Secondly, meeting the stakeholders separately helped to overcome the authority segregation problem in the Jordanian wastewater sector, Thirdly, practicing AHP and pairwise comparison was confusing for some stakeholders, conducting MCA and pairwise comparison with stakeholders through face-to-face interviews helped in solving their confusion, and regular consistency ratio checks have been carried out immediately to avoid and to minimize the possible errors. Most of the stakeholders expressed their interest in AHP and the composite score approach after seeing the results and figures.
7. Limitations and Future Development
Although the sensitivity analysis for this research did not show any possibilities of reverse ranking, the pairwise comparisons can usually be sensitive to the number of alternatives to be compared, and the changes in weights, which might lead to rank reversal. Therefore, the sensitivity analysis is crucial to determining the critical criteria and its impact on the final ranking.
While the methodology for the MCA and AHP can be the same, the indicators and criteria can be different for another case study within the same country. This means that if we apply the same methodology and with the same indicators for another case study in Jordan, it might lead to different technology ranking. However, this can be considered as a benefit, since the flexibility of selecting indicators helps with obtaining better results for each specific case.
The Saaty scale in AHP (1–9 point) was difficult to use for stakeholders who were unfamiliar with the method. The scale can be considered as long scale; therefore, extreme values such as 9 or 8 were rarely used, and it was difficult for some stakeholders to understand the definition of the scale. For that, the reduced scale is recommended, and will be considered for future similar applications
While the mathematical part is relativity simple, achieving the consistency ratio limit was challenging. The consistency ratio was calculated since it is also linked with using the (0–9 point) scale; therefore, stakeholders were carefully scored for the indicators.
Further implementations of the sustainability assessment tools will provide accumulative knowledge and a database to support the decision-making process in the Jordanian wastewater sector.
Further research can consider different indicators listed in order to create a wider vision of the sustainability definitions in Jordan. Further research to assess the applicability of MCA and AHP tools in the surrounding region of Jordan could help the international donors and NGOs who are actively working in the wastewater sector in the region.
Further research will assess and evaluate using MCA and AHP to evaluate among the treatment options, rather than the indicators.
8. Conclusions
There is a great demand to serve the underserved community in Jordan with a sustainable sanitation solution. Parallel to that, there is also a great demand for an integrated sustainability assessment tool in the Jordanian water and wastewater sector, in order to support the decision makers in comparing, assessing, and selecting the best sustainable options. This study has used the MCA tool to compare and select wastewater treatment options for the case study of Al Azraq town in the eastern part of Jordan. The MCA tool provided a simple and wide approach for stakeholders to rank treatment alternatives by composite scores aggregated and adopted from the sustainability criteria and sub-indicators.
The study found that the AHP approach, combined with the semi-structured interviews with each stakeholder, can be a feasible and a practical approach to developing the weights. The results of composite and aggregated scores can be visualized easily and can be used to select between the alternative options. The study showed that FCW was identified as the best treatment technology for Al Azraq town, compared to the AS and SP.
Stakeholders’ engagement should also be included in the early stage of developing the methodology. The use of interviews and thematic analysis can develop a basic understanding of the current method for evaluating and selecting treatment technology; the collected data and information can be used to select the criteria and indicators that lead to having an assessment tool that is compatible with the stakeholder’s preference and decision-making context in the water and wastewater sector.
The development and optimization of the MCA tool will also help and support donors and international agencies who are working in the sectors in understanding the local context and selecting the appropriate and sustainable treatment options for each context while minimizing the risk potential.
The development of the MCA tool is basically an iterative process, and it can be reviewed and updated regularly. The criteria hierarchy and weights presented in this research were developed for a unique and specific case in Jordan. However, the methodology can be generalized to perform sustainability assessments for other cases or projects within the water and wastewater sector.