Next Article in Journal
Solids Removal Efficiency of a Sedimentation Tank in a Peri-Urban Catchment
Previous Article in Journal
Psychosocial Predispositions Towards Sustainability and Their Relationship with Environmental Identity
Previous Article in Special Issue
Optimization Design and Test Bed of Fuzzy Control Rule Base for PV System MPPT in Micro Grid
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Development of a Weight Factor Method for Sustainability Decisions in Building Renovation. Case Study Using Renobuild

1
Building Technology, Dalarna University, 791 88 Falun, Sweden
2
Department of Building, Energy and Environmental Engineering, Gävle University, 801 76 Gävle, Sweden
3
Organisation, Leadership and Management, Innland Norway University of Applied Sciences, 2418 Elverum, Norway
*
Author to whom correspondence should be addressed.
Sustainability 2020, 12(17), 7194; https://doi.org/10.3390/su12177194
Submission received: 6 July 2020 / Revised: 24 August 2020 / Accepted: 30 August 2020 / Published: 3 September 2020
(This article belongs to the Special Issue Sustainable Building Retrofit and Energy Optimization)

Abstract

:
Energy efficiency investments have become strategically important for the European Union. In particular, energy efficient renovation and investment in the existing building stock have become major challenges. Renovation of a building should involve a holistic and integrated design process, which considers all aspects of sustainability. The aim of this work is to suggest a mathematical model that weighs economic, social and ecological aspects into a measure that supports housing owners/decision makers to find the optimal renovation alternative from their perspective, taking factors such as budget, energy consumption, etc. into consideration. Multi-criteria decision-making (MCDM) concerns structuring and solving multiple-criteria decision problems. MCDM has become popular in energy planning as it enables the decision maker to pay attention to all the criteria available and make the appropriate decision as per the priority of the criteria. In this study, the concept is introduced based on economic, social and ecological aspects assessed during a renovation project. A pedagogical example illustrates the suggested numerical system for comparing different renovation alternatives. The suggested method will facilitate decision-making processes in renovation projects and will allow decision makers to choose the best renovation alternatives that are in line with their business ideas and principles.

1. Introduction

“Sustainable development is the bridge, between environmental, economic and social goals, between north and south, between Governments, civil society and business, between science and policy, and between policy and actions” [1]. Today, the world faces challenges in all three main dimensions of sustainable development, i.e., regarding environmental, economic, and social concerns. Achieving sustainable development requires global actions towards further economic and social progress and, at the same time, the strengthening of environmental protection. Strategies need to be ambitious, action-oriented and collaborative, and to adapt to different levels of development [2]. European Union institutions and Member States identify several systemic barriers shared among participants, such as the availability and reliability of data; lack of political will; weak capacity and technical know-how; and inadequate mechanisms and structures for recognizing financial opportunities and accessing available financial resources [3].
Investments for improvements in energy efficiency have become strategically important for the European Union; they are seen as the most effective way to reduce the EU’s dependence on energy imports [4]. Buildings are central to the EU’s energy efficiency policy, as buildings account for nearly 40% of the final energy consumption and 36% of greenhouse gas emissions [5]. Buildings are also long-term assets expected to remain in use for 50 years or more [4]; some 75–90% of the stock of buildings today are expected to exist at least until 2050 [6]. At present, around 35% of the EU’s buildings are over 50 years old and about 75% of the building stock is energy inefficient [7]. Demolition rates are low (0.4–1.2% per year, depending on the country) and so too are renovation rates (1.2% per year). Although the growth of the number of new buildings encompasses highly energy-efficient new-build (1% additions per year) [6], the new buildings will increase the stock’s absolute use of energy and fuel consumption. It is therefore necessary to reduce the energy use of the existing stock through energy efficient renovations, and the implication of this investment has become a challenge for the EU. Thus, one of the adopted policies for improving energy efficiency in the EU is that member countries should carry out energy efficient renovations on at least 3% of the buildings owned and occupied by governments per year [8]. Renovation of existing buildings can significantly increase energy efficiency and play an essential role in clean energy transition, as it could reduce the EU’s total energy consumption by 5–6% and lower CO2-emissions by around 5% [7].
“Sustainable Development involves the simultaneous pursuit of economic prosperity, environmental quality, and social equity” [9], thus “sustainable renovation” should correspond to sustainable development principles. According to the European Commission’s 2019 recommendations on building renovation, all environmental, economic, and social aspects need to be included in the renovation process to achieve sustainable development [10].
The definition of sustainability mentioned above is commonly used. It is, however, only one of many definitions [11,12]; there are more than three hundred others [13]. One of the present arguments about the concept regards the need for criteria that enable sustainability assessments of systems [14]. However, many definitions consider that sustainability is to be understood as constituted by three general aspects: economical, environmental, and social [15,16]. Some studies stress the importance of adding other aspects to sustainability in renovation assessment, such as a cultural dimension, suggested by Mickaityte [17] and Kohler and Hassler [18]. Lind [19] stresses the importance of including a “technical” aspect as a fourth dimension.
However, regarding sustainability aspects, a literature review concerning building renovation projects by Farsäter in 2017 [20] revealed that energy efficiency measures are those most widely researched. The energy aspect is included in over 70% of the analyzed strategies for refurbishment. Moreover, very few publications evaluate the effects of renovation measures regarding a combination of all three aspects: economical, environmental, and social. Kohler and Hassler [18] highlight the importance of the interrelationships between these aspects in terms of the sustainable management of the building stock.
Several obstacles hindering the creation of sustainable buildings through renovation are identified by Thuvander [21], Cattano [22], and Häkkinen and Belloni [23]. Apart from a fear of high investment costs and problems regarding low profitability, as identified by Olsson [24], the literature particularly emphasizes four obstacles: lack of knowledge about sustainability aspects; lack of simplified evaluation and decision-making tools; inadequate knowledge of the quality of the building stock; weak coordination between the goal of energy-saving and other project goals. Lind et al. [25] conclude that although sustainable renovation is possible, there are various conflicts between the different dimensions of sustainability. As an example of such a conflict, giving more weight to the environmental aspect of sustainability would increase costs and rents, which would create problems from a social perspective. Consequently, very few housing owners manage to address all sustainability aspects throughout a renovation project in a satisfactory manner. Several studies indicate that the focus on economic/financial issues reduces building owners’ interest in other sustainability aspects of buildings [26,27]. This suggests that owners/decision makers do not consider the various aspects of sustainability to be equally important.
Considering a multitude of sustainability criteria while undertaking a renovation project naturally adds to its complexity. Several critical decisions are taken throughout the process and certainly during the design stage [28]. Additionally, different actors involved in the renovation process, and specifically decision makers, have diverse priorities and preferences. There is a notable lack of simplified evaluation and decision-making tools [28,29]. An optimal tool should reduce complexity and help the decision makers to carry out renovation projects according to a holistic and integrated design process which considers various aspects of sustainability.
This study mainly concerns sustainability aspects applying so-called “deep renovation” of buildings. To accomplish sustainable deep renovation, different renovation alternatives or packages are evaluated regarding economic, environmental, and social performance. Changing the windows, adding extra insulation, and choosing between different HVAC systems are examples of renovation measures that can be included in possible packages of deep renovation. Different renovation packages/alternatives have different impacts as regards sustainability aspects and different decision makers/owners have different preferences. Accordingly, the research question of this study is the following: How to weigh the decision-making input factors regarding deep sustainable renovation packages? To address this research question, this work develops a method using the Weighted Sum Method (WSM). The reason behind the choice of the WSM is its simplicity and applicability. Moreover, if the assessment of different alternatives is based on three or four criteria and each criteria has one or two metrics, the WSM can be a very suitable method due to its straightforward implementation. To assess the trade-off between different criteria, a new way of weighting is suggested in this study.

Novelty and Aim of the Study

A way to support decision makers during renovation projects is to find a systematic method—a tool—that evaluates the various aspects of sustainability of different renovation scenarios. Given that there is a tool that assesses various aspects of sustainability, decision makers have difficulty when evaluations of vastly differing aspects have to be made. This paper relates these aspects in terms of quantitative values for different renovations, presents how this can be realized, and shows how this might be applied in a case study.
The aim of this work is thus to suggest a method that considers sustainability aspects in the decision-making process regarding the optimal sustainable renovation alternative for the building/property owner.
One tool for assessing aspects of sustainability, which has gained interest from decision makers in Swedish renovation projects, is Renobuild [30]. This tool is used in the present case study, and the output from Renobuild is used as input to the proposed method of weighting sustainability aspects.

2. Decision-Making Processes in the Early Phases of a Renovation Project

The importance of proper decision making in the early phases of projects has been addressed by Kolltviet and Gronhaug [31], who conclude that these decisions may dramatically affect a project’s value generation. Other studies emphasize that it is important to consider sustainability at an early stage in renovation projects [32,33]. The most important decisions that influence the life-cycle performance of a building are taken in the early phase of the design process [34]. According to Kohler and Moffatt [35], the earlier the assessment, the higher the ability to affect the life-cycle performance of the building.
Various studies address different steps in the early phase of renovation projects to define goals, assessment criteria, and the weighting of these; the steps are defined in different ways in these studies. Some studies [36,37] address sustainable decision models in building renovation; the models consist of steps regarding the choice of possible renovation scenarios and sustainability criteria that can be used for assessments and final decisions. Nielsen [29] performed a literature review concerning the tools that are developed to support decision-making processes in the early phases of renovation projects. Performance estimation of different renovation projects is the most researched area and the evaluation of design alternatives is the least researched area within the literature that concerns decision-making processes in renovation projects [29].
Multi-criteria decision-making (MCDM) is considered a potential tool for analyzing complex real problems due to its deep-rooted ability to judge different alternatives on various criteria for possible selection of the optimal alternative [38]. In a sustainable renovation process, the decision maker needs to compare the performance of different renovation alternatives/packages as regards aspects of sustainability, which make MCDM a suitable tool for analyzing this complex system.
MCDM methodologies have been developed in order to carry out a sustainable assessment. When it comes to the weighting of sustainability assessment criteria there are two principal approaches brought forward: the first is to consider criteria as having equal weight and the second is to assign weight to the particular criterium [29]. One study [39] investigates the use of two subjective weighting methods in the case of selecting which buildings to renovate within a building portfolio of 56 schools; an important finding of the study was that most of the participants experienced advantages of using a weighting method in the final decision-making process in comparison to not having any weighting method. The weighting methods can be classified into three categories: subjective weighting depending on the preferences of the decision maker, objective weighting based on quantitative measured data, and combination of subjective and quantitative weighting methods [40]. The most used weighting method is the Analytic Hierarchy Process (AHP) according to the review study by Nilsson [29]. Saaty [41] developed the Analytic Hierarchy Process (AHP) in 1980, and it is now a widely-used MCDM approach. With this approach, a scale of priorities is derived from pairwise comparison measurements of decision criteria. One of AHP’s limitations is the assumption of independence among various criteria of decision-making [41,42], which is not reasonable considering renovation projects. It is widely recognized that there is a conflict between the economic, environmental and social aspects of sustainability in renovation projects [19]. A study by Pirouz et al. [43] concerned with sustainability in the industrial sector has suggested Triangular Fuzzy Analytic Hierarchy Process (TFAHP) as a method to mitigate this limitation.
The Decision Making Trial and Evaluation Laboratory (DEMATEL) method [44] has been used in several studies to extract the mutual relationships and strength of interdependencies among criteria [45,46,47]. The DEMATEL method can be used with other techniques such as the Analytic Hierarchy Process (AHP) since it accounts for interdependence among the criteria. As the first step in using DEMATEL, the degree of influence between criteria should be defined based on data from literature reviews, brainstorming, or expert opinions. However, in renovation projects where the relationship between the different aspects of sustainability have not been defined in literature, especially the social aspect is hard to define by other means [20]. Moreover, as stated by many authors, there is a general lack of knowledgeable decision makers/buildings owners as regards the principles of sustainable renovation projects [21,22,23,24]. Thus, use of DEMATEL will probably add further complexity to the decision-making process in renovation projects where the aim of this work is to develop a simplified method that could be practical enough to be used by decision makers/buildings owners.
The Weighted Sum Method (WSM) is probably the oldest and most commonly used approach in MCDM, especially in single-dimensional problems [48]. Kumar reviewed [49] various MCDM techniques for making development sustainable in terms of renewable energy. The strength of WSM developed by Fishburn in 1967 is its simplicity; however, it fails to integrate multiple preferences. AHP allows more than one decision maker to be involved; however, it has been found that such wider involvement can make assigning weights to criteria a more complicated and time-consuming problem [39,45]. Kolios [50] compared WSM and AHP in a wind turbine design case study, in which 10 alternatives were assessed based on 10 criteria. WSM was the simpler method and gave similar results as AHP. Tupenaite [51] used different multiple criteria analysis to assess alternatives for built and human environment renovation. Here AHP and WSM also revealed similar results. However, weighting of criteria using AHP was more complicated, requiring experts in the fields to estimate weight.

3. Suggested Sub-Criteria to Assess Sustainability of Renovation Projects

To assess sustainability in a renovation project, sustainability performance needs to be quantified, i.e., estimated. The need for a sustainability performance metric and publicity tools brought about the development of certification rating systems by the World Green Building Council (GBC). The World GBC is a union of national councils, which was formed by eight nations in 2002. Its mission is to accelerate the transformation of the built environment towards sustainability [52]. However, these rating systems do not include the three aspects of sustainability, and thus they are not necessarily sustainability metrics and rarely used in academic literature as a means to measure sustainability performance and behavior [53].
Many studies [34,53,54,55] emphasize that the life cycle analysis (LCA) method is the most popular and comprehensive metric to evaluate environmental sustainability in renovation projects. LCA was developed in the early 1960s in an effort to quantify the environmental impact of various packaging options at a Coca Cola factory. It has now been developed and standardized into an analytical framework in the ISO 14040 series of standards. LCA is the “compilation and evaluation of the inputs, outputs and the potential environmental impacts of a product system throughout its life cycle” [56]. LCA studies were applied in many different sectors and, previously, were widely applied in the construction field [55,57].
For the economic assessment of sustainability in a renovation project, life cycle costing (LCC) is among the most solid and used methodologies [34,54]. LCC comprises an economic approach for assessing the total costs of products or projects during the service life of a system or component. It entails predominant influencing economic factors and discounts future costs to their present values, perceived as particularly relevant for systems with a long life span, such as buildings [58]. Life Cycle Assessment (LCA) and Life Cycle Cost (LCC) are combined by expressing environmental impacts in financial values [59,60].
The social aspect of sustainability in renovation projects is the least researched subject in literature [20,34]. Thermal comfort and indoor air quality are the most used criteria to assess the social aspect of sustainable renovation [29]. However, Attia [61] summarizes the evolution of comfort models in the last 50 years, worldwide, and conclude that these are mainly focused on office buildings, and there are a limited number of surveys in the area of residential buildings.

4. Weighted Sum Method in Multi-Criteria Decision Making

MCDM is a well-known abbreviation for multiple-criteria decision-making and multiple-criteria decision analysis. MCDM concerns structuring and solving decision and planning problems involving multiple criteria [62]. It helps a decision maker to quantify a particular criterion based on its importance in the presence of other objectives.
MCDM has become popular in energy planning as it enables the decision maker to give attention to all the criteria available and to make an appropriate decision as regards the priority of criteria [62]. Multi-criteria decision analysis has been widely applied in environmental decision-making. In single-dimensional cases, where all the units are the same, the WSM can be used without difficulty [63]. WSM is the most used of the multi-criteria decision-making methods in projects/studies concerned with renewable energy, planning energy, and building energy management, according to a literature review carried out by Pohekar [64].
In the renovation process, the decision maker will choose between different renovation measures based on the environmental, social, and economic impact of these alternatives. Each renovation alternative has a score reflecting its performance in each sustainability aspect. However, the sustainability aspects are not always equally important from the decision makers’ perspective. The present work suggests the WSM to be a suitable method to help decision makers in their final decision regarding the best renovation alternative from their perspective.
There are three steps in utilizing any decision-making technique involving the numerical analysis of alternatives:
  • Determine the relevant alternatives and criteria.
    • If there is set A with n alternatives, then
      A = { a 1 , a 2 , a 3 ,   a n }
    A set C with m criteria can be established such that
    C = { c 1 , c 2 , c 3 ,   c m }
  • Quantify the elements of matrices A and C.
  • Process the numerical values to determine the ranking of each alternative.
This is formulated in matrix form, with normalized elements, as:
    a 1         a n
c 1 c m [   μ 11   μ 1 n   μ m 1   μ m n ]
where μ i j   [ 0 ,   1 ] ,   i = { 1 ,   2 ,   3 m } ,   j = { 1 ,   2 ,   3 n }   represents the satisfaction of criterion c i by alternative a j . A higher value of μ i j means that alternative a j satisfies criterion c i in a better way.
If w i is the weight of importance associated with each criteria, c i , then
A W S M _ s c o r e = m a x ( a W S M s c o r e   j = i = 1 m μ i j · w i )
In Equation (4), a W S M s c o r e   j denotes the WSM score of each alternative, j, and the best alternative is the one with the highest A W S M s c o r e .

5. Steps of the Suggested Method

The following chart, Figure 1, explains the proposed method in this work.
  • Set the matrix: The decision maker has different renovation scenarios/alternatives, and these scenarios/alternatives should be evaluated with respect to the three sustainability aspects. Life cycle cost analysis (LCCA) is used to calculate the life cycle cost related to the energy efficient renovation measures of each alternative, which helps to assess the economic aspect of sustainability. Life cycle analysis (LCA) to calculate CO2 emissions and primary energy can be used to evaluate the environmental impact of each renovation alternative. After the preliminary calculations for different criteria (LCC, LCA, and social aspect analysis) for all the renovation scenarios, the matrix in Equation (3) can be formed.
  • Set the min/max requirement levels: As has been mentioned before, there are neither specific requirements nor a clear definition of a sustainable system. However, there are usually certain regulations (minimum requirements) to be fulfilled, for example, the energy use of buildings, ventilation requirements, and thermal comfort criteria. Moreover, the decision makers may have a limited budget, which should not be exceeded. This step will allow the decision maker to justify the minimum requirement of each aspect of sustainability. For example, the decision maker can cap acceptable cost or CO2 emissions or require a certain level of social points.
  • Calculate the score of each alternative on each criterion: This step calculates the value of certain alternatives lower or higher than the minimum requirement as a percentage. Any alternative with a negative score will be eliminated to guarantee that the final choice complies with the minimum requirements of sustainability.
  • Set the weight factors: Depending on the project, ambitions and company policies, decision maker preferences can, for certain aspects of sustainability, have more weight than other aspects and the weight factors are subjectively quantified. The method in this work suggests that the decision maker should choose the weight factor for each aspect of sustainability between [0, 1] so that the final sum of factors is 1. If a certain aspect has more than one metric to assess, the weight factor of this aspect can be divided between the used metrics.
  • Calculate weighted scores: In this step, scores from step 3 for different alternatives regarding certain criteria should be multiplied with the weight factor of this criteria to calculate the weighted scores.
  • Take the final decision: Calculate the total score for each alternative by adding the weighted scores for all criteria. The renovation scenario with the highest score is the best alternative from the decision makers’ perspective.

6. The Renobuild Case Study

The suggested methodology is set up to use any assessment tool that quantifies variables within each sustainability aspect. The SP Technical Research Institute (RISE) of Sweden has developed such a tool: Renobuild [30,65,66]. This tool aims to develop an instrument for evaluating various renovation options for an individual building or an area with several buildings (a neighborhood) regarding economic, environmental, and social aspects. The tool aims to support decision makers when choosing alternatives in renovation projects regarding the three aspects of sustainability, simply and transparently. The goal is to reduce energy use while at the same time maximizing the positive social effects of the measures at a reasonable cost. Renobuild is unique as it mainly concerns renovation projects and provides a framework for quantifying the assessed variables.
To assess the economic value of each renovation scenario, a particular LCC analysis tool [30] is used. For each renovation option, information needs to be generated and specified concerning investment costs, energy costs, discount rates, and annual price increases. For conducting more detailed analysis, the following items should also be included: reinvestment costs, operation/maintenance costs, and rental change. As a result, total life cycle costs are reported in a table and a bar graph, where the various parts are quantified and graphically represented.
Renobuild includes environmental impact in production as well as during the actual usage phase of the building. In the environmental module, the user defines the refurbishment options with quantity data, including systems energy, insulation, windows and doors, building materials, and the plumbing distribution system. Results are presented as changes in climate impact and primary energy use (resource use) in tables and charts.
In assessing the social aspects, the impact of renovation on people’s living conditions is supposed to be analyzed. However, involved parties need to form ideas and definitions as regards the building without renovation and possible future scenarios, for example through discussions with residents and current situation analyses. “Parks and squares”, greenery, storage and functions, common places and premises, and indoor environment are examples of items that can be analyzed from a social perspective.
Renobuild has certain limitations due to being in a development phase. An example of these limitations is the problem of finding correct input data. For Renobuild, this becomes a challenge at an early stage of renovation projects, since many uncertain inputs and many estimates/assumptions must be made. Furthermore, to be able to carry out the analysis with accurate results, a relatively extensive database is required, which can mean significant work for a decision maker. However, the analysis can be repeated during later stages when more data is available.
The results of Renobuild assumes that the three aspects of sustainability have equal importance, which is not necessarily true from the owner/decision maker’s perspective. This has posed problems for decision makers, since they have difficulties in evaluating which measure is better than the others.

6.1. Building Description

The Million Homes Program in Sweden is a common name for a housing project which was undertaken in Sweden between 1965 and 1974. During this program, 1,005,578 dwellings were constructed, both as single-family houses and multi-family buildings [67]. Some 50 years later, many of the technical systems and components in these buildings are reaching the end of their service-lives and need renovation. Almost 300,000 buildings are in urgent need of renovation [68]. Increased insulation of the floor and facades, new windows with lower U-values, and changed ventilation systems are some examples of the renovation measures needed.
The following example, which is a renovation project that was a case study for Renobuild, reflects the principal numerical system. The example is taken from the report that was published by Mjörnell [30]; the building example typifies the buildings of the Million Homes Program.
The chosen case is called Garvaren and is located at Uddevalla Municipality in Västra Götaland County, Sweden, as Figure 2 shows. Over the year, the temperature in Uddevalla typically varies from −4 °C to 20 °C and is rarely below −13 °C or above 25 °C [69]. The building is a U-shaped building constructed in 1955 and is three storeys high. It has 76 apartments and a heated floor area (Atemp) of almost 7227 m2.
Table 1 shows the five renovation alternatives, which were suggested and used as renovation alternatives in the Renobuild calculations:

6.2. Calculation Procedure

1. 
Set the matrix:
The decision maker chose the input data in the calculation of LCC and LCA in this case study. The study period of LCC analysis is 40 years, the discount rate is 3.8%, and price escalation is 2%. The analysis includes investment costs, operation and maintenance costs, and energy costs. The chosen study period of LCA is also 40 years and the greenhouse gas (GHG) emissions with the unit CO2-eq were calculated taking into consideration the technical lifespan for renovation material, and the production, transportation, and use phases.
To assess the social aspect, four sub-criteria were chosen assessed on a scale from 1 to 5 regarding each renovation alternative. The studied aspects in the present case are limited to habitat quality and they are:
  • The renovation does not cause any significant disturbance to the residents.
  • The rate of relocation in the area is low.
  • The indoor environment is perceived as good.
  • Noise levels in the outdoor environment are low and not disturbing.
Table 1 shows the final results from Renobuild for all the renovation alternatives regarding the life cycle cost, reduction of/increase in GHG emissions with the unit CO2-eq and primary energy use compared to the case without any renovation, and the social assessment. Note that the environmental aspect is composed of two indicators to illustrate how more variables/indicators can be introduced under each aspect.
As seen in Table 2, Alternative 2 is the most expensive and Alt5 the cheapest based on an LCC period of 40 years. Alternative 5 displays the largest reduction in GHG emissions; Alt4 the least. In terms of primary energy, only Alt1 shows a reduction, while Alt4 presents the largest increase. In term of social aspect, the Alt3 has the highest points. Diversity in results poses a problem for the decision-maker.
2. 
Set the min/max requirement levels:
There are always limits to which values a variable can have. These may be linked to legislation, resource limitations, ambitions, or related to moral limits. Table 3 shows an example of min/max requirement levels: the maximum life cycle cost which the company can afford, the minimum acceptable value of reduction of CO2-eq compared to the case without any renovation, the minimum acceptable value of reduction, the maximum acceptable value of an increase in primary energy compared to the case without any renovation, and the minimum acceptable point for the social questionnaire.
3. 
Calculate the score of each alternative in each criteria:
The amount by which each renovation alternative is higher or lower than the minimum requirement in percent is shown in Table 4. The score is in this case related to how well the quantified variable relates to the maximum/minimum values presented in Table 2. Alt2 and Alt4 have negative scores, which means that they do not comply with the min/max requirement levels of the owner/decision maker, and consequently, they are eliminated as alternatives. Alternative 2 is too expensive for the budget, generates too much CO2, and uses more resources than desired. Alternative 4 also consumes more resources than the upper limit and is rejected.
4. 
Set the weight factors:
Weight factors are to be pre-determined based on the companies’ principles, ethics, etc. These should be decided prior to utilization and should be based on comprehensive and accepted values for the decision makers’ companies/institutions. Table 5 and Table 6 give two examples/cases of decision makers’ weight factors, which are subjectively quantified, depending on each owner/decision maker’s perspective. The environmental aspect of sustainability in this example is assessed using two indices, thus the weight factor of this aspect is divided between them according to the owner/decision maker’s point of view. Note that the sum of the weight factors is unity (1), thereby making the choice of weight factor quantities a reflection of the companies/institutions/organization’s principles. The weight factors of metrics handles the weight of variables within each sustainability aspect.
5. 
Calculate weighted scores:
Table 7 and Table 8 show the weighted scores of case 1 and case 2 respectively, according to Equation (4), and the final total scores of the three renovation alternatives that have positive scores from step 3. This illustrates the influence of a slight difference in the weighting factors.
As can be observed, Alt 3 renders the lowest final score. Alt 1 and Alt 5 are sensitive to the minor differences in factors as displayed in Table 4 and Table 5, giving different maximum scores.
6. 
Take the final decision:
Based on the final scores shown in Table 7, Alt5 is the optimal renovation scenario based on the suggested weight factors shown in Table 5. On the other hand, Alt1, which has the highest total score in Table 8, is the optimal renovation scenario based on the suggested weight factors shown in Table 6. This shows how different weight factors give different results. This example illustrates that a small shift in weight from the economic to environmental aspect, here corresponding to 10%, has an impact on results and shows which alternative is most suitable depending on a company’s economical, environmental, and social profile.

7. Discussion and Conclusions

The suggested method in this study facilitates the decision-making process in renovation projects and allows the decision makers to choose the most suitable renovation alternatives according to their own preferences—that is, guided by company management principles and values—but also for the fulfillment of minimum requirements set by society and other institutions. The final scores of renovation alternatives are nonetheless guided by the decision makers’ choices of the weight factors. No recommendations are provided for choosing the weight factors; decision makers choose them depending on their companies’ business ideas, missions, and policies. The choice of weight factors opens up discussion about prioritizing sustainability aspects, both internally in the company and externally between the companies in the building sector, and about what image each company wishes to convey to customers, partners, and the public in general. The chosen weight factors should be consistent in various timely renovation projects but are likely to change in the transition process to a more sustainable society.
In the case presented in this work, LCA was used to assess associated carbon emissions and primary energy and to quantify the environmental aspect of sustainability; LCC was used for the economic part, and a questionnaire was used for the social part. In the social questionnaire, it is easy to alter the contents and the number of questions. Other criteria could be added or substituted in each category if there are case-specific aspects to which the decision makers prefer to compare the renovation alternatives. Today, the Swedish building regulations (BBR) have requirements regarding primary energy, and in the near future, they will have a requirement regarding carbon emissions related to building projects. Other regulations concerning deep renovation projects include requirements for minimum ventilation flow rates, thermal comfort, accessibility to and within the building, natural lighting, and preservation of historic buildings.
MCDM can be used to reduce complex problems to a singular basis for selection of a preferred alternative. The suggested method in this work is a way to consider sustainability as a whole and not just in terms of only one aspect, such as energy use. The intention of this method is to establish the idea of sustainability as a one-dimensional issue and, at the same time, to encourage decision makers to include all aspects of sustainability in their decision-making, as they can give weight for each criterion depending on the project and their own preferences. A current major drawback with the method is that there is no guidance on weight factor quantities—neither empirical nor theoretical values. Future work could encompass interviews to try to assess the order of magnitude of values expected for the weight factors for different decision makers, e.g., managers of public and private housing companies.
The presented method is flexible and can be compiled with various sustainability definitions or decision maker requirements by adding more criteria to the matrix of decision. As the European Union considers that it is important to accelerate the renovation process, it is possible to add the duration of the renovation process as a criterion in the decision matrix and assign a weight for it.
In future work, the proposed method will be applied in a renovation project to evaluate sustainability aspects of different renovation scenarios. Stora Tunabyggen AB, the public housing company in Borlänge municipality, began a renovation project in the Tjärna Ängar area where three multi-family buildings were renovated with different renovation packages (E2B2 grant No 39628-1). The proposed method in this work will be applied to compare the three buildings from the owner/decision maker’s perspective. A qualitative study is also planned to investigate how much weight decision makers in the Swedish building sector give to each aspect of sustainability in renovation projects.

Author Contributions

Conceptualization, A.K., M.H., J.A. and J.A.M.; Data curation, A.K.; Formal analysis, A.K.; Funding acquisition, J.A.M.; Investigation, A.K.; Methodology, A.K., M.H., J.A. and J.A.M.; Software/Programming, A.K.; Supervision, M.H., J.A. and J.A.M.; Writing—original draft, A.K.; Writing—review and editing, A.K., M.H., J.A. and J.A.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Swedish Energy Agency grant number [40811-2].

Acknowledgments

The research leading to these results has received funding from the Swedish Energy Agency under grant agreement No 40811-2 and from Sustainable Integrated Renovation (SIRen).

Conflicts of Interest

The authors declare no conflict of interest

Nomenclature

MCDMMultiple-criteria decision-making
WSMWeighted sum method
HVACHeating, ventilation, and air conditioning
AHPAnalytic hierarchy process
TFAHPTriangular fuzzy analytic hierarchy process
DEMATELDecision making trial and evaluation laboratory
GBCWorld green building council
LCALife cycle analysis
LCCLife cycle cost
GHGGreenhouse gases

References

  1. United Nation. Challenges to Sustainable Development. Available online: https://www.un.org/en/development/desa/financial-crisis/sustainable-development.html (accessed on 23 July 2020).
  2. Sustainable Development Challenges; United Nations Publication: New York, NY, USA, 2013.
  3. European Union. Available online: https://europa.eu/capacity4dev/articles/challenges-implementing-sustainable-development-goals-asia (accessed on 23 July 2020).
  4. Energy Efficiency Finanacial Institutions Group. Energy Efficiency—The First Fuel for The EU Economy; European Commission: Brussel, Belgium, 2015. [Google Scholar]
  5. IEA. Internatioal Energy Agency. Available online: https://www.iea.org/topics/energyefficiency/buildings/ (accessed on 10 January 2019).
  6. Evaluation of the Energy Performance of Buildings Directive 2010/31/EU; European Commission: Brussel, Belgium, 2015.
  7. European Commission. Available online: https://ec.europa.eu/energy/en/topics/energy-efficiency/energy-performance-of-buildin (accessed on 31 August 2019).
  8. European Commission. Available online: https://ec.europa.eu/energy/en/topics/energy-efficiency (accessed on 27 February 2019).
  9. Elkington, J.; Rowlands, I. Cannibals with forks: The triple bottom line of 21st century business. Altern. J. 1999, 25, 42–43. [Google Scholar]
  10. Recommendations; NO. 127/34; Official Journal of the European Union: Brussel, Belgium, 2019.
  11. Müller-Eie, D.; Bjørnø, L. Urban sustainability as social innovation. Sustain. City IX 2014, 191, 97–109. [Google Scholar]
  12. Sharma, A. Contemporary practice in sustainable design: Appraisal and articulation of emerging trend. Eco Archit. II 2010, 128, 119–129. [Google Scholar]
  13. Dobson, A. Drei Konzepte ökologischer Nachhaltigkeit, Natur und Kultur—Transdisziplinäre Zeitschrift für ökologischer. Nachhaltigkeit 2000, 1, 62–85. [Google Scholar]
  14. Costanza, R.; Patten, B. Defining and predicting sustainability. Ecol. Econ. 1995, 15, 193–196. [Google Scholar] [CrossRef]
  15. Grossman, D. The Three Pillars of Sustainable Development: Critical Issues and Perspectives; Comparative Education Society of Asia (CESA): Bangkok, Thailand, 2012. [Google Scholar]
  16. Sikdar, S. Sustainable development and sustainability metrics. AIChE J. 2003, 49, 1928–1932. [Google Scholar] [CrossRef]
  17. Mickaityte, E.; Zavadskas, E.K.; Kaklauskas, A.; Tupenaite, L. The concept model of sustainable buildings refurbishment. Int. J. Strateg. Prop. Manag. 2008, 12, 53–68. [Google Scholar] [CrossRef]
  18. Kohler, N.; Hassler, U. The building stock as a research object. Build. Res. Inf. 2002, 30, 226–236. [Google Scholar] [CrossRef] [Green Version]
  19. Lind, H. Sustainable renovation strategy in the Swedish million homes programme: A case study. Sustainability 2016, 8, 388. [Google Scholar] [CrossRef] [Green Version]
  20. Hamid, K.; Farsäter, K.; Wahlström, Å.; Wallentén, P. Literature review on renovation of multifamily buildings in temperate climate conditions. Energy Build. 2018, 172, 414–431. [Google Scholar] [CrossRef]
  21. Thuvander, L.; Femenías, P.; Mjörnell, K.; Meiling, P. Unveiling the process of sustainable renovation. Sustainability 2012, 4, 1188–1213. [Google Scholar] [CrossRef] [Green Version]
  22. Cattano, R.; Valdes-Vasquez, J.; Plumblee, M.; Klotz, L. Potential solutions to common barriers experienced during the delivery of building renovations for improved energy performance: Literature review and case study. J. Archit. Eng. 2013, 19, 3. [Google Scholar] [CrossRef]
  23. Häkkinen, T.; Belloni, K. Barriers and drivers for sustainable building. Build. Res. Inf. 2011, 39, 239–255. [Google Scholar] [CrossRef]
  24. Olsson, S.; Malmqvist, T.; Glaumann, M. Managing sustainability aspects in renovation processes: Interview study and outline of a process model. Sustainability 2015, 7, 6336–6352. [Google Scholar] [CrossRef] [Green Version]
  25. Lind, H.; Annadotter, K.; Björk, F.; Högberg, L. Sustainable Renovation Strategy in the Swedish Million Homes; School of Architecture and the Built Environment: Stockholm, Sweden, 2014. [Google Scholar]
  26. Gan, X.; Zuo, J.; Ye, K.; Skitmore, M.; Xiong, B. Why sustainable construction? Why not? An owner’s perspective. Habitat Int. 2015, 47, 61–68. [Google Scholar] [CrossRef]
  27. Landman, M. Breaking through the Barriers to Sustainable Building; Tufts University: Boston, MA, USA, 1999. [Google Scholar]
  28. Myhren, J.A.; Heier, J.; Hugosson, M.; Zhang, X. The perception of Swedish real-estate owner’s on the strategies to increase the rate of energy efficient refurbishment of buildings. Intell. Build. Int. 2018, 12, 153–168. [Google Scholar] [CrossRef]
  29. Nielsen, N.; Jensen, R.L.; Larsen, T.S.; Nissen, S.B. Early stage decision support for sustainable building renovation—A review. Build. Environ. 2016, 103, 165–181. [Google Scholar] [CrossRef]
  30. Mjörnell, K. Verifiering av Renobuild, en Beslutsmetodik för Hållbar Renovering—Fyra Fallstudier; RISE-Research Institutes of Sweden: Borås, Sweden, 2014. [Google Scholar]
  31. Kolltveit, J.; Grønhaugb, K. The importance of the early phase: The case of construction and building projects. Int. J. Proj. Manag. 2004, 22, 545–551. [Google Scholar] [CrossRef]
  32. Farsäter, K. Sustainability Aspects in Renovation—Information Supporting Early Decisions Made by Building Owners; Lund University: Lund, Sweden, 2017. [Google Scholar]
  33. Nielsen, A.N.; Larsen, T.S.; Jensen, R.L.; Nissen, S.B. Decision-making in the pre-design stage of building renovation projects. In Proceedings of the World Sustainable Built Environment Conference 2017, Hong Kong, China, 5–7 June 2017. [Google Scholar]
  34. Pombo, O.; Rivela, B.; Neila, J. The challenge of sustainable building renovation: Assessment of current criteria and future outlook. J. Clean. Prod. 2016, 123, 88–100. [Google Scholar] [CrossRef]
  35. Kohler, N.; Moffatt, S. Life-cycle analysis of the built environment. Ind. Environ. 2003, 26, 17–21. [Google Scholar]
  36. Moschetti, R.; Brattebø, H.; Skeie, K.S.; Lien, A.G. Performing quantitative analyses towards sustainable business models in building energy renovation projects: Analytic process and case study. J. Clean. Prod. 2018, 199, 1092–1106. [Google Scholar] [CrossRef]
  37. Moschetti, R.; Brattebø, H. Projects, combining life cycle environmental and economic assessments in building energy renovation. Energies 2017, 10, 1851. [Google Scholar] [CrossRef] [Green Version]
  38. Hester, P.T.; Velasquez, M. An analysis of multi-criteria decision making methods. Int. J. Oper. Res. 2013, 10, 56–66. [Google Scholar]
  39. Gade, N.; Jensen, R.L.; Larsen, T.S.; Nissen, S.B.; Andresen, I. Value-based decision making in the pre-design stage of sustainable building renovation projects exploring two methods for weighting criteria. Int. J. Constr. Manag. 2019, 1–16. [Google Scholar] [CrossRef]
  40. Wang, J.J.; Jing, Y.Y.; Zhang, C.F.; Zhao, J.H. Review on multi-criteria decision analysis aid in sustainable energy decision-making. Renew. Sustain. Energy Rev. 2009, 13, 2263–2278. [Google Scholar] [CrossRef]
  41. Saaty, T. The Analytic Hierarchy Process; McGraw-Hill: New York, NY, USA, 1980. [Google Scholar]
  42. Ishizaka, A.; Labib, A. Analytic hierarchy process and expert choice: Benefits and limitations. Or Insight 2009, 22, 201–220. [Google Scholar] [CrossRef] [Green Version]
  43. Pirouz, N.; Arcuri, B.; Pirouz, S.; Palermo, A.; Turco, M.; Maiolo, M. Development of an assessment method for evaluation of sustainable factories. Sustainability 2020, 12, 1841. [Google Scholar] [CrossRef] [Green Version]
  44. Gabus, A.; Fontela, E. Perceptions of the World Problem Atique: Communication Procedure, Communicating with Those Bearing Collective Responsibility; DEMATEL Report No.1; Battelle Geneva Research Centre: Geneva, Switzerland, 1973. [Google Scholar]
  45. Seker, S.; Zavadskas, E.K. Application of fuzzy DEMATEL method for analyzing occupational risks on construction sites. Sustainability 2017, 9, 2083. [Google Scholar] [CrossRef] [Green Version]
  46. Kirupanandan, S.; Jeyapaul, R.; Vimal, K. A DEMATEL approach for evaluating barriers for sustainable end-of-life practices. J. Manuf. Technol. Manag. 2018, 29, 1065–1091. [Google Scholar]
  47. Büyüközkan, G.; Güleryüz, S. An integrated DEMATEL-ANP approach for renewable energy resources selection in Turkey. Int. J. Prod. Econ. 2016, 182, 435–448. [Google Scholar] [CrossRef]
  48. Triantaphyllou, E. Multi-Criteria Decision Making Methods: A Comparative Study; Springer: Boston, MA, USA, 2000; pp. 5–21. [Google Scholar]
  49. Kumar, B.; Sah, A.; Singh, R.; Deng, Y.; He, X.; Kumar, P.; Bansal, R. A review of multi criteria decision making (MCDM) towards sustainable renewable energy development. Renew. Sustain. Energy Rev. 2017, 69, 596–609. [Google Scholar] [CrossRef]
  50. Kolios, V.; Mytilinoiu, E.; Minguez, L.; Salonitis, K. A comparative study of multiple-criteria decision-making methods under stochastic inputs. Energies 2016, 9, 566. [Google Scholar] [CrossRef] [Green Version]
  51. Tupenaite, L.; Zavadskas, E.K.; Kaklauskas, A.; Turskis, Z.; Seniut, M. Multiple criteria assessment of alternatives for built and human environment renovation. J. Civil Eng. Manag. 2010, 16, 257–266. [Google Scholar] [CrossRef]
  52. About Green Building. World Green Building Council. Available online: https://www.worldgbc.org/rating-tools (accessed on 1 March 2020).
  53. Chidiac, S.; Marjaba, G. Sustainability and resiliency metrics for buildings—Critical review. Build. Environ. 2016, 101, 116–125. [Google Scholar]
  54. Pinheiro, M.D.; Ferreira, J.; Brito, J.D. Refurbishment decision support tools review—Energy and life cycle as key aspects to sustainable refurbishment projects. Energy Policy 2013, 62, 1453–1460. [Google Scholar]
  55. Ingrao, C.; Messineo, A.; Beltramo, R.; Yigitcanlar, T.; Ioppolo, G. How can life cycle thinking support sustainability of buildings? Investigating life cycle assessment applications for energy efficiency and environmental performance. J. Clean. Prod. 2018, 201, 556–569. [Google Scholar] [CrossRef]
  56. Klüppel, H.J. The revision of ISO standards 14040-3-ISO 14040: Environmental management life cycle assessment principles and framework-ISO 14044: Environmental management Life cycle assessment requirements and guidelines. Int. J. Life Cycle Assess. 2005, 10, 3. [Google Scholar] [CrossRef]
  57. Ortiz, O.; Castells, F.; Sonnemann, G. Sustainability in the construction industry: A review of recent developments based on LCA. Constr. Build. Mater. 2009, 23, 28–39. [Google Scholar] [CrossRef]
  58. Fuller, S.K.; Petrsen, S.R. Life Cycle Cosing Manual for the Federal Energy Management Program; National Institute of Standards and Technology: Washington, DC, USA, 1995. [Google Scholar]
  59. Pombo, O.; Allacker, K.; Rivela, B.; Neila, J. Sustainability assessment of energy saving measures: A multi-criteria approach for residential buildings retrofitting—A case study of the Spanish housing stock. Energy Build. 2016, 116, 384–394. [Google Scholar] [CrossRef] [Green Version]
  60. Gluch, P.; Baumann, H. The life cycle costing (LCC) approach: A conceptual discussion of its usefulness for environmental decision-making. Build. Environ. 2004, 39, 571–580. [Google Scholar] [CrossRef] [Green Version]
  61. Attia, S.; Eleftheriou, P.; Xeni, F.; Morlot, R.; Ménézo, C.; Kostopoulose, V.; Betsi, M.; Kalaitzoglou, I.; Pagliano, L.; Cellura, M.; et al. Overview and future challenges of nearly zero energy buildings(nZEB) design in Southern Europe. Energy Build. 2017, 155, 439–458. [Google Scholar] [CrossRef]
  62. Kahraman, S.; Onar, C.; Oztaysi, B. Fuzzy multicriteria decision-making: A literature review. Int. J. Comput. Intell. Syst. 2015, 8, 637–666. [Google Scholar] [CrossRef] [Green Version]
  63. Kiker, G.; Bridges, T.; Vaghese, A.; Linkov, I. Integrated environmental assessment and management. Soc. Environ. Toxicol. Chem. 2009, 1, 95–108. [Google Scholar]
  64. Pohekar, S.D.; Ramachandran, M. Application of multi-criteria decision making. Renew. Sustain. Energy Rev. 2004, 8, 365–381. [Google Scholar] [CrossRef]
  65. Malmgren, L.; Mjörnell, K. Application of a decision support tool in three renovation projects. Sustainability 2015, 7, 12521–12538. [Google Scholar] [CrossRef] [Green Version]
  66. RISE Research Institutes of Sweden. Renobuild. Available online: https://renobuild.se/ (accessed on 1 March 2020).
  67. Under Miljonprogrammet Byggdes en Miljon Bostäder. Available online: https://www.boverket.se/sv/samhallsplanering/stadsutveckling/miljonprogrammet/ (accessed on 2 July 2019).
  68. Energirenovera Miljonprogrammet. Naturskyddsföreningen. Available online: https://www.naturskyddsforeningen.se/energirenovera (accessed on 4 May 2019).
  69. SMHI. Available online: https://www.smhi.se/vadret/vadret-i-sverige/ortsprognoser/q/Uddevalla/2666670#tab=0,chart=1 (accessed on 23 August 2020).
  70. Maplandia.com. Available online: http://www.maplandia.com/sweden/goteborgs-och-bohus-lan/uddevalla-kommun/uddevalla/ (accessed on 22 August 2020).
Figure 1. Steps in the suggested method.
Figure 1. Steps in the suggested method.
Sustainability 12 07194 g001
Figure 2. Location of Uddevalla Municipality [70].
Figure 2. Location of Uddevalla Municipality [70].
Sustainability 12 07194 g002
Table 1. Studied renovation alternatives.
Table 1. Studied renovation alternatives.
Studied AlternativesRenovation Measures
Alternative 1Adding more insulation to the attic, facades, and basement walls.
Adding an extra pane to the existing double-glazed windows.
Alternative 2Installing exhaust air heat pumps.
Alternative 3Alternatives 1 and 2.
Alternative 4Installing mechanical ventilation with heat recovery.
Alternative 5Alternatives 1 and 4.
Table 2. Results from Renobuild for studied renovation alternatives.
Table 2. Results from Renobuild for studied renovation alternatives.
Studied AspectsStudied MetricsStudied Alternatives
Alt1Alt2Alt3Alt4Alt5
EconomyLife cycle cost LCC(€)1,949,0002,466,0002,406,0001,989,0001,929,000
EnvironmentGHG emissions (tons of CO2-eq) *−814−280−1093−702−1453
Primary energy use (MWh) *−952037194220721530
SocialHabitat quality (points)1515161215
* The results are presented comparing to the case without any renovation.
Table 3. An example of minimum/maximum requirements.
Table 3. An example of minimum/maximum requirements.
Studied AspectsStudied MetricsMin/Max Requirement
EconomyLCC (€)2,410,000 (max)
EnvironmentGHG emissions (tons of CO2-eq)−700 (min)
Primary energy (MWh)2000 (max)
SocialHabitat quality (points)12 (min)
Table 4. The scores for the studied renovation alternatives based on min/max requirements.
Table 4. The scores for the studied renovation alternatives based on min/max requirements.
Studied AspectsStudied MetricsScores
Alt1Alt2Alt3Alt4Alt5
EconomyLCC (€)19%−2%0%17%20%
EnvironmentGHG emissions (tons of CO2-eq)16%−60%56%0%108%
Primary energy (MWh)105%−2%3%−4%24%
SocialHabitat quality (points)25%25%33%0%25%
Table 5. Case 1 for weight factors.
Table 5. Case 1 for weight factors.
Studied AspectsWeight Factors of AspectsStudied MetricsWeight Factors of Metrics
Economy0.4LCC0.4
Environment0.4GHG emissions0.2
Primary energy0.2
Social0.2Habitat quality0.2
Table 6. Case 2 for weight factors.
Table 6. Case 2 for weight factors.
Studied AspectsWeight Factors of AspectsStudied MetricsWeight Factors of Metrics
Economy0.3LCC0.4
Environment0.5GHG emissions0.2
Primary energy0.3
Social0.2Habitat quality0.2
Table 7. Case 1—The final scores for the renovation alternatives.
Table 7. Case 1—The final scores for the renovation alternatives.
Studied AspectsStudied MetricsWeighted Scores
Alt1Alt3Alt5
EconomyLCC0.080.000.08
EnvironmentGHG emissions0.030.110.22
Primary energy0.210.010.05
SocialHabitat quality0.050.070.05
Total scores0.370.190.39
Table 8. Case 2—The final scores for the renovation alternatives.
Table 8. Case 2—The final scores for the renovation alternatives.
Studied AspectsStudied MetricsWeighted Scores
Alt1Alt3Alt5
EconomyLCC0.060.000.06
EnvironmentGHG emissions0.030.110.22
Primary energy0.310.010.07
SocialHabitat quality0.050.070.05
Total scores0.450.190.39

Share and Cite

MDPI and ACS Style

Khadra, A.; Hugosson, M.; Akander, J.; Myhren, J.A. Development of a Weight Factor Method for Sustainability Decisions in Building Renovation. Case Study Using Renobuild. Sustainability 2020, 12, 7194. https://doi.org/10.3390/su12177194

AMA Style

Khadra A, Hugosson M, Akander J, Myhren JA. Development of a Weight Factor Method for Sustainability Decisions in Building Renovation. Case Study Using Renobuild. Sustainability. 2020; 12(17):7194. https://doi.org/10.3390/su12177194

Chicago/Turabian Style

Khadra, Alaa, Mårten Hugosson, Jan Akander, and Jonn Are Myhren. 2020. "Development of a Weight Factor Method for Sustainability Decisions in Building Renovation. Case Study Using Renobuild" Sustainability 12, no. 17: 7194. https://doi.org/10.3390/su12177194

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop