1. Introduction and Literature Review
Good asset management is increasingly seen as normal practice in mature organizations around the world [
1]. Asset management is an important part of any organization as it enables it to create value from its assets [
2]. The goal of asset management is to enable organizations to have assets that meet their business needs and provide supporting services so that they can operate effectively [
3]. Asset management encompasses a variety of disciplines, including engineering, finance, maintenance, risk management, human resources management, investment, sustainable efficiency, IT and more [
4]. It starts with understanding the needs of the organization in line with its business objectives to deliver goods and services reliably, safely, on time and cost-effectively [
5]. Asset management strategy begins with the organization’s strategy and plan to achieve its objectives and then supports the delivery of the value associated with the organization’s plan. However, ISO 55000 [
6] does not provide information on the approach to asset management, but merely sets the direction for elements of an asset management system (AMS) focused on value creation and risk management.
Asset management translates organizational goals into asset-related decisions, plans and activities, using a risk-based approach [
7,
8,
9]. The efficient management of existing and emerging risks is a topic that is well discussed within the asset management body of knowledge [
10,
11,
12,
13,
14,
15]. The impact (positive or negative) of uncertainties on an organization is referred to as risk, which leads to opportunities or threats [
16]. Since every activity at every level involves risk, organizations of all sectors and sizes would prefer to deal with them in order to develop better strategies and make the right decisions [
14]. Risk management is an integral part of ISO 55001 and should be considered in the overall risk management approach of the organization [
2]. In recent years, a lot of attention has also been paid to asset performance evaluation and asset management [
17]. Performance evaluation is also an important part of the AMS, as it is crucial to define appropriate financial and non-financial measures to evaluate performance against business objectives [
6]. Managing asset performance under the prevailing dynamic business and industry scenarios is becoming increasingly critical and complex due to technological advancements [
18].
Asset management requires a multidisciplinary approach [
9,
19,
20]. Therefore, different competence requirements are needed in asset management. Of course, the mix of competences depends on the industry, context and environment in which the organization operates. Asset management requires competences that meet the requirements of knowledge, skills, experience, behavior, attitudes and attributes related to asset management [
2]. The range of required knowledge includes an understanding of the technical areas of the business, the commercial needs of the business, the relevant suite of asset management techniques, the ability to bring together plans and projects and to present a balanced view of all aspects of an issue as a basis for developing business cases and decision making [
3]. Nevertheless, ISO 55001 [
2] includes a requirement for organizations to ensure that they understand the required skills of those involved in managing their assets and to review and update these on a regular basis. Accordingly, it is important to ensure that these individuals have the required skills and that they are aware of any competence gaps and have plans and processes in place to address these gaps. However, these are general requirements that provide little insight into how they can be met. There are several possible sources for asset management competences. The first is the competences framework developed by the Institute of Asset Management (Guidance [
21] and Requirements [
4]). The framework was originally developed to meet the requirements of PAS 55 [
22] and has been updated since the issuance of ISO 55001 [
2] to ensure consistency with the terminology in the aforementioned international standard. The framework is based on seven main asset management roles, namely, policy development, strategy development, asset management planning, asset management plan implementation, asset management capability development, risk management and performance improvement and asset knowledge management. A possible second source of asset management competences is the list of competences developed by the Asset Management Council [
23] in Australia. It contains over 200 individual competences. However, this list of competences was developed primarily to support their individual certification scheme (e.g., Certified Practitioner in Asset Management—CPAM) rather than to assist organizations in identifying asset management competences. More recently, an asset management framework has been developed by the Canadian Network of Asset Managers (CNAM) to support communities in developing their asset management capacity [
24]. Additionally, the Global Forum on Maintenance and Asset Management (GFMAM) has developed a competency specification framework [
25]. These competency requirements have been created to provide the basis for ensuring the competence of persons responsible for auditing or assessing organizations according to ISO 55001. Considering only the maintenance perspective and engineered assets, the standard EN 15628 specifies requirements such as competences, essential knowledge and basic and target qualifications for maintenance personnel [
26].
As more and more organizations take over asset management and the demand for asset managers increases, there is a growing interest in the personal skills of asset managers. Selecting the most qualified asset managers can be a daunting task due to the many aspects that should be considered, some of which are subjective. As it is important to select the most suitable person, decision support tools are needed to support and ensure a rigorous selection process. Multi-criteria decision-making techniques, namely, the analytic hierarchy process (AHP), have been extensively used to solve the problem of personnel selection based on the competence criteria hierarchies [
27]. Personnel selection is one of the most important phases of the human resources management process [
28]. The basic function of personnel selection is to identify, among the applicants who apply for specific positions in the company, those who have the necessary knowledge, skills and abilities to successfully meet the requirements of the position. Prior studies addressing competence requirements in asset management were merely focused on education (e.g., [
29]) or competency model development (e.g., [
30]). Despite the importance of these efforts, there is still a lack of studies addressing this topic. To the best of our knowledge, no previous studies have explicitly focused on developing a framework for the evaluation/selection of asset managers using decision-making techniques. To address this gap, this paper presents a novel approach for evaluating/selecting asset managers based on the Institute of Asset Management (IAM) competences framework. Accordingly, the purpose of this study is to contribute to the field of asset management by applying an analytic hierarchy process (AHP) for the evaluation/selection of personnel in the field of asset management. In this study, competences in risk management and performance improvement were used as an important topic in asset management.
The remainder of this paper is structured as follows. The introduction and literature review form the first section of the main body of the paper, followed by a brief overview of the AHP method in the second section. The third section presents the development and validation of the AHP-based framework for the selection of asset managers. It begins with a discussion of the steps involved in building an AHP-based framework, followed by the implementation of the proposed steps for asset manager selection. The final section of this paper outlines the main findings of this paper and some suggestions for future work.
3. An AHP-Based Framework for Asset Manager Selection
The AHP modeling process involves several stages, such as outlining the problem, structuring the decision hierarchy, making pairwise comparisons for each matrix, using the priorities obtained from the comparisons to weight the priorities at the level immediately below and continuing this process of weighing and adding until the final priorities of the alternatives are reached [
31,
32,
36]. Thus, in previous AHP studies (e.g., [
27,
37]), several steps are identified for conducting the AHP according to the above guidelines. An AHP framework was developed on the basis of these guidelines.
Figure 1 shows a flow chart with different steps for the implementation of the AHP study.
As mentioned in the previous section, an important phase of the AHP is the definition of the hierarchy tree. Starting from the main goal (the first level of the hierarchy). The goal of this study is to evaluate and select the most appropriate asset manager. Specifically, this study addresses the possibility of using the AHP to select and prioritize the most appropriate factors for evaluating managers from the perspective of asset risk management and performance improvement. This study was conducted within a Slovenian group of asset management professionals. This group consists of several asset management specialists covering different aspects of asset management.
Before the criteria and sub-criteria were defined, the area of asset management to be evaluated was identified and confirmed. The information collected from the literature, namely, the GFMAM’s asset management landscape subjects [
38], was assessed through brainstorming by seven experts consisting of academics and practitioners (see
Table A1). As a result of the assessment, it was determined that risk and review is the most appropriate asset management subject for this AHP study. Within the scope of the study, the potential criteria and sub-criteria have been identified through literature review. According to the literature research, the IAM competences framework [
4] was the one that came closest to the selected area. The IAM framework is a globally recognized competency requirements framework, allowing organizations to plan and develop the competences they need to meet current and future needs in the field of asset management. The role of risk management and performance improvement was chosen because it corresponds to the selected area of the GFMAM. The selected dimension (i.e., risk management and performance improvement) was subject to a two-stage breakdown of competence requirements into units and elements and a list of the underlying knowledge and understanding considered most relevant to the role. The units selected for this study are concerned with ensuring that organizations identify, understand and manage risk effectively and that performance is reviewed and improved over time. According to the IAM framework, risks include health and safety, security, environment, reputation, finance, etc. [
4]. Units and elements were used as criteria and sub-criteria in this study. In this regard, the following criteria were considered: assess and manage risks (AMR), assure the quality of asset management (AM) processes (AQAM), monitor and review progress and performance (MRPP), review and audit compliance with legal, regulatory, ethical and social requirements (RACR) and learn from incidents (LI). The criteria and sub-criteria are presented in
Table A2.
Once the objective of this study was defined, relevant criteria and sub-criteria were identified in steps 1 and 2. These criteria and sub-criteria were then structured in a hierarchy descending from the overall goal (see
Figure 2). In this context, the study problem (i.e., evaluating and selecting the most appropriate asset manager) was decomposed into a series of hierarchies, with each level representing a smaller number of managed attributes. According to the decision team (i.e., a group of asset management professionals), five different sets of criteria should be used to represent the most critical issues in selecting the most appropriate asset manager. Following the hierarchy in
Figure 2 and in conjunction with the standard AHP scale as defined by Saaty (see
Table 1), data collection was conducted during the group sessions.
This step involves the collection of empirical information and data through the combined judgments of the individual evaluators from the Slovenian group of asset management professionals. First, four experts in asset management were selected to evaluate the selected criteria. Second, an evaluator with sufficient knowledge, expertise and understanding of asset management was selected to guide the decision-making process. The IAM documents (Guidance [
21] and Requirements [
4]) were used to understand the role, units and elements of the competence framework. Both persons evaluated were asked to complete the self-evaluation of the selected sub-criteria of level 3. This was done prior to the interview with the evaluator, as the interview time was limited to one hour. For the purpose of self-evaluation, the following scale (see
Table 2) was adopted from [
39]. The self-evaluation was mainly used as support and input for conducting the interviews, especially to improve the decision-making process during the AHP study. Generally, essential elements of the data collection process were: (i) self-evaluation form for managers in accordance with the scale presented in
Table 2; (ii) Excel template for the AHP using the Saaty scale (1–9) for criteria evaluation done by the above experts. Prior to actual data collection, the self-evaluation form was pilot tested within the AHP team (i.e., a group of professionals) to ensure that the criteria and corresponding scales were understandable. Empirical data on the criteria evaluation are provided in step 5 (see
Table 3, which summarizes the pairwise comparison data).
Once relevant empirical information and data were collected, the next step was to determine the relative importance between the criteria and sub-criteria (taking into account the self-assessment levels confirmed during the interview for the competence level of each person being evaluated, as mentioned above). The evaluator carefully compared the criteria at each hierarchical level by assigning relative scales in pairs in light of the goal of this study. A relational scale with real numbers from 1 to 9 was used for the rating (see
Table 2).
There are six pairwise comparison matrices in total: one for the criteria relating to the objective, which is presented here in
Table 3, five for the sub-criteria, the first of which is for the sub-criteria under Assess and manage risks (see
Table 4), the second under Assure the quality of asset management (AM) processes (see
Table 5), the third under Monitor and review progress and performance (
Table 6), the fourth under Review and audit compliance with legal, regulatory, ethical and social requirements (see
Table 7) and finally under the sub-criterion Learn from incidents (
Table 8). For illustrative purposes, the calculations for the priority vector are explained below. First, a normalized comparison matrix should be calculated by dividing each value in the pairwise comparison matrix by the sum of its column. For example, the value X
11 (0.38) of the normalized pairwise matrix is obtained by dividing 1 (from
Table 3) by 2.66, the sum of the column items in
Table 3 (1 + 1/3 + 1/2 + 1/2 + 1/3). According to this calculation approach, the normalized pairwise matrix is generated. The priority vectors in
Table 3,
Table 4,
Table 5,
Table 6,
Table 7 and
Table 8 can be obtained by finding the row averages. For example, the priority value of AMR with respect to the goal is calculated by dividing the sum of the rows (0.38 + 0.30 + 0.44 + 0.32 + 0.3819) by the number of criteria, i.e., 5, in order to obtain the value of 0.362 (see
Table 3).
In this step, a consistency test was performed. A measure of inconsistency is useful for identifying possible errors in the expression of judgments as well as actual inconsistencies in the judgments themselves [
31]. The AHP provides a method called the consistency ratio (CR) to assess whether a criterion can be used for decision making. In the AHP, pairwise comparisons in an assessment matrix are considered consistent if the CR is less than 10% [
31]. Thus, the CR was calculated according to the following equation: CR = CI/RI. The consistency index (CI) was calculated according to the following equation: CI = λ
max − n/n − 1, where “n” is the number of criteria or sub-criteria of each level and λ
max is the largest eigenvector. The values for the eigenvectors were obtained using an Excel template [
35]. The following table (see
Table 9) shows the values of the random index (RI).
In this step, the priority weights are divided into “local weights”—the priority weight in relation to the previous hierarchical level—and “global weights”—the priority weight in relation to the highest hierarchical level—the goal or objective. The value of a local weight (LW) represents the priority weight of each category. The sum of all values in each level of the model must equal 1.00. Global weight (GW) is calculated by multiplying the LW of each sub-criterion by the local weight of the corresponding main criterion. For example, the GW for AMR1 (0.083) is calculated by multiplying the LW of AMR1 (0.230) by the LW of the main AMR criterion (0.362). A calculation of the local and global weights is presented in
Table 10.
In order to obtain the final results, the results of managers 1 and 2 were multiplied by the global weighting of each decision criterion (see
Table 11). The mechanism for calculating the final priority consists of multiplying the global priority of each sub-criterion by the alternative priority. The priorities for alternatives (managers 1 and 2) are presented in
Table A3.
Table 11 calculates the global priorities for each of the managers. The highest value (0.560) corresponds to manager 1, while 0.440 corresponds to manager 2.
In this step, a sensitivity analysis is performed to show how the change in various parameters of the model affects the final results. The dynamic sensitivity of Expert Choice was performed to analyze the change in the result caused by a change in each of the main criteria. Dynamic sensitivity analysis is used to dynamically change the priorities of the criteria to determine how these changes affect the priorities of the alternative choices. First, the criterion Assess and manage risks (AMR) was increased by about 25% (from 36.2% to 45.5%). The results are shown in
Figure 3. This figure consists of two parts. The results shown on the left side of
Figure 3 are criteria and their corresponding weighting, while the right side of the figure illustrates the ranking of the alternative (managers 1 and 2), expressed by the importance (in percentage). The results of the sensitivity analysis showed that a change (an increase of 25 percent) in the first criterion has no significant effect on the final ranking.
Secondly, the criterion Assure the quality of AM processes (AQAM) was increased by about 25 percent (from 10.2% to 12.7%) (see
Figure 4). The final ranking remained unchanged.
Thirdly, the criterion Monitor and review progress and performance (MRPP) was increased by about 25 percent (from 23.7% to 29.6%) (see
Figure 5). The final ranking remained unchanged.
Fourthly, the criterion Review and audit compliance with legal, regulatory, ethical and social requirements (RACR) was increased by about 25 percent (from 17.5% to 21.7%) (see
Figure 6). The final ranking remained unchanged.
Finally, the last criterion Learn from incidents (LI) was also increased by 25 percent (from 12.4% to 15.7%). The final ranking (see
Figure 7) remains unchanged as in the previous scenarios.
In addition to the increase, we also reduced all criteria by 25 percent. The final ranking remained stable in all cases. As a result of the sensitivity analyses, we found that the outcome of our analysis is very robust and the final ranking of the alternatives can be confirmed.
Considering the results of step 9 and the results of the sensitivity analysis, the final solution of the AHP method can be determined. According to the results, manager 1 (0.560) achieved a better result than manager 2 (0.440).