Next Article in Journal
Static Aeroelastic Optimization of High-Aspect-Ratio Composite Aircraft Wings via Surrogate Modeling
Previous Article in Journal
A Self-Supervised Fault Detection for UAV Based on Unbalanced Flight Data Representation Learning and Wavelet Analysis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Evaluating the Performance-Shaping Factors of Air Traffic Controllers Using Fuzzy DEMATEL and Fuzzy BWM Approach

Department of Industrial & Systems Engineering, De La Salle University, Manila City 1004, Philippines
*
Author to whom correspondence should be addressed.
Aerospace 2023, 10(3), 252; https://doi.org/10.3390/aerospace10030252
Submission received: 3 February 2023 / Revised: 28 February 2023 / Accepted: 3 March 2023 / Published: 6 March 2023
(This article belongs to the Section Air Traffic and Transportation)

Abstract

:
In the air traffic management domain, a set of performance-shaping factors are defined to characterize how such factors influence the overall performance of air traffic controllers. While it is worth understanding the nature of these factors, including their priority for policymaking and strategy implementation, no research in the extant literature has conducted an in-depth investigation of this matter. Therefore, this paper aims to explore the performance-shaping factors of air traffic controllers by using fuzzy DEMATEL and fuzzy BWM—such methodologies in the classification of factors as well as their corresponding priority vector. As an illustration, a case study in the Mactan Control Tower of the Civil Aviation Authority of the Philippines (CAAP) is conducted. The key results of the hybrid methodology showed that causal factors are ‘situation awareness,’ ‘communication,’ ‘teamwork,’ ‘vigilance,’ ‘and ‘attention.’ Effect factors are ‘workload,’ ‘trust,’ ‘fatigue,’ and ‘stress.’ Furthermore, ‘communication’ is found to be of the highest priority among other factors. The results can provide relevant insights to the decision-makers of air traffic management in formulating programs and strategies related to the improvement of air traffic controllers’ performance. Note, however, that the study is limited to identifying the inherent characteristics of the factors and their priority ranking; specific plans of action for improving the performance of air traffic controllers are not provided. As a future research direction, the inputs obtained in this paper can pave the way to a more in-depth analysis of improving the performance of air traffic controllers.

1. Introduction

Different thematic analyses relating to the commercial aviation industry have gained significant attention in the literature since the 1920s because of their undeniable benefits to the general air transportation system and the prominent issues they confront. Such issues revolve around aspects relating to the environment (e.g., carbon emissions, sustainable food waste management) [1,2,3,4], health [5,6,7], economics [8,9], operational efficiency (e.g., on-time performance, routing of flights, ground handling) [10,11], society (e.g., flight booking scheme, passenger satisfaction) [12,13], and safety (e.g., workload, design, fatigue, human performance [14,15,16,17]. At a closer look, the most pressing concern that most scholarly works emphasize is general air transportation safety. In fact, the safety of every flight is highly desired by key stakeholders of the commercial aviation industry (i.e., airlines industry, airport management, and air traffic services) from the departure of flights until their arrival, considering that hundreds of lives are at stake should aviation errors result to an unfortunate mishap [18]. The strands under air transportation safety extend to multiple facets of designs specific to aircraft and machine interface, process efficiency, and human performance, to name a few. Among these considerations, humans are highly capitalized in nearly every operation, from strategic planning to its eventual task execution. For instance, pilots maneuver aircraft in all the phases of flight with the aid of air traffic control communication [19,20], while ground handlers are assigned to oversee procedures and equipment necessary to ensure that the next flight leg is ready and sound [21]. On the other hand, air traffic controllers are involved in surface operations management, which includes giving directions to aircraft among stands, taxiways, holding areas, and runways while ensuring a minimum separation distance between aircraft for safe arrivals and departures [22,23]. Therefore, it is necessary to build on a strong workforce whose overall aptitude for their respective aviation tasks is considered outstanding in order to accomplish such tasks efficiently. These comprise the concept of human performance envelope (HPE) consisting of nine human performance factors, also known as performance-shaping factors, as follows: situation awareness (SA), workload, communication, teamwork, trust, fatigue, stress, vigilance, and attention [24,25].
The HPE concept suggests covering a wide array of factors that can significantly affect human performance and further detect when one or more factors fall short of tolerance [24]. According to the envelope metaphor, looking into a set of interdependent factors is needed to improve human–machine interaction designs in the aviation industry instead of examining only one or two human factors affecting performance. Unfortunately, prior works in the literature focused solely on the characterization of a factor toward another factor. For instance, ref. [26] focused on the multifactor analysis of workload and SA in varying levels of automation. They found that workload and SA are definitely related in ways that even in high workload and good SA or low workload and poor SA, the performance of air traffic controllers remains the same.
On the other hand, ref. [27] confirmed that the level of automation may affect SA, considering that the actual interaction of air traffic controllers (e.g., being a human-outside-the-loop entity) in operational control and monitoring tasks may vary with the level of automation. Moreover, ref. [28] also agreed on the negative influence of automation, particularly on wider applications in remote air traffic control systems, on the SA of air traffic controllers. Taking the relationships between factors in isolation from the general set of factors, such as the case in the previous works, it appears to be rather inadequate due to the exclusivity introduced. When the relationships among factors are examined one at a time (i.e., one factor to another), the inherent interaction among a combination of one or more factors toward another factor is considerably neglected, resulting in weaker generalizations and misinterpretations of the actual inherent relationships among factors given the complex and changing characteristics of air traffic control operations. In other words, since these factors co-exist in the working environment of air traffic controllers, it is only fitting to measure and analyze these together rather than taking each into isolation [29,30]. Furthermore, while previous works can identify the relationship between one factor and another, the corresponding strength of a relationship is not established objectively. Such relationship strength is integral to understanding how factors should be treated with respect to improving performance in the overall sense. Relevant countermeasures can also be significantly framed according to these established relationships. At a closer look, therefore, evaluating the complex relationships among a full range of factors covered in the HPE concept can be better represented as a multicriteria decision-making (MCDM) problem.
The MCDM approach is designed to evaluate the distinct and even conflicting relationships among criteria according to the judgment of subject matter experts [31]. The approach ranges from a variant of criteria assessment tools, that is, decision-making trial an evaluation laboratory (DEMATEL) [32], analytic network process (ANP) [33], interpretive structural modeling (ISM) [34], Matriced’ Impacts Croise’s Multiplication Appliqueé a UN Classement (MICMAC) [35], best-worst method (BWM) [36], to alternative evaluation tools being preference ranking organization method for enrichment evaluations (PROMETHEE) [37,38,39], analytic hierarchy process (AHP) [40], the technique for order of preference by similarity to ideal solution (TOPSIS) [41], VIKOR (the Serbian name, VIseKriterijumska Optimizacija I Kompromisno Rsenje) [42,43], Elimination Et Choix Traduisant la REalité (ELECTRE) [44], data envelopment analysis (DEA) [45], or a hybrid combination and extensions thereof. In fact, the MCDM approach is successfully applied in various domains which consider the evaluation of interrelationships among factors, such as in the redesign of warning signs following the ergonomics principles [46], premature closure of microbusiness enterprise [47], sustainable supplier selection in the healthcare sector [48], optimizing crop mix subject to constraints in environment and economic considerations [49], aircraft and helicopter selection [50,51,52], to name a few.
In the case of the air transport domain, the MCDM approach is widely applied to tackle diverse cases as follows: (a) mitigating airport congestion using fuzzy DEMATEL-ANP and an integrated fuzzy DEMATEL-ANP-TOPSIS, respectively [53,54]; (b) minimizing departure delays using DEMATEL-AHP technique [55]; (c) evaluating the performance of airports based on sustainability-balanced scorecard using DEMATEL DEMATEL-based on ANP, and VIKOR [56]; (d) evaluating the performance factors of human resources involved in air traffic control using fuzzy graded mean integration representation (GMIR) and fuzzy additive ratio assessment method (ARAS-F) [57]; and (e) analyzing interrelationships and prioritizing the factors affecting sustainable intermodal freight using grey-DANP approach [58], among others.
Despite the viability of using the MCDM approach in assessing the interrelationships among factors, particularly in the air transport domain, it has not yet been applied in the context of the HPE concept, which satisfactorily covers a full range of factors influencing the performance of air traffic controllers. With the MCDM approach, the inherent relationships among factors can be better demonstrated according to the elicited judgment of subject matter experts, which previous methodologies failed to fulfill with the use of subjective survey questionnaires. Recognizing this significant limitation in the literature, this paper pioneers in developing a support system involving the MCDM approach, which extracts the interacting relationship among factors that influence the performance of air traffic controllers. This approach is designed to prioritize such factors in order to put forward relevant improvement measures in the general air traffic control scenario focused on highly prioritized factors. To illustrate the applicability of the proposed methodology, a case study is carried out in the Mactan Control Tower of the Civil Aviation Authority of the Philippines (CAAP).
In order to carry out such objectives, the most fitting MCDM approach points to DEMATEL and BWM. Individually, DEMATEL and BWM provide a significant contribution to the analysis of HPEs. For one, DEMATEL distinguishes the inherent characteristics of factors according to its classification being causal or effect criteria. For another, BWM provides weights of factors that can adequately shape its corresponding priority ranking. Recognizing the inherent characteristics of factors and their priority can sufficiently aid the decision-makers in strategy formulation and further policy initiatives by allocating efforts and resources to factors with high priority ranks. Furthermore, no other MCDM approach has a discriminating power, similar to DEMATEL, that can satisfactorily distinguish the characteristics of factors. While other MCDM approaches can also compute for weights of factors, such as ANP, BWM can provide a better perspective by considering both the best and worst criteria and analyzing the roster of factors with respect to these best and worst criteria. Additionally, due to the vagueness of human judgment, the fuzzy set theory is also integrated into the traditional DEMATEL and BWM in order to reflect the subjective nature of the decision-making process. The capability and synergy of DEMATEL, BWM, and fuzzy set theory can collectively advance an important part of the decision-making process of analyzing the factors involved in the HPE framework.
This paper proceeds with Section 2, which discusses an overview of the HPE factors that influence air traffic controllers’ performance. Then Section 3 presents the MCDM tools currently used in general air transport operations. Next, Section 4 provides a brief discussion of the proposed MCDM methodology and the case study background. Section 5 then shows the proposed methodology’s results and corresponding implications. Lastly, Section 6 presents the implications of the results and its research directions.

2. Human Performance Envelope (HPE) Components

With respect to aviation, human factors, and cognitive science literature, a comprehensive review of HPE components affecting operator performance and their corresponding dependencies is conducted [25,59,60]. The nine HPE components, also referred to as performance-shaping factors, are summarized as follows.

2.1. Workload

The mental workload resulting from the task loads expended externally, such as aircraft movements, weather, and rotation of laborers, is considered one of the most important factors influencing operator performance [18,26]. Correspondingly, the workload is perceived to be an emergent factor from the integration among various components, such as task requirements under specific circumstances, skills, behavior, and perceptions of operators [61]. In the context of air traffic control, the number of aircraft movements serves as a primary indicator of workload among other manifestations (e.g., weather) [18,62,63,64,65,66,67]. That is, an increase in workload (i.e., aircraft movements) and task difficulty may imply poor performance, as evidenced by low response accuracy and response latency. Other than the aircraft movement, other measurement tools include the uni-dimensional instantaneous self-assessment scale (ISA) [26,68], Bedford Workload Scale [69], and the National Aeronautics and Space Administration task load index (NASA-TLX) [58,67,68,69,70,71], air traffic workload input technique (ATWIT) [19,67], the hit-to-signal ratio on pointer deviations in gauge monitoring [27], and saccade durations [72], among others.

2.2. Situation Awareness (SA)

SA is defined as a three-level hierarchy construct involving the perception of elements in the environment within a volume of time and space, followed by the comprehension of their meaning, and lastly, the projection of their status in the near future [22]. In the cognitive science domain, SA is often used as a tool to assess the quality of human-machine interfaces such that a high level of SA corresponds to a properly designed interface and vice versa [73]. As a result of high SA, effective decision-making and high performance are maintained. However, in cases when there is a loss of SA, serious and even catastrophic consequences can occur [62]. In fact, 88% of aviation accidents in the commercial aviation industry are caused by human errors attributed to LSA [74]. Aside from the application of SA as a key concept that widely describes human performance in the air transportation system, it has also been used in other critical scenarios, the command and control room [75], sea-faring [76], land transportation [77], space traffic management [78], supply chain management [79], nuclear power plant [80], and healthcare [81], among others.

2.3. Communication

For communication, this factor involves the transfer of meaningful information from one entity to another and is independent of (but related to) language and speech [81,82,83]. For example, communications in air traffic control include radio and telephone, which often occurs simultaneously due to an increased air traffic volume [64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84]. Such exchange of information requires timeliness, accuracy, clarity, and receptiveness among the entities concerned. Some measurement tools for evaluating communication include TARGET, BOS, simulation study, direct observation, analysis of incident reports, and speech recordings, to name a few [24].

2.4. Teamwork

Teamwork, also termed crew resource management in the aviation industry, focuses on the proper response to threats to safety, including the proper management of errors committed by crew members [85]. Along with communication, teamwork requires close coordination between the team members and crew, even those outside the cockpit, to ensure aviation safety [86]. Otherwise, failure to communicate clearly can lead to a number of major accidents. Therefore, relevant error management training is strongly imposed to address several functions in teamwork, which relates to coordinating in a proactive sense, cross-checking members, and backing them up during phases that require a high workload [87]. When teams are in a safe and efficient environment to perform their tasks in the air traffic services, team resource management (TRM) aids in avoiding serious incidents and accidents resulting from inadequate teamwork [88].

2.5. Trust

Trust typically covers two constructs: dispositional trust and situational trust [89]. Between the two constructs, the use of the term ‘trust’ in the aviation industry leans more toward situational trust, specifically in the use of automation, also referred to as human-machine trust. As greater utilization of automation tools is perceived to aid in the tasks of air traffic controllers, the dynamic expectation of machine reliability continues to affect the operator’s trust in an automated system [90]. Although made to support and fully benefit air traffic control operations such as conflict and flight anomaly detection [27,91], the level of automation imposed in the control room can also present many disadvantages, particularly a loss of controller SA due to the exclusion of human in the system control loops [92,93]. According to [27], automation applied to information processing functions may not necessarily support successful controller clearing of aircraft. In most conditions, it is dependent on the order level of information processing functions in which automation is embedded. Similarly, [28] noted that while a remote air traffic control system can supply air traffic services to airports by enabling communication, navigational support, and surveillance from a remote location, it can also pose serious challenges to traditional air traffic operations, including coordination among controllers and control during increased traffic volume and multiple airports. In short, introducing automation to air traffic control promotes a human-outside-the-loop system which, in particular, offloads controllers in their manual task loads resulting in a general loss of SA [27]. That is, as increased air traffic control tasks are performed via automation, air traffic controllers become less aware of the system as a whole. Moreover, [26] also reported that SA is reduced in most automated conditions which are responsible for dominant air traffic control tasks such as conflict detection and decision-making. Nevertheless, tasks carried out in most automated conditions imply less workload on air traffic controllers.

2.6. Fatigue

In the context of the International Civil Aviation Organization (ICAO), fatigue is defined as “the physiological state of reduced mental or physical performance capability resulting from sleep loss or extended wakefulness, circadian phase, or workload (mental and/or physical activity) that can impair a crew member’s alertness and ability to safely operate an aircraft or perform safety-related duties” [94]. Since fatigue and other states, such as drowsiness, may be considered similar in terms of neurophysiological characterization, there exists a difficulty in distinguishing one from the other. To measure fatigue, subjective and objective tools are deployed according to the type of fatigue one is concerned with examining (e.g., severity, physical fatigue, and the overall extent of fatigue) [95]. Such tools include, but are not limited to, self-reported measures (e.g., Samn–Perelli fatigue scale, sleep logs) [68,95,96,97,98], OHCS urine test, heart rate, vanillyl mandelic acid (VMA) excretion, simple auditory reaction time, critical flicker fusion, oral temperature, event-related potential (ERP), cortisol, electroencephalogram (EEG) and electra-oculogram (EOG), tapping test, grid tapping test, pupil diameter, and physiological tests (e.g., flicker fusion threshold, response stick, near point, thumb/index finger strength, systolic and diastolic pressure) [16,71,96,98,99].

2.7. Stress

Stress in jobs is specifically a result of work settings that come from various factors such as work tasks, workplace, job characteristics, role conflict, and worker capabilities [84]. In the dynamic nature of air traffic control, which demands multiple safety decisions in quick succession, the stress of air traffic controllers results in fatigue, affecting their professional capabilities, responsiveness, and vigilance. Among air traffic controllers, particularly enroute controllers, several contributory activities such as situation monitoring, managing air traffic sequences, resolving aircraft conflicts, routing or planning of flights, managing sector/position resources, and assessing weather impact are identified to have caused stress in the workplace [100]. In this line, the need to establish stress coping strategies (e.g., compartmentalization, cognitive behavioral therapy, recovery context indicator) becomes necessary to reactivate air traffic controllers quickly, effectively, and sustainably [101]. Furthermore, several approaches have been developed in the literature to measure stress, including the occupational stress indicator (OSI) [102], stress diagnostic survey (SDS) [103], and exploratory and confirmatory factor analysis (EFA & CFA) [104].

2.8. Attention and Vigilance

Attention is defined as the ability to attend to information or any stimulus in the environment, while vigilance is the representation of sustained attention over a considerably prolonged period [105]. In the nature of air traffic controllers’ jobs, it is extremely necessary to combat lapses in sustained attention to avoid severe or even deadly consequences. Unfortunately, for vigilance, any lapse can only be noted after a mistake attributed to such lapse occurs [106]. In such conditions, it is difficult to directly measure operators’ performance or cognitive states in any working environment. For instance, errors of perception in empirical research work are found to be associated with a loss of vigilance as manifested by failure to monitor non-salient stimuli (e.g., aircraft’s climb rate) [107].

3. MCDM in Air Transport Operations

3.1. Fuzzy Set Theory

Traditional MCDM methods such as DEMATEL and BWM are transformed into their fuzzy counterpart in recognition of the subjective nature of judgment among humans. With fuzzy set theory, technically known as fuzziness, vagueness is handled well by capturing the decision makers’ judgment (e.g., imprecise goals, constraints, and actions) and presenting such judgment into fuzzy numbers [108]. In the case of HPE components, examining the relationship among factors involves subjective functions (e.g., SA, communication, trust) that cannot be directly represented by a numerical value. Thus, the use of fuzzy logic becomes appropriate in this context to ensure that any subjectivity in the assessment of each factor is considered. A detailed discussion of the fundamental theory of fuzzy set is discussed by [109], while some of its basic concepts are presented as follows:
Let X be a universal set where A X . A is considered a standard fuzzy set if a membership function μ A x where μ A x : X 0 ,   1 . In a set of 2-tuple, A = x , μ A x : x X ,   μ A x X 0 ,   1 is a fuzzy set where x A and μ A x is a membership function of x A . In the case of a triangular fuzzy number (TFN), a triplet A ˜ = l , m , r and a membership function μ A x can be defined as follows (see Equation (1)):
μ A x = 0 x l / m l r l / r m 0     x < l       l x m             m x r     x > r
where l , m , r are real numbers being l , m , r R ,   μ A x 0 ,   1 and X is the universe of discourse. The fuzzy logic has been widely integrated over the years into MCDM approaches such as AHP, TOPSIS, and DEMATEL, to name a few.

3.2. Decision-Making Trial Evaluation and Laboratory (DEMATEL)

The DEMATEL methodology was first introduced at the Battelle Memorial Institute of Geneva Research Center, which aims to extract the relation between criteria from a complex system [32]. With DEMATEL, the interrelation among criteria is illustrated better as its corresponding classification (i.e., causal or effect) is established. Furthermore, DEMATEL is able to develop an interrelationship network digraph showing the structural relationship among factors along with the strength of influence evident among criteria. The process of evaluating the relationship among HPE components can be formulated as an MCDM problem, which can be represented suitably with the use of the DEMATEL methodology. As an extension to the classical DEMATEL methodology, it has been successfully combined with other MCDM tools, such as ANP and BWM, to advance the application of such tools into the complex decision-making process of evaluating criteria.

3.3. Best-Worst Method (BWM)

One of the most recent advances in the field of MCDM is the development of the best-worst method (BWM) in 2015 [36]. Here, the weights of criteria and alternatives with respect to a defined criterion (i.e., the best and the worst) based on pairwise comparisons can be obtained sufficiently. Unlike prior MCDM tools, the BWM only performs reference comparisons that consider the preference of a criterion (i.e., best criterion) over other criteria and the preference of all other criteria over another (i.e., worst criterion). As such, the BWM effectively removes the inconsistency evident from the pairwise comparisons and renders it more accurate and easier to perform. Despite its infancy as an MCDM tool, the BWM has already been widely adopted, singly or together with other tools, to address various practical issues in the literature and has proved to be significantly viable.

3.4. Proposed Fuzzy DEMATEL-Based BWM

This section presents the implementation of the proposed fuzzy DEMATEL-based BWM to evaluate the HPE components in the air transport industry. In the context of this paper, an expert team of air traffic controllers’ shift supervisors consisting of six specialists serves as decision-makers in the assessment of HPE components. These supervisors have been serving at the Mactan Control Tower of CAAP and are considered credible sources concerning their areas of expertise.
Step 1: Compute for initial direct-relation fuzzy matrices.
The initial direct-relation fuzzy matrix E ˜ k for each decision-maker is obtained as in Equation (2). Here, the decision-makers elicit their judgment on the influence of criterion i to criterion j using the linguistic scales in Table 1 according to [109], where K denotes the number of decision-makers.
E ˜ k = 0 e ˜ 1 n k e ˜ n 1 k 0 ,   K = 1 , 2 , , p
Step 2: Generate the aggregated direct-relation fuzzy matrix.
The initial direct-relation fuzzy matrix of K decision-makers is aggregated using Equation (3) to arrive at the matrix E ˜ = e ˜ i j where e ˜ i j = l i j , m i j , u i j .
E ˜ = E ˜ 1 + E ˜ 2 + + E ˜ k K
Step 3: Calculate normalized direct-relation fuzzy matrix.
The direct-relation fuzzy matrix is normalized in Equations (4)–(7). Here, the normalized fuzzy direct-relation matrix is represented by the matrix F ˜
F ˜ = E ˜ γ
γ = m a x j = 1 n u j
F ˜ = f ˜ 11 f ˜ 1 n f ˜ n 1 f ˜ n n
f ˜ i j = e ˜ i j γ = l i j γ , m i j γ , u i j γ
Step 4: Calculate the total-relation fuzzy matrix.
In this step, the total-relation fuzzy matrix, T ˜ , is computed as in Equations (8)–(12), where I is an identity matrix.
T ˜ = t ˜ 11 t ˜ 1 n t ˜ n 1 t ˜ n n
t ˜ i j = l i j , m i j , u i j
M a t r i x   l i j = F l × I F l 1
M a t r i x   m i j = F m × I F m 1
M a t r i x   u i j = F u × I F u 1
Step 5: Transform the total-relation fuzzy matrix into a total-relation crisp matrix.
The total-relation fuzzy matrix, T ˜ , is converted into a total-relation crisp matrix represented by T using Equation (13).
t i j = 1 4 l i j + 2 m i j + u i j
Step 6: Compute cause-effect vectors using the matrix components of the total-relation crisp matrix.
Following the matrix components of matrix T , vectors r and s can be computed using Equation (14) and Equation (15), respectively. Vectors r and s represent the sum of the rows and columns of matrix T . Each criterion can be classified as a causal criterion or an effect criterion based on the following relations: when r i s i is positive, criterion i is considered to be under the causal cluster; otherwise, it falls under the effect cluster. An influential network relations map can also be generated by mapping the data set of r i + s i , r i s i .
r = j = 1 n t i j n × 1
s = j = 1 n t i j 1 × n
Step 7: Proceed with the DEMATEL methodology beginning with the identification of the best and worst criteria among a set of decision criteria representing the HPE components.
The decision-makers elicit their judgment by selecting the best criterion (most important) and the worst criterion (least important) among the HPE components. The best criterion is denoted as c B while the worst criterion as c W .
Step 8: Perform the fuzzy reference comparisons for the best criterion.
The best criterion chosen by the decision-makers is evaluated with respect to other criteria such that a fuzzy reference comparison is represented as a ˜ i j with i being the best criterion while j is the other criterion. Using the natural language listed in Table 2, the fuzzy preference of the best criterion over other criteria can be identified as the fuzzy best-to-others vector, A ˜ B , as in Equation (16):
A ˜ B = a ˜ B 1 ,   a ˜ B 2 , , a ˜ B n
Step 9: Perform the fuzzy reference comparisons for the worst criterion.
Similar to the previous step, a fuzzy reference comparison is executed between the other criteria and the worst criterion chosen by the decision-makers. Here, the fuzzy reference comparison represents the others-to-worst vector, A ˜ W , using the natural language listed in Table 1 (see Equation (17)).
A ˜ W = a ˜ 1 W ,   a ˜ 2 W , , a ˜ n W
Step 10: Solve for the optimal fuzzy weights.
The optimal fuzzy weight w ˜ 1 * , w ˜ 2 * , , w ˜ n * for each criterion is, for each fuzzy pair w ˜ B / w ˜ j and w ˜ j / w ˜ W , should have w ˜ B / w ˜ j = a ˜ B j and w ˜ j / w ˜ W = a ˜ j W . In order to satisfy such conditions for all j , a solution where the maximum absolute gaps w ˜ B w ˜ j a ˜ B j and w ˜ j w ˜ W a ˜ j W for all j minimized should be computed. While the traditional BWM involves crisp numbers instead of triangular fuzzy numbers, as in this case, the weights of each criterion are represented as w ˜ j = l j w , m j w , u j w . Furthermore, GMIR is employed as a defuzzification method (see Equation (18)) where a ˜ i = l i , m i , u i and the GMIR R a ˜ i . To obtain the optimal fuzzy weights and the optimal value of ξ ˜ referred to as ξ * ˜ , Equation (19) is solved considering the relations of the triangular fuzzy set l ξ m ξ u ξ and ξ * ˜ = k * , k * , k * , k * l ξ :
R a ˜ i = l i + 4 m i + u i 6
min   ξ * ˜ subject   to : { l B w m B w u B w l j w m j w u j w l B j m B j u B j k * k * k * l j w m j w u j w l W w m W w u W w l j W m j W u j W k * k * k * j = 1 n R w ˜ j = 1 l j w m j w u j w l j w 0 j = 1 , 2 ,.., n
Following the definition of a consistency degree of fuzzy pairwise comparisons according to [110], a fuzzy comparison is considered to be fully consistent when a ˜ B j × a ˜ j W = a ˜ B W . Recall that a ˜ B j is the fuzzy preference of the best criterion over criterion j , a ˜ j W is the fuzzy preference of criterion j over the worst criterion, and a ˜ B W is the fuzzy preference of the best criterion over the worst criterion. For a comprehensive presentation of the constrained optimization problem for calculating the optimal fuzzy weights, its corresponding nonlinear constrained optimization problem, and consistency ratio (CR) for fuzzy BWM, please see [110]. The consistency index (CI) for fuzzy BWM is shown in Table 3, which serves as an input in computing the CR using Equation (20):
C R = ξ * ˜ C I
A CR value close to zero indicates high consistency among the elicited judgment of decision-makers.

4. Results and Discussion

Illustrative Case Study

MCIA is one of the most important airport transportation hubs in the southern area of the Philippines and is situated in Lapu-Lapu City, Mactan Island, province of Cebu. MCIA also acts as the country’s secondary primary international entry point. Since then, as Cebu, the Queen City of the South, has grown to be a popular tourist destination for both domestic and international travelers, the airport has been a source of economic growth for the nation. The Mactan-Cebu International Airport Authority (MCIAA) reported a 13% annual passenger increase over the previous ten years, demonstrating the rising demand for air travel. However, because of the frequent airline delays, the demand is typically met with complaints. The MCIAA, along with Mactan Control Tower’s airline and air traffic management, are faced with meeting the demands of the increasing volume of flight passengers while maintaining schedule reliability. Furthermore, these stakeholders also collaborate to address air traffic congestion as it occurs. Note that air traffic management plays a crucial role in carrying out the ATFM actions among other stakeholders whose interests focus on minimizing operating costs and maximizing the utilization of resources [111,112].
Therefore, this paper centers on evaluating the performance-shaping factors that affect the efficiency of air traffic controllers. The performance-shaping factors represent the decision criteria considered in this paper. Such factors are denoted as C1 for ‘workload,’ C2 for ‘situation awareness,’ C3 for ‘communication,’ C4 for ‘teamwork,’ C5 for ‘trust,’ C6 for ‘fatigue,’ C7 for ‘stress,’ C8 for ‘vigilance,’ and C9 for ‘attention.’ Following the fuzzy DEMATEL and fuzzy BWM methods, decision-makers in air traffic management are tasked to elicit judgment using the linguistic expressions presented in Table 4. For illustration purposes, take the results from the assessment of expert 1. First, the decision criteria are evaluated pairwise in terms of its relational impact being ‘no influence,’ ‘very low influence,’ ‘low influence,’ ‘high influence,’ and ‘very high influence’ (see Table 1). Then, the equivalent fuzzy numbers corresponding to each linguistic scale are indicated in Table 5. Once the fuzzy numbers are set, the individual judgment of each decision-maker is aggregated, as shown in Table 6 using Equation (3). The aggregated matrix is then normalized by Equation (4), with results listed in Table 7. The total relations matrix is obtained via Equation (8), as presented in Table 8. To further evaluate the criteria classification as causal or effect, the elements of the total relations matrix are defuzzified using Equation (13). As a result, the defuzzified values are then obtained, as shown in Table 9. Note that there are matrix elements highlighted in grey, which represent significant relations among criteria. For instance, in C1, all matrix elements corresponding to C1 through C9, except C6, are highlighted, which implies that C1 significantly impacts all criteria except C6. A visual representation of these influential relations is reflected in Figure 1. These crisp values are then processed to distinguish the classifications of criteria. A final output of the fuzzy DEMATEL method is shown in Table 10, where the criteria are classified according to the inherent nature it contributes to the decision-making process.
Aside from classifying the nature of each criterion, the fuzzy BWM approach is carried out to obtain its priority vector. To begin with, the decision-makers are delegated to select the best and worst criterion among the set of criteria given. Take, for instance, the evaluation of one decision-maker. The best criterion is selected as ‘teamwork’ while the worst criterion is ‘stress.’ The best criterion is evaluated with respect to another criterion with a linguistic expression shown in Table 2. On the other hand, the other criterion is also evaluated against the worst criterion. These evaluations on the best-to-others and others-to-worst are presented in Table 11 and Table 12, respectively. Note that these linguistic expressions have their corresponding fuzzy numbers, which are then embedded into the model shown in Equation (19). Then, by solving Equation (19), the optimal value is obtained along with the optimal fuzzy weights of each criterion (see, for example, Table 13). After generating the optimal fuzzy weights of all decision-makers, their corresponding crisp values are generated, as shown in Table 14. Then, the aggregated optimal fuzzy weights are obtained by solving for the normalized arithmetic mean of the entire set of optimal fuzzy weights. This aggregated optimal fuzzy weight and the CR are shown in Table 15 and Table 16, respectively. It can be noted that an average CR of 0.2417 is a good indication that the judgment elicited by decision-makers is rather consistent, given that it is close to 0.

5. Managerial Implications

The application of fuzzy DEMATEL and fuzzy BWM to evaluate the performance-shaping factors of air traffic controllers has produced interesting results on the nature of such factors and their priority vector. Firstly, a key result of the fuzzy DEMATEL methodology pointed out that the performance-shaping factors C2 (situation awareness), C3 (communication), C4 (teamwork), C8 (vigilance), and C9 (attention) are under the casual cluster, while C1 (workload), C5 (trust), C6 (fatigue), and C7 (stress) are under the effect cluster. Causal criteria imply that these factors influence the other criteria to some degree. The matrix elements highlighted in grey, as shown in Table 9, indicate significant relations among criteria. Figure 1 also illustrates such a relationship among criteria. It can be noted further that while there are significant relations among pairs of criteria (e.g., C1–C2, C2–C9, C7–C2), there are also insignificant ones (e.g., C6–C8, C9–C4, C8–C5). Such a result implies that one criterion’s influence or effect on another can be considered significant or negligible.
To continue the classification of criteria, since causal criteria are those that affect the other criteria, decision-makers are directed towards paying the most attention to such causal criteria in order to improve the overall performance of air traffic controllers. For instance, in reference to the total influential matrix, since C1 (workload) has a significant impact on all the rest of the criteria except C6 (communication), framing an improvement effort specific to C1 (workload) will have a significant impact on other criteria. On the other hand, effect criteria are those that are influenced by causal criteria. For decision-makers, it is also critical to carefully monitor such effect criteria to minimize the impact of other criteria on an effect criterion. As an example, C2 (situation awareness) is influenced by all criteria except C6 (communication); therefore, any strategy formulation efforts are certain to influence C2 (situation awareness). It is very interesting to notice that C6 (fatigue) does not significantly influence other criteria or is influenced by other criteria. This suggests that efforts to improve other criteria will not have a significant impact on C6 (fatigue). As such, dedicated programs specific to handling C6 (fatigue) should be developed by decision-makers.
Classifying the nature of performance-shaping actors as either casual or effect helps decision-makers frame policies with respect to how each factor should be treated to improve the performance of air traffic controllers. However, the fuzzy DEMATEL methodology is limited to only exploring such relationships and the nature of criteria. To aid in the analysis of the criteria, the fuzzy BWM is employed.
Key results of the fuzzy BWM method center on the priority vector of criteria. It is found that among the criteria, C3 (communication) is considered to be the first priority. It is imperative to highlight that decision-makers must carefully look into the priority of criteria in policymaking; for one, it is a given truth that resources, such as time, finances, and labor, available for use in the improvement programs of the air traffic controllers are limited. Putting most efforts into improving the critical criteria rather than taking everything in one phase can apparently provide improvement to the overall performance of air traffic controllers.

6. Conclusions and Ways Forward

The nature of air traffic controllers’ tasks in managing air traffic flow requires maximum performance to ensure that an efficient and safe flow is always observed. The overall performance of air traffic controllers is shaped by a number of factors, such as workload, situation awareness, communication, teamwork, trust, fatigue, stress, vigilance, and attention. While stakeholders in the air traffic management sector strive to enhance the performance of air traffic controllers, no particular guideline is available for decision-makers reference. This paper aims to provide a springboard on which particular factors (or factors) to focus first.
Using fuzzy DEMATEL and fuzzy BWM, these performance-shaping factors are evaluated via a case study performed in the Mactan Control Tower of the Civil Aviation Authority of the Philippines (CAAP) to distinguish the classification of factors and their priority vector. Key results of the model implementation clearly showed the nature of factors being either causal or effect criterion. Furthermore, the priority of each criterion is also known. With such results at hand, it becomes convenient for decision-makers to develop strategies and allocate limited resources to enhance performance by focusing on critical factors. The results showed that there is practically no need for decision-makers to tackle all criteria at once, as addressing one criterion can significantly impact other criteria.
Along the line of the case study performed, the proposed methodology can satisfactorily reflect the decision maker’s preference in assessing the factors affecting air traffic controllers’ performance under the HPE framework. However, such results should be taken with caution. Although the same interpretation can work for any case study involving the analysis of the same factors, a different classification of factors and their priority weights may be obtained depending on the raw responses of the decision-makers of another case study. Note that this paper serves as a methodological guideline for stakeholders of the aviation industry, in fact, even for other types of industries, to follow in analyzing the interplay among factors affecting the performance of its human capital.
In future work, specific action plans on critical factors can be explored to provide a clearer strategy implementation for decision-makers. Other than that, the priority vector obtained for each criterion can also be used as an input to analytical tools for further evaluation.

Author Contributions

Conceptualization, M.F.B.; Methodology, M.F.B.; Formal analysis, M.F.B. and R.R.S.; Investigation, M.F.B.; Writing—original draft, M.F.B.; Writing—review & editing, R.R.S.; Supervision, R.R.S. All authors have read and agreed to the published version of the manuscript.

Funding

The authors wish to thank the Philippine Department of Science and Technology (DOST) Engineering Research and Development for Technology (ERDT) for the support through the full graduate scholarship program provided to M.F.B. The authors also wish to thank De La Salle University-Manila for funding the journal APC.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are in-text.

Acknowledgments

M.F.B. wishes to thank the Philippine Department of Science and Technology (DOST) Engineering Research and Development for Technology (ERDT) for the support through the full graduate scholarship program provided and the Civil Aviation Authority of the Philippines (CAAP) for accommodating the author during the course of the study and for the active participation of its air traffic controllers. The authors also wish to acknowledge De La Salle University-Manila for providing the financial grant to publish this paper in an open-access format.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Fang, Z.; Moolchandani, K.; Chao, H.; DeLaurentis, D. A Method for Emission Allowances Allocation in Air Transportation Systems from a System-of-Systems Perspective. J. Clean. Prod. 2019, 226, 419–431. [Google Scholar] [CrossRef]
  2. Otčenášek, J. Environmental Aircraft Take-off Noise—Sound Quality Factors Associated with Unpleasantness. Transp. Res. Part D Transp. Environ. 2019, 67, 366–374. [Google Scholar] [CrossRef]
  3. Lam, C.-M.; Yu, I.K.M.; Medel, F.; Tsang, D.C.W.; Hsu, S.-C.; Poon, C.S. Life-Cycle Cost-Benefit Analysis on Sustainable Food Waste Management: The Case of Hong Kong International Airport. J. Clean. Prod. 2018, 187, 751–762. [Google Scholar] [CrossRef]
  4. Thamagasorn, M.; Pharino, C. An Analysis of Food Waste from a Flight Catering Business for Sustainable Food Waste Management: A Case Study of Halal Food Production Process. J. Clean. Prod. 2019, 228, 845–855. [Google Scholar] [CrossRef]
  5. da Menegon, L.S.; Vincenzi, S.L.; de Andrade, D.F.; Barbetta, P.A.; Vink, P.; Merino, E.A.D. An Aircraft Seat Discomfort Scale Using Item Response Theory. Appl. Ergon. 2019, 77, 1–8. [Google Scholar] [CrossRef]
  6. Shaban, R.Z.; Sotomayor-Castillo, C.F.; Jakrot, H.; Jiang, P. Passenger Travel Health Advice Regarding Infection Control and the Prevention of Infectious Diseases: What’s in Airline Inflight Magazines? Travel Med. Infect. Dis. 2020, 33, 101453. [Google Scholar] [CrossRef]
  7. Bouwens, J.M.A.; Fasulo, L.; Hiemstra-van Mastrigt, S.; Schultheis, U.W.; Naddeo, A.; Vink, P. Effect of In-Seat Exercising on Comfort Perception of Airplane Passengers. Appl. Ergon. 2018, 73, 7–12. [Google Scholar] [CrossRef]
  8. Achenbach, A.; Spinler, S. Prescriptive Analytics in Airline Operations: Arrival Time Prediction and Cost Index Optimization for Short-Haul Flights. Oper. Res. Perspect. 2018, 5, 265–279. [Google Scholar] [CrossRef]
  9. Dalmau, R.; Prats, X. Fuel and Time Savings by Flying Continuous Cruise Climbs. Transp. Res. Part D Transp. Environ. 2015, 35, 62–71. [Google Scholar] [CrossRef]
  10. Kenan, N.; Jebali, A.; Diabat, A. The Integrated Aircraft Routing Problem with Optional Flights and Delay Considerations. Transp. Res. Part E Logist. Transp. Rev. 2018, 118, 355–375. [Google Scholar] [CrossRef]
  11. Mohammadian, I.; Abbasi, B.; Abareshi, A.; Goh, M. Antecedents of Flight Delays in the Australian Domestic Aviation Market. Transp. Res. Interdiscip. Perspect. 2019, 1, 100007. [Google Scholar] [CrossRef]
  12. Jiang, H.; Ren, X. Model of Passenger Behavior Choice under Flight Delay Based on Dynamic Reference Point. J. Air Transp. Manag. 2019, 75, 51–60. [Google Scholar] [CrossRef]
  13. Sezgen, E.; Mason, K.J.; Mayer, R. Voice of Airline Passenger: A Text Mining Approach to Understand Customer Satisfaction. J. Air Transp. Manag. 2019, 77, 65–74. [Google Scholar] [CrossRef]
  14. Tobaruela, G.; Schuster, W.; Majumdar, A.; Ochieng, W.Y.; Martinez, L.; Hendrickx, P. A Method to Estimate Air Traffic Controller Mental Workload Based on Traffic Clearances. J. Air Transp. Manag. 2014, 39, 59–71. [Google Scholar] [CrossRef]
  15. Asadi, H.; Yu, D.; Mott, J.H. Risk Factors for Musculoskeletal Injuries in Airline Maintenance, Repair & Overhaul. Int. J. Ind. Ergon. 2019, 70, 107–115. [Google Scholar] [CrossRef]
  16. Chen, M.-L.; Lu, S.-Y.; Mao, I.-F. Subjective Symptoms and Physiological Measures of Fatigue in Air Traffic Controllers. Int. J. Ind. Ergon. 2019, 70, 1–8. [Google Scholar] [CrossRef]
  17. Stroeve, S.H.; van Doorn, B.A.; Everdij, M.H.C. Analysis of the Roles of Pilots and Controllers in the Resilience of Air Traffic Management. Saf. Sci. 2015, 76, 215–227. [Google Scholar] [CrossRef]
  18. Chang, Y.-H.; Yang, H.-H.; Hsu, W.-J. Effects of Work Shifts on Fatigue Levels of Air Traffic Controllers. J. Air Transp. Manag. 2019, 76, 1–9. [Google Scholar] [CrossRef]
  19. Endsley, M.R.; Sollenberger, R.; Stein, E. Situation awareness: A comparison of measures. In Proceedings of the Human Performance, Situation Awareness and Automation: User Centered Design for the New Millennium Conference, Savannah, GA, USA, 15–19 October 2000. [Google Scholar]
  20. Kearney, P.; Li, W.-C.; Yu, C.-S.; Braithwaite, G. The Impact of Alerting Designs on Air Traffic Controller’s Eye Movement Patterns and Situation Awareness. Ergonomics 2019, 62, 305–318. [Google Scholar] [CrossRef] [Green Version]
  21. Padrón, S.; Guimarans, D.; Ramos, J.J.; Fitouri-Trabelsi, S. A Bi-Objective Approach for Scheduling Ground-Handling Vehicles in Airports. Comput. Oper. Res. 2016, 71, 34–53. [Google Scholar] [CrossRef] [Green Version]
  22. Endsley, M.R. Toward a Theory of Situation Awareness in Dynamic Systems. Hum. Factors 1995, 37, 32–64. [Google Scholar] [CrossRef]
  23. Argyle, E.M.; Houghton, R.J.; Atkin, J.; De Maere, G.; Moore, T.; Morvan, H.P. Human Performance and Strategies While Solving an Aircraft Routing and Sequencing Problem: An Experimental Approach. Cogn. Tech. Work 2018, 20, 425–441. [Google Scholar] [CrossRef] [Green Version]
  24. Graziani, I.; Berberian, B.; Kirwan, B.; Le Blaye, P.; Napoletano, L.; Rognin, L.; Silvagni, S. Development of the human performance envelope concept for cockpit HMI design. In Proceedings of the HCI-Aero 2016 International Conference on Human-Computer Interaction in Aerospace, Paris, France, 14–16 September 2016; hal-01409075ff. [Google Scholar]
  25. Edwards, T.; Homola, J.; Mercer, J.; Claudatos, L. Multifactor Interactions and the Air Traffic Controller: The Interaction of Situation Awareness and Workload in Association with Automation. Cogn. Technol. Work. 2016, 49, 597–602. [Google Scholar] [CrossRef]
  26. Edwards, T.; Gabets, C.; Mercer, J.; Bienert, N. Task Demand Variation in Air Traffic Control: Implications for Workload, Fatigue, and Performance. In Advances in Human Aspects of Transportation; Stanton, N.A., Landry, S., Di Bucchianico, G., Vallicelli, A., Eds.; Springer: Cham, Switzerland, 2017; Volume 484, pp. 91–102. ISBN 9783319416816. [Google Scholar]
  27. Kaber, D.B.; Perry, C.M.; Segall, N.; McClernon, C.K.; Prinzel, L.J. Situation Awareness Implications of Adaptive Automation for Information Processing in an Air Traffic Control-Related Task. Int. J. Ind. Ergon. 2006, 36, 447–462. [Google Scholar] [CrossRef]
  28. Gawade, M.; Zhang, Y. Synthesis of Remote Air Traffic Control System and Air Traffic Controllers’ Perceptions. Transp. Res. Rec. 2016, 2600, 49–60. [Google Scholar] [CrossRef] [Green Version]
  29. Wickens, C.D.; Mavor, A.S.; McGee, J.; National Research Council (U.S.) (Eds.) Flight to the Future: Human Factors in Air Traffic Control. National Academy Press: Washington, DC, USA, 1997; ISBN 9780309056373. [Google Scholar]
  30. Friedrich, M.; Biermann, M.; Gontar, P.; Biella, M.; Bengler, K. The Influence of Task Load on Situation Awareness and Control Strategy in the ATC Tower Environment. Cogn. Techol. Work 2018, 20, 205–217. [Google Scholar] [CrossRef]
  31. Mulliner, E.; Malys, N.; Maliene, V. Comparative Analysis of MCDM Methods for the Assessment of Sustainable Housing Affordability. Omega 2016, 59, 146–156. [Google Scholar] [CrossRef]
  32. Gabus, A.; Fontela, E. World Problems. An Invitation to Further Thought within the Framework of DEMATEL; Battelle Geneva Research Centre: Geneva, Switzerland, 1972. [Google Scholar]
  33. Saaty, T.L. Decision Making with Dependence and Feedback: The Analytic Network Process; RWS Publications Publishers: Pittsburgh, PA, USA, 1996. [Google Scholar]
  34. Warfield, J.N. Developing Subsystem Matrices in Structural Modeling. IEEE Trans. Syst. Man Cybern. 1974, SMC-4, 74–80. [Google Scholar] [CrossRef]
  35. Sharma, H.D.; Gupta, A.D.; Sushil. The Objectives of Waste Management in India: A Futures Inquiry. Technol. Forecast. Soc. Chang. 1995, 48, 285–309. [Google Scholar] [CrossRef]
  36. Rezaei, J. Best-Worst Multi-Criteria Decision-Making Method. Omega 2015, 53, 49–57. [Google Scholar] [CrossRef]
  37. Brans, J.P. L’ingénierie de la décision. Elaboration d’instruments d’aide à la décision. Méthode PROMETHEE. In L’aide à la Décision: Nature, Instruments et Perspectives D’avenir; Nadeau, R., Landry, M., Eds.; Presses de l’Université Laval: QC, Canada, 1982; pp. 183–214. [Google Scholar]
  38. Brans, J.P.; Vincke, P. Note—A Preference Ranking Organisation Method: (The PROMETHEE Method for Multiple Criteria Decision-Making). Manag. Sci. 1985, 31, 647–656. [Google Scholar] [CrossRef] [Green Version]
  39. Brans, J.-P.; Mareschal, B. The PROMCALC & GAIA Decision Support System for Multicriteria Decision Aid. Decis. Support Syst. 1994, 12, 297–310. [Google Scholar] [CrossRef]
  40. Saaty, T.L. The Analytic Hierarchy Process, New York: McGraw Hill. International, Translated to Russian, Portuguese, and Chinese, Revised Editions, Paperback (1996, 2000); RWS Publications: Pittsburgh, PA, USA, 1980. [Google Scholar]
  41. Hwang, C.L.; Yoon, K. Multiple Attributes Decision Making Methods and Applications; Springer: Berlin/Heidelberg, Germany, 1981. [Google Scholar]
  42. Opricovic, S. Multicriteria Optimization of Civil Engineering Systems; Faculty of Civil Engineering: Belgrade, Serbia, 1998. [Google Scholar]
  43. Opricovic, S.; Tzeng, G.-H. Compromise Solution by MCDM Methods: A Comparative Analysis of VIKOR and TOPSIS. Eur. J. Oper. Res. 2004, 156, 445–455. [Google Scholar] [CrossRef]
  44. Roy, B. The Outranking Approach and the Foundations of Electre Methods. Theor. Decis. 1991, 31, 49–73. [Google Scholar] [CrossRef]
  45. Cooper, W.W.; Seiford, L.M.; Tone, K. Data Envelopment Analysis a Comprehensive Text with Models, Applications, References, and DEA-Solver Software, 1st ed.; Kluwer Academic: Boston, MA, USA, 2000; ISBN 9781280200281. [Google Scholar]
  46. Bañares, J.R.; Caballes, S.A.; Serdan, M.J.; Liggayu, A.T.; Bongo, M.F. A Comprehension-Based Ergonomic Redesign of Philippine Road Warning Signs. Int. J. Ind. Ergon. 2018, 65, 17–25. [Google Scholar] [CrossRef]
  47. del Pilar, E.C.; Alegado, I.; Bongo, M.F. Structural Relationships among Critical Failure Factors of Microbusinesses. JSBED 2019, 27, 148–174. [Google Scholar] [CrossRef]
  48. Stević, Ž.; Pamučar, D.; Puška, A.; Chatterjee, P. Sustainable Supplier Selection in Healthcare Industries Using a New MCDM Method: Measurement of Alternatives and Ranking According to COmpromise Solution (MARCOS). Comput. Ind. Eng. 2020, 140, 106231. [Google Scholar] [CrossRef]
  49. Balezentis, T.; Chen, X.; Galnaityte, A.; Namiotko, V. Optimizing Crop Mix with Respect to Economic and Environmental Constraints: An Integrated MCDM Approach. Sci. Total Environ. 2020, 705, 135896. [Google Scholar] [CrossRef]
  50. de Assis, G.S.; dos Santos, M.; Basilio, M.P. Use of the WASPAS Method to Select Suitable Helicopters for Aerial Activity Carried Out by the Military Police of the State of Rio De Janeiro. Axioms 2023, 12, 77. [Google Scholar] [CrossRef]
  51. Bakır, M.; Akan, Ş.; Özdemir, E. Regional aircraft selection with fuzzy piprecia and fuzzy marcos: A case study of the turkish airline industry. Facta Univ. Ser. Mech. Eng. 2021, 19, 423–445. [Google Scholar] [CrossRef]
  52. Maêda, S.M.D.N.; Costa, I.P.D.A.; Castro, M.A.P.D.; Fávero, L.P.; Costa, A.P.D.A.; Corriça, J.V.D.P.; Gomes, C.F.S.; dos Santos, M. Multi-criteria Analysis Applied to Aircraft Selection by Brazilian Navy. Prod. J. 2021, 31. [Google Scholar] [CrossRef]
  53. Bongo, M.F.; Ocampo, L.A. A Hybrid Fuzzy MCDM Approach for Mitigating Airport Congestion: A Case in Ninoy Aquino International Airport. J. Air Transp. Manag. 2017, 63, 1–16. [Google Scholar] [CrossRef]
  54. Bongo, M.F.; Ocampo, L.A. Exploring Critical Attributes during Air Traffic Congestion with a Fuzzy DEMATEL–ANP Technique: A Case Study in Ninoy Aquino International Airport. J. Mod. Transport. 2018, 26, 147–161. [Google Scholar] [CrossRef] [Green Version]
  55. Ancheta, R.A.A., Jr.; Bongo, M.F.; Ocampo, L.A.; Kilongkilong, D.A.A.; Amit, M.; Cuizon, O.A.; Arda, N.J. DEMATEL-AHP Technique to Minimise Departure Delays Due to Airspace Congestion: A Case in Mactan-Cebu International Airport. IJSSE 2018, 8, 365. [Google Scholar] [CrossRef]
  56. Lu, M.-T.; Hsu, C.-C.; Liou, J.J.H.; Lo, H.-W. A Hybrid MCDM and Sustainability-Balanced Scorecard Model to Establish Sustainable Performance Evaluation for International Airports. J. Air Transp. Manag. 2018, 71, 9–19. [Google Scholar] [CrossRef]
  57. Pandey, M.M.; Shukla, D. Evaluating the Human Performance Factors of Air Traffic Control in Thailand Using Fuzzy Multi Criteria Decision Making Method. J. Air Transp. Manag. 2019, 81, 101708. [Google Scholar] [CrossRef]
  58. Kumar, A.; Anbanandam, R. Analyzing Interrelationships and Prioritising the Factors Influencing Sustainable Intermodal Freight Transport System: A Grey-DANP Approach. J. Clean. Prod. 2020, 252, 119769. [Google Scholar] [CrossRef]
  59. Edwards, T.; Sharples, S.; Wilson, J.R.; Kirwan, B. The Need for a Multi-Factorial Model of Safe Human Performance in Air Traffic Control. In Proceedings of the 28th Annual European Conference on Cognitive Ergonomics, ACM, Delft, The Netherlands, 25 August 2010; pp. 253–260. [Google Scholar]
  60. Chang, Y.-H.; Yeh, C.-H. Human Performance Interfaces in Air Traffic Control. Appl. Ergon. 2010, 41, 123–129. [Google Scholar] [CrossRef]
  61. Hart, S.G.; Staveland, L.E. Development of NASA-TLS (Task Load Index): Results of empirical and theoretical research. In Human Mental Workload; Hancock, P.A., Meshkati, N., Eds.; North-Holland Elsevier Science: Amsterdam, NY, USA, 1988; pp. 139–183. [Google Scholar]
  62. Li, P.; Zhang, L.; Dai, L.; Zou, Y.; Li, X. An Assessment Method of Operator’s Situation Awareness Reliability Based on Fuzzy Logic-AHP. Saf. Sci. 2019, 119, 330–343. [Google Scholar] [CrossRef]
  63. Miles, J.D.; Strybel, T.Z. Measuring Situation Awareness of Student Air Traffic Controllers with Online Probe Queries: Are We Asking the Right Questions? Int. J. Hum. Comput. Interact. 2017, 33, 55–65. [Google Scholar] [CrossRef]
  64. Lundberg, J. Situation Awareness Systems, States and Processes: A Holistic Framework. Theor. Issues Ergon. Sci. 2015, 16, 447–473. [Google Scholar] [CrossRef]
  65. Vu, K.L.; Strybel, T.Z.; Kraut, J.; Paige Bacon, L.; Minakata, K.; Nguyen, J.; Rotterman, A.; Battiste, V.; Johnson, W. Pilot and controller workload and situation awareness with three traffic management concepts. In Proceedings of the 29th Digital Avionics Systems Conference, Salt Lake City, UT, USA, 3–7 October 2010; pp. 4.A.5-1–4.A.5-10. [Google Scholar] [CrossRef]
  66. Inoue, S.; Furuta, K.; Kanno, T.; Aoyama, H.; Nakata, K. Cognitive Process Modelling of Team Cooperative Work in En Route Air Traffic Control. IFAC Proc. Vol. 2010, 43, 19–24. [Google Scholar] [CrossRef] [Green Version]
  67. Yang, J.; Rantanen, E.M.; Zhang, K. The Impact of Time Efficacy on Air Traffic Controller Situation Awareness and Mental Workload. Int. J. Aviat. Psychol. 2009, 20, 74–91. [Google Scholar] [CrossRef]
  68. Tattersall, A.J.; Foord, P.S. An Experimental Evaluation of Instantaneous Self-Assessment as a Measure of Workload. Ergonomics 1996, 39, 740–748. [Google Scholar] [CrossRef]
  69. Roscoe, A.E.; Ellis, G.A. A Subjective Rating Scale for Assessing Pilot Workload in Flight: A Decade of Practical Use (TR 90019). 1990. Available online: www.dtic.mil/dtic/tr/fulltext/u2/a227864.pdf (accessed on 4 March 2022).
  70. Dönmez, K.; Demirel, S.; Özdemir, M. Handling the Pseudo Pilot Assignment Problem in Air Traffic Control Training by Using NASA TLX. J. Air Transp. Manag. 2020, 89, 101934. [Google Scholar] [CrossRef]
  71. Farbos, B.; Mollard, R.; Cabon, P.; David, H. Measurement of fatigue and adaptation in large-scale real-time ATC simulation. In Proceedings of the IEA 2000/HFS 2000 Congress, San Diego, CA, USA; 2000; pp. 204–207. [Google Scholar]
  72. Harris, D. (Ed.) Engineering Psychology and Cognitive Ergonomics. In Proceedings of the 15th International Conference, EPCE 2018, Held as Part of HCI International 2018, Las Vegas, NV, USA, 15–20 July 2018; Lecture Notes in Computer Science; Springer International Publishing: Cham, Switzerland, 2018; Volume 10906, ISBN 9783319911212. [Google Scholar]
  73. Mulder, M.; Borst, C.; van Paassen, M. Designing for situation awareness—Aviation perspective. In Proceedings of the International Conference on Computer-Human Interaction Research and Applications, Funchal, Portugal, 31 October–2 November 2017; pp. 9–21. [Google Scholar]
  74. Endsley, M. A taxonomy of situation awareness errors. In Proceedings of the Western European Association of Aviation Psychology 21st Conference, Dublin, Ireland, 20–21 June 1994. [Google Scholar]
  75. Bhavsar, P.; Srinivasan, B.; Srinivasan, R. Quantifying Situation Awareness of Control Room Operators Using Eye-Gaze Behavior. Comput. Chem. Eng. 2017, 106, 191–201. [Google Scholar] [CrossRef]
  76. Scott-Parker, B.; Curran, M.; Rune, K.; Lord, W.; Salmon, P.M. Situation Awareness in Young Novice Ambulance Drivers: So Much More than Driving. Saf. Sci. 2018, 108, 48–58. [Google Scholar] [CrossRef]
  77. Oltrogge, D.L.; Alfano, S. The Technical Challenges of Better Space Situational Awareness and Space Traffic Management. J. Space Saf. Eng. 2019, 6, 72–79. [Google Scholar] [CrossRef]
  78. Sawaragi, T.; Fujii, K.; Horiguchi, Y.; Nakanishi, H. Analysis of Team Situation Awareness Using Serious Game and Constructive Model-Based Simulation. IFAC-PapersOnLine 2016, 49, 537–542. [Google Scholar] [CrossRef]
  79. Naderpour, M.; Lu, J.; Zhang, G. A Safety-Critical Decision Support System Evaluation Using Situation Awareness and Workload Measures. Reliab. Eng. Syst. Saf. 2016, 150, 147–159. [Google Scholar] [CrossRef] [Green Version]
  80. Reinerman-Jones, L.E.; Hughes, N.; D’Agostino, A.; Matthews, G. Human Performance Metrics for the Nuclear Domain: A Tool for Evaluating Measures of Workload, Situation Awareness and Teamwork. Int. J. Ind. Ergon. 2019, 69, 217–227. [Google Scholar] [CrossRef]
  81. Brommelsiek, M.; Graybill, T.L.; Gotham, H.J. Improving Communication, Teamwork and Situation Awareness in Nurse-Led Primary Care Clinics of a Rural Healthcare System. J. Interprofessional Educ. Pract. 2019, 16, 100268. [Google Scholar] [CrossRef]
  82. Hogg, M.A.; Vaughan, G.M. Social Psycholog, 3rd ed.; Prentice Hall: London, UK, 2002. [Google Scholar]
  83. Huttunen, K.; Keränen, H.; Väyrynen, E.; Pääkkönen, R.; Leino, T. Effect of Cognitive Load on Speech Prosody in Aviation: Evidence from Military Simulator Flights. Appl. Ergon. 2011, 42, 348–357. [Google Scholar] [CrossRef] [PubMed]
  84. Jou, R.-C.; Kuo, C.-W.; Tang, M.-L. A Study of Job Stress and Turnover Tendency among Air Traffic Controllers: The Mediating Effects of Job Satisfaction. Transp. Res. Part E Logist. Transp. Rev. 2013, 57, 95–104. [Google Scholar] [CrossRef]
  85. Tullo, F.J. Teamwork and Organizational Factors. In Crew Resource Management; Elsevier: Amsterdam, The Netherlands, 2010; pp. 59–78. ISBN 9780123749468. [Google Scholar]
  86. Ajeigbe, O.D. Nurse-physician Teamwork in the Emergency Department. Ph.D. Thesis, University of California, Los Angeles, CA, USA, 2012. [Google Scholar] [CrossRef] [Green Version]
  87. Kontogiannis, T.; Malakis, S. Strategies in Coping with Complexity: Development of a Behavioural Marker System for Air Traffic Controllers. Saf. Sci. 2013, 57, 27–34. [Google Scholar] [CrossRef]
  88. Woldring, M. Team Resource Management in European Air Traffic Control. Air Space Eur. 1999, 1, 81–84. [Google Scholar] [CrossRef]
  89. Kiffin-Petersen, S.; Cordery, J. Trust, Individualism and Job Characteristics as Predictors of Employee Preference for Teamwork. Int. J. Hum. Resour. Manag. 2003, 14, 93–116. [Google Scholar] [CrossRef]
  90. Muir, B.M. Trust between Humans and Machines, and the Design of Decision Aids. Int. J. Man-Mach. Stud. 1987, 27, 527–539. [Google Scholar] [CrossRef]
  91. Yasar, M. Flight anomaly tracking for improved situational awareness: Case study of Germanwings flight 9525. In Proceedings of the Annual Conference of the Prognostics and Health Management Society, PHM, Ottawa, ON, Canada, 20–22 June 2016; pp. 237–243. [Google Scholar]
  92. Dillingham, G.L. Air Traffic Control: Evolution and Status of FAA’s Automation Program; Technical Report GAO/T-RCED/AIMD-98-85; United States General Accounting Office: Washington, DC, USA, 1998. [Google Scholar]
  93. Endsley, M.R.; Jones, D.G. Situation Awareness Requirements Analysis for TRACON Air Traffic Control; Technical Report TTU-IE-95-01; Technology Center, Federal Aviation Administration: Atlantic City, NJ, USA, 1995. [Google Scholar]
  94. International Civil Aviation Organization (ICAO) Fatigue Risk Management Systems: Implementation Guide for Operators. 2019. Available online: http://www.icao.int (accessed on 11 August 2019).
  95. Gawron, V.J. Overview of Self-Reported Measures of Fatigue. Int. J. Aviat. Psychol. 2016, 26, 120–131. [Google Scholar] [CrossRef]
  96. Grandjean, E.P.; Wotzka, G.; Schaad, R.; Gilgen, A. Fatigue and Stress in Air Traffic Controllers. Ergonomics 1971, 14, 159–165. [Google Scholar] [CrossRef]
  97. Triyanti, V.; Azis, H.A.; Iridiastadi, H.; Yassierli. Workload and Fatigue Assessment on Air Traffic Controller. IOP Conf. Ser. Mater. Sci. Eng. 2020, 847, 012087. [Google Scholar] [CrossRef]
  98. Kuo, J.; Lenné, M.G.; Myers, R.; Collard-Scruby, A.; Jaeger, C.; Birmingham, C. Real-time assessment of operator state in air traffic controllers using ocular metrics. In Proceedings of the Human Factors and Ergonomics Society 2017 Annual Meeting, Austin, TX, USA, 9–13 October 2017; pp. 257–261. [Google Scholar]
  99. Gomes De Carvalho, L.M.; De Souza Borges, S.F.; Machado Cardoso Júnior, M. Fatigue Assessment Methods Applied to Air Traffic Control – A Bibliometric Analysis. In Proceedings of the 21st Congress of the International Ergonomics Association (IEA 2021), Online, 13–18 June 2021; Black, N.L., Neumann, W.P., Noy, I., Eds.; Springer International Publishing: Cham, Switzerland, 2021; Volume 221, pp. 136–142, ISBN 9783030746070. [Google Scholar]
  100. Costa, G. Occupational Stress and Stress Prevention in Air Traffic Control; International Labour Office: Geneva, Switzerland, 1996; ISBN 9789221100706. [Google Scholar]
  101. Bongo, M.F.; Alimpangog, K.M.S.; Loar, J.F.; Montefalcon, J.A.; Ocampo, L.A. An Application of DEMATEL-ANP and PROMETHEE II Approach for Air Traffic Controllers’ Workload Stress Problem: A Case of Mactan Civil Aviation Authority of the Philippines. J. Air Transp. Manag. 2018, 68, 198–213. [Google Scholar] [CrossRef]
  102. Cooper, C.L.; Sloan, S.J.; Williams, S. Occupational Stress Indicator Management Guide; NFER-Nelson Press: London, UK, 1988. [Google Scholar]
  103. Lesiuk, T. The Effect of Preferred Music Listening on Stress Levels of Air Traffic Controllers. Arts Psychother. 2008, 35, 1–10. [Google Scholar] [CrossRef]
  104. Chiou, Y.-C.; Chen, Z.-T. Identifying Key Risk Factors in Air Traffic Control by Exploratory and Confirmatory Factor Analysis. J. Adv. Transp. 2010, 44, 267–283. [Google Scholar] [CrossRef]
  105. Eysenck, M.W. Principles of Cognitive Psychology; Psychology Press: London, UK, 2001. [Google Scholar]
  106. McIntire, L.K.; McKinley, R.A.; Goodyear, C.; McIntire, J.P. Detection of Vigilance Performance Using Eye Blinks. Appl. Ergon. 2014, 45, 354–362. [Google Scholar] [CrossRef]
  107. Shorrock, S.T. Errors of Perception in Air Traffic Control. Saf. Sci. 2007, 45, 890–904. [Google Scholar] [CrossRef]
  108. Chen, S.-M.; Munif, A.; Chen, G.-S.; Liu, H.-C.; Kuo, B.-C. Fuzzy Risk Analysis Based on Ranking Generalized Fuzzy Numbers with Different Left Heights and Right Heights. Expert Syst. Appl. 2012, 39, 6320–6334. [Google Scholar] [CrossRef]
  109. Chang, B.; Chang, C.-W.; Wu, C.-H. Fuzzy DEMATEL Method for Developing Supplier Selection Criteria. Expert Syst. Appl. 2011, 38, 1850–1858. [Google Scholar] [CrossRef]
  110. Ali, A.; Rashid, T. Hesitant Fuzzy Best-worst Multi-criteria Decision-making Method and Its Applications. Int. J. Intell. Syst. 2019, 34, 1953–1967. [Google Scholar] [CrossRef]
  111. Bongo, M.F.; Sy, C.L. A Robust Optimisation Formulation for Post-Departure Rerouting Problem. In Proceedings of the 2020 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM), Singapore, 14 December 2020; IEEE: Singapore; pp. 509–513. [Google Scholar]
  112. Bongo, M.; Sy, C. An integer linear programming formulation for post-departure air traffic flow management. AEJ 2021, 11, 101–117. [Google Scholar] [CrossRef]
Figure 1. Influential network relations map (sample for C1).
Figure 1. Influential network relations map (sample for C1).
Aerospace 10 00252 g001
Table 1. Linguistic scales for the pairwise evaluation of decision criteria.
Table 1. Linguistic scales for the pairwise evaluation of decision criteria.
Linguistic TermMembership Function
No influence (NI)(0.00, 0.00, 0.25)
Very low influence (VLII)(0.00, 0.25, 0.50)
Low influence (LI)(0.25, 0.50, 0.75)
High influence (HI)(0.50, 0.75, 1.00)
Very high influence (VHI)(0.75, 1.00, 1.00)
Table 2. Linguistic scales for the evaluation of decision criteria.
Table 2. Linguistic scales for the evaluation of decision criteria.
Linguistic TermMembership Function
Equally important (EI)(1, 1, 1)
Weakly important (WI)(2/3, 1, 3/2)
Fairly important (FI)(3/2, 2, 5/2)
Very important (VI)(5/2, 3, 7/2)
Absolutely important (AI)(7/2, 4, 9/2)
Table 3. Linguistic scales for the evaluation of decision criteria [36].
Table 3. Linguistic scales for the evaluation of decision criteria [36].
a B W 123456789
Consistency index ξ 0.000.441.001.632.303.003.734.475.23
Table 4. Sample pairwise evaluation of one decision-maker according to the fuzzy DEMATEL method.
Table 4. Sample pairwise evaluation of one decision-maker according to the fuzzy DEMATEL method.
CriteriaC1C2C3C4C5C6C7C8C9
C1NIVHIHIVHIHIHIVHIHIVHI
C2HINIHIHIHIHIHIVHIHI
C3HIHINIHIHIVHIVHIHIHI
C4HIHIHINIVHILILIHIHI
C5VHIHIVHIHINIHIVHIHIHI
C6VHIHIVHIHILINIHILILI
C7LIHIHILILILINIHILI
C8VHILIVHILILIHILINIHI
C9LIHIHILILILILILINI
Table 5. Corresponding fuzzy numbers of the pairwise evaluation among criteria.
Table 5. Corresponding fuzzy numbers of the pairwise evaluation among criteria.
CriteriaC1C2C3C4C5C6C7C8C9
C1(0.00, 0.00, 0.25)(0.75, 1.00, 1.00)(0.50, 0.75, 1.00)(0.75, 1.00, 1.00)(0.50, 0.75, 1.00)(0.50, 0.75, 1.00)(0.75, 1.00, 1.00)(0.50, 0.75, 1.00)(0.75, 1.00, 1.00)
C2(0.50, 0.75, 1.00)(0.00, 0.00, 0.25)(0.50, 0.75, 1.00)(0.50, 0.75, 1.00)(0.50, 0.75, 1.00)(0.50, 0.75, 1.00)(0.50, 0.75, 1.00)(0.75, 1.00, 1.00)(0.50, 0.75, 1.00)
C3(0.50, 0.75, 1.00)(0.50, 0.75, 1.00)(0.00, 0.00, 0.25)(0.50, 0.75, 1.00)(0.50, 0.75, 1.00)(0.75, 1.00, 1.00)(0.75, 1.00, 1.00)(0.50, 0.75, 1.00)(0.50, 0.75, 1.00)
C4(0.50, 0.75, 1.00)(0.50, 0.75, 1.00)(0.50, 0.75, 1.00)(0.00, 0.00, 0.25)(0.75, 1.00, 1.00)(0.25, 0.50, 0.75)(0.25, 0.50, 0.75)(0.50, 0.75, 1.00)(0.50, 0.75, 1.00)
C5(0.75, 1.00, 1.00)(0.50, 0.75, 1.00)(0.75, 1.00, 1.00)(0.50, 0.75, 1.00)(0.00, 0.00, 0.25)(0.50, 0.75, 1.00)(0.75, 1.00, 1.00)(0.50, 0.75, 1.00)(0.50, 0.75, 1.00)
C6(0.75, 1.00, 1.00)(0.50, 0.75, 1.00)(0.75, 1.00, 1.00)(0.50, 0.75, 1.00)(0.25, 0.50, 0.75)(0.00, 0.00, 0.25)(0.50, 0.75, 1.00)(0.25, 0.50, 0.75)(0.25, 0.50, 0.75)
C7(0.25, 0.50, 0.75)(0.50, 0.75, 1.00)(0.50, 0.75, 1.00)(0.25, 0.50, 0.75)(0.25, 0.50, 0.75)(0.25, 0.50, 0.75)(0.00, 0.00, 0.25)(0.50, 0.75, 1.00)(0.25, 0.50, 0.75)
C8(0.75, 1.00, 1.00)(0.25, 0.50, 0.75)(0.75, 1.00, 1.00)(0.25, 0.50, 0.75)(0.25, 0.50, 0.75)(0.50, 0.75, 1.00)(0.25, 0.50, 0.75)(0.00, 0.00, 0.25)(0.50, 0.75, 1.00)
C9(0.25, 0.50, 0.75)(0.50, 0.75, 1.00)(0.50, 0.75, 1.00)(0.25, 0.50, 0.75)(0.25, 0.50, 0.75)(0.25, 0.50, 0.75)(0.25, 0.50, 0.75)(0.25, 0.50, 0.75)(0.00, 0.00, 0.25)
Table 6. Aggregated relational impact among criteria in triangular fuzzy numbers representing the direct-influence matrix G .
Table 6. Aggregated relational impact among criteria in triangular fuzzy numbers representing the direct-influence matrix G .
CriteriaC1C2C3C4C5C6C7C8C9
C1(0.00, 0.00, 0.25)(0.71, 0.96, 1.00)(0.67, 0.92, 1.00)(0.63, 0.88, 1.00)(0.58, 0.83, 1.00)(0.63, 0.88, 1.00)(0.75, 1.00, 1.00)(0.63, 0.88, 1.00)(0.71, 0.96, 1.00)
C2(0.63, 0.88, 1.00)(0.00, 0.00, 0.25)(0.50, 0.75, 0.92)(0.63, 0.88, 1.00)(0.58, 0.83, 1.00)(0.54, 0.79, 0.96)(0.54, 0.79, 0.96)(0.67, 0.92, 1.00)(0.71, 0.96, 1.00)
C3(0.67, 0.92, 1.00)(0.67, 0.92, 1.00)(0.00, 0.00, 0.25)(0.58, 0.83, 1.00)(0.63, 0.88, 1.00)(0.38, 0.63, 0.83)(0.46, 0.71, 0.88)(0.58, 0.83, 1.00)(0.63, 0.88, 1.00)
C4(0.50, 0.75, 0.96)(0.67, 0.92, 1.00)(0.50, 0.75, 1.00)(0.00, 0.00, 0.25)(0.71, 0.96, 1.00)(0.33, 0.54, 0.79)(0.29, 0.50, 0.75)(0.54, 0.79, 0.96)(0.58, 0.83, 1.00)
C5(0.71, 0.96, 1.00)(0.58, 0.83, 1.00)(0.67, 0.92, 1.00)(0.54, 0.79, 0.96)(0.00, 0.00, 0.25)(0.33, 0.50, 0.75)(0.71, 0.96, 1.00)(0.54, 0.75, 0.88)(0.58, 0.83, 1.00)
C6(0.67, 0.92, 1.00)(0.50, 0.75, 0.96)(0.50, 0.71, 0.83)(0.42, 0.67, 0.92)(0.29, 0.46, 0.71)(0.00, 0.00, 0.25)(0.63, 0.88, 1.00)(0.42, 0.63, 0.83)(0.42, 0.63, 0.83)
C7(0.42, 0.67, 0.83)(0.63, 0.88, 1.00)(0.63, 0.88, 1.00)(0.54, 0.79, 0.96)(0.42, 0.63, 0.83)(0.42, 0.67, 0.92)(0.00, 0.00, 0.25)(0.54, 0.79, 1.00)(0.58, 0.83, 0.96)
C8(0.75, 1.00, 1.00)(0.50, 0.75, 0.92)(0.75, 1.00, 1.00)(0.58, 0.83, 0.92)(0.42, 0.67, 0.92)(0.42, 0.67, 0.92)(0.33, 0.58, 0.83)(0.00, 0.00, 0.25)(0.58, 0.83, 1.00)
C9(0.42, 0.63, 0.83)(0.63, 0.88, 1.00)(0.54, 0.79, 1.00)(0.50, 0.75, 0.96)(0.42, 0.67, 0.88)(0.33, 0.58, 0.83)(0.46, 0.71, 0.88)(0.54, 0.79, 0.96(0.00, 0.00, 0.25)
Table 7. Normalized direct-influence matrix X .
Table 7. Normalized direct-influence matrix X .
CriteriaC1C2C3C4C5C6C7C8C9
C1(0.00, 0.00, 0.03)(0.09, 0.12, 0.12)(0.08, 0.11, 0.12)(0.08, 0.11, 0.12)(0.07, 0.10, 0.12)(0.08, 0.11, 0.12)(0.09, 0.12, 0.12)(0.08, 0.11, 0.12)(0.09, 0.12, 0.12)
C2(0.08, 0.11, 0.12)(0.00, 0.00, 0.03)(0.06, 0.09, 0.11)(0.08, 0.11, 0.12)(0.07, 0.10, 0.12)(0.07, 0.10, 0.12)(0.07, 0.10, 0.12)(0.08, 0.11, 0.12)(0.09, 0.12, 0.12)
C3(0.08, 0.11, 0.12)(0.08, 0.11, 0.12)(0.00, 0.00, 0.03)(0.07, 0.10, 0.12)(0.08, 0.11, 0.12)(0.05, 0.08, 0.10)(0.06, 0.09, 0.11)(0.07, 0.10, 0.12)(0.08, 0.11, 0.12)
C4(0.06, 0.09, 0.12)(0.08, 0.11, 0.12)(0.06, 0.09, 0.12)(0.00, 0.00, 0.03)(0.09, 0.12, 0.12)(0.04, 0.07, 0.10)(0.04, 0.06, 0.09)(0.07, 0.10, 0.12)(0.07, 0.10, 0.12)
C5(0.09, 0.12, 0.12)(0.07, 0.10, 0.12)(0.08, 0.11, 0.12)(0.07, 0.10, 0.12)(0.00, 0.00, 0.03)(0.04, 0.06, 0.09)(0.09, 0.12, 0.12)(0.07, 0.09, 0.11)(0.07, 0.10, 0.12)
C6(0.08, 0.11, 0.12)(0.06, 0.09, 0.12)(0.06, 0.09, 0.1)(0.05, 0.08, 0.11)(0.04, 0.06, 0.09)(0.00, 0.00, 0.03)(0.08, 0.11, 0.12)(0.05, 0.08, 0.10)(0.05, 0.08, 0.10)
C7(0.05, 0.08, 0.10)(0.08, 0.11, 0.12)(0.08, 0.11, 0.12)(0.07, 0.10, 0.12)(0.05, 0.08, 0.10)(0.05, 0.08, 0.11)(0.00, 0.00, 0.03)(0.07, 0.10, 0.12)(0.07, 0.10, 0.12)
C8(0.09, 0.12, 0.12)(0.06, 0.09, 0.11)(0.09, 0.12, 0.12)(0.07, 0.10, 0.11)(0.05, 0.08, 0.11)(0.05, 0.08, 0.11)(0.04, 0.07, 0.10)(0.00, 0.00, 0.03)(0.07, 0.10, 0.12)
C9(0.05, 0.08, 0.10)(0.08, 0.11, 0.12)(0.07, 0.10, 0.12)(0.06, 0.09, 0.12)(0.05, 0.08, 0.11)(0.04, 0.07, 0.10)(0.06, 0.09, 0.11)(0.07, 0.10, 0.12)(0.00, 0.00, 0.03)
Table 8. Total-influential matrix.
Table 8. Total-influential matrix.
CriteriaC1C2C3C4C5C6C7C8C9
C1(0.10, 0.38, 2.84)(0.18, 0.50, 3.01)(0.17, 0.48, 2.97)(0.16, 0.47, 2.96)(0.15, 0.44, 2.84)(0.14, 0.4, 2.72)(0.17, 0.46, 2.81)(0.16, 0.46, 2.93)(0.18, 0.49, 2.99)
C2(0.16, 0.45, 2.88)(0.09, 0.37, 2.87)(0.15, 0.44, 2.91)(0.15, 0.44, 2.90)(0.14, 0.41, 2.79)(0.13, 0.38, 2.67)(0.14, 0.42, 2.76)(0.16, 0.45, 2.88)(0.17, 0.47, 2.93)
C3(0.16, 0.45, 2.84)(0.16, 0.46, 2.92)(0.08, 0.35, 2.80)(0.15, 0.43, 2.87)(0.15, 0.41, 2.75)(0.11, 0.35, 2.62)(0.13, 0.40, 2.72)(0.15, 0.43, 2.84)(0.16, 0.45, 2.90)
C4(0.13, 0.41, 2.76)(0.15, 0.43, 2.84)(0.13, 0.41, 2.80)(0.07, 0.31, 2.70)(0.15, 0.40, 2.68)(0.10, 0.32, 2.54)(0.10, 0.36, 2.63)(0.14, 0.40, 2.76)(0.15, 0.42, 2.82)
C5(0.17, 0.45, 2.8)(0.16, 0.45, 2.88)(0.16, 0.45, 2.84)(0.14, 0.42, 2.82)(0.08, 0.31, 2.63)(0.10, 0.34, 2.58)(0.16, 0.43, 2.69)(0.14, 0.42, 2.79)(0.15, 0.45, 2.86)
C6(0.15, 0.4, 2.64)(0.13, 0.39, 2.71)(0.13, 0.38, 2.66)(0.12, 0.37, 2.66)(0.10, 0.33, 2.53)(0.05, 0.24, 2.37)(0.13, 0.38, 2.54)(0.12, 0.36, 2.63)(0.12, 0.38, 2.67)
C7(0.13, 0.4, 2.75)(0.15, 0.43, 2.85)(0.15, 0.42, 2.81)(0.13, 0.40, 2.79)(0.12, 0.37, 2.67)(0.10, 0.34, 2.57)(0.07, 0.30, 2.58)(0.14, 0.40, 2.77)(0.15, 0.42, 2.82)
C8(0.17, 0.45, 2.77)(0.14, 0.43, 2.84)(0.17, 0.45, 2.81)(0.14, 0.42, 2.79)(0.12, 0.38, 2.68)(0.11, 0.35, 2.57)(0.11, 0.38, 2.65)(0.08, 0.32, 2.69)(0.15, 0.44, 2.83)
C9(0.12, 0.38, 2.70)(0.14, 0.42, 2.79)(0.13, 0.4, 2.76)(0.13, 0.38, 2.74)(0.11, 0.36, 2.62)(0.09, 0.32, 2.51)(0.12, 0.36, 2.60)(0.13, 0.39, 2.72)(0.07, 0.31, 2.69)
Table 9. Defuzzified total influential matrix.
Table 9. Defuzzified total influential matrix.
CriteriaC1C2C3C4C5C6C7C8C9
C10.921.051.031.010.970.910.981.011.04
C20.990.920.990.990.940.890.930.981.01
C30.971.000.900.970.930.860.910.960.99
C40.930.960.940.850.910.820.860.920.95
C50.970.980.980.950.830.840.920.940.98
C60.900.910.890.880.820.730.860.870.89
C70.910.970.950.930.880.840.810.930.95
C80.960.960.970.940.890.840.880.850.96
C90.900.940.920.910.860.810.860.910.85
Table 10. Influences given (and received) by (and on) each criterion.
Table 10. Influences given (and received) by (and on) each criterion.
Criteria r s r s r + s Cluster
C18.458.91−0.4617.36Effect
C28.708.630.0617.33Causal
C38.558.490.0617.05Causal
C48.438.140.2916.57Causal
C58.028.40−0.3816.42Effect
C67.537.73−0.2015.26Effect
C78.018.17−0.1616.19Effect
C88.378.260.1216.63Causal
C98.617.950.6616.56Causal
Table 11. Best-to-others fuzzy reference comparisons.
Table 11. Best-to-others fuzzy reference comparisons.
CriteriaC1C2C3C4C5C6C7C8C9
C1VIEIVIVIVIEIEIEIVHI
C2AIEIAIFIFIAIAIAIHI
C3AIEIEIEIEIEIEIEIHI
C4VIEIAIAIVIEIVIVIHI
C5VIVIVIVIVIWIWIVIHI
C6VIVIVIVIVIVIVIVILI
C7LIHIHILILILINIHILI
C8VHILIVHILILIHILINIHI
C9LIHIHILILILILILINI
Table 12. Others-to-best fuzzy reference comparisons.
Table 12. Others-to-best fuzzy reference comparisons.
CriteriaC1C2C3C4C5C6C7C8C9
C1FIFIVIEIWIFIFIFIVI
C2FIFIVIEIWIFIFIFIVI
C3FIFIVIFIWIFIFIFIVI
C4FIEIVIEIWIFIFIEIVI
C5FIVIVIFIWIFIFIVIVI
C6FIFIVIFIWIFIFIFIVI
C7FIVIVIFIEIFIFIVIVI
C8FIFIVIFIWIFIFIFIVI
C9FIFIVIEIWIFIFIFIVI
Table 13. Fuzzy optimal weights.
Table 13. Fuzzy optimal weights.
Criterialmu
C10.10643580.10643580.1064358
C20.05913100.05913100.0591310
C30.05913100.05913100.0591310
C40.17088690.22784920.2660894
C50.10643580.11392460.1139246
C60.05913100.05913100.0591310
C70.10643580.11392460.1139246
C80.13304470.13304470.1330447
C90.13304470.13304470.1330447
Table 14. Crisp optimal weights.
Table 14. Crisp optimal weights.
CriteriaWeights
C10.10644
C20.05913
C30.05913
C40.22473
C50.11268
C60.05913
C70.11268
C80.13304
C90.13304
Table 15. Aggregated weights of criteria.
Table 15. Aggregated weights of criteria.
CriteriaWeights
C10.1022
C20.0994
C30.1436
C40.1112
C50.0836
C60.1232
C70.1198
C80.1130
C90.1197
Table 16. Consistency ratio of each decision-makers evaluation.
Table 16. Consistency ratio of each decision-makers evaluation.
ExpertBest-WorstRatingCI ξ * ˜ CR
1C2-C5FI5.29000.55050.1041
2C2-C4AI8.04002.00000.2488
3C1-C5EI3.00001.76390.5880
4C3-C9VI6.69001.00000.1495
5C4-C7VI6.69001.00000.1495
6C2-C9VI6.69001.40620.2102
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Bongo, M.F.; Seva, R.R. Evaluating the Performance-Shaping Factors of Air Traffic Controllers Using Fuzzy DEMATEL and Fuzzy BWM Approach. Aerospace 2023, 10, 252. https://doi.org/10.3390/aerospace10030252

AMA Style

Bongo MF, Seva RR. Evaluating the Performance-Shaping Factors of Air Traffic Controllers Using Fuzzy DEMATEL and Fuzzy BWM Approach. Aerospace. 2023; 10(3):252. https://doi.org/10.3390/aerospace10030252

Chicago/Turabian Style

Bongo, Miriam F., and Rosemary R. Seva. 2023. "Evaluating the Performance-Shaping Factors of Air Traffic Controllers Using Fuzzy DEMATEL and Fuzzy BWM Approach" Aerospace 10, no. 3: 252. https://doi.org/10.3390/aerospace10030252

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop