Next Article in Journal
Set-Based Group Search Optimizer for Stochastic Many-Objective Optimal Power Flow
Next Article in Special Issue
Effects of Fatigue and Tension on the Physical Characteristics and Abilities of Young Air Traffic Controllers
Previous Article in Journal
Bioremediation of Oil Contaminated Soil and Restoration of Land Historically Polluted with Oil Products in the Agricultural Circuit in the Plain and Western Hills, Romania
Previous Article in Special Issue
Comparing Response Behaviors to System-Limit and System-Malfunction Failures with Four Levels of Operational Proficiency
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Core Competency Quantitative Evaluation of Air Traffic Controller in Multi-Post Mode

1
College of Civil Aviation, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China
2
Zhejiang Air Traffic Management Sub-Branch, Civil Aviation Administration of China, Hangzhou 311207, China
*
Author to whom correspondence should be addressed.
Appl. Sci. 2023, 13(18), 10246; https://doi.org/10.3390/app131810246
Submission received: 2 August 2023 / Revised: 7 September 2023 / Accepted: 11 September 2023 / Published: 12 September 2023
(This article belongs to the Special Issue Ergonomics and Human Factors in Transportation Systems)

Abstract

:
In order to quantify the core competency of air traffic controllers (ATCO) in multi-post mode, and analyze the ATCO competency-post fit (CPF) degree, this paper proposes the AFE-TOPSIS evaluation method based on the analytic hierarchy process (AHP), factor analysis (FA), and entropy weight method (EWM). Through the analysis of job tasks, it preliminarily develops an evaluation index library of ATCO core competency. Then, it constructs an improved adaptive multi-dimension core competency model divided into four types of post modes. It proposes a method for determining the combined weight of core competency indexes, where the weights are determined subjectively through AHP, combined with the objective method of FA and EWM. Furthermore, it constructs a comprehensive evaluation model based on AFE-TOPSIS and analyzes the CPF degree by calculating the relative closeness degree of each evaluation index. The empirical analysis results show that the four types of core competency models in General, TWR, APP, and ACC post mode include seven dimensions, such as situation awareness, and workload management, which are also graded into the pyramid hierarchical structure of basic, advanced, and high-level. The calculation of the ATCO CPF degree based on the proposed AFE-TOPSIS method can scientifically assist in the fit of ATCO and multi-post mode.

1. Introduction

With the rapid development of air transportation, the safety of air traffic operation has been put forward very high requirements. Air traffic management (ATM) has the characteristics of high strength, high risk, and high load. The ability level of air traffic controllers (ATCO) is one of the most essential and complex factors [1]. How to make a practical qualitative and quantitative evaluation of the ATCOs’ ability and quality, accurately find out the unfavorable factors affecting the safety of air traffic operation, and make effective adjustments in time to avoid the risk of ATM operation, and rationally allocate team resources are the fundamental theoretical and practical problems that need to be studied and analyzed in the field of aviation human factors [2]. Establishing a scientific and reasonable quantitative evaluation method for the ability and quality of ATCOs, grasping the performance and development trend of their working ability and working status, and adjusting the allocation of team resources in time will help the dynamic improvement of the ability and quality of controllers. It is significant to improve the safety efficiency of control operation, expand air traffic flow, and ensure flight safety. In this paper, the main objective of the scientific study is to achieve multiple classifications and construct an assessment model of ATCO ability, then quantify the ATCO ability in multi-post mode, and finally analyze the fit degree of ATCO between ability and post quantitatively.
Based on this, domestic and foreign scholars have gradually deepened the research on the evaluation of ATCOs’ ability, extending from the concept of “skill” to the level of “competency” [3], and successively researched the ATCO competency evaluation model, combined with relevant business scenarios, taking the qualitative and quantitative analysis of ATCOs’ ability, professional level, and knowledge application [4]. In 2005, by referring to the internationally accepted research methods of competency framework for professional management and technical personnel [5,6], Oprins Esther et al., developed an initial ATCO competency framework [7] for capacity assessment and job training [8]. The International Civil Aviation Organization (ICAO), the Federal Aviation Administration (FAA), and the European Organization for the Safety of Air Navigation (EUROCONTROL) have also researched the competency characteristics of ATCOs and applied them to training and evaluation, etc. [9]. In 2016, based on the research of Oprins Esther et al., ICAO updated the “Training Manual” (ICAO DOC 9868) [10], through extensive questionnaire survey and analysis, proposed a relatively complete ATCO competency framework, and initially introduced the competency characteristics and performance behavior indexes. Based on the competency framework, Tímea Vas conducted research and application of training for military ATCOs [11]. At the same time, the FAA issued a “Control Job Training Teaching/Evaluation Manual” [12], described the competency of controllers, and proposed 23 secondary indexes from 6 dimensions. Vuckovic et al. [13] proposed 15 secondary indexes from 3 dimensions of individual, organization, and psychology around the ability assessment of controllers. Although a relatively mature ATCO competency framework has been formed abroad, it does not directly apply to China’s national conditions and ATM status quo. Because the framework does not address the specific definition of duties, sharing of tasks, ratings, and proficiency levels existing in the organization, which should be adapted to the local context of the organization and the professional experience of ATCOs [10]. It is necessary to design a special adaptive model according to the specific situation within the organization, otherwise, the application effect will not be ideal. At the same time, there are some differences in the operating environment, regulations and standards, facilities and equipment, management concepts, and other aspects between Chinese and foreign air traffic control units, some indexes do not match or apply to China’s actual job requirements, and related indexes cannot obtain data support and cannot be quantified. Relevant models must be adapted and localized based on the organizational context.
In 2007, Nuo Xu [14] started research on the competency theory of domestic controllers and put forward 20 competency characteristics of ATCOs through survey data and statistical analysis. Ruishan Sun [15] and Jingqiang Li [16] constructed the explanatory structure model of the ATCO competency, studied the internal structure and connection of the competency model and the influence of its elements on the system, and determined the weight distribution of the indexes according to the centrality and importance ranking [17]. Saiping Liu [18] used Analytic Hierarchy Process (AHP) to establish the competency model of trainee ATCOs; Li Jianqiao [19] constructed the competency model of controller leader and determined the weight of each dimension subjectively according to experience. Longfang Mou [20] used the Entropy method to assign the ATCOs’ quality factors, which is more objective and fair than the traditional empirical value method and easy to operate. Xiaofeng Bian [21] conducted a questionnaire survey on the content of the competency framework, used the expert survey method to determine the weight of the 10 elements in groups, and obtained the ranking of competency elements to guide the training of controllers. Some domestic scholars have put forward the framework of the ATCOs’ ability and quality or the core competency at the theoretical level. However, based on the competency theory, the system construction of the ATCOs’ competency evaluation model in line with the actual ATM in China is still lacking, which is one of the urgent problems that should be solved in the current ATM.
From the perspective of qualitative analysis, the above research mainly puts forward the general competency framework, competency feature element library, and evaluation index model. There needs to be more research on the competency of controllers in specific jobs and situational conditions, and the descriptive, quantifiable, measurable degree of the ATCO competency evaluation index needs to be higher. With the increasing complexity of the air traffic control production and operation environment, the multi-post mode shows obvious diversity of job characteristics; that is, there are differences in the scope of responsibilities, knowledge level, work experience, work intensity, environmental conditions, job requirements and other aspects between the general post and the professional posts such as tower, approach, and area. The multi-post mode classification and grading competency model for fine management must be studied. At the same time, the competency evaluation model’s scientificity, universality, and practicability must also be further verified and optimized. Some scholars have studied the weight of the evaluation index based on the subjective or objective method, and the scientific and reasonable weighting method of the evaluation index system needs further study. At the same time, the application of competency-based evaluation needs to be improved. Therefore, the research questions of this paper mainly include classifying and establishing a multi-dimensional core competency index system, scientifically determining the weight of competency indexes, and finely measuring the competency-post fit degree of ATCOs. The exploration of relevant theories and methods has been carried out around these issues. This paper carries out the task analysis of the multi-post mode [22,23] and studies the core competency most related to professional competency. Focusing on the current ATM production and operation practice, based on the ICAO competency framework, this paper proposes an improved adaptive multi-dimensional core competency model for the multi-post mode’s diversity and convergence characteristics. Moreover, it establishes a general classification and grading model for various professional posts, which can assist in enhancing the universality and practicability of the model and apply it to the decision-making of post-adaptation.
The core competency quantitative evaluation mainly focuses on model construction, index weighting, and model application. This paper carries out quantitative evaluation and verification according to the technical route of “analysis of core competency characteristic elements, construction of core competency model of multi-post mode, determination of dimension index weight, competency measurement of benchmark population, and evaluation of competency-post fit degree”. It shows the research framework in Figure 1, and the specific research content includes the following three parts.
(1)
The first part is constructing an improved adaptive multi-dimensional core competency model. Based on literature analysis, expert interview, and work analysis, this paper summarizes ATCOs’ core competency index library according to the characteristics, operation environment, and operation rules of posts. It carries out the ATCOs’ core competency questionnaire and data analysis to analyze the effective indexes by verifying the structural model. Then it establishes the content and structure of localized multi-dimensional core competency evaluation index according to the local organizational context and constructs the multi-dimensional core competency model of general and professional posts by classification.
(2)
The second part proposes a combination weighting method of the ATCO core competency index. Aiming to combine subjective and objective weighting methods based on AHP, FA, and EWM, it proposes the AHP-FA-EWM (AFE) method to determine the weight coefficient of each dimension and secondary indexes of the core competency model.
(3)
The third part proposes a calculation method of competency-post fit degree based on the AFE weighting method and the distance method of superior and inferior solution (AFE-TOPSIS). According to combined index weights, it puts ATCOs’ core competency evaluation results into the four types of models constructed above and then calculates the fit degree between the core competency index value of each controller and the post requirements based on AFE-TOPSIS.
This paper opens up a new perspective of core competency classification research, expands the application scope of core competency theory in the field of ATM, and puts forward an ATCO core competency evaluation and analysis method based on multi-post mode, which can provide a new auxiliary decision-making basis for ATCO ability evaluation, competency-post fit and fine management of human resources.

2. Construction of Improved Adaptive Multi-Dimensional Core Competency Model

2.1. The Concept of ATCO Core Competency

Competency originated from the article “Testing for competency rather than for intelligence” published by American psychologist David C. McClelland in 1973. McClelland laid out some fundamental theories and techniques of competency research [3] and proposed the classic competency “iceberg model”, which mainly includes knowledge, skills, and attitudes, referred to as the “KSA” model [8]. After decades of development, the concept definition of competency theory has been continuously updated from its introduction to its application in the field of air traffic control. ATCO competency refers to the individual characteristics that can be objectively measured and the resulting predictable and performance-oriented behavioral characteristics of the excellent performers in a specific job position, organizational environment, and cultural atmosphere. It is an aspect of personnel performance and can be used to predict successful performance in the work reliably. The core competency of controllers describes how to effectively carry out work and a set of related behavioral abilities based on job requirements for skilled skill performance.

2.2. Construction of Improved Adaptive ATCO Core Competency Index System

The ATCO competency framework proposed by ICAO, from knowledge, skills, and attitudes, puts forward ten competency dimensions, such as situational awareness, traffic and capacity management, separation, and conflict resolution, and lists relevant performance behavior measurement indexes. The content is relatively comprehensive, covering the technical and non-technical capabilities required by the general posts, and is suitable for guiding training and evaluation [10]. However, it does not make adaptive analysis and classification of specific jobs and specific situational conditions. At the same time, it needs the weight coefficient reflecting the importance of dimension indexes, which could be more convenient for the classification and classification application in the actual core competency model. Therefore, based on the ATCO competency framework, combined with the localized operating environment, operating rules, job characteristics, etc., this paper analyzes, extracts, and supplements the dimensions indexes in the competency framework according to the job requirements, constructs an improved adaptive ATCO core competency index system, and it scientifically empowers the dimension indexes.
Based on summarizing a large number of domestic and foreign literature, combined with job task analysis, referring to the ATM task model [24], according to the controller competency analysis process shown in Figure 2, this paper analyzes the requirements of various control jobs and sorts out the knowledge, skills, attitudes and other factors required by controllers. Through mathematical statistics technology, this paper extracts the key characteristics that affect the ATCO competency in each control seat, such as business ability, work experience, personal characteristics, etc., combined with expert interview opinions, summarizes the quality dictionary of ATCO core competency, and preliminarily formulates the evaluation dimension and secondary evaluation index database of ATCO core competency. Based on the field investigation of an air traffic control unit, the Delphi expert evaluation method is used to consult the control expert team composed of control instructors, senior controllers, business leaders, business managers, and experts from scientific research institutes. The evaluation dimension and the content of the secondary indexes are further improved, and it finally constructs the localized and adaptive primary indexes of the ATCO core competency, as shown in Table 1. The secondary indexes’ observable behavior description and measurable behavior data are studied and discussed for the quantitative evaluation of ATCO competency. According to the primary indexes in Table 1, this paper designs and compiles a questionnaire on the adapted ATCO core competency index system. Through the empirical analysis of the questionnaire data, it extracts the localization and adaptability indexes, further explores the index system, and verifies the structural model, and finally constructs the adapted multi-dimensional core competency model.

2.3. Classification and Grading of the Core Competency Model in Multi-Post Mode

In order to realize the adaptability and practicability of the ATCO competency model, based on the specific job and situational condition, as well as the diversity of controllers’ job tasks, the core competency model must be further classified and graded. This paper proposes the General post model of ATCO core competency, suitable for all business leaders, managers, controllers, trainees, etc. At the same time, it proposes three professional post models of ATCO core competency, which are respectively suitable for tower control unit (TWR), approach control unit (APP), and area control center (ACC) controllers. The above General, TWR, APP, and ACC post model of ATCO core competency are useful the further refined analysis.
Through the job analysis method in human resource management, this paper researches and establishes the ATCO job analysis model. ATM usually includes air traffic flow management, airspace management, alarm service, flight information service, and air traffic control service. TWR, APP, and ACC are the essential ATM service posts, their job responsibilities and work priorities are different, and the requirements for controllers’ competencies are also different. The specific core competency requirements of each post are shown in Table 2.
(1)
Compared to front-line personnel posts, general posts are mainly engaged in management work, teaching and training work related to air traffic management business, including unit leaders, business managers and researchers, teaching staff, training staff, and so on.
(2)
The most essential ability that TWR controllers should have is to assist the flight crew in dealing with emergencies and unusual situations in a stable and unhurried manner. The most significant core competency indexes required are x22 and x23.
(3)
The most important thing for the APP controller is to have accurate conflict allocation ability. Whether it is the accuracy of heading guidance, the rationality of speed adjustment, or the ability to grasp the timing of turning, they must firmly grasp the conflict relief ability. The most significant core competency demand indexes are x11, x12, x13, x14, x15, and x16.
(4)
The most crucial ability of ACC controllers is to avoid unsafe incidents caused by human factors, to detect potential flight conflicts as soon as possible or in time, and to deal with them in time. The most significant core competency demand indexes are x11, x12, x13, x14, x24, and x25.
The evaluation index system set of the ATCO core competency constructed in the final study is A = ( x 1 , x 2 , , x m ) , where xi (i = 1, 2, …, m) indicates the competency evaluation index element, m indicates the total number of evaluation indexes; the core competency dimension set is F = ( F 1 , F 2 , , F n ) , where F j ( i = 1 , 2 , n ) represents the secondary index set of the extracted factors, and n represents the total number of factors (dimensions). Therefore, based on analyzing the multi-post mode’s specific situational conditions and competency needs, it constructs the evaluation index set of ATCO core competency by classification and graded as General, TWR, APP, and ACC models.
Overall, after the comprehensive training, ATCOs must meet the most significant core competency needs of General, TWR, APP, and ACC posts before they have the basic conditions of core competency for such posts. Only after reaching the qualification standards, psychological quality, and physical quality of the specific post, then ATCOs can work in this post after passing the post examination.

3. The Combination Weighting Method of Core Competency Evaluation Index Based on AHP-FA-EWM

The weighting methods of evaluation indexes usually divide subjective and objective weighting. The subjective weighting methods, including expert evaluation method, AHP, etc., are simple but strongly affected by the human factor; objective weighting methods, including correlation coefficient method, FA, and EWM, are not affected by human factors but mainly depend on data samples. Both methods will have the loss of information. The combination weighting method can minimize the loss of information and make the weighting results as close as possible to the actual situation [25]. Therefore, this paper proposes a combination weighting method of multi-dimensional evaluation index for the ATCO core competency based on the combination of the AHP-FA-EWM (AFE) method.

3.1. Index Weight Determination by AHP Method

The AHP method is mainly used to study the calculation of expert scoring weights. First, it must construct a judgment matrix, and then take a consistency test [26,27]. Based on the dimension and secondary index obtained by exploratory factor analysis (EFA) and confirmatory factor analysis (CFA), this paper calculates the average value of each questionnaire item, in which the more significant the average value, the higher the importance and weight of the index. Then, it constructs the order judgment matrix by dividing the average value, calculates the weight of each index, and obtains the subjective weight vector of the ATCO core competency evaluation index as v i .
Finally, it carries out the consistency test of the m evaluation indexes. Calculating the index C I for judging the consistency of matrix deviation, as follows:
C I = λ max m m 1
By finding the consistent average random consistency index R I , calculating the random consistency ratio C R as follows:
C R = C I R I
If C R < 0.1 , the constructed judgment matrix satisfies the consistency test, so the calculated weights are consistent [28].

3.2. Index Weight Determination by FA-EWM Method

Compared with the AHP, FA, and EWM are objective weighting methods. Among them, the FA method can use a few common factors to reflect most of the sub-information of the original data and reveal the correlation between the indexes [29]. The EWM combines the information value provided by the entropy value to determine the weight, which can reduce the instability judged by subjective experience [30,31]. Analyzing the effective data of the questionnaire survey, it uses the FA-EWM method to correct the index weight obtained by the AHP, calculate the relative total target weight of the dimension and the secondary index, and construct the index weight system.

3.2.1. Determining the Weight of Dimension Index by the FA Method

The FA method is based on the principle of information concentration of data, and a few common factors are obtained from the dimension reduction of the index, and the weight is calculated by using the index variance interpretation rate. Firstly, the variance interpretation rate after the rotation of the factor is calculated, and then the cumulative contribution rate of the variance interpretation rate after the rotation of each common factor is obtained. After normalization, the weight of each factor can be obtained as follows:
ρ j = V j j = 1 n V j

3.2.2. Determining the Weight of the Secondary Index by the EWM

First of all, the data in the original score table are standardized, and the calculation method is as shown in Equation (4), where Q represents the sample data set, q is the number of samples, t is one of the samples, max ( x i ) = max t Q x t i , min ( x i ) = min t Q x t i , y t i represents the value of the corresponding element x t i after standardization.
y t i = x t i min ( x i ) max ( x i ) min ( x i )
Based on the standardized score table, according to the calculation formula of information entropy (5), the information entropy of each index E i is calculated to represent the entropy value of the evaluation index i .
E i = ln ( q ) 1 t = 1 q f t i ln f t i
Among them, the calculation formula for each element f t i in the probability matrix is as follows:
f t i = y t i t = 1 q y t i
Generally, the smaller the information entropy of the index is, the greater the difference between different individuals is, and the more information is provided, so the role of the index in the comprehensive evaluation is greater, and the corresponding weight is greater. On the contrary, when the information entropy of the index is larger, it means that the degree of difference between different individuals is smaller, and the amount of information provided is less, so the role in the comprehensive evaluation is smaller, and the corresponding weight is smaller.
The calculation formula for determining the index weight according to the entropy value is as follows:
u i = 1 E i m i = 1 m E i
Combined with the above FA, the weight of each factor (dimension) to the target layer ρ j can be calculated by using the factor load coefficient. According to Equation (7), the weight of the measurement item (secondary index) to the factor u i is calculated; by multiplying the two, the weight of the secondary index to the target layer is obtained as follows:
w i = ρ j u i

3.3. Combination Weighting Method Based on AFE

Because a single decision-making statistical method may have a large decision-making deviation, the reasonable combination of subjective weight and objective weight of decision attributes is the key problem of multi-attribute decision-making. Therefore, in order to realize the rigorous and scientific index weight as far as possible, this paper proposes a combination weight method based on AHP, FA, and EWM, using the AHP, FA, and EWM to obtain the subjective and objective basic weights of each evaluation index respectively, which integrates subjective and objective weight methods according to the principle of “minimum information discrimination”. It adopts the theory of “minimum information discrimination” as the optimization goal to calculate the combination weight. This method not only takes into account the subjective preferences of decision-makers, but also takes into account the objectivity of actual quantitative characteristics, and the calculation results are more scientific.
Among them, the principle of “minimum information discrimination” means that when the decision maker only grasps the prior probability distribution or some statistical information, the minimum discriminant information of the prior distribution and the target distribution is used as the objective function to integrate and analyze the existing statistical data, so that the target distribution is the closest to the probability distribution under various constraints, so as to judge the overall distribution law. Usually, the discriminant information is used to measure the difference between the two distributions, the distance between the two distributions should be minimized as much as possible [32].
This paper proposes the AHP-FA-EWM (AFE) weighting method based on the principle of “minimum information discrimination”, which is more scientific and objective than the single use of the subjective weighting method or objective weighting method.
The index weight obtained by AHP is v i , and the index weight obtained by the FA and EWM is w i , the combined weight of the index ξ i should be as close as possible to the weighted sum. The calculation formula is as follows:
ξ i = v i w i i = 1 m v i w i
Combined with the weight data of the above AHP, FA, and EWM, the combined weight of each evaluation index of the ATCO core competency ξ i is calculated by Equation (9).

4. The Calculation Method of the ATCO CPF Degree Based on AFE-TOPSIS

In order to carry out the quantitative evaluation of the ATCO core competency, the matching index system between the ability and the job requirements is established based on the multi-dimensional core competency evaluation model. Based on the combination weighting of the multi-post mode evaluation index, this paper proposes a method to calculate the proximity of the ATCO ability to the optimal scheme of the job requirements based on the AFE-TOPSIS, and then reflect the fit degree between the ability and the job requirement. The TOPSIS is a multi-index evaluation and decision-making method, which is mainly used to evaluate the relative advantages and disadvantages of existing objects, and the relative closeness between the object, and the optimal scheme can be obtained [33,34]. Based on the pros and cons solution distance method, the core competency fit degree evaluation steps [35] are as follows:
Step 1: Based on the adapted multi-dimensional core competency model, the data values of each core competency matching index are calculated through expert scoring evaluation. The original decision matrix X of the ATCO core competency is obtained, as shown in Equation (10). Among them, P represents the sample data set, m represents the total number of evaluation indexes, and x p i represents the p ATCO’s value of the secondary evaluation index i .
X = x 1 1 x 1 2 x 1 m x p 1 x p 2 x p m
Step 2: Standardize the original decision matrix, and mark the dimensionless decision matrix as X , as follows:
X = ( x p i ) p = 1 , 2 , , P , i = 1 , 2 , m
x p i represents the normalized value of the corresponding element x p i , where max ( x i ) = max p P x p i , min ( x i ) = min p P x p i , is as follows:
x p i = x p i min ( x i ) max ( x i ) min ( x i )
Step 3: Copy p copies of the combined weight vector ξ obtained in the above model construction process to construct the weight vector matrix W of all controllers, as shown in Equation (13); it is normalized and weighted with the dimensionless evaluation matrix X of controller, as shown in Equation (14), the normalized judgment matrix is multiplied by the corresponding term of the weight matrix to obtain the weighted standardized evaluation matrix Z , as shown in Equation (15).
W = ξ 1 ξ 2 ξ m ξ 1 ξ i ξ 1 ξ 2 ξ m
Z = W × X = z p i P × m
Z = ξ 1 · x 1 1 ξ 2 · x 1 2 ξ m · x 1 m ξ 1 · x p 1 ξ i · x p i ξ 1 · x P 1 ξ 2 · x P 2 ξ m · x P m
Step 4: Calculate the positive ideal value and the negative ideal value of each evaluation index. The calculation formulas are as follows:
z i + = max p P z p i
z i = min p P z p i
The positive and negative ideal schemes are obtained, and the maximum value is defined as follows:
Z + = ( z 1 + , z 2 + , , z i + )
Similarly, define the minimum value as follows:
Z = ( z 1 , z 2 , , z i )
Step 5: Calculate the relative closeness of each controller’s core competency in the collective. According to the positive and negative ideal values of the ATCO core competency evaluation, the Euclidean distance between the core competency evaluation of each controller and the positive and negative ideal values is calculated.
Among them, the Euclidean distance s p + between the ATCO competency evaluation and the positive ideal value and the Euclidean distance s p between the ATCO competency evaluation and the negative ideal value are as follows:
s p + = i = 1 m ( z p i z i + ) 2
s p = i = 1 m ( z p i z i ) 2
After obtaining the Euclidean distance between the core competency evaluation of each controller and the positive and negative ideal values, the relative closeness of each controller is calculated based on this, which indicates the CPF degree between the controller’s ability and the post requirements. Among them, the controller’s relative closeness C p calculation formula is:
C p = S p S p + + S p
Moreover C p [ 0 , 1 ] , the larger the value, the higher the fit degree between the ATCO core competency and the post requirement; on the contrary, it means that the fit degree with the post is low.

5. Example Verification and Analysis

5.1. Core Competency Questionnaire Preparation and Research

Based on literature analysis and ATM expert advice, combined with the analysis of job tasks, based on the study that the primary indexes are appropriate, combined with Table 1, a survey questionnaire on the adapted ATCO multi-dimensional core competency index system is compiled. The first part of the questionnaire is the basic information about the personnel, including the job position, qualification level, position, and so on. In the second part of the questionnaire, a revised Likert scale was developed. The respondents score the importance of the indexes. The scoring range of each item was 1–5, which is expressed as “very unimportant”, “unimportant”, “general”, “important”, and “very important”. The questionnaire contains 31 evaluation index items of the ATCO core competency and sets up an open short-answer question, which can be used for index integrity and additional suggestions.
The questionnaire is aimed at the on-the-job ATCOs and related business leaders and assistants of an air traffic control unit in China. A total of 1203 questionnaires were distributed through We Chat, web pages, and paper forms, and the integrity and authenticity of the answers were tested. The questionnaires with an obvious tendency to answer and all the same answer data for each item were deleted. A total of 978 valid questionnaires are counted, and the effective questionnaire rate is 81.30%. SPSS 26.0 software was used to analyze and process the data of the effective questionnaire, and the average score of each index was calculated.

5.2. Questionnaire Data Analysis

The frequency analysis of 978 valid questionnaires is shown in Table 3. The data statistics show that the number of frontline controllers on jobs such as TWR, APP, and ACC has reached 82.11%, and the number of mature controllers of third-level controllers and above has reached 64.62%. Firstly, this paper studies and analyzes the General model of the comprehensive samples of 978 questionnaires, and then uses the same method to study and analyze the professional post model of the individual samples about TWR, APP, and ACC posts, respectively, for exploring the evolution law of the multi-dimensional core competency model about multi-post mode.

5.2.1. Project Analysis

In order to verify the feasibility and reliability of the questionnaire items, SPSS 26.0 software is used to analyze the items of the answer scale, the total score of the questionnaire, and the score of each item are analyzed by correlation analysis to test the discrimination of each item. The total score of each item is calculated, through the critical ratio value method, thirty-one items are selected as the first 27% and the last 27% of the test questionnaires. Two groups are used as controls for the independent sample t-test. The critical ratio (CR) of each item and the significant difference value of each item are calculated, which are less than 0.05, showing the significance of the items. All thirty-one items have good discrimination, no invalid items, and no deletion is required.

5.2.2. Reliability Analysis

Reliability analysis is usually used to study the reliability and accuracy of the questionnaire. After the SPSS 26.0 software calculation, the reliability coefficient value is 0.965, which is greater than 0.9, indicating that the reliability quality of the questionnaire data is high. For the “item deleted α coefficient”, if any item is deleted, the reliability coefficient will not be significantly improved, indicating that any item does not need to be deleted, and thirty-one index elements are proposed for further research and analysis.

5.2.3. Validity Analysis

Validity analysis is usually used to study the rationality and scientificity of the questionnaire items. Exploratory factor analysis (EFA) is used to test the validity of the questionnaire data through a comprehensive analysis of statistical indexes such as KMO (Kaiser-Meyer-Olkin) value, commonality, variance interpretation rate, and factor load coefficient. The KMO value is used to judge the suitability of information extraction, the common degree value is used to exclude unreasonable research items, the variance interpretation rate value is used to explain the level of information extraction, and the factor load coefficient is used to measure the correspondence between factors (dimensions) and measurement items (secondary indexes).
From the perspective of professional analysis, the EFA method initially sets the factor number to eight and analyzes thirty-one core competency evaluation index items. The measurement relationship indexes between the three measurement items of “x6 keep aircraft identification”, “x7 manage the traffic situation”, “x17 air traffic control experience” and other factors are not good, so the three items should be deleted. After deletion, the number of factors is set to seven again. For the analysis of 27 index items, the common degree values corresponding to all items are higher than 0.4, and there is no need to delete any item. KMO and Bartlett sphericity tests are performed: the KMO value is 0.910, greater than 0.6, indicating that the data can be effectively extracted information. The sphericity test value is 0, less than 0.05, and the seven factors are judged to be suitable for factor analysis. In addition, the absolute value of the factor loading coefficient is greater than 0.4, and the corresponding relationship between seven factors and 28 items is confirmed, which is consistent with the expectation and does not need to be adjusted. The variance interpretation rates of the seven factors are 16.453%, 13.019%, 10.888%, 10.751%, 10.535%, 8.917%, and 6.038%, respectively. The cumulative variance interpretation rate after rotation is 76.601% > 50%, It shows that the questionnaire data has high construct validity.
Finally, the seven factors (dimensions) extracted are named as follows: F1 Separation and conflict resolution(SCR), F2 Situational awareness(SAW), F3 Communication and coordination(CCO), F4 Self-management(SFM), F5 Workload management(WLM), F6 Traffic and capacity management(TCM), F7 Non-routine situations management(NRS). Thus, the General model of the ATCO core competency index system is constructed as shown in Figure 3, including seven dimensions and 28 secondary indexes.

5.2.4. Confirmatory Factor Analysis

Based on the results of the index system selection of the above EFA method, in order to test the structural validity of the model, AMOS 26.0 software is used for confirmatory factor analysis (CFA). CFA can be used for aggregation validity, fitting validity, and discriminant validity analysis. For the samples collected from 978 questionnaires, the fitting results of the general model are shown in Table 4. The results of relevant indexes meet the goodness requirements of the fit standard, and the overall fitting degree of the model is good, indicating that the model construction of the ATCO core competency index is reasonable.
In summary, the structural validity and discriminant validity of the ATCO core competency index system are good, and the verified structural model is shown in Figure 4.

5.2.5. The Classification and Grading Construction of the Adapted ATCO Core Competency Model

Using the above EFA and CFA methods, the adapted ATCO core competency model is classified into four categories: General post, TWR post, APP post, and ACC post model. The index system is shown in Table 5.
(1)
ATCO core competency model of the General post
According to the core competency index content and index weight research results of 978 questionnaires, the General core competency model is constructed as seven dimensions and 28 secondary indexes.
(2)
ATCO core competency model of the TWR post
According to 171 questionnaires of the TWR post controllers, the above methods are used for factor analysis and model verification. The chi-square degree of freedom ratio x2/df is 1.939 < 5, and the overall fitting degree of the model is good. The ATCO core competency model of the TWR post is constructed as seven dimensions and 26 secondary indexes.
(3)
ATCO core competency model of the APP post
According to 357 questionnaires of the APP post controllers, the same method as above is used for factor analysis and model verification. The chi-square degree of freedom ratio x2/df is 2.295 < 5, and the overall fitting degree of the model is good. The ATCO core competency model of the APP post is constructed with seven dimensions and thirty secondary indexes.
(4)
ATCO core competency model of the ACC post
According to 275 questionnaires of the ACC post controllers, factor analysis and model verification are carried out by using the same method as above. The chi-square degree of freedom ratio x2/df is 3.118 < 5, and the overall fitting degree of the model is good. The ATCO core competency model of the ACC post is constructed with seven dimensions and 27 secondary indexes.

5.2.6. The Comparison of ATCO Core Competency Models of Multi-Post Mode

According to the different tasks of specific jobs, the above four classification and grading models generally show certain convergence and differences in structure and content. The specific performance is as follows:
(1)
The four types of model structure are the same, they all maintain the seven dimensions of Separation and conflict resolution, Situational awareness, Self-management, Workload management, Communication and coordination, Traffic and capacity management, and Non-routine situations management. However, the ranking of the extracted factor load coefficients is different, which is manifested in the order of dimension naming. The main reason is that the dimensional importance of various models is different, that is, the focus of various posts is inconsistent. The General, TWR, and APP post models mainly focus on the competency dimension of F1 Separation and conflict resolution, and the ACC post model mainly focuses on the competency dimension of F1 Situational awareness.
(2)
The content of the model is the composition of the secondary indexes of each dimension, which is basically about 28 items. The model of the APP post contains up to thirty items, and the TWR model contains only 26 items. The number of secondary indexes is ranked as APP > General > ACC > TWR, which is consistent with the order of command difficulty coefficient and workload of various posts.
(3)
The competency indexes of each model are consistent with the multi-post competency needs analyzed in Table 2. The competency index content of the General post model is relatively balanced, taking into account the seven dimensions. The significant competency requirements of TWR, APP, and ACC posts are non-routine situations management abilities (x22, x23), accurate separation and conflict resolution abilities in complex situations (x11, x12, x13, x14, x15, x16), and the abilities to discover potential flight conflicts and resolve risks (x11, x12, x13, x14, x24, x25), which are reflected in various core competency models and constitute an important part of the model.

5.3. Weight Calculation of Core Competency Evaluation Index

(1)
Index weight of multi-post core competency model
For all kinds of model survey questionnaire samples, the index weights are calculated based on the above core competency combination weights method of AFE. The combined weights of each evaluation index are calculated by Equation (7), and the secondary index combined weights of the General, TWR, APP, and ACC models are obtained. The results are shown in Table 6.
(2)
Dimension weight of the multi-post core competency model
According to the results of Table 5, the weight of each dimension of the core competency model of multi-position mode is calculated, as shown in Figure 5 and Table 7. As mentioned above, the four types of models have convergence in the structural model, and the radar maps of the weights of each dimension are generally consistent.
At the same time, there are some differences in the value of each dimension weight. On the one hand, the dimension weight values of the four models all show three levels. The dimension with the smallest level of weight values is the traffic and capacity management, and non-routine situations management, which is called the basic core competency, representing the basic ability to meet the post requirement. The dimension with the medium level of weight values is workload management, self-management, and communication and coordination, which is called advanced core competency, representing the important non-technical ability required for the development of the post. The dimension with the largest level of weight value is separation and conflict resolution, and situational awareness, which is called high-level core competency, representing the common ability characteristic of excellent performance controllers. The pyramid hierarchical structure diagram of the above core competency dimensions is as follows in Figure 6.
On the other hand, the dimension of the ATCO core competency model is compared horizontally. The TWR model has the largest weight in the dimension of non-routine situations management, which is consistent with the characteristics of the TWR post in the face of massive non-routine situations treatment tasks. The largest weight of the traffic and capacity management dimension is the APP model, because of the reason that the most onerous tasks faced by the APP posts are traffic flow and sector capacity management. The largest weight of the separation and conflict resolution dimension is the ACC model, which is determined by the ACC posts characteristics of detecting flight conflicts early and resolving risks timely.
The convergence and difference of the above four core competency models are determined by specific job posts and situational conditions, so their scope of application also shows specific adaptability. The General core competency model can be applied to comprehensive management posts such as instructors, assistants, leaders, and various professional posts. The core competency model of TWR, APP, and ACC posts is more suitable for controllers and leaders in ATC seats of professional posts, in which the model is closer to the production and operation situation of the professional post.

5.4. The Calculation of ATCO Core Competency Fit Degree

According to the matching index system between the core competency and job requirements, the ATCO core competency in multi-post mode is evaluated. And the CPF degree of each item with the full score is set to reach 1, indicating the optimal matching degree target level, as the evaluation reference standard for test controllers. According to the CPF degree value calculated by the total sample data, combined with the experience of the ATCO post ability performance, when the CPF degree reaches 0.5 and above, the ATCO can meet the core competency requirement of the post. The closer the CPF degree value is to 1, the better the fit between the ATCO and the post.
Based on the empirical analysis of the ATCO core competency evaluation, four ATCOs named A, B, C, and D are randomly selected to evaluate the core competency in another ATC unit. The experts score the controllers around the thirty-one indexes of the core competency evaluation index system. Each item can be scored 0–5 points, and the total scores of the four evaluation objects are 144 points, 146 points, 148 points, and 146 points, respectively.
In order to quantitatively study the fit degree between four controllers and multiple posts, the core competency evaluation performance matrix of ATCOs A, B, C, and D is input, and the relative closeness degree of four controllers under the core competency General model, TWR model, APP model, and ACC model is calculated based on the AFE-TOPSIS method. The calculation results of the CPF degree are shown in Figure 7 and Table 8.
Each ATCO shows different fit degrees for different posts, which is consistent with their respective job expertise. At the same time, the overall fit degree of the four controllers is ranked as follows: C > B > A > D. C can be well qualified for any post of the four types, A is most suitable for the general post, B is most suitable for the ACC post, and D is most suitable for the APP post. From the perspective of rational allocation of human resources and giving full play to the core competency advantages of each controller, it is recommended that A, B, C, and D be engaged in ATC assistant post, ACC post, TWR post, and APP post respectively, which can achieve the optimal matching scheme.

6. Conclusions

The main conclusions of this paper are as follows:
(1)
As a data-based ability evaluation method, the adapted ATCO core competency evaluation can effectively quantify the ATC ability level of multi-post mode. The proposed General core competency model includes seven dimensions and 28 secondary indexes, the dimensions contain SCR, SAW, CCO, SFM, WLM, TCM, and NRS. The model can effectively explain the core competency indexes required for excellent performance ATCOs, as well as the hierarchical attributes of basic core competency, advanced core competency, and high-level core competency, which provides theoretical guidance and a practical basis for the evaluation and training of ATCOs.
(2)
The ATCO core competency shows the diversity of multi-post mode, this paper proposes a refined model analysis method of classification and grading to identify the convergence and difference of the General model, TWR model, APP model, and ACC model in the ATCO core competency dimension and secondary indexes. Through the personalized modeling method, it realizes the differentiated representation of the weight of each dimension. The proposed AFE method for determining the weight of the ATCO core competency index based on the combination weighting method of AHP-FA-EWM can give full play to the advantages of subjective and objective weighting methods and more accurately and scientifically reflects the importance of evaluation indexes.
(3)
In order to support the ATCO effectiveness evaluation and team resource management, based on the classification and grading model of core competency, this paper proposes a calculation method of the ATCO core competency-post fit degree based on the AFE-TOPSIS. It can effectively evaluate the matching degree of ATCO individual effectiveness and post requirements, effectively distinguish the overall arrangement level of the post candidate’s ability, and help to meet the overall matching of personnel and posts to the greatest extent, which can realize the full use of their abilities and the efficient management of human resources.
In the future, this paper will take the busy degree of the ATC sector, the characteristics of the ATC seat, the workload, and the fatigue process into further consideration, study the ATCO CPF degree of specific sectors and specific seats in multi-post mode, and reveal the mechanism and changing trend of the ATCO refined seat CPF.

Author Contributions

Conceptualization, L.Y.; Investigation, C.D.; Writing original draft, C.D.; Visualization, Q.G.; Supervision, M.H. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National key research and development program (NO. 2022YFB2602400) and the National Natural Science Foundation of China (NO. U2133207).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The authors acknowledge with thanks the support for this work by the College of Civil Aviation at Nanjing University of Aeronautics and Astronautics.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Teperi, A.M.; Leppänen, A.; Norros, L. Application of new human factors tool in an air traffic management organization. Saf. Sci. 2015, 73, 23–33. [Google Scholar] [CrossRef]
  2. Zhang, H.; Lyu, W.; Wan, J.; Yang, L. Network modeling and evolution characteristics for air traffic risk situation in sectors. J. Traffic Transp. Eng. 2023, 23, 222–241. [Google Scholar]
  3. McClelland, D.C. Testing for competency rather than for intelligence. Am. Psychol. 1973, 28, 1–14. [Google Scholar] [CrossRef]
  4. Petri, A.-M. Competency Assessment of Air Traffic Controllers: A Transition from Safety-I to Safety-II. Master’s Thesis, Lund University, Lund, Sweden, 2015. [Google Scholar]
  5. Shankararaman, V.; Ducrot, J. Leveraging competency framework to improve teaching and learning: A methodological approach. Educ. Inform Technol. 2016, 21, 1299–1327. [Google Scholar] [CrossRef]
  6. Ziakkas, D.; Michael, W.S.; Pechlivanis, K. The Implementation of Competency-Based Training and Assessment (CBTA) Framework in Aviation Manpower Planning. In Proceedings of the 34th Conference of the European Association for Aviation Psychology, Gibraltar, UK, 26–30 September 2022; pp. 226–239. [Google Scholar]
  7. Oprins, E.; Burggraaff, E.; van Weerdenburg, H. Competency-Based Assessment Design for Air Traffic Control Training. In Proceedings of the International Symposium on Aviation Psychology, Oklahoma City, OK, USA, 18–21 April 2005; pp. 546–552. [Google Scholar]
  8. Oprins, E. Design of a Competency-Based Assessment System for Air Traffic Control Training. Ph.D. Thesis, Maastricht University, Maastricht, The Netherlands, 2008. [Google Scholar]
  9. Bao, M.; Zhang, X.; Yuan, W. ICAO’s General Practice and Application of Competency-based Training. J. Civil Aviat. 2021, 5, 86–90+95. [Google Scholar]
  10. International Civil Aviation Organization. Training; ICAO: Montreal, QC, Canada, 2016. [Google Scholar]
  11. Tímea, V. Required Matco Competencies for the Efficient Air Traffic Management at the Airfield in Mission Environment. Comput. Sci. 2018, 30, 45–60. [Google Scholar]
  12. Wilshusen, G.C.; Barkakati, N.; Dillingham, G.L. Information Security: FAA Needs to Address Weaknesses in Air Traffic Control Systems; U.S. Government Accountability Office: Washington, DC, USA, 2015.
  13. Vuckovic, A.; Sanderson, P.; Neal, A.; Gaukrodger, S.; Wong, B.W. Relative Position Vectors: An Alternative Approach to Conflict Detection in Air Traffic Control. Human Factors 2013, 55, 946–964. [Google Scholar] [CrossRef]
  14. Xu, N. The Study of Chinese Air Traffic Controller’s Competency. Ph.D. Thesis, Jinan University, Guangzhou, China, 2007. [Google Scholar]
  15. Sun, R.; Zhao, N.; Li, J.; Wang, W. Structure analysis of competency model for air traffic controller. China Saf. Sci. J. 2014, 24, 8–14. [Google Scholar]
  16. Jingqiang, L.; Hao, L.; Ning, Z. Competency model and analysis on its influence relationship for air traffic controller. J. Saf. Sci. Technol. 2016, 12, 175–180. [Google Scholar]
  17. Yang, C.; Wang, X.; Guo, R. Post Allocation Method Based on Controller Competency Model. China Transp. Rev. 2021, 43, 61–65+75. [Google Scholar]
  18. Liu, S. Study on competency of trainee controller. Civil Aviat. Manag. 2017, 6, 70–74. [Google Scholar]
  19. Li, J.; Zhong, F. Study on competency model of air traffic control leader. Civil Aviat. Manag. 2018, 9, 46–48. [Google Scholar]
  20. Long-fang, M.O.; Peng, B.A.; Na, M.E.; Ya-rong, L.I. Research on computer-aided measurement factor empowerment of air traffic controllers’ quality based on entropy method. J. Civil Aviat. Univ. China 2015, 33, 58–60. [Google Scholar]
  21. Bian, X.; Fum, J. Training Method Research of Controllers Based on Competency Model. China Transp. Rev. 2020, 42, 75–78. [Google Scholar]
  22. Eißfeldt, H. Ability requirements for air traffic controllers–review and integration. In Proceedings of the 24th EAAP Conference, Zürich, Switzerland, 21–24 August 2000; pp. 1–22. [Google Scholar]
  23. Wium, J.; Eaglestone, J. Job Analysis for Air Traffic Control: A Review of the Literature from 1949 to 2020. Aviat. Psychol. Appl. Human Factors 2022, 12, 1–19. [Google Scholar] [CrossRef]
  24. Xiang, H.; Liang, M. Analysis of Air Traffic Accidents Based on the Mode of Air Traffic Controllers’ Tasks. J. Wuhan Univ. Technol. (Transp. Sci. Eng.) 2014, 38, 529–533. [Google Scholar]
  25. Zhang, L.; Li, N.; Zhao, H.; Yang, K. A novel comprehensive evaluation for the performance of energy saving and emission reduction in thermal power enterprise based on combination weights and improved matter-element extension model. Appl. Mech. Mater. 2014, 3207, 556–562. [Google Scholar] [CrossRef]
  26. Wang, Y.; Ye, S. On the safety behavior capacity model of the civil air traffic controllers. J. Saf. Environ. 2012, 12, 187–191. [Google Scholar]
  27. Ma, X.; Wu, D.; Lai, G. Research on Fuzzy Comprehensive Evaluation of Controller’s Psychological Tendency Based on Analytic Hierarchy Process. Aeronautical Comput. Techn. 2019, 49, 71–74+78. [Google Scholar]
  28. Wu, R.; He, Y.; Jia, Y. Key personnel risk assessment method based on improved AHP. China Saf. Sci. J. 2021, 31, 112–118. [Google Scholar]
  29. Zhang, X.; He, N. Study on Classification and Applicability of Comprehensive Evaluation Methods. Stat. Decis. 2022, 6, 31–36. [Google Scholar]
  30. Wang, S.; Wang, C.; Li, X. Competency Evaluation System of Standardized Nurse Training Instructors Based on Delphi-Entropy Weight Method. Chin. Hosp. Manag. 2021, 41, 87–90. [Google Scholar]
  31. Hu, M.; Dan, C. Characteristics of Air Traffic Controller’s Workload. Command Inform. Syst. Technol. 2018, 9, 1–7. [Google Scholar]
  32. Wang, L.; Jiang, Y.; Tan, W. Study on construction of risk portrait index system for airline pilots. China Saf. Sci. J. 2020, 30, 13–21. [Google Scholar]
  33. Li, W. Research on Civil Aviation Safety Supervision Capability Evaluation Model Based on Entropy Weight TOPSIS. For. Chem. Rev. 2022, 3, 1055–1062. [Google Scholar]
  34. Xu, J.; Sun, Y. Study on the Environmental Innovation Capability Evaluation Model of Manufacturing Enterprises Based on Entropy Weight TOPSIS-BP Neural Network and Empirical Research. In Proceedings of the 2018 International Conference on Management Science and Engineering, Frankfurt, Germany, 17–20 August 2018; pp. 121–129. [Google Scholar]
  35. Ding, W.; Hu, M.; Jiang, B. Multi-mode Approach Effectiveness Analysis of Parallel Runways Based on Entropy Weight Method. J. East Chin. Jiaotong Univ. 2023, 40, 44–51. [Google Scholar]
Figure 1. Research framework.
Figure 1. Research framework.
Applsci 13 10246 g001
Figure 2. Process analysis of ATCO competency based on the job task model.
Figure 2. Process analysis of ATCO competency based on the job task model.
Applsci 13 10246 g002
Figure 3. General model indexes of ATCO core competency.
Figure 3. General model indexes of ATCO core competency.
Applsci 13 10246 g003
Figure 4. Structure model of general air traffic controller core competency.
Figure 4. Structure model of general air traffic controller core competency.
Applsci 13 10246 g004
Figure 5. Core competency model dimensions of multi-post mode.
Figure 5. Core competency model dimensions of multi-post mode.
Applsci 13 10246 g005
Figure 6. Pyramid hierarchical structure diagram of the core competency dimensions.
Figure 6. Pyramid hierarchical structure diagram of the core competency dimensions.
Applsci 13 10246 g006
Figure 7. ATCO competency-post fit degree of multi-post mode.
Figure 7. ATCO competency-post fit degree of multi-post mode.
Applsci 13 10246 g007
Table 1. Primary indexes of ATCO core competency.
Table 1. Primary indexes of ATCO core competency.
Competency Index Code and NameDescription of Observable Behavior
x1Monitor the operational situationMonitors air traffic, meteorological conditions, the status of the ATC systems and equipment, and operational circumstances
x2Scan for specific or new informationAcquires information from available systems and any other means available
x3Comprehend the operational situationIntegrates information acquired from monitoring and scanning and analyses the actual situation
x4Anticipate the future situationInterprets the situation based on the analysis and predicts the future operational situation
x5Recognize indications of reduced situational awarenessIdentifies potentially hazardous situations, verifies the accuracy of the information, and predicts operational situations
x6Keep aircraft identificationKeep radar identification of aircraft and provides aircraft location information
x7Manage the traffic situationUses prescribed procedures and a variety of techniques to manage traffic effectively
x8Achieve optimal operational performanceIncreases safety margins, ensure appropriate sector capacity, maintains focus, reacts appropriately to situations
x9Disseminate flight informationIssues clearances and instructions to the flight crews, issues appropriate clearances and instructions promptly, uses available tools to reduce delays and optimize flight profiles, provides flight information and status of facilities promptly
x10Inform essential traffic and weather informationInforms essential traffic and weather information, issues hazard and safety alerts, traffic proximity information, and weather information to the flight crews when necessary
x11Detect potential traffic conflictsIdentifies traffic conflicts
x12Resolve traffic conflictsSelects the most appropriate separation method, applies appropriate air traffic separation and spacing
x13Maintain separation between aircraftApplies appropriate air traffic separation and spacing, issues clearances and instructions that ensure separation is maintained
x14Maintain separation of aircraft from terrain and known obstaclesIssues clearance and instructions that resolve traffic conflicts and adjusts control actions to maintain separation
x15Command ability under normal circumstancesUnder normal circumstances, the busy degree of the command sector, the hourly capacity of the sector
x16Command capability in complex situationsCommand level in the case of large flow, complex weather
x17Air traffic control experienceExperience in each position, seat, and major security
x18Select appropriate mode of communicationSelects a communication mode that takes into account the requirements of the situation
x19Demonstrate effective verbal communicationSpeaks clearly, accurately, and concisely
x20Demonstrate effective radiotelephony phraseologyUses standard radiotelephony phraseology, adjusts speech techniques to suit the situation, demonstrates active listening
x21Select the appropriate method of coordinationSelects the appropriate coordination method, uses the prescribed coordination procedures
x22Manage emergency and unusual
situations
Recognizes the possibility of an emergency or unusual situation developing, determines the nature of the emergency, prioritizes actions, decides upon the most appropriate type of assistance, follows prescribed procedures, provides assistance and takes action when necessary
x23Manage degraded modes of ATS operationsDetects degraded situation, assesses the impact of a degraded mode, follows prescribed procedures, creates appropriate solutions
x24Determine possible solutionsDetermines possible solutions to a problem based on existing rules and
operating procedures, implements an appropriate solution
x25Manage risks effectivelyApplies an appropriate mitigation strategy, perseveres in working through problems without impacting safety
x26Adapt to differing workload conditionsManages tasks effectively in response to workload, manages interruptions and distractions effectively
x27Request assistance when necessaryDetermines if and when support is necessary based on workload, asks for help, or accepts assistance when necessary
x28Use ATS equipment effectivelySelects appropriate resources to support the efficient achievement of tasks, uses the automated ATS equipment to improve efficiency
x29Self-evaluate to improve performanceTakes responsibility for own performance, improves performance through self-evaluation
x30Use feedback to improve performanceSeeks and accepts feedback to improve performance, maintains self-control, changes behavior, and responds as needed
x31Engage in continuous development activitiesMaintains awareness of developments and changes in aviation, participates in learning activities
Table 2. The required core competency of multi-post mode.
Table 2. The required core competency of multi-post mode.
PostTask CharacteristicsThe Most Significant Core Competency Needs
Generalcontrol command, sustainable development, and other comprehensive abilityCompetencies are relatively balanced
TWRgood ability to deal with unusual situationsx22, x23
APPaccurate conflict resolution capabilityx11, x12, x13, x14, x15, x16
ACCDetects potential traffic conflicts and resolves conflictsx11, x12, x13, x14, x24, x25
Table 3. Frequency statistics.
Table 3. Frequency statistics.
Demographic InformationFrequencyPercentage (%)
Age>50 years old666.75
40~50 years old16917.28
30~40 years old41842.74
≤30 years old32533.23
Work PostTWR post17117.48
APP post35736.50
ACC post27528.12
Related post17517.89
Qualification≥Second-level ATCO39540.39
Third-level ATCO23724.23
Fourth-level ATCO11812.07
Fifth-level ATCO13213.50
Intern ATCO969.82
Working year≥20 years18518.92
10~20 years34435.17
5~10 years21622.09
≤5 years23323.82
Education
background
Master degree and above747.57
Undergraduate college88890.80
Junior college and below161.64
Total978100.0
Table 4. CFA fitting results of the general model.
Table 4. CFA fitting results of the general model.
Commonly Used Indexesx2/dfRMSEARMRCFINFITLI
Reference standard<5<0.10<0.05>0.9>0.9>0.9
Test results4.6350.0610.0250.9450.9310.936
Table 5. Adapted multi-dimensional core competency model in multi-post mode.
Table 5. Adapted multi-dimensional core competency model in multi-post mode.
General ModelTWR ModelAPP ModelACC Model
DimensionSecondary IndexDimensionSecondary IndexDimensionSecondary IndexDimensionSecondary Index
F1 Separation and conflict resolutionx11, x12, x13, x14, x15, x16F1 Separation and conflict resolutionx11, x12, x13, x14F1 Separation and conflict resolutionx11, x12, x13, x14, x15, x16F1 Situational awarenessx1, x2, x3, x4, x5, x6
F2 Situational awarenessx1, x2, x3, x4, x5F2 Situational awarenessx1, x2, x3, x4, x5F2 Situational awarenessx1, x2, x3, x4, x5, x6F2 Separation and conflict resolutionx11, x12, x13, x14, x24, x25
F3 Communication and coordinationx18, x19, x20, x21F3 Self-managementx29, x30, x31F3 Self-managementx29, x30, x31F3 Communication and coordinationx18, x19, x20, x21
F4 Self-managementx29, x30, x31F4 Workload managementx24, x25, x26, x27, x28F4 Workload managementx24, x25, x26, x27, x28F4 Self-managementx29, x30, x31
F5 Workload managementx24, x25, x26, x27, x28F5 Communication and coordinationx18, x19, x20, x21F5 Communication and coordinationx18, x19, x20, x21F5 Traffic and capacity managementx8, x9, x10
F6 Traffic and capacity managementx8, x9, x10F6 Traffic and capacity managementx8, x9, x10F6 Traffic and capacity managementx7, x8, x9, x10F6 Workload managementx26, x27, x28
F7 Non-routine situations managementx22, x23F7 Non-routine situations managementx22, x23F7 Non-routine situations managementx22, x23F7 Non-routine situations managementx22, x23
Table 6. Combined weights of each index about the ATCO core competency model.
Table 6. Combined weights of each index about the ATCO core competency model.
Secondary IndexCombined Weights of Each Index
General ModelTWR ModelAPP ModelACC Model
x10.03470.03370.03470.0354
x20.03620.03660.03550.0368
x30.03300.03480.03170.0350
x40.03670.03920.03460.0383
x50.03650.03660.03520.0386
x60.03260.0365
x70.0285
x80.03430.03300.02830.0370
x90.03600.03460.03100.0376
x100.03750.03570.03280.0378
x110.03440.04610.03370.0364
x120.03470.04230.03340.0404
x130.03560.04430.03370.0405
x140.03940.04840.03560.0486
x150.04110.0402
x160.03800.0368
x17
x180.03310.03450.03100.0365
x190.03300.03270.03050.0380
x200.04130.04380.04010.0436
x210.03260.03280.03090.0354
x220.03490.04060.02720.0297
x230.04160.04410.03340.0364
x240.03170.03500.03020.0285
x250.03060.03540.02940.0327
x260.03130.03360.03080.0344
x270.03250.03620.03150.0329
x280.03100.03340.02970.0349
x290.03820.04450.03770.0371
x300.03920.04190.03900.0393
x310.04090.04620.04030.0417
Table 7. Combined weights about each dimension of the core competency model.
Table 7. Combined weights about each dimension of the core competency model.
Dimension of Core CompetencyCombined Weights of Each Dimension
General ModelTWR ModelAPP ModelACC Model
Separation and conflict resolution (SCR)0.22320.18110.21330.2271
Situational awareness (SAW)0.17710.18100.20430.2206
Communication and coordination (CCO)0.14000.14380.13250.1535
Self-management (SFM)0.11830.13250.11710.1181
Workload management (WLM)0.15710.17360.15160.1022
Traffic and capacity management (TCM)0.10780.10330.12060.1125
Non-routine situations management (NRS)0.07650.08470.06060.0662
Table 8. Relative proximity and ranking of multi-post mode.
Table 8. Relative proximity and ranking of multi-post mode.
Evaluation ATCOsEvaluation ResultsGeneral Model CpRankingTWR Model CpRankingAPP Model CpRankingACC Model CpRanking
A1440.622720.586930.605830.57113
B1460.611230.630720.618520.64392
C1480.644410.665910.655810.65591
D1460.592840.561840.603840.56464
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Duan, C.; Hu, M.; Yang, L.; Gao, Q. Core Competency Quantitative Evaluation of Air Traffic Controller in Multi-Post Mode. Appl. Sci. 2023, 13, 10246. https://doi.org/10.3390/app131810246

AMA Style

Duan C, Hu M, Yang L, Gao Q. Core Competency Quantitative Evaluation of Air Traffic Controller in Multi-Post Mode. Applied Sciences. 2023; 13(18):10246. https://doi.org/10.3390/app131810246

Chicago/Turabian Style

Duan, Changmiao, Minghua Hu, Lei Yang, and Qi Gao. 2023. "Core Competency Quantitative Evaluation of Air Traffic Controller in Multi-Post Mode" Applied Sciences 13, no. 18: 10246. https://doi.org/10.3390/app131810246

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop