1. Introduction
The implementation of performance-based navigation (PBN) of civil aircrafts in recent years has greatly enhanced the capacity of civil airspace. With the development of airborne navigation systems, especially global navigation satellite systems (GNSSs), the implementation of required navigation performance (RNP) with higher performance requirements has become a trend for future civil aviation air traffic management [
1,
2,
3,
4].
RNP is an advanced civil aviation navigation procedure that defines the essential capability of the airborne navigation system in the form of a performance threshold tunnel when operating in specified airspace. The flight management system (FMS) requires fault detection, fault isolation, and system reconfiguration capabilities, and it uses hardware redundancy and model-based analytic redundancy methods for accurate fault identification [
5,
6,
7]. The FMS also needs to accurately evaluate a civil aircraft’s navigation capability in real-time to determine if it meets the current RNP threshold. An incorrect evaluation result will cause misjudgement by the crew, which will lead to serious threats to flight safety.
The FMS uses the probability circle radius (95%) of estimated position uncertainty (EPU) to represent the actual navigation performance (ANP) [
8]. The existing ANP evaluation method focuses on the improvement of the EPU model [
9,
10,
11]. As shown in
Figure 1, the evaluation accuracy of ANP depends on the precision of position uncertainty estimation provided by the FMS.
Airborne integrated navigation systems usually use empirical positioning error models of each navigation sensor for position calculation to ensure computational efficiency [
12]. However, the performance of the primary navigation source during civil flight is time-varying and unpredictable [
13]. In this case, the use of an empirical error model will lead to inaccurate calculation of the position error covariance matrix (PECM) by the integrated navigation system, which in turn leads to inaccuracy of the ANP value [
14].
Accurate estimation of the time-varying PECM is a prerequisite for ANP calculations. The exact solution of the time-varying PECM caused by inaccurate and unknown noise cannot be obtained in-flight, and it is more common to estimate the PECM using approximation methods. There are numerous approximation methods, including the maximum likelihood method, maximum a posterior method, expectation–maximization method, variational Bayesian methods, etc. [
15]. Variational Bayesian (VB) methods are a combination of Bayesian reasoning and variational calculus. They can perform approximate posterior inference at a low computational cost by choosing an appropriate conjugate prior distribution [
16,
17]. However, the existing VB-based estimator can estimate an unknown and slowly varying measurement noise by choosing the appropriate conjugate prior distribution [
18]. But when the estimator uses an inaccurate process noise matrix, it will introduce inaccuracy in the PECM estimation; therefore, the tracking capability for time-varying unknown system noise needs to be improved.
This paper aims to solve the ANP misestimation cost due to unknown time-varying sensor noise. An adaptive 3D ANP evaluation method based on variational Bayesian was proposed. The main contributions of this paper are as follows: (1) A novel VB-based PECM estimator was constructed to accurately estimate both the predicted error covariance matrix and the measurement noise matrix in integrated navigation systems. This approach effectively addresses the issue of inaccurate estimation caused by unknown noise in the integrated navigation system input. (2) The fading memory index weighting is used to improve the tracking capability of time-varying noise, and the accuracy of the actual navigation performance of the integrated navigation system is further improved. (3) To address the limitations of the traditional ANP model, a 3D ANP model was developed that was specifically designed to overcome issues such as missing evaluation dimensions and model inaccuracy. Finally, a simulation was performed to prove the algorithm.
The structure of the proposed airborne integrated navigation system and ANP evaluation is shown in
Figure 2. The FMS uses the inertial reference system (IRS) as the reference system and the GNSS and land-based radio system as auxiliary systems. The accurate PECM can be obtained using the proposed VB-based estimator, and by applying PECM to the 3D ANP model, the FMS can output a 3D-ANP evaluation result for civil aircrafts during RNP flight.
2. Traditional Airborne ANP Evaluation with Kalman Filter
The traditional airborne ANP evaluation is based on the Kalman filter. The discrete-time linear state-space model of the airborne integrated system is as follows:
Gaussian system noise and Gaussian measurement noise are irrelevant.
The process of integrated navigation based on the Kalman filter is as follows:
is the estimated error matrix (EEM) of the Kalman filter, which includes the position estimate error (PEE) of the airborne integrated navigation system.
is the one-step prediction error matrix. FMS uses the PECM obtained according to
as the ANP calculation input. PECM
for the horizontal plane can be expressed as follows:
where:
is the similarity transformation matrix of
. Then, the ANP in the horizontal plane can be expressed as follows:
is the major axis of the PEE ellipses, and
k is the scale factor of the 95% probability elliptic integral:
The Kalman filter is the optimal recursive linear variance estimation algorithm with accurate
and
values. However, active FMS empirically sets
and
according to the sensor error characteristics. As shown in
Figure 3, such customized parameters cannot reflect the changing characteristics of uncertain noise [
19]. The use of inaccurate
and
values will result in substantial estimation errors in the PECM, leading to misevaluation of ANP. Therefore, a novel VB-based PECM approximation method will be proposed.
4. Experimental Setup
To verify the effectiveness of the algorithm proposed in this paper, the performance of the following algorithms is compared, including the traditional ANP evaluation method based on KF with a nominal and noise matrix(KFNN), traditional ANP evaluation method based on KF with a true and noise matrix(KFTN), ANP evaluation method based on VBKF for estimating only (VBKFR), and the proposed 3D ANP evaluation method based on the VB-PECM estimator for estimating and .
The integrated navigation system loosely adopts the IRS/GNSS position combination. The simulation experiments are carried out in the MATLAB environment. The standard deviation of the GNSS positioning error for each leg is set as follows: (1) 10 m (take off, landing), (2) 20 m (departure, climb, descent, approach), (3) 50 m (en-route). The bias of airborne accelerometers is set as 10
−4 g, and the bias of gyros is set as 0.01°/h [
20,
21,
22].
The RNP flight procedure from Shanghai Hongqiao International Airport (ZSSS) to Chengdu Shuangliu International Airport (ZUUU) is executed in the simulation. The aircraft’s flight trajectory is dynamic, taking full account of the aircraft’s maneuverability, comprising five phases: takeoff, climb, steady flight, turn, descent and landing. The initial position is 31.1967° N, 121.335° E at an altitude of 8 m; the initial heading angle is 175°; and the arrival airport is 30.58° N, 103.948° E at an altitude is 495 m. The simulation duration is 10,505 s. The fly track simulation output is shown in
Figure 6.
5. Results
Figure 7 shows the comparison results of the position-estimated error of the FMS in the east, north, and vertical directions of the different algorithms.
To evaluate the position estimate accuracy of the proposed algorithm, the root mean square error (RMSE) of position error is chosen as an evaluation metric. The formula for calculating RMSE is as follows:
where
is the number of data points,
is the position estimated value of FMS, and
is the position true value of FMS obtained from the simulated track generator.
Table 1 shows the position error RMSE of each algorithm in three directions.
Table 2 and
Table 3 show the mean and standard deviation of the position error for each algorithm in three directions.
As can be seen from the position error curve and the statistical table of position errors, the proposed VB-PECM method can significantly improve the precision of integrated navigation. The addition of forgetting factor makes the tracking performance of measurement noise better, reducing the influence of time-varying noise on the navigation results.
The comparison of the traditional ANP method with KFNN, the traditional ANP method with VB-PECM, and the proposed 3D ANP method with VB-PECM that was proposed in this paper is shown in
Figure 8.
To compare the success rate and precision of each ANP evaluation method, the F-score and mean absolute percentage error (MAPE) statistics are introduced as the evaluation metrics.
The F-score represents the comprehensive efficiency of the ANP evaluation, TP is the number of correct evaluations, FP is the number of misevaluations, FN is the number of missed evaluations, and is the harmonization factor of precision and recall. When , the F-score can fully represent the accuracy of each ANP model.
MAPE denotes the approximability of ANP to the true position error.
where
n is the number of data points,
is the true position error of FMS, and
is the ANP results in each direction.
As can be seen, because the traditional ANP with KFNN uses a nominal
and
noise matrix, the ANP evaluation result is a smooth curve, which has a large error gap compared to the real navigation positioning error. The traditional ANP with VB-PECM and the proposed ANP with VB-PECM accurately perceived the time-varying unknown noise in the integrated navigation system due to the PECM estimator. The ANP model proposed in this paper further improved the accuracy of the ANP evaluation.
Table 4 and
Table 5 show the F-1score and MAPE of each ANP method in three directions.
Table 6 and
Table 7 show the mean and standard deviation of ANP for each algorithm in three directions.
As can be seen from the ANP curve and the statistical table of ANP, the proposed 3D ANP model with VB-PECM has the lowest MAPE and the highest F1-score. This means the results of the ANP algorithm proposed in this paper are closer to the real navigation error, and the 3D model proposed in this paper makes the ANP evaluation in three directions more accurate. The statistical results of the mean and variance of each algorithm also show that the proposed algorithm has a higher performance.
In order to verify the effectiveness of the proposed algorithm, Monte Carlo simulations were carried out under the RNP flight procedure from Beijing Capital Airport (ZBAA) to Shanghai Hongqiao International Airport (ZSSS). The initial position is 40.073333° N, 116.598333° E at an altitude of 30.4 m, the initial heading angle is 175°, and the end point is 31.196667° N, 121.335000° E at an altitude is 8 m. The standard deviation of GNSS positioning error for each leg is set to be the same as the previous simulation conditions. The F1-score and MAPE of each ANP method in three directions are shown in
Table 8 and
Table 9.
Based on the above simulation results, it can be seen that the proposed VB-PECM filter has stronger adaptability to time-varying unknown noise. The proposed VB-PECM filter not only improves the accuracy of positioning but also the estimation accuracy of the PECM. Combined with the 3D ANP model proposed in this paper, the ANP evaluation is more effective. The evaluation accuracy in the east direction is 60.7% higher than the traditional ANP with KFNN, and it is 38.8% higher than the traditional ANP with VB-PECM. In the north direction, it is 55.8% higher than the traditional ANP with KFNN and 39.7% higher than the traditional ANP with VB-PECM. In the vertical direction, it is 56.9% higher than the traditional ANP with KFNN and 31.7% higher than the traditional ANP with VB-PECM.
6. Conclusions
During RNP operation, it is important to monitor the actual navigation performance of FMS accurately. We aimed to address the problem that the traditional ANP calculation method has regarding nominal noise matrices, where the Kalman filter cannot be sensitive to time-varying unknown noise, which will lead to inaccurate evaluation results.
Firstly, this paper proposed a PECM estimator based on the variational Bayesian method. Accurate estimation of the PECM is achieved via iterative approximation of the predicted error covariance matrix and the measurement noise matrix. Meanwhile, the addition of fading memory index weighting endows the VB-PECM with a better tracking performance for time-varying noise. On this basis, the 3D ANP calculation model is constructed to solve the problem of missing evaluation dimensions and inaccurate evaluation of the traditional model. The simulation results show that the proposed ANP calculation method in this paper can effectively improve the evaluation accuracy of ANP during RNP operation with time-varying unknown noise. Thus, the proposed algorithm has a certain theoretical reference value for ensuring the flight safety of civil aircrafts under RNP operation.