1. Introduction
To provide global and all-weather navigation information, a strap-down inertial navigation system (SINS) relies only on a gyroscope and an accelerometer to sense the motion of the carrier in the inertial frame; it is an independent and autonomous navigation system. It has outstanding advantages, such as continuous output of the carrier’s position, speed, and attitude information, high short-term navigation accuracy, and complete independence [
1]. It is widely used in vehicle, ship, aircraft, tactical, and strategic navigation.
With the development of the global navigation satellite system (GNSS), represented by a global positioning system (GPS), a SINS can provide high-precision global and all-weather navigation and positioning services in which error does not accumulate over time. Satellite navigation systems have played essential roles in military, aviation, economic construction, and scientific fields [
2]. However, because satellite signals are easily blocked and experience regular interference, the data update rate of the navigation result is low, and there is no attitude information output. Combined with the advantages of the SINS (short-term positioning accuracy and high data sampling rate), the integrated navigation algorithm can obtain the three-dimensional position, speed, stability, and reliability attitudes, good accuracy, and a high data update rate. The integrated navigation algorithm facilitates the complementary functioning of SINS and GPS systems [
3]. First, inertial navigation results are corrected using satellite navigation results in which errors do not accumulate over time; thus, avoiding the rapid accumulation of errors over time. Second, high-precision and high-stability inertial navigation results in a short period can partially solve the navigation and positioning problems when the satellite signal is blocked. The integrated navigation systems improve the robustness of navigation results. In addition, integrated navigation can estimate the constant errors of the inertial element and feedback, and correct the accelerometer and gyroscope outputs to realize the online calibration of the inertial element [
4]. Therefore, the integration of satellite navigation and inertial navigation can obtain stable and reliable three-dimensional position, speed, and attitude information with good accuracy and a high data update rate.
Although integrated navigation systems can provide navigation information to users in most locations on Earth, doing so requires capturing standard satellite signals. In sheltered outdoor areas, such as cities, canyons, and forests, when satellite signals are attenuated or lost due to occlusion by buildings, mountains, trees, etc., the errors of using a pure inertial navigation system (INS) accumulates rapidly over time. This results in decreased positioning accuracy and an inability to navigate properly [
5]. In rapidly changing cities, there are many large floors with dense forests, and an increasing number of large and sealed indoor environments; as a result, the application of satellite and integrated navigation systems in complex environments is minimal.
For the past few years, the rapid development of machine learning (ML) technology has led many researchers to begin employing ML-aided SINS/GPS integrated navigation systems to improve the SINS’ navigation performance during GPS outages [
6,
7,
8,
9,
10,
11,
12,
13,
14,
15,
16,
17,
18,
19,
20,
21]. The specific working principle is that when the GNSS’s signal is available, an ML algorithm trains the mapping model between the SINS’ acceleration, specific force, speed, and position increments outputs and GNSS’s speed/position increments [
6,
7,
8,
9,
10,
11,
12,
13]. When GNSS data are unavailable, the GPS’ speed/velocity measurements are replaced with the well-trained ML module’s prediction outputs; information fusion with the SINS reduces the degree of system error divergence [
14,
15,
16,
17,
18,
19,
20,
21]. ML technology has an excellent capability to learn and reason in an inaccurate and uncertain environment, and in this way it corresponds to the human brain. It can effectively compensate for the inherent flame of the traditional Kalman filtering (KF) theory when integrated navigation data are fused. Even during GPS outages, ML technology can aid KF in forecasting and estimating the navigation calculation error of the SINS; the accuracy of the integrated system is improved through error compensation. However, these ML methods are unsuitable for processing data streams in online learning scenarios.
Therefore, this paper proposes an online sequential extreme learning machine with a dynamic forgetting factor (DOS-ELM) aided methodology for a SINS/GPS integrated navigation system during GPS outages is proposed. The main contributions of this paper are summarized as follows: (1) The DOS-ELM algorithm is used to train the mapping model between the SINS’ acceleration, specific force, speed, and position increments outputs and the GPS’ speed/position increments. When the GPS’ signal is unavailable, GPS speed/velocity measurements are replaced with the well-trained DOS-ELM module’s prediction outputs, and information fusion with the SINS reduces the degree of system error divergence. A semi-physical simulation was performed to verify the feasibility and effectiveness of the proposed methodology. (2) Each time the proposed model is updated, the DOS-ELM algorithm can adjust the forgetting factor according to the difference between the prediction accuracies of the current and previous models. Thus, the model can dynamically adjust the relative importance of contemporary and historical data according to changes in the data flow. This allows the model to adapt faster and more accurately to the current environment.
The outline of this paper is as follows. After this introduction,
Section 2 establishes the KF model of the SINS/GPS loosely integrated navigation systems.
Section 3 presents the design process for the proposed DOS-ELM-aided methodology for SINS/GPS integrated navigation systems during GPS outages. The actual vehicle-mounted experimental data is used for semi-physical simulation in
Section 4. Finally,
Section 5 concludes.
2. KF Model of SINS/GPS Integrated Navigation Systems
Position and speed measurements are used in SINS/GPS loosely integrated navigation systems. The difference between the position/speed obtained by the GPS receiver and the position/speed calculated by the SINS are directly used as Kalman filter inputs. The Kalman filter output adopts feedback correction; the drift error correction of the gyroscope and accelerometer are corrected in SINS. In contrast, the position and speed information directly correct the SINS’s calculation results. Thus, the integrated method’s advantages are its simple structure and easily implemented engineering. The two navigation subsystems are independent, and the navigation information has a certain degree of redundancy.
The state equation of the SINS/GPS integrated navigation systems is as follows:
where
is the state vector; it is as follows:
where
denotes the SINS speed error, and
.
and
are the eastward, northward, and upward axes of the n coordinate system, respectively.
represents the attitude error, and
.
and
are the system’s latitude, longitude, and altitude errors, respectively.
denotes the accelerometer bias, and
.
x,
y, and
z are the three axes of the b coordinate system, respectively.
is the gyroscope drift, and
.
The system noise vector
is as follows:
where
,
, and
represent the noise of the x axial, y axial, and z axial gyroscope, respectively.
,
, and
represent the noise of the x axial, y axial, and z axial accelerometers, respectively. Their means are all zero, and they obey the standard Gaussian distribution.
The system state transition matrix
can be derived according to the attitude error equation, velocity error equation, and position error equation [
1,
2]; it is as follows:
where
is the element of the attitude matrix
.
denotes the SINS speed, and
.
indicates the acceleration, and
.
is the Earth’s rotation angular speed.
and
are the semi-major axis and radius of curvature along the circle of the Earth, respectively.
is the geographic latitude. Other elements in the matrix
are represented as follows:
The system process noise transfer matrix is as follows:
The system measurement equation is as follows:
where
is the observation vector, and
is the observation noise vector.
It is supposed that the SINS’s speed/position information outputs are as follows:
where
,
, and
are the eastward, northward, and upward speeds of the carrier calculated by the SINS, respectively.
,
, and
are the actual eastward, northward, and upward speeds of the carrier, respectively.
,
, and
are the eastward, northward, and upward speed errors of the SINS, respectively.
,
, and
are the latitude, longitude, and altitude of the carrier calculated by the SINS, respectively.
,
, and
are the actual latitude, longitude, and altitude of the carrier, respectively.
,
, and
are the latitude, longitude, and altitude errors of the SINS, respectively.
It is supposed that the speed/position information output by the GPS is as follows:
where
,
, and
are the eastward, northward, and upward speeds of the carrier calculated by the GPS, respectively.
,
, and
are the eastward, northward, and upward speed errors of the GPS, respectively.
,
, and
are the latitude, longitude, and altitude of the carrier calculated by the GPS, respectively.
,
, and
are the latitude, longitude, and altitude errors of the GPS, respectively.
The system observation vector is as follows:
Without considering the control action, it is supposed that the stochastic linear discrete system’s equation is as follows [
22,
23]:
where
is the system’s
-dimensional state matrix.
is the system’s
-dimensional state transition matrix and can be obtained by the discretization of
.
is the
-dimensional noise input matrix, and can be obtained by the discretization of
.
is the system’s
-dimensional observation sequence,
is the
-dimensional observation matrix,
is
-dimensional observation noise sequence, and
is the system’s
-dimensional process noise sequence. Simultaneously,
and
satisfy the following conditions:
,
,
,
, and
.
is the system’s noise variance matrix, and
is the measurement noise variance matrix.
The KF prediction and update processes are then as follows:
- (1)
State one-step prediction
- (2)
- (3)
- (4)
One-step prediction mean square error
- (5)
Estimated mean square error
where
is the estimated state matrix at
.
is the error covariance matrix of the optimal filter value at
.
is the system noise variance matrix at
.
is a unit matrix.
3. ML-aided Methodology during GPS Outages
3.1. Proposed System Structures
A novel ML-aided methodology is proposed and was introduced into the SINS/GPS integrated navigation systems during GPS outages, shown in
Figure 1.
The proposed ML-aided methodology operates as follows. The differences between the speeds/positions of the SINS and GPS are input into the KF module as a measurement value; the estimated attitude, speed, and position errors are fed back to correct the SINS. The SINS’s accelerometer, gyroscope, and the speed/position information of SINS are input into the ML module. After a certain amount of data are stored, the data set is trained using a specific machine learning algorithm to obtain the mapping model between the SINS’ acceleration, specific force, and speed/position increments outputs, and GPS’ speed/position increment. When the GPS signal is unavailable, SINS’ navigation data are input into a trained ML model. The model’s output is used as the optimal estimation of the actual navigation output. In the training procedure, the accelerometer, gyroscope, and speed/position information of the SINS and GPS were input into the ML module as predictors. The obtained mapping model was as the target variable. In the prediction procedure, the SINS’ accelerometer, gyroscope, and speed/position information of the SINS were input into as the ML module as predictors. The estimated pseudo speed/position of the GPS was as the target variable.
3.2. The Typical ML Algorithm
DOS-ELM [
24] is a newly proposed single hidden-layer feedforward neural network. The model’s updating error functions as the forgetting factor’s adjustment signal using the DOS-ELM algorithm. If the accuracy rate drops after the model is updated, the algorithm uses a custom formula to reduce the value of the forgetting factor according to the magnitude of the decline. Compared with the backpropagation neural network (BPNN), DOS-ELM has a higher learning speed, and its nonlinear approximation ability is not reduced by this optimization method. The DOS-ELM algorithm’s forgetting factor can be automatically and dynamically adjusted according to the iterative error, thus avoiding instability [
24]. Therefore, the DOS-ELM algorithm was chosen to aid SINS/GPS integrated systems during GPS outages.
The main steps of the DOS-ELM algorithm can be summarized as follows: a training dataset , the activation function is , the number of hidden layer neurons is , and the initial forgetting factor .
Step 1. Initialization Phase:
An initial model is obtained by training with the initial training set
using the ELM algorithm [
25]. Here, the output weight matrix of this initial model is written as
, and the output matrix of the hidden layer is written as
. The data block identifier is set as
, and a transition variable
. The initial model’s accuracy using the current initial training set is calculated and labeled
.
Step 2. Online Sequential Learning Phase:
- (1)
When a new data block
identified as
begins processing, the output matrix of the model’s hidden layer is updated as follows:
where
denotes the output matrix of the hidden layer corresponding to the new data block.
- (2)
The model’s output weight matrix at the moment is calculated as follows:
where
.
denotes the labels of the new dataset, and
.
- (3)
The prediction accuracy of the current model using the new data block is calculated and labelled
. The accuracy difference between the current model and the model before it was updated is compared as follows:
- (4)
The forgetting factor is updated as follows [
25]:
where
atan() is an arctangent function.
, and
indicates that the importance of new data is the same as that of historical data.
indicates that the relative importance of historical data is lower than that of furture data.
The DOS-ELM algorithm takes the model’s update error as the adjustment signal for the forgetting factor. If the accuracy rate decreases after the model is updated, the algorithm will use the above equation to reduce the value of the forgetting factor according to the extent of the decline. This means that the volume of historical information is reduced and the importance of new data is relatively increased, and vice versa.
- (5)
Check if there are any new data that have not been trained. If so, set , return to (1) in Step 2, and the model’s training continues. Otherwise, the model training is stopped, and the model parameters are output.
At this point, the DOS-ELM-aided methodology for SINS/GPS integrated navigation systems during GPS outages has been implemented.
4. Simulation Results
To verify the feasibility and effectiveness of the proposed methodology, actual vehicle-mounted experimental data were used in an offline semi-physical simulation. A SINS prototype, with fiber-optic gyroscopes and quartz accelerometers as its sensors, was used in the experiment. The specific parameters of the inertial measurement unit (IMU) and GPS are shown in
Table 1. The vehicle-mounted experiment used the PHINS [
26] developed and produced by the French iXBlue company. The prototype’s IMU was fixed to a transition board and placed inside the experimental vehicle. The PHINS was set to GPS integration. The attitude, speed, and position information output after integrating the PHINS and GPS were used as the reference for vehicle navigation information. The installation and structure diagrams of the vehicle experiment are shown in
Figure 2 and
Figure 3, respectively.
The whole experiment lasted approximately 5700 s; initial SINS alignment occurred during seconds 0–900, and SINS/GPS loosely integrated navigation occurred during seconds 1800–5700. Data for seconds 1100–3100 were stored as the training data set for the DOS-ELM algorithm. When training was finished, the system entered the prediction phase. Three stages of GPS outages (from the 3500 s to 3800 s; 4100 s to 4300 s; and 4500 s to 4700 s) were artificially set. The navigation track and experimental vehicle trajectory are shown in
Figure 4 and
Figure 5, respectively. Here, three sections of GPS outages are marked by the red lines.
The vehicle’s dynamic characteristics during the experiment are shown in
Figure 6, which illustrates that the vehicle’s driving state is complex and repetitive, which met the requirements for ML algorithms training data sets.
Figure 7 presents an intelligent estimation process of the pseudo GPS speed/position. The predicted values were very close to the actual speed/position information. To demonstrate the proposed method’s advantage, it was compared with the pure INS method. During GPS outages, the system operated in pure INS mode.
Figure 8,
Figure 9 and
Figure 10 show the speed/position errors of both east and north directions of the DOS-ELM-aided method, the pure INS method, and the high-precision reference during GPS outages #1, #2, and #3, respectively. In these three figures, the red and blue lines correspond to the results of the pure INS and DOS-ELM-aided methods, respectively. The error of the pure INS method generally oscillated sharply and quickly diverged. Although the error correction of the DOS-ELM-aided method to the navigation solution could not achieve an effect similar to the complete convergence of the filter on the error, it dramatically reduced the error value.
Table 2 presents the mean and standard deviation (SD) of speed/position errors during GPS outages #1, #2, and #3.
Table 2’s comparison of the information fusion algorithm using the DOS-ELM-aided and pure INS methods shows that the DOS-ELM-aided algorithm’s navigation calculation error was lower than the pure INS calculation error. The DOS-ELM-aided algorithm’s calculation result was very close to the reference value of the integrated system navigation solution. The error values of the pure INS solution were different during GPS outages #1, #2, and #3, indicating that, in the several calculation epochs before the GPS signal failure, the filtering estimation had other correction effects on the INS navigation calculation under normal GPS measurement update conditions. In addition, integrated factors, such as the uncertainty of the IMU device’s error drift, affected the GPS. When the GPS signal failed, the INS calculation error was uncertain, whereas the DOS-ELM-aided method realized a partial correction of the INS navigation calculation error.