Next Article in Journal
Electrochemical Enzyme Biosensor Bearing Biochar Nanoparticle as Signal Enhancer for Bisphenol A Detection in Water
Next Article in Special Issue
CC-DTW: An Accurate Indoor Fingerprinting Localization Using Calibrated Channel State Information and Modified Dynamic Time Warping
Previous Article in Journal
A Discrete Curvature Estimation Based Low-Distortion Adaptive Savitzky–Golay Filter for ECG Denoising
Previous Article in Special Issue
Wi-Fi-Based Effortless Indoor Positioning System Using IoT Sensors
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Steering Angle Assisted Vehicular Navigation Using Portable Devices in GNSS-Denied Environments

1
Geomatics Engineering Department, University of Calgary, Calgary, AB T2N 1N4, Canada
2
Department of Electrical Engineering, Port Said University, Port Said 42523, Egypt
*
Author to whom correspondence should be addressed.
Sensors 2019, 19(7), 1618; https://doi.org/10.3390/s19071618
Submission received: 9 March 2019 / Revised: 30 March 2019 / Accepted: 2 April 2019 / Published: 4 April 2019
(This article belongs to the Special Issue Sensor Fusion and Novel Technologies in Positioning and Navigation)

Abstract

:
Recently, land vehicle navigation, and especially by the use of low-cost sensors, has been the object of a huge level of research interest. Consumer Portable Devices (CPDs) such as tablets and smartphones are being widely used by many consumers all over the world. CPDs contain sensors (accelerometers, gyroscopes, magnetometer, etc.) that can be used for many land vehicle applications such as navigation. This paper presents a novel approach for estimating steering wheel angles using CPD accelerometers by attaching CPDs to the steering wheel. The land vehicle change of heading is then computed from the estimated steering wheel angle. The calculated change of heading is used to update the navigation filter to aid the onboard Inertial Measurement Unit (IMU) through the use of an Extended Kalman Filter (EKF) in GNSS-denied environments. Four main factors that may affect the steering wheel angle accuracy are considered and modeled during steering angle estimations: static onboard IMU leveling, inclination angle of the steering wheel, vehicle acceleration, and vehicle inclination. In addition, these factors are assessed for their effects on the final result. Therefore, three methods are proposed for steering angle estimation: non-compensated, partially-compensated, and fully-compensated methods. A road experimental test was carried out using a Pixhawk (PX4) navigation system, iPad Air, and the OBD-II interface. The average Root Mean Square Error (RMSE) of the change of heading estimated by the proposed method was 0.033 rad/s. A navigation solution was estimated while changes of heading and forward velocity updates were used to aid the IMU during different GNSS signal outages. The estimated navigation solution is enhanced when applying the proposed updates to the navigation filter by 91% and 97% for 60 s and 120 s of GNSS signal outage, respectively, compared to the IMU standalone solution.

1. Introduction

Recently, Inertial Measurement Units (IMUs) and Global Navigation Satellite Systems (GNSS) have been widely used to provide accurate and reliable navigation information (i.e., altitude, velocity, and position). GNSS has long-term stability in ideal conditions but has certain limitations in urban areas (e.g., congested areas), inside tunnels and under heavy tree canopies. IMU is completely self-contained and autonomous, but suffers from accuracy degradation over time [1]. The integration of GNSS and IMU can maximize the respective advantages and minimize the individual drawbacks, providing a more consistent navigation solution [2]. Furthermore, many sensors can also be used to aid the IMU, such as Light Detection and Ranging (LiDAR) [3], cameras [4], odometers [5], magnetometers [6], barometers, ultrasonic sensors [7], etc. However, there are some limitations to these aiding sources which will be discussed in the Problem Formulation section.
Consumer portable devices (CPDs) such as tablets and smartphones contain many sensors—such as GNSS receivers, IMUs, barometers and magnetometers—that can be used in navigation [8]. CPDs, therefore, offer all the measurements needed to provide full navigation states. This paper introduces a new way of using CPDs to measure heading changes by estimating the steering angle as an update in the navigation estimation filter. The steering angle information may be determined from the Controller Area Network (CAN) bus, using Steering Angle Sensors (SAS). However, this information is not typically provided by commercial OBD-II units, and it requires additional customized hardware and software designs [9,10,11].

2. Related Works

The last decade has seen major research on the use of the consumer portable devices in land vehicle applications such as navigation applications [12,13], road condition analyses [14], traffic states [15], and insurance telematics [16]. Different smartphone applications for land vehicles are summarized in review paper [17].
CPDs have also been used in land vehicle navigation applications. For example in Ref. [18], the MEMS IMU inside an iPhone 4 was integrated with GPS along with Non-Holonomic Constraint (NHC) for car navigation using loosely-coupled integration through the use of an Extended Kalman Filter (EKF). The authors concluded that the accuracy of the attitude angle is in the range of 2 degrees for heading and less than 1.5 degrees for roll and pitch, while the position accuracy reached 30 m after 30 s of GNSS signal outage. Three-dimensional accelerometers and one gyroscope were used by Ref. [19], in addition to a probabilistic map-matching algorithm to tune the navigation solution and calibrate the inertial sensors errors.
Automatic parking positioning (Park Sense) has been proposed by Ref. [20] by sensing in-vehicle magnetic field variations using a smartphone magnetometer. Precise magnetic fingerprinting-based outdoor localization has been proposed by Ref. [21]. Smartphone gyroscopes have been integrated with a vehicle’s CAN bus for speed information to provide a navigation solution during GNSS signal outages using a Kalman Filter [22]. A vehicle navigation system was proposed by Ref. [23] using the smartphone rear camera and IMU to identify the position of a car within the lane using computer vision techniques, to an accuracy of 88.5%. Smartphone sensors (GNSS, and IMU) have been used by [24] for lane localization through machine-learning based on a Support Vector Machine (SVM) -based lane-change identification algorithm to detect lane changes to an accuracy of 98 %. In Ref. [25], a mobile mapping system using a smart phone GNSS, MEMS IMU, an odometer (CAN bus), and Velodyne HDL-32e LiDAR was developed using the SLAM and loop closure method, where the output maps were used for self-driving applications. VeMap, a roadmap construction system based on smartphones inside vehicles, was proposed by Ref. [26]; in this approach, multiple sensors were fused together for navigation-denied GNSS environments such as underground parking.
Most approaches reported in the literature have used gyroscopes as the main sensors for estimating steering wheel angles. However, these methods are very sensitive to gyro errors. Therefore, some research has integrated other sensors to compensate for these errors. Ref. [27] used gyroscopes to estimate steering wheel angles and incorporated accelerometer and magnetometer measurements to reduce biases and errors due to the gyroscope errors through the use of an Extended Kalman Filter; the main problem here is introducing more sensors, as well as minimizing errors and biases, to the system when estimating the steering wheel angle. Furthermore, this work [27] didn’t compensate for vehicle inclination, which may affect the accuracy of the estimated steering wheel angle. Other related works have used gyroscope data from smartwatches to measure wrist rotation; in this way, the steering wheel angle can be estimated in unsafe driving detection applications [28]. In Ref. [29], both the accelerometer and gyroscope measurements have been integrated through a weighted average method to estimate steering wheel angles where the gyroscope was the main sensor. However, the vehicle inclination and acceleration, static leveling, and the steering wheel inclination angles are not considered for the computation of steering wheel angles.
Other researchers have used the accelerometers as the main sensors to estimate steering wheel angles. Ref. [30] used accelerometers only to estimate the steering wheel angle. The steering wheel inclination angle is considered here, but vehicle inclination is not taken into consideration during estimations. Moreover, the acceleration and the deceleration of the vehicle (the non-gravity-related acceleration) were not modeled in the solution. A low-cost driving data acquisition system for different land vehicles, BigRoad, was proposed by [11]. These data, comprising steering wheel angle, speed, and conditions of the surrounding environment of the vehicle, are obtained using smartphones and IMUs installed inside the vehicle. However, the method of estimating the steering angle using Invensense MPU-9150 accelerometers takes into account neither the leveling of the device in a static state nor the vehicle inclination. Moreover, the steering wheel inclination was estimated using gyroscopes which require rotation maneuvers. Finally, they didn’t employ the estimated steering wheel angle in navigation states estimations.

3. Problem Formulation and Objective

Many aiding sensors have been discussed in previous papers, as described in the introduction. However, most of these have some limitations; for example, LiDAR aiding is expensive and typically needs high storage and high processing, and may be affected by weather conditions. On the other hand, vision-aided navigation systems suffer from weather and lighting conditions in addition to scale issues when using a single camera. Magnetometers may be used as aiding sensors for IMUs, but they suffer from many issues such as the magnetic interference (soft and hard iron effects) [31], biases and scale factors, in addition to environmental magnetic disturbances that greatly affect the magnetometers [32], especially in land vehicle navigation applications.
As the accelerometer measures only the linear acceleration of the device, it could be used to estimate both the roll and pitch angles, but it cannot observe the heading (azimuth) or its change. Gyroscopes are the most commonly-used sensor used for heading/azimuth change measurements, but such measurements are typically contaminated by a high level of errors (bias + scale factor, noise) on account of the consumer-level sensors used in CPDs.
The main objective of this paper is to introduce a new way to use CPD sensors to update IMUs in land vehicle navigation estimation filters. The idea is based on estimating the steering wheel angle using CPD accelerometers mounted on the steering wheel. This steering angle is converted to change of heading information for the vehicle motion, which can be considered as a heading update to the navigation solution through EKF to limit IMU drift during GNSS signal outages.

4. Methodology

This paper introduces a new approach for estimating the navigation states of land vehicles in GNSS-denied environment by integrating CPD sensors with onboard sensors along with vehicle information through EKF. The navigation system architecture is shown in Figure 1.
The system will obtain information from three sources:
(1)
An integrated GNSS and IMU to estimate the full vehicle navigation states. In this integration, the GNSS provides the absolute position and velocity. This integration is called the onboard sensors.
(2)
Vehicle information which can be obtained via the On-Board Diagnostics (OBD-II). The OBD-II provides forward velocity of the vehicle direction which can be used as a velocity update to limit the IMU velocity and position drift during GNSS signal outages.
(3)
A new idea for using CPD sensors to estimate the heading of the vehicle. The main idea depends on mounting the portable device onto the steering wheel of the vehicle to estimate the rotation angle of the steering wheel (called steering angle), using the self-contained tri-axial accelerometers of the CPD. This steering angle can then be used to compute changes of heading of land vehicles.
It is very well known that heading errors of IMU constitute one of the major sources of position drifts. For example, gyroscope bias introduces heading errors through the following equations:
δ A = b ω ω e cos ϕ
δ P = ( 1 6 ) b ω g t 3
where δA is the heading error, bw is the gyroscope bias, ωe is the Earth’s rotation (15 °/hr), and φ is the latitude of the vehicle. δP is the position error due to the gyroscope drift (bω), g is the gravity acceleration, t is the time since the IMU work in stand-alone mode. For example, for a gyroscope with a drift of 0.1 °/s, after 10 s, the position error will reach around 2.85 m. Therefore, constraining the heading drift will dramatically reduce position errors during GNSS signal outages. However, there are four main factors that should be compensated for in order to better estimate the steering angle, i.e.,:
(1)
The static leveling of the GNSS/IMU integrated system.
(2)
The inclination angle of the steering wheel.
(3)
The acceleration of the vehicle.
(4)
The vehicle inclination.
These factors are discussed in detail in the next subsections.

4.1. Different Used Coordinate Frames

In this research, four main coordinate frames are used:
  • The steering wheel frame, which is a fixed frame, is defined at a 0° steering angle, where the x-axis is in the up direction and is defined as xs, while ys is perpendicular to xs and in the same plane of the steering wheel and pointing to the left direction, while zs is perpendicular to the steering wheel plane (xs-ys plane).
  • The CPD frame comprises the 3-axis accelerometers frame which rotates with the steering wheel where x’ and y’ are in the upper and left direction respectively while z’ is perpendicular to the CPD plane defined by x’ and y’. When the steering angle equals zero, both frames coincide with each other. Figure 2 shows the relationship between both frames at two different steering angles: zero and (θ), respectively.
  • Body frame (vehicle frame). The IMU body frame is defined by the axis of the accelerometers of the IMU, and in this research, it is aligned with the vehicle frame in which the vehicle forward direction is aligned with the x-axis of the onboard IMU (Xv), while the y-axis (Yv) of the onboard IMU coincides with the vehicle lateral direction, and finally, the IMU z-axis (Zv) is directed downwards, as shown in Figure 3.
  • The navigation frame is defined as the local level frame (North, East, and Down directions) in which the orientation and the velocity are estimated.

4.2. Static Leveling of Vehicle Onboard IMU

The inclination of the vehicle in a stationary condition should be taken into consideration before estimating the steering angle. This inclination is caused by the presence of the vehicle on an up- or down-hill road. The vehicle pitch and roll angles are functions of the earth’s gravity acceleration (g) components sensed by the x, and y onboard IMU accelerometers (forward and lateral direction of the vehicle), as given in Equations (3) and (4).
r = sin 1 ( a Y v g )
p = sin 1 ( a X v g )
Generally, the pitch angle is much more important than the roll angle in regular land vehicle navigation because cars may experience large changes in elevation on normal roads (e.g., on mountainous roads). Therefore, cars’ motion can experience significant pitch angles. On the other hand, the roll can be neglected because of its very small values under normal road conditions.

4.3. Inclination Angle of Steering Wheel

The second factor which should be compensated for when determining the steering angle is the inclination angle of the steering wheel (δ), as shown in Figure 4. The steering wheel inclination angle is the angle between the zs axis and the car forward direction axis (Xv).
There are two methods that can be used to estimate the steering wheel inclination angle; the first depends on the x and y accelerometers of the CPD that lie on the same plane as the steering wheel. The following equations show the relationship between the x and y accelerometers with gravity acceleration, the steering wheel inclination angle (δ) and the steering angle (θ).
a x = g cos δ cos θ a y = g cos δ sin θ
a x 2 = g 2 cos 2 δ cos 2 θ a y 2 = g 2 cos 2 δ sin 2 θ
a x 2 + a y 2 = g 2 cos 2 δ [ cos 2 θ + sin 2 θ ]
The inclination angle can be estimated from Equation (8).
δ = cos 1 ( a x 2 + a y 2 g 2 )
The second method uses the third accelerometer that is perpendicular to the steering wheel plane (i.e., the z accelerometer), as shown in Equations (9) and (10).
a z = g sin δ
δ = sin 1 ( a z g )
However, in Equations (9) and (10), the vehicle is assumed to be on horizontal terrain when calculating the steering wheel inclination (i.e., the body or the vehicle frame coincides with the direction of gravity and the horizontal axis). Figure 5 shows the different cases for calculating the steering wheel inclination (δ) based on the pitch (P) of the vehicle at the start of the navigation.
For uphill or downhill roads, the non-compensated steering wheel inclination angle (δ’) is calculated, instead of the steering wheel inclination angle (δ), using Equations (8) and (10) (δ’ is the angle between the zs axis and the horizontal plane). The steering wheel inclination angle should be compensated for by the pitch angle which was determined during the static leveling process, as given in Equations (11) and (12) for the two cases of the uphill and downhill terrains respectively.
δ = δ + P
δ = δ P
Finally, the estimated inclination angle from the two previous methods (Equations (8) and (10)) are fused into a single estimate to make use of all used accelerometer sensors through least squares adjustment.

4.4. Steering Angle Estimation Using Portable Devices Accelerometers

The relationship between the vehicle’s frame and the fixed steering frame can be derived as shown in Figure 6.
The acceleration in the xs direction senses three components, i.e., the forward and vertical vehicle acceleration and the gravity acceleration, after compensating for all of them with the inclination angle. On the other hand, the acceleration in direction ys measures the lateral vehicle acceleration only. Meanwhile, the measured acceleration in the zs direction includes components of the forward and the vertical vehicle acceleration, as shown in Equations (13)–(15).
a x s = a X v sin δ g cos δ ( a Z v + g ) cos δ
a y s = a Y v
a z s = a X v cos δ ( a Z v + g ) sin δ
The relationship between the fixed and the rotating steering frames is described in Equation (16).
[ a x a y ] = [ cos θ sin θ sin θ cos θ ] [ a x s a y s ]
The relation between the vehicle frame and the rotating steering frame is described in Equations (17) and (18).
a x = cos θ [ a X v sin δ g cos δ ( a Z v + g ) cos δ ] a Y v sin θ
a y = a Y v cos θ sin θ [ a X v sin δ g cos δ ( a Z v + g ) cos δ ]
The steering angle can be derived using Equations (19) to (26).
a x = a x s cos θ + a y s sin θ
a y = a x s sin θ + a y s cos θ
Dividing Equation (20) by Equation (19) gives:
a y a x = a x s sin θ + a y s cos θ a x s cos θ + a y s sin θ
a y a x = a x s tan θ + a y s a x s + a y s tan θ
Cross multiplication between the left and right-hand sides of Equation (22).
a x [ a x s tan θ + a y s ] = a y [ a x s + a y s tan θ ]
a x a x s tan θ + a x a y s a y a x s a y a y s tan θ = 0
a x a x s tan θ + a y a y s tan θ = a x a y s a y a x s
tan θ = a x a y s a y a x s a x a x s + a y a y s
Finally, Equation (27) leads to the steering angle.
tan θ = a x a Y v a y [ a X v sin δ g cos δ ( a Z v + g ) cos δ ] a x [ a X v sin δ g cos δ ( a Z v + g ) cos δ ] a y a Y v

4.5. Vehicle Inclination

When the car moves up- or down-hill, the x accelerometer of the onboard IMU senses a partial component of the gravity acceleration vector while the z accelerometer senses the rest of the vector. Equations (28)–(30) show this effect.
a X v = a X v g sin p
a Y v = a Y v
a Z v = a Z v + g cos p
where the pitch angle is estimated using GNSS/IMU integration solution of the onboard sensors. Such a compensation accounts for the dynamic change of the vehicle inclination.
Therefore, the general formula for determining the steering angle is expressed as follows in Equation (31).
tan θ = a x a Y v a y [ a X v sin δ g cos δ a Z v cos δ ] a x [ a X v sin δ g cos δ a Z v cos δ ] a y a Y v
This general equation takes into consideration all the factors that may affect the steering angle estimation, i.e., the static leveling of the onboard IMU, the inclination angle of the steering wheel, the land vehicle acceleration, and the dynamic change of the vehicle’s inclination.
Figure 7 shows a flow chart of the full compensation for the steering angle estimation, in which all the four aforementioned factors are implemented to estimate the steering angle.

4.6. Change of Heading Computaion

Changes of heading of the vehicle motion are determined after estimating the steering angle by multiplying this angle by the Vehicle Steering Ratio (VSR). The VSR is defined as the ratio between the steering wheel angle and the wheel (tire) angle (which is the heading change of the vehicle). This ratio varies from one car to another, depending on the type and model of the car; it ranges between (1:12) to (1:24) [33]. This ratio is constant for a certain type and model of vehicle. Equation (32) shows the relationship between the change of heading (Δθvehicle) and the steering angle (θsteering) [11].
Δ θ v e h i c l e = ( V S R ) θ s t e e r i n g

5. Land Vehicle Navigation Estimation

Land vehicle navigation states are usually estimated through GNSS/IMU integration to determine the navigation states which include: 3D position, 3D velocity and the orientation of the vehicle. The next subsection describes the GNSS/IMU integration through EKF, while the second subsection describes the proposed updates to estimate the land vehicle navigation states.

5.1. GNSS/IMU Integration

GNSS/IMU integration can be implemented through loosely-, tightly-, or deeply-coupled integration schemes [34]. In this research, a loosely-coupled integration scheme is used where GNSS provides both position and velocity updates to the IMU navigation solution through EKF.
KF is based on two main models: the system model and the observation model. The system model describes changes in states over time [35]. The continuous time system model is expressed in Equation (33).
x ˙ ( t ) = F ( t ) x ( t ) + G ( t ) w ( t )
where x ˙ is the time rate of change of the state vector, F is the dynamics matrix, x is the state vector, G is the shaping matrix, and w is white noise. The system may be described in a discrete time model [36], as given in Equation (34).
x k + 1 = ϕ k , k + 1 x k + w k
where ϕ is the transition matrix which is calculated using the dynamics matrix, as given in Equation (35), where Δt is the discrete time interval and I is an identity matrix.
ϕ = ( I + F Δ t )
The observation model is described in Equation (36), where zk is the observation vector, Hk is the design matrix and η is the measurement noise.
z k = H k x k + η k
KF is divided into two main stages: the prediction stage and the update stage [36]. The system model is responsible for the prediction stage, in which the error states (xk) and its covariance matrix (Pk) are predicted, as in Equations (37) and (38).
x k = ϕ k , k 1 x k 1 +
P k = ϕ k , k 1 P k 1 + ϕ k , k 1 T + Q k 1
where (−) define the predicted values and (+) define the updated values, (Qk−1) is the process noise matrix which describes the degree of confidence in the system model.
The second stage is the update stage, in which the Kalman gain (Kk) is computed as in Equation (39), which is a function of the degree of confidence of the observation model (Rk), as well as the degree of confidence of the system model, which is represented in the predicted covariance matrix of the error states. Next, the updated error states, as well as the updated covariance matrix, are computed [36], as shown in Equations (40) and (41).
K k = P k H k T [ H k P k H k T + R k ] 1
x k + = x k + K k [ z k H k x k ]
P k + = [ I K k H k ] P k
The error states are described, as shown in Equation (42)
δ x = [ δ P 1 × 3 δ v 1 × 3 δ θ 1 × 3 b a 1 × 3 b g 1 × 3 S a 1 × 3 S g 1 × 3 ]
where the first three elements of the vector are the navigation error states which are 3D position, 3D velocity, and three attitude angles (roll, pitch, and azimuth) respectively; the other four elements are the biases and scale factors of the accelerometers and gyroscopes. ba and bg are the bias drift of the accelerometers and gyroscopes in x, y, and z directions respectively, and Sa and Sg are the scale factor of the 3D accelerometers and the 3D gyroscopes respectively.

5.2. Navigation System Integration Architecture

The proposed navigation system integrates onboard navigation sensors (GNSS/IMU) with CPD sensors (triaxial accelerometers) and vehicle forward velocity from OBD-II. In the proposed navigation system, GNSS-derived positions and velocities are integrated with IMU through EKF. The IMU is also used to provide navigation information during GNSS signal outages, and can be used for fast GNSS signal reacquisition. In this case, and to control IMU drift, the heading change estimated from the CPD accelerometers and the vehicle forward velocity provided through OBD-II are used as update measurements in EKF.
For the partially-compensated steering angle estimation method, additional static leveling compensation is applied to correct the inclination angle of the steering wheel before computing the steering angle. For the fully-compensated steering angle determination method, the onboard accelerometer, as well as the pitch angle that is estimated using EKF, will contribute to making steering angle estimations. Finally, the non-compensated steering angle estimation method does not take into account any of the previous mentioned factors. Figure 8 shows the proposed navigation scheme with different compensation level of the steering angle estimation method.

6. Experimental Results

A land vehicle test was conducted at the city of Calgary. The onboard navigation system includes the Pixhawk (Px4), which consists of Invensense MPU-6000 and a u-blox GPS single frequency receiver (LEA-6H module), while the CPD was the iPad air, which was mounted onto the driving steering wheel of a Ford Focus car. An OBD-II interface (Uni-link Mini ELM327 OBD-II Bluetooth Scanner Tool) was used in the experiment to access information about the vehicle’s forward velocity.
The data rate of the Pixhawk IMU is 25 Hz, while that of the GPS is 5 Hz. On the other hand, the iPad IMU’s data rate is 50 Hz, which is acquired by SensorLog software application, and that of the OBD-II is 1 Hz. In our tests, the change of heading updates estimated from the iPad were downsampled to 5 Hz during navigation solution estimations in the EKF.

6.1. Steering Angle and Heading Change Results Using CPD Accelerometers

As described, steering angle and heading changes can be estimated by three methods: non-compensated, partially-compensated, and fully-compensated. The non-compensated method doesn’t consider any of the previously mentioned factors that may render steering angle estimations less effective. The partially-compensated method considers the static leveling of the onboard IMU accelerometers, as well as the inclination angle of the steering wheel and the acceleration of the vehicle; it doesn’t consider dynamic changes in the vehicle’s inclination. Finally, the fully-compensated method takes into consideration all the aforementioned factors. These three methods were compared in this test. Figure 9 shows steering angle determinations using the partially and non-compensated methods and the difference between them. The figure clearly show that the two methods generally offer similar trends.
The maximum difference between the non- and partially-compensated steering angle estimates is around 19°. The Root Mean Square (RMS) of the difference between these two methods is 3.6436° for the steering angle difference and 0.2277° for the change of heading difference.
Table 1 lists the RMS of the steering angle and change of heading differences between the non-, partially- and fully-compensated methods.
As shown in Table 1, there is a significant difference between the non- and the partially-compensated methods’ estimates: the difference is slightly higher between the non- and the fully-compensated methods. However, there is a slight difference between the partially- and the fully-compensated methods.
The difference between the change of heading estimated by the three methods and the reference heading change determined by the GNSS/INS integration were computed to evaluate the proposed techniques. Table 2 shows the Root Mean Square Error (RMSE) of the three proposed methods.
Figure 10 depicts the histogram of the change of heading difference between the fully-compensated method and the GNSS/INS integrated solution.
The three methods are used in navigation state estimations using EKF through changes of heading updates to show the effect of each method on the final estimated navigation states, as will be discussed in the next section.

6.2. Navigation States Estimation Using EKF

This section is divided into two subsections. The first shows the effect of each steering angle estimation method on the final integrated navigation solution, while the second shows the effect of different updates on the final estimated navigation states.

6.2.1. Effect of the Three Steering Angle Estimation Methods on the Navigation Solution

Changes of heading are computed through the three methods to show the effect of each method on the final navigation solution. The change of heading contributes to integrated navigation estimations as a relative heading update where the heading at time (k + 1) is equal to the heading at time (k) plus the change of heading (Δθvehicle) as given in Equation (43).
H e a d i n g k + 1 = H e a d i n g k + Δ θ v e h i c l e
The vehicle steering ratio, in our case for the Ford Focus, is (1:16); this was provided in the manufacture’s specifications.
First, the navigation solution is estimated using the Pixhawk (Px4) GNSS/IMU integrated system as the reference navigation, which has an expected sub-meter level accuracy. Then, different simulated GNSS signal outages are applied for 60 s and 120 s. During these periods, the IMU works in stand-alone mode to provide the navigation solution. Figure 11 shows the reference trajectory, the GNSS signal outage region, and the IMU stand-alone navigation solution for the periods of 60 and 120 s GNSS signal outage for two different sample outage regions.
As shown in Figure 11, the IMU navigation solution deviates considerably from the reference navigation solution due to the large bias drifts of the accelerometers and gyroscopes. The average RMSE of the position of the IMU stand-alone navigation solution for different GNSS signal outages is 98.97 m for 60 s GNSS signal outage and 392.105 m for 120 s GNSS signal blockage.
Change of heading and velocity updates are then applied to aid the IMU during GNSS signal outages. The three developed methods of steering angle and change of heading estimation are used separately in the navigation solution. Figure 12 shows the reference trajectory with the outage period and the IMU/vehicle forward velocity/change of heading integrated navigation solution for 60 and 120 s GNSS signal blockage when using the fully-compensated steering angle estimation method for different outage regions.
Figure 12 shows that the integrated navigation solution is very close to the reference solution and provides more accurate solutions compared to the IMU standalone navigation during GNSS signal outages.
Two other integrated navigation solutions were tested using the other two steering angle estimation methods, i.e., the non- and partially-compensated methods, to compare the final integrated navigation position states estimations. Table 3 lists the average RMSE of the three methods for different outage periods.
The fully-compensated steering angle estimation method provides the best navigation results, reaching 5.47 m for 60 s outage and an average RMSE of 14.18 m for 120 s GNSS signal outage. However, there is a slight difference between the partially- and fully-compensated methods. Such a difference could be attributed to the fact that the test area does not exhibit a high level of variation of height. The non-compensated method provides the least accurate position solution. However, the performance variation between the methods is expected to increase under more extreme acceleration patterns and high height variations in the vehicle’s motion.
A comparison between the results with different factors being taken into account was included to assess whether the extra hardware/processing required to consider all factors is justified and can significantly affect the final results. The comparison results indicate that the sole use of CPD (without any usage of external information from the onboard IMU) could achieve comparable results to that of a fully integrated system.

6.2.2. Effect of Different Updates on the Navigation Solution

Different updates can contribute to integrated navigation estimations during GNSS signal outages by limiting the IMU drift. These updates include velocity updates from OBD-II and heading change updates from steering angle calculations. Different combinations of updates for navigation estimations were tested in order to study the effect of each update on the final navigation solution.
Table 4 describes the average RMSE for different GNSS signal outage regions of the integrated navigation solution using the IMU standalone, IMU/velocity update integration, and IMU/forward velocity updates/proposed change of heading updates navigation solutions.
Table 4 shows that integrating the IMU standalone solution with the velocity and heading change updates provides more accurate navigation solutions than the IMU/forward velocity integrated solution. The position RMSE of the proposed heading update, along with the velocity update when aiding IMU, reaches 8.56 m and 15.33 m for 60 and 120 s GNSS signal outage respectively. On the other hand, the RMSE of the IMU /forward velocity integrated solution reaches 9.20 m and 16.10 m for 60 s and 120 s GNSS signal outage respectively.
It was observed that the change of heading updates slightly enhance the solution when they are provided to the navigation filter. However, in a GNSS denied environment, land vehicle navigation solution accuracy depends on the accuracy of the INS, the availability and the accuracy of velocity data, and heading change updates. The INS accuracy is based on the precision of the INS parameters during the GNSS availability period. However, if such a condition is not fulfilled, the quality of the navigation solution will deteriorate, and the heading change role will be able more significantly improve the solution. Moreover, an accurate change of heading estimation can help in achieving a comparable solution without an extra INS system i.e., using the proposed heading change estimation method with the vehicle velocity being obtained from a commercial OBD II to form a dead reckoning system.

7. Conclusions

Consumer portable device accelerometers are employed to improve the accuracy of a low-cost vehicle onboard IMU during GNSS signal outages by estimating heading changes of the vehicle, which serve as updates through the EKF to mitigate the IMU drift. Changes of heading are estimated by calculating the steering wheel angle through three methods: non-compensated, partially-compensated, and fully-compensated steering angle estimation. There are four main factors that influence the steering angle computation: the static leveling of the onboard IMU in vehicle stationary mode, the inclination angle of the vehicle’s steering wheel, the vehicle acceleration, and the changes of vehicle inclination due to vehicle motion on up- or down-hill roads, which affects the vehicle’s acceleration, as measured across the vehicle longitudinal axis. An experimental test was conducted, and the navigation solution was improved to obtain an accuracy 91% for 60 seconds of GNSS signal outage when providing the navigation filter with the proposed change of heading and velocity updates when compared with the IMU standalone solution.
The proposed change of heading estimation methods are based on the use of CPD accelerometers only. Other sensors such as gyroscopes and/or magnetometers are not used to avoid gyro drift and magnetometer interference problems. Moreover, the estimation method doesn’t require any external dedicated hardware/software to acquire the steering wheel angle, which reduces the system cost. Finally, the proposed steering wheel angle estimation is not used only for land vehicle navigation enhancement, but may also be employed in driving safety applications.

Author Contributions

This is research work accomplished under the supervision of N.E.-S. M.M., and A.M. designed and implemented the proposed algorithm and performed the experiments. M.M. wrote the paper. N.E.-S. contributed the sensors used in the experiments. N.E.-S., and A.M. reviewed and provided feedback on the paper.

Funding

This research was funded by NSERC, and Canada Research Chairs programs.

Acknowledgments

This work was supported by Dr. Naser El-Sheimy research funds from NSERC and Canada Research Chairs programs.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Niu, X.; Nassar, S.; El-Sheimy, N. An Accurate Land-Vehicle MEMS IMU/GPS Navigation System Using 3D Auxiliary Velocity Updates. J. Inst. Navig. 2007, 54, 177–188. [Google Scholar]
  2. Liu, H.; Nassar, S.; El-Sheimy, N. Two-filter smoothing for accurate INS/GPS land-vehicle navigation in urban centers. IEEE Trans. Veh. Technol. 2010, 59, 4256–4267. [Google Scholar] [CrossRef]
  3. Tang, J.; Chen, Y.; Niu, X.; Wang, L.; Chen, L.; Liu, J.; Shi, C.; Hyyppa, J. LiDAR scan matching aided inertial navigation system in GNSS-denied environments. Sensors 2015, 15, 16710–16728. [Google Scholar] [CrossRef] [PubMed]
  4. Wolcott, R.W.; Eustice, R.M. Visual Localization within LIDAR Maps for Automated Urban Driving. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Chicago, IL, USA, 14–18 September 2014; pp. 176–183. [Google Scholar]
  5. Carlson, C.R. Estimation with Applications for Automobile Dead Reckoning and Control. Ph.D. Thesis, Stanford University, Stanford, CA, USA, April 2004. [Google Scholar]
  6. Ladetto, Q.; Gabaglio, V.; Merminod, B. Combining Gyroscopes, Magnetic Compass and GPS for Pedestrian Navigation. In Proceedings of the International Symposium on Kinematic Systems in Geodesy, Geomatics, and Navigation, Banff, AB, Canada, 5–8 January 2001; pp. 205–212. [Google Scholar]
  7. Moussa, M.; Moussa, A.; El-Sheimy, N. Ultrasonic based heading estimation for aiding land vehilce navigation in GNSS denied environment. Available online: https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-1/315/2018/isprs-archives-XLII-1-315-2018.pdf (accessed on 3 April 2019).
  8. Li, Y.; Georgy, J.; Niu, X.; Li, Q.; El-Sheimy, N. Autonomous calibration of MEMS gyros in consumer portable devices. IEEE Sens. J. 2015, 15, 4062–4072. [Google Scholar] [CrossRef]
  9. Xiao, Z.; Li, P.; Havyarimana, V.; Georges, H.M.; Wang, D.; Li, K. GOI: A Novel Design for Vehicle Positioning and Trajectory Prediction Under Urban Environments. IEEE Sens. J. 2018, 18, 5586–5594. [Google Scholar] [CrossRef]
  10. Farroni, F.; Pasquino, N.; Rocca, E.; Timpone, F. A comparison among different methods to estimate vehicle sideslip angle. In Proceedings of the World Congress on Engineering, London, UK, 1–3 July 2015; Volume 2218. [Google Scholar]
  11. Liu, L.; Li, H.; Liu, J.; Karatas, C.; Wang, Y.; Gruteser, M.; Chen, Y.; Martin, R.P. BigRoad: Scaling road data acquisition for dependable self-driving. In Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services, New York, NY, USA, 19–23 June 2017; pp. 371–384. [Google Scholar]
  12. Eren, H.; Makinist, S.; Akin, E.; Yilmaz, A. Estimating driving behavior by a smartphone. In Proceedings of the 2012 IEEE Intelligent Vehicles Symposium, Alcala de Henares, Spain, 3–7 June 2012; pp. 234–239. [Google Scholar]
  13. Johnson, D.A.; Trivedi, M.M. Driving Style Recognition Using a Smartphone as a Sensor Platform. In Proceedings of the 14th International IEEE Conference on Intelligent Transportation Systems, Washington, DC, USA, 5–7 October 2011; pp. 1609–1615. [Google Scholar]
  14. Strazdins, G.; Mednis, A.; Kanonirs, G. Towards Vehicular Sensor Networks with Android Smartphones for Road Surface Monitoring. Available online: https://www.researchgate.net/profile/Girts_Strazdins/publication/235429698_Towards_Vehicular_Sensor_Networks_with_Android_Smartphones_for_Road_Surface_Monitoring/links/00b4951f01ab1658fc000000/Towards-Vehicular-Sensor-Networks-with-Android-Smartphones-for-Road-Surface-Monitoring.pdf (accessed on 3 April 2019).
  15. Mohan, P.; Padmanabhan, V.N.; Ramjee, R. Nericell: Rich Monitoring of Road and Traffic Conditions using Mobile Smartphones. In Proceedings of the 6th International Conference on Embedded Networked Sensor Systems, Raleigh, NC, USA, 5–7 November 2008; p. 323. [Google Scholar]
  16. Handel, P.; Skog, I.; Wahlstrom, J.; Bonawiede, F.; Welch, R.; Ohlsson, J.; Ohlsson, M. Insurance telematics: Opportunities and challenges with the smartphone solution. IEEE Intell. Transp. Syst. Mag. 2014, 6, 57–70. [Google Scholar] [CrossRef]
  17. Wahlström, J.; Skog, I.; Händel, P. Smartphone-Based Vehicle Telematics: A Ten-Year Anniversary. IEEE Trans. Intell. Transp. Syst. 2017, 18, 2802–2825. [Google Scholar] [CrossRef]
  18. Niu, X.; Zhang, Q.; Li, Y.; Cheng, Y.; Shi, C. Using inertial sensors of iPhone 4 for car navigation. In Proceedings of the 2012 IEEE/ION Position, Location and Navigation Symposium, Myrtle Beach, SC, USA, 23–26 April 2012; pp. 555–561. [Google Scholar]
  19. Davidson, P.; Vazquez, M.A.; Piche, R. Uninterrupted portable car navigation system using GPS, map and inertial sensors data. In Proceedings of the 2009 IEEE 13th International Symposium on Consumer Electronics, Kyoto, Japan, 25–28 May 2009; pp. 836–840. [Google Scholar]
  20. Nguyen, P.; Nguyen, H.; Nguyen, D.; Dinh, T.N. ParkSense: Automatic Parking Positioning by Leveraging In-Vehicle Magnetic Field Variation. IEEE Access 2017, 5, 25021–25033. [Google Scholar] [CrossRef]
  21. Jeon, S.; Lee, H.; Son, S.H. A Magnetic Fingerprinting-Based Precise Automobile Localization Using Smartphones. In Proceedings of the 2016 IEEE 22nd International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA), Daegu, Korea, 17–19 August 2016; p. 105. [Google Scholar]
  22. Walter, O.; Schmalenstroeer, J.; Engler, A.; Haeb-Umbach, R. Smartphone-based sensor fusion for improved vehicular navigation. In Proceedings of the 2013 10th Workshop on Positioning, Navigation and Communication (WPNC), Dresden, Germany, 20–21 March 2013. [Google Scholar]
  23. Song, T.; Capurso, N.; Cheng, X.; Yu, J.; Chen, B.; Zhao, W. Enhancing GPS with Lane-Level Navigation to Facilitate Highway Driving. IEEE Trans. Veh. Technol. 2017, 66, 4579–4591. [Google Scholar] [CrossRef]
  24. Zhu, S.; Wang, X.; Zhang, Z.; Tian, X.; Wang, X. Lane-level vehicular localization utilizing smartphones. In Proceedings of the 2016 IEEE 84th Vehicular Technology Conference (VTC-Fall), Montreal, QC, Canada, 18–21 September 2016. [Google Scholar]
  25. Yokozuka, M.; Hashimoto, N.; Matsumoto, O. Low-cost 3D mobile mapping system by 6 DOF localization using smartphone embedded sensors. In Proceedings of the 2015 IEEE International Conference on Vehicular Electronics and Safety (ICVES), Yokohama, Japan, 5–7 November 2015; pp. 182–189. [Google Scholar]
  26. Gao, R.; Luo, G.; Ye, F. VeMap: Indoor road map construction via smartphone-based vehicle tracking. In Proceedings of the 2016 IEEE Global Communications Conference (GLOBECOM), Washington, DC, USA, 4–8 December 2016. [Google Scholar]
  27. Drosescu, R. MEMS based device for steering wheel angle experimental measuring. Appl. Eng. Mater. Mech. 2016, 304–313. [Google Scholar] [CrossRef]
  28. Karatas, C.; Liu, L.; Li, H.; Liu, J.; Wang, Y.; Tan, S.; Yang, J.; Chen, Y.; Gruteser, M.; Martin, R. Leveraging wearables for steering and driver tracking. In Proceedings of the IEEE INFOCOM 2016—The 35th Annual IEEE International Conference on Computer Communications, San Francisco, CA, USA, 10–14 April 2016. [Google Scholar]
  29. Lawoyin, S.A.; Fei, D.-Y.; Bai, O. A Novel Application of Inertial Measurement Units (IMUs) as Vehicular Technologies for Drowsy Driving Detection via Steering Wheel Movement. Open J. Saf. Sci. Technol. 2014, 04, 166–177. [Google Scholar] [CrossRef]
  30. Lawoyin, S.; Fei, D.Y.; Bai, O. Accelerometer-based steering-wheel movement monitoring for drowsy-driving detection. Proc. Inst. Mech. Eng. Part D J. Automob. Eng. 2015, 229, 163–173. [Google Scholar] [CrossRef]
  31. Li, W.; Wang, J. Magnetic sensors for navigation applications: An overview. J. Navig. 2014, 67, 263–275. [Google Scholar] [CrossRef]
  32. Wang, J. Intelligent MEMS INS/GPS Integration for Land Vehicle Navigation; University of Calgary: Calgary, AB, Canada, 2006. [Google Scholar]
  33. Fahami, S.M.H.; Zamzuri, H.; Mazlan, S.A.; Saruchi, S.A. The Variable Steering Ratio for Vehicle Steer by Wire System Using Hyperbolic Tangent Method. Appl. Mech. Mater. 2014, 575, 781–784. [Google Scholar] [CrossRef] [Green Version]
  34. Noureldin, A.; Karamat, T.B.; Georgy, J. Fundamentals of Inertial Navigation Satellite-Based Positioning and Their Integration; Springer: Berlin/Heidelberg, German, 2013. [Google Scholar]
  35. Grewal, M.S.; Andrews, A.P. Kalman Filtering: Theory and Practice Using MATLAB; John Wiley & Sons Inc.: New York, NY, USA, 2011; Volume 5. [Google Scholar]
  36. Petovello, M.G. Real-Time Integration of a Tactical-Grade IMU and GPS for High-Accuracy Positioning and Navigation; University of Calgary: Calgary, AB, Canada, 2003. [Google Scholar]
Figure 1. Consumer Portable devices/on-board navigation sensor integration architecture.
Figure 1. Consumer Portable devices/on-board navigation sensor integration architecture.
Sensors 19 01618 g001
Figure 2. Steering fixed frame and the CPD frame. (a) The steering fixed and the CPD frames coincide for a 0° steering angle; (b) the steering angle and the CPD frames for steering angle (θ).
Figure 2. Steering fixed frame and the CPD frame. (a) The steering fixed and the CPD frames coincide for a 0° steering angle; (b) the steering angle and the CPD frames for steering angle (θ).
Sensors 19 01618 g002
Figure 3. Vehicle frame (Body frame).
Figure 3. Vehicle frame (Body frame).
Sensors 19 01618 g003
Figure 4. Steering wheel inclination angle.
Figure 4. Steering wheel inclination angle.
Sensors 19 01618 g004
Figure 5. Different terrain types of land vehicle starting.
Figure 5. Different terrain types of land vehicle starting.
Sensors 19 01618 g005
Figure 6. Steering angle estimation using CPD accelerometers.
Figure 6. Steering angle estimation using CPD accelerometers.
Sensors 19 01618 g006
Figure 7. Fully-Compensated steering angle and heading change estimation.
Figure 7. Fully-Compensated steering angle and heading change estimation.
Sensors 19 01618 g007
Figure 8. Navigation system with different compensation for the steering angle estimation method.
Figure 8. Navigation system with different compensation for the steering angle estimation method.
Sensors 19 01618 g008
Figure 9. (a) Partially- and non-compensated steering angle estimation method; (b) the steering angle difference between the partially and non-compensated steering angle estimation methods.
Figure 9. (a) Partially- and non-compensated steering angle estimation method; (b) the steering angle difference between the partially and non-compensated steering angle estimation methods.
Sensors 19 01618 g009
Figure 10. Histogram of the heading change difference between the fully-compensated method and GNSS/INS integrated solution.
Figure 10. Histogram of the heading change difference between the fully-compensated method and GNSS/INS integrated solution.
Sensors 19 01618 g010
Figure 11. (a) Trajectory IMU standalone navigation solution for 60 s GNSS signal outage for a sample outage region. (b) Trajectory IMU standalone navigation solution for 120 s GNSS signal outage for another sample outage region.
Figure 11. (a) Trajectory IMU standalone navigation solution for 60 s GNSS signal outage for a sample outage region. (b) Trajectory IMU standalone navigation solution for 120 s GNSS signal outage for another sample outage region.
Sensors 19 01618 g011
Figure 12. (a) Trajectory IMU/ fully-compensated heading change update/velocity update integrated navigation solution for 60 s GNSS signal outage for a sample outage region. (b) Trajectory IMU/ fully-compensated heading change update/velocity update integrated navigation solution for 120 s GNSS signal outage for a sample outage region.
Figure 12. (a) Trajectory IMU/ fully-compensated heading change update/velocity update integrated navigation solution for 60 s GNSS signal outage for a sample outage region. (b) Trajectory IMU/ fully-compensated heading change update/velocity update integrated navigation solution for 120 s GNSS signal outage for a sample outage region.
Sensors 19 01618 g012
Table 1. RMS of the different steering angle and change of heading estimation methods.
Table 1. RMS of the different steering angle and change of heading estimation methods.
Steering Angle Estimation MethodRMS (°)
Steering AngleChange of Heading
Non-Compensated and Partially-Compensated3.64360.2277
Non-Compensated and Fully-Compensated3.64690.2279
Partially-Compensated and Fully-Compensated0.02210.0014
Table 2. RMSE of the different change of heading estimation methods.
Table 2. RMSE of the different change of heading estimation methods.
Heading Change Estimation MethodRMSE (°/s)
Non-Compensated1.77
Partially-compensated1.71
Fully-compensated1.70
Table 3. Average RMSE of the integrated 2D position states for heading change and velocity updates for different GNSS signal outage periods.
Table 3. Average RMSE of the integrated 2D position states for heading change and velocity updates for different GNSS signal outage periods.
Steering Angle Estimation MethodRMSE (m)
60 s Outage120 s Outage
Non-Compensated5.5814.68
Partially-Compensated5.4814.19
Fully-Compensated5.4714.18
Table 4. Average RMSE for different GNSS signal outage regions of the integrated 2D position states for different types of updates.
Table 4. Average RMSE for different GNSS signal outage regions of the integrated 2D position states for different types of updates.
Type of SolutionRMSE (m)
60 s Outage120 s Outage
IMU standalone97.98493.49
IMU/velocity update9.2016.10
IMU/velocity/heading change updates8.5615.32

Share and Cite

MDPI and ACS Style

Moussa, M.; Moussa, A.; El-Sheimy, N. Steering Angle Assisted Vehicular Navigation Using Portable Devices in GNSS-Denied Environments. Sensors 2019, 19, 1618. https://doi.org/10.3390/s19071618

AMA Style

Moussa M, Moussa A, El-Sheimy N. Steering Angle Assisted Vehicular Navigation Using Portable Devices in GNSS-Denied Environments. Sensors. 2019; 19(7):1618. https://doi.org/10.3390/s19071618

Chicago/Turabian Style

Moussa, Mohamed, Adel Moussa, and Naser El-Sheimy. 2019. "Steering Angle Assisted Vehicular Navigation Using Portable Devices in GNSS-Denied Environments" Sensors 19, no. 7: 1618. https://doi.org/10.3390/s19071618

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop