Next Article in Journal / Special Issue
On-Board Liquid Hydrogen Cold Energy Utilization System for a Heavy-Duty Fuel Cell Hybrid Truck
Previous Article in Journal
A CNN-Based System for Mobile Robot Navigation in Indoor Environments via Visual Localization with a Small Dataset
Previous Article in Special Issue
Lattice Boltzmann Method Study on Liquid Water Dynamic inside Gas Diffusion Layer with Porosity Distribution
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

An Intelligent Networked Car-Hailing System Based on the Multi Sensor Fusion and UWB Positioning Technology under Complex Scenes Condition

School of Automobile and Rail Transportation, Nanjing Institute of Technology, Nanjing 211167, China
*
Author to whom correspondence should be addressed.
World Electr. Veh. J. 2021, 12(3), 135; https://doi.org/10.3390/wevj12030135
Submission received: 30 July 2021 / Revised: 21 August 2021 / Accepted: 26 August 2021 / Published: 27 August 2021

Abstract

:
In order to solve the problems of difficulty and long times to pick up cars in complex traffic scenes, this paper proposes an intelligent networked car-hailing system in complex scenes based on multi sensor fusion and Ultra-Wide-Band (UWB) technology. UWB positioning technology is adopted in the system, and the positioning data is optimized by the untraceable Kalman filter algorithm. Based on the environment perception technology of multi sensor fusion, such as machine vision and laser radar technology, an anti-collision warning algorithm was proposed in the process of car-hailing, which improved the safety factor of car-hailing. When the owner enters the parking lot, the intelligent vehicle can automatically locate the owner’s position and drive to the owner without human intervention, which provides a new idea for the development of intelligent networked vehicles and effectively improves the navigation accuracy and intelligence of intelligent vehicles.

1. Introduction

At present, the time consumption caused by parking difficulty is high in China because of increasing rates of car ownership [1]. The main reason is that the driver cannot find parking spaces and their own car. One of the ways to solve the above problems is by an using intelligent vehicle system to make parking efficient [2,3,4]. In order to improve the efficiency of car pick-up, an intelligent car-hailing system is proposed. After the owner enters the parking lot, the vehicle can automatically locate the owner’s position and drive to the owner’s side without human intervention. It can solve the problem that the car cannot be found fundamentally and save the time of pick-up.
The intelligent car-hailing system is a comprehensive system with the functions of environment perception, path planning, navigation and decision control [5]. As the basis and premise, environment perception technology is a crucial link to realize intelligent car-hailing, and it is also the basic guarantee of its safety and intelligence [6]. In the environment of dim light, uneven distribution and reflected light intensity, a single sensor for target recognition has inherent defects in sensing range and recognition accuracy [7]. Compared with the traditional single perception, the multi sensor fusion environment perception technology has a higher ability to obtain road environment information that is more accurate and more compatible [8,9]. UWB positioning technology has the advantages of accurate positioning and stable operation, which lay the foundation for the path planning of intelligent car-hailing. The positioning system can effectively locate the dynamic and static targets with high precision and provide a feasible solution for intelligent car-hailing positioning [10,11].
The intelligent car-hailing system can cooperate by providing the whole technology development scheme of the intelligent networked car-hailing system for automobile manufacturers and auto parts enterprises and by realizing the intelligent car-hailing on the basis of intelligent parking, so as to realize the complete intellectualization of “parking looking for car” and to solve the problems of the difficulty and low efficiency of car picking. It provides a new breakthrough to improve the car pick-up efficiency of large domestic parking lots at the present stage. At the same time, the system can also be further applied to smart cargo trucks in docks, mines and other scenarios, sharing smart cargo platforms, etc., with good market prospects and social value [12,13].

2. Development Status at Home and Abroad

Research status abroad: in September 2019, Tesla launched a new function called “smart summon”, but this function has a distance limit of 60.96 m and a positioning error of 1 m, which makes the vehicle unable to accurately locate the owner’s position, and there are some security risks. According to NHTSA (National Highway Traffic Safety Administration), there have been at least three safety accidents related to Tesla’s “smart call” function in the United States, and the short positioning distance is embarrassing in the specific environment of large domestic parking lots.
Domestic research started late, but it has developed rapidly in recent years. In July 2019, the valet parking of Baidu Apollo was able to realize the functions of remote call, automatic queuing, automatic parking and automatic parking. Baidu can realize the perception and control of vehicle environment and trajectory through vehicle measurement sensors. In a certain scene, the relative positioning accuracy is 0.1–0.2 m, the redundancy/omission rate is 0.01% and the L4 is unmanned. However, it has a strong dependence on high-precision cards and high requirements for the application environment. Whether the AVP automatic parking function is still efficient or not, in the case of complex scenes or a lack of on-site arrangement, it is difficult to promote it to a large extent if it cannot solve the problem of high on-site cost.
In October 2020, the function of the NIO OS 2.7 version of the Wei Lai automobile was exposed. Compared with the previous version, we can see from the details that this version has added the function of automatic vehicle call. The new automatic vehicle call function allows users to control the vehicle to move forward and backward for a certain distance near the outside of the vehicle through the app, so as to facilitate users to get on and get off or park the vehicle. Generally speaking, it is more similar to the remote parking function.
In 2021, Liu of Fujian University of technology designed and implemented an intelligent obstacle avoidance path planning system (Figure 1), including the construction of a hardware platform and the implementation of a software obstacle avoidance algorithm. The simulation results verify the effectiveness and feasibility of the combined algorithm. The actual experiment shows that the car can successfully avoid obstacles from the planned initial position and reach the designated position on the planned path.

3. Intelligent Online Car-Hailing System in Complex Scenes

The framework of the intelligent networked car-hailing system is shown in Figure 2. This paper will describe it from three aspects: navigation and positioning, environment perception and path planning.

3.1. Navigation and Positioning

Positioning generally has the following methods: GPS, Ultrasonic, WIFI, UWB, RFID, FMCW and so on. With the development and modernization of the global navigation satellite system, it has made a great breakthrough in positioning and navigation and has been widely used [14,15]. However, GPS is susceptible to weather, earth rotation, satellite movements, cloud flow and other factors [16]. Additionally, the indoor signal strength is weak and the accuracy cannot meet the demand. The ultrasonic wave easily produces a multipath effect and NLOS error, and the frequency is affected by the Doppler effect and temperature [17]. WIFI is a wireless local area network composed of wireless access points, but its positioning error is large and susceptible to interference [18]. RFID can achieve centimeter-level positioning within a few milliseconds, but it operates at a short range and has no communication capability [19]. The FMCW radar is limited by transmit power, antenna efficiency and receiver sensitivity. The FMCW signal bandwidth also limits the maximum range of the radar, leading to concessions in range resolution. The pairs of different indoor positioning methods are shown in Table 1.
UWB positioning technology has the advantages of a short working time, strong penetration, high time resolution and high matching accuracy. It is initially decided to adopt UWB positioning technology, and the trilateration trilateral measurement method will be used to locate the vehicle owner’s position. In order to improve the positioning accuracy of UWB and ensure the stability of data, the unscented Kalman filter algorithm is used.

3.2. Environmental Perception

Single sensor for target recognition has inherent defects in sensing range and recognition accuracy. For example, the light transmission efficiency of the atmosphere has a great impact on the LiDAR, which cannot work all day and cannot work normally in bad weather. The directivity of ultrasonic ranging is poor, and the detection accuracy is low in bad weather. Infrared ranging has a low resolution, small detection range and short operating range [20,21]. Therefore, it is difficult to provide a comprehensive description of the road environment only by a single sensor.
In this paper, the fusion technology of machine vision and LiDAR multi-sensor is adopted to improve the accuracy of the sensing information. In terms of environmental perception, LiDAR is mainly used for obstacle detection, avoidance, mapping and 3D motion capture. The lane line is detected by machine vision technology to ensure the safe driving of vehicles. Firstly, the image of the lane is corrected and preprocessed, and then gray and Gaussian fuzzy are processed in turn. Then, the interested area is selected according to the lane line detection in the previous frame. Finally, the edge detection is carried out based on the improved sparrow search algorithm, and the lane line is extracted by Hough transform.

3.3. Path Planning

A* algorithm is a typical global path planning algorithm, and its basic implementation process is as follows: calculate the f value of each sub node from the starting point, select the sub node with the smallest f value as the next search point, and iterate repeatedly until the next sub node becomes the target point. Based on A* algorithm, Anthony Stentz proposed D* algorithm in 1994. D* algorithm is a reverse incremental search algorithm; that is, the reverse algorithm searches from the target point to the starting point step by step. Incremental search—that is, the algorithm—calculates the distance information H(x) of each node in the search process. In a dynamic environment, if there are obstacles that cannot be searched on the path in advance, the algorithm will redesign the path of the current state point according to the distance information of each point obtained in advance and carry out appropriate path planning [22,23,24]. Finally, according to the mastery degree of environmental information, it makes the corresponding judgment.

4. Key Technologies of Intelligent Networked Car-Hailing System

As shown in Figure 3, three key technologies must be solved for the normal operation of the system: (1) high precision positioning technology; (2) lane detection technology; and (3) the model and algorithm of vehicle anti-collision warning.

4.1. High Precision Positioning Technology

The traditional three-sided measurement method may cause the three locating circles to be unable to be intersected at one point due to the different power consumption and the existence of the multipath effect of the base station, which will reduce the positioning accuracy. Therefore, the standard trilateral measurement method is improved.
In most cases, the trilateral method will intersect in an area, as shown in Figure 4. Set the intersection of three circles as x a , y a , x b , y b , x c , y c and select the center of gravity x a + x b + x c 3 , y a + y b + y c 3 of the triangle surrounded by three points to represent the position of the label. Obviously, the size of the area surrounded by three circles has a great influence on the location accuracy of the label, and experiments show that the smaller the area surrounded, the higher the accuracy. Therefore, the area can be used as a weight to measure the credibility of the positioning point.
There is a positive correlation between the intersection area of three circles and the triangle area surrounded by the three intersection points. The relationship between the intersection area of three circles and the accuracy of location can be approximated by the relationship between the triangle area surrounded by the three intersection points and the accuracy of location. The smaller the area of the triangle is, the more accurate the anchor point is and the larger the weight is. The three sides of the triangle formed by the intersection point, respectively, are:
l 0 : y y a = y a y b x a x b ( x x a ) l 1 : y y b = y b y c x b x c ( x x b ) l 2 : y y c = y a y c x a x c ( x x c )
Triangle area:
S = x c x b l 1 l 2 d x + x b x a l 0 l 2 d x
Suppose that UWB obtains n groups of valid data every 0.1 s and the triangle area enclosed by the intersection under each group of data is s. The following weight function can be defined to represent the credibility of the location:
x c , j = x i S i
y c , j = y i S i
The optimal position is obtained by standardization:
x = i = 1 n 1 S i x i i = 1 n 1 S i
y = i = 1 n 1 S i y i i = 1 n 1 S i
Above all, the unknown point position is estimated for many times, the location point is determined by using the weight of each position and the optimal location point is obtained by the unscented Kalman filter algorithm with an adaptive factor. It not only solves the problem that the standard trilateral measurement method cannot meet at one point, but it also overcomes the influence of the multipath effect and NLOS error on positioning to a certain extent, increases the reliability of positioning and realizes the high-precision positioning of the human vehicle.
In order to verify the rationality of the positioning and algorithm, static tests and dynamic tests were carried out, respectively. The test was carried out in a 10 m × 10 m LOS environment using the DWM 1000 radio frequency module produced by Decawave. The typical bandwidth is 500 MHz, the transmission power adjustment range is −62–−35 dBm/MHz and a communication rate of 110 kB/s is selected.
In the static positioning test, at a positioning speed of 10 times per second, the lateral and longitudinal errors are within 10 cm, the highest positioning accuracy is within 7 cm, the RMSE (root mean square error) is reduced by 12.74% and the MaE (average absolute Error) is reduced by 21.58%, as shown in Table 2.
The comparison between the static positioning result and the traditional positioning algorithm is shown in Figure 5. It can be seen from the experimental results that this work proposes an improved trilateral measurement method. The absolute positioning accuracy and relative positioning accuracy have been significantly improved.
In the dynamic positioning S-shaped test, the maximum deviation in the horizontal and vertical directions is within 20 cm and the error of most points is within 10 cm. Compared with the ideal point (3000, 4000), the average error in the x-direction in the unimproved group is 7.091 cm and the maximum error is 17.208 cm. The average error in the y direction is 8.947 cm and the maximum error is 23.987 cm. In the improved group, the average error in the x direction is 5.566 cm and the maximum error is 10.225 cm. The average error in the y direction is 6.817 cm and the maximum error is 18.038 cm. The dynamic positioning trajectory is shown in Figure 6.
In dynamic positioning, the maximum deviation in the x direction is 12.4 cm and the maximum deviation in the y direction is 15.0 cm. The error of most points is within 10.0 cm, and the trajectory fluctuates little, which is basically consistent with the ideal trajectory.
In order to verify the optimization effect of the algorithm of this work on UWB positioning data and the ability to correct NLOS errors, a simulated NLOS test was carried out in a laboratory environment of 10 m × 10 m. A UWB device with a transmission power of –45 dBm/MHz is adopted, with a communication rate of 6.8 m/s, a center frequency of 6489.6 MHz, a frequency band of 6240–6739.2 MHz and a bandwidth of 499.2 MHz. It complies with IEEE 802.15.4-2011 protocol. The test scenario is shown in Figure 7. The base station is placed along the vertices of an equilateral triangle with a side length of 6 m, and the dashed line represents the movement trajectory of the tag MS. A metal block is inserted between the base station and the track. When the tag, the metal block and the base station are on the same straight line, the metal block with a dielectric coefficient greater than 1 will interfere with the propagation of the direct single-path component DP, forming a strong NLOS environment. The traditional positioning algorithm and the algorithm of this work were used to carry out the positioning test, and the test results are shown in Figure 8.
It can be seen from Figure 4 that in the 30th to 40th ranging, the base station was affected by the metal block and the ranging value suddenly changed, which is shown in the positioning result, as shown in Figure 9.
The black dots in Figure 5 are the positioning results of the traditional algorithm. It can be seen that the data began to be abnormal at y = 150 cm, and then there was a large error in the positioning and the maximum error value reached 33.589 cm. The red dot in the figure is the positioning of the work algorithm. As a result, it is obvious that the data fluctuation is smaller and the data mutation at the original NLOS error is relatively smooth. The maximum error is only 15.883 cm, which is 52.7% lower than the maximum error of the traditional algorithm. The RMSE value and MAE value are shown in Table 3.
Experiments show that the algorithm proposed in this work improves the positioning accuracy of UWB, solves the problem of low positioning accuracy in complex scenes and realizes the real-time accurate positioning of people and vehicles.

4.2. Lane Detection Technology

The premise of lane detection is to detect the edge of the lane. Because of the uneven distribution of light in the parking lot and the strong reflection of the ground, the commonly used edge detection methods easily judge the noise as the edge, so the threshold needs to be manually selected. This paper proposes a lane detection method based on an improved sparrow search algorithm, which reduces the interference of ambient light by dynamically selecting the region of interest (ROI). The optimization of parameters such as step size and warning threshold can avoid noise, quickly and accurately find the edge area of lane line, improve the accuracy of lane line detection and ensure the safety and standardization of calling vehicles.
The main flow chart (Figure 10) and steps of edge detection of the improved sparrow search algorithm are as follows:
(1) Input the pre-processed image, and each pixel is regarded as a location where the sparrow can forage. Initialize the sparrow position: randomly distribute n sparrows to the pixels of the image.
(2) A fixed proportion of sparrows were selected as the discoverers to provide direction for the whole sparrow species. The location updating formula is as follows:
m i , z t + 1 = m i , z t * e x p ( i α * n m a x ) , C x , y < S T m i , z t + Q , C x , y S T
where m i , z t is the position of the i sparrow in generation t in the z dimension of the image, α is the random number in the value space 0.1 , n m a x is the maximum number of iterations, Q is the random number in the standard normal distribution, S T is the alert threshold and C x , y is the fitness of the position, which is defined as follows:
C x , y = 1 255 × m a x H x 1 , y 1 H x + 1 , y + 1 H x 1 , y + 1 H x + 1 , y 1 H x , y 1 H x , y + 1 H x 1 , y H x + 1 , y
In the formula, H x , y represents the gray value of the pixel at x , y position. The gray value of pixels in the edge region changes greatly and has better adaptability. When C x , y < S T , it doesn’t reach the warning threshold and it carries out an extensive search. When C x , y c S T , it reaches the warning threshold and randomly moves in a small range according to the standard normal distribution.
(3) In each generation of sparrows, except the sparrow selected as the discoverer, it is regarded as the follower. The follower follows the discoverer to forage, and its location updating formula is as follows:
m i , z t + 1 = Q e x p m w i , z t m i , z t , i > n 2 m b i , z t 1 D d = 1 D r a n d 1 , 1 m b i , z t m i , z t , i n 2
m w i , z t is the lowest global fitness position of the current sparrow, m b i , z t is the highest fitness position of the current discoverer and D is determined by the location dimension. Since the input image is a two-dimensional image, the value of D in this work is 2. When i > n 2 , it indicates that the adaptability of the position of the i follower is relatively low and it needs to fly to other places. When i n 2 , the follower will fly to the optimal position of the current discoverer at random.
(4) All sparrows, except those selected as discoverers, are regarded as followers who follow discoverers to forage. The formula for updating its position is as follows:
m i , z t + 1 = m r i , z t + β m i , z t m r i , z t , C x , y C m a x m i , z t + K m i , z t m w i , z t C x , y C m i n + ε , C x , y = C m a x
In the formula, m r i , z t is the highest global fitness position of the current sparrow, the parameters of β control step follow the standard normal distribution, K   is the random number between 1 , 1 , C m a x is the current global maximum fitness, C m i n is the current global minimum fitness and ε > 0 in order to prevent the denominator from being 0. When C x , y C m a x , the sparrow flies to the best position in the whole world. When C x , y = C m a x , the sparrow will fly to a nearby position.
(5) Continue to iterate until the maximum number of iterations is reached. In the edge detection, the output image is a binary image. The pixel value of the position where the sparrow stays is set to 1, and the pixel value of the position where the sparrow does not stay is set to 0. Finally, the image is output, and the effect of the output image is shown in Figure 11.
The last step of edge detection also detected some interference factors; there is a need to further operate the image after edge detection to find the lane line. In most cases, the lane line is a straight line, so this paper uses Hough transform to extract the lane line.
Input the two-dimensional image. In a Cartesian coordinate system, the function expression of straight line is y = k x + b and the expression converted to the Hough coordinate system is b = x k + y . As shown in Figure 12 below, a point on a straight line in a Cartesian coordinate system is transformed into a Hough space and is intersected at a point.
However, in the case of k = , it is not convenient for the straight line to be expressed in the Cartesian coordinate system, so it needs to be converted to the polar coordinate system that   x   c o s   θ   +   y   s i n   θ   =   ρ , and then the Cartesian coordinate system is converted to the Hough coordinate system and the function expression after conversion is ρ   =   c o s   θ   x   +   s i n   θ   y . As shown in Figure 13 below, a line in the polar coordinate system is transformed upward into the Hough space and intersects at a point:
Therefore, lane lines can be well fitted through Hough transform, and the effect of lane line detection can be achieved, as shown in Figure 14.
In order to verify the effect of the lane line detection and recognition method based on the improved sparrow search algorithm proposed in this paper, this paper performs lane line detection on the same computer on the videos taken by three groups of actual vehicles driving on the road. The results are shown in Table 4.
For three groups of the same video on the same computer, the traditional edge detection method based on the canny operator is used to detect lane lines. The results are shown in Table 5.
In Table 4 and Table 5, video 1 is a video of a vehicle driving on a highway during the day, video 2 is a video of a vehicle driving on a highway on a cloudy day and video 3 is a video of a vehicle driving on a highway under strong light. From the simulation results in Table 4 and Table 5, it can be seen that under the same number of frames, the lane line detection and recognition method based on the improved sparrow search algorithm proposed in this paper has a higher detection and recognition rate.

4.3. Vehicle Collision Warning Model and Algorithm

The safety of vehicle operation is affected by many factors such as meteorological conditions and road conditions. The traditional safety distance calculation model is only calculated by speed limit, which leads to an inaccurate alarm. In this paper, an improved Berkeley model is proposed; that is, the vehicle forward and backward motion parameters are analyzed using LiDAR, and the effect of braking deceleration on displacement is ignored [25,26].
0 t 3 0 t a m a x t s t d t d t
(1) When the car in front moves at a constant speed and the car behind decelerates to 0, the required time is as shown in Figure 15 for the velocity displacement variation of the two vehicles.
When t 0 , the speed of the vehicle behind, decreases to the same as that of the vehicle in front, the safety distance between the two vehicles is:
D b = s 1 ( t 0 ) s 2 ( t 0 ) + d 0
(2) When the deceleration time of the rear vehicle to zero is greater than or equal to the time when the speed deceleration time of the front vehicle reaches zero, the velocity-displacement changes of the two vehicles are shown in Figure 16.
When the vehicle has decelerated to a static state at t z 2 time because of t z 1 > t z 2 , the following vehicle still keeps a certain deceleration state and moves forward. The safe distance is:
D b = s 1 ( t z 1 ) s 2 ( t z 2 ) + d 0
(3) When the time t z 1 that the rear vehicle decelerates to zero is smaller than the time t z 2 that the front vehicle decelerates to zero, the velocity-displacement changes of the two vehicles are shown in Figure 17.
At t 0 time, the speed of the two vehicles is the same and the safety warning distance is:
D b = s 1 ( t 0 ) s 2 ( t 0 ) + d 0
Synthesizing the above three situations, different calculation formulas of safety warning distance are selected at the right time.
D b = s 1 ( t 0 ) s 2 ( t 0 ) + d 0 t z 1 < t z 2 s 1 ( t z 1 ) s 2 ( t z 2 ) + d 0 t z 1 t z 2
In order to remedy the defect of the Berkeley model neglecting side safety, this paper proposes a new side safety distance model for driving on curved roads (Figure 18).
For the model with the angle of the two cars and the speed of the car as the main parameters, the lateral critical safety distance model is established, according to the angle between the two cars   θ = a r c t a n d 2   d 1 D (D ipsilateral two laser sensors for vehicle distance, d 1 , d 2 ; respectively different obstacle distance from the laser sensor), and the relative velocity was carried out on the side of the vehicle driving state, an analysis of lateral safe distance:
d 0 = s i n θ v B t + 1 2 a B t 2 + 0.94 t = t 1 , X B y < X A A t = t 4 , X B y > X A A
( X B y is the longitudinal traveling distance of car B and X A A is the longitudinal traveling distance of car A.) Compared with the traditional model, this model takes into account the influence of other vehicles on the side safety in the process of self-vehicle turning and lane change. It has fast signal transmission, strong anti-interference ability and can predict the lane change of vehicles in different lanes in real time, thus improving the accuracy of early warning.
Simulation analysis of the improved Berkeley model and the traditional Berkeley model based on MATLAB (the left picture in Figure 19 is the traditional Berkeley model, and the right picture is the improved model of the work). The simulation data shows that at different vehicle speeds, the improved Berkeley model has an earlier warning, and this advantage becomes more obvious as the vehicle speed increases. When the relative vehicle speed is higher, the safety warning distance in the improved model is compared with the safety warning in the traditional model. The distance is relatively small, and the difference is about 1 to 2.5 m. Compared with the traditional model, the improved Berkeley model can effectively prevent false alarms and realize that the safety warning distance changes according to the changes of the front and rear vehicle motion parameters.
The lateral safety distance model of the curve is simulated based on MATLAB, as shown in Figure 20.
When passing railway crossings, sharp bends, narrow roads and narrow bridges, the maximum speed of motor vehicles shall not exceed 30 km per hour, which is about 8.3 m/s. So, take V A = 25 km/h, which is about 6.94 m/s.
In order to ensure that the two vehicles are in a safe state when they are stopped, the safe distance between the vehicle and the vehicle in front of it after stopping is generally taken as 2 to 5 m. In view of the fact that both vehicles are driving on curves, in order to ensure that the two vehicles still have a safe distance after driving for a period of time, the longitudinal critical safety distance is S 0 = 3.5 m.
The results show that when the reference speed is 25 km/h and the longitudinal critical safety distance is 3.5 m, the lateral safety distance and lateral critical safety distance change significantly with the change of the included angle and relative speed of the two vehicles. When the driving speed is low, the change of the lateral critical safety distance is not obvious, and the change of the angle between the two vehicles has little effect on it. The change of the lateral safety distance in the vehicle curve is relatively obvious, with an amplitude of about 0.3 m. When the relative speed increases, the longitudinal distance between the two vehicles gradually increases, which is not prone to collision risk, and the lateral safety distance decreases when the vehicle bends. When the included angle between the two vehicles increases, the longitudinal distance between the two vehicles gradually decreases, which renders them prone to collision, and the lateral safety distance increases. The test shows that on the premise of ensuring driving safety, the lateral warning distance can reach 0.94 m and the accuracy of the longitudinal safety warning distance can be increased by 3.8%. Compared with the traditional model, this model predicts the side vehicles based on the relative speed and the angle between the two vehicles so as to improve the reliability of early warning and ensure the driving safety in the state of curve and vehicle lane change.

5. Conclusions

In this paper, an intelligent networked car-hailing system based on multi sensor fusion and UWB positioning in complex scenes is proposed. Compared with the traditional car-hailing system, this scheme can achieve high-precision positioning and high lane detection accuracy in complex scenes, and the anti-collision safety warning is more in line with the actual driving characteristics, It provides a guarantee for the safe driving of vehicles in the process of car-hailing, which is of great significance for improving the stability and safety of intelligent car-hailing, and provides a new idea for promoting the development of digital intelligent transportation, which has a good market prospect and application value.

Author Contributions

Z.W. (Zhi Wang) conducted experiments and wrote the manuscript; L.Z. contributed to the conception of the study; Y.T. was responsible for testing and put forward constructive amendments; Y.S. summarized the data; Z.W. (Zhenxuan Wu) found some information and summarized the research status at home and abroad. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the National Natural Science Foundation of China (Grant Number. 51605215), the China Postdoctoral Science Foundation (Grant Number. 2019T120450), the Qing Lan Project, the Research Foundation of Nanjing Institute of Technology (Grant Number. CKJA201906) and the Science and Technology Innovation Fund Project of Nanjing Institute of Technology (Grant Number. TB202117028)

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Liu, C.; Li, W.; Luo, H. Design of intelligent parking system based on cloud edge fusion technology. Microcontrollers Embed. Syst. 2020, 20, 78–81. [Google Scholar]
  2. Li, N.; Wei, D.; Cao, Y.; Tian, B.; Li, J. Obstacle avoidance control algorithm for autonomous electric vehicles. Chin. J. Sci. Instrum. 2021, 42, 199–207. [Google Scholar]
  3. Wang, M.; Wang, Z.; Zhang, L. Research on local path planning method of intelligent vehicle based on collision risk assessment. J. Mech. Eng. 2021, 57, 28–41. [Google Scholar]
  4. Wang, Y.; Qu, L. Impact of intelligent driving technology on traditional automobile industry: Complementary and substitution effects. J. Fudan Univ. 2020, 59, 483–489. [Google Scholar]
  5. Weng, M. Research on autonomous navigation method of intelligent vehicle based on machine vision. Chang. Univ. Technol. 2020, 25–28. [Google Scholar]
  6. Liu, W.; Wang, X.; Wei, L. Overall visual structure model and its application in road environment perception. Comput. Eng. 2016, 42, 26–31. [Google Scholar]
  7. Wang, M.; He, L.; Li, Y.; Suo, C. Research on multi-sensor information fusion algorithm of mobile robot. J. Meas. Sci. In-Strum. 2020, 11, 152–160. [Google Scholar]
  8. Zhang, Y.; Yan, Y.; Li, J. Overview of traffic data acquisition system based on multi sensor fusion. Internet Things Technol. 2021, 11, 15–18. [Google Scholar]
  9. Wang, D.; Cai, Z.; Zeng, J.; Zhang, G.; Guo, J. Survey of data collection in urban traffic control. Transp. Syst. Eng. Inf. 2020, 20, 95–102. [Google Scholar]
  10. Wang, C.; Wang, J.; Yu, H.; Han, H.; Ning, Y. Research on UWB positioning system for error correction of ranging. Sci. Surv. Mapp. 2019, 44, 98–103. [Google Scholar]
  11. Niu, Q.; Cao, Y.; Wang, L.; Hui, Y.B. Study of UWB indoor positioning technology and optimization algorithm based on TW-TOF. Autom. Instrum. 2018, 33, 5–9. [Google Scholar]
  12. Bai, L. Analysis of intelligent vehicle environment perception algorithm and test evaluation method. Auto Time 2020, 2, 4–6. [Google Scholar]
  13. Meng, H.; Jiang, H.; Tang, W. The development status and trend of global autopilot (Part 1). E. China Sci. Technol. 2014, 4, 66–68. [Google Scholar]
  14. Zrinjski, M.; Barković, Đ.; Matika, K. Razvoj i modernizacija GNSS-a. Geod. List 2009, 73, 45–65. Available online: https://hrcak.srce.hr/218855 (accessed on 12 August 2021).
  15. Barnes, D. GPS status and modernization. In Proceedings of the Presentation at Munich Satellite Navigation Summit, Munich, Germany, 25–27 March 2019. [Google Scholar]
  16. Ai, W.; Lu, H.; Chen, Z.; Jiang, L. Research on automatic tracking smart car based on navigation system. Automob. Technol. 2018, 5, 1–5. [Google Scholar]
  17. Su, W.; Gong, B.; Pan, X. Error analysis of ultrasonic ranging. Transducer Microsyst. Technol. 2004, 4, 8–11. [Google Scholar]
  18. Huang, M.; Qin, J.; Gao, L.; Lu, Z. Design of zero turning radius following robot control system based on UWB. J. Chongqing Univ. Technol. 2019, 33, 142–150. [Google Scholar]
  19. Meng, Q.; Xu, H. Positioning technology based on RFID. Comput. Knowl. Technol. 2013, 9, 158–161. [Google Scholar]
  20. Zhao, L. Multi sensor information fusion technology and its application. Infrared 2021, 42, 21–26. [Google Scholar]
  21. Yang, C. Multi sensor information fusion and application. Technol. Wind 2019, 13, 86. [Google Scholar]
  22. Panov, A.I.; Yakovlev, K.S.; Suvorov, R. Grid path planning with deep reinforcement learning: Preliminary results. Procedia Comput. Sci. 2018, 123, 347–353. [Google Scholar] [CrossRef]
  23. Shi, Y.; Li, Q.; Bu, S.; Yang, J.; Zhu, L. Research on intelligent vehicle path planning based on improved A* algorithm. Comput. Meas. Control. 2020, 28, 170–176. [Google Scholar]
  24. Jing, X.; Chen, Y. Intelligent vehicle trajectory planning based on improved genetic algorithm. Sci. Technol. Eng. 2020, 20, 11161–11165. [Google Scholar]
  25. Wang, R.; Jiang, K. Analysis and calculation of braking distance of ABS automobiles. J. Cent. South Univ. For. Technol. 2005, 25, 12–14. [Google Scholar]
  26. Li, Z.P.; Peng, T.; Wang, Q.; Zhan, C.S. Calculation model of automobile braking distance on pavement with deicing salt. J. Traffic Transp. Eng. 2012, 12, 50–54. [Google Scholar]
Figure 1. Path map of intelligent car-hailing.
Figure 1. Path map of intelligent car-hailing.
Wevj 12 00135 g001
Figure 2. Frame diagram of the car-hailing system.
Figure 2. Frame diagram of the car-hailing system.
Wevj 12 00135 g002
Figure 3. Car-hailing flow chart.
Figure 3. Car-hailing flow chart.
Wevj 12 00135 g003
Figure 4. Improved trilateration method.
Figure 4. Improved trilateration method.
Wevj 12 00135 g004
Figure 5. Comparison of static positioning.
Figure 5. Comparison of static positioning.
Wevj 12 00135 g005
Figure 6. Dynamic positioning trajectory.
Figure 6. Dynamic positioning trajectory.
Wevj 12 00135 g006
Figure 7. Test environment.
Figure 7. Test environment.
Wevj 12 00135 g007
Figure 8. Base station ranging value.
Figure 8. Base station ranging value.
Wevj 12 00135 g008
Figure 9. Positioning results of traditional algorithms.
Figure 9. Positioning results of traditional algorithms.
Wevj 12 00135 g009
Figure 10. Flow chart of lane detection algorithm.
Figure 10. Flow chart of lane detection algorithm.
Wevj 12 00135 g010
Figure 11. Before and after edge detection. (a) Image to be detected. (b) Edge detection renderings.
Figure 11. Before and after edge detection. (a) Image to be detected. (b) Edge detection renderings.
Wevj 12 00135 g011
Figure 12. Schematic diagram of a Hough transformation in a cartesian coordinate system. (a) Cartesian coordinate system. (b) Hough Cartesian coordinates.
Figure 12. Schematic diagram of a Hough transformation in a cartesian coordinate system. (a) Cartesian coordinate system. (b) Hough Cartesian coordinates.
Wevj 12 00135 g012
Figure 13. Schematic diagram of a Hough transformation in a polar coordinate system. (a) Cartesian coordinate system. (b) Hough Cartesian coordinates.
Figure 13. Schematic diagram of a Hough transformation in a polar coordinate system. (a) Cartesian coordinate system. (b) Hough Cartesian coordinates.
Wevj 12 00135 g013
Figure 14. Before and after lane line detection. (a) Image to be detected. (b) Renderings of lane line detection.
Figure 14. Before and after lane line detection. (a) Image to be detected. (b) Renderings of lane line detection.
Wevj 12 00135 g014
Figure 15. Velocity—displacement variation diagram.
Figure 15. Velocity—displacement variation diagram.
Wevj 12 00135 g015
Figure 16. Velocity—displacement variation diagram.
Figure 16. Velocity—displacement variation diagram.
Wevj 12 00135 g016
Figure 17. Velocity—displacement variation diagram.
Figure 17. Velocity—displacement variation diagram.
Wevj 12 00135 g017
Figure 18. New lateral safe distance model.
Figure 18. New lateral safe distance model.
Wevj 12 00135 g018
Figure 19. Comparison of the early warning distances of the improved Berkeley model.
Figure 19. Comparison of the early warning distances of the improved Berkeley model.
Wevj 12 00135 g019
Figure 20. Curve lateral safety distance model early warning distance.
Figure 20. Curve lateral safety distance model early warning distance.
Wevj 12 00135 g020
Table 1. Common indoor positioning methods.
Table 1. Common indoor positioning methods.
Positioning ModeComparison of Common Indoor Positioning Methods
AccuracyPenetrabilityAnti-InterferenceLayout ComplexityCost
ZigBee location★★☆☆☆★★★★☆★★★☆☆★★☆☆☆★★★☆☆
RFID location★★★★☆★★★☆☆★★☆☆☆★★☆☆☆★★☆☆☆
WI-FI location★☆☆☆☆★★★☆☆★★★☆☆★☆☆☆☆★☆☆☆☆
UWB location★★★★★★★★★☆★★★★☆★☆☆☆☆★★☆☆☆
Table 2. Static positioning test results.
Table 2. Static positioning test results.
DirectionValueTraditional AlgorithmImprove Algorithm
X directionPositioning accuracy/cm7.095.57
Root mean square error/cm5.184.52
Mean absolute error/cm7.095.56
Y directionPositioning accuracy/cm8.946.82
Root mean square error/cm6.815.73
Mean absolute error/cm8.956.82
Table 3. Test results.
Table 3. Test results.
DirectionValueUnimproved GroupImprovement Group
X direction/cmRMSE7.985.51
MaE6.184.25
Table 4. Test results of this method.
Table 4. Test results of this method.
Video NumberNumber of FramesThe Number of Frames Correctly DetectedDetection Accuracy
11260121096.03%
21550148295.61%
31700160494.35%
Table 5. Edge based on canny operator detection method detection result.
Table 5. Edge based on canny operator detection method detection result.
Video NumberNumber of FramesThe Number of Frames Correctly DetectedDetection Accuracy
11260108285.87%
21550129684.61%
31700138283.29%
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Wang, Z.; Zang, L.; Tang, Y.; Shen, Y.; Wu, Z. An Intelligent Networked Car-Hailing System Based on the Multi Sensor Fusion and UWB Positioning Technology under Complex Scenes Condition. World Electr. Veh. J. 2021, 12, 135. https://doi.org/10.3390/wevj12030135

AMA Style

Wang Z, Zang L, Tang Y, Shen Y, Wu Z. An Intelligent Networked Car-Hailing System Based on the Multi Sensor Fusion and UWB Positioning Technology under Complex Scenes Condition. World Electric Vehicle Journal. 2021; 12(3):135. https://doi.org/10.3390/wevj12030135

Chicago/Turabian Style

Wang, Zhi, Liguo Zang, Yiming Tang, Yehui Shen, and Zhenxuan Wu. 2021. "An Intelligent Networked Car-Hailing System Based on the Multi Sensor Fusion and UWB Positioning Technology under Complex Scenes Condition" World Electric Vehicle Journal 12, no. 3: 135. https://doi.org/10.3390/wevj12030135

Article Metrics

Back to TopTop