1. Introduction
In the fourth industrial revolution era, characterized by big data, artificial intelligence, and autonomous driving, technologies in all domains are being rapidly advanced through innovation and fusion. At present, unmanned transport vehicles are being actively researched in the fields of automobiles and aviation. Furthermore, in the shipbuilding and offshore domains, the realization of vessel autonomy, remote control systems, and fault diagnosis systems is being focused on, according to the global trend to reduce human intervention. An unmanned surface vehicle (USV) refers to a ship that is operated remotely or automatically without an active crew. Unmanned ships can perform dangerous missions such as reconnaissance patrol and mine clearing. Furthermore, in the private sector, such ships can be used to realize passenger transport, coast guarding, marine exploration, and rescue. In such applications, cost effectiveness and work efficiency can be enhanced through the automation of ships, and the number of casualties can be minimized by preventing human intervention.
A key technology for unmanned ships is collision avoidance, aimed at ensuring the safety of a sailing vessel while maintaining its course when the vessel encounters other ships or obstacles. Research on collision avoidance technology has been performed since before the development of USV, and many collision avoidance techniques have been established. To determine the collision risk of a ship, a ship domain can be introduced using the relative distance between the ship and other ships [
1,
2]. Moreover, AIS data and probabilistic approaches can be applied [
3,
4,
5,
6,
7]. According to an alternative theory, a moving robot can be expressed as a dynamic obstacle [
8,
9,
10]. Certain methods for collision avoidance use the direction priority sequential selection algorithm; International Regulations for Preventing Collisions at Sea (COLREGs), defined by the International Maritime Organization [
11]; and virtual vector fields [
12]. In terms of the control method, collision avoidance methods can be divided into deliberative and reactive control methods. Although deliberative control methods exhibit a high performance in tasks, their reaction speed is low, and these methods cannot effectively adapt to environmental changes. In contrast, although reactive control can promptly respond to changes in the external environment, accurate control is challenging to realize. Overall, although various methods can be used for identifying the collision risk of a vessel and performing collision avoidance, the vessel may not be able to promptly respond to unfamiliar obstacles or obstacles that suddenly appear during a voyage. In such situations, reactive collision avoidance methods are highly effective. In particular, in very urgent situations, the vessel may maneuver in a way that does not comply with COLREGs to avoid a collision situation. Coping methods in emergency situations are described in Rule 2(b) of COLREGs [
13]. Several researchers have attempted to realize the collision avoidance of autonomous surface vehicles (ASVs) and unmanned aerial vehicles by using the control barrier function [
14] and real-time local Gaussian Mixture Model (GMM) maps [
15]. A commonly used technique for local collision avoidance is based on a conceptual force known as the potential field, which is exerted by the obstacle on a robot [
16]. This concept has been extended to propose the virtual force field (VFF) concept [
12]. Notably, in these methods, a local minima occurs in the process of force composition. Consequently, the robot cannot follow its trajectory or traverse a narrow path. In this context, it is necessary to establish a simple method that can allow a vessel to follow its trajectory while effectively avoiding obstacles.
Considering these aspects, this study is focused on establishing a reaction control-based system to ensure the safety of an unmanned ship. Mapping is performed through the GMM by using the LiDAR information of an unmanned ship, and collision avoidance is performed in a reactive manner.
The remaining paper is organized as follows.
Section 2 describes the global mapping technique based on GMM to create a map of the surrounding environment of a USV.
Section 3 describes the proposed reactive collision avoidance method to realize real-time collision avoidance based on the GMM-based global map.
Section 4 describes the reactive collision avoidance simulations performed using the proposed technique to evaluate its performance.
Section 5 presents the conclusions.
4. Collision Avoidance Simulation
4.1. Simulation Environment
To verify the proposed algorithm, VRX Simulation, a Gazebo robot operating system (ROS) simulation platform, is used. In general, the ROS is used to develop robot applications, with functionalities of hardware abstraction, low-level device control, message transfer between devices, and library provision. VRX is a type of subpackage of the Gazebo simulation, which corresponds to a virtual ship simulation developed in cooperation with the Naval Postgraduate School, Office of Naval Research and Open Robotics. In the simulation, a wave adaptive modular vessel (WAM-V) is used, and the shape and specifications are presented in
Figure 8 and
Table 1, respectively. WAM-V is a twin-propelled ship equipped with two thrusters in the stern. It is a differential thruster-type vessel that changes direction by generating a steering control moment caused by the difference in rpm. The steering command is defined as Equations (
10) and (
11) [
24].
refers to the average RPM of both thrusters and
is the difference in the RPM of the thrusters, which are normalized to have a value between −1 and 1 by divided by the maximum speed.
refer to RPM of the left/right thruster and the maximum RPM of the thruster respectively.
In VRX, Fossen’s 6-DOF vectorial model was adopted to express the motion of WAM-V. The equation of motion is expressed in Equation (
12) [
25].
where
and
stand for position and velocity vectors for surge, sway, heave, roll, pitch, and yaw, respectively.
means the relative speed of the vessel with respect to the fluid. On the right-hand side, the terms mean the forces and moments generated by the thruster, wind, and waves, in order. However, in this study, the effects of wind and waves are not considered, so
and
can be omitted. The hydrodynamic force term includes added mass. The hydrodynamic derivatives follow the SNAME (1950) notation. The simplified added mass term is expressed as Equation (
14).
where
.
The Coriolis-centripetal matrix is expressed as Equation (
15).
As in Equation (
16), the hydrodynamic damping matrix
consists of the sum of the linear term
and the quadratic term
. Each term is expressed in Equations (
17) and (
18).
The control method of the WAM-V is as follows. After calculating the desired psi considering the locations of the vessel and target point, the desired yawrate and delta command are sequentially obtained through the psi controller and yawrate controller. Subsequently, the delta command is transmitted to the actuator to drive the thrusters. The controller has a double-loop control structure, and the gains of the controller are calculated through trial and error. The flow of control is presented as a block diagram in
Figure 9.
The simulation environment is as follows. Obstacles are placed in the path of the WAM-V, which is set to sail toward a target point. No external force such as winds or currents are introduced. Collision avoidance is considered to fail when a maneuvering vessel and an obstacle come into contact, and the obstacle deviates by a certain distance. To verify the validity of the collision avoidance algorithm, two scenarios are considered.
4.1.1. Scenario with Multiple Fixed Obstacles
The objective is to avoid multiple fixed obstacles. Many obstacles were placed at random positions.
Figure 10 shows the arrangement of the fixed obstacles and moving direction of the ship. The target point is 150 m ahead of the ship. The obstacles are spherical buoys with a diameter of 1 m, randomly placed in a 110 m × 30 m space on the path.
4.1.2. Scenario with Fixed and Mobile Obstacles
This situation involves multiple obstacles and two vessels whose routes cross with that of the ship. First, an obstacle ship approaches the front of the own vessel. Subsequently, the other obstacle ship approaches from the port side of the own vessel.
Figure 11 shows the arrangement of the fixed and moving obstacles and the desired path of the own ship and obstacle ships. The obstacle ships move only in the surge direction at a speed of approximately 1.4 kn (1 kn = 0.51 m/s).
The performance of the proposed method based on GMM is compared with that of the method based on the VFF. The success/failure of collision avoidance is evaluated by calculating the minimum distance between the obstacle and the own ship. The sum of half the width of the ship and radius of the obstacle buoy is set as the threshold for collision judgment. A collision is considered to occur when the minimum distance is smaller than the threshold.
4.2. Simulation Results
The information obtained from the simulation is visualized through the RViz program. RViz is a 3D visualization tool that can be used to visualize and examine the data in the ROS environment. For example, using the shape of a ship, LiDAR point cloud information, GMM data calculated from obstacles, and trajectories of motion primitives in a virtual space, the progress can be conveniently evaluated. The following subsections describe the results of the simulations.
4.2.1. Scenario with Multiple Fixed Obstacles
Figure 12 shows the simulation screen for the scenario with fixed obstacles.
Figure 12a shows the trajectory of the USV toward the target point in intervals of 8 s. The USV successfully arrives at the target point while avoiding the obstacles.
Figure 12b shows the virtual information around the ship, expressed in RViz. ➀, ➁, and ➂ in (b) indicate the GMM mapping at ship positions shown in (a). The red dots represent the LiDAR point cloud information and the yellow ellipse is the confidence ellipse determined based on the point cloud information, that is, the obstacle information captured by the USV to avoid collision. The curve located in front of the USV represents the local trajectories generated by the unicycle model. The blue and red curves are trajectories in the direction in which the USV does not collide and does collide with other obstacles, respectively. The vessel controls the direction by adopting the optimal path closest to the desired psi among the trajectories that do not lead to a collision, and the optimal path is displayed as a green curve on RViz. The shortest path to the waypoint is indicated by a pink dotted line. As shown in the bottom part of the figure, a path with a range larger than the actual obstacle size corresponds to a collision. In other words, a safety margin for the collision prediction is set to ensure the safety of the ship.
Figure 13a shows the state variables of the USV, which vary in the simulation. The horizontal axis t indicates the elapsed time, and the vertical axis of each graph is the state variable of the USV.
u represents the surge speed of the ship. The ship progresses while maintaining an operating speed of 2.3 kn.
and r denote the heading angle and yawrate of the USV, respectively. The solid red line represents
, which is the desired yawrate when the optimal path is selected in motion primitives, and the solid blue line is the current yawrate. Except in a certain section, the desired yawrate is suitably followed.
is the steering command. The thruster command value is
[0, 1]. When the USV advances, the left and right thrusters receive a command value of 0.5. While turning hard to the port and starboard sides, the left and right thrusters receive values of 0 and 1 and values of 1 and 0, respectively. Therefore, a positive and negative delta command is transmitted when turning left and right, respectively.
Figure 13b shows the distance to the closest obstacle to determine whether the USV collides with the obstacle.
is the distance between the USV and the nearest obstacle, corresponding to the Euclidean distance.
is defined as in Equation (
19), where
are the obstacle coordinates.
In
Figure 13b, the critical distance at which the ship collides with the obstacles is 1.72 m and the minimum distance between the USV and the obstacle is 2.64 m. Therefore, the USV can proceed toward the destination without any collision.
Next, to verify the effectiveness of the GMM·MP-based collision avoidance method, it is compared with the VFF theory.
Figure 14 shows representative trajectories of GMM·MP method and VFF method for fixed obstacles. The simulation for each method was performed 10 times, and the average values of the results presented in
Table 2.
The finish time is the time elapsed from the initial movement of the unmanned ship to when it is 5 m from the target point. The finish time of the GMM·MP method is 3.83 s smaller than that of the VFF method. On average, the distance from the nearest obstacle for the GMM·MP method is 0.02 m smaller than that for the VFF method. The GMM·MP method and VFF method can successfully avoid collision with obstacles, as indicated by the number of collisions and percentage of success (number of simulations completed without any collisions). The cross-track error indicates the degree of deviation of the USV from the virtual straight line connecting the starting and destination points. The error of the GMM·MP method is 2.74 m smaller than that for the VFF method. To provide the information more intuitively, the deviation of the avoidance performance of the two collision avoidance methods is expressed as a box plot in
Figure 15.
is the finish time of the USV, and
is the cross-track error. In the first graph, although the standard deviation of
for the GMM·MP method is greater than that for the VFF method, the GMM·MP method exhibits a smaller finish time than the VFF method in all simulations. For the GMM·MP method, the maximum and minimum finish time are 127.92 and 126.18 s, respectively. The corresponding values for the VFF method are 131.14 s and 130.66 s. As shown in the second graph, the distance from the obstacle is smaller for the GMM·MP method than that for the VFF method. The standard deviation for the GMM·MP method and the VFF method are 0.12 m and 0.07 m, respectively. The VFF method yields more stable results, likely because the vessel in this case does not pass through the narrow space between the obstacles. The standard deviation of the cross-track error is 0.06 m for the GMM·MP method, corresponding to a higher stability than that for the VFF method (0.1 m).
4.2.2. Scenario with Fixed and Mobile Obstacles
Figure 16 shows the trajectory for the case in which the USV performs collision avoidance for fixed and mobile obstacles, in intervals of 8 s. The simulation environment is shown in
Figure 16a, and the GMM mapping and local trajectories are shown in
Figure 16b. In (a), the path of the target ships is marked by faint lines. The point at which the ship starts to avoid the target ships is highlighted in orange. ➀, ➁, and ➂ in the (b) represent the results of GMM mapping of obstacles at positions shown in (a). As indicated in (a), the ship first encounters an obstacle ship at point ➀ in a head-on situation and turns to starboard. At point ➁, the ship encounters the second obstacle ship in the crossing situation, and thus, collision avoidance is implemented. At point ➂, collision avoidance for fixed obstacles is performed.
Figure 17 shows the state variables of the USV in the scenario with fixed and mobile obstacles.
Figure 17a shows the state variables of the USV during collision avoidance in the form of a graph. The first graph shows that the average ship speed is maintained at 2.3 kn. The ship speed rapidly increases after 70–80 s. This phenomenon occurs because
is maximized while avoiding dynamic obstacles. Moreover, as shown in the third graph, the yawrate is effectively tracked. However, the control response becomes slower in the section in which the desired yawrate rapidly changes.
Figure 17b shows the distance between the USV and nearest obstacle. The minimum distance is 2.36 m, which is greater than the collision distance threshold (1.72 m).
Ten simulations are performed to verify the collision avoidance performance of the USV against dynamic obstacles.
Figure 18 shows representative trajectories of GMM·MP method and VFF method in mobile obstacle scenario.
Table 3 summarizes the results of the different collision avoidance methods for dynamic obstacles. The finish time for the GMM·MP method is approximately 2.67 s smaller than that of the VFF method, although the distance from the nearest obstacle is approximately 0.32 m larger for the VFF method. Using the GMM·MP method, all 10 simulations were successfully completed without collisions. However, when using the VFF method, collisions occurred once in two simulations.
Figure 19 shows the deviation in the avoidance performance of the USV for dynamic obstacles as a box plot. The standard deviation of the finish time is 0.37 s and 0.55 s for the GMM·MP method and VFF method, respectively. Therefore, the GMM·MP method exhibits a fast and stable response. The distance to the nearest obstacle is 0.54 m and 0.42 m for the GMM·MP and VFF methods, respectively. Therefore, the VFF method is slightly more stable. However, the standard deviations of the cross-track error are 0.08 m and 0.61 m for the GMM·MP and VFF, respectively. Therefore, the GMM method is more stable. This finding can be explained by the fact that a collision occurs when using the VFF method, and an outlier exists in the cross-track error.
4.3. Overview of the Results
The GMM·MP generally outperforms the VFF method. When the VFF theory is applied, the vessel tends to avoid obstacles by taking a detour without passing through the narrow space between obstacles. In contrast, the GMM·MP method allows the vessel to pass through narrow passages. Nevertheless, because the GMM·MP method implements obstacle mapping based on probability, obstacle mapping is performed differently even in the same simulation environment, and thus, the standard deviation of the avoidance performance is larger than that associated with the VFF method. In terms of the maintenance of distance from the obstacles, the VFF method exhibits more stable results.
5. Conclusions
According to collision avoidance simulations, the vessel implementing the proposed algorithm can arrive at the target point without colliding with an obstacle. Notably, the method based on GMM mapping and the unicycle model does not yield the exact position of obstacles or vessel behavior compared to the model that considers dynamics. However, using the GMM, the location of the obstacles can be approximated, and the trajectory of the vessel can be corrected through prompt calculation to avoid a collision situation. In addition, the stability of the proposed method was verified by confirming that the USV can safely avoid obstacles in ROS simulations. The proposed technique, which can correct the local trajectory according to obstacles while maintaining the current route, is expected to enhance the reliability of path planning and collision avoidance when used in combination with existing deliberative control methods. Finally, this technology is expected to be useful when performing the USV formation control by preventing collision close USVs or obstacles while maintaining their formation.