Next Article in Journal
Numerical Study and Optimal Design of the Butterfly Coil EMAT for Signal Amplitude Enhancement
Next Article in Special Issue
Guidelines on Asset Management of Offshore Facilities for Monitoring, Sustainable Maintenance, and Safety Practices
Previous Article in Journal
Detection of Horse Locomotion Modifications Due to Training with Inertial Measurement Units: A Proof-of-Concept
Previous Article in Special Issue
Seabed Modelling by Means of Airborne Laser Bathymetry Data and Imbalanced Learning for Offshore Mapping
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Fuzzy Inference and Sequence Model-Based Collision Risk Prediction System for Stand-On Vessel

1
Division of Navigation and Information System, Mokpo National Maritime University, Mokpo 58628, Korea
2
Department of Maritime Transportation System, Mokpo National Maritime University, Mokpo 58628, Korea
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(13), 4983; https://doi.org/10.3390/s22134983
Submission received: 13 June 2022 / Revised: 28 June 2022 / Accepted: 30 June 2022 / Published: 1 July 2022

Abstract

:
Although the International Regulations for Preventing Collision at Sea (COLREGs) provide guidelines for determining the encounter relations between vessels and assessing collision risk, most collision accidents occur in crossing situations. Accordingly, prior studies have investigated methods to identify the relation between the give-way and stand-on vessels in crossing situations to allow the stand-on vessel to make the optimal collision-avoidance decision. However, these studies were hindered by several limitations. For example, the collision risk at the current time (t) was evaluated as an input variable obtained at the current time (t), and collision-avoidance decisions were made based on the evaluated collision risk. To address these limitations, a collision risk prediction system was developed for stand-on vessels using a fuzzy inference system based on near-collision (FIS-NC) and a sequence model to facilitate quicker collision avoidance decision making. This was achieved by predicting the future time point (t + i) collision risk index (CRI) of the stand-on vessel at the current time point (t) when the own-ship is determined to be the stand-on vessel in different encounter relations. According to the performance verification results, navigators who use the developed system to predict the CRI are expected to avoid collisions with greater clearance distance and time.

1. Introduction

According to data compiled by the Korea Maritime Safety Tribunal [1] on vessel accidents by accident type in South Korea over the past five years (2017–2021), the most common accident type was engine damage, followed by collision, safety accidents, grounding, fire and explosion, capsizing, sinking, and contact. Vessel collision accidents are of particular concern because they not only result in structural damage to the hull but also cause loss of life and property, as well as marine pollution. The main cause of collision accidents is operational negligence, such as non-compliance with general navigational principles, laws, and regulations, which accounts for approximately 95% of all accidents. Hence, to prevent these accidents, complying with the International Regulations for Preventing Collisions at Sea (COLREGs) [2] is essential. These regulations describe the appropriate collision-avoidance actions at optimal positions and times based on the analysis of a wide variety of collected data.
According to the navigation rules in COLREGs Part B, the collision-avoidance actions between vessels, shown in Figure A1, are performed considering Rules 5, 7, 8, and 13–17 [3]. In particular, the collision risks are assessed, and encounter relations are determined according to the following rules, as shown in Figure A1:
“Rule 7”: Perform collision risk assessment using radar plotting or equivalent systematic observation and compass bearing of an approaching vessel.
“Rules 13–15”: Determine whether it is a head-on situation, overtaking, or a crossing situation between the own-ship (OS) and target ship (TS).
“Rule 16”: If determined to be a give-way vessel, create a safe distance early by simultaneously changing both course and speed, or only course or speed, and take action to avoid collision with the TS.
“Rule 17”: If determined to be a stand-on vessel, and if there is no risk of collision due to the collision-avoidance action of the give-way vessel, then maintain current course and speed; otherwise, take a collision-avoidance action.
Despite the vessel collision risk assessment and encounter relation determination according to Rules 7 and 13–17, most collision accidents occur in crossing situations [4,5,6]. This is because, for various crossing situations, the crew often cannot determine the relation between the give-way and stand-on vessels. Moreover, although the duty of the give-way vessel is relatively lucid and simple, the stand-on vessel must perform a collision-avoidance action after observing the give-way vessel’s navigation. Nonetheless, most of these studies are designed from the give-way ship perspective only [7,8,9,10,11,12,13,14,15].
Hence, conflict analysis on the activation of the stand-on ship’s role in conflict elimination to improve safe conflict resolution among ships encountering one another has been conducted as follows. To unambiguously interpret the relation between the give-way and stand-on vessels in a crossing situation and to assist the stand-on vessel in making the optimal decision to avoid collision, the ship domain (SD) [16,17,18], collision risk index (CRI) [5,19,20,21,22,23], minimum distance to collision (MDTC) [24,25,26,27,28], and nonlinear velocity obstacle (NL-VO) algorithm [6,29] have been used. The SD is a generalized safe distance that must be maintained in situations where there are no TSs or obstacles. It is used as a standard to assess the collision risk of the stand-on vessel [16,17,18]. In the CRI, if the OS is determined to be a stand-on vessel, then a collision-avoidance action is taken when the defined CRI is higher than a threshold value [5,19,20,21,22,23]. The MDTC defines the minimum distance at which the stand-on vessel can avoid a collision; when the distance between the give-way and stand-on vessels is less than the MDTC, a collision-avoidance decision is made [24,25,26,27,28]. In collision avoidance using the NL-VO algorithm, the stand-on vessel estimates the navigation intention of the give-way vessel using SLoD (Stand-on Ship as Second Line of Defense) and makes a collision-avoidance decision considering the dynamic characteristics of the vessel’s behavior using the NL-VO algorithm [6,29]. However, although the aforementioned studies were performed to reduce collision accidents in crossing situations, they did not consider several important issues. First, they considered only the relations between the give-way and stand-on vessels based on the four stages of a collision situation that is outlined in a guide on collision-avoidance rules [30]. Therefore, these studies do not consider all of the encounter relations that occur between give-way and stand-on vessels in various crossing situations. Second, the collision risk at the current time (t) was assessed using input variables obtained at this time, and the collision-avoidance decision was made based on the evaluated collision risk level. Thus, when assessing collision risk based on the current time point, a collision-avoidance action must be performed without clearance space or time since the navigator must make a decision when the vessel has already passed the current time point (t).
In this study, a collision risk prediction system was developed for stand-on vessels using a sequence model to facilitate quicker collision-avoidance decision making compared to conventional approaches by predicting the future time point (t + i) CRI of the stand-on vessel at the current time point (t) when the OS is determined to be the stand-on vessel in various encounter relations. First, to identify the encounter relation in various crossing situations, the give-way vessel and stand-on vessel are determined according to the encounter relation determination diagram. Additionally, for each encounter angle of each stand-on vessel, continuous input and output data are collected from the point when the collision risk between the give-way and stand-on vessels occurs to the point when the stand-on vessel must perform collision-avoidance actions. Finally, an optimal collision risk prediction system was developed based on learning using the long short-term memory (LSTM), bidirectional LSTM (Bi-LSTM), and gated recurrent unit (GRU) sequence models.
The remainder of this paper is separated into different sections. Section 2 presents the theoretical background of this study. Section 3 outlines the system development process and describes the development of the collision risk prediction system for stand-on vessels in detail. Section 4 examines the performance evaluations based on a case study of the developed system, in addition to a detailed discussion of the results. Finally, Section 5 presents the main conclusions of the study.

2. Theoretical Background

2.1. Determining Encounter Relations and Required Avoidance Actions

The required avoidance actions in COLREGs rules 13–15 [2], i.e., (a) a head-on situation, (b) overtaking, and (c) a crossing situation, are schematized in Figure 1. In the head-on situation, the OS and TS have equal responsibilities for avoiding each other. In the overtaking situation, a vessel is deemed to be overtaking when approaching another vessel from a direction more than 22.5° abaft of its beam, and the overtaking vessel is not relieved of its duty to keep clear of the overtaken vessel until completely past and clear. In the crossing situation, the vessel that has the other vessel on its starboard side (i.e., the give-way vessel) must avoid the course of the other vessel and, unless circumstances permit, avoid crossing ahead of it (i.e., the stand-on vessel).
Figure 2 is a diagram for determining the encounter relation and the required avoidance actions between the OS and TS using the visibility range of navigation lights. Based on the course ϕ o of the OS, the position area of the TS is determined as the relative bearing α r , and the encounter angle ϕ e , where the course of the OS, ϕ o , meets that of the TS, ϕ t , in the determined area is calculated, thereby determining the encounter relation and the avoidance actions required by the OS. The circled areas indicate the TS; the OS determines the encounter relation in the circle based on ϕ e , and the OS’s avoidance actions differ depending on the encounter relation. These are classified here as head-on, crossing (give-way), crossing (quarter lee give-way), crossing (stand-on), crossing (quarter lee stand-on), overtaking, being overtaken, and safe.
Here, α r and ϕ e between the OS and TS are geometrically related, as shown in Figure 3. Further, ϕ e is calculated using Equation (1); if it is a negative number, then 360° is added.
ϕ e = ϕ t ϕ o π

2.2. Collision Risk Inference Using FIS-NC

2.2.1. Input Parameters

D CPA is the minimum distance at which the OS passes the TS when maintaining its current course and speed in an encounter. T CPA is the time taken to reach D CPA , the point at which the two vessels are the closest. D CPA and T CPA are obtained from geometric calculations, as shown in Figure 4 [3,23].
Here, x o , y o , ϕ o , and V o represent the position, course, and speed of the OS, and x t , y t , ϕ t , and V t indicate the position, course, and speed of the TS; α r is the relative bearing of the TS with respect to the OS. The relative movement parameters, D CPA , and T CPA are mathematically expressed using Equations (2)–(6).
D r = x t x o 2 + y t y o 2
V r = V o × 1 +   V t V o   2 2 × V t V o × cos ϕ o ϕ t
ϕ r = c o s 1   V o V t × cos ϕ o ϕ t V r
D C P A = D r × sin ϕ t α t π
T C P A = D r × cos ϕ t α t π / V r
where D r is the relative distance between the OS and TS, V r is the relative speed, ϕ r is the relative course, and α t is the true bearing of the TS. Here, the variance of compass degree (VCD) can be calculated using Equation (7).
V C D i = α r i α r i 1

2.2.2. CRI Inference Based on IF-THEN Rule

D CPA , T CPA , VCD , and D r are set to the antecedent parameter values x 1 , x 2 , x 3 , and x 4 , and CRI is set to the consequent parameter value R C . The membership function for each fuzzy set is determined using Equation (8) based on the language variables Collision (C), Danger (D), Threat (T), and Attention (A).
R u l e i   :   If   x 1   i s   μ D C P A i   and   x 2   is   μ T C P A i   and   x 3   is   μ V C D i   and   x 4   is   μ D r i
                                                                        t h e n     R C   = f i x 1 ,   x 2 ,   x 3 ,   x 4      
The antecedent parameters x 1 , x 2 , x 3 , and x 4 are expressed as   μ D C P A , μ T C P A ,   μ V C D , and     μ D r , and the consequent parameter R c i is the function f i x 1 ,   x 2 ,   x 3 ,   x 4 ; f i x 1 ,   x 2 ,   x 3 ,   x 4 is a polynomial expressed in Equation (9). If k i , 0 , k i , 1 , k i , 2 , k i , 3 , and k i , 4 are the consequent argument set of rule i , and x 1 , x 2 , x 3 , and x 4 are 0, then f i has only the k i , 0 term.
f i = k i , 0   +   k i , 1 × x 1 + k i , 2 × x 2   + k i , 3 × x 3   + k i , 4 × x 4              
Therefore, there are a total of 256 rules in the fuzzy inference system based on near-collision (FIS-NC) that comprise combinations of the membership functions, as shown in Table 1 [23].
Given that FIS-NC has a total of 256 rules, the function f i x 1 ,   x 2 ,   x 3 ,   x 4 can be expressed as Equation (10).
f 1 x 1 ,   x 2 ,   x 3 ,   x 4   f 256 x 1 ,   x 2 ,   x 3 ,   x 4
The final output expresses all 256 consequent argument sets as a single unit, which is obtained using the weighted average f , as shown in Equation (11).
f   = i = 1 256 μ k i 1 × k i 1 + μ k i 2 × k i 2 + μ k i 3 × k i 3 + μ k i 4 × k i 4 μ k i 1 + μ k i 2 + μ k i 3 + μ k i 4
The calculated CRI ranges from 0.00 to 1.00; if the time point for collision avoidance of the give-way vessel is at least 0.01 or that of the stand-on vessel is at least 0.33, then a collision-avoidance action is taken.

2.3. Sequence Model

If it is assumed that the give-way vessel does not perform adequate clearing action early in a crossing situation, then the stand-on vessel’s CRI gradually increases as all of the input parameters approach 0 over time. In this sequence data, since the past data influence present data, it is necessary to consider both sets of data for future prediction. A recurrent neural network (RNN) is a representative model that can be applied to sequence data to create a prediction model [31,32]. A backpropagation algorithm is used for training general RNNs. However, when error information is backpropagated to a point in the past, the gradient generally vanishes quickly. The usual approaches for mitigating this phenomenon include LSTM [33,34], Bi-LSTM [35,36,37], and GRU [38].

2.3.1. LSTM

In Figure 5, x t represents the input to the hidden node at time t , and h t indicates the node output at time t . The input gate i t plays a role in determining how much of the processing result of input information, x t , is represented in the memory cell, c t . The output value i t of the input gate is calculated using Equation (12) based on the input x t and its weight U i , the output h t 1 of the previous time point and its weight W i , and the bias term b i . Here, σ is the sigmoid function.
i t = σ U i x t + W i h t 1 + b i
The forget gate f t determines the ratio of the previous state value c t 1 of the memory cell that should be maintained at the current time point t . The value of the forget gate is calculated using Equation (13) based on input x t and its weight U f , the output h t 1 of the previous time point and its weight W f , and the bias term b f .
f t = σ U f x t + W f h t 1 + b f
The value c t stored in the memory cell at time t is calculated using Equation (14); a t is the newly determined state value that is calculated using the LSTM model at time t .
a t = tanh U c x t + W c h t 1 + b c c t = i t a t + f t c t 1
where indicates the product of the corresponding position elements of two vectors. According to the second equation, the value c t of the memory cell is determined by considering the ratio, f t , of the previous state value, c t 1 , and the ratio i t of the new state value a t . The output gate o t plays a role in adjusting the output of the value stored in memory cell c t . Here, U o , W o , and V o are the weights of the input, previous output, and previous state value, respectively, and b o is the bias term.
o t = σ U o x t + W o h t 1 + V o c t 1 + b o
Output h t at time point t is calculated by multiplying the output gate values o t and tanh c t for each element, as shown in Equation (16).
h t = o t tanh c t
Algorithm 1 state the execution of LSTM [33,34].
Algorithm 1: Algorithm for execution of LSTM
Input: sequence data ( x 1 ,   x 2 ,   ,   x t )
weight W i ,   U i , W f , U f ,     W o ,   U c ,   W c   U o ,   V o
bias b i ,   b f ,   b c ,   b o
output: h 1 ,   h 2 , ,   h t
 
1 h 0 0
2 c 0 0
3      for t = 1 to t
4            i t σ U i x t + W i h t 1 + b i
5            a t tanh U c x t + W c h t 1 + b c
6            f t σ U f x t + W f h t 1 + b f
7            c t i t a t + f t c t 1
8            o t σ U o x t + W o h t 1 + V o c t 1 + b o
9            h t o t tanh c t
10     end

2.3.2. Bi-LSTM

Bi-RNN is a model in which the output at time point t is affected by not only the input and hidden layer values at a previous time but also the input and hidden layer values at a later time. Figure 6 shows the architecture of a Bi-RNN, in which the output is obtained from two hidden layer nodes. The connected lines from left to right indicate that the past has an influence. In contrast, the connected lines from right to left indicate that the future influences the present. Here, Bi-LSTM uses an LSTM model for each hidden layer of the former.
If we define the weight matrix between the input and forward layers as U , the weight matrix between the forward layers as W , and the bias term vector of the forward layer as b , then the forward layer value h t at time t can be calculated using Equation (17).
h t = σ U x t + W h t 1 + b
If we define the weight matrix between the input and backward layers as U , the weight matrix between the backward layers as W , and the bias term vector of the backward layer as b , then the backward layer value h ¯ t at time t can be calculated as in Equation (18).
h ¯ t = σ U x t + W h ¯ t + 1 + b
The output layer value y t at time t is calculated as shown in Equation (19) by combining the forward layer value h t and backward layer value h ¯ t . V is the weight matrix between the forward and output layers, V is the weight matrix between the backward and output layers, b o is the bias term, and f is the activation function.
y t = f V h t + V h ¯ t + b o

2.3.3. GRU

Like LSTM in RNN, the GRU model is proposed to solve the vanishing gradient problem, and its internal operation is simpler than that of the LSTM. Figure 7 shows the architecture of the GRU model. While LSTM has three gates, GRU has only two gates: reset and update. The reset gate r decides how to combine input x t and existing stored content h t 1 . The reset gate performs computations according to Equation (20).
r t = σ U r x t + W r h t 1 + b r
Equation (21) can be used to calculate a new internal state value h ~ t by combining input x t and the existing stored content h t 1 according to the reset gate value r t .
h ˜ t = tanh ( U h x t + W h r t h t 1
The update gate z determines the ratio that represents the existing stored value h t 1 and newly calculated value h ˜ t . The value of the update gate z t is calculated using h t 1 and input x t according to Equation (22).
z t = σ U z x t + W z h t 1 + b z
The internal state value, h t , is calculated by combining the existing stored content h t 1 and newly calculated internal state value h ˜ t according to the updated gate value obtained from Equation (23).
h t = z t h t 1 + 1 z t h ˜ t
The internal state value, h t , is the output value without modification. Therefore, in the GRU model, the internal state value and output data have the same dimensions.

3. Stand-On Vessel Collision Risk Prediction System Using FIS-NC and Sequence Model

3.1. System Development Process

As shown in Figure 8, the development process of the stand-on vessel collision risk prediction system is divided into data collection and system development. In data collection, sectors I, V, and VI in the encounter relation determination diagram of Figure 2 are established using α r , and in the determined sectors, ϕ e is used to judge whether the vessel is a stand-on vessel. Second, if the vessel is judged to be a stand-on vessel, then according to the guide on collision avoidance rules [30], the input parameters D CPA , T CPA , VCD , and D r are calculated from 5 nautical miles (nm), the boundary point where the give-way vessel and stand-on vessel lose freedom of movement, to the point where both vessels collide. Third, the calculated parameters are input to FIS-NC to infer the CRI. Fourth, the CRIs from 0.01 (time point for collision avoidance of the give-way vessel) to 0.33 (time point for collision avoidance of the stand-on vessel) that are inferred based on the FIS-NC and input parameters used for this inference are collected. During system development, the collected input parameters and CRIs from 0.01 to 0.33 are designated as the input and target data of the sequence data, respectively. Additionally, after the values are input to LSTM, Bi-LSTM, and GRU and learned to develop a stand-on vessel collision risk prediction system for each case, their performances are compared.

3.2. Data Collection

3.2.1. Simulation Scenario

After configuring the scenarios shown in Table 2, data were collected via simulation using MATLAB. First, we set the speed of both vessels to 15 kn, the highest speed limit in Korean ports [39]. Second, the automatic identification system (AIS) dynamic information was updated according to the required changes in the vessel’s speed and course to prevent a collision between the vessels. Since the reporting period was 4 s when the speed was set to 15 kn, the AIS period was set to 4 s [40]. Third, the D r was calculated considering the relative speed of both vessels and an AIS period of 4 s, according to the guide on collision-avoidance rules [30], from 5 nm, the boundary point where the give-way and stand-on vessels lose freedom of movement, until collision. Finally, in sectors I, V, and VI, the OS’s heading was set to 000 degrees as the reference, and the TS’s heading was set as 11.25° to allow the OS to become the stand-on vessel for the circles in sectors I, V, and VI. Here, the α r of the TS for each OS reference was set to 360° in sector I, 270° in sector V, and 320.625° in sector VI.

3.2.2. Collected Data

Based on the simulation results for each scenario, the input parameters D CPA , T CPA , VCD , and D r and the CRIs that were inferred by applying the parameters in FIS-NC were collected from sectors I and VI (1680 data) and sector V (2520 data). Table 3 shows the averages of the D CPA , T CPA , VCD , D r , and CRI data collected from sectors I, V, and VI from CRI 0.01 (the time point for collision avoidance of the give-way vessel) to 0.33 (the time point for collision avoidance of the stand-on vessel). These values represent the characteristics of the sequence model for learning data according to the flow of time. As a result, 40, 39, and 40 data values were acquired in sectors I, V, and VI, respectively.

3.3. System Development

D CPA , T CPA , VCD , and D r , which are the input data obtained via data collection, and the CRI, which is the output data, were input to LSTM, Bi-LSTM, and GRU for learning. To predict the CRI for a certain time step in the future, the target data were determined using data that were moved twice at each time step of the input data, as shown in Figure 9. Among all vessels, the ship with the slowest reaction time is the tanker. Therefore, the difference in time was applied using a tanker. In the ship handling simulator shown in Figure 10, the laden 330,000-tonnage tanker ship experienced a kick phenomenon from its original course. The time point of this incidence was taken as the reaction time, which was measured at 8 s via the ship handling simulator in Figure 10.
To compare the systems developed using LSTM, Bi-LSTM, and GRU, each neural network was configured with the same conditions (hidden nodes of identical layers, number of learning epochs, gradient threshold, and initial learning rate). Adaptive moment estimation (ADMA), a method for learning weights while adjusting the learning rate for each weight, was utilized during learning. The root-mean-squared error (RMSE) was used as the selection criterion for each prediction system. RMSE is a measure of prediction error and was used to show the difference between the CRI ( R ^ c i ) predicted using the test data of the explanatory variable in the system trained with the training data and the CRI ( R c i ) contained in the test data of the response variable. It can be calculated as shown in Equation (24).
R M S E   =     i = 1 n R ^ c i R c i 2 n
Figure 11, Figure 12 and Figure 13 show the learning results of sectors I, V, and VI for the test data predicted using LSTM, Bi-LSTM, and GRU. According to the results, the sequence model with RMSE values that were closest to 0 in all sectors was Bi-LSTM.

3.4. System Application

The collision risk prediction system for stand-on vessels that was developed based on Bi-LSTM can be implemented using the following Algorithm 2. Initially, when the CRI is less than 0.01, the OS maintains its original course and speed. However, when the CRI is 0.01 or greater, the OS determines whether the TS is located in sectors I, V, or VI depending on α r . In each sector, ϕ e is then used to determine whether the OS is a stand-on vessel; if so, then the collision-avoidance time point of the stand-on vessel, CRI = 0.33, is predicted using the developed system.
Algorithm 2: Algorithm for developed system application
Input: α r , ϕ e , encounter relation E r , D C P A , T C P A , V C D , D r
output: C R I
1 Initialize C R I < 0.01 ← keep course and speed
2    while C R I >= 0.01 do
3        if TS is in “sector I, V, and VI” decided with α r
4            if ( ϕ e > 247.5) and (348.75 > ϕ e ) or ( ϕ e > 180) and (348.75 > ϕ e ) or ( ϕ e > 247.5) and (348.75 > ϕ e ) then
5          decide  E r ← crossing situation (stand-on, quarterlee stand-on) of OS
6          predict CRI 0.33 ← the time point for collision avoidance of stand-on vessel
7            else
8          decide  E r ← head-on situation or overtaking or Safe of OS
9         end
10     end
11 end

4. Case Study

According to the Korea Maritime Safety Tribunal decision [1], on 14 December 2011 at approximately 06:24 at 34° 33′ 17″ N, 128° 01′ 49″ E, PACIFIC CARRIER (stand-on vessel), which was carrying 133,104 t of coal to Samcheonpo Port, collided with HYUNDAI CONFIDENCE (give-way vessel), which was carrying 3133 twenty-foot equivalent units (TEUs) of containers from Gwangyang Port to Busan Port. The two vessels encountered a crossing situation wherein HYUNDAI CONFIDENCE was unable to avoid PACIFIC CARRIER, and the two vessels collided, as shown in Figure 14. Consequently, PACIFIC CARRIER experienced a puncture in the hull approximately 20 m long and 10 m high at the center of the left side, severe damage to cargo holds 4, 5, and 6, and approximately 70 cm of flooding in the engine room. HYUNDAI CONFIDENCE experienced severe damage to the bow and cargo hold 1. In this study, we determined whether it was possible to perform a collision-avoidance action with sufficient space and time clearance by applying the developed system to PACIFIC CARRIER and determining the encounter relation between the give-way and stand-on vessels in a crossing situation.

4.1. Simulation Results

Table 4 shows the trajectory data of both vessels based on the AIS information. The trajectory data were interpolated in 30 s increments and simulated using MATLAB, as shown in Figure 15. The trajectory numbers were set to simultaneously identify the movements of both vessels. Based on the analysis of trajectories from the AIS information of both vessels, trajectory number 1 had a D r of 6.4 nm and a relative speed of 27 kn and showed no encounter relation. Given trajectory number 2, however, with a D r of 5.5 nm and a relative speed of 21.2 kn, based on PACIFIC CARRIER (stand-on vessel), the encounter relation in sector VI of Figure 15 was initiated, and neither vessel took appropriate collision-avoidance actions, which led to the collision accident.
To evaluate performance, FIS-NC and the developed system were applied to PACIFIC CARRIER (stand-on vessel), and the results are shown in Figure 16 and Table 5. For FIS-NC and the developed system, in trajectory number 3, the CRI gradually increased according to the input variable from 0.01 and higher (time point for collision avoidance of the give-way vessel). In trajectory number 4, however, the developed system gave a greater D r and T CPA clearance of 0.297 nm and 1 min, respectively, compared to FIS-NC at CRI = 0.33 and higher (time point for collision avoidance of the stand-on vessel) and recommended a collision-avoidance action for PACIFIC CARRIER (stand-on vessel).

4.2. Discussion

By applying the Algorithm 2 for the developed system to PACIFIC CARRIER (stand-on vessel) in a real collision accident, it was not only possible to accurately determine whether the vessel was the stand-on vessel in a changing encounter relation, but a collision-avoidance action was also recommended for PACIFIC CARRIER (stand-on vessel) for CRI values of 0.33 and higher (time point for collision avoidance of the stand-on vessel) assuming that HYUNDAI CONFIDENCE (give-way vessel) did not perform an appropriate collision-avoidance action. However, FIS-NC also recommended the same collision-avoidance action for PACIFIC CARRIER (stand-on vessel) from CRI 0.33 and higher (time point for collision avoidance of the stand-on vessel).
Because each system infers and predicts different CRIs according to changes in the input variables at the same distance and time, the clearance distance and time for PACIFIC CARRIER (stand-on vessel) to avoid collision were different. To evaluate whether the avoidance actions recommended at the clearance distance and time for the CRIs inferred and predicted using each system were appropriate, the results were analyzed based on a guide for collision avoidance rules [30]. Accordingly, if the give-way vessel does not take appropriate action in the open sea according to Rule 16, the stand-on vessel must take a collision-avoidance action within 6 min at approximately 2 to 3 nm. We compared D r and T CPA of FIS-NC and the developed system when the inferred and predicted CRIs were 0.33 and higher, as shown in Table 6. The developed system recommended collision-avoidance actions that satisfied the distance and time requirements in the guide to collision avoidance rules. Hence, navigators who use the system to predict CRI are expected to be able to safely avoid collisions while securing more clearance distance and time.

5. Conclusions

In this study, a collision risk prediction system was developed using FIS-NC and a sequence model to enable stand-on vessels to perform safe collision-avoidance actions while securing appropriate clearance distance and time. This was achieved by predicting the future CRI if the OS was determined to be a stand-on vessel in various encounter relations. The development of the collision risk prediction system for stand-on vessels was divided into data collection and system development. In data collection, when the OS was determined to be the stand-on vessel according to the encounter relation judgment guidelines, CRI values from 0.01 (time point for collision avoidance of the give-way vessel) to 0.33 (time point for collision avoidance of the stand-on vessel) that were inferred using FIS-NC and the input parameters D CPA , T CPA , VCD , and D r used for this inference were collected. In system development, the collected input parameters and CRIs from 0.01 to 0.33 were designated as the input data and target data of the sequence data, respectively. Additionally, after the values were input to the sequence models (LSTM, Bi-LSTM, and GRU) and learned to develop a stand-on vessel collision risk prediction system for each case, the optimal system was selected. According to the results, the collision risk prediction system for collision avoidance of stand-on vessels using Bi-LSTM demonstrated superior performance. Among vessels that experienced collision accidents, the developed system using Bi-LSTM was applied to a stand-on vessel to evaluate its performance. In this instance, the system recommended a collision-avoidance action that could be safely performed by the stand-on vessel while also securing more clearance distance and time compared to conventional approaches. However, despite the diverse maritime navigation environments and vessel navigation information encountered during voyages, only the input parameters D CPA , T CPA , VCD , and D r are required for the proposed system. Therefore, in future studies, systems that can predict the optimal CRI by considering additional navigation environmental factors should be investigated.

Author Contributions

Conceptualization, H.N. and S.-W.O.; methodology S.-W.O.; software, H.N.; validation, H.N. and S.-W.O.; formal analysis S.-W.O.; investigation, H.N.; resources, H.N.; data curation, S.-W.O.; writing—original draft preparation, H.N.; writing/review and editing, S.-W.O.; visualization, H.N.; supervision, S.-W.O.; funding acquisition, H.N. and S.-W.O. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Basic Science Research Program through the National Research Foundation of Korea (NRF) by the Ministry of Education, grant number 2020R1I1A1A01060533.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data that support the findings of this study are available from the corresponding author upon reasonable request.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Figure A1. Procedure for collision avoidance based on COLREGs ([3]. 2022, Namgung, H.).
Figure A1. Procedure for collision avoidance based on COLREGs ([3]. 2022, Namgung, H.).
Sensors 22 04983 g0a1

References

  1. Korean Maritime Safety Tribunal. Annual Report of Marine Accident. 2020. Available online: http://www.kmst.go.kr/kmst/statistics/annualReport/selecAnnReportList.do/ (accessed on 21 October 2021).
  2. International Maritime Organization. Convention on the International Regulations for Preventing Collisions at Sea (COLREGs); International Maritime Organization: London, UK, 1972.
  3. Namgung, H. Local route planning for collision avoidance of maritime autonomous surface ships in compliance with COLREGs rules. Sustainability 2022, 14, 198. [Google Scholar] [CrossRef]
  4. Kim, T.-G.; Hong, S.-H. Empirical analysis on the apportionment system of causation ratio in ship collision. J. Navig. Port Res. 2013, 37, 6. [Google Scholar]
  5. Shaobo, W.; Yingjun, Z.; Yisong, Z. Multi-ship encounter situation adaptive understanding by individual navigation intention inference. Ocean Eng. 2021, 237, 109612. [Google Scholar]
  6. Lei, D.; Floris, G.; Osiris, A.V.; Yamin, H.; Yuanqiao, W. Improving stand-on ship’s situational awareness by estimating the intention of the give-way ship. Ocean Eng. 2020, 201, 107110. [Google Scholar]
  7. Coldwell, T.G. Marine traffic behaviour in restricted waters. J. Navigat. 1983, 36, 430–444. [Google Scholar] [CrossRef]
  8. Smierzchalski, R. Ships’ domains as a collision risk at sea in the evolutionary trajectory planning. In Proceedings of the RISK Computer Simulation Risk Analysis and Hazard Mitigation, Southampton, UK, 11–13 October 2000; p. 45. [Google Scholar]
  9. Kijima, K.; Furukawa, Y. Automatic collision avoidance system using the concept of blocking area. In Proceedings of the IFAC Conference on Manoeuvring and Control of Marine Craft, Madrid, Spain, 17–19 September 2003; Volume 36, pp. 223–228. [Google Scholar]
  10. Pietrzykowski, Z.; Uriasz, J. The ship domain—A criterion of navigational safety assessment in an open sea area. J. Navigat. 2009, 62, 93–108. [Google Scholar] [CrossRef]
  11. Bakdi, A.; Glad, I.K.; Vanem, E.; Engelhardtsen, Ø. AIS-based multiple vessel collision and grounding risk identification based on adaptive safety domain. J. Mar. Sci. Eng. 2019, 8, 5. [Google Scholar] [CrossRef] [Green Version]
  12. Kearon, J. Computer program for collision avoidance and track keeping. In Proceedings of the Conference on Mathematical Aspects of Marine Traffic, London, UK, 15–16 September 1977; pp. 229–242. [Google Scholar]
  13. Smeaton, G.P.; Coenen, F.P. Developing an intelligent marine navigation system. Comput. Control Eng. J. 1990, 1, 95. [Google Scholar] [CrossRef]
  14. Lenart, A.S. Analysis of collision threat parameters and criteria. J. Navigat. 2015, 68, 887–896. [Google Scholar] [CrossRef] [Green Version]
  15. Zhao, Y.; Li, W.; Shi, P. A real-time collision avoidance learning system for unmanned surface vessels. Neurocomputing 2016, 182, 255–266. [Google Scholar] [CrossRef]
  16. Im, N.; Luong, T.N. Potential risk ship domain as a danger criterion for real-time ship collision risk evaluation. Ocean Eng. 2019, 194, 106610. [Google Scholar] [CrossRef]
  17. Rafal, S.; Przemyslaw, K.; Joanna, S. A ship domain-based method of determining action distances for evasive manoeuvres in stand-on situation. J. Adv. Transp. 2018, 2018, 3984962. [Google Scholar]
  18. Bing, W.; Yixiong, H.; Weixuan, H.; Junmin, M.; Liling, L.; Ke, Z.; Liwen, H. A decision-making method for autonomous collision avoidance for the stand-on vessel based on motion process and COLREGs. J. Mar. Sci. Eng. 2021, 9, 584. [Google Scholar]
  19. Hasegawa, K.; Kouzuki, A.; Muramatsu, T.; Komine, H.; Watabe, Y. Ship auto-navigation fuzzy expert system (SAFES). J. Soc. Nav. Archit. Jpn. 1989, 1989, 445–452. [Google Scholar] [CrossRef] [Green Version]
  20. Lee, H.; Rhee, K. Development of collision avoidance system by using expert system and search algorithm. Int. Shipbuild. Prog. 2001, 48, 197–212. [Google Scholar]
  21. Ahn, J.-H.; Rhee, K.-P.; You, Y.-J. A study on the collision avoidance of a ship using neural networks and fuzzy logic. Appl. Ocean Res. 2012, 37, 162–173. [Google Scholar] [CrossRef]
  22. Ohn, S.W.; Namgung, H. Interval type-2 fuzzy inference system based on closest point of approach for collision avoidance between ships. Appl. Sci. 2020, 10, 3919. [Google Scholar] [CrossRef]
  23. Namgung, H.; Kim, J.-S. Collision risk inference system for maritime autonomous surface ships using COLREGs rules compliant collision avoidance. IEEE Access 2021, 9, 7823–7835. [Google Scholar] [CrossRef]
  24. Montewka, J.; Hinz, T.; Kujala, P.; Matusiak, J. Probability modelling of vessel collisions. Reliab. Eng. Syst. Saf. 2020, 95, 573–589. [Google Scholar] [CrossRef]
  25. Montewka, J.; Goerlandt, F.; Kujala, P. A new definition of a collision zone for a geometrical model for ship-ship collision probability estimation. In Methods and Algorithms in Navigation; CRC Press: Boca Raton, FL, USA, 2011; pp. 93–100. [Google Scholar] [CrossRef]
  26. Montewka, J.; Goerlandt, F.; Lammi, H.; Kujala, P. A method for assessing a causation factor for a geometrical MDTC model for ship-ship collision probability estimation. In Methods and Algorithms in Navigation; CRC Press: Boca Raton, FL, USA, 2011; pp. 65–73. [Google Scholar] [CrossRef]
  27. Montewka, J.; Goerlandt, F.; Kujala, P. Determination of collision criteria and causation factors appropriate to a model for estimating the probability of maritime accidents. Ocean. Eng. 2012, 40, 50–61. [Google Scholar] [CrossRef]
  28. Mateusz, G.; Jakub, M.; Przemyslaw, K.; Tomasz, H.; Spyros, H. Determination of the dynamic critical maneuvering area in an encounter between two vessel: Operation with negligible environmental disruption. Ocean Eng. 2020, 213, 107709. [Google Scholar]
  29. Du, L.; Valdez, B.O.; Goerlandt, F.; Huang, Y.M.; Kujala, P. A COLREG-compliant vessel collision alert system for stand-on vessels. Ocean Eng. 2020, 218, 107866. [Google Scholar] [CrossRef]
  30. Cockcroft, A.N.; Lameijer, J.N.F. A Guide to the Collision Avoidance Rules: International Regulations for Preventing Collisions at Sea, 7th ed.; Butterworth-Heinemann: London, UK, 2012; pp. 85–86. [Google Scholar]
  31. Zhao, L.; Shi, G. Maritime anomaly detection using density-based clustering and recurrent neural network. J. Navig. 2019, 72, 894–916. [Google Scholar] [CrossRef]
  32. Rumelhart, D.E.; Hinton, G.E.; Williams, R.J. Learning representations by back-propagating errors. Nature 1986, 323, 533–536. [Google Scholar] [CrossRef]
  33. Hochreiter, S.; Schmidhuber, J. Long short-term memory. Neural Comput. 1997, 9, 1735–1780. [Google Scholar] [CrossRef]
  34. Gers, F.A.; Schmidhuber, J.; Cummins, F. Learning to forget: Continual prediction with LSTM. IEE Conf. Publ. 1999, 2, 850–855. [Google Scholar]
  35. Schuster, M.; Paliwal, K.K. Bidirectional recurrent neural networks. IEEE Trans. Signal Process. 1997, 45, 2673–2681. [Google Scholar] [CrossRef] [Green Version]
  36. Graves, A.; Schmidhuber, J. Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural Netw. 2005, 18, 602–610. [Google Scholar] [CrossRef]
  37. Siami-Namini, S.; Tavakoli, N.; Namin, A.S. The performance of LSTM and BiLSTM in forecasting time series. In Proceedings of the 2019 IEEE International Conference on Big Data (Big Data), Los Angeles, CA, USA, 9–12 December 2019; IEEE: Piscataway, NJ, USA, 2019; pp. 3285–3292. [Google Scholar]
  38. Cho, K.; Van Merriënboer, B.; Gulcehre, C.; Bahdanau, D.; Bougares, F.; Schwenk, H.; Bengio, Y. Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv 2014, arXiv:1406.1078. [Google Scholar]
  39. Kim, D.-B.; Yun, B.-W.; Jeong, J.-Y.; Park, J.-S.; Park, Y.-S. A fundamental study on the improvements of speed limit at the ports and fairways in Korea. J. Kor. Soc. Mar. Environ. Safety 2012, 18, 5. [Google Scholar]
  40. International Association of Marine Aids to Navigation and Lighthouse Authorities. IALA Guidelines 1082 an Overview of AIS; IALA: Saint-Germain-en-Laye, France, 2016. [Google Scholar]
Figure 1. Routes of steering for collision avoidance in COLREGs.
Figure 1. Routes of steering for collision avoidance in COLREGs.
Sensors 22 04983 g001
Figure 2. Decisions for different encounter relations ([3]. 2022, Namgung, H.).
Figure 2. Decisions for different encounter relations ([3]. 2022, Namgung, H.).
Sensors 22 04983 g002
Figure 3. Relative bearing and encounter angle.
Figure 3. Relative bearing and encounter angle.
Sensors 22 04983 g003
Figure 4. Geometry of collision of moving ships.
Figure 4. Geometry of collision of moving ships.
Sensors 22 04983 g004
Figure 5. Schematic architecture of the LSTM.
Figure 5. Schematic architecture of the LSTM.
Sensors 22 04983 g005
Figure 6. Schematic architecture of the Bi-RNN.
Figure 6. Schematic architecture of the Bi-RNN.
Sensors 22 04983 g006
Figure 7. Schematic architecture of the GRU.
Figure 7. Schematic architecture of the GRU.
Sensors 22 04983 g007
Figure 8. Development process of collision risk prediction system for stand-on vessel.
Figure 8. Development process of collision risk prediction system for stand-on vessel.
Sensors 22 04983 g008
Figure 9. Schematic of the sequence model used for learning data.
Figure 9. Schematic of the sequence model used for learning data.
Sensors 22 04983 g009
Figure 10. Ship handling simulator: (a) tanker ship and (b) measured trajectory.
Figure 10. Ship handling simulator: (a) tanker ship and (b) measured trajectory.
Sensors 22 04983 g010
Figure 11. Sector I: (a) RMSE of LSTM, (b) test observation of LSTM, (c) RMSE of Bi-LSTM, (d) test observation of Bi-LSTM, (e) RMSE of GRU, and (f) test observation of GRU.
Figure 11. Sector I: (a) RMSE of LSTM, (b) test observation of LSTM, (c) RMSE of Bi-LSTM, (d) test observation of Bi-LSTM, (e) RMSE of GRU, and (f) test observation of GRU.
Sensors 22 04983 g011
Figure 12. Sector V: (a) RMSE of LSTM, (b) test observation of LSTM, (c) RMSE of Bi-LSTM, (d) test observation of Bi-LSTM, (e) RMSE of GRU, and (f) test observation of GRU.
Figure 12. Sector V: (a) RMSE of LSTM, (b) test observation of LSTM, (c) RMSE of Bi-LSTM, (d) test observation of Bi-LSTM, (e) RMSE of GRU, and (f) test observation of GRU.
Sensors 22 04983 g012
Figure 13. Sector VI: (a) RMSE of LSTM, (b) test observation of LSTM, (c) RMSE of Bi-LSTM, (d) test observation of Bi-LSTM, (e) RMSE of GRU, and (f) test observation of GRU.
Figure 13. Sector VI: (a) RMSE of LSTM, (b) test observation of LSTM, (c) RMSE of Bi-LSTM, (d) test observation of Bi-LSTM, (e) RMSE of GRU, and (f) test observation of GRU.
Sensors 22 04983 g013
Figure 14. Collision accident between HYUNDAI CONFIDENCE and PACIFIC CARRIER.
Figure 14. Collision accident between HYUNDAI CONFIDENCE and PACIFIC CARRIER.
Sensors 22 04983 g014
Figure 15. Ship trajectories of the collision accident between HYUNDAI CONFIDENCE and PACIFIC CARRIER.
Figure 15. Ship trajectories of the collision accident between HYUNDAI CONFIDENCE and PACIFIC CARRIER.
Sensors 22 04983 g015
Figure 16. Comparison of results for CRI.
Figure 16. Comparison of results for CRI.
Sensors 22 04983 g016
Table 1. Components of the fuzzy inference rules for FIS-NC.
Table 1. Components of the fuzzy inference rules for FIS-NC.
Rule i D C P A T C P A V C D D r
Rule   1 DangerDangerDangerDanger
Rule   2 ThreatThreatThreatThreat
Rule   3 AttentionAttentionAttentionAttention
Rule   254 CollisionThreatDangerCollision
Rule   255 CollisionThreatDangerDanger
Rule   256 DangerDangerThreatThreat
Table 2. Scenario for simulation between OS and TS.
Table 2. Scenario for simulation between OS and TS.
Sector ISector VSector VI
OS
(Stand-On
Vessel)
TS
(Give-Way Vessel)
OS
(Stand-On
Vessel)
TS
(Give-Way Vessel)
OS
(Stand-On
Vessel)
TS
(Give-Way Vessel)
000°168.75°000°168.75°000°168.75°
000°157.5°000°157.5°000°157.5°
000°146.25°000°146.25°000°146.25°
000°135°000°135°000°135°
000°123.75°000°123.75°000°123.75°
000°112.5°000°112.5°000°112.5°
000°101.25°000°101.25°000°101.25°
000°090°000°090°000°090°
000°078.75°000°078.75°000°078.75°
000°067.5°000°067.5°000°067.5°
---056.25°--
---045°--
---033.75°--
---022.5°--
---011.25°--
Table 3. Collected data in sector I.
Table 3. Collected data in sector I.
Sector I
D CPA ( nm ) T CPA ( min ) VCD ( degree ) D r ( nm ) CRI D CPA ( nm ) T CPA ( min ) VCD ( degree ) D r ( nm ) CRI
0.0866616.99651803.110.010890.0699425.64670702.510.126185
0.0858256.92902803.080.011070.0691065.57921702.480.137516
0.0849896.86153703.050.011130.068275.51172602.450.148778
0.0841536.79404603.020.011180.0674345.44423602.420.159971
0.0833176.72655602.990.011250.0665985.37674502.390.171095
0.0824816.65906502.960.011570.0657625.30925502.360.182153
0.0816456.59157502.930.011890.0649265.24176402.330.193143
0.0808096.52408402.90.012080.064095.17427402.30.204067
0.0799736.45659402.870.012650.0632545.10678302.270.214926
0.0791376.38910302.840.012970.0624185.03929302.240.22572
0.0783016.32161302.810.013020.0615824.97180202.210.236449
0.0774656.25412202.780.0209790.0607464.90431202.180.247114
0.0766296.18663202.750.0329640.059914.83682102.150.257716
0.0757946.11914102.720.0448730.0590744.76933102.120.268255
0.0749586.05165102.690.0567080.0582384.7018402.090.278732
0.0741225.9841602.660.0684680.0574024.6343502.060.289148
0.0732865.9166702.630.0801560.0565664.56685902.030.299502
0.072455.84917902.60.091770.0557314.499369020.309796
0.0716145.78168902.570.1033130.0548954.43187801.970.32003
0.0707785.71419802.540.1147850.0540594.36438701.940.330205
Table 4. AIS trajectory data between HYUNDAI CONFIDENCE and PACIFIC CARRIER.
Table 4. AIS trajectory data between HYUNDAI CONFIDENCE and PACIFIC CARRIER.
Trajectory Number D r
(nm)
V r
(kn)
HYUNDAI CONFIDENCE
(Give-Way Vessel)
PACIFIC CARRIER
(Stand-On Vessel)
Heading
(degree)
Speed
(kn)
Heading
(degree)
Speed
(kn)
16.427.017419.80288.2
6.227.017419.80288.2
6.027.017419.80288.2
5.927.017419.80288.2
5.727.017419.80288.2
25.521.212018.80258.4
5.321.212018.80258.4
5.121.212018.80258.4
4.921.212018.80258.4
4.821.212018.80258.4
4.621.212018.80258.4
4.421.212018.80258.4
4.221.212018.80258.4
34.118.510418.80298.5
4.018.510418.80298.5
3.818.510418.80298.5
3.718.510418.80298.5
3.518.510418.80298.5
43.318.910219.40288.7
3.218.910219.40288.7
3.018.910219.40288.7
2.918.910219.40288.7
2.718.910219.40288.7
2.618.910219.40288.7
2.419.010219.40288.8
2.319.010219.40288.8
2.119.010219.40288.8
2.019.010219.40288.8
1.819.010219.40288.8
51.719.410519.50298.8
1.519.410519.50298.8
1.419.410519.50298.8
1.319.410519.50298.8
61.121.411919.40288.7
0.921.411919.40288.7
0.821.411919.40288.7
70.523.917615.90228.6
0.323.917615.90228.6
0.223.917615.90228.6
Table 5. Comparison of results of FIS-NC and the developed system.
Table 5. Comparison of results of FIS-NC and the developed system.
Trajectory Number D CPA ( nm ) T CPA ( min ) VCD ( degree ) D r ( nm ) FIS-NCDeveloped System
30.64412.1390.8983.8030.0110.015
0.64411.6390.9173.6510.0120.016
0.64411.1390.9373.4990.0150.028
40.74110.2961.1823.3360.0210.031
0.7419.7960.9583.1820.0280.057
0.7419.2960.9773.0280.0370.084
0.7418.7960.9962.8760.0490.119
0.7418.2961.0152.7230.0580.165
0.7417.7961.0332.5720.1170.221
0.7287.2911.0832.4170.1740.283
0.7286.7911.0782.2670.2310.338
0.7286.2911.0962.1180.2840.387
0.7285.7911.1141.9700.3350.429
Table 6. Comparison of results of point positioning and timing for collision avoidance.
Table 6. Comparison of results of point positioning and timing for collision avoidance.
Division Guide to Collision Avoidance Rules FIS-NC Developed System
D r (nm)2 to 31.9702.267
T CPA (min)65.7916.791
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Namgung, H.; Ohn, S.-W. Fuzzy Inference and Sequence Model-Based Collision Risk Prediction System for Stand-On Vessel. Sensors 2022, 22, 4983. https://doi.org/10.3390/s22134983

AMA Style

Namgung H, Ohn S-W. Fuzzy Inference and Sequence Model-Based Collision Risk Prediction System for Stand-On Vessel. Sensors. 2022; 22(13):4983. https://doi.org/10.3390/s22134983

Chicago/Turabian Style

Namgung, Ho, and Sung-Wook Ohn. 2022. "Fuzzy Inference and Sequence Model-Based Collision Risk Prediction System for Stand-On Vessel" Sensors 22, no. 13: 4983. https://doi.org/10.3390/s22134983

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop