Next Article in Journal
Evolution and Neural Network Prediction of CO2 Emissions in Weaned Piglet Farms
Next Article in Special Issue
Domain Knowledge-Based Evolutionary Reinforcement Learning for Sensor Placement
Previous Article in Journal
Radiation and Dust Sensor for Mars Environmental Dynamic Analyzer Onboard M2020 Rover
Previous Article in Special Issue
An Observation Scheduling Approach Based on Task Clustering for High-Altitude Airship
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Cooperatively Routing a Truck and Multiple Drones for Target Surveillance

1
College of Systems Engineering, National University of Defense Technology, Changsha 410073, China
2
College of Business Administration, Hunan University of Finance and Economics, Changsha 410205, China
3
School of Traffic and Transportation Engineering, Central South University, Changsha 410075, China
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(8), 2909; https://doi.org/10.3390/s22082909
Submission received: 5 March 2022 / Revised: 1 April 2022 / Accepted: 2 April 2022 / Published: 10 April 2022
(This article belongs to the Special Issue Parallel and Distributed Computing in Wireless Sensor Networks)

Abstract

:
With the development of drone technology, drones have been deployed in civilian and military fields for target surveillance. As the endurance of drones is limited, large-scale target surveillance missions encounter some challenges. Based on this motivation, we proposed a new target surveillance mode via the cooperation of a truck and multiple drones, which enlarges the range of surveillance. This new mode aims to rationally plan the routes of trucks and drones and minimize the total cost. In this mode, the truck, which carries multiple drones, departs from its base, launches small drones along the way, surveils multiple targets, recycles all drones and returns to the base. When a drone is launched from the truck, it surveils multiple targets and flies back to the truck for recycling, and the energy consumption model of the drone is taken into account. To assist the new problem-solving, we developed a new heuristic method, namely, adaptive simulated annealing with large-scale neighborhoods, to optimize truck and drone routes, where a scoring strategy is designed to dynamically adjust the selection weight of destroy operators and repair operators. Additionally, extensive experiments are conducted on several synthetic cases and one real case. The experimental results show that the proposed algorithm can effectively solve the large-scale target surveillance problem. Furthermore, the proposed cooperation of truck and drone mode brings new ideas and solutions to targets surveillance problems.

1. Introduction

1.1. Research Motivation

Drones have the advantages of high flexibility, high timeliness, low cost, and freedom from the limitations imposed by human physiological constraints [1]. Therefore, they have been widely used in surveillance missions in civil and military fields, such as agriculture [2,3,4], search and rescue [5,6], aerial photography and surveillance [7], and detection and defense Systems [8]. In addition, drones can accurately obtain high-precision and high-resolution multivariate data from areas of interest. Therefore, they have become important tools for target surveillance missions in harsh and dangerous battlefield environments [9]. In recent studies, the drone target surveillance problem has been oriented to static targets on the ground, and multiple heterogeneous drones have been considered [10]. Compared with a single drone system, the application of multiple drones can result in more surveillance missions and improve the efficiency of surveilling targets [11].
In this study, the target surveillance problem focuses on how to rationally plan the routes of trucks and drones to improve the surveillance efficiency and minimize the total cost. However, the limited endurance of a single drone makes it difficult to surveil large-scale targets distributed over a wide range [12]. Therefore, we study the target surveillance routing problem by cooperatively using a truck and multiple drones to surveil targets. As shown in Figure 1, the truck, which is loaded with multiple drones, starts at the base, surveils its targets and then returns to the base. Drones can take off and land from the truck. After a drone takes off, it can surveil multiple targets and then return to the truck within its maximum flight range. As shown in Figure 1, drone1 takes off at the 3rd target and surveils the 8th and 9th targets. Then, it returns to the truck at the 5th target. The 3rd and 5th targets are surveilled by the truck. By this process, the truck increases the drone’s surveillance range. Besides, the truck has enough energy when conducting the surveillance mission and both trucks and drones can surveil targets.
However, traditional optimization solvers and exact algorithms may not obtain satisfactory solutions in an acceptable time. Therefore, we design a new method to assist in target surveillance problem solving. This method consists of two main parts: (1) Solution initialization: The initial solution of the surveillance problem is generated according to the nearest neighbor and the preservation strategies, and the idea of maximum cost savings is adopted by replacing several truck targets with drone targets. (2) Solution optimization: An adaptive simulated annealing with large-scale neighborhoods (ASALN) algorithm is developed to optimize the surveillance routes of the truck and drones. In ASALN, multiple destroy and repair operators are designed, and the probability of operators is dynamically adjusted by roulette wheel selection. Meanwhile, multiple scoring operators are developed to update the weight of the selection probability.

1.2. Research Contribution

The main contributions of this paper are summarized as follows:
(1) A new target surveillance mode based on the cooperation of a truck and multiple drones is studied. In this mode, the truck, which carries multiple drones, starts from the base and returns to the base after finishing the surveillance of all the targets. Both the truck and drones can surveil the targets. Drones take off from the truck, surveil a number of targets, and return to the truck.
(2) A novel heuristic method is proposed to assist in target surveillance problem-solving. In this method, the initial solution is generated according to the nearest neighbor algorithm of the maximum cost savings strategy, and then an adaptive simulated annealing with large-scale neighborhoods algorithm is developed to further optimize the routes of the truck and drones. Specifically, a scoring strategy is designed to dynamically update the selection weights of the destroy and repair operators.
(3) Extensive experiments are conducted on synthetic and real cases, and the experimental results show that the proposed method can effectively solve the multitarget surveillance problem. Furthermore, sensitivity experiments on several crucial parameters of this method are analyzed.

1.3. Research Organization

The brief overview of this paper is organized as follows. In Section 2, the relevant works on the targets surveillance problem and related methods are briefly reviewed. In Section 3, the model assumptions and development of the studied targets surveillance problem are presented. Section 4 elaborates the proposed optimization algorithms to assist the problem-solving, Section 5 reports and discusses the experimental results. Section 6 draws the conclusion and provides future research directions.

2. Related Work

The target surveillance problem based on drones mainly focuses on targets on the ground, and a corresponding heuristic algorithm is proposed [13]. Huang et al. [14,15] studied the collaboration with public transportation vehicles (PTVs) and the deployment of charging stations for aerial surveillance by UAVs, and proposed an iterative algorithm to optimize the locations of the charging stations. Yang et al. [16] studied the routing problem of multiple drones traveling to multiple targets by using a particle swarm optimization algorithm. Wu et al. [17] proposed a cooperative routing algorithm that meets drone maneuvering constraints and adapts to the data communication delay for the cooperation of multiple drones in uncertain environments. The authors in [18,19] studied spatiotemporal cooperative routing to ensure that multiple drones reach their targets and made attempts to consider communication constraints in the routing of multiple drones. Kuo et al. [20] considered the task time window in the drone task allocation model and proposed the variable neighborhood search procedure with a novel solution representation as a solver. Boso et al. [21] proposed the neural dynamic programming method on the premise that the positions and heading directions of different drones could be shared among the swarm. Hu et al. [22] studied multidrone routing in surveillance missions to ensure full coverage of surveillance areas. Tian et al. [23] established that target surveillance requires multiple cooperative drone surveillance models. Ahn et al. [24] considered a multiobjective vehicle routing problem with drones for military surveillance operations. With the development of drone operational application technology, drones can land on carrier platforms to carry out surveillance missions but are no longer allowed to access a fixed base for scheduling and task planning. Gonzalez et al. [25] solved the truck drone team logistics (TDTL) problem by mixed integer planning, which generates routes the drone must follow to visit all specified locations and assigns rendezvous points where the drone’s batteries are replaced from the truck.
Researchers have been increasingly interested in the cooperation of trucks and drones for performing complex tasks, such as parcel delivery problems, road network surveillance problems and target surveillance problems. However, the target surveillance problem in this study focuses on rationally planning the routing of trucks and drones. In recent years, many routing problems for trucks and drones have been studied, and corresponding algorithms have been proposed. Murray and Chu [26] proposed the flying sidekick traveling salesman problem (FSTSP), in which a truck launches a drone at a delivery point and the drone returns to the truck after delivering to series of customers in a flight. This problem is described as the mixed integer linear programming (MILP) problem. The heuristic algorithm of FSTSP first solves the TSP route as truck routing problem and then decides whether to assign the eligible drone to the drone route or reinsert it to the truck route at a different delivery location. Agatz et al. [27] proposed a similar problem, the traveling salesman problem with drone (TSP-D). Murray and Raj [28] extended the problem in which only single trucks and single drones are considered and studied the problem of the cooperation of trucks and multiple drones. Since then, many other extended problems and improved algorithms have been proposed, including modified FSTSP routing problems [29,30,31,32], extended multitruck and multidrone routing problems [33,34,35], and more effective optimization algorithms [36,37,38,39,40,41,42]. In addition, Poikonen and Golden [43] proposed the mothership and drone routing problem (MDRP), where the drone is allowed to visit multiple targets sequentially before returning to the mothership for refueling, and an exact branch-and-bound and two greedy heuristic methods are proposed to solve the problem.
It can be found that in the previous studies, only trucks or only drones are considered in the target surveillance problem, while the cooperation of trucks and drones has not yet been addressed. Different from the truck-only or drone-only mode, the cooperative routing of trucks and drones for the target surveillance problem is a variant of the two-echelon routing problem (2E-RP). The main distinguishing features of this problem are that both the truck and drones can surveil targets, a drone takes off from the truck and surveils multiple targets in a flight, and flies to the truck for recycling. Multiple drones can simultaneously surveil targets. Eventually, the truck returns to the base with all the drones. As a result, the truck can be used as a mobile carrier to extend the endurance of drones; thus, more surveillance missions can be accomplished, and the surveillance efficiency can be significantly improved. Additionally, an adaptive simulated annealing with large-scale neighborhoods (ASALN) algorithm is designed to effectively solve the target surveillance problem.

3. Problem Description and Model Development

3.1. Problem Description and Definitions

The target surveillance problem begins with a truck carrying multiple drones to surveil the target set, which is aim at finding the best route for the truck and drones to surveil all targets at the lowest cost while not violating the capacity limit of the drone battery. Essentially, the surveillance problem based on trucks and multiple drones is a two-echelon routing problem (2E-RP), where the first echelon is truck route and the second echelon is drone route. In addition, according to graph theory, each point in the undirected graph represents the distribution center and target location, and the line between two points represents the truck or drone route. Therefore, the undirected graph can be used for the routing problem G = ( L , E ) , where L:{ D i where i = 0,; 1, ;2…, n} represents the set of surveillance targets and the base, and D 0 represents the base, D a l l = 1 , 2 , , n represents the set of all surveillance targets, and E represents the set of edges in the truck’s (or the drone’s) route.
To clearly express the proposed model, we first list the symbols and definitions used for the cooperation of the truck and drones in the target surveillance problem in Table 1, including the truck and drone parameter definitions, set definitions, and decision variables.

3.2. Model Assumptions

The proposed model focuses on studying the target surveillance problem using a truck and multiple drones. The truck carries multiple drones from the base and launches drones at the surveillance target. Then, a small drone surveils multiple targets depending on its battery capacity and flies back to the truck for recycling. The truck surveils targets along its route and finally returns to the base with all the drones. To simplify the problem model, we make the following assumptions:
(1) The truck has enough energy to surveil all the surveillance targets;
(2) Both the truck and drones surveil targets;
(3) Drones only take off/land on the truck when the truck stops at a surveillance target;
(4) The truck must arrive at the landing point before the drone arrives;
(5) The truck surveillance process does not affect the taking off/landing the drones;
(6) The weight of the drone is constant, and the truck and drones maintain a uniform speed;
(7) The unit costs of the truck and drones are fixed. That is, the change in the unit driving cost of the truck caused by the weight change of the truck-mounted drone is not considered.

3.3. Energy Consumption Model of the Drone Battery

Since the energy consumption rate is a crucial factor for drone endurance, it is of great significance to estimate the energy consumption model during the surveillance of multiple targets in the drone subroute. For the convenience of presentation, it is assumed that the drone’s self-weight is w d , its flight speed is a fixed value v 2 , and its power is p. When the type of drone is determined, the values of all relevant parameters of the drone are known. To achieve the highest surveillance efficiency, we assume that the drone flies at the highest speed, i.e., it maintains its maximum power during flight.
v 2 = V
p = P
where P denotes the maximum power, and V denotes the maximum flight speed. Thus, the flight time and energy consumption from the i-th surveillance target to the j-th surveillance target can be calculated as follows:
t i j = L i j V
F i j = P t i j = P L i j V
On this basis, the total energy F i j consumed by the drone in a subroute can be calculated to determine whether it exceeds the capacity of the battery. Meanwhile, the cost of drones in a subroute can be further calculated.

3.4. Mathematical Formulation

To understand the definition of the problem more accurately, a mathematical model is established for truck and drone surveillance missions. Given the network G = ( L , E ) , each truck route starts from the base D 0 , visits multiple surveillance targets in D a l l and then returns to base D 0 , as shown in Figure 1, i.e., the sequence of the route is (0, 1, 2, 3, 4, 5, 6, 0). Each route ( r R ) should satisfy two constraints: The first constraint is that the in-degree and out-degree of any target in r (including the surveillance targets and base) must be equal to 1; the second constraint is that there is no subloop in r. For any directed main route by truck r ( r R ) , its cost can be calculated and denoted as c r .
Suppose the truck route is r ( r R ) , where D r is the set of surveillance targets visited by the truck; then, all other surveillance targets in D r should be surveilled by the drones. Meanwhile, assuming that all route segments l in the given main route r ( r R ) can be enumerated, let S r be the set of all route segments in the main route r. For route segment l in the main route r ( l S r ) , assume that the feasible subroutes corresponding to the route segment are denoted as R r l . Each drone’s subroute m ( m R r l ) starts from the first surveillance target in the route segment, visits several surveillance targets D r , and ends at surveillance target l. Suppose Drlm denotes the surveillance target set in drone subroute m ( m R r l ) , and E r l m denotes the edge set in drone subroute m ( m R r l ) .
According to the energy consumption model, the drone flight cost of subroute m can be calculated and expressed as crlm. Suppose x r {0,1}, y r l m {0,1}, a i j r l m {0,1}, b i r l m {0,1}, and c i r {0,1} are binary variables. If the truck chooses the main route r ( r R ) , then x r =1; otherwise, x r = 0. Given the truck route ( r R ) , the directed subroute l S r . If the drone chooses subroute m ( m R r l ) , then y r l m = 1; otherwise, y r l m = 0. Given two surveillance targets i , j ( i , j D a l l ) and a drone subroute m ( m R r l ) , if edge ( i , j ) E r l m , then a i j r l m = 1; otherwise, a i j r l m = 0. If i D r l m , then b i r l m = 1; otherwise, b i r l m = 0. If i D r , then c i r = 1; otherwise, c i r = 0.
Based on the above assumptions and definitions, we establish the 2RP-T&D mathematical formulation based on the two-echelon route problem. In the first echelon, a heuristic algorithm is proposed to optimize the drone subroute on the premise of a given truck route, which can be used to calculate the lowest cost of all main routes R. In the second echelon, the overall cost of the truck and drones is iteratively optimized.
Model 1 (Drone subroute optimization): For any given truck route r ( r R ) and definitely set S r , D r , and D r , the feasible drone subroutes corresponding to the main route r can be calculated and denoted as R r l . Then, the minimum cost of the drone’s subroute accessing all targets in D r can be calculated by Model 1, which can be expressed as follows:
M i n z r = l , m c r l m y r l m
s . t . l , m a i j r l m y r l m 1 , i , j D r
l , m b i r l m y r l m = 1 , i D r
i D r , j D r a i j r l m = i D r , j D r a i j r l m = n m R r l , l S r
a t i + ( d t i + L i j v 2 ) a i j r l m M ( 1 a i j r l m ) a t j i , j D a l l , i j , m R r l , l S r
( i , j ) E r l m F i j W , m R r l , l S r
y r l m { 0 , 1 } , m R r l , l S r
l y r l m N d , m R r l .
Objective function (5) minimizes the cost of the drone subroute [44]. For a given main route r ( r R ) , constraint (6) ensures that each truck route segment l corresponds to at most one subroute of a drone to prevent the crossing of drone routes. Constraint (7) forces each drone surveillance target to be visited only once. Constraint (8) imposes the takeoff or landing of drones at only truck surveillance targets. Constraint (9) is the time window constraint of drones, which ensures that drones can only conduct surveillance operations only after reaching the surveillance target. Constraint (10) restricts the energy constraint of the drone. Constraint (11) defines the decision variables. Constraint (12) refers to the number constraint of vehicle-mounted drones.
Model 2 (Truck main route optimization): For the truck main route optimization, the lowest total cost is obtained. The lowest subroute cost corresponding to truck main route r denotes z r , which can be obtained through Model 1. The truck main route optimization model is shown as follows:
M i n Z = r c r x r + r x r z r
s . t . r x r = 1
r R c i r x r = 1 i D r
a t i + ( d t i + L i j v 1 ) c i r M ( 1 c i r ) a t j i , j D a l l D 0 , i j , r R
a t i + ( d t i + L i j v 1 ) c i r M ( 1 c i r ) M ( 1 c j r ) M ( 1 a i j r l m ) a t i + ( d t i + L i j v 2 ) a i j r l m i , i , j D a l l D 0 , i j , i j , m R r l , l S r , r R
a t i + ( d t i + L i j v 2 ) a i j r l m M ( 1 c i r ) M ( 1 c j r ) M ( 1 a i j r l m ) a t i + ( d t i + L i j v 1 ) c i r + t e i
i , i , j D a l l D 0 , i j , i j , m R r l , l S r , r R , x r { 0 , 1 } , r R
Objective function (13) minimizes the total cost, where z r is obtained by Model 1. Constraint (14) ensures that only one truck main route can be selected. Constraint (15) forces each truck surveillance target to be visited only once. Constraints (16–18) denote the time window constraints. Constraint (16) restricts that the surveillance can be conducted only after the truck arrives; Constraints (17–18) ensure that the truck reaches the landing point before the drone and leaves the landing point after the drone lands. Constraint (19) defines the decision variables. For the directed main route r ( r R ) , note that there may be no feasible solution in Model 1, in which case, z r is set as infinity .
Based on the above model, the surveillance problem based on the 2RP-T&D model can be optimized in two main steps. First, the main route of the truck is obtained so that the set R can be obtained. For the main route r ( r R ) , the subroutes of the drones are obtained by Model 1. Second, the optimized route of the truck and drones is obtained by Model 2.

4. Algorithm Design

With the increase in the scale of the target surveillance problem using a truck and multiple drones, it is difficult to obtain high-quality solutions in an acceptable time using an exact algorithm or optimization solver. Therefore, we design a method to assist problem solving in this section, where the nearest neighbor and cost savings strategies are first developed to obtain the initial solution. Then, the adaptive simulated annealing with large-scale neighborhoods algorithm is developed to optimize the initial solution, in which a scoring strategy is designed to dynamically update the selection weights of the destroy and repair operators. The flowchart of the proposed method is presented in Figure 2.

4.1. Nearest Neighbor Cost-Savings Strategy (NNCS)

Inspired by the idea of truck first drone second, we design a heuristic algorithm combining nearest neighbor and cost savings strategy (NNCS). This strategy is graphically represented in Figure 3. First, the nearest neighbor search is applied to construct the main route of the truck, which is shown in Figure 3a. Then, the maximum cost savings are adopted by replacing several trucks with drones, which is shown in Figure 3b. The pseudocode of the NNCS algorithm is presented in Algorithm 1.
From Algorithm 1, the current surveil target d , the target set that never surveilled Du, the target set that has already been surveilled D s , the truck route S 0 and the drone route S 1 are initialized (line 1). First, the main route of truck is constructed (lines 3–8). The target d c nearest to d from D u is found, and it is reassigned to the current target d (line 3). The target d c is removed from the unsurveil target set D u , and the target d c is added to the surveilled target set D s (lines 4–6). When the truck returns to base, a truck-only route S 0 is generated (line 8).
Then, several truck targets are replaced with drone targets according to the order of the surveillance targets in the main route (lines 10–18). In each iteration, the cost-savings C s i (line 11) for surveillance target i is calculated, and the surveillance target with the maximum cost-savings Csimax is found (line 12). If C s i m a x 0 , target i is removed from truck route S 0 , and target i is added to drone route S 1 (lines 13–15). If C s i m a x < 0 , then the loop is terminated (lines 16–17), and the initialized solution S = { S 0 , S 1 } is output (line 18).
Algorithm 1:NNCS( D a l l , D 0 )
Sensors 22 02909 i001

4.2. Adaptive Simulated Annealing with Large-Scale Neighborhoods (ASALN)

In this section, the proposed ASALN algorithm is presented. The destroy operators and repair operators designed in ASALN are described, and the adaptive adjustment strategy developed in ASALN is presented to dynamically select the destroy and repair operators. In addition, simulated annealing is introduced as an iterative optimization framework, and the tabu list is utilized to avoid short-term loops and make the routing algorithm for trucks and drones more effective.

4.2.1. Design of Destroy and Repair Operators

Since adaptive large-scale neighborhoods have significant advantages, the self-definition of the operator, which increases the diversity of solutions, is easy to expand, and the added heuristic information improves the algorithm search efficiency [40], which is suitable for solving the routing problem of the truck and drones. However, when the size of the neighborhoods gradually increase, the time complexity increases exponentially. To improve search efficiency, the proposed ASALN algorithm allows multiple neighborhoods to be searched in a single search, the neighborhood operator weight is adjusted according to the solution’s quality, and the neighborhood of the next iteration is selected based on its weight. Specifically, the design of the destroy and repair operators is elaborated as follows.
(1) Destroy Operator Design
When the NNCS algorithm obtains an initial solution, the destroy operator is generated by roulette wheel selection and q surveillance targets are removed from the route of the truck or the drones, resulting in a route S p that is missing q targets and has q deleted targets. In subsequent repair operations, the q surveillance targets will be reinserted into S p .
Considering that the drone must take off or land from the surveillance target visited by the truck, the destroy operation is divided into two types, as shown in Figure 4a. If the selected target does not include the takeoff or landing point of the drone, it can be deleted directly. If the selected target consists of the takeoff or landing point of the drone, as shown in Figure 4b, a new takeoff or landing point needs to be constructed when the drone takeoff or landing point is deleted. Specifically, if the drone takeoff point is deleted, the previous point is taken as the new drone takeoff point; if the drone landing point is deleted, the next point is taken as the new landing point.
There are two specific destroy operator designs, i.e., random destroy operators and maximum saving destroy operators.

Random Destroy Operators

The random destroy operator randomly removes the q surveillance target from the route of the truck and the drones, resulting in a partial solution S p that is missing q surveillance targets and has q removed surveillance targets, as shown in Figure 5. Random destroy operators enhance the randomness of heuristic algorithms and thus increase the diversity of solutions.

Maximum Savings Destroy Operators

The maximum savings destroy operators remove the q surveillance targets with the highest cost increase in the route of the truck and drones. Thus, a partial solution S p is missing q surveillance targets and has q removed surveillance targets, as shown in Figure 6. For solution s, the cost savings of removing target i are defined as c o s t ( i , s ) = f ( s ) f i ( s ) , where f ( s ) is the cost of the current solution and f i ( s ) is the cost of the solution after removing surveillance target i. The cost savings for each surveillance target are calculated and recorded, and the surveillance target with the largest cost savings in the existing solution is removed. Then, the current solution is updated, the cost savings of all surveillance targets are recalculated, and the surveillance targets with the largest cost savings are deleted. This process is repeated until q surveillance targets are deleted. The maximum saving destruction operator makes the algorithm obtain a smaller cost portion of the solution S p , and the surveillance targets have more costs removed. The reconstruction of the route may cause the targets to be inserted into a different location than the current solution, which will reduce the cost of the surveillance problem.
(2) Repair Operator Design
When q surveillance targets are deleted by the destroy operator, a repair operator is executed based on roulette wheel selection. According to the repair operator, the algorithm will insert q surveillance targets and reinsert them into the route of the truck or drone to obtain a new solution S . Specifically, two repair operators are designed, the greedy repair operator and the regret repair operator.

Greedy Repair Operator

The greedy repair operator inserts q deleted surveillance targets into the partial solution S p with a greedy strategy; thus, a new complete solution S is obtained, which is graphically presented in Figure 7. The greedy repair operator first inserts each of the q surveillance targets previously deleted into the truck and drone routes of partial solution S p and selects the surveillance targets and locations corresponding to the lowest cost solution. Then, the insertion action is executed to obtain the new partial solution S p and the remaining q 1 surveillance targets. The insertion cost of the remaining surveillance targets in the new solution S p is recalculated to determine the next surveillance targets to be inserted. Then, the q deleted surveillance targets are successively added to the partial solution S p .

Regret Repair Operator

Different from the greedy repair operator, the regret repair operator first selects an appropriate surveillance target according to the extra cost and then inserts it into the appropriate position to minimize the total cost. The regret value insertion operator determines the insertion of q deleted surveillance targets according to the regret value of the insertion cost.
The regret value is the cost difference between the best insertion position and the rest insertion position of surveillance targets in the route. The higher the regret value is, the more significant the cost difference between the optimal insertion position and the suboptimal insertion position of the surveillance target. Therefore, surveillance targets with high regret values should be inserted into the truck and drone routes. The regret value is calculated as follows:
max i U c i = Δ f i 2 Δ f i 1
where Δ f i 1 denotes the increased cost after inserting surveillance target i at the optimal insertion location, Δ f i 2 denotes the increased cost after inserting surveillance target i at the suboptimal location, c i denotes the regret values of surveillance target i inserted at different locations, and U is the set of deleted surveillance targets.
According to the characteristics of the surveillance problem, it is necessary to calculate the regret value of the surveillance target inserted into the two different routes of truck and drone and compare the regret value of all the different insertion targets of each surveillance target in the truck and drone routes to obtain the maximum value of the regret value of each surveillance target.
First, the increased cost of each previously deleted surveillance target i after the insertion of each feasible insertion point is calculated, and the increased cost of the surveillance target i after the insertion of the optimal insertion point is subtracted to obtain the maximum regret value of each surveillance target. Then, the largest regret of each surveillance target is compared, and the maximum regret value is selected. Thus, the surveillance target that needs to be inserted and its location can be determined, and then the regret value of the deleted surveillance targets is recalculated. The q previously deleted surveillance targets are added to the partial solution S p in iteration until all the surveillance targets are inserted into the truck and drone routes.

4.2.2. Adaptive Adjustment Strategy (AAS)

For the selection strategy of destruction and repair, an adaptive adjustment strategy (AAS) is designed. The selection weight w j of the adaptive adjustment operator is determined according to the number of destroy and repair operators used.
Specifically, the core idea of the designed adaptive strategy is to calculate the score of destroy and repair operators by three bonuses, i.e., the higher the score is, the better the performance of the operator. The first bonus σ 1 occurs when generating new and improved solutions by deleting and inserting operations. The second bonus σ 2 occurs when accepting an unaccepted solution that is better than the current solution. The third bonus σ 3 occurs when accepting an unaccepted solution that is worse than the current solution.
The process of added bonuses is divided into several periods. In each period, the score of the operators is initialized to zero. The roulette probability of all operators is the same. After each additional period, the total score of each operator in the previous period is used to calculate the new weight, and the formula for calculating the weight is presented as follows:
ω i , j + 1 = ω i , j ( 1 r ) + r π i θ i
where ω i j denotes the weight of operator i in period j, π i denotes the scores of operator i, and θ i denotes the number of uses of operator i. Influence factor r controls the change speed and change proportion of weight. The algorithm determines the probability that the next periodic operator will be selected by roulette according to the new weight. The better the operator performs, the higher its score and weight, and the greater the probability that the operator will be used. The pseudocode of the adaptive adjustment strategy is presented In Algorithm 2.
Algorithm 2:AAS ( Z b e s t , Z, Z , π i 1 , π i 2 , σ 1 , σ 2 , σ 3 )
Sensors 22 02909 i002
The input of Algorithm 2 is the objective function values of the best solution, current solution and temporary solution, which are Z b e s t , Z, and Z , respectively. First, the differences in objective function Z s are calculated. If the temporary solution is better than the current solution, then the operator score is the score plus σ 2 (lines 2–4). If the best solution is obtained, then the operator score is the score plus σ 1 (lines 5–7). If accepting a temporary solution that is worse than the current one, then the operator score is the score plus σ 3 (lines 9–11). Thus, the operator scores π i 1 and π i 2 are updated and finally output.

4.2.3. The Proposed ASALN Algorithm

As mentioned above, the proposed ASALN algorithm adopts the SA algorithm as the iterative optimization framework. Specifically, the core idea of SA is to accept the poor solution with a certain probability that may jump out the local optima and may obtain the global optimum. In addition, the lack of short-term memory easily leads to short-term loops and revisiting targets. Therefore, the efficiency of SA can be improved by memorizing the tabu list. In the search for a target surveillance problem, the new solution is accepted if it costs less than the old one, or the new solution is accepted with a certain probability if the new solution costs more than the old one. Once the new solution is accepted, the selected neighborhood is added to the tabu list. Without loss of generality, neighbor solutions in the tabu list cannot be inserted into the new solution until the temperature drops. In all, the pseudocode of the adaptive simulated annealing with large-scale neighborhoods is presented in Algorithm 3.
Algorithm 3:The proposed ASALN
Sensors 22 02909 i003
From Algorithm 3, the input is target set D, the initial temperature T 1 , the terminate temperature T 2 , the maximum number of iterations N m a x , cooling ratio R. First, parameters of iterations and the tabu list are initialized (line 1), and the operator weights ω i 1 and ω i 2 , the operator scores π i 1 and π i 2 are initialized (line 2). The initial solution is obtained by the NNCS algorithm (line 3). At each temperature, the number of iterations and tabu list is set to improve the performance of the inner loop (line 5). In each iteration, the algorithm adopts a roulette strategy to select destroy and repair operators and the current neighborhood is generated (line 6). The temporary solution is obtained from the current neighborhood S (line 7), and its objective function value Z is calculated (lines 8). The invalid moves are added to the tabu list (line 9). If the difference ( Z Z ) is less than 0 (line 10), the solution S is considered the best solution (line 12). If the temporary solution is better than the best solution, the best solution is reset to the temporary solution (lines 13–15). In addition, a poor solution may be accepted with a certain probability according to the criterion of r a n d o m ( ) < e x p ( ( Z ˘ Z ) / T ) (lines 17–18). At the end of each iteration, the operator scores are updated by the AAS algorithm (line 19). After the inner loop, the number of uses of the destroy operator θ i 1 and repair operators θ i 2 are counted (line 21), the weights of the destroy and repair operators are updated (line 22), the temperature is cooled down (line 23), and the scores of the operators are reset to zero in the next iteration (lines 24–25). When the termination condition of SA is met, the best solution S b e s t and the best objective function value Z b e s t are output.

5. Experiments and Analysis

In this section, three scales of the synthetic cases are generated to verify the performance of the proposed algorithm. In addition, a real case of target surveillance, i.e., 100 traffic surveillance targets in Changsha, China, is conducted for comparison with different surveillance modes. Furthermore, the sensitivity of crucial factors of the truck and drone for surveillance problems is analyzed, including the scale of the drone surveillance target in the initial solution, the influence of the number of drones, and the battery power of drones.

5.1. Experimental Design and Settings

The environment is conducted on an Intel Core i5-8300H CPU with 8 GB memory. The experimental cases include several synthetic cases and a real case. The synthetic cases include small-scale, medium-scale, and large-scale cases, and the real case is selected from traffic surveillance targets in Changsha.
(1) Surveillance case setting
The surveillance targets of synthetic cases are generated in the same way as in [40]. The surveillance area is divided into four parts, and each part generates the same number of surveillance targets. For the synthetic cases, each of the small, medium, and large surveillance scales generates ten instances. The number of surveillance targets and the surveillance area dimensions corresponding to the target surveillance scale are listed in detail in Table 2. For the real case, 100 traffic intersection surveillance targets in Changsha are selected according to the longitude and latitude of traffic intersections, which are obtained from Baidu and converted into the relative coordinate values x and y according to the Miller coordinate system.
(2) Algorithm parameter settings
To verify the effectiveness of the proposed algorithm, we compare it with a truck-only surveillance algorithm and three other cooperation of truck and drone surveillance algorithms, including the SA algorithm, the TS algorithm and the truck-only (TO) algorithm. The parameter settings of these algorithms are as follows.
ASALN algorithm: According to the settings in [45], the iteration p u is set to 5 times to ensure the timeliness of the operator weight update. The influence factor r of weight transformation is set as 0.4. The bonus σ 1 for deleting and inserting operations that generate new and better solutions is 33. Bonus σ 2 for accepting an unaccepted solution that is better than the current one is 9. Bonus σ 3 for accepting an unaccepted solution that is worse than the current one is 13. In addition, the initial temperature T 1 = ω c i / l o g ( 2 ) , where ω = 0.05, c i denotes the cost of the initial solution; the initial temperature T 1 is 6000 ° C; the terminating temperature T 2 is 100 ° C; the cooling ratio R is 0.9; and the maximum number of iterations N m a x is the same as p u and is set to 5. The above parameters are set according to the settings in [45].
SA algorithm: The parameters in the SA search are the same as those in the SA-TS search, T 1 = ω c i / l o g ( 2 ) . The cooling function T k = T s 0.99 k is adopted according to the settings in [46]; the initial temperature T 1 is set to 6000, and the terminate temperature T 2 = T 1 / 50 . The cooling ratio R is set to 0.99.
TS algorithm: According to the settings in [47], the maximum number of iterations and the maximum number of unimproved solutions are set to 100 and 10, respectively.
TO algorithm: According to the settings in [48], the initial temperature T 1 is set to 93 ° C, the termination temperature T 2 is set to 3 ° C, and the cooling ratio R is set to 0.99.
(3) Truck and drone settings
The parameters of the truck and drones are set according to the parameters commonly used in surveillance problems. The truck can travel up to 400 km with a full tank of gas. Therefore, it can complete surveillance missions without refueling. In addition, truck costs include energy consumption and operating expenses. According to the settings in [44], a delivery truck has an efficiency of six miles per gallon when using diesel and consumes 0.392 L per kilometer, and the cost of a truck is $0.717/km. In addition, the operating cost of the truck is $0.484/km after factoring in maintenance, depreciation and driver wages. Thus, the total truck operating cost is $1.201/km.
According to the parameters of the Amazon octa-rotor drone [49], the weight of the drone is set to 2 kg, and the weight of the surveillance camera loaded by the drone is set to 2 kg. Based on the energy consumption model, the drone has a power of 5000 mAh and a maximum sailing distance of 14 km. For the cost of the drone, according to the work in [44], it can be estimated that the unit energy cost of the drone is $1.345 × 10 4 /mAh. When the battery power of the drone is 5000 mAh and the maximum range is 14 km, the energy consumption cost per unit distance of the drone is approximately $0.048/km. After considering the drone cost and depreciation fee, the cost of a drone is approximately $0.45/km. Thus, the total cost of drones is approximately $0.498/km. Therefore, the parameters of the truck and drone can be determined as shown in Table 3.

5.2. Experimental Analysis on Synthetic Cases

On each scale, five examples are generated using the above experimental settings and parameters. For each case, the initial solution obtained by the NNCS is compared with the solution obtained by ASALN. Meanwhile, the solutions generated by the proposed ASALN algorithm are compared with those generated by the traditional SA and TS algorithms. Each case runs ten times, and the average is then calculated. The experimental results on synthetic cases at three scales are shown in Table 4.
Comparison with the NNCS algorithm: From Table 4, for the small-scale cases, compared to the cost of the initial solution obtained by the NNCS, the cost of the solution obtained by the proposed ASALN algorithm is reduced by 38.78% to 45.90%. For the medium-scale cases, compared to the cost of the initial solution obtained by the NNCS, the cost of the ASALN algorithm is reduced by 22.64% to 42.81%. For the large-scale cases, the cost of the ASALN algorithm is reduced by 33.40% to 42.81%. In most cases, the final cost calculated by the ASALN algorithm is more than 30% lower than the cost calculated by the NNCS, which proves the effectiveness of the proposed ASALN algorithm.
Comparison with SA and TS algorithm: The experimental results of the SA and TS algorithms on the small-scale, medium-scale, and large-scale cases are recorded in Table 4. It can be found that the cost of the ASALN algorithm is similar to the cost of the SA algorithm. However, with the increase in the case scale, the SA algorithm is more time-consuming, and takes up to 1.27 times longer to run than the ASALN algorithm. The reason can be inferred as the lack of heuristic information in the SA algorithm which easily leads to short-term repetition. Compared with the TS algorithm, the experimental results of the ASALN algorithm are more stable, and they become sensitive to the increase in the case scale. On the large-scale cases, the ASALN algorithm has a cost savings that is 7.90% higher (25.21% total) compared to the TS algorithm. However, in terms of algorithm computational time, the computation time of the ASALN algorithm is longer than that of the TS algorithm, but it can still be controlled within 2 min. Considering the cost savings, the computation time of the ASALN algorithm can be accepted.
Comparison with truck-only surveillance mode: Two different surveillance modes, i.e., the cooperation of truck and drone target surveillance ASALN and truck-only (TO) target surveillance, are compared. From Table 4, it can be observed that the mode of cooperation of trucks and drones can dramatically reduce the total cost compared to that of the truck-only mode. With the assistance of drones, the final cost generated by the ASALN is more than 70% lower than that of the truck-only model. The comparative analysis of the two modes is shown in Figure 8.

5.3. Experimental Analysis on a Real Case

(1) Source of data: One-hundred surveillance target sites are selected in Changsha, China. Specifically, the latitude and longitude of the locations in this experiment are obtained from Google Maps and converted into Miller coordinates.
(2) Analysis of experimental results: The surveillance route of the truck and drones is shown in Figure 9, where the bold line represents the truck route, and the fine lines of different colors represent the routes of the drones. From Figure 9, 29 targets are surveilled by the truck and 71 targets are surveilled by the drones. A total of six drones are needed. In addition, from the route shown in Figure 9, the main route of the truck is relatively smooth, while remote surveillance targets and the surveillance targets that may cause round-trip trends are surveilled by drones, which significantly reduces the total cost.
Figure 10 presents the convergence curve of the proposed ASALN algorithm. The termination conditions of ASALN adopts the termination criteria of simulated annealing, where the temperature would drop at each iteration until the termination temperature is reached. Specifically, the parameters are set as follow: the initial temperature T 1 is set to 6000 ° C, the terminating temperature T 2 is set to 100 ° C, and the cooling ratio R is set to 0.9. From Figure 10, the objective function value converges at the 64th iteration, and the number of iterations is within an acceptable range. In the first 20 iterations, the objective function value converges quickly, and the operator’s reconstruction of the initial solution is more intense. In the iterative process, the convergence curve can continuously find a promising solution. The reason can be speculated to be that the ASALN algorithm allows multiple neighborhoods to be searched in a single search, which increases the diversity of solutions. Meanwhile, the SA algorithm can jump out of the local optimum, and the TS algorithm can avoid reducing the repeated search of the solution space of poor quality to improve the search efficiency of the ASALN method.

5.4. Sensitivity Analysis

Based on the above real case, sensitivity analyses are conducted on three crucial factors, i.e., the proportion of drone surveillance targets in the initial solution, the number of vehicle-mounted drones, and the drone endurance.
(A) Sensitivity analysis of drone surveillance target proportion in the initial solution: To investigate the influence of drone surveillance target proportion in the initial solution, the proportions of drone surveillance targets are set as 25%, 35%, 45%, 55% and 65% of the total number of targets. The experimental results are shown in Table 5.
From Table 5, it can be found that the proportion of drone surveillance targets in the initial solution has little influence on the objective function value when other parameters remain the same. In the initial solution, when drone surveillance targets are set to 65% of the total surveillance targets, “—” means that the number of vehicle-mounted drones is insufficient to complete the surveillance of all drone surveillance targets.
In addition, the influence of the drone surveillance target scale on algorithm convergence in the initial solution is shown in Figure 11. By observing the convergence of different curves, it can be seen that the curves can converge quickly in 100 generations. It can be inferred that this is the optimization effect of the proposed ASALN algorithm on the initial solution. Although the proportions of drone surveillance targets in the initial solution are different, the initial solution is destroyed and repaired by the proposed ASALN algorithm, which makes the proportion of drone surveillance targets and truck surveillance targets in the final solution tend to be the same. Therefore, the above convergence curves of four scales can converge well and there is little difference between the convergent values. However, the different scales of drones in the initial solution lead to different convergence rates of the proposed ASALN algorithm. Specifically, as the proportions of drone surveillance targets go from 25% to 45%, the scale of the drone surveillance target in the initial solution gradually enlarged and the convergence rate becomes faster. When the proportion of drone surveillance targets in the initial solution reaches 55%, the convergence rate of the proposed ASALN algorithm becomes slowed down. When the proportion of drone surveillance targets in the initial solution is 65%, there is no feasible solution due to the limited number of drones.
(B) Sensitivity analysis of vehicle-mounted drone number: Since vehicle-mounted drones can only be used once in a surveillance mission, the number of vehicle-mounted drones determines the upper limit of the number of drone surveillance routes. To investigate the influence of the number of vehicle-mounted drones, different numbers of drones are set under the condition that other parameters are unchanged. The experimental results are shown in Figure 12.
From Figure 12, as the number of vehicle-mounted drones increases, the targets in the best solution can make cost-savings after changing their surveillance mode, and the targets can be surveilled by the drones, thus saving cost. Therefore, it is necessary to explore the appropriate number of vehicle-mounted drones for a specific case. As the number of vehicle-mounted drones increases from 3 to 9, the average number of targets surveilled by drones is decreased, and some targets that are originally surveilled by trucks become surveilled by drones. Combining the results in Table 4, the cost of surveilling targets by the truck decreases, while the cost of surveilling targets by drones increases, and the total cost decreases. Specifically, the total cost decreased from $20.52 to $17.74, a reduction of 13.6%. Truck costs decreased from $15.78 to $8.73, a reduction of 44.7%. Drone costs increased from $4.74 to $9.01, an increase of 90%. By observing the curve trend in Figure 12, it can be seen that with the increase in the number of vehicle-mounted drones, the rate of total cost reduction gradually slows down. When there are more than 6 drones, the total cost remains constant. In this case, the drones appear idle, and blindly increasing drones may produce more costs. The endurance of drones becomes the main constraint. In addition, as the operators in the ASALN algorithm always give priority to the target that saves the most costs, the rate of cost-savings should be expressed as high to low, which is consistent with the results in Figure 12.
(C) Sensitivity analysis of drone endurance: Drone endurance, as an important parameter of a drone, determines the maximum number of surveillance targets in a flight, and the reasonable selection of different drone endurances is of great help to save costs. To investigate the influence of the drone endurance on total cost, the drone endurance is set to 10–22 km, and the experimental results are shown in Figure 13.
From Figure 13, as the drone endurance increases, some targets surveilled by the truck are changed to be surveilled by drones, which reduces the cost of the truck and increases the cost of the drones, meanwhile the total cost decreased from $21.14 to $17.34, a reduction of 18%. Truck costs decreased from $13.92 to $8.73, a reduction of 37.3%. Drone costs increased from $4.74 to $9.01, an increase of 19.4%. The reason can be explained as follows. In the process of optimization solutions, adding a truck target to an existing drone route may yield cost-savings, while the drone may not afford surveillance missions at that target due to endurance constraints. However, adding that target to a new drone route would increase the total cost. Increasing the endurance of the drone would generate a better solution. In addition, when the drone has a range of more than 16 km, the total cost remains constant. In this case, there are no extra suitable targets for drone surveillance, and the drone has surplus energy. The targets outside the drone surveillance route are closer to the truck’s route; thus, the cost of surveillance by the truck becomes smaller, and the remaining energy is always few so as to the second take-off will not be enough to complete the surveillance mission or can only surveil fewer targets, and this part of the energy is often wasted.

6. Conclusions

In this paper, we study the target surveillance problem based on a new mode, i.e., the cooperation of trucks and drones, This new mode focuses on how to rationally plan the routes of trucks and drones to improve the surveillance efficiency and the aim of this target surveillance problem is to minimize the total cost. In this mode, a truck departs from the base and surveils targets along the way and returns to the base with all drones. After being launched from the truck, drones surveil multiple targets and then return to the truck. Based on this motivation, we propose a method ASALN, where the nearest neighbor and cost-saving strategy is designed to generate initial solutions to the target surveillance problem. Then, an adaptive large-scale neighborhood strategy is developed under the simulated annealing framework to optimize the routing of the truck and drones. In addition, extensive experiments are conducted on real and synthetic cases, and the results show that the proposed method ASALN has competitive performance than the SA and TS algorithms on the small-scale, medium-scale and large-scale cases of multitarget surveillance problems. Therefore, the proposed cooperation of truck and drone mode brings new ways to targets surveillance problem.
In the future, we will further explore the target surveillance problem via the cooperation of multiple trucks and multiple drones. Additionally, the objective function of this paper is to consider the minimum cost of the target surveillance problem are not comprehensive enough, studing the customer satisfaction as an objective function is meaningful work. Therefore, in the next stage of research work, further studying the multi-objective optimization problem to improve the level of multi-target surveillance problems is a promissing direction, where considering the objective of minimum cost and the objective of customer satisfaction simultaneously.
This research was funded by the National Natural Science Foundation of China under Grant 62073341.

Author Contributions

Methodology, S.T.; Writing—review & editing, X.W.; Supervision, G.W.; Writing—original draft, B.W.; Resources, G.W. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by National Natural Science Foundation of China under Grant 62073341.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Xia, Y.; Shi, j.; Chen, C.; Huang, J.; Cheng, G. Path Planning Method for Multi-Area Reconnaissance by Cooperated Ground Vehicle and Drone. J. Command. Control 2020, 6, 372–380. [Google Scholar]
  2. Ukaegbu, U.F.; Tartibu, L.K.; Okwu, M.O.; Olayode, I.O. Development of a Light-Weight Unmanned Aerial Vehicle for Precision Agriculture. Sensors 2021, 21, 4417. [Google Scholar] [CrossRef] [PubMed]
  3. Angira, R.; Babu, B. Optimization of process synthesis and design problems: A modified differential evolution approach. Chem. Eng. Sci. 2006, 61, 4707–4721. [Google Scholar] [CrossRef]
  4. Valente, J.; Del Cerro, J.; Barrientos, A.; Sanz, D. Aerial coverage optimization in precision agriculture management: A musical harmony inspired approach. Comput. Electron. Agric. 2013, 99, 153–159. [Google Scholar] [CrossRef] [Green Version]
  5. Miao, Y.; Zhong, L.; Yin, Y.; Zou, C.; Luo, Z. Research on dynamic task allocation for multiple unmanned aerial vehicles. Trans. Inst. Meas. Control. 2017, 39, 466–474. [Google Scholar] [CrossRef]
  6. Raap, M.; Meyer-Nieberg, S.; Pickl, S.; Zsifkovits, M. Aerial vehicle search-path optimization: A novel method for emergency operations. J. Optim. Theory Appl. 2017, 172, 965–983. [Google Scholar]
  7. Cakıcı, F.; Ergezer, H.; Irmak, U.; Leblebicioğlu, M.K. Coordinated guidance for multiple UAVs. Trans. Inst. Meas. Control 2016, 38, 593–601. [Google Scholar] [CrossRef]
  8. Chiper, F.L.; Martian, A.; Vladeanu, C.; Marghescu, I.; Craciunescu, R.; Fratu, O. Drone Detection and Defense Systems: Survey and a Software-Defined Radio-Based Solution. Sensors 2022, 22, 1453. [Google Scholar] [CrossRef]
  9. Kyriakakis, N.A.; Marinaki, M.; Matsatsinis, N.; Marinakis, Y. Moving peak drone search problem: An online multi-swarm intelligence approach for UAV search operations. Swarm Evol. Comput. 2021, 66, 100956. [Google Scholar] [CrossRef]
  10. Chen, J.; Ling, F.; Zhang, Y.; You, T.; Liu, Y.; Du, X. Coverage path planning of heterogeneous unmanned aerial vehicles based on ant colony system. Swarm Evol. Comput. 2021, 69, 101005. [Google Scholar] [CrossRef]
  11. Yang, J.; Dong, L.; Wang, H.; Wang, L. Multi-cooperative UAV mission planning method based on hierarchical optimization. J. Command. Control 2019, 5, 41–46. [Google Scholar]
  12. Ma, Y.; Zhang, W.; Zhang, Y.; Zhang, X.; Zhong, Y. Research on overall Parameter Design method of Distributed Electric Propulsion UAV. J. Northwestern Polytech. Univ. 2021, 39, 27–36. [Google Scholar] [CrossRef]
  13. Tian, Q.; Shen, L. Research on cooperative surveillance of multi-base and multi-uav. Acta Aeronaut. ET Astronaut. Sin. 2007, 28, 913–921. [Google Scholar]
  14. Huang, H.; Savkin, A.V. Surveillance of Remote Targets by UAVs. In Proceedings of the 2021 Australian & New Zealand Control Conference (ANZCC), Gold Coast, Australia, 25–26 November 2021; pp. 222–225. [Google Scholar]
  15. Huang, H.; Savkin, A.V. Optimal deployment of charging stations for aerial surveillance by UAVs with the assistance of public transportation vehicles. Sensors 2021, 21, 5320. [Google Scholar] [CrossRef]
  16. Yang, Z.; Lei, H. Simulation of multi-uav cooperative surveillance route planning algorithm. J. Syst. Simul. 2007, 19, 433–436. [Google Scholar]
  17. Wu, W.; Huang, C.; Song, L. Cooperative search route planning of multiple UAVs in uncertain environment. Acta Armamentarii 2011, 32, 1337–1342. [Google Scholar]
  18. Yu, R.; Liu, M.; Kong, F. Simulation of Cooperative route Planning algorithm for multiple UAVs based on Conflict resolution. Electron. Opt. Control. 2011, 18, 41–44. [Google Scholar]
  19. Dong, Y.; Zhang, W.; Cui, W. A synthetic index model for evaluating the effectiveness of man-unman UAV cooperative air-ground attack. Electron. Opt. Control 2015, 40, 58–62. [Google Scholar]
  20. Kuo, R.; Lu, S.H.; Lai, P.Y.; Mara, S.T.W. Vehicle routing problem with drones considering time windows. Expert Syst. Appl. 2022, 191, 116264. [Google Scholar] [CrossRef]
  21. Bauso, D.; Giarré, L.; Pesenti, R. Multiple UAV cooperative path planning via neuro-dynamic programming. In Proceedings of the 2004 43rd IEEE conference on decision and control (CDC)(IEEE Cat. No. 04CH37601), Nassau, Bahamas, 14–17 December 2004; Volume 1, pp. 1087–1092. [Google Scholar]
  22. Hu, M.; Liu, W.; Peng, K.; Ma, X.; Cheng, W.; Liu, J.; Li, B. Joint routing and scheduling for vehicle-assisted multidrone surveillance. IEEE Internet Things J. 2018, 6, 1781–1790. [Google Scholar] [CrossRef]
  23. Tian, J.; Shen, L.; Zheng, Y. Formulation and a MOGA based approach for multi-UAV cooperative reconnaissance. In International Conference on Cooperative Design, Visualization and Engineering; Springer: Berlin/Heidelberg, Germany, 2006; pp. 99–106. [Google Scholar]
  24. Ahn, N.; Kim, S. Optimal and heuristic algorithms for the multi-objective vehicle routing problem with drones for military surveillance operations. J. Ind. Manag. Optim. 2021. [Google Scholar] [CrossRef]
  25. Gonzalez-R, P.L.; Canca, D.; Andrade-Pineda, J.L.; Calle, M.; Leon-Blanco, J.M. Truck-drone team logistics: A heuristic approach to multi-drop route planning. Transp. Res. Part C Emerg. Technol. 2020, 114, 657–680. [Google Scholar] [CrossRef]
  26. Murray, C.C.; Chu, A.G. The flying sidekick traveling salesman problem: Optimization of drone-assisted parcel delivery. Transp. Res. Part Emerg. Technol. 2015, 54, 86–109. [Google Scholar] [CrossRef]
  27. Agatz, N.; Bouman, P.; Schmidt, M. Optimization approaches for the traveling salesman problem with drone. Transp. Sci. 2018, 52, 965–981. [Google Scholar] [CrossRef]
  28. Raj, R.; Murray, C. The multiple flying sidekicks traveling salesman problem with variable drone speeds. Transp. Res. Part C Emerg. Technol. 2020, 120, 102813. [Google Scholar] [CrossRef]
  29. Wang, Z.; Sheu, J.B. Vehicle routing problem with drones. Transp. Res. Part B Methodol. 2019, 122, 350–364. [Google Scholar] [CrossRef]
  30. De Freitas, J.C.; Penna, P.H.V. A randomized variable neighborhood descent heuristic to solve the flying sidekick traveling salesman problem. Electron. Notes Discret. Math. 2018, 66, 95–102. [Google Scholar] [CrossRef]
  31. Zhou, Y.; Huang, J.; Shi, J.; Wang, R.; Huang, K. The electric vehicle routing problem with partial recharge and vehicle recycling. Complex Intell. Syst. 2021, 7, 1445–1458. [Google Scholar] [CrossRef]
  32. Ha, Q.M.; Deville, Y.; Pham, Q.D.; Hà, M.H. On the min-cost traveling salesman problem with drone. Transp. Res. Part C Emerg. Technol. 2018, 86, 597–621. [Google Scholar] [CrossRef] [Green Version]
  33. Kitjacharoenchai, P.; Ventresca, M.; Moshref-Javadi, M.; Lee, S.; Tanchoco, J.M.; Brunese, P.A. Multiple traveling salesman problem with drones: Mathematical model and heuristic approach. Comput. Ind. Eng. 2019, 129, 14–30. [Google Scholar] [CrossRef]
  34. Sacramento, D.; Pisinger, D.; Ropke, S. An adaptive large neighborhood search metaheuristic for the vehicle routing problem with drones. Transp. Res. Part C Emerg. Technol. 2019, 102, 289–315. [Google Scholar] [CrossRef]
  35. Ham, A.M. Integrated scheduling of m-truck, m-drone, and m-depot constrained by time-window, drop-pickup, and m-visit using constraint programming. Transp. Res. Part C Emerg. Technol. 2018, 91, 1–14. [Google Scholar]
  36. Ukaegbu, U.; Tartibu, L.; Laseinde, T.; Okwu, M.; Olayode, I. A deep learning algorithm for detection of potassium deficiency in a red grapevine and spraying actuation using a raspberry pi3. In Proceedings of the 2020 International Conference on Artificial Intelligence, Big Data, Computing and Data Communication Systems (ICABCD), Durban, South Africa, 6–7 August 2020; pp. 1–6. [Google Scholar]
  37. Liu, S.; Tang, K.; Yao, X. Memetic search for vehicle routing with simultaneous pickup-delivery and time windows. Swarm Evol. Comput. 2021, 66, 100927. [Google Scholar] [CrossRef]
  38. Wu, H.; Gao, Y.; Wang, W.; Zhang, Z. A hybrid ant colony algorithm based on multiple strategies for the vehicle routing problem with time windows. Complex Intell. Syst. 2021, 2020, 8839526. [Google Scholar] [CrossRef]
  39. Chen, H.; Cheng, R.; Wen, J.; Li, H.; Weng, J. Solving large-scale many-objective optimization problems by covariance matrix adaptation evolution strategy with scalable small subpopulations. Inf. Sci. 2020, 509, 457–469. [Google Scholar] [CrossRef]
  40. İlhan, İ. An improved simulated annealing algorithm with crossover operator for capacitated vehicle routing problem. Swarm Evol. Comput. 2021, 64, 100911. [Google Scholar] [CrossRef]
  41. Cao, L.; Ye, C.M.; Cheng, R.; Wang, Z.K. Memory-based variable neighborhood search for green vehicle routing problem with passing-by drivers: A comprehensive perspective. Complex Intell. Syst. 2022, 15, 1–19. [Google Scholar]
  42. Wu, Z.; Zhang, J. A branch-and-price algorithm for two-echelon electric vehicle routing problem. Complex Intell. Syst. 2021, 49, 1–16. [Google Scholar] [CrossRef]
  43. Poikonen, S.; Golden, B. The mothership and drone routing problem. INFORMS J. Comput. 2020, 32, 249–262. [Google Scholar] [CrossRef]
  44. Liu, Y.; Liu, Z.; Shi, J.; Wu, G.; Pedrycz, W. Two-echelon routing problem for parcel delivery by cooperated truck and drone. IEEE Trans. Syst. Man, Cybern. Syst. 2020, 51, 7450–7465. [Google Scholar] [CrossRef]
  45. Wang, X. Vehicle and Drone Joint Distribution routing Problem with Multiple Drone Hubs. Oper. Res. Manag. Sci. 2021, 30, 31–37. [Google Scholar]
  46. Lu, Y.; Lin, Y.; Peng, Q.; Wang, Y. Review of simulated annealing algorithm improvement and parameter exploration. Coll. Math. 2015, 31, 96–103. [Google Scholar]
  47. Li, J.; Fu, P. Modeling and Simulation of Vehicle routing problem with time Window based on energy consumption. J. Syst. Simul. 2013, 25, 1147–1154. [Google Scholar]
  48. Cachon, G.P. Retail store density and the cost of greenhouse gas emissions. Manag. Sci. 2014, 60, 1907–1925. [Google Scholar] [CrossRef] [Green Version]
  49. Allain, R. Physics of the Amazon octocopter drone. Wired 2013, 2, 1–5. [Google Scholar]
Figure 1. A truck and multiple drones for target surveillance.
Figure 1. A truck and multiple drones for target surveillance.
Sensors 22 02909 g001
Figure 2. The flowchart of the proposed method.
Figure 2. The flowchart of the proposed method.
Sensors 22 02909 g002
Figure 3. The initial solution schematic diagram by combining the nearest neighbor and cost-savings strategies. (a) Truck only for surveillance targets. (b) Cooperation of a truck and drones for surveillance targets.
Figure 3. The initial solution schematic diagram by combining the nearest neighbor and cost-savings strategies. (a) Truck only for surveillance targets. (b) Cooperation of a truck and drones for surveillance targets.
Sensors 22 02909 g003
Figure 4. Schematic diagram of destroy operators.
Figure 4. Schematic diagram of destroy operators.
Sensors 22 02909 g004
Figure 5. Schematic diagram of the random destroy operator when q = 2.
Figure 5. Schematic diagram of the random destroy operator when q = 2.
Sensors 22 02909 g005
Figure 6. Schematic diagram of the maximum savings destroy operator.
Figure 6. Schematic diagram of the maximum savings destroy operator.
Sensors 22 02909 g006
Figure 7. Schematic diagram of the greedy repair operator.
Figure 7. Schematic diagram of the greedy repair operator.
Sensors 22 02909 g007
Figure 8. The comparison results of the two surveillance modes.
Figure 8. The comparison results of the two surveillance modes.
Sensors 22 02909 g008
Figure 9. The surveillance route of truck and drone.
Figure 9. The surveillance route of truck and drone.
Sensors 22 02909 g009
Figure 10. Convergence curve of the objective function value.
Figure 10. Convergence curve of the objective function value.
Sensors 22 02909 g010
Figure 11. The convergence of different drone surveillance targets in the initial solution.
Figure 11. The convergence of different drone surveillance targets in the initial solution.
Sensors 22 02909 g011
Figure 12. Experimental results under different numbers of drones.
Figure 12. Experimental results under different numbers of drones.
Sensors 22 02909 g012
Figure 13. Experimental results under different drone endurances.
Figure 13. Experimental results under different drone endurances.
Sensors 22 02909 g013
Table 1. Symbols and definitions.
Table 1. Symbols and definitions.
SymbolsDefinitions
Sets:
GThe undirected graph of the surveillance problem;
LThe set of surveillance targets and the base;
EThe set of edges in the truck’s (or the drone’s) route;
D a l l =1, 2,…, n, the set of all surveillance targets;
D 0 =0, the base of the truck and drones;
RThe main route of the truck;
S r The set of route segments contained in truck route r , r R ;
D r The set of truck surveillance targets in truck route r , r R ;
D r The set of drone surveillance targets in truck route r , r R ;
R r l The set of drone routes in truck route r , r R ;
D r l m The set of surveillance targets in the drone route m in route segment l in truck route r , m R r l , l S r , r i n R ;
E r l m The set of edges in the drone route m in route segment l in truck route r , m R r l , l S r , r i n R ;
Parameters:
nThe number of drone take-off points;
L i j The distance from surveillance target i to surveillance target j in the truck’s route, i , j D a l l ;
L i j The distance from surveillance target i to surveillance target j in the truck’s route, i , j D a l l ;
s 1 The cost per kilometer of the truck;
s 2 The flying cost per KWH of the drone;
w d The weight of the drone;
v 1 The speed of the truck;
v 2 The flying speed of the drone;
pThe power of the drone;
VThe maximum flight speed of the drone;
PThe maximum power of the drone;
WThe maximum battery capacity of the drone;
t i j The time consumption of the drone from i to j;
F i j The energy consumption of the drone from i to j;
T M The maximum endurance of the drone;
a t i The start time of truck surveillance target i;
d t i The time required for the truck at surveillance target i;
t e i The extra stop time for the truck at surveillance target i;
a t i The start time of drone surveillance target i;
d t i The time required for the drone at surveillance target i;
c i j T The cost for the truck to go from target i to target j , i , j D a l l ;
c r The total cost of the trucks’ main route r , r R ;
c r l m The flight cost of drone in subroute m corresponding to route segment l of trucks’ main route r , m R r l , l S r , r R ;
MThe infinite positive numbers;
N d The number of truck-mounted drones;
π i 1 , i 2 The scores of the destroy and the repair operator;
ω i 1 , i 2 The weights of the destroy and the repair operator;
Decisions:
a i j l m If edge ( i , j ) E r l m , then a i j r l m = 1; otherwise, a i j r l m = 0 , i , j D a l l , r R , l S r , m R r l ;
b i j l m If i D r l m , then b i j l m =1; otherwise, b i j l m = 0 , r R , l S r , m R r l ;
c i r If i D r , then c i r = 1 ; otherwise, c i r = 0 , r R ;
x r If the truck chooses the main route r, then x r = 1; otherwise x r = 0 , r R ;
y r l m If the drone chooses the subroute m corresponding to the route segment l in the main route r of the truck, then y r l m = 1. Otherwise, y r l m = 0 , m R r l , l S r , r R ;
Table 2. The setting of synthetic cases.
Table 2. The setting of synthetic cases.
ScaleThe Number of TargetsSurveillance Area Size
Small5010 km × 10 km
Medium8015 km × 15 km
Large10020 km × 20 km
Table 3. The parameter settings of the truck and drones.
Table 3. The parameter settings of the truck and drones.
TruckCost$1.201/km
DroneSelf-weight2 kg
Battery power5000 mAh
Maximum range14 km
Cost$0.498/km
Table 4. Experimental results on synthetic cases on three scales.
Table 4. Experimental results on synthetic cases on three scales.
TOT&DT&D (TS)T&D (SA)T&D (ASALN)Comparison (%)
Area SizeCost ($)Cost ($)Cost ($)Time (s)Cost ($)Time (s)Cost ($)Time (s)NNCS (%)TO (%)
Small Scale179.8979.9444.9451.3244.7363.1844.7351.6444.0575.13
197.6287.2656.4551.2348.5270.9849.6849.8843.0774.86
178.6378.3643.8752.0042.3663.6542.3952.6845.9076.27
187.3580.3255.6848.6445.8960.5446.3050.0142.3675.29
202.6987.6860.8750.9852.9366.5853.6849.6838.7873.52
Medium Scale560.96170.08124.87213.81105.38386.63100.74275.6740.7782.04
598.67176.56136.9240.39106.96356.29100.98282.6942.8183.13
585.62179.65138.62252.95121.94297.63121.75263.9532.2379.21
541.35180.63139.75257.65120.98340.95115.64289.6435.9878.64
574.98184.65157.62275.65140.96360.89142.85298.7922.6475.16
Large Scale872.89241.67174.75428.69167.04576.52160.95489.6433.4081.56
909.65305.08217.62452.97190.97562.98189.64492.6337.8479.15
863.98298.63201.68421.63179.00591.39170.78465.1942.8180.23
790.65278.17198.65399.67162.66567.99162.39458.6641.6279.46
921.78298.66254.97401.03189.99577.08190.69508.9636.1579.31
Table 5. Different proportions of drone surveillance targets in the initial solution.
Table 5. Different proportions of drone surveillance targets in the initial solution.
Proportions25%35%45%55%65%
Objective values17.9817.8417.7217.72
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Tian, S.; Wen, X.; Wei, B.; Wu, G. Cooperatively Routing a Truck and Multiple Drones for Target Surveillance. Sensors 2022, 22, 2909. https://doi.org/10.3390/s22082909

AMA Style

Tian S, Wen X, Wei B, Wu G. Cooperatively Routing a Truck and Multiple Drones for Target Surveillance. Sensors. 2022; 22(8):2909. https://doi.org/10.3390/s22082909

Chicago/Turabian Style

Tian, Shuangxi, Xupeng Wen, Bin Wei, and Guohua Wu. 2022. "Cooperatively Routing a Truck and Multiple Drones for Target Surveillance" Sensors 22, no. 8: 2909. https://doi.org/10.3390/s22082909

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop