Next Article in Journal
Acknowledgement to Reviewers of Robotics in 2016
Previous Article in Journal
Improving Robot Mobility by Combining Downward-Looking and Frontal Cameras
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Complete Coverage Path Planning for a Multi-UAV Response System in Post-Earthquake Assessment

1
Department of Industrial Engineering, Eastern Mediterranean University, Famagusta, North Cyprus, via Mersin 10, Famagusta 99450, Turkey
2
Department of Industrial Engineering, University of Kurdistan, Pasdaran Boulevard, Sanandaj 15175-66177, Iran
*
Author to whom correspondence should be addressed.
Robotics 2016, 5(4), 26; https://doi.org/10.3390/robotics5040026
Submission received: 10 October 2016 / Revised: 11 November 2016 / Accepted: 17 November 2016 / Published: 2 December 2016

Abstract

:
This paper presents a post-earthquake response system for a rapid damage assessment. In this system, multiple Unmanned Aerial Vehicles (UAVs) are deployed to collect the images from the earthquake site and create a response map for extracting useful information. It is an extension of well-known coverage path problem (CPP) that is based on the grid pattern map decomposition. In addition to some linear strengthening techniques, two mathematic formulations, 4-index and 5-index models, are proposed in the approach and coded in GAMS (Cplex solver). They are tested on a number of problems and the results show that the 5-index model outperforms the 4-index model. Moreover, the proposed system could be significantly improved by the solver-generated cuts, additional constraints, and the variable branching priority extensions.

1. Introduction

Rapid damage assessment in post-earthquake situations plays an important role in the early response phase activities (i.e., evacuation of injured individuals, debris collection, and relief distribution). The ground-based post-earthquake inspection is extremely time-consuming, and unhelpful in severely damaged areas; therefore, at present, aerial systems are widely used for investigations. It is highly desirable for densely populated urban areas to have a pre-planned immediate and automated post-disaster mapping and monitoring system. In the past decade, scientists have made an attempt to improve high-resolution satellite imaging and laser scanning systems to evaluate the disaster damage and loss [1,2,3,4,5,6,7,8]. However, the satellite systems have many limitations for an efficient post-disaster imaging, such as weather conditions (cloudy or dust whirls), time constraints for acquiring images and uplinking the acquisition plan to the satellite, delay in satellite data delivery after collection, etc. [9,10]; therefore, much attention has been focused on utilizing small unmanned aerial vehicles (UAVs) for post-disaster mapping [11,12,13].
In recent times, UAVs have become a popular entertaining tool globally. UAVs of various sizes are available on the market that can carry film or photographic cameras for different applications. The classification of UAVs according to their classes, distinct applications, and characteristics is beyond the scope of this article, though interested readers can refer to earlier studies [13,14]. Moreover, Colomina and Molina [15] have reviewed significant applications of UAVs, such as imaging and remote sensing. This study focuses on the mapping applications of small UAVs in post-earthquake situations. In a UAV-mapping system, consecutive overlapping aerial images taken by the UAVs are processed to obtain a complete map or to extract useful information. In earthquake situations, the information, such as building and bridge destructions, road blockages, and population relocation, aids the managers in organizing a more effective post-earthquake response system. Within the first 30 min, the post-earthquake survival rate is 91%, decreasing to 36.7% by the second day [11]. Hence, in addition to accuracy, time is also an important factor in post-earthquake mapping. Based on this fact, it can be said that an optimal solution to the UAV coverage path-planning problem with a time-dependent objective function will have a great effect on the efficiency of the response system.
Coverage path problem (CPP), can be considered as a variant of Vehicle Routing Problem (VRP). In VRP, a fleet of vehicles start and end their tour at a single depot while visiting all nodes on the route. Unlike the classical VRP that considers a single main depot, in multi depot vehicle routing problem (MDVRP), there are several depots and the customers can be served from any of the depots. MDVRP has widely been studied in the literature and the interested readers may refer to the extensive survey of Montoya-Torres et al. [16]. Based on the literature the UAV routing problem is also formulated as a VRP model where additional constraints need to be added to reflect the characteristics of the problem. UAV routing problem has attracted much attention in the past decade for different applications [17,18]. CPP, tries to find an appropriate path for robots while covering the pre-defined nodes. The problem has a wide range of applications in automated harvesting, vacuum cleaning, mapping, demining, monitoring, etc. It is worth mentioning that CPP is different from the Covering Tour Problem (CTP). In CTP there are two types of nodes, those that must be visited by the tour and those that must be covered i.e., it lies within a pre-defined distance from a vertex of the tour [19]. Choset [20] and Galceran and Carreras [21] conducted comprehensive surveys on CPP methods, algorithms, and recent advances.
Immediately after an earthquake, the damage and location of afflicted people can be identified by imaging and then processing the obtained images. Since time factor is very important in post-earthquake response phase, UAVs are considered to be reliable for this task. Earthquake is not the only disaster that can be monitored by UAVs, but it is the most suitable one for imaging due to absence of information about the condition of each construction over the entire area. The imaging application of UAV based on CPP necessitates further considerations. One important issue is the direction of the path while passing through a node. Another important issue that arises due to earthquake situation is that, unlike the routing problem, the maximum mission time of vehicles must be minimized. UAVs start their route from a base and end their route at the same base for refueling or at the mission completion. This study extends the CPP for an application in the post-earthquake rapid damage assessment. The CPP features on a grid-based map are adopted on a multi-depot multi-tour vehicle routing problem for an emergency situation.
Zelinsky et al. [12] were the first to investigate the CPP on a robot, starting from an origin and ending at a goal point to minimize the length, energy consumption, and travel time. Later Carvalho et al. [22] proposed an algorithm for a mobile robot in an industrial environment such that the obstacles were not pre-specified on the map. The subject of path planning has attracted a lot of attention due to the recent development of UAV systems. Li et al. [23] studied an exact cellular decomposition method for UAV path planning in a polygon region. For the purpose of precision agriculture mapping, Barrientos et al. [24] performed an experiment using an integrated tool. Initially, they subdivided the polygon area and then conducted path planning for each subarea using a multi-UAV system. Torres et al. [25] presented a path planning algorithm for a single UAV with the aim of reducing battery usage and minimizing the number of turns, coping with both convex and non-convex regions. In a study by Wang et al. [26], an algorithm was used that minimized the consumed energy by the UAV for covering 3D terrain. In addition, a distinct study [27] introduced the multi-robot boundary coverage problem with the application of inspection of blade surfaces inside a turbine. Furthermore, Galceran and Carreras [21] conducted a comprehensive survey on CPP.
Most CPP algorithms are based on boustrophedon path strategy. In this strategy, the back and forth motion in a sweep direction of a polygon tries to cover an area with a minimum number of turns. Another approach divides the decomposing area into sub-areas and then finds the visiting sequence of the sub-areas in a sweep direction base [28], describing how to find the optimal sweep direction for robots in a polygon. Huang and York claimed that the minimization of the number of turns leads to the most efficient solution (Figure 1). Li et al. [23] showed that the path with a lower number of turning motions is a more efficient coverage path for UAVs with regards to energy, distance, and travel time.
Furthermore, the map decomposition and sweep direction method were applied for a multi-UAV system [29]. Due to lack of time in a post-earthquake situation, using a multi-UAV system is potentially more beneficial and practical. Avellar et al. [30] studied a multi-UAV CPP in which the nodes were pre-defined corresponding to the boustrophedon motion. Similar to earlier studies, they decomposed the region into several sub-regions and used a VRP model to find the optimal path. However, the travel time between the sub-areas and the base to a region, as well as the possibility of turning back from the middle of a region to the base for refueling, were neglected.
Although numerous studies have been conducted on the sweep direction method, path covering based on grid-based decomposition has not yet received much attention. In a study by Wang and Li [31], the desired region was divided into grids and the amount of information collected by UAV and the path-length were maximized. According to their algorithm, passing through the center of a grid is equivalent to covering the grid; however, to have a complete image of the grid, the covering is considered as entering a grid from one side and exiting from the opposite side. Therefore, the turning motions in the grids are not considered as a part of the covered area (Figure 2). The grid size can vary depending on the altitude of the UAVs and focal length of the camera; however, by increasing the number of grids the complexity of the problem will increase.
In this study, it is assumed that the number of available UAVs, potential location of UAV bases, and the possible number of open bases are based on the restrictions prescribed by the decision maker. In addition, the total mission time limit should be specified earlier according to the endurance of UAVs. We have tried to address the following questions in the proposed post-earthquake mapping problem: (1) which potential UAV base must be open; (2) how many UAVs among all the available ones should be assigned to each open base; (3) what must be the passing sequence of squares in each route; and (4) what is the minimum time required for covering all residential squares with the existing limitations. The proposed problem has a Minimax objective function that minimizes the maximum traveling time of each UAV in order to find the fastest possible mapping schedule. Each UAV belongs to a UAV base from where its mission starts and ends, and battery replacement or refueling is performed at the same base. Each UAV’s mission time cannot exceed a maximum flight time (MT) due to its endurance. To the best of our knowledge, this problem has not been studied thus far, and the formulations presented here are the first mixed integer linear programming (MILP) mathematical models of the grid-based CPP problem. We call this problem multi-UAV multi-tour location coverage path planning (MUTLCPP). The application of this model is a post-earthquake mapping system due to the Minimax objective function, and a grid-based decomposition of the residential areas.
The remainder of this study is organized as follows: Section 2 represents the problem definition and two 4-index and 5-index mathematical models. Section 3 contains the extensions and techniques used to improve the performance of the branch and cut algorithm. Section 4 includes the test problems and computational results, and Section 5 contains conclusions and future prospects of CPP.

2. Problem Definition and Mathematical Formulations

Associated with the MUTLCPP problem, the sets, parameters, and decision variables are defined as follows (in Table 1):
The map of earthquake struck region was decomposed into equal sized squares, according to the UAV’s camera footprint. The camera footprint (CF) depends on the camera sensor size (CSS), lens focal length (FL), and flight altitude (FA). Figure 3 shows the camera footprint, which can be calculated as follows.
C F = F A C S S F L
The camera plays a very important role in CPPs especially for a post-earthquake situations. Despite the resolution demanded by the decision maker, the focal length of the lens and the sensor size of the camera have a great impact on the mapping schedule length. A smaller focal length with a larger sensor size ends up in a larger camera footprint (Equation (1)) and consequently a lower number of squares in the map and schedule length. Also, the horizontal flight disposition is preferred for covering residential areas by a sequence of overlapping images, although the new UAV systems allow changes in the viewing angle of the installed camera.
The ground sampling distance (GSD) is a scale of resolution in aerial photogrammetry. It is the distance between two successive pixel centers on the ground. The smaller value of the GSD leads to the higher resolution of the image and more differentiable details. At a fixed focal length, decreasing the altitude results in a smaller GSD, and at a fixed flight altitude, by increasing the focal length, the GSD value will decrease. In an earthquake situation, the GSDs of several meters may suffice for damage assessment of non-urban regions. However, it is quiet insufficient when analyzing highly populated earthquake-struck cities and detailed images of at least 1 m GSD are essential [32].
While the geographical mapping might not require a quick scheduling process, in post-earthquake mapping, time factor has a great importance. Since the use of UAVs for mapping is in its early days, there are potential improvements and considerable innovations related to unseen problems and technical challenges.
To ease the image processing, an overlap from each side is essential; thus, if the overlap is α % from each side, then the square edge must be equal to ( 1 2 α ) % of the camera footprint length. The overlap is required to discover the common details among the images, however; the minimum and maximum overlaps depend on the post-image-processing software. Considering the fact that image-processing discussion is beyond the scope of this study, and there is no universally accepted overlap standard [33], we only mention that the overall overlap for a specified-path mapping must be at least 20% of the image width [34].
The MUTLCPP is defined on an undirected graph G ( S , A ) , where S = S O S D is a set of squares and A = { ( i , j ) | i , j S } is the set of arcs. S D is a set of potential depot squares and S O = S C S E , where S C is the set of residential squares that must be covered and S E is the set of empty squares. Non-negative travel time, t i j , and travel distance, d i j , are associated with each arc with a triangular inequality (i.e., t i k + t k j t i j ). Moreover, the set of homogenous UAVs is denoted by U = { 1 , 2 , 3 , . . , u } and the set of routes by L = { 1 , 2 , 3 , , l } . There is a set R = { L e f t ,   R i g h t ,   U p ,   D o w n ,   D i r e c t } that specifies the leaving direction form one square to another. All the squares belonging to S C must be covered, at least once, such that the UAV enters and exists from opposite sides (i.e., Right-Left, Left-Right, Up-Down, and Down-Up). Among the | S D | number of potential depots, T D number of them can be opened, according to the restrictions prescribed by the decision maker. The flight time limitation for each UAV is specified by M T . All UAVs start and end their tours at the same base. Because time plays a vital role in the post-disaster response phase against cost, the proposed model must minimize the maximum mission time of all UAVs.
When M is a sufficiently large positive number, the 4-index and 5-index models of MUTLCPP are presented as follows:

2.1. 4-Index Formulation

Model:
M i n   T
The objective Equation (1) is to minimize the maximum mission time of UAVs. This objective function leads to the minimum mapping schedule length for all UAVs. The MUCLTPP’s constraints are as follows:
S . t .   i S D y i = T D
i S D p i u = 1   u U
Equation (3) ensures that the total number of open bases is TD, and Equation (4) imposes that each UAV has to be allocated to one depot only.
i S u U w i j u l 1   j S , i j , l L
Equation (5) ensures that each square is passed at most once in each route.
j S w i j u l j S w j i u l = 0   i S , i j , l L , u U
Equation (6) guarantees that if a UAV enters a square then it must leave that square. In other words, the total number of entrances to a square is equal to the total number of exits from that square.
j S O l L u U w i j u l M y i 0   i S D
Equation (7) assures that the UAVs exit from an open base only. This constraint forces the w i j u l variable to take the value of zero if the base is close ( y i = 0 ) .
v i j u l M w i j u l 0   i & j S , i j ,   u U ,   l L
Equation (8) assigns zero to v i j u l variables according to the movement variable of w i j u l .
i S v i j u l i S v j i u l i S w i j u l = 0   j S O , i j , u U , l L
Equation (9) indicates that if a UAV pass through square i S O , then the remaining number of the nodes in route l will decrease by one.
i S j s , j i l L t i j w i j u l M T   l L
Equation (10) ensures that the duration of each route does not exceed the UAV’s flight time limitation M T .
i S j s , j i l L t i j w i j u l + i S D j S O l L S T w i j u l T   u U
The value of T which is the maximum mission time of UAVs is determined by Equation (11).
j S O l L w i j u l M p i u 0   i S D , u U
i S D j S O u U w i j u l 1   l L
Equation (12) indicates that UAVs can only leave their own depot and Equation (13) eliminates the illegal routes.
l L r R , r D i r e c t j S x i j l r = 0   i S ,     d ( i , j ) > d m
Equation (14) prevents the formation of arcs with the length more than d m for the horizontal and vertical directions. d m is the distance between the center of two consecutive squares; the length of horizontal or vertical arcs cannot exceed it.
j S ( x i j l r + x j i l r ) 2 g i l r 0   i S C , i j , l L , r R | r D i r e c t
Equation (15) specifies that the value of g i l r can be one if the entrance and exit are in the same horizontal or vertical directions.
l L r R | r D i r e c t g i l r 1   i S C
r R x i j l r u U w i j u l = 0   i i , j S , l L
Equation (16) ensures that all residential squares must be covered by a UAV in either horizontal or vertical directions and Equation (17) defines the value of variable x i j l r .
x i j l   U p = 0   i , j S | i 1 j , l L
x i j l   D o w n = 0   i , j S | i + 1 j , l L
x i j l   L e f t = 0   i , j S | i j + 1 , l L
x i j l   R i g h t = 0   i , j S | i j 1 , l L
Equations (18)–(21) imposes the value of zero for the wrong horizontal and vertical directions. For example Equation (18) ensures that the travel in the upward ( u p ) direction from i to j is zero unless i 1 is less than or equal j . The travel from one square to its right square must be impossible for the up, down, and left directions and it is shown in Equation (21).
w i j u l ,   x i j l r   { 0 , 1 }   i & j S , u U , l L , r R
y i ,   p i u ,   g j l r { 0 , 1 }   i S D , j S C , l L , r R
Finally, Equations (22) and (23) are used as the integrality constraints.

2.2. 5-Index Formulation

The 5-index model development is presented in the same structure of the 4-index formulation as follows:
M i n   T   ( 1 )   S . t   ( 2 ) ,   ( 3 ) ,   and
i S r R u U w i j u l r 1   j S , i j , l L
j S r R w i j u l r j S r R w j i u l r = 0   i S , i j , l L , u U
j S O l L u U r R w i j u l r M y i 0             i S D
v i j u l r R M w i j u l r 0   i & j S , i j ,   u U ,   l L
i S v i j u l i S v j i u l i S r R w i j u l r = 0   j S O , i j , u U , l L
i S j s , j i l L r R t i j w i j u l r M T   l L
i S j s , j i l L r R t i j w i j u l r + i S D j S O l L r R S T w i j u l r T   u U
j S O l L r R w i j u l r M p i u 0           i S D , u U
i S D j S O u U r R w i j u l r 1             l L
l L u U j S r R , r D i r e c t w i j u l r = 0               i S ,     d ( i , j ) > d m
j S ( w i j u l r + w j i u l r ) 2 g i u l r 0   i S C , i j , l L , u U ,   r R | r D i r e c t
l L r R | r Direct u U g iu lr 1   i S C
w i j u l   U p = 0   i , j S | i 1 j , l L , u U
w i j u l   D o w n = 0   i , j S | i + 1 j , l L , u U
w i j u l   L e f t = 0   i , j S | i j + 1 , l L , u U
w i j u l   R i g h t = 0   i , j S | i j 1 , l L , u U
w i j u l r   { 0 , 1 }   i & j S , u U , l L , r R
y i ,   p i u ,   g j u l r { 0 , 1 }   i S D , j S C , l L , r R , u U
Equations (24)–(41) are the same equations as Equations (5)–(16) and Equations (18)–(23) in the 4-index formulation. In this problem, the size of | L | is problem dependent, and an increase in the number of routes results in an exponential increase in the execution time of the problem. The minimum size of | L | equals to the size of | U | ; the maximum size can be calculated according to any feasible solution that the problem solver decides. However, it is preferable to use solutions that connect the squares (horizontally or vertically) with minimum turns.

3. Methodology

The 4-index and 5-index models were coded in GAMS and the Cplex solver was selected. To improve the algorithm and make it more effective, some extensions and techniques were found to be appropriate for our problem. Branch-and-Bound is the main algorithm used for solving MIP problems in Cplex. Using well-known techniques based on the model’s features can effectively reduce the execution time of the problem and improve the performance of MIP for effective collaborative decision-making in disaster management. The following subsections shortly describe the techniques that were effective for the models.

3.1. Solver Generated Cuts and Heuristics

In the early sixties, Gomory [35] introduced the procedure of fractional cuts. The procedure was considered impractical until a study [36] proved that Gomory’s cuts can be effectively distributed over different branches of the search tree in a branch and cut framework for a mixed 0–1 problem. In the present time, most optimizers use Gomory’s cuts for MILP problems. In the Cplex optimizer, the fraccuts option decides whether or not Gomory’s fractional cuts should be generated for the problem; and the parameters 0, 1 and 2 control the cuts to be generated automatically, moderately, and aggressively, respectively. In the case of lack of progress in the best bound, one effective solution uses more aggressive levels of cut generation to further tighten the formulation [37]. As initial observations confirm the lack of progress in the best-found-bound, parameter 2 (aggressive cut generation) was found to be more effective for the proposed models. According to the structure of the mathematical formulations, cover cuts are also useful. Therefore, Gomory’s fractional cuts and cover cuts were aggressively generated for the models.
GAMS (General Algebraic Modeling System) is a high level modeling language designed for programming the linear, nonlinear, and mixed integer optimization models. GAMS can support different forms of linear and nonlinear programming problems. The system has a language compiler and an integrated high-performance commercial solver, e.g., Cplex. Cplex is a famous commercial optimizer that can solve linear, mixed integer, quadratic, and quadratically constrained programming problems. GAMS provides access to the Cplex solver with a variety of options to interact with it and improve the solution procedure. Cplex uses several alternative algorithms such as primal simplex, dual simplex, barrier, or sifting algorithms. For mixed integer programming problems, Cplex uses the branch-and-cut algorithm.
Cplex takes advantage of different heuristic techniques to avoid tree pollution, increasing the diversity of the branch-and-bound search, achieving integer feasible solution in shorter time, and fastening the final optimality. Based on the characteristics of the proposed problem, two heuristic features from the different heuristic procedures offered by Cplex were utilized, i.e., local branching heuristic (LBHeur), and node heuristic (NHeur). The LBHeur was introduced by Fischetti and Lodi [38] and has been widely used by commercial optimizers. We can infer the following facts based on the ILOG Cplex explanations:
  • LBHeur attempts to enhance new incumbents found throughout an MIP search. The LBHeur algorithm will be appealed only if a new incumbent is identified. In cases where several incumbents are identified at a single node, the last one will be considered.
  • NHeur implements the techniques to find a feasible solution from the present node in branch and bound algorithm. The parameter HeurFreq restricts this offer. A positive number specifies the frequency of invoking NHeur (in the number of nodes).

3.2. Additional Constraints

User cuts or additional constraints are the polynomial constraints that strengthen the mathematical formulation and reduce the solution space. These cuts are not supposed to affect the feasible solutions space. The following constraints eliminate unfavorable fractional solutions and expedite the execution process:
i S D j S O v i j u l   i S j S O r R w i j u l r = 0   u U , l L
i S O j S D u U l L v i j u l = 0
Equation (42) imposes that the total number of squares that are to be visited by UAV u in route l right after leaving the depot is equal to the total number of squares allocated to UAV u in route l . Equation (43) ensures that the value is equal to 0 just before ending the tour at the depot. Equations (9), (42) and (43) are adapted from a previous study [39].
p i u y i 0   i S D , u U
Equation (44) indicates that if a UAV belongs to a depot, then the depot must be open.
i S D l L u U r R j S O w i j u l r | L |
Equation (45) ensures that the total number of arcs leaving the depots is less than or equal to the number of the available routes.
i S N l L u U r R | r d i r e c t j S N w i j u l r = 0
According to the logic of the problem and the grid-based decomposed map, the UAVs must travel directly through the nodes of the S E set, and it is applied in Equation (46). As mentioned earlier, only the residential squares must be covered by horizontal or vertical movements. In other words, in favor of the objective function value, and in order to find the minimal path, the UAVs should travel in the direct direction while passing through the nonresidential squares.
r R u U i S C g i u l r i S j S C u U r R w i j u l r 0   l L
Equation (47) ensures that the number of times a UAV enters a square in each route is more than or equal to the number of times the square is covered in that route.

3.3. Variable Branching Priority

The variable branching priority based on the mathematical formulation’s specifications is one of the most efficient techniques that speeds up the solution procedure and tightens the model. Without using this feature, the solver automatically decides the appropriate variable to be branch on. It is imperative to select a suitable priority among the existing variables depending on the variables’ dependence, relevance, and significance in the proposed mathematical model. In this study there are 4-index and 5-index mathematical formulations of a single problem. In this study, 4-index and 5-index mathematical formulations were used for a single problem. Based on the model’s characteristics and variables’ significance, the following priorities were suggested:
  • For the 4-index model, the variable branching priority order must be g i l r , x i j l r , w i j u l ,     v i j u l ,   p i u and y i .
  • The branching priority of the 5-index model should be g i l r ,     v i j u l ,   w i j u l r , p i u , and y i .

4. Computational Experiments and Results

In this section, some instances are designed to test the validity of the models and features proposed in Section 3. Based on the problem’s characteristics, it is assumed that the number of available UAVs, number of possible open depot squares, and maximum limit for the total traveling time of each UAV are known. Each test instance was named in the X-Y-Z-L format, where X refers to the total number of squares in the map, Y refers to the total number of residential squares, Z represents the number of potential UAV bases, and L is the number of available UAVs. The test instances are shown in Figure 4. For instance, in problem 36-11-2-3 map, where 36 is the total number of squares, 11 squares are residential areas, two squares are potential depots, and three represents the available UAVs.
It is assumed that each small square side is one in terms of length unit and the speed of the UAVs is also one in terms of speed unit. The mathematical models were coded in GAMS 24.7.3 and solved using the Cplex 12.6.3.0 solver. The models were run on a laptop with the configuration of Intel® Core™ i7–2620M CPU 2.70 GHz, RAM 8.00 GB, and windows 10 Enterprise operating system.
To evaluate the efficiency of the techniques mentioned in Section 3, each technique was considered alone in an individual run at the first step. Subsequently, the combination of efficient ones was used. All the problems were solved in a 5-h time limit, irrespective whether a feasible or optimal solution was found or not. The reason for the 5-h time limit is that no significant improvement would occur by increasing this limit. The calculation time increases exponentially by increase in the number of squares or the number of routes. Table 2 and Table 3 show the results of the 4-index and 5-index models, respectively, in a combination of techniques mentioned in Section 3.
According to the results presented in Table 2 and Table 3, it can be concluded that the 5-index model shows better solutions in terms of CPU time and the absolute gap. Furthermore, as previously anticipated, the combination of the proposed LP strengthening techniques offered better solutions in a shorter amount of time. The CPU time of the 5-index problem 16-4-2-4 was 11,320 s in the original model, which decreased to 479 s by adding the techniques. In addition, for problem 36-12-4-4, a feasible solution was not obtained in the original model; however, with a combination of techniques, a solution with 6.3% relative gap was acquired. Furthermore, while no feasible solution was found for the original model of problem 39-20-3-2 in the 5-h time limit, the optimal solution was found under the influence of the techniques in 10,554 s. Figure 5 depicts the optimal solutions for problems 39-20-3-2 and 36-11-2-3 test instances as examples.

5. Conclusions and Future Prospects

A multi-UAV and multi-tour CPP problem based on the grid map decomposition was investigated. MUTLCPP supports the application of post-earthquake CPP where high accuracy is required. Moreover, due to the speedy decrease in the survival rate in post-earthquake situations, the Minimax objective function was considered for the optimization problem. Two mathematical models of MUTLCPP were presented and coded in GAMS, and the 5-index model outperformed the 4-index formulation in terms of solution quality and execution time. The models were improved by additional constraints and other techniques described in Section 3. On the basis of the results of the test instances, it can be affirmed that the combination of the proposed techniques sped up the execution procedure and gained solutions with a lower gap in a shorter amount of time. In the small size instance of 16-7-3-2, the combination of techniques decreased the calculation time by 85% for the 5-index model but increased by 7% for the 4-index formulation. The results depicted in Table 2 and Table 3 show that the linear strengthening techniques are more effective for the 5-index model. Based on the results of Table 2 and Table 3, the proposed techniques decreased the CPU time by 85%, 95%, 94%, 96%, and 79% for the first five instances of the 5-index model and decreased the time by 79%, 94%, more than 91%, and 79% for the corresponding five instances of the 4-index model. For the further three instances, while the solution is not available in the original models, by the intervention of the linear strengthen techniques optimal solutions or very good feasible solutions were found. Generally, by comparing the results (Table 2 and Table 3), it is clear that the 5-index model performs much better that the 4-index formulation. Another conclusion based on the obtained results is that the solver generated cuts (Section 3.1) have less effect, and additional constraints (Section 3.2) have the maximum effect on decreasing the CPU time.
There are several interesting directions for further investigations. Some new valid inequalities can be added to the model to strengthen the MILP formulations. In addition, exact methods such as the lagrangian relaxation can be developed to find the optimal or near-optimal solutions to large real size problems. The most interesting subject for further investigations is designing a heuristic or meta-heuristic algorithm to solve large-scale problems of MUTLCPP. Each randomly generated individual solution in a heuristic algorithm can be represented in such a way that each cell takes an integer <6 indicating the UAV direction (set R). Finally, one can extend the problem by reflecting the map rotation possibility to test the different covering directions.

Acknowledgments

The authors would like to thank the anonymous reviewers for their valuable comments.

Author Contributions

Arman Nedjati conceived the problem, designed the mathematical models, and wrote the paper. Gokhan Izbirak, Bela Vizvari and Jamal Arkat revised the models and the manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Pesaresi, M.; Gerhardinger, A.; Haag, F. Rapid damage assessment of built-up structures using VHR satellite data in tsunami-affected areas. Int. J. Remote Sens. 2007, 28, 3013–3036. [Google Scholar] [CrossRef]
  2. Chang, K.T.; Wang, E.H. Developing procedures for post-earthquake structural evaluation by laser scanning techniques. Insight-Non-Destr. Test. Cond. Monit. 2012, 54, 562–567. [Google Scholar] [CrossRef]
  3. Szantoi, Z.; Malone, S.; Escobedo, F.; Misas, O.; Smith, S.; Dewitt, B. A tool for rapid post-hurricane urban tree debris estimates using high resolution aerial imagery. Int. J. Appl. Earth Obs. Geoinf. 2012, 18, 548–556. [Google Scholar] [CrossRef]
  4. Olsen, M.J.; Chen, Z.; Hutchinson, T.; Kuester, F. Optical techniques for multiscale damage assessment. Geomat. Nat. Hazards Risk 2013, 4, 49–70. [Google Scholar] [CrossRef]
  5. Kashani, A.G.; Crawford, P.S.; Biswas, S.K.; Graettinger, A.J.; Grau, D. Automated Tornado Damage Assessment and Wind Speed Estimation Based on Terrestrial Laser Scanning. J. Comput. Civ. Eng. 2015, 29, 4014051. [Google Scholar] [CrossRef]
  6. Jiang, S.; Friedland, C.J. Automatic urban debris zone extraction from post-hurricane very high-resolution satellite and aerial imagery. Geomat. Nat. Hazards Risk 2016, 7, 933–952. [Google Scholar] [CrossRef]
  7. Janalipour, M.; Mohammadzadeh, A. Building Damage Detection Using Object-Based Image Analysis and ANFIS From High-Resolution Image (Case Study: BAM Earthquake, Iran). IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2016, 9, 1937–1945. [Google Scholar] [CrossRef]
  8. Fernandez Galarreta, J.; Kerle, N.; Gerke, M. UAV-based urban structural damage assessment using object-based image analysis and semantic reasoning. Nat. Hazards Earth Syst. Sci. 2015, 15, 1087–1101. [Google Scholar] [CrossRef]
  9. Al-Wassai, F.A.; Kalyankar, N.V. Major Limitations of Satellite images. Available online: https://arxiv.org/ftp/arxiv/papers/1307/1307.2434.pdf (accessed on 29 November 2016).
  10. Grandoni, D. Advantages and Limitations of Using Satellite Images for Flood Mapping. Available online: http://www.copernicus.eu/sites/default/files/documents/User_uptake/Emergency_Events/Athens/03_Session_01_AdvantageAndLimitationsOfUsingSatelliteImagery.pdf (accessed on 29 November 2016).
  11. Qi, J.; Song, D.; Shang, H.; Wang, N.; Hua, C.; Wu, C.; Qi, X.; Han, J. Search and Rescue Rotary-Wing UAV and Its Application to the Lushan Ms 7.0 Earthquake. J. Field Robot. 2016, 33, 290–321. [Google Scholar] [CrossRef]
  12. Zelinsky, A.; Jarvis, R.A.; Byrne, J.C.; Yuta, S. Planning Paths of Complete Coverage of an Unstructured Environment by a Mobile Robot. In Proceedings of the International Conference on Advanced Robotics, Tokyo, Japan, 1–2 November 1993; pp. 533–538.
  13. Nedjati, A.; Vizvari, B.; Izbirak, G. Post-earthquake response by small UAV helicopters. Nat. Hazards 2015, 80, 1669–1688. [Google Scholar] [CrossRef]
  14. Kendoul, F. Survey of Advances in Guidance, Navigation, and Control of Unmanned Rotorcraft Systems. J. Field Robot. 2012, 29, 315–378. [Google Scholar] [CrossRef]
  15. Colomina, I.; Molina, P. Unmanned aerial systems for photogrammetry and remote sensing: A review. ISPRS J. Photogramm. Remote Sens. 2014, 92, 79–97. [Google Scholar] [CrossRef]
  16. Montoya-Torres, J.R.; López Franco, J.; Nieto Isaza, S.; Felizzola Jiménez, H.; Herazo-Padilla, N. A literature review on the vehicle routing problem with multiple depots. Comput. Ind. Eng. 2015, 79, 115–129. [Google Scholar] [CrossRef]
  17. Oberlin, P.; Rathinam, S.; Darbha, S. Today’s Traveling Salesman Problem. IEEE Robot. Autom. Mag. 2010, 17, 70–77. [Google Scholar] [CrossRef]
  18. Ho, H.-M.; Ouaknine, J. The Cyclic-Routing UAV Problem is PSPACE-Complete. In Foundations of Software Science and Computation Structures; Springer: Berlin/Heidelberg, Germany, 2015; pp. 328–342. [Google Scholar]
  19. Gendreau, M.; Laporte, G.; Semet, F. The Covering Tour Problem. Oper. Res. 1997, 45, 568–576. [Google Scholar] [CrossRef]
  20. Choset, H. Coverage for robotics—A survey of recent results. Ann. Math. Artif. Intell. 2001, 31, 113–126. [Google Scholar] [CrossRef]
  21. Galceran, E.; Carreras, M. A survey on coverage path planning for robotics. Robot. Auton. Syst. 2013, 61, 1258–1276. [Google Scholar] [CrossRef]
  22. De Carvalho, R.N.; Vidal, H.A.; Vieira, P.; Ribeiro, M.I. Complete coverage path planning and guidance for cleaning robots. In Proceedings of the 1997 IEEE International Symposium on Industrial Electronics, Guimaraes, Portugal, 7–11 July 1997; pp. 677–682.
  23. Li, Y.; Chen, H.; Joo Er, M.; Wang, X. Coverage path planning for UAVs based on enhanced exact cellular decomposition method. Mechatronics 2011, 21, 876–885. [Google Scholar] [CrossRef]
  24. Barrientos, A.; Colorado, J.; Cerro del, J.; Martinez, A.; Rossi, C.; Sanz, D.; Valente, J. Aerial remote sensing in agriculture: A practical approach to area coverage and path planning for fleets of mini aerial robots. J. Field Robot. 2011, 28, 667–689. [Google Scholar] [CrossRef]
  25. Torres, M.; Pelta, D.A.; Verdegay, J.L.; Torres, J.C. Coverage path planning with unmanned aerial vehicles for 3D terrain reconstruction. Expert Syst. Appl. 2016, 55, 441–451. [Google Scholar] [CrossRef]
  26. Wang, X.; Sun, T.; Li, D. Energy-optimal coverage path planning on topographic map for environment survey with unmanned aerial vehicles. Electron. Lett. 2016, 52, 699–701. [Google Scholar]
  27. Easton, K.; Burdick, J. A Coverage Algorithm for Multi-robot Boundary Inspection. In Proceedings of the 2005 IEEE International Conference on Robotics and Automation; Barcelona, Spain, 18–22 April 2005; pp. 727–734.
  28. Huang, W.H.; York, N. Optimal Line-sweep-based Decompositions for Coverage Algorithms. In Proceedings of the 2001 IEEE International Conference on Robotics & Automation, Seoul, Korea, 21–26 May 2001; pp. 27–32.
  29. Maza, I.; Ollero, A. Multiple UAV cooperative searching operation using polygon area decomposition and efficient coverage algorithms. In Distributed Autonomous Robotic Systems 6; Springer: Tokyo, Japan, 2007; pp. 221–230. [Google Scholar]
  30. Avellar, G.; Pereira, G.; Pimenta, L.; Iscold, P. Multi-UAV Routing for Area Coverage and Remote Sensing with Minimum Time. Sensors 2015, 15, 27783–27803. [Google Scholar] [CrossRef] [PubMed]
  31. Wang, X.; Li, D. Coverage path planning for UAVs in unknown directional regions. Int. J. Wirel. Mob. Comput. 2015, 8, 285–293. [Google Scholar] [CrossRef]
  32. Lemmens, M. Geo-information Technology—What It Is, How It Was and Where It Is Heading to. In Geo-Information; Springer: Dordrecht, The Netherlands, 2011; pp. 1–22. [Google Scholar]
  33. Greenwood, F. How To Make Maps With Drones. In Drones and Aerial Observation: New Technologies for Property Rights, Human Rights, and Global Development a Primer; New America: Washington, DC, USA, 2015; pp. 35–48. [Google Scholar]
  34. Falkner, E.; Morgan, D. Aerial Mapping: Methods and Applications; Lewis Publishers: Boca Raton, FL, USA, 2002. [Google Scholar]
  35. Gomory, R.E. An Algorithm for the Mixed Integer Problem; RAND Corporation: Santa Monica, CA, USA, 1960. [Google Scholar]
  36. Balas, E.; Ceria, S.; Cornuéjols, G.; Natraj, N. Gomory cuts revisited. Oper. Res. Lett. 1996, 19, 1–9. [Google Scholar] [CrossRef]
  37. Klotz, E.; Newman, A.M. Practical guidelines for solving difficult mixed integer linear programs. Surv. Oper. Res. Manag. Sci. 2013, 18, 18–32. [Google Scholar] [CrossRef]
  38. Fischetti, M.; Lodi, A. Local branching. Math. Program. 2003, 98, 23–47. [Google Scholar] [CrossRef]
  39. Karaoglan, I.; Altiparmak, F. A memetic algorithm for the capacitated location-routing problem with mixed backhauls. Comput. Oper. Res. 2015, 55, 200–216. [Google Scholar] [CrossRef]
Figure 1. The right polygon is covered by lesser waste (lesser number of turns) than the left one. (a) The vertical direction with 11 turns; (b) The horizontal direction with 4 turns.
Figure 1. The right polygon is covered by lesser waste (lesser number of turns) than the left one. (a) The vertical direction with 11 turns; (b) The horizontal direction with 4 turns.
Robotics 05 00026 g001
Figure 2. The gray cells indicate the cells that have been covered by the unmanned aerial vehicle (UAV), according to entrance and exit from the opposite sides. The picture depicts a feasible solution of grid decomposition-based coverage path problem (CPP).
Figure 2. The gray cells indicate the cells that have been covered by the unmanned aerial vehicle (UAV), according to entrance and exit from the opposite sides. The picture depicts a feasible solution of grid decomposition-based coverage path problem (CPP).
Robotics 05 00026 g002
Figure 3. Camera footprint.
Figure 3. Camera footprint.
Robotics 05 00026 g003
Figure 4. Test instance maps (the gray squares are assumed to be residential areas that should be covered by UAVs and squares with black triangles are potential UAV bases).
Figure 4. Test instance maps (the gray squares are assumed to be residential areas that should be covered by UAVs and squares with black triangles are potential UAV bases).
Robotics 05 00026 g004
Figure 5. The optimal solutions of problems 39-20-3-2 and 36-11-2-3. (a) There are two available UAVs and each belongs to one base; (b) There are three available UAVs and base number 15 is selected to be open.
Figure 5. The optimal solutions of problems 39-20-3-2 and 36-11-2-3. (a) There are two available UAVs and each belongs to one base; (b) There are three available UAVs and base number 15 is selected to be open.
Robotics 05 00026 g005
Table 1. The definition of sets, parameters, and variables.
Table 1. The definition of sets, parameters, and variables.
Sets:
S C The set of residential squares that must be covered
S D The set of potential AUV base (depot) squares
S E The set of nonresidential squares
U The set of available UAVs
L The set of routes
R The set of moving directions from one square to the other
Parameters:
t i j The travel time from square i to j
d i j The distance between square i and j
T D Total number of UAV bases (depots) that asked to be open
M T The possible flight time of each UAV
Variables:
w i j u l r Binary decision variable equals to 1, if UAV u exists from r side of square i to square j in route l , and 0 otherwise
w i j u l Binary decision variable equals to 1, if UAV u travels from square i to square j in route l , and 0 otherwise
v i j u l Positive integer variable determines how many nodes are left to cover in route l by UAV u , after visiting i and just before visiting j
y i Binary variable equals to 1, if potential depot i is open and 0 otherwise
x i j l r Binary variable equals to 1, if a UAV travels from r side of square i to square j in route l
p i u Binary variable equals to 1, if UAV u belongs to depot i and 0 otherwise
g i u l r Binary variable equals to 1, if a UAV enters from r side of i and exits from the opposite side in route l
g i l r Binary variable equals to 1, if a UAV enters from r side of i and exits from the opposite side in route l
TThe maximum mission time of UAVs
Table 2. Effects of techniques described in Section 3.1, Section 3.2 and Section 3.3 on the 4-index mathematical model.
Table 2. Effects of techniques described in Section 3.1, Section 3.2 and Section 3.3 on the 4-index mathematical model.
4-Index Model
Original Model3.1, 3.23.1, 3.33.2, 3.33.1, 3.2, 3.3
InstanceCPUResultsGap (%)CPUResultsGap (%)CPUResultsGap (%)CPUResultsGap (%)CPUResultsGap (%)
16-7-3-225421.3013621.3028121.3021621.3028421.30
16-4-2-418,00013.1515.2385013.150430013.150540013.150365013.150
25-11-2-2140024031024034324016224084240
27-12-2-218,00035.9835.11325280210428012062801618280
30-12-3-212,58726.320287726.320275426.320310726.320263926.320
36-11-2-318,000NA-18,000NA-18,000NA-18,000NA-18,000NA-
36-12-4-418,000NA-18,000NA-18,000NA-18,000NA-18,00024.459.4
39-20-3-218,000NA-18,000NA-18,000NA-18,000NA-15,669360
Table 3. Effects of techniques described in Section 3.1, Section 3.2 and Section 3.3 on the 5-index mathematical model.
Table 3. Effects of techniques described in Section 3.1, Section 3.2 and Section 3.3 on the 5-index mathematical model.
5-Index Model
Original Model3.1, 3.23.1, 3.33.2, 3.33.1, 3.2, 3.3
InstanceCPUResultsGap (%)CPU ResultsGap (%)CPUResultsGap (%)CPUResultsGap (%)CPUResultsGap (%)
25-5-3-388821.3046721.3078221.3015921.3012921.30
16-4-2-411,32013.150135913.150552713.15065013.15047913.150
25-11-2-285024028624018624022624048240
27-12-2-218,00030.8230.996628018,00030.2430.1570280559280
30-12-3-2687526.320247226.320383026.320295826.320142126.320
36-11-2-318,000NA-18,000NA-18,000NA-18,00021.313.718,00020.796.3
36-12-4-418,000NA-18,000NA-18,000NA-18,000NA-18,00022.8249.2
39-20-3-218,000NA-18,00042.8227.118,000NA-18,0003611.710,554360

Share and Cite

MDPI and ACS Style

Nedjati, A.; Izbirak, G.; Vizvari, B.; Arkat, J. Complete Coverage Path Planning for a Multi-UAV Response System in Post-Earthquake Assessment. Robotics 2016, 5, 26. https://doi.org/10.3390/robotics5040026

AMA Style

Nedjati A, Izbirak G, Vizvari B, Arkat J. Complete Coverage Path Planning for a Multi-UAV Response System in Post-Earthquake Assessment. Robotics. 2016; 5(4):26. https://doi.org/10.3390/robotics5040026

Chicago/Turabian Style

Nedjati, Arman, Gokhan Izbirak, Bela Vizvari, and Jamal Arkat. 2016. "Complete Coverage Path Planning for a Multi-UAV Response System in Post-Earthquake Assessment" Robotics 5, no. 4: 26. https://doi.org/10.3390/robotics5040026

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop