1. Introduction
Unmanned aerial vehicles (UAVs) and unmanned ground vehicles (UGVs), as mobile actuators, are being deployed in many application areas, including disaster relief [
1,
2,
3,
4,
5,
6], surveillance in war zones [
7], and energy-efficient data collection over wireless sensor networks (WSNs) [
8]. Energy consumption is one important design aspect for WSNs since battery replacement or recharging for sensor nodes (SNs) is typically inconvenient, costly, and sometimes impossible. By employing a UAV or UGV as a mobile data collector, each SN can directly send its sensed data to it.
However, new challenges arise when a UAV or UGV performs data collection missions alone. To ensure the safety of UAVs and compliance with UAV traffic rules, UAVs are usually specified with a minimum safe flight altitude and no-fly zones [
9]. SNs that cannot successfully upload their data to the UAV may exist, due to factors such as SNs’ insufficient energy and the UAV’s minimum flight altitude. We define these SNs as remote SNs. In addition, SNs may generate data on a regular basis [
10], which makes it important to minimize the mission completion time for ongoing data collection missions so that subsequent missions can begin early. Although the UGV can collect remote SNs’ data nearby, it will take more time to complete the mission due to the slow movement speed. The UAV and UGV can complement each other, for example, the UAV can move quickly from one place to another and have line-of-sight (LoS) communication links with SNs. On the other hand, the UGV can carry larger payloads, closer to the target, and provide the ability to intervene in the environment, deploy SNs and communication equipment, etc. [
11]. Therefore, we propose a UAV-UGV-enabled data collection system.
The path planning problem becomes a critical problem for the UAV-UGV-enabled data collection system. In addition, idle listening is one important cause of energy waste for many sensor network applications. To address this issue, the sleep/wake-up scheme has been introduced [
12], which is able to adjust the ratio between the sleeping and awake time of each SN to minimize idle listening. In this article, we consider a sensor to be associated with the device it is awakened by. If each SN is only woken up and transmits data when UAV-UGV is closer, then the energy consumed by the SNs is reduced. However, at this point, UAV-UGV would need to move further to get closer to the SNs, which would result in a longer completion time. There is a fundamental trade-off between the completion time and the energy consumption of SNs.
Accordingly, this paper focuses on the path planning problem for the UAV-UGV-enabled data collection system. Our work makes the following three contributions:
We propose a UAV-UGV-enabled data collection system with two cooperative strategies. We aim to minimize the mission completion time by jointly optimizing the UAV-UGV paths, as well as the SN association while ensuring that SNs can successfully upload their data with the remaining energy.
To tackle the formulated problem, we propose a simple scheme in that UAV-UGV only collects data while staying near or above SNs. The problem is reduced to finding the optimal stop-over above or near the SNs and the time duration at each staying location, as well as the serving order among these locations.
We propose a collaborative strategy selection algorithm, combining a multi-stage-based SN association and UAV-UGV path optimization algorithm, to solve the problem effectively, where techniques including convex optimization and genetic algorithm are adopted.
The rest of the paper is organized as follows. The next section presents a literature review. In
Section 3, we introduce the system model and present the problem formulation. In
Section 4, we present the proposed algorithm. In
Section 5, we present simulation results. Finally, conclusions and future research directions are outlined.
2. Literature Review
UAV-UGV collaboration systems are increasingly used in both military and civilian applications because they allow coordinated actions to leverage the strengths of each to achieve a common goal [
13]. The strong complementarity between UAVs and UGVs offers many new application prospects for UAV-UGV collaboration systems. Our focus is on cooperative path planning in sensor data collection. Path planning is the basis for the research of UAV-UGV-enabled data collection [
14].
Considering the heterogeneous and complementary nature of UAVs and UGVs, two types of UAV-UGV-enabled data collection approaches have been extensively studied in the existing literature. The first one is to play separate functional roles. For example, the UGV is set up as a charging station for UAVs to improve the flying range. In this case, the UAV needs to periodically visit the stationary power station acted by the UGV and replenish energy via a battery replacement system, or the UGV acts as a mobile charging station and the UAV needs to periodically rendezvous with the UGV for resupply [
15].
In [
16], the authors investigate the use of UGVs as mobile charging stations to solve the energy-constrained problem of UAVs. To avoid the introduction of UGVs as charging stations leading to long mission cycles, the combination of classical techniques and modern evolutionary approaches is used to minimize the distance traveled by UGVs while satisfying the UAV charging requirements and full node coverage. In [
17], the path planning problem of multiple UGVs as mobile charging stations for a UAV is investigated for a large-area distribution of sensors. An FCURP-MRS model is proposed, which ensures that UGVs can charge UAVs by generating multiple UGV and UAV paths to shorten the mission cycle and minimize the travel distance of UAVs. The authors of [
18] investigated a scenario where a UGV acts as a mobile charging station for multiple small UAVs by jointly optimizing the trajectories of the UGV and the UAV to minimize the maximum flight time of multiple UAVs, while ensuring that charging can be completed for multiple UAVs. The authors of [
19] considered the charging of a single energy-limited UAV by a UGV that can only travel on a defined grid road, with the UAV responsible for collecting data from sensors. A two-stage algorithm was used to solve this problem. Firstly, a set of charging station locations was found using the UAV range restrictions. Secondly, a mixed-integer linear programming problem was formulated to obtain the paths.
The second approach is to play the same functional role. There are significant differences in terms of detection accuracy, detection angle, and mechanical structure. By effectively coordinating UGVs and UAVs with the same functional role, data collection, inspection, and target tracking can be achieved. When performing data collection, reconnaissance, and tracking missions, a large area can be covered quickly with the UAV, and the UGV can get closer to the target and intervene in it.
In the data collection mission, the authors of [
20] proposed a data collection scheme that uses UGVs as mobile cluster heads in WSNs to assist the UAV to save data collection time and energy for SNs. The ground mobile cluster head is responsible for aggregating sensor data together and the UAV obtains the required information from it. Finally, the route of the ground mobile cluster head is optimized according to the network density. In [
21], a mixed-integer linear programming (MILP) algorithm was developed by considering the communication constraints between the UAV and UGV to ensure that the data collected by the UAV can be transmitted to the UGV instantaneously, which uses a branch-and-cut strategy to plan the paths of the UAV and the UGV. In [
22], a UAV-UGV cooperative environmental monitoring system is proposed, in which both the UAV and UGV are used as mobile sensors. The UAV is responsible for monitoring the airborne atmospheric quality and the UGV is responsible for monitoring the ground-based atmospheric quality, and the system has been extensively tested in field experiments. A heterogeneous system of UAVs and UGVs with the mission of monitoring the terrain on a given path is presented in [
23]. Both the UAV and UGV are equipped with cameras that monitor the terrain within their field of view, making terrain mapping more efficient and mapping data more accurate. Path planning for UAV-UGV collaboration systems can be well-generalized to the path length-based traveling salesman problem (TSP) [
24] and can be solved by some classical heuristic algorithms.
In summary, most researchers assume that UAVs can always successfully receive data from SNs, which is not true. To ensure the safety of UAVs and compliance with UAV traffic rules, UAVs are usually specified with a minimum safe flight altitude and no-fly zones [
9]. SNs that cannot successfully upload their data to the UAV may exist, due to factors such as SNs’ insufficient energy and the UAV’s minimum flight altitude. We define these SNs as remote SNs. In most studies, there is no joint mission assignment for the UAV and the UGV. In this paper, a UAV-UGV-enabled data collection system is studied, where data collection missions are cooperatively conducted by a UAV and a UGV to minimize the mission completion time by jointly optimizing the selection of the cooperative strategy, the SN association, and the UAV-UGV path.
3. Problem Description
As shown in
Figure 1, one UAV and one UGV are assigned to collect data from
SNs. Some SNs cannot upload data due to their limited transmission power and the limited safe flight altitude of the UAV. Two cooperative strategies are proposed, i.e., collaboration without information interaction, and collaboration with information interaction. In the first strategy, the UGV collects data from remote SNs (i.e., the SNs that cannot upload data to the UAV) as well as some normal SNs (i.e., the SNs that can upload data to the UAV), while the UAV only collects data from some normal SNs. Then, they carry the data back to the data center (DC) without interacting with each other. In the second strategy, the UGV only collects data from remote SNs, while transmitting the collected data to the UAV at a data interaction point, then the data are carried back to the DC by the UAV. The goal is to minimize the mission completion time.
3.1. Problem Assumptions
- (1)
The position of SNs, the remaining energy, and the amount of data to be uploaded are known before the mission is performed.
- (2)
To ensure the safety of the UAV, the UAV flies at a fixed safe altitude.
- (3)
The UGV and UAV depart from the DC with sufficient energy to complete the mission.
- (4)
The UAV and UGV collect the data in an orthogonal frequency channel, and SNs only wake up when they are scheduled for data transmission to save energy.
3.2. Problem Models
The notations that appear in the model are provided in
Table 1.
The positions of the UAV and the UGV at the time slot
are denoted by
and
, respectively. Then, the path of the UAV and the UGV can be denoted as
and
. In addition, the deployment position of SNs is known in advance, and the coordinates of SN
are expressed as
. Assume that the channel between SN
and UAV is a LoS channel. The channel gain from SN
to UAV is:
where
denotes the channel power gain at a reference distance of 1 m, then the SN to UAV upload rate (bits/s/Hz) can be obtained as:
where
is additive Gaussian white noise (AWGN) power received by the receiver at the UAV and
is the path loss index. Similarly, the upload rate from SN
to the UGV and the transmission rate from the UGV to the UAV are:
The minimum energy required by the SN to transmit its data to the UAV, i.e., the energy consumed by the SN to upload data when the UAV is hovering above the SN is: , where . If , SN data can only be collected by the UGV.
Idle listening is one important cause of energy waste for many sensor network applications. To address this issue, the sleep/wake-up scheme has been introduced [
12], which is able to adjust the ratio between the sleeping and awake time of each SN to minimize idle listening. Define
. If SN
is awakened by
and transmits data to
,
, and inversely,
. Therefore, we can obtain
. Using
to denote the label of the access order of
, the access order can be determined as
. For example, if
,
, then the
’s access order is
. To ensure that the data can be uploaded with the remaining energy, the region of feasible staying locations for
can be obtained as:
3.3. Problem Formulation
The SN association and UAV-UGV path are optimized to minimize the mission completion time. The mission completion time is denoted by
. When strategy A is used,
, conversely,
. The problem can be formulated as:
The objective function (6) indicates that our goal is to minimize the time for data to reach the DC. Constraint (9) indicates that any SNs can only be associated with either the UAV or UGV. Constraints (10) and (11) indicate that the energy of the SNs is guaranteed to be sufficient to upload the data. This problem is NP-hard due to the presence of integer variables and the discrete nature of .
4. Proposed Solution
We propose a simple scheme that UAV-UGV only collects data while staying near or above SNs, termed as staying mode (S-mode). For this mode, to find the optimized stop-over above or near the SNs and the access order among all locations, we propose an efficient algorithm by leveraging the min–max multiple traveling salesman problem (min–max m-TSP) and convex optimization techniques.
Define . The mission completion time consists of the moving time and the collecting time. Since S-mode is used, the moving time and the collecting time are only related to the staying locations, and to minimize the moving time, both the UGV and the UAV move between staying locations at maximum speed. The moving time and the staying time can be obtained as ,, where represents the time used by to collect data from SN .
4.1. Two-Stage Optimization Algorithm for Strategy A
The problem is decoupled into two subproblems. In the first subproblem, the SN association and the access order are obtained by solving Equation (12). In the second subproblem, given the association and the access order obtained from the first subproblem, the staying locations, , are optimized to minimize the mission completion time.
4.1.1. Solving for the Association and the Access Order
In the first subproblem, given that
, then the problem can be formulated as follows:
The association and access order can be obtained by solving the min–max m-TSP, and although the problem is NP-hard, various algorithms exist to efficiently find high-quality approximate solutions (e.g., genetic algorithms) [
25].
4.1.2. Optimizing the UAV-UGV Path
Since
is a non-convex function, and the sum of a finite number of non-convex functions is still a non-convex function, therefore, Equation (6) is a non-convex optimization problem. To solve the problem, relaxation variables
are introduced.
Since the left-hand side of Constraint (16) is a convex function, Constraint (16) is a non-convex constraint. The left-hand side of the equal sign of Constraint (16) is a convex function, which can be subjected to a first-order Taylor expansion and then obtained as a concave lower bound [
26], which can be obtained by giving the local point
.
where
is a linear function that is both convex and concave. The equation holds at
, and
has the same gradient as
[
25]. For any given local point
and the lower bound expression in Equation (17), the problem is approximated by:
Since the objective function and constraint are convex constraints, Equation (20) is a convex problem, which can be efficiently solved using standard convex optimization tools such as CVX [
27]. The original non-convex problem can be solved by applying the SCA technique [
28] to iteratively optimize Equation (20), updating the local points
at each iteration until the objective function converges. The overall algorithm for strategy A is summarized in Algorithm 1.
Algorithm 1. Overall algorithm for strategy A |
1. Initialize ; 2. Solving (12) with a genetic algorithm, then obtain and ; 3. ,; 4. while (Obj()-Obj()) 5. Given , solve (20) and denote the optimal solution as ; 6. , ; 7. end while |
4.2. Three-Stage Optimization Algorithm for Strategy B
The association has been provided in strategy B,
. Then, the problem is decoupled into three subproblems. The first subproblem is to obtain the access order
. The second subproblem is to obtain the intersection location
. The access order and the intersection location are then found by iterative means. Then, the third subproblem is to optimize
and
. In strategy B, the mission completion time is:
4.2.1. Solving for the Association and the Access Order
The first subproblem is to obtain the access order by solving the TSP given . It can be solved directly by a variety of algorithms, including genetic algorithms.
4.2.2. Solving for Intersection Location
In the second subproblem, the intersection location of the UAV and the UGV is obtained by substituting the results found in the first subproblem. Since the left-hand side of Constraint (27) is a convex function, as in solving the problem (20), the relaxation variables,
, are introduced and a first-order Taylor expansion is performed on
to obtain
by giving the local point
. For any given local point
and concave function
, the problem is approximated as:
Since the objective function and constraint are convex constraints, Equation (28) is a convex problem, which can be solved efficiently using standard convex optimization tools.
4.2.3. Optimizing the UAV-UGV Path and Intersection Location
Finally, the optimal staying location
and the interaction point
are obtained by solving the third subproblem. The relaxation variables
and
are introduced and a first-order Taylor expansion is performed on
and
at the given local points
and
. We can obtain the following problem:
The objective function and constraints are convex, and the problem is convex. Equation (32) can be solved directly using convex optimization tools. The algorithm for strategy B is obtained and is shown in Algorithm 2.
Algorithm 2. Overall algorithm for strategy B |
1. , ; 2. while () 3. 4. while () 5. ; 6. ; 7. Solve TSP with a genetic algorithm to obtain the order of service ; 8. Substitute and obtain the interaction point by solving the convex problem (28) 9. if 10. ; 11. end if 12. ; 13. end while 14. ; 15. end while 16. Substitute and into (32), and obtain and . |
4.3. The Collaborative Strategy Selection Algorithm
Based on the results obtained in the previous two subsections, the overall algorithm for solving Equation (6) is proposed. By solving Equation (12) to obtain
and
, if
, the UAV need not receive data from the UGV, and strategy A is adopted, where
is the time taken by the UGV to transmit the data to the UAV hovering above the UGV; conversely, if
and
, then strategy B is adopted. The overall algorithm for Equation (6) is shown in Algorithm 3.
Algorithm 3. Overall algorithm |
1. Initialize ; 2. Solving (12) with a genetic algorithm, obtain and ; 3. if 4. Execution of Algorithm 1. 5. else 6. Execution of Algorithm 2. 7. end if |
5. Simulation and Results
In this section, the performance of the proposed algorithm is evaluated. K = 15 SNs were uniformly and randomly distributed in a square area with a side length equal to 0.8 km. It is assumed that all SNs have the same transmit power. Assume that the remaining energy of the remote nodes is
and the sufficient energy of the remaining SNs is
. For comparison, two strategies are simulated in this paper. The main parameters are shown in
Table 2.
To demonstrate the effectiveness of our proposed scheme, we compared it to three benchmarks, namely the minimum staying time benchmark, the fixed interaction benchmark, and the non-synergistic benchmark.
In the minimum staying time benchmark, the UAV/UGV moves to the staying locations of its associated SNs with the maximum speed by solving the min–max m-TSP and stays there for a sufficient duration to complete the data collection.
In the fixed interaction benchmark, the interaction point area is set to be midway between the center of the remote SNs and the center of the normal SNs.
In the uncooperative benchmark, the UGV is only responsible for collecting data from the remote SNs and bringing the data back itself.
Figure 2 shows the UAV-UGV paths and associations for missions with different data sizes. It can be observed that as the
increases, the UAV needs to spend more time on data collection as the SN requires more communication resources, when the advantage of the UGV arriving close to the data collection is more obvious, as expected. For example, compare
Figure 2a,c. In
Figure 2a, the SN has fewer data to upload, and the time difference between the UAV and the UGV for data collection is small. The mission completion time depends more on the moving time. In
Figure 2c, the SN has more data to upload, the time difference between the UAV and the UGV for data collection is larger, and the mission completion time depends more on the data collection time. Therefore, when the amount of data is small, the UAV is responsible for more nodes. Otherwise, make the UGV responsible for more nodes. Similarly, compare
Figure 2b,d. In
Figure 2b, it is important to try to avoid the disadvantage of the UGV in terms of movement speed, and therefore to make the distance traveled by the UGV as small as possible, allowing the UAV to move further to receive the data from the UGV and then bring the data back. In
Figure 2d, the UGV will collect the data in less time, compensating for the lack of movement speed, while the UAV takes time to collect the data and therefore does not need to UAV to receive the data from the UGV, and instead has the UGV wait on the return path of the UAV.
Figure 3 depicts the mission completion time versus the amount of data uploaded by SNs. It can be observed that as the amount of uploaded data increases, the mission completion time increases. When
Mbits, the performance of the proposed solution is close to that of strategy B, while when
Mbits, the performance of the proposed scheme is close to that of strategy A. This is to be expected. Combine this with the trajectory analysis in
Figure 2. When
Mbits, the mission completion time is more dependent on the moving time. Comparing
Figure 2a,b, to reduce the disadvantage of the slow UGV movement speed, it is important to make the distance traveled by the UGV as small as possible, so when executing strategy A, only the UGV is allowed to collect data from the remote SNs. When executing strategy B, the UGV is made to move as small a distance as possible. When
Mbits, the amount of data to be uploaded by the SN is high, and the mission completion time is more dependent on the data collection time. Comparing
Figure 2c,d, to reduce the UAV’s disadvantage in data collection, the UGV has time to collect data from normal SNs after the remote SNs are collected. In strategy B, the UGV has more time to move to a position that is conducive to reducing the distance traveled by the UAV after collecting data from remote SNs. Since it is more advantageous for the UGV to be nearby for data collection, the use of strategy A to allow the UGV to collect data from more SNs yields better results. Compared with the uncooperative benchmark scheme, the proposed scheme reduces the task completion time by 36% on average.
Figure 4 depicts the mission completion time versus the number of insufficient-energy SNs. Strategy A is preferred when the number of remote nodes is low when the UGV must access fewer SNs and the UGV can collect from more SNs. When the number of remote SNs is higher, strategy B is preferred, because the UGV must access more SNs, and the UAV can quickly complete its mission. Therefore, try to keep the UGV execution time as low as possible and let the UAV receive data from the UGV. As the number increases again, the amount of data collected by the UGV increases, and the time to transmit the data to the UAV exceeds that for the UGV to bring back, so strategy A is chosen as superior. Moreover, when the number of remote SNs is low, the mission completion time of strategy B tends to decrease as the number of remote SNs increases. This is because the UGV will finish collecting the data it is responsible for in a short time and then move to the interaction point to wait for the UAV. After all, the UAV is responsible for more SNs. The waiting time of the UGV is enough to collect data from normal SNs. As the number of remote SNs increases and the number of SNs responsible for the UAV decreases, the time for the UAV to reach the intersection will advance, while the UGV can still reach the intersection before the UAV. As the number of remote SNs increases, the mission completion time will have a decreasing process. Compared with the uncooperative benchmark scheme, the proposed scheme reduces the task completion time by 23% on average.
Figure 5 depicts the relationship between UAV energy consumption and the amount of data uploaded by SNs. When
Mbits, the energy consumption of the UAV in strategy B is smaller than that in strategy A. This is because the UAV has an advantage over the UGV in saving more time when the amount of data to be collected is less, so the UAV will collect data from more SNs. When
Mbits, the energy consumption of the UAV in strategy B is greater than that in strategy A. This is because, when the amount of data to be collected is larger, the UGV takes less time, so it will let the UGV move further to collect data from more SNs. The solution proposed in this paper allows the UGV/UAV to take full advantage of its advantages by choosing the strategy to speed up the mission completion time at the cost of consuming more energy of the UAV or the UGV.
Figure 6 depicts the relationship between the degree of aggregation of the remote nodes and the mission completion time. Where the degree of aggregation of the remote nodes is represented by the average distance from the remote nodes to the geometric center of all the remote nodes, the result is obtained by randomly taking 20% of the energy-deficient SNs for simulation several times and then taking the average value. When the remote nodes are all distributed in a small area, the mission completion time for strategy A is shorter. As the degree of aggregation decreases, the UGV takes more time to move between the remote nodes. When the time taken by the UGV to perform data collection is close to the time taken by the UAV, strategy B is chosen to allow the UAV to fly further to receive data from the UGV. Compared with the uncooperative benchmark scheme, the proposed scheme reduces the task completion time by 33% on average.