Next Article in Journal
Sparse Adversarial Video Attacks via Superpixel-Based Jacobian Computation
Next Article in Special Issue
NC-OFDM Satellite Communication Based on Compressed Spectrum Sensing
Previous Article in Journal
Electrochemical Aptasensors for Antibiotics Detection: Recent Achievements and Applications for Monitoring Food Safety
Previous Article in Special Issue
Reliable and Energy-Efficient LEO Satellite Communication with IR-HARQ via Power Allocation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Shooting Utility Maximization in UAV-Assisted Wireless Camera Sensor Networks

1
College of Electronic and Information Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China
2
College of Computer Science and Technology, Nanjing University, Nanjing 210023, China
*
Authors to whom correspondence should be addressed.
Sensors 2022, 22(10), 3685; https://doi.org/10.3390/s22103685
Submission received: 7 April 2022 / Revised: 6 May 2022 / Accepted: 10 May 2022 / Published: 12 May 2022
(This article belongs to the Special Issue Integration of Satellite-Aerial-Terrestrial Networks)

Abstract

:
Recently, wireless camera sensor networks (WCSNs) have entered an era of rapid development, and WCSNs assisted by unmanned aerial vehicles (UAVs) are capable of providing enhanced flexibility, robustness and efficiency when executing missions such as shooting targets. Existing research has mainly focused on back-end image processing to improve the quality of captured images, but it has neglected the question of attaining quality images on the front-end, which is significantly influenced by the location and hovering time of the UAV. Therefore, in this paper, we conceive a novel shooting utility model to quantify shooting quality, which is maximized by simultaneously considering the UAV’s trajectory planning, hovering time and shooting point selection. To expound further, we prove the submodularity of the utility function, whereby the original problem can be expressed as a submodular maximization problem with path constraints, and we propose a utility-cost ratio (UCR) algorithm to maximize shooting utility through two-level optimization. Then, by using the relaxation of the cost function, we analyze the gap between the proposed algorithm and the optimal algorithm (OPT) and prove that the UCR algorithm has a bi-criterion approximation ratio of 1 1 / e / 2 . Simulation results show that the algorithm outperforms both the random algorithm (RAN) and the maximum shooting utility point selection algorithm (MSU) in terms of shooting utility and time utilization efficiency, improving shooting utility by 51% and 21% compared to the RAN and MSU algorithms, respectively, and achieving at least 88.2% of the OPT algorithm in terms of time utilization efficiency.

1. Introduction

In recent years, wireless camera sensor networks (WCSNs) have attracted substantial attention from academia and industry, as they can obtain high-resolution target information by providing videos and images [1,2,3]. WCSNs are capable of supporting a wide range of applications, such as traffic monitoring [4,5], building inspection [6] and crowd protection [7], with the aid of camera shooting. However, setting up fixed camera sensors for WCSNs may require extensive infrastructure implementation, resulting in cost inefficiencies.
Fortunately, thanks to the mobility, flexibility and economic feasibility of unmanned aerial vehicles (UAVs), these devices constitute promising candidates for shooting images for WCSNs when the UAVs are equipped with camera sensors [8,9,10,11]. As shown in Figure 1, when shooting and monitoring urban buildings, a traditional fixed camera sensor network cannot cope with challenges such as high altitude or panoramic shooting, whereas UAVs can move toward targets for multi-angle shooting, which greatly improves the efficiency of shooting tasks.
Substantial efforts have been made in the research of UAV-assisted WCSNs, and the existing research mainly focuses on conserving system resources and improving image quality. First, in terms of conserving system resources, some works are mainly devoted to the question of how to reduce the energy and power consumption of UAVs. For example, Gao et al. [12] designed a network of UAV-assisted camera sensors to detect air quality. In order to minimize the energy consumption of the UAVs, they optimized the flight altitude of the UAVs and their two-dimensional coordinates when flying with the aim of ensuring the accuracy of air quality indicators. Ji et al. [13] investigated the problem of using cooperative UAVs in reconnaissance missions to achieve full coverage of targets. They achieved fairness in energy consumption by planning the trajectory of multiple UAVs. Zhan et al. [14] considered the energy consumption problem when using UAVs to collect data from sensor nodes. They jointly optimized the wake-up time of sensor nodes and the trajectory of the UAVs to minimize the maximum energy consumption of all sensor nodes.
In addition, some works mainly focus on improving image quality. Considering the problem of low illumination in UAV pedestrian detection at night, Wang et al. [15] proposed a block-matching and 3D-filtering method to improve the low-illumination image quality. Yuan et al. [16] proposed a seam-cutting strategy based on UAV image mosaics to reduce image distortions and artifacts. Zhang et al. [17] proposed a new real-time pure image mosaic technology for UAVs. They synthesized aerial images through mosaic transformation to obtain wide-angle panoramic images quickly and accurately. Wang et al. [18] considered the scenario of blurred images due to insufficient power when UAVs shoot high-frequency images and proposed a nonlinear image enhancement method to improve the quality of blurred images from UAV aerial photography. However, these studies all focused on back-end image processing, and the influence of the flight trajectory and the hovering time of the UAV on shooting was not considered at the front-end.
As far as we know, most of the existing research on UAV-assisted WCSNs focuses on the back-end processing of UAV-shot images. However, there is little consideration given to the front-end, such as the influence of the shooting time and the hovering position of the UAV on the shot image. With respect to UAV-assisted data acquisition, we know that the hovering position and hovering time of UAVs have a significant influence on the information collected [19,20]. Based on this principle, in this paper, we conceive the concept of a shooting utility to quantify the amount of information obtained. Then, the UAV’s trajectory planning, hovering time and shooting point selection are optimized to maximize shooting utility. The main contributions of this work are as follows:
  • We conceive a novel shooting utility model to quantify shooting quality and then address the problem of maximizing shooting utility. We show that the elaborated shooting utility function obeys the rule of submodularity, which is beneficial for transforming the original problem into a submodularity maximization problem with path constraints.
  • We formulate a utility-cost ratio (UCR) algorithm to maximize shooting utility. By using the relaxation of the cost function, we analyze the gap between the proposed algorithm and the optimal algorithm (OPT) and prove that the UCR algorithm has a bi-criterion approximation ratio of 1 1 / e / 2 .
  • We conduct numerous simulations to analyze the performance of the UCR algorithm. The results demonstrate that the algorithm outperforms both the random algorithm (RAN) and the maximum shooting utility point selection algorithm (MSU) in terms of shooting utility and time utilization efficiency, improving shooting utility by 51% and 21% compared to the RAN and MSU algorithms, respectively, and achieving at least 88.2% of the OPT algorithm in terms of time utilization efficiency.
The rest of this paper is organized as follows. In Section 2, we describe the model of the UAV-enabled shooting system in detail. In Section 3, we analyze the problem and put forward a solution. Section 4 provides the simulation results and performance evaluation. Finally, we summarize this paper in Section 5.

2. System Model

We consider a UAV-enabled shooting mission scenario, as shown in Figure 2. Assume that we have a total of M targets O = { o 1 , o 2 , , o m } on the ground that must be shot. A UAV equipped with a camera is capable of shooting an area with radius R. Since the ground targets are widely distributed, it is expensive, time-consuming and difficult for the UAV to fly over each target for its shooting mission. Therefore, we adopt an overlapping clustering approach [21,22] to group the ground targets into different clusters to accomplish the shooting mission efficiently, and the cluster head set is denoted as C = { c 1 , c 2 , , c n } . By doing so, the UAV is capable of moving to the position above the cluster head to complete the shooting of members in the cluster, which means that the UAV can capture multiple targets at a single shooting point, and a target can be captured at multiple shooting points. We study the scenario of a UAV flying at altitude h with a fixed speed v a . The UAV starts at the service station s 0 and returns to s 0 after completing the shooting tasks. The major notations used in this paper are summarized in Table 1.

2.1. Energy Consumption Model

We divide the energy consumption model into two categories: one is motion energy cost, and the other is hovering energy cost. The motion energy is related to the flight distance of the UAV between clusters, while the hovering energy is related to the hovering time of the UAV at each cluster head. We can use ( x ( c i ) , ( y ( c i ) ) to denote the location coordinates of the cluster head c i ; then, the Euclidean distance between two cluster heads can be expressed as
d ( c i , c i + 1 ) = x ( c i + 1 ) x ( c i ) 2 + y ( c i + 1 ) y ( c i ) 2 .
We use the set K to represent the cluster heads over which the UAV chooses to hover; then, a new selected cluster head set K C can be formed and used to obtain the following motion energy cost
E m = d ( k i , k i + 1 ) L TSP ( K ) p m d ( k i , k i + 1 ) η v a ,
where d ( k i , k i + 1 ) represents the distance between two adjacent points in the set K , L TSP ( K ) is a closed path for the UAV that starts at and returns to the service station s 0 , p m is the minimum motion power consumption of the UAV and η is the UAV’s power efficiency. We use the parameter λ to represent p m / η v a . The UAV only visits each cluster head in K once.
The UAV’s hovering energy consumption is related to the hovering time and various parameters of the UAV. We use t i to denote the time that UAV hovers at the cluster head c i . Then, we denote the hovering energy consumption for cluster head c i as
E ( c i ) = ( m g ) 3 2 π ρ r u 2 n u t i ,
where m, g and ρ are, respectively, the mass of the UAV, the gravity of the earth and the air density. The radius of the rotor and the number of rotors are expressed by r u and n u , respectively. We use parameter μ to represent ( m g ) 3 / 2 π ρ r u 2 n u . For the selected cluster head set K , the total hovering energy consumption can be expressed as
E h = c i K E ( c i ) = c i C ( m g ) 3 2 π ρ r u 2 n u t i a i ,
where a i is a binary variable used to indicate whether the UAV chooses to hover above the cluster head c i for shooting. For example, a i is 1 if c i is selected; otherwise, it is 0. Thus, the total cost for any selected cluster head set K can is given by
E ( K ) = E m + E h = d L T S P ( K ) p m d η v a + c i C ( m g ) 3 2 π ρ r u 2 n u t i a i = d L T S P ( K ) λ d + c i C μ t i a i .

2.2. Shooting Utility Model

As the shooting time is related to acquired information, we formulate the shooting utility model to quantify the amount of information we obtain. For the shooting utility model, we first define the shooting utility weight p i j , that is, the amount of information that can be obtained per unit time by shooting a cluster member o j above the cluster head c i . Then we find that the shooting utility of the UAV flying above the cluster head c i on target o j is
q ( o j , c i ) = p i j t i j ,
where t i j is the shooting time allocated to the target o j when the UAV hovers over the cluster head c i . According to overlapping clustering, a target may belong to multiple clusters, and the utility of a target contributed by multiple clusters is additive. That is to say, for any given set K C , the total shooting utility for target o j can be expressed as
q K ( o j ) = c i K q ( o j , c i ) = c i C p i j t i j a i .
Furthermore, considering the varying importance of each target, the maximum amount of information that can be captured also varies, so that there is a maximum shooting utility Q j m defined for each target. When the shooting time is greater than a predefined threshold, shooting utility remains equal to Q j m . Thus, we can obtain the complete shooting utility of the target o j as
Q ( K , o j ) = min q K ( o j ) , Q j m .
In order to simplify the model, in this paper, we do not consider the correlation between targets or the information redundancy when shooting the same target from different positions. We think that shooting utility is a simple addition quantity, but in this work, we consider it according to the feature distribution of computer vision and use information theory modeling to solve this problem [23].

3. Problem Formulation

The total shooting utility is the sum of the shooting utility of UAVs for all members in the selected clusters, which can be expressed as
Q ( K , T ) = j = 1 m Q ( K , o j ) = j = 1 m min q K ( o j ) , Q j m = j = 1 m min c i C p i j t i j a i , Q j m ,
in which T = t i j | i = 1 , , n ; j = 1 , , m represents the shooting time allocation of the UAV to targets in different clusters. As the sum of shooting time assigned to cluster members cannot be greater than the hover time of the UAV at the cluster head position, we have
o j O t i j a i t i , c i C .
At the same time, considering the energy constraints of the UAV, the total energy consumption cannot exceed its maximum energy consumption, which can be described as
E ( K ) E max , K C ,
where E max is the maximum energy consumption of the UAV.
As defined above, our goal is to find a closed path for the UAV, that is, to find a cluster head subset K that maximizes the shooting utility of the UAV on a target in the network under the conditions expressed in Equations (10) and (11). Thus we can describe our problem as
P 1 : max a i , t i j Q ( K , T ) s . t . o j O t i j a i t i , c i C , E ( K ) E max , K C .
The cluster head set K and time allocation strategy T can be found by optimizing a i and t i j .
According to the above definition, the formulated problem consists of a two-layer optimization, where the optimization objective at the bottom layer is cluster head selection and time allocation, and the top layer performs trajectory planning for the energy-constrained UAV based on the selected cluster heads. The two layers of optimization are interrelated and cannot be handled separately to obtain the global solution. If the cluster head is selected without considering trajectory planning, a lot of motion energy is consumed. If the appropriate cluster head is not considered in trajectory planning, the shooting utility cannot be maximized.
When considering only shooting utility without considering the UAV energy constraint, we can reduce the problem P 1 to a 0-1 backpack problem, as follows:
max a i , t i j Q ( K , T ) s . t . o j O t i j a i t i , c i C ,
The 0-1 backpack problem is a classic NP-hard problem. When we further consider the energy consumption of the UAV, the problem can be modeled as a traveling salesman problem (TSP). It is intractable to attain the traveling cost E ( K ) , as it needs to find a closed TSP tour L TSP ( K ) , which is also an NP-hard problem. Therefore, the formulated optimization problem P 1 is coupled by two NP-hard problems.

4. An Effective Approximation Algorithm: UCR Algorithm

In this section, we first prove the submodularity of the utility function, based on which we can formulate the problem as a submodular maximization problem with path constraints and propose an efficient approximation algorithm, that is, a UCR, to maximize the shooting utility of the UAV.

4.1. A Proposed UCR Algorithm

In order to solve our problem, we first prove that our function has three properties: monotonicity, nonnegativity and submodularity. These properties are beneficial because they allow us to transform our problem into a submodule maximization problem with path constraints. For convenience of expression, we construct a function G ( K ) to represent our shooting utility function. We obtain the equational relation G ( K ) = Q ( K , T ) , which means that when the time allocation strategy is T , the total shooting utility is G ( K ) . Then we prove that the function G ( K ) has the above three properties.
Definition 1.
For a given element set Φ, a real set function is defined as f: 2 Φ R . f is considered to be monotonous, nonnegative and submodular if and only if f satisfies the following conditions, respectively:
  • f ( A ) f ( B ) for all A B Φ or equivalently: f ( A x ) f ( A ) > 0 for all A Φ and x Φ \ A (monotonicity);
  • f ( ) = 0 and f ( A ) 0 for all A Φ (nonnegativity);
  • f ( A ) + f ( B ) f ( A B ) + f ( A B ) for any A , B Φ or equivalently: f ( A x ) f ( A ) f ( B x ) f ( B ) for all A B Φ , x Φ \ B (submodularity).
Theorem 1.
The constructed function G ( K ) is monotone, nonnegative and submodular.
Proof 
The detailed procedure is shown in Appendix A.    □
On the basis of proving that G ( K ) is a submodule function, we design an effective algorithm that considers two-level optimization to solve the submodule maximization problem with path constraints by referring to the idea in [24,25].
For the cluster head c i in C , we sort the ground targets in order of decreasing utility weights. The UAV then greedily allocates the shooting time to each target in this order until each target rises to the utility threshold or the UAV has no remaining time to allocate at the cluster head c i position. That is to say, before shooting utility reaches the threshold, we tend to allocate more time to shoot targets with higher utility weights. Furthermore, we need to take into account the energy constraints of the UAV. In each iteration, we use the nearest neighbor rule to calculate the energy consumption of the UAV. The core of this algorithm is that for a given set K , we need to add a new cluster head c i with the maximum utility-cost ratio to the current set. The newly added cluster head can be represented as
c i = arg max c C \ K i 1 G ( K i 1 + c ) G ( K i 1 ) E ^ ( K i 1 + c ) E ^ ( K i 1 ) ,
where E ^ ( · ) is an approximate cost function of E ( · ) . The reason for this substitution is that we observe that the optimal cost function cannot be calculated in polynomial time, so we use an effective approximate cost function in its place. This may influence the quality of our results. Therefore, in the next section, we prove the approximation ratio of the algorithm.
The detailed steps of the UCR algorithm can be found in Algorithm 1. In each iteration, we use the greedy method to select a cluster head with the largest utility-cost ratio. Using this iterative method, we can continuously add new cluster heads to the set K to obtain higher shooting utility until the energy consumption constraint of the UAV is broken.

4.2. Approximation Analysis

One of the major limitations of prior works on submodular maximization with routing constraints is that the cost function was usually assumed to be a submodule. However, in many practical problems, the optimal cost function is not submodular. To solve this problem, we take advantage of the natural relaxation of the cost function, the β -submodularity [26], and the approximation of our algorithm is affected by the β -submodularity.
Definition 2.
For the energy consumption cost function E, β-submodularity is defined as
β = min c min A , B : A B E ( A + c ) E ( A ) E ( B + c ) E ( B ) .
Algorithm 1: Utility-Cost Ratio Algorithm
Input: 
Cluster head set C = { c 1 , c 2 , , c n } , target set O = { o 1 , o 2 , , o m } , energy constraint E ^ max , shooting utility weight p i j .
Output: 
Selected cluster heads K C , time allocation T .
  1:
Initialize C C , T , K 0 , E ^ ( K 0 ) 0 , i 1 , K = arg max G ( c ) | c C , E ^ ( c ) E max ;
  2:
while  C do
  3:
    for  c C  do
  4:
        Calculate G ( K i 1 + c ) and G ( K i 1 ) with corresponding time allocation scheme;
  5:
        Use the nearest neighbour rule to calculate the energy consumption E ^ ( K i 1 + c ) and E ^ ( K i 1 ) ;
  6:
    end for
  7:
     c i = arg max c C \ K i 1 G ( K i 1 + c ) G ( K i 1 ) E ^ ( K i 1 + c ) E ^ ( K i 1 ) ;
  8:
    if  E ^ ( K i 1 + c i ) E max  then
  9:
         K i K i 1 + c i , i i + 1 , T T c i ;
10:
    end if
11:
     C C \ c i ;
12:
end while
13:
if  G ( K ) G ( K i 1 )   then
14:
      K K ;
15:
else
16:
       K K i 1 ;
17:
end if
18:
Output K C , T
In addition, for the cost function E, we need another concept curvature to help prove the approximate ratio, which essentially measures the linear deviation.
Definition 3.
For the cost function E in the subsets of Ψ, we can define the total curvature K ¯ e as
K ¯ e = 1 min c Ψ E ( Ψ \ c + c ) E ( Ψ ) E ( c ) .
Definition 4.
We introduce another variable N e , which is the largest set of feasible solutions for our problem in the set Ψ, defined as
N e = max | K | : E ( K ) E max .
In the UCR algorithm, the initial set is K 0 = 0 ; through iteration, we can continuously add new cluster heads to the set K , thus generating a series of intermediate sets K 1 , . . . , K s until the energy consumption constraint of UAV is broken. We assume that the s + 1 iteration does not satisfy the constraint, and then the iteration stops.
Lemma 1.
For i = 1 , . . . , s + 1 , it holds that
G ( K i ) 1 l = 1 i ( 1 E ^ ( K l ) E ^ ( K l 1 ) E max ) G ( K ˜ ) .
Proof. 
For i = 1 , . . . , s + 1 ,
G ( K i ) G ( K i 1 ) E ^ ( K i ) E ^ ( K i 1 ) E max G ( K ˜ ) G ( K i 1 ) ) ,
where E ^ is a β submodular ψ ( n ) -approximation of the β -submodular cost function E, and K ˜ is the optimal solution of max G ( K ) | E ( K ) β E max ( 1 + β ( N e 1 ) ( 1 K ¯ e ) ) ψ ( n ) N e [26].
Thus for i = 1 , we can obtain
G ( K 1 ) E ^ ( K 1 ) E ^ ( K 0 ) E max G ( K ˜ ) .
For i > 1 , we can obtain
G ( K i ) = G ( K i 1 ) + [ G ( K i ) G ( K i 1 ) ] G ( K i 1 ) + E ^ ( K i ) E ^ ( K i 1 ) E max ( G ( K ˜ ) G ( K i 1 ) ) = 1 E ^ ( K i ) E ^ ( K i 1 ) E max G ( K i 1 ) + E ^ ( K i ) E ^ ( K i 1 ) E max G ( K ˜ ) 1 E ^ ( K i ) E ^ ( K i 1 ) E max 1 l = 1 i ( 1 E ^ ( K l ) E ^ ( K l 1 ) B E max ) G ( K ˜ ) + E ^ ( K i ) E ^ ( K i 1 ) E max G ( K ˜ ) = 1 l = 1 i ( 1 E ^ ( K l ) E ^ ( K l 1 ) E max ) G ( K ˜ ) .
Theorem 2.
The UCR algorithm can achieve a bi-criterion approximation ratio of 1 1 / e / 2 .
Proof. 
From Lemma 2, we can obtain
G ( K s + 1 ) 1 l = 1 s + 1 ( 1 E ^ ( K l ) E ^ ( K l 1 ) E max ) G ( K ˜ )
From the fact that the s + 1 iteration violates the UAV energy consumption constraint, we have E ^ ( K s + 1 ) > E max . Then we can obtain
G ( K s + 1 ) 1 l = 1 s + 1 ( 1 E ^ ( K l ) E ^ ( K l 1 ) E ^ ( K s + 1 ) ) G ( K ˜ )
For z 1 , . . . , z n R + such that z i = Z , 1 i = 1 n ( 1 z i / Z ) achieves minimum value at z 1 = . . . = z n = Z / n . Therefore, we have
G ( K s + 1 ) 1 l = 1 s + 1 ( 1 E ^ ( K l ) E ^ ( K l 1 ) E ^ ( K s + 1 ) ) G ( K ˜ ) 1 1 1 s + 1 s + 1 G ( K ˜ ) 1 1 e G ( K ˜ )
In addition, since we proved that G ( K ) is a submodular function in the above, we have G ( K s + 1 ) G ( K s ) G ( K s + 1 ) G ( K * ) , where K * = arg max K Ψ G ( K ) . Therefore, we can obtain
G ( K s ) + G ( K * ) G ( K s + 1 ) 1 1 e G ( K ˜ )
and
max G ( K s ) , G ( K * ) 1 2 1 1 e G ( K ˜ ) .
To sum up, the UCR algorithm has a bi-criterion approximation ratio of 1 1 / e / 2 .

5. Simulations and Evaluations

In this section, we simulate the system under different settings and evaluate our algorithm in terms of total shooting utility and time utilization efficiency. The overall shooting utility was introduced in the system model, and the time utilization efficiency can be obtained by dividing the total shooting time of the UAV for the target at the shooting point by the total hovering time, which can be expressed by the formula j = 1 m i = 1 n t i j / i = 1 n t i . By default, the task area is 500 m × 500 m in size, the numbers of ground targets and cluster heads are 40 and 10, respectively, and the maximum shooting utility per target is 220. Some other important parameters of the simulation are shown in Table 2 [27,28]. In each different parameter setting, we conducted 1000 simulations and took the average value to obtain the following experimental results.
In order to evaluate the performance of our proposed UCR algorithm, we compare it with the following three algorithms:
  • Random algorithm (RAN): Within the energy consumption constraint, the UAV randomly selects cluster heads for shooting.
  • Maximum shooting utility point selection algorithm (MSU): The essence of the MSU algorithm is to select the cluster head with the greatest shooting utility in each iteration. This process is repeated until the UAV’s energy consumption exceeds the UAV’s energy capacity or all cluster heads have been selected.
  • Optimal algorithm (OPT): We use the powerful optimization software LINGO to obtain the optimal solution to analyze the gap between our proposed algorithm and the optimal one. Because of the high computational complexity, we run it once for different settings to obtain the optimal solution, and we can only use it to solve small instances of this problem.

5.1. Impact of the Number of Targets

In Figure 3, the number of ground targets varies from 40 to 100, and we analyze the effects of different numbers of ground targets on shooting utility and time utilization efficiency. It can be seen from Figure 3a that when the number of ground targets is 40, the performance of the UCR algorithm is almost close to the optimal scheme. With an increase in the number of ground targets, the gap between the performance of the UCR algorithm and the OPT algorithm increases from 7.0% to 16.3%. Nevertheless, our proposed algorithm still outperforms the RAN and MSU algorithms in the case of a large number of ground targets. Compared to the RAN algorithm, our algorithm improves shooting utility by 25–50.1%, which is reasonable because RAN randomly selects cluster heads while our algorithm selects cluster heads with the maximum utility-cost ratio at each iteration, taking into account the energy consumption of the UAV, thus saving motion energy and improving shooting utility. Compared to the MSU algorithm, the performance of this algorithm is improved by 14.9–21.9%. This is reasonable because the MSU algorithm only selects the cluster head with the greatest shooting utility in each iteration, while ignoring the energy consumption of the UAV, which leads to higher energy consumption. As shown in Figure 3b, the utilization rate of the hover time of the UAV gradually increases with an increase in ground targets, which is reasonable because when there is a sufficient number of ground targets, shooting utility no longer increases significantly. When the number of ground targets is 100, the optimal scheme can achieve a time utilization rate of 90.8%, and our algorithm can achieve a time utilization rate of 84.4%, which is better than 74.1% for MSU and 52.5% for RAN.

5.2. Impact of the Radius of Clusters

Figure 4 shows the trend of shooting utility and time utilization efficiency with the radius of clusters. We set the number of ground targets to 40. It can be seen from Figure 4a that with an increase in the radius of the clusters, shooting utility gradually decreases. We note that the average shooting utility of our algorithm is 28.5% higher than that of RAN and 24% higher than that of MSU. In order to compare the gap between our algorithm and the OPT algorithm more intuitively, we give approximations of the shooting utility of the two algorithms for different cluster radius parameters in Table 3. In Figure 4b, we can see that the time utilization shows little change with an increase in the radius of clusters and shows a downward trend as a whole. At the same time, we can still see that the UCR algorithm is the closest to OPT. When the radius of clusters is 10 m, our algorithm achieves a time utilization rate of 80.3%, which is higher than 69.5% for MSU and 60.6% for RAN.

5.3. Impact of the UAV Energy Capacity

In Figure 5, the UAV energy capacity changes from 10 4 J to 7 × 10 4 J. Figure 5a shows that when the energy capacity of the UAV increases, the target shooting utility of the four algorithms is improved. Moreover, the overall shooting utility UCR outperforms MSU and RAN on average by 11.2% and 57.3%, respectively. This is reasonable because, with the growth of the UAV’s energy capacity, more cluster heads can be selected for shooting. As shown in Figure 5b, with the increase in the maximum energy of the UAV, the time utilization efficiency shows an upward trend. It can be seen that when the energy capacity of the UAV is 5 × 10 4 J, the UCR algorithm can achieve a time utilization rate of 74.9%, which is close to the 83.2% of the OPT algorithm and better than 66.5% for MSU and 44% for RAN.

5.4. Impact of the Target Distribution Density

Figure 6 shows the trend of target shooting utility and time utilization efficiency with the target distribution density. Assuming that the mission area is square, we set the number of ground targets to 60 and change the side length of the area from 400 m to 1000 m. In Figure 6a, we can see that as the side length of the mission area increases, shooting utility shows a downward trend. This is reasonable because when the number of targets is fixed, a larger mission area means a greater distance between target points and, therefore, a more scattered ground target distribution, which results in more energy consumed for UAV movement and less energy for shooting. As shown in Figure 6a, the UCR algorithm shows better performance with respect to shooting utility. For example, when the side length of the mission area is 400 m, the shooting utility of this algorithm is improved by 20% and 41.1%, respectively, compared with the MSU and RAN algorithms. As shown in Figure 6b, the time utilization shows a decreasing trend as the task area expands. This is reasonable because when the mission area increases, the distribution of ground targets is scattered, and there are fewer targets in each cluster, so the shooting time of the UAV when hovering at the cluster head decreases. When the side length of the mission area is 400 m, our algorithm achieves a time utilization rate of 88.4%, which is higher than 80.1% for MSU and 51.5% for RAN.

5.5. Impact of the UAV Parameters

The parameters of the UAV have an impact on its motion energy consumption and hovering energy consumption. For example, differences in the weight, flight speed and number of rotors of the UAV yield different results. As shown in Figure 7, we set λ from 4 to 10 and μ from 1 to 4 to evaluate the effect on the overall shooting utility. We can see that smaller values for λ and μ result in higher shooting utility, which is reasonable because λ and μ represent the energy consumption per unit distance of UAV flight and the energy consumption per unit time of UAV hovering, respectively. Therefore, lower values for these variables result in a reduction in energy consumption and an increase in shooting utility.

5.6. Trajectory Planning of the UAV

In this section, we use Figure 8 to represent the UAV trajectory generated by each algorithm. From the figure, we see that our algorithm considers the energy consumption of the UAV in each iteration, unlike the MSU and RAN algorithms, so more cluster heads are selected, and the trajectory obtained by our algorithm does not produce a loop. In addition, we can also see that the cluster heads chosen by our algorithm are the same as those of the OPT algorithm.

5.7. Algorithm Comparison

In Table 4, we compare the advantages of the four algorithms in terms of time complexity, global optimal solution and applicable scale.

6. Conclusions

In this paper, we considered a UAV-assisted shooting mission scenario. In order to improve the utility of shooting targets, we optimized UAV trajectory planning, hovering time and shooting point selection. By proving the submodularity of the utility function, we transformed the initial problem into a problem of maximizing the submodularity function under path constraints. We proposed an approximate algorithm to maximize shooting utility through two-level optimization, and the approximate ratio of the algorithm is proved to be 1 1 / e / 2 . Simulation results showed that the performance of our algorithm is closest to the optimal algorithm, and compared with the MSU and RAN algorithms, our proposed algorithm improves the overall shooting utility and time utilization efficiency. In this paper, we only consider the scenario where a single UAV completes the task, but multi-UAV cooperation can achieve more efficient shooting tasks. In the future work, we will consider the communication between UAVs and dynamically realize the task scheduling and trajectory planning of distributed UAVs by using deep reinforcement learning.

Author Contributions

Conceptualization, C.D. and W.W.; formal analysis, Y.W. and W.W.; visualization, Y.W.; supervision, S.F. and C.D.; writing—original draft, Y.W.; writing—review and editing, S.F. and W.W. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded in part by the Key Research and Development project of Jiangsu Province under Grant BE2021013-4; in part by China NSF under Grant 61931011; in part by China NSF under Grant 62001219; and in part by the Shuangchuang Talent Program of Jiangsu Province under Grant JSSCBS20210159.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The researchers would like to thank the funding support.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

According to the definition of the shooting utility function, shooting utility increases with an increase in the number of cluster heads. Thus, for any A B K , G A ( o j ) G B ( o j ) . Due to the fact that the total shooting utility is superimposed, we obtain the following relationship:
G ( A ) = j = 1 m G A ( o j ) j = 1 m G B ( o j ) = G ( B ) ,
which implies that G ( K ) is monotone.
From the definition of the substitution function, G ( K ) = Q ( K , T ) 0 , thus it is nonnegative.
For submodularity, we prove it by proving the following inequation G ( A + c i ) G ( A ) G ( B + c i ) G ( B ) . It is equivalent to proving that for each target o j , G A + c i ( o j ) G A ( o j ) G B + c i ( o j ) G B ( o j ) . We use G A + c i for G ( A c i ) to make the expression more intuitive.
It can be seen from the superposition of the shooting utility, q A ( o j ) q B ( o j ) , then we can divide the proof problem into the following three cases.
Case 1. 
q A ( o j ) q B ( o j ) Q j m : In this case,
G A + c i ( o j ) G A ( o j ) = min q A + c i ( o j ) , Q j m min q A ( o j ) , Q j m = min q ( o j , c i ) , Q j m q A ( o j )
and
G B + c i ( o j ) G B ( o j ) = min q B + c i ( o j ) , Q j m min q B ( o j ) , Q j m = min q ( o j , c i ) , Q j m q B ( o j ) .
Since Q j m q B ( o j ) Q j m q A ( o j ) , we can consider the following three cases to prove the inequality.
(a). If q ( o j , c i ) Q j m q B ( o j ) Q j m q A ( o j ) , we have
G A + c i ( o j ) G A ( o j ) = q ( o j , c i ) = G B + c i ( o j ) G B ( o j ) .
(b). If Q j m q B ( o j ) < q ( o j , c i ) < Q j m q A ( o j ) , we have
G A + c i ( o j ) G A ( o j ) = q ( o j , c i ) > Q j m q B ( o j ) = G B + c i ( o j ) G B ( o j ) .
(c). If Q j m q B ( o j ) Q j m q A ( o j ) q ( o j , c i ) , we have
G A + c i ( o j ) G A ( o j ) = Q j m q A ( o j ) Q j m q B ( o j ) = G B + c i ( o j ) G B ( o j ) .
Case 2. 
q A ( o j ) Q j m q B ( o j ) : In this case,
G A + c i ( o j ) G A ( o j ) = min q A + c i ( o j ) , Q j m min q A ( o j ) , Q j m = min q A + c i ( o j ) , Q j m q A ( o j ) = min q ( o j , c i ) , Q j m q A ( o j ) 0 ,
G B + c i ( o j ) G B ( o j ) = min q B + c i ( o j ) , Q j m min q B ( o j ) , Q j m = Q j m Q j m = 0 .
Case 3. 
Q j m q A ( o j ) q B ( o j ) : In this case,
G A + c i ( o j ) G A ( o j ) = min q A + c i ( o j ) , Q j m min q A ( o j ) , Q j m = Q j m Q j m = 0 ,
G B + c i ( o j ) G B ( o j ) = min q B + c i ( o j ) , Q j m min q B ( o j ) , Q j m = Q j m Q j m = 0 .
For the above three cases, G A + c i ( o j ) G A ( o j ) G B + c i ( o j ) G B ( o j ) is satisfied, thus we prove that G ( K ) is a submodular function.

References

  1. Wu, D.; Ci, S.; Luo, H.; Ye, Y.; Wang, H. Video Surveillance Over Wireless Sensor and Actuator Networks Using Active Cameras. IEEE Trans. Autom. 2011, 56, 2467–2472. [Google Scholar] [CrossRef]
  2. Abbas, N.; Yu, F. Design and Implementation of a Video Surveillance System for Linear Wireless Multimedia Sensor Networks. In Proceedings of the 2018 IEEE 3rd International Conference on Image, Vision and Computing (ICIVC), Chongqing, China, 27–29 June 2018. [Google Scholar]
  3. Hsiao, Y.-P.; Shih, K.-P.; Chen, Y.-D. On Full-View Area Coverage by Rotatable Cameras in Wireless Camera Sensor Networks. In Proceedings of the 2017 IEEE 31st International Conference on Advanced Information Networking and Applications (AINA), Taipei, China, 27–29 March 2017. [Google Scholar]
  4. Song, K.-T.; Tai, J.-C. Dynamic Calibration of Pan–Tilt–Zoom Cameras for Traffic Monitoring. IEEE Trans. Syst. Man Cybern. 2006, 36, 1091–1103. [Google Scholar] [CrossRef] [PubMed]
  5. Kanhere, N.K.; Birchfield, S.T. A Taxonomy and Analysis of Camera Calibration Methods for Traffic Monitoring Applications. IEEE Trans. Intell. Transp. Syst. 2010, 11, 441–452. [Google Scholar] [CrossRef]
  6. Yu, H.; Yang, W.; Zhang, H.; He, W. A UAV-based crack inspection system for concrete bridge monitoring. In Proceedings of the 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Fort Worth, TX, USA, 23–28 July 2017. [Google Scholar]
  7. DeMoraes, R.S.; DeFreitas, E.P. Multi-UAV Based Crowd Monitoring System. IEEE Trans. Aerosp. Electron. Syst. 2020, 56, 1332–1345. [Google Scholar] [CrossRef]
  8. Hayat, S.; Yanmaz, E.; Muzaffar, R. Survey on Unmanned Aerial Vehicle Networks for Civil Applications: A Communications Viewpoint. IEEE Commun. Surv. Tutor. 2016, 18, 2624–2661. [Google Scholar] [CrossRef]
  9. Kim, Y.; Min, Y.G.; Hee, P.S.; Wun-Cheol, J.; Soonyong, S.; Tae-Wook, H. The analysis of image acquisition method for Anti-UAV surveillance using cameras image. In Proceedings of the 2020 International Conference on Information and Communication Technology Convergence (ICTC), Jeju Island, Korea, 21–23 October 2020. [Google Scholar]
  10. Sanchez-Fernandez, A.J.; Romero, L.F.; Bandera, G.; Tabik, S. VPP: Visibility-Based Path Planning Heuristic for Monitoring Large Regions of Complex Terrain Using a UAV Onboard Camera. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2022, 15, 944–955. [Google Scholar] [CrossRef]
  11. Vazquez-Carmona, E.V.; Vasquez-Gomez, J.I.; Herrera-Lozada, J.C. Environmental Monitoring using Embedded Systems on UAV. IEEE Lat. Am. Trans. 2020, 18, 303–310. [Google Scholar] [CrossRef]
  12. Gao, J.; Hu, Z.; Bian, K.; Mao, X.; Song, L. AQ360: UAV-Aided Air Quality Monitoring by 360-Degree Aerial Panoramic Images in Urban Areas. IEEE Internet Things J. 2021, 8, 428–442. [Google Scholar] [CrossRef]
  13. Ji, Y.; Dong, C.; Wu, Q. Fair-energy trajectory plan for multi-target omnidirectional coverage based on cooperative UAVs. In Proceedings of the IET 8th International Conference on Wireless, Mobile Multimedia Networks(ICWMMN), Beijing, China, 15–17 November 2019. [Google Scholar]
  14. Zhan, C.; Zeng, Y.; Zhang, R. Energy-Efficient Data Collection in UAV Enabled Wireless Sensor Network. IEEE Wirel. Commun. Lett. 2018, 7, 328–331. [Google Scholar] [CrossRef] [Green Version]
  15. Wang, W.; Peng, Y.; Cao, G.; Guo, X.; Kwok, N. Low-Illumination Image Enhancement for Night-Time UAV Pedestrian Detection. IEEE Trans. Industr. Inform. 2021, 17, 5208–5217. [Google Scholar] [CrossRef]
  16. Yuan, Y.; Fang, F.; Zhang, G. Superpixel-Based Seamless Image Stitching for UAV Images. IEEE Trans. Geosci. Remote Sens. 2021, 59, 1565–1576. [Google Scholar] [CrossRef]
  17. Zhang, F.; Yang, T.; Liu, L.; Liang, B.; Bai, Y.; Li, J. Image-Only Real-Time Incremental UAV Image Mosaic for Multi-Strip Flight. IEEE Trans. Multimed. 2021, 23, 1410–1425. [Google Scholar] [CrossRef]
  18. Wang, L.-J.; Hsieh, W.-S. Toward an Improvement of UAV-Aerial Image Using Non-linear Image Enhancement. In Proceedings of the 2018 32nd International Conference on Advanced Information Networking and Applications Workshops (WAINA), Krakow, Poland, 16–18 May 2018. [Google Scholar]
  19. Li, Y.; Liang, W.; Xu, W.; Xu, Z.; Jia, X.; Xu, Y.; Kan, H. Data Collection Maximization in IoT-Sensor Networks Via an Energy-Constrained UAV. IEEE Trans. Mob. Comput. 2021. [Google Scholar] [CrossRef]
  20. Chen, M.; Liang, W.; Das, S.K. Data Collection Utility Maximization in Wireless Sensor Networks via Efficient Determination of UAV Hovering Locations. In Proceedings of the 2021 IEEE International Conference on Pervasive Computing and Communications (PerCom), Kassel, Germany, 22–26 March 2021. [Google Scholar]
  21. Youssef, M.; Youssef, A.; Younis, M. Overlapping Multihop Clustering for Wireless Sensor Networks. IEEE Trans. Parallel Distrib. Syst. 2009, 20, 1844–1856. [Google Scholar] [CrossRef]
  22. Baadel, S.; Thabtah, F.; Lu, J. Overlapping clustering: A review. In Proceedings of the 2016 SAI Computing Conference (SAI), London, UK, 13–15 July 2016. [Google Scholar]
  23. Wang, W.; Dai, H.; Dong, C.; Xiao, F.; Zheng, J.; Cheng, X.; Chen, G.; Fu, X. Deployment of Unmanned Aerial Vehicles for Anisotropic Monitoring Tasks. IEEE Trans. Mob. Comput. 2022, 21, 495–513. [Google Scholar] [CrossRef]
  24. Zheng, Z.; Shroff, N.B. Submodular Utility Maximization for Deadline Constrained Data Collection in Sensor Networks. IEEE Trans. Autom. 2014, 59, 2400–2412. [Google Scholar] [CrossRef]
  25. Qin, Z.; Dong, C.; Wang, H.; Li, A.; Dai, H.; Sun, W.; Xu, Z. Trajectory Planning for Data Collection of Energy-Constrained Heterogeneous UAVs. Sensors 2019, 19, 4884. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Zhang, H.; Vorobeychik, Y. Submodular optimization with routing constraints. In Proceedings of the Thirtieth Aaai Conference on Artificial Intelligence (AAAI), Phoenix, AZ, USA, 12–17 February 2016. [Google Scholar]
  27. Monwar, M.; Semiari, O.; Saad, W. Optimized Path Planning for Inspection by Unmanned Aerial Vehicles Swarm with Energy Constraints. In Proceedings of the 2018 IEEE Global Communications Conference (GLOBECOM), Abu Dhabi, United Arab Emirates, 9–13 December 2018. [Google Scholar]
  28. Chiping, T.; McKinley, P.K. Energy Optimization under Informed Mobility. IEEE Trans. Parallel Distrib. Syst. 2006, 17, 947–962. [Google Scholar] [CrossRef]
Figure 1. A diagram of a UAV-assisted WCSN scenario.
Figure 1. A diagram of a UAV-assisted WCSN scenario.
Sensors 22 03685 g001
Figure 2. A diagram of the shooting scenario.
Figure 2. A diagram of the shooting scenario.
Sensors 22 03685 g002
Figure 3. Impact of the number of targets. (a) Overall shooting utility; (b) Time utilization efficiency.
Figure 3. Impact of the number of targets. (a) Overall shooting utility; (b) Time utilization efficiency.
Sensors 22 03685 g003
Figure 4. Impact of the number of cluster heads. (a) Overall shooting utility; (b) Time utilization efficiency.
Figure 4. Impact of the number of cluster heads. (a) Overall shooting utility; (b) Time utilization efficiency.
Sensors 22 03685 g004
Figure 5. Impact of the UAV energy capacity. (a) Overall shooting utility; (b) Time utilization efficiency.
Figure 5. Impact of the UAV energy capacity. (a) Overall shooting utility; (b) Time utilization efficiency.
Sensors 22 03685 g005
Figure 6. Impact of the target distribution density. (a) Overall shooting utility; (b) Time utilization efficiency.
Figure 6. Impact of the target distribution density. (a) Overall shooting utility; (b) Time utilization efficiency.
Sensors 22 03685 g006
Figure 7. Overall shooting utility versus parameters λ and μ .
Figure 7. Overall shooting utility versus parameters λ and μ .
Sensors 22 03685 g007
Figure 8. Trajectory planning of the UAV. (a) OPT algorithm; (b) UCR algorithm; (c) MSU algorithm; (d) RAN algorithm.
Figure 8. Trajectory planning of the UAV. (a) OPT algorithm; (b) UCR algorithm; (c) MSU algorithm; (d) RAN algorithm.
Sensors 22 03685 g008
Table 1. Notations.
Table 1. Notations.
NotationDefinition
O Ground target set
C Cluster head set
L UAV trajectory set
mNumber of ground targets
nNumber of cluster heads
d ( c i , c i + 1 ) Distance between cluster head i and i + 1
E m Motion energy cost of UAV
E h Hovering energy cost of UAV
E m a x Energy capacity of UAV
v a Velocity of UAV
RShooting radius of UAV
T Time allocation strategy
K Selected cluster head set
Q ( K , o j ) Shooting utility for single target o j
Q ( K , T ) Overall Shooting utility
Table 2. Simulation Parameters.
Table 2. Simulation Parameters.
SymbolDefinitionValue
mMass of UAV2.07 kg
E m a x Energy capacity of UAV4 × 10 4 J
hAltitude of UAV30 m
v a Velocity of UAV20 m/s
r u Rotor radius0.127 m
n u Number of rotors4
ρ Air density1.225 kg/m 3
RShooting radius of UAV16 m
Table 3. Approximation of Shooting Utility Between UCR and OPT Algorithms Under Different Cluster Radius Parameters.
Table 3. Approximation of Shooting Utility Between UCR and OPT Algorithms Under Different Cluster Radius Parameters.
Radius of clusters (m)10111213141516
Approximation of shooting utility94.76%94.91%95.05%94.69%95.13%95.19%95.58%
Table 4. Algorithm Comparison.
Table 4. Algorithm Comparison.
AlgorithmTime ComplexityGlobal Optimal SolutionApplicable Scale
OPTHighHighSmall
UCRComparatively lowComparatively highLarge
MSULowComparatively lowLarge
RANLowLowLarge
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Wu, Y.; Feng, S.; Dong, C.; Wang, W. Shooting Utility Maximization in UAV-Assisted Wireless Camera Sensor Networks. Sensors 2022, 22, 3685. https://doi.org/10.3390/s22103685

AMA Style

Wu Y, Feng S, Dong C, Wang W. Shooting Utility Maximization in UAV-Assisted Wireless Camera Sensor Networks. Sensors. 2022; 22(10):3685. https://doi.org/10.3390/s22103685

Chicago/Turabian Style

Wu, Yulei, Simeng Feng, Chao Dong, and Weijun Wang. 2022. "Shooting Utility Maximization in UAV-Assisted Wireless Camera Sensor Networks" Sensors 22, no. 10: 3685. https://doi.org/10.3390/s22103685

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop