**1. Introduction**

In the past decade, the problem of UAV control has attracted more and more attention [1–3]. Since the multi-agent control problem has received continuous attention [4,5], multi-UAV control is also a hot area of research [6–8]. The multi-UAV circumnavigation control problem is a field of application for multi-UAV control, which refers to a group of UAVs surrounding the target in a prescribed formation to perform tasks such as monitoring [9], tracking and rounding up [10].

The circumnavigation problem has gradually developed from a single-agent circumnavigation static target [11–13] to a single-agent circumnavigation dynamic target [14–16], and up to the current multi-agent circumnavigation dynamic target [4,17,18]. Ref. [19] analyzed the circumnavigation problem in a two-dimensional plane, assuming that each agent has a fixed velocity. Ref. [20] used the self-propelled particle system to analyze the circumnavigation problem, but it required the circumnavigation target to be a static target. Most of the initial research assumed that each agent can accurately know the position information of the target [17,21], but this is difficult to achieve in practice. In order to overcome this drawback, researchers have proposed the use of distance measurement to obtain the position of the target. In [22], by measuring the distance between the agent and the target, the backstepping control is used to analyze the circumnavigation problem. In [23], a sliding mode control method based on distance measurement is designed to enable the UAV to achieve circumnavigation without using GPS. In practice, achieving distance measurement requires high-accuracy and expensive sensors, but UAVs are small and have limited payload capacity, so this approach is not realistic for UAVs. In contrast, angle measurement is relatively easy to implement. UAVs only need to carry cameras or other small sensors to measure angles.

In [24], the kinematic model of the underwater vehicle is combined with the dynamic model, and a cascade-based distributed circumnavigation control system is proposed, which can realize the circumnavigation of static and dynamic targets. In [25], the navigation control is realized by using the angle information between adjacent UAVs and the angle information between the UAV and the target. According to the local information of the target, ref. [26] uses the estimation method to estimate the location information of the target, so as to achieve circumnavigation, and this method does not need to consider the initial state of the agent. Refs. [27,28] propose a wireless speed measurement method to keep the multi-agent formation in the desired formation. Ref. [29] proposes a swarm control strategy for fixed-wing UAVs using multi-objective reinforcement learning. Taking the underwater robot as the research object, ref. [30] uses fast non-singular terminal sliding technology to provide faster convergence for full-drive underwater robot trajectory tracking control, while using adaptive technology to remove the restrictions that require system parameters.

However, the above studies were all conducted in the two-dimensional plane, but the UAV is active in the complex three-dimensional space; it is obviously more challenging to analyze the circumnavigation problem in three-dimensional space. At the same time, it should be noted that the formations proposed in these works are generally circular formations, which limits their practical application. In this paper, we set the formation to be elliptical and allowed the UAVs to be deployed in different orbits. The main contributions of this paper are summarized as follows:


#### **2. Problem Formulation**

#### *2.1. Define the Desired Angle*

In the three-dimensional space, UAV *i* moves with speed *υ<sup>i</sup>* , and a space coordinate system is established with the UAV *i* as the origin, as shown in Figures 1 and 2. The target is denoted by *h*, and its projection point on the i-plane is denoted by *h*'. The distance between *i* and *h*' is denoted by *l* 0 *i* , and *l<sup>d</sup>* is the desired radius, that is, the desired distance between the UAV emphi and the target projection point *h*'.

**Definition 1.** *δ<sup>i</sup> is the angle between ih and ih*0 *. γ<sup>i</sup> is the angle formed by ih' and the positive direction of the X-axis. θ<sup>i</sup> is the pitch angle of i, and α<sup>i</sup> is the heading angle of i. Next, make the following assumption:*

**Assumption 1.** *Assume that every UAV can know the angles in Definition 1, and the communication between UAVs is realized under a cyclic directed graph, i.e., UAV* i *+ 1 can get the information of UAV* i*; at the same time, there is no interference in the communication between UAVs.*

**Figure 1.** Schematic diagram of three-dimensional space circumnavigation.

**Figure 2.** Top view of circumnavigation.

**Definition 2.** *Define a set of orthogonal vectors* [*κ<sup>i</sup>* , *κ***¯***<sup>i</sup>* , *κ***¯¯***<sup>i</sup>* ] *as shown in Figure 1, where κ<sup>i</sup> represents the unit vector pointed by the i to h* 0 *; κ***¯***<sup>i</sup> represents the unit vector in the XOY plane, perpendicular to κ<sup>i</sup> ; and κ***¯¯***<sup>i</sup> represents the vector perpendicular to the XOY plane.*

$$\begin{cases} \begin{aligned} \kappa\_{\bar{i}} &= \begin{bmatrix} \cos \gamma\_{\bar{i}} & \sin \gamma\_{\bar{i}} & 0 \end{bmatrix}^T \\ \tilde{\kappa}\_{\bar{i}} &= \begin{bmatrix} \sin \gamma\_{\bar{i}} & -\cos \gamma\_{\bar{i}} & 0 \end{bmatrix}^T \end{aligned} \tag{1} \\ \begin{aligned} \tilde{\kappa}\_{\bar{i}} &= \begin{bmatrix} 0 & 0 & \sin \delta\_{\bar{i}} \end{bmatrix}^T . \end{aligned} \tag{1}$$

## *2.2. Multi-Orbit Circumnavigation*

The multi-orbit circumnavigation is shown in Figure 3. For agent *i*, its required circumnavigation radius at time *t* should be set as *li*(*t*) = *τ<sup>i</sup> ld* . *li*(*t*) represents the actual distance between the UAV *i* and the target projection point. *τ<sup>i</sup>* and *l<sup>d</sup>* are positive real numbers, and by adjusting different *τ<sup>i</sup>* , different circumnavigation radii can be obtained.

Therefore, in the multi-orbit circumnavigation, different orbits are realized according to the given basic circumnavigation radius *l<sup>d</sup>* and multiplied by the corresponding *τ<sup>i</sup>* . The relationship between different orbits is based on the multiple relationship of *l<sup>d</sup>* .

**Figure 3.** Multi-orbit circumnavigation.

*2.3. Dynamic Model of UAVs*

First, we make the following assumption:

**Assumption 2.** *In this paper, the quadrotor UAV is taken as the research object. Next, the quadrotor UAV dynamic model in the inertial coordinate system can be described as [31]*

$$\begin{cases} \begin{aligned} \pounds\_{i} &= \frac{F\_{i}}{m\_{i}} (\cos\psi\_{i}\cos\phi\_{i}\sin\theta\_{i} + \sin\psi\_{i}\sin\phi\_{i}) + d\_{xi} \\ \pounds\_{i} &= \frac{F\_{i}}{m\_{i}} (\sin\psi\_{i}\cos\phi\_{i}\sin\theta\_{i} + \cos\psi\_{i}\sin\phi\_{i}) + d\_{yi} \\ \pounds\_{i} &= \frac{F\_{i}}{m\_{i}} (\cos\phi\_{i}\cos\theta\_{i}) - g + d\_{zi} \end{aligned} \tag{2}$$

*where m<sup>i</sup> represents the mass of the UAV. Defining p<sup>i</sup>* = [*x<sup>i</sup>* , *yi* , *zi* ] *T indicates the position of the i-th UAV in the inertial coordinate system, and B<sup>i</sup>* = [*ψ<sup>i</sup>* , *θi* , *φ<sup>i</sup>* ] *T indicates the roll, pitch and yaw of the UAV in the body coordinate system. The relationship between the inertial coordinate system and the body coordinate system is given in Figure 4. F<sup>i</sup> is the total thrust generated by the motors of the UAV, and g is the acceleration of gravity. d<sup>i</sup>* = [*dxi*, *dyi*, *dzi*] *T indicates system external interference.*

**Figure 4.** Quadcopter UAV coordinate system.

In order to convert the coordinates of the UAV from the body coordinate system to the inertial coordinate system, we need the following rotation matrix *ϑ<sup>i</sup>*

$$
\theta\_{l} = \begin{bmatrix}
\cos\theta\_{l}\cos\psi\_{l} & \sin\theta\_{l}\cos\psi\_{l}\sin\phi\_{l} - \sin\psi\_{l}\cos\phi\_{l} & \sin\theta\_{l}\cos\psi\_{l}\cos\phi\_{l} + \sin\psi\_{l}\sin\phi\_{l} \\
\cos\theta\_{l}\sin\psi\_{l} & \sin\theta\_{l}\sin\psi\_{l}\sin\phi\_{l} + \cos\psi\_{l}\cos\phi\_{l} & \sin\theta\_{l}\sin\psi\_{l}\cos\phi\_{l} - \cos\psi\_{l}\sin\phi\_{l} \\
\end{bmatrix}.
\tag{3}
$$

After some transformations, the dynamics model can be written as in [32]

$$m\_i \begin{bmatrix} \not p\_{xi} \\ \not p\_{yi} \\ \not p\_{zi} \end{bmatrix} = \vartheta\_i F\_i + \begin{bmatrix} 0 \\ 0 \\ -m\_i g \end{bmatrix} + m\_i \begin{bmatrix} d\_{xi} \\ d\_{yi} \\ d\_{zi} \end{bmatrix} \tag{4}$$

where *T<sup>i</sup>* is a continuous variable that represents the external input of UAV *i*, and can be written as

$$T\_{\mathbf{i}} = m\_{\mathbf{i}} \mathfrak{d}\_{\mathbf{i}}^T [\boldsymbol{u}\_{\mathbf{x}\mathbf{i}}, \boldsymbol{u}\_{\mathbf{y}\mathbf{i}}, \boldsymbol{u}\_{\mathbf{z}\mathbf{i}} + \mathbf{g}]^T,\tag{5}$$

where *u<sup>i</sup>* = [*uxi*, *uyi*, *uzi*] *T* represents the components of the control force of the UAV *i* on the three axes in the inertial coordinate system.

Next, combining (2), (4) and (5), a new expression can be obtained

$$\begin{aligned} F\_i &= m\_i u\_{xi} (\cos \psi\_i \cos \phi\_i \sin \theta\_i + \sin \psi\_i \sin \phi\_i)^{-1} \\ &+ m\_i u\_{yi} (\sin \psi\_i \cos \phi\_i \sin \theta\_i + \cos \psi\_i \sin \phi\_i)^{-1} \\ &+ m\_i u\_{zi} (\cos \phi\_i \cos \theta\_i)^{-1} . \end{aligned} \tag{6}$$

From Equation (6), it can be seen that by designing the control *u<sup>i</sup>* = [*uxi*, *uyi*, *uzi*] *T* , the UAV can be controlled by applying the external input *T<sup>i</sup>* and the attitude angle *B<sup>i</sup>* = [*ψ<sup>i</sup>* , *θi* , *φ<sup>i</sup>* ] *T* , so as to realize the circumnavigation control.

#### *2.4. Control Objective*

Given a group of *n* UAVs and a moving target *h*, the purpose of this paper is to design a control law to make the UAV group around the given target in elliptical orbits. Ultimately, the UAV group needs to meet the following conditions:


The above objective can be written in the following form:

$$\begin{cases} \lim\_{t \to +\infty} l\_i(t) = \tau\_i l\_{d\prime} \\ \lim\_{t \to +\infty} \omega\_i = \omega\_{d\prime} \\ \lim\_{t \to +\infty} \omega\_i - \alpha\_j = \beta\_{d\prime} \end{cases} \quad \forall i, j \in \mathcal{N}\_{\prime} \tag{7}$$

where *N* = {1, · · · , *n*}, *ω<sup>d</sup>* represents the desired circumnavigation angular velocity; *β<sup>d</sup>* is the desired angular spacing between two UAVs, with a value of 2*π*/*n*; and *n* is the number of UAVs. This means that at time *t* → +∞, the angular spacing between adjacent UAVs will be a fixed value.

#### **3. Circumnavigation Control**

Due to the target coordinate position, an estimator is needed to estimate the position of the target. We use the following estimator

$$\begin{aligned} \dot{\boldsymbol{\dot{p}}}\_{ti} &= k(\boldsymbol{I} - \boldsymbol{\varepsilon}(\boldsymbol{t})\boldsymbol{\varepsilon}(\boldsymbol{t})^T)(\boldsymbol{p}\_i - \boldsymbol{p}\_{ti}),\\ \boldsymbol{\varepsilon}(\boldsymbol{t}) &= \frac{p\_t - p\_i}{||\boldsymbol{p}\_t - \boldsymbol{p}\_i||} = \begin{bmatrix} \cos\delta\_i \cos\gamma\_i\\ \cos\delta\_i \sin\gamma\_i\\ \sin\delta\_i \end{bmatrix},\end{aligned} \tag{8}$$

where *k* is a constant gain, *p<sup>t</sup>* = [*x<sup>t</sup>* , *y<sup>t</sup>* , *z<sup>t</sup>* ] *T* is the coordinates of the target, and *p***ˆ***ti* = [*x*ˆ*ti*, *y*ˆ*ti*, *z*ˆ*ti*] is the coordinate estimation of the target by the UAV *i*. *I* is the identity matrix. Through this three-dimensional position estimator, the position of the target can be estimated with only the angle information known. The desired elliptical circumnavigation radius is set as follows

$$d\_d = \frac{ab}{\sqrt{a^2 \sin^2 \gamma\_i + b^2 \cos^2 \gamma\_i}},\tag{9}$$

where *a* and *b* are the major and minor axes of the ellipse, respectively. By setting different values for *a* and *b*, the desired elliptical orbit *l<sup>d</sup>* can be obtained. Using *l<sup>d</sup>* multiplied by constant *τ<sup>i</sup>* , we can obtain different elliptical orbits; then, we can cause each UAV circle to be in its own orbit. It is worth noting that when *a* = *b*, it is a circular orbit.

Next, we write the dynamic Equation in (4) in the following form:

$$
\dot{p}\_i = \mathbf{s}\_i \,\dot{\mathbf{s}}\_i = \boldsymbol{\mu}\_i + \mathbf{d}\_i. \tag{10}
$$

At the same time, the angle in Definition 1 can be represented by known information and estimated values

$$\begin{cases} \delta\_{\bar{i}} = \arctan \frac{\hat{z}\_{\bar{i}\bar{i}} - z\_{\bar{i}}}{\sqrt{\left(\mathfrak{x}\_{\bar{i}\bar{i}} - \mathfrak{x}\_{\bar{i}}\right)^2 + \left(\mathfrak{y}\_{\bar{i}\bar{i}} - \mathfrak{y}\_{\bar{i}}\right)^2}},\\ \gamma\_{\bar{i}} = (-1)^{\mathsf{f}} \arccos \frac{\mathfrak{x}\_{\bar{i}\bar{i}} - \mathfrak{x}\_{\bar{i}}}{\sqrt{\left(\mathfrak{x}\_{\bar{i}\bar{i}} - \mathfrak{x}\_{\bar{i}}\right)^2 + \left(\mathfrak{y}\_{\bar{i}\bar{i}} - \mathfrak{y}\_{\bar{i}}\right)^2}} + 2\pi \mathfrak{f}\_{\mathsf{s}}. \end{cases} \tag{11}$$

where

$$\mathcal{J} = \begin{cases} \ 0, \hat{y}\_{ti} < y\_{i\prime} \\ 1, \hat{y}\_{ti} \ge y\_i. \end{cases} \tag{12}$$

It can be seen that *γ<sup>i</sup>* is discontinuous, but the derivative of *γ<sup>i</sup>* with respect to time can be expressed in the following form

$$\gamma\_{\dot{i}} = \frac{\upsilon\_{\dot{i}} \cos \theta\_{\dot{i}} \sin(\gamma\_{\dot{i}} - \mathfrak{a}\_{\dot{i}})}{l'\_{\dot{i}}(t)} - \omega\_{\dot{i}\prime} \tag{13}$$

where *l* 0 *i* (*t*) is the distance between the UAV and the target projection point.

**Proof.** Suppose the motion of UAV *i* at time *t* is as shown in Figure 5; at this time, the relationship between the angles *γ<sup>i</sup>* and *α<sup>i</sup>* is also marked in Figure 5. The velocity of *i* on the horizontal plane can be decomposed orthogonally into *υia* and *υib*; then, *υia* can be written as:

$$\upsilon\_{ia} = \upsilon\_i \cos \theta\_i \sin(\gamma\_i - \alpha\_i) \tag{14}$$

The derivative of *γ<sup>i</sup>* + (2*π* − *αi*) can be written as:

$$
\dot{\gamma}\_i - \dot{\alpha}\_i = \frac{\upsilon\_{ia}}{l\_i'(t)}.\tag{15}
$$

Then, (14) and (15) can be combined to obtain the result in (13). The proof is finished.

**Figure 5.** Top view of the UAV *i* at time *t*.

Next, the ideal relative velocity is constructed from the orthogonal vector in (1)

$$
\sigma\_{id} = c\_1 (l\_i'(t) - \tau\_i l\_d) \kappa\_i + \tau\_i l\_d \omega\_d (1 - \frac{2}{\pi} \arctan \beta\_i) \overline{\kappa}\_i + c\_2 \overline{\kappa}\_{i\prime} \tag{16}
$$

where *c*<sup>1</sup> > 0, *c*<sup>2</sup> > 0 , *β<sup>i</sup>* = *α<sup>i</sup>* − *α<sup>j</sup>* − (*i* − *j*) 2*π n* .

*σ***1***<sup>i</sup>* is defined as the difference between the actual relative position and the ideal relative position of the UAV *i*, and *σ***2***<sup>i</sup>* as the difference between the actual relative speed and the ideal relative speed of the UAV *i*; thus, we can obtain

$$\begin{cases} \sigma\_{1i} = p\_i - p\_t - \int v\_{id} dt\_\prime \\ \dot{\sigma}\_{1i} = \sigma\_{2i} = \dot{p}\_i - \dot{p}\_t - \upsilon\_{id\prime} \\ \dot{\sigma}\_{2i} = u\_i + d\_i - \dot{p}\_t - \dot{\upsilon}\_{id\prime} \end{cases} \tag{17}$$

In order to improve the robustness of the system, sliding mode control is adopted. The sliding surface is designed as

$$\mathbf{S} = \chi \sigma\_{1i} + \sigma\_{2i} \tag{18}$$

where *χ* > 0, using the exponential reaching law as follows

$$
\dot{\mathbf{S}} = -c\_3 \mathbf{S} - c\_4 \text{sgn}(\mathbf{S}) \,\tag{19}
$$

where *c*<sup>3</sup> > 0, *c*<sup>4</sup> > 0. Then, we obtain the following control law

$$
\mu\_{\dot{t}} = -\varepsilon\_3 \mathbf{S} - \varepsilon\_4 \text{sgn}(\mathbf{S}) - \chi \sigma\_{2\dot{t}} + \ddot{p}\_t + \dot{v}\_{\dot{t}d} - d\_{\dot{t}}.\tag{20}
$$

**Theorem 1.** *Considering a group of UAVs as a nonlinear system (4), if the three-dimensional position estimators are set as (8), the ellipse surround radius is set as (9), and the parameters c*1*, c*2*, c*3*, c*4*, and χ are selected to be greater than 0, then the controller (20) can make the group of UAVs circle the target on multiple elliptical orbits.*

**Proof.** Considering the Lyapunov candidate function *V* = <sup>1</sup> 2 *S* 2 , we take its derivative with respect to time as

$$\begin{split} \dot{\mathcal{V}} &= \mathbf{S} \dot{\mathbf{S}} \\ &= \mathbf{S} (\chi \sigma\_{2i} + \dot{\sigma}\_{2i}) \\ &= \mathbf{S} (\chi \sigma\_{2i} + (\mu\_i + d\_i - \ddot{p}\_t - \dot{v}\_{id})) .\end{split} \tag{21}$$

Next, we substitute (20) into (21)

$$\begin{split} \dot{\mathbf{V}} &= \mathbf{S}(\chi \sigma\_{2i} - c\_3 \mathbf{S} - c\_4 \text{sgn}(\mathbf{S}) - \chi \sigma\_{2i} + \vec{p}\_t + \vec{v}\_{id} - d\_i - \vec{p}\_t - \dot{v}\_{id} + d\_i) \\ &= \mathbf{S}(-c\_3 \mathbf{S} - c\_4 \text{sgn}(\mathbf{S})) \\ &= -c\_3 \|\mathbf{S}\|^2 - c\_4 \|\mathbf{S}\|\_{\prime} \end{split} \tag{22}$$

where *<sup>c</sup>*<sup>3</sup> <sup>&</sup>gt; 0, and *<sup>c</sup>*<sup>4</sup> <sup>&</sup>gt; 0; therefore, *<sup>V</sup>***˙** <sup>≤</sup> 0 satisfies the Lyapunov stability criterion.

#### **4. Simulation Results**

In this section, the performance of the estimator (8) and control law (20) is verified by considering a group of five UAVs circling a moving target on multiple trajectories, where *βd* is 2*π*/5. We set the mass of each UAV to *m<sup>i</sup>* = 1 kg, and the acceleration of gravity to *g* = 9.8 m/s<sup>2</sup> . For the ideal relative velocity in (16), *c*<sup>1</sup> = 1 and *c*<sup>2</sup> = 5 were selected. Parameters in the controller (20) were selected as *c*<sup>3</sup> = 5, *c*<sup>4</sup> = 10, *χ* = 1.

#### *4.1. Case 1: Target Moves in a Straight Line*

The speed of the moving target in three-dimensional space is selected as *p***˙***<sup>t</sup>* = [2 2 4] *T* .

First, the parameters of the estimator are selected, *k* = 1, and the initial positions of the five UAVs are randomly generated. Figure 6 presents the simulation results of the convergence effect of the position estimator.

**Figure 6.** Position estimator error convergence ||*p***ˆ***ti* − *pt*||.

Next, when external interference is not considered, that is *d<sup>i</sup>* = [0, 0, 0] *T* , the parameters of the elliptical orbit are taken as *a* = 25 and *b* = 15, with *τ<sup>i</sup>* selected as *τ<sup>i</sup>* = [1, 1.5, 1.8, , 2.3, 2.8].

Figure 7 shows the angular spacing between two adjacent UAVs, Figure 8 gives the circumnavigation control error, and Figure 8a shows distance between each UAV and the target, that is ||*p<sup>i</sup>* − *p<sup>t</sup>* ||. Since the circumnavigation track is elliptical, the distance should change all the time. Figure 8b is ||*p<sup>i</sup>* − *p<sup>t</sup>* || − *τ<sup>i</sup> ld* , that is, the error between the actual distance and estimated distance from the position of UAV to target. The three-dimensional simulation diagram of the UAVs circumnavigation is given in Figure 9.

**Figure 7.** Angular spacing between adjacent UAVs.

**Figure 8.** Circumnavigation control error. (**a**) ||*p<sup>i</sup>* − *pt*||. (**b**) ||*p<sup>i</sup>* − *pt*|| − *τ<sup>i</sup> ld* .

**Figure 9.** Three−dimensional diagram of circumnavigation control.

Since the UAV is easily interfered with by external factors during the operation, the robustness of the control system is tested. When *t* = 70 s, the external interference of the third UAV is set to *d***<sup>3</sup>** = [0, 30, 70] *T* . Figure 10 shows the change in the angular spacing between each UAV, and Figure 11 shows the circumnavigation control error, where Figure 11a is ||*p<sup>i</sup>* − *p<sup>t</sup>* ||, and Figure 11b is ||*p<sup>i</sup>* − *p<sup>t</sup>* || − *τ<sup>i</sup> ld* . It can be seen from the above pictures that when there is interference, the sliding mode control can quickly eliminate the influence of the interference and maintain the formation of the UAV group.

**Figure 10.** Variation in angular separation between adjacent UAVs when interference occurs.

**Figure 11.** The circumnavigation control error when disturbance occurs. (**a**) ||*p<sup>i</sup>* − *pt*||. (**b**) ||*p<sup>i</sup>* − *pt*|| − *τ<sup>i</sup> ld* .

#### *4.2. Case 2: Target Moves in a Curve*

The speed of the moving target in three-dimensional space is selected as *p***˙***<sup>t</sup>* = [3 cos(0.5*t*) 3 sin(0.5*t*) *t*] *T* .

The parameters of the estimator are selected, *k* = 1, and the initial positions of the five UAVs are randomly generated. Figure 12 presents the simulation results of the convergence effect of the position estimator.

**Figure 12.** Position estimator error convergence ||*p***ˆ***ti* − *pt*||.

When *d<sup>i</sup>* = [0, 0, 0] *T* , we take the parameters of the elliptical orbit as *a* = 30 and *b* = 20, with *τ<sup>i</sup>* selected as *τ<sup>i</sup>* = [1, 1.2, 1.4, , 1.6, 1.8].

Figure 13 shows the angular spacing between two adjacent UAVs, Figure 14 gives the circumnavigation control error, and Figure 14a shows the distance between each UAV and the target, that is ||*p<sup>i</sup>* − *p<sup>t</sup>* ||. Figure 14b is ||*p<sup>i</sup>* − *p<sup>t</sup>* || − *τ<sup>i</sup> ld* . The three-dimensional simulation diagram of the UAVs circumnavigation is given in Figure 15.

**Figure 13.** Angular spacing between adjacent UAVs.

**Figure 14.** Circumnavigation control error. (**a**) ||*p<sup>i</sup>* − *pt*||. (**b**) ||*p<sup>i</sup>* − *pt*|| − *τ<sup>i</sup> ld* .

**Figure 15.** Three−dimensional diagram of circumnavigation control.

The robustness of the system is verified again. When *t* = 70 s, the external interference of the fifth UAV is set to *d***<sup>3</sup>** = [30, 10, 50] *T* . Figure 16 shows the change in the angular spacing between each UAV, and Figure 17 shows the circumnavigation control error, where Figure 17a is ||*p<sup>i</sup>* − *p<sup>t</sup>* ||, and Figure 17b is ||*p<sup>i</sup>* − *p<sup>t</sup>* || − *τ<sup>i</sup> ld* . The above experiments once again prove that the sliding mode control adopted in this paper has strong robustness.

**Figure 16.** Variation in angular separation between adjacent UAVs when interference occurs.

**Figure 17.** The circumnavigation control error when disturbance occurs. (**a**) ||*p<sup>i</sup>* − *p<sup>t</sup>* ||. (**b**) ||*p<sup>i</sup>* − *p<sup>t</sup>* − *τ<sup>i</sup> ld* ||.

#### **5. Conclusions**

In this paper, the problem of circumnavigation control in three-dimensional space is studied, the group of UAVs is made to circle the target in elliptical formation and with multiple orbits. The target is made to move with curvilinear variable speed, and UAVs estimate the position of the target only from the angle information. The error dynamic equation is constructed using the ideal relative velocity and the actual relative velocity, and the circumnavigation control is transformed into a velocity tracking problem. In order to improve the robustness of the system, sliding mode control is used to design the control law. Finally, the effectiveness of the proposed control law is proved by simulation, and disturbance is added to the simulation process to verify the robustness of sliding mode control.

**Author Contributions:** Conceptualization, Y.L. and Z.W.; methodology, Z.W.; software, Z.W.; validation, Y.L. and Z.W.; formal analysis, Z.W.; investigation, Z.W.; resources, Y.L.; data curation, Z.W.; writing—original draft preparation, Z.W.; writing—review and editing, Y.L.; visualization, Z.W.; supervision, Y.L.; project administration, Y.L.; funding acquisition, Y.L. All authors have read and agreed to the published version of the manuscript.

**Funding:** This research was funded by the National Natural Science Foundation of China (62173082), Shenyang Science & Technology Innovation Program for Young and Middle-aged Talents (RC210503), and the Liaoning Joint Fund of the National Natural Science Foundation of China (U1908217).

**Institutional Review Board Statement:** Not applicable.

**Informed Consent Statement:** Not applicable.

**Data Availability Statement:** Not applicable.

**Conflicts of Interest:** The authors declare no conflict of interest.
