1. Introduction
In recent years, unmanned aerial vehicles (UAV) have developed rapidly and have been widely used in many fields [
1,
2,
3]. The duration of flight has always been a major issue limiting its application. Autonomous Aerial Refueling (AAR) technology can effectively improve the endurance of UAVs and has attracted widespread attention [
4]. In this area, a novel concept of a controllable drogue has been proposed recently [
5,
6]. Through actuators on the drogue, it can actively maneuver and dock with the refueling plug. Compared with the traditional aerial refueling methods, a controllable drogue can significantly improve the safety and efficiency of the AAR mission [
7]. However, due to the complex flow field around the drogue [
8,
9] and the large uncertainties in the model of the refueling hose–drogue system, stabilizing and maneuvering the controllable drogue is very difficult.
In terms of dynamic modeling of the hose–drogue system, Williamson et al. [
5] proposed a dynamic model for the hose–drogue system, in which the refueling hose is assumed to be a straight rod and the bending characteristics are ignored. Subsequently, in [
10] by Ro et al., the hose was established as a multi-link model consisting of many straight links and frictionless joints. Based on this model, the hose bending recovery force and the wind interference were both considered in [
11] by Wang et al. Furthermore, Paniagua et al. [
9] considered the hose as a continuum and introduced a micro-element method to analyze the vibration characteristics of the hose. Similarly, Clifton et al. [
12] also adopted the continuum assumption and derived the dynamics model of the towing system using the catenary theory. The release and retrieval of the hose have been neglected in the above studies. Kamman et al. [
13] investigated the dynamics of the cable retrieve/release process based on the multi-link model for an underwater towing system. This theory is also applicable to the AAR mission. Cheng et al. [
14] considered the length of the first link of the hose to be variable based on the multi-link model.
In terms of control of the hose–drogue system, Williamson et al. [
5] linearized the hose–drogue system model and used a linear quadratic regulator to realize stable control of the drogue. Su’s team designed a trajectory tracking controller that combines high-order sliding mode observers and dynamic surface control [
15]. Subsequently, in [
16], an estimator-based minimal learning parameter neural network is used to accurately reconstitute the disturbances and uncertainties. Liu et al. [
17,
18,
19] modeled the system using partial differential equations and achieved vibration control of the hose based on Lyapunov’s direct method. Song et al. [
20] designed a trajectory tracking control algorithm based on an improved extended state observer, solving the peaking issue. Furthermore, several studies in unrelated domains, including UAV control, also concentrate on model uncertainty, such as fuzzy systems [
21] and neural networks [
22]. In [
23], an unknown input observer is employed to isolate the unknown time-varying delays in the state estimation process. Bianchi [
24] makes use of high-order sliding mode estimators to estimate the perturbations that can be canceled by the control. Existing control algorithms for controllable drogue mostly focus on problems such as model inaccuracy and generally ignore the problem of aerodynamic parameter uncertainty. For this problem, the available methods include the Nussbaum function [
25,
26], adaptive estimation [
27] and other methods. In this paper, the aerodynamic parameters and other model uncertainties are combined into one item and approximated using an adaptive fuzzy system.
Most of the current research focuses on the autonomous control of the controllable drogue. However, the maneuvering range is limited by relying solely on the drogue. Therefore, a cooperative control algorithm that comprehensively uses the hose retrieve/release device and drogue actuators is established. The main contributions of this paper are as follows:
- (1)
Unlike the current methods that solely rely on the drogue actuator for maneuver control, this paper constructs a cooperative maneuver control framework that leverages open-loop control of the hose and closed-loop control of the drogue. This integration enables autonomous aerial refueling with wide-range maneuverability for UAVs.
- (2)
The hose retraction and extension processes are subject to latency and error accumulation, which impedes the precise execution of closed-loop control. Existing research overlooks these issues. This paper introduces an open-loop control method for the hose based on neural networks, ensuring rapid convergence to the desired length.
- (3)
Addressing the issues of model uncertainty and time-varying aerodynamic parameters in the drogue closed-loop control, this paper employs fuzzy systems to approximate the uncertain elements. Adaptive estimation of the approximation errors further enhances the control accuracy.
The rest of this paper is organized as follows. A complete refueling hose–drogue dynamic model is established in
Section 2. A trajectory-tracking control method is proposed in
Section 3, including a neural network approximator and an adaptive fuzzy controller.
Section 4 verifies the controller performance using simulation experiments. Finally, the conclusion is drawn in
Section 5.
3. Refueling Drogue Trajectory Tracking Controller Designing
Figure 3 shows the cooperative controller with comprehensive utilization of hose retrieval/release and drogue actuators, where
are the instruction of the drogue position.
and
are the output of the hose’s receiving/releasing device and the drogue struts, respectively. In order to achieve the large-scale and all-around maneuvering of the drogue, all three directions of
need to be controlled.
The autonomous control of the drogue studied in this paper is realized by the variation in the canopy area in four directions. It is assumed that the sum of the areas of the canopy remains constant during the control process, which results in the drogue being unable to generate significant aerodynamic forces in the direction. Therefore, maneuvering in this direction is realized by hose retrieval and release. Using a Gated Recurrent Unit (GRU) neural network to approximate the hose catenary model, the hose length is calculated online according to the desired drogue position. Maneuvering in other directions is realized by drogue actuators. The control inputs are angles of struts. A fuzzy approximator, whose parameters are updated adaptively, is used to approximate the model uncertainty terms and disturbance. Considering the controller saturation problem, a fuzzy-based anti-saturation controller is designed. Moreover, adaptive error estimation is used to estimate and compensate for the upper bound error of the two fuzzy systems.
3.1. Hose Retrieve/Release Controller Based on GRU Neural Network
The refueling pod’s motor is in charge of hose retrieval/release. Compared to the closed-loop control, the open-loop control procedure does not include a feedback mechanism, which is theoretically finished quickly and can ensure rapid convergence. In practice, the control rate of the hose is influenced by hose damping, reel power, and other variables, but it is always faster than closed-loop control. Furthermore, closed-loop control necessitates real-time hose length measurements as well as an extremely fast retrieve/release response. The large mass and inertia of the refueling hose will cause a large accumulation of errors, making accurate control difficult. As a result, the open loop control strategy is used by the hose’s retrieve and release controller.
During the flight task, the hose assumes a special catenary shape. A GRU neural network is then used to approximate the catenary model, which is used to characterize the relationship between the hose length and the position of the drogue under certain flight conditions, including the flight speed, hose mass and drogue mass.
Figure 4 (left) depicts the GRU’s basic structure. To obtain sufficient data, given the flight conditions and the hose length, the equilibrium position of the drogue can be calculated by the dynamic model (for real flight tasks, the equilibrium position can be obtained using the wind tunnel blow test). After that, using flight conditions and drogue equilibrium positions as inputs and the hose length as the output, the GRU can be trained offline. The training process and GRU parameters are as follows:
Step 1: Preprocess the data, including normalization and partitioning of training sets and test sets.
Step 2: Define a GRU model, with input dimension 4 and output dimension 3. The number of layers in the model is 3 and the number of hidden units is 100.
Step 3: Train the GRU model. Set the maximum number of iterations to 200, the initial learning rate to 0.005, and the learning rate decline factor to 0.5.
Step 4: Use the trained GRUs to make predictions and plot the curve of the loss function.
Figure 4 (right) depicts the RMSE and loss during the training process, both of which converge near zero.
It is worth noting that because the hose retrieve/release control is open-loop, its response characteristics are faster than the drogue actuator closed-loop control. Therefore, it is reasonable that the change in hose length does not have a significant effect on the and direction control of the drogue. Furthermore, under the influence of factors such as actuator error, sensor error, wind interference, etc., the hose’s retrieve/release control may exhibit errors for its open-looped characteristics. Because the two positions of are controlled independently by an adaptive fuzzy controller, errors in these two directions are small. As a result, errors exist primarily in the direction of . In an AAR mission, is the docking direction between the drogue and the receiver, with far lower accuracy requirements than the other two directions. As a result, the open-loop hose retrieve/release control strategy used in this paper is feasible.
3.2. Strut Angles Controller Based on Adaptive Fuzzy Method
At present, most studies regard attitude as the inner loop variable of position. However, for the controllable drogue studied in this paper, its supporting refueling hose contains power lines, signal lines, etc. This results in a large diameter and stiffness. Therefore, according to the theoretical analysis and the experimental phenomenon of the relevant wind tunnel test conducted by the author, this paper directly believes that the attitude of the drogue changes with the shape of the hose, that is, the drogue position is directly controlled by the drogue actuators. For the controllable drogue studied in this paper, struts in opposite directions generate aerodynamic force in the same direction. Then, four pairs of struts will generate two orthogonal directions of control force. Therefore, in this section, two pairs of opposite strut angles are combined into one, which generates the control force in the corresponding direction together, i.e.,
For the directions of
and
, an adaptive fuzzy controller is designed in this section. Therefore, in order to facilitate the analysis and controller design, the drogue’s dynamic positioning model is rewritten as follows:
where,
,
,
,
, and
.
denotes known items in the dynamic model, i.e., gravity. The hose’s aerodynamic force, bending recovery force, hose tension, and items in the drogue’s aerodynamic force that are not related to the control variable
are all contained in
. These items cannot be accurately measured in real-time, which are classified as model uncertainties. The items that are related to the control variable are denoted by
. The drogue’s aerodynamic force will change with the complex flow field because the drogue canopy is flexible. Therefore,
is also thought to be unknown. It is assumed that
is invertible and has the upper bound of
, and its first-order derivative has the upper bound of
.
The error vector is defined as , and then, .
The Lyapunov function is defined as:
The virtual control law is designed as:
where the matrix
is designed as positive-definite to ensure that
is negative-definite.
For the second-order subsystem, define the error vector
, and then
, where
is unknown. A fuzzy system is used to approximate it. According to the universal approximation theorem [
29], singleton fuzzification, product inference and central weighted defuzzification methods are used. Then, a fuzzy system is constructed to approximate the uncertain terms:
where
is the fuzzy system input. Then,
. The control law is designed as follows:
where
, which is bounded. And
represents the estimate of the upper bound of
.
is the control parameter to be designed.
is the positive definite matrix to be designed.
are the upper bound of matrix
and its first-order derivative, respectively. To solve the problem of input saturation, the upper bound of each pair of strut angles is defined as
, which is
. Thus, according to Equation (11), the range control quantity in each direction is
. Taking the
direction as an example, the relationship between the actual output
and the desired output
of the controller is as follows:
It is necessary to design an anti-windup module. Define the error between
and
, as
. From Equation (16), we know that
is bounded, which means that
is bounded. A fuzzy system is constructed to approximate this error as follows:
Similarly, it is easy to obtain the control quantity
in the
direction as:
Then, the control law can be modified as follows:
The adaptive law is designed as follows:
where
are all the parameters to be designed.
represents a vector consisting of the absolute values of each component of
. The control law and the adaptive law, shown as (20) and (21), can maneuver the refueling drogue to a given desired position.
It is worth noting that the influence of complex environmental factors on the dynamic model of the drogue is mainly reflected in two aspects: the uncertainty of hose tension and the uncertainty of aerodynamic parameters. For hose tension uncertainty, the adaptive fuzzy system can compensate by approaching its upper bound in the controller. For the problem of uncertainty of aerodynamic parameters, the upper bound of the control gain is used in the design of the control law to effectively suppress its influence on control accuracy.
3.3. Stability Proof
The stability of the designed controller is demonstrated in this section by using Lyapunov’s stability theory.
The Lyapunov function is defined as:
Its derivative is given by
Equation (20) can be rewritten as:
According to the Young’s inequality [
30]:
Combining Equation (23), Equation (24) and Equation (25),
where
.
Considering that
has an upper bound
, then:
Substituting Equation (27) and the adaptive law Equation (21) into Equation (26),
According to the Young’s inequality,
Then, Equation (28) can be transformed into:
where
Integrating Equation (30), we obtain:
It is proved that the controller and adaptive laws designed in this paper can make
,
,
,
,
and
uniformly ultimately bounded [
31], whose bound
can come to be arbitrarily small by the parameter adjustment of
and
. This ends the proof.
4. Discussion
This section verifies the controller’s capability of handling model uncertainties and disturbances, as well as tracking continuous trajectory instruction. Parameters of the refueling hose and the drogue are shown as follows [
15]: The initial length of the hose is 30 m. The hose diameter is 0.05 m. The hose linear density is 0.48 kg/m. The hose skin friction coefficient is 0.01, and the crossflow coefficient is 0.5. The initial number of links in the dynamic model was chosen as 5. The characteristic area and length of the drogue are 0.3 square meters and 0.25 m. The drogue mass is 20 kg. The inertia moment of the drogue is
,
and
in the directions of
. The tanker flew in a straight line at a constant speed, flying at an altitude of 7000 m and a speed of 200 m/s. Nominal aerodynamic force and moment parameters of the drogue are shown as follows. Aerodynamic parameters are obtained from the wind tunnel tests shown in reference [
32].
The controller parameters were chosen as: , , , , , , , , , , , , where and have a direct effect on the system’s convergence rate and features. Furthermore, and have a clear influence on the results, while other parameters are insensitive to the results. The steady-state inaccuracy is reduced as decreases, while the oscillation amplitude increases. And increasing can accelerate convergence but degrade steady-state performance. The membership function of the fuzzy system is chosen as Gaussian type, i.e., , where is the input variable of the fuzzy system, and .
In order to verify the anti-disturbance capability, the complex flow field, which consists of a tanker trail vortex, atmospheric turbulence, receiver bow wave and wind gust is considered [
33]. The first three items are modeled in the reference by [
34]. The gust is modeled using the “1-cosine” full wavelength model starting from the 20th second and lasting 13 s with an amplitude of 20 m/s in directions of
. Furthermore, according to the analysis in
Section 3, the uncertainty of the drogue’s aerodynamic parameters is closely related to the wind disturbance, which also needs to be considered in this section. For the sake of simplicity, it is assumed that the drogue’s aerodynamic parameters change with wind speed, with the maximum change being 250% of the nominal value. The variation in wind disturbance and the drogue’s aerodynamic parameters are shown in
Figure 5.
In order to verify the effectiveness of the proposed controller, the following two sets of simulation experiments were designed.
Simulation I: Experiment for handling the disturbances and uncertainties. This simulation takes into account both complex flow fields and uncertainty in aerodynamic parameters. The aim is that the drogue moves to the fixed desired position from the initial position and remains stable. Under the control framework of this paper, comparative tests were designed, respectively:
Controller A represents the cooperative controller designed in this paper.
Controller B represents the traditional back-stepping controller.
Controller C represents the adaptive fuzzy controller without the technology of error estimation.
Figure 6 (left) depicts the drogue position when three controllers are used. Under the action of controller A and controller C, the position of the drogue can be rapidly converged. Controller A presented in this paper has better convergence characteristics and can reach the desired position within 1 s, while controller C requires 4 s. Furthermore, when the gust and aerodynamic parameter change occurred at the 20th second, the position changes in the three directions under controller B were 0.28 m, 0.9 m and 0.75 m, respectively. This is because the uncertainty of aerodynamic parameters has a great influence on the accuracy of classical back-stepping control, which is consistent with the theoretical analysis. These changes were reduced to 0.002 m, 0.006 m and 0.009 m under controller A and controller C. Therefore, it shows that the controller presented in this paper has better convergence speed and steady-state performance and can effectively suppress the influence of uncertainty in aerodynamic parameters.
Figure 6 (right) shows the variation in the hose length and angles of the drogue struts
, respectively. The angles of struts have always been within the interval of
, which means that the cooperative controller proposed in this paper can achieve stable control of the drogue while satisfying the input constraints.
Remark: It can be noted that the maneuverability range of the drogue reaches up to 6 m. However, the maneuvering distance achieved through the sole use of the drogue is less than 2 m, which proves the effectiveness of the collaborative control framework.
Figure 7 (left) shows the variation in the hose attitude. As mentioned above, the hose recovery moment has a significant influence on the drogue, causing the attitude to tend to be stable with positions becoming stable. In addition, when the aerodynamic moment parameters of the drogue change, the attitude of the drogue is changed by no more than
.
Figure 7 (right) shows the variation in the upper bound of
, which converges to near 0 within 2 s. This result shows that the fuzzy systems designed above could quickly approximate the model uncertainties, as well as the error between the actual and ideal output of the actuators, and maintain stability with a small error.
Simulation II: Experiment for continuous trajectory tracking. The desired position instruction of the drogue is not fixed in actual aerial refueling missions but is provided by the outer ring guidance loop, which is generally a continuous signal. The simulation experiment is designed as follows to test the drogue’s ability to track the continuous desired position instruction: under the influence of a complex flow field and uncertainty of aerodynamic parameters, the initial position of the drogue is
, and the desired trajectory instruction is:
The simulation results are shown in
Figure 8. The results show that the desired trajectory is tracked well in all three directions. The maximum tracking error in both
directions is 0.1 m and 0.05 m, respectively, which meets the requirements of the air refueling mission. The
direction tracking effect is slightly worse, with a maximum error of 0.22 m. As discussed in
Section 3, the accuracy requirement in the
direction is far less than in the other two directions. The designed cooperative controller can make the drogue track the continuous trajectory command well and meet the requirements of AAR. In
Figure 8 (right), we can find that the actual input of actuators has always satisfied the input constraints.