1. Introduction
Unmanned aerial vehicles (UAVs) equipped with various types of equipment play an increasingly important role in aerial photography, search, surveillance, etc. [
1,
2,
3,
4]. In particular, unmanned aerial manipulators (UAMs) consisting of a UAV and robotic manipulators have potential operational applications, providing improved maneuverability relative to mobile manipulators. UAMs can substitute humans to actively perform aerial missions, reducing cost and personal injury [
5] associated with tasks such as disaster rescue [
6,
7], social security [
7,
8] and object delivery [
9,
10]. Quadrotor-based UAMs have the advantages of uncomplicated composition and easy maintenance, with numerous structural solutions. However, the underactuated characteristics of quadrotors, the coupling generated by the rigid connection with the manipulator and the reaction force of the manipulator motion on the quadrotor reduce the stability of UAMs, making it difficult to achieve precise control. Therefore, it is crucial to design a robust, high-precision UAM controller with rapid response capability [
11].
A variety of control methods have been proposed to control aerial manipulator systems, such as proportional-integral-derivative (PID) control [
12,
13], model-predictive control [
14,
15,
16], impedance control [
17,
18], adaptive control [
19,
20,
21], etc. PID control is the most widely used method, with the advantages of seldomly considering model information, simple calculation and easy implementation. A controller based on the PID method was designed for a UAM to conduct a hammering test on a bridge pier for defect inspection [
12]. However, the robustness of the PID controller was limited under the influence of disturbances. A model-predictive controller was designed for visual servo control of an aerial manipulator, as well as aerial grasping of cylindrical objects [
14]. An impedance controller was developed for an aerial manipulator to suppress disturbances caused by manipulator movements when the system performed aerial tasks [
18]. An adaptive controller capable of estimating online load parameters was designed for a UAM to transport an unknown object and track the desired trajectory [
20]. However, these operations were performed with the system slowly changing or with uncomplicated external disturbances. Under real-world conditions, the quadrotor is very sensitive to interference, owing to its underactuated and strong coupling characteristics. Therefore, the robust control of aerial manipulators is a critical problem to be solved.
Sliding mode (SM) control is a variable structure control that forces the system to move along the trajectory of the predetermined sliding surface by varying purposefully based on the system state. With the advantage of fast convergence and anti-disturbance characteristics, SM control has become one of the most widely used robust nonlinear control methods. Many studies have been conducted on the use of SM for aerial manipulators conducting aerial tasks. An adaptive SM controller was developed for precise control of the quadrotor position and manipulator motion to accurately pick up and transfer objects [
21]. A passive adaptive SM controller was developed to control the position and velocity of a UAM using an image-based servo [
22]. A PID- and SM-based controller was proposed to perform precisely desired trajectory tracking for an aerial manipulator system [
23]. A composite controller combined proportional derivative (PD), SM-based aerial manipulator system decoupled into two subsystems was designed for a UAM to accurately track the desired trajectory [
24]. The above experimental results show that an SM controller can effectively improve the robustness, accuracy and decoupling ability of a UAM without guaranteeing the error convergence time. Hence, to ensure zero convergence of system errors in finite time, researchers have improved the SM function to enhance control performance and ensure sufficient response speed to meet the requirements of rapid system change.
The position or velocity errors of a UAM during missions are related to the underactuation and instability of the quadrotor. Therefore, the response and convergence time of the quadrotor are crucial to the operation stability of a UAM. A novel robust terminal sliding mode control method was proposed to guarantee system converged to a stability point in a limited time [
25]. An adaptive integral-type terminal sliding mode controller was proposed for the quadrotor to track the attitude and position under the conditions of model uncertainties and external disturbances [
26]. A time delay, estimation-based, nonsingular terminal sliding mode controller was proposed for a UAM to enhance the joint desired angle tracking accuracy of the manipulator [
27]. A controller based on SM and an extended-state observer was designed for a quadrotor to precisely track a spiral curve under the influence of disturbances [
28]. The above findings demonstrate that the system can reliably perform aerial missions with little regard for external disturbances. However, various unavoidable environmental disturbances, such as gusts of wind, seriously affect the system’s stability in practical applications. Therefore, the ability to actively suppress interference is critical for UAMs.
The aim of the present study is to improve general SM function design a nonsingular global fast terminal sliding mode (NGFTSM) function. Combined with a radial basis function (RBF) neural network, a composed controller is proposed for an aerial manipulator to ensure reliable tracking of desired trajectories under the influence of external disturbances. The UAM system dynamics model is simplified under given conditions and decoupled into two subsystems to design an NGFTSM controller. To achieve active anti-disturbance and high-accuracy control of a UAM, we incorporate an RBF neural network into the controller to estimate lumped disturbances, including internal coupling and external disturbances. In the previous studies [
29,
30], neural networks have been used to approximate unknown models. The proposed controller and neural network are derived according to Lyapunov theory to ensure the system’s stability. A final simulation and actual flight verify the reliability of the proposed control method.
The remainder of this paper is organized as follows. In
Section 2, we present the UAM dynamics model with reasonable simplification. In
Section 3, we propose a control scheme for a UAM and conduct a Lyapunov analysis of the system’s stability. Then, in
Section 4 and
Section 5, several simulations are performed for comparison with other control methods, and an actual flight test is carried out to verify the performance of the proposed controller. Finally, in
Section 6 we present our concluding remarks.
3. Materials and Methods
In this section, we propose a controller based on the nonsingular global fast terminal sliding mode (NGFTSM) and an RBF neural network. The generalized state vector is computed by the dynamic model of the UAM and subtracted from the desired value to obtain the tracking error. Subsequently, the tracking error and its derivative are substituted into the nonlinear sliding mode surface function to calculate the sliding mode variable and imported into the proposed controller with this variable. To avoid uncertainties caused by disturbances and system imperfections and improve the trajectory tracking performance of the UAM, an RBF neural network estimates lumped disturbances containing the internal coupling, modelling errors and external disturbances and compensates for the controller.
is the state variable of the quadrotor, and
is the system input. Equation (13) can be rewritten as:
where
;
;
;
.
The general quadrotor system is divided into outer and inner rings, and the desired Euler angles are generated from the outer ring. In Equation (14), calculation of the outer-loop control input (
) requires
of the inner loop, which is unknown. Therefore, to eliminate the coupling between the inner and outer rings and possible algebraic-loop problems in simulation, we set
, yielding the new control input [
31]:
3.1. Position Controller Design
The system position error (
) and nonsingular global fast terminal sliding mode function (
) are defined as:
where
;
;
;
;
;
;
;
;
are all positive odd numbers; and
is the error switching function. The control law is expressed as follows.
where
;
is the robust term to overcome the neural network approximation error; and
is the estimation of the lumped disturbances of the position system from the RBF neural network. Therefore, the expected Euler angle of the inner ring can be calculated according to Equations (20)–(22) [
23].
where
is the unit vector of the
axis in the body coordinate system,
is the unit vector of the
axis in the body coordinate system,
is the desired yaw angle,
is the rotation matrix of the expected pose and
is a tangent function that is calculated as:
3.2. Attitude Controller Design
The tracking error and nonsingular global fast terminal sliding mode function of the attitude loop are defined as Equations (16) and (17), and the control input of the inner loop is obtained as follows.
where
is the lumped disturbances estimation of the attitude system from the RBF neural network. To avoid dynamic changes in the attitude system affecting the stability of the position system, attitude controller gains need to be adjusted to ensure that the attitude errors converge faster than the position errors [
31].
3.3. RBF Neural Network Design and Stability Judgement
Because the controllers have the same design form, the
channel is used as an example to design the RBF neural network.
where
is the network input;
is the ideal network weight;
is the network approximation error, where
;
and
are the Gaussian function parameters;
is the output of the Gaussian function; and
is the actual network output. The network input is defined as
, and the estimation output is defined as:
Because RBF neural networks have excellent generalization ability and approximation performance, we introduce a virtual variable (
). The virtual variable of the position system is defined as
, and the position dynamics model can be rewritten as:
Therefore, the time derivative of the sliding mode function and the estimation of the neural network can be obtained from Equations (18) and (19).
where
is the neural network estimation for each position system channel. To obtain the network weight (
) and prove the stability of the controller, the
channel is taken as an example to design the Lyapunov function.
Then,
is set as the sliding surface of the system, and Equation (17) can be rewritten as:
where
represents the process of the system approaching the sliding surface,
,
represents the process of neural network approximation for lumped disturbances and
represents the convergence process after the system reaches the sliding mode surface. Therefore, the time derivative of the Lyapunov function can be written as:
Accordingly,
, and the weight-adaptive law is defined as
. Because
are all positive numbers and
is an even number, we
,
and
. The system is asymptotically stable according to the Lyapunov stability criterion, and the error can gradually converge to zero from any initial value. In addition, the neural network output (
) of channel
can be obtained according to Equation (28). Similarly, the neural network output (
) of other channels can be determined. Hence, the lumped interference estimation of the position and attitude system can be expressed as:
4. Evaluation Criteria for UAM
In this section, we describe three sets of simulations to verify the feasibility and practicality of the proposed controller (composite nonsingular global fast terminal sliding mode controller, CNGFTSM), and the simulation results are assessed and analyzed in comparison with a nonsingular global fast terminal sliding mode controller (NGFTSM), sliding mode controller (SM) [
21] and sliding mode PID controller (SMPID) [
23]. A set of illustrative metrics are established to evaluate the performance of the proposed UAM controller.
The underactuated deficiency of the quadrotor makes the UAM system extremely sensitive to the impact of internal uncertainty and external disturbances during operation. Hence, the robustness of the controller is a crucial indicator to ensure the resistance of the system to these disturbances and reliable operation. The metric used to validate the system’s robustness involves comparison with two experimental dataset with and without disturbances; an error of less than 0.001 indicated the robustness of the system controller.
The convergence rate of the state vector is very high in the UAM system. The trajectory deviation caused by slow convergence of the system can lead to severe accidents. Therefore, to evaluate the system’s real-time performance, the convergence time is set as the time taken to complete trajectory tracking.
Accurate tracking of the desired trajectory is one of the most critical performance metrics for evaluation of UAM control systems. For the subsequent simulations, if the tracking error is stable at less than 0.001, the system is considered to meet the trajectory tracking target.
To simulate the external disturbances during flight, the disturbances are set as follows (parameters are listed
Table 1 and
Table 2).
5. Simulations Results
In this section, we present three simulations to verify the tracking performance of the proposed controller: aerial hovering, square trajectory and spiral trajectory tracking. External interference is shown in Equations (39) and (40). The desired yaw angle and the initial position of the aerial manipulator system are set to zero and (0, 0, 0), respectively. The manipulator swings continuously in states , and , .
5.1. Aerial Hovering
The system continues hovering at the initial position (0, 0, 0). As shown in
Figure 3, because the static disturbances occur within 0–10 s, the steady-state errors of NGFTSM, SM and SMPID controllers are more than 0.002 m, 0.02 m and 0.01 m in the
and
directions, respectively. Similarly, the errors of NGFTSM, SM and SMPID controllers change continuously within 10–30 s due to the dynamic disturbances. In contrast, the errors of the proposed CNGFTSM controller are nearly zero throughout the process. In addition, the average convergence times for CNGFTSM, NGFTSM, SM and SMPID to reach the steady-state error in the
and
directions are about 0.45 s, 0.35 s, 0.95 s and 0.91 s, respectively.
Figure 4 shows the error curves between the desired system and the actual attitude under the four control methods. The attitude tracking errors of the four controllers are minor with unchanged disturbances, whereas the roll and pitch angle curves of SMPID appear to oscillate when the disturbances change. However, the UAV motor is a mechanical device, and excessive changes in the amplitude of speed will produce considerable heat and violent vibration, eventually leading to mechanical failure. Therefore, vibration of the SMPID controller is not conducive to the mechanical characteristics of UAVs.
5.2. Square Trajectory Tracking
The expected square trajectory is as follows:
The overshoot part not shown in
Figure 5 is 5 or −5. The systems using NGFTSM, SM and SMPID controllers have obvious steady-state errors compared with the using a CNGFTSM controller. The average convergence times for the four controllers to reach the steady-state error in the
and
directions are about 0.45 s, 0.36 s, 1.03 s and 0.94 s, respectively. As shown in
Figure 5d, the actual flight trajectory of the system using the proposed controller almost coincides with the desired trajectory.
Figure 6 shows the error curves between the desired system and actual the attitude under the four control methods. Similar to the results presented in
Figure 4, the attitude tracking errors of the four controllers are minor in the 0–10 s range, whereas the controller SMPID oscillates in the 10–30 s range, possibly damaging the system’s mechanical characteristics. To evaluate the robustness of the four controllers, we subtract the result with disturbance from the result without disturbance, as shown in
Figure 7. With the excepting the robust error of CNGFTSM, which is almost zero, the other controllers have obvious robust errors in the
and
directions, with average values of 0.002 m, 0.023 m and 0.014 m, respectively.
5.3. Spiral Trajectory Tracking
The expected spiral trajectory of the UAM system is , and .
As shown in
Figure 8, in the
and
directions, the maximum errors of the CNGFTSM both are both 0.010 m; the NGFTSM errors in the
and
directions are 0.032 m and 0.038 m, respectively; those of SM are both 0.122 m; and those of SMPID are both are 0.113 m. In the
direction, the time required to reach the steady-state error are 0.46 s, 0.36 s, 0.76 s and 0.79 s, and the maximum errors are 0.01 m, 0.037 m, 0.123 m and 0.113 m, for the CNGFTSM, NGFTSM, SM and SMPID controllers, respectively.
Figure 8d shows the actual and desired trajectory of the system. Owing to the estimation and compensation of the RBF neural network, the position control accuracy of CNGFTSM is improved by more than 300% compared with NGFTSM.
Figure 9 and
Figure 10 show the attitude and robustness error curves of the four controllers. Similar to the previous experimental results, the attitude tracking errors are minor, with the exception of those of the SMPID controller, and controllers have obvious and continuously varying robust errors in the three directions, with the exception of the proposed controller. The simulation results are shown in
Table 3,
Table 4 and
Table 5.
According to the results presented in
Table 3,
Table 4 and
Table 5, the robustness and precision errors of the CNGFTSM controller are considerably less than 0.001 m, meeting the requirements of robustness and accuracy. On the contrary, NGFTSM only meets the robustness requirement, and SM and SMPID meet neither the robustness nor the accuracy requirements. The average errors of each term based on the simulation results are shown in
Figure 11 for a comprehensive comparison of the controllers; the outer position line indicates a better ability. With the addition of a neural network module, the CNGFTSM convergence is slightly slower than that of the NGFTSM controller. Therefore, the CNGFTSM controller is suitable for applications with anti-disturbance and high-precision requirements. On the contrary, the NGFTSM controller is appropriate for applications requiring rapid response. In the next stage, we attempt to improve the convergence performance using neural networks to replace part of the model information to reduce computation requirements.
In summary, the CNGFTSM controller achieved the best performance, followed by the NGFTSM, SM and SMPID controllers. Moreover, a comparison of the NGFTSM controller with SM and SMPID controllers, reveals that the proposed nonsingular global fast terminal sliding mode has anti-disturbance ability, meeting the requirements of a fast variable system. Although we do not propose evaluation criteria for the RBF neural network, it has excellent compensation ability is robust according to a comparison the CNGFTSM and NGFTSM simulation results.
6. Experimental Results
In this section, an experimental flight test of the aerial manipulator is carried out using the proposed control strategy. The quadrotor used in the experiment is shown in
Figure 12, and the aerial manipulator used in the experiment is shown in
Figure 13, consisting of a quadrotor and a manipulator. The quadrotor is equipped with 12-inch propellers, with a total diameter of 500 mm. It uses a Pixhawk autopilot board for low-level control of the quadrotor and a Raspberry Pi computer to run the control algorithm. The robotic arm is installed at the bottom of the quadrotor, consisting of a three-degrees-of-freedom robotic arm and a manipulator gripper; the battery is located opposite to the robotic arm to avoid the center of gravity leaning too far forward.
In the experiment, we place a fan to generate two levels of external disturbances corresponding to two levels of wind. After the quadrotor is armed under the manual control, autopilot is enabled. The expected height is 1.8 m. When the aerial manipulator reaches the desired height, a polygon trajectory is used as the expected trajectory for tracking.
Figure 13 shows the position of the aerial manipulator in the trajectory tracking experiment. The average errors in the
and
directions are less 0.02 m, and the convergence times are about 0.55 s. The actual trajectory can closely track the desired trajectory, and the tracking errors are almost unchanged under the influence of external disturbances, changing from zero to the first-gear wind to the second-gear wind. Therefore, the system using the proposed controller achieves staisfactory response with minor trajectory tracking errors, fulfilling our requirements. The flight test results are shown in
Figure 14.