1. Introduction
In recent years, robot manipulators have been widely used in many fields, such as manufacturing [
1], assembly [
2], grinding [
3], and drilling [
4]. However, these robotic arms are almost always mounted on fixed bases, significantly limiting their working space. In order to expand the operating space, installing the manipulator on a non-fixed platform for operation has become a hot topic in current research. As a combination of aerial platform and manipulator, the aerial manipulator has better maneuverability in three-dimensional space and flexibility to operate. It has consequential value in multiple domains like national defense, rescue, and scientific research and has recently attracted more and more attention from researchers.
The Unmanned Aerial Vehicle (UAV) platform and the manipulator are both highly nonlinear systems, and their combination makes the entire system more complex. In addition, external interference and internal uncertainty make it more difficult to control the system accurately. Some researchers treat the UAV and the manipulator as an entirety, establish a unified model, and design a set of controllers to control all system states directly [
5,
6,
7]. However, the system developed by this method has high dimensions. For embedded systems such as aerial manipulators, their computing resources are limited, making it hard to realize real-time calculation of the system state. Especially when the load of the manipulator changes or contact force occurs with the external environment, the accuracy of the coupling model established offline is incredibly reduced, which will seriously affect the controller’s performance. Therefore, many researchers regard the UAV platform and the manipulator as two separate subsystems and the interaction between them as mutual disturbances, which dramatically reduces the dimensionality of the system model. By designing controllers for each subsystem, the controller’s performance can be effectively improved [
8,
9,
10,
11,
12]. These studies use multi-rotors as motion platforms to drive manipulators to complete operating tasks. However, the body coordinate system of the multi-rotor changes constantly when it is moving, which causes the coordinate system of the manipulator to change with the body coordinate system constantly. Continuous coordinate transformation will seriously affect the accuracy of control. Therefore, a more stable contact method and robust controller are needed to achieve high-precision contact force operations.
In this paper, we propose an adaptive robust control strategy based on impedance control for the aerial manipulator to exert the contact force accurately. The main contributions can be summarized as follows:
By discussing the characteristics of aerial operations, a new operating mode for aerial manipulators is designed, in which the UAV platform only provides a fixed fulcrum in the air, and the manipulator works as the fixed manipulator.
A nonsingular global fast terminal sliding mode control (NGFTSMC) method is proposed, which can quickly converge the state error in a limited time to achieve accurate trajectory tracking of UAVs and robotic arms. Furthermore, to make the system resistant to the model’s uncertainty, RBFNN is used to estimate the part of the controller that contains the model information.
A double-layer control structure is designed to achieve compliant contact between the manipulator and the target and reduce the impact of contact force on the stability of the aerial manipulation system. The outer layer impedance control converts the expected contact force into the desired position trajectory, and the inner layer position control realizes the trajectory tracking of the desired position.
The rest of this article is organized as follows.
Section 2 provides an overview of related work.
Section 3 describes the dynamics model of the UAV platform and the manipulator, respectively.
Section 4 designs robust sliding mode controllers based on adaptive RBFNN for both subsystems and an impedance controller for the compliant contact of the aerial manipulator. The simulation and experimental results and analysis are shown in
Section 5 and
Section 6. Finally,
Section 7 gives the conclusion.
2. Related Work
The fixed base in the air dramatically expands the operating range of the manipulator, but the key to achieving an aerial fixed base is precise trajectory tracking. The multirotor is an underactuated, strongly coupled nonlinear system, and its sensitivity to internal uncertainty and external disturbances is essential to its stability. Moreover, the manipulator’s movement and the target’s reaction force also seriously affect the stability of the multirotor. Designing effectively robust controllers to fix these problems poses a significant challenge to researchers.
Many studies have shown that the sliding mode controller is one of the most effectively robust control techniques. Almakhles DJ designed a double-loop control structure and proposed a controller with integral sliding mode and backstepping sliding mode methods to ensure the position trajectory tracking capability under uncertainties [
13]. Labbadi M improved proportional integral differential sliding mode control with the super-twist algorithm, providing good robustness against the time-varying external disturbances, solving the chattering issue, and avoiding discontinuousness of input signals [
14]. Wang X proposed a sensor-based Incremental Nonlinear Dynamic Inversion Sliding Mode Control driven by Sliding Mode Disturbance Observers, which can simultaneously reduce the model dependency of the controller and the uncertainties in the closed-loop system [
15]. However, the traditional sliding mode control method cannot guarantee the rapid convergence of trajectory tracking within a limited time, which is an enormous disadvantage for real-time systems. Therefore, terminal sliding mode control methods were proposed to solve this problem. Labbadi M designed a double-loop control strategy, where the outer layer utilizes a robust adaptive back-stepping controller to control the position, and the inner layer uses a controller that combined back-stepping and fast terminal sliding modes to control the attitude [
16]. Nekoukar V suggested a new robust flight control system consisting of an adaptive fuzzy terminal sliding mode controller and two proportional-derivative controllers to guarantee flight stability and efficient tracking of pre-defined paths [
17]. Tripathi VK designed a finite-time super-twisting sliding mode control scheme to assure finite-time convergence of tracking error with chattering attenuation and developed a high-order sliding mode observer to determine unknown bounded lumped disturbances acting on the quadrotor [
18]. In [
19], he also proposed an adaptive fast terminal sliding-mode controller with a power ratio proportional reaching law, which can track the position and altitude of a quadrotor with parametric uncertainties and external disturbances. Razmjooei H presented a time-varying chattering-free disturbance observer-based position tracking control law of serial robotic manipulators to track a reference signal in a finite time and employ a positive-increasing function associated with the control/observer objectives to improve the control performance [
20].
The design of the above controllers depends on the system model. Nevertheless, the parameters of the system model often change during actual operation, which will seriously deteriorate the performance of the controller. The Radial Basis Function Neural Network (RBFNN) is a special type of neural network structure that can design an adaptive rate based on the Lyapunov stability theorem. It has strong self-learning and nonlinear mapping abilities and can approximate any nonlinear function. Therefore, many controllers are designed based on RBFNN to eliminate their dependence on the system model and compensate for uncertain signals to obtain better trajectory tracking effects. Luo H developed a robust double-loop control scheme for quadrotor speed and attitude tracking, where the outer loop was designed with a coupling controller to ensure velocity tracking based on the stability of altitude tracking control and the inner loop to control the attitude by utilizing the RBFNN to compensate for model disturbance uncertainty [
21]. Tao M proposed a singularity-free terminal sliding mode control scheme improved by RBFNN and Extended State Observer (ESO) that does not require prior knowledge about unknown nonlinear uncertainties and external disturbances for quadrotor UAVs [
22]. Zhang Q proposed a terminal sliding mode attitude controller based on the RBFNN uncertainty compensator and optimized it via a particle swarm intelligence algorithm with two fitness functions, solving the non-unique actuator action caused by over-actuation of the tilt-rotor quadcopter [
23]. Huang S proposed a non-singular fast terminal sliding mode controller for trajectory tracking control of the quadrotor, with a disturbance observer to estimate the external interference and a neural network approximator to develop an online estimate of the model uncertainty [
24].
The manipulator is the operational part of the aerial manipulation system. Environmental constraints restrict the movement of the manipulator and generate contact forces. To reduce the impact of the target’s reaction force on the entire aerial manipulation system, the contact between the manipulator and the target should be compliant. Compliance control has been widely used in robotics, such as welding [
25], polishing [
26], and human–computer interaction [
27]. Traditional compliance control methods include force/position hybrid control [
28] and impedance control [
29]. In actual environments, the contact between the manipulator and the target has problems of low absolute accuracy and lack of real pose information, which makes force/position hybrid control hard to achieve. Nonetheless, the impedance control theory applies the manipulator’s motion trajectory and contact force to a dynamic framework, so the contact force can be controlled by following the position trajectory. Therefore, the manipulator also needs to design a high-precision trajectory-tracking controller.
The relevant theories for designing trajectory-tracking controllers for quadrotors are also widely used in manipulators. Tran DT proposed a non-singular fast terminal sliding mode controller for manipulator position tracking and used adaptive RBFNN to approximate and eliminate uncertainties [
30]. Zhang W utilized the fractional-order method in the proposed non-singular fast terminal sliding mode controller to improve the tracking performance of the controller and designed RBFNN to approximate the unknown nonlinear function of the system to accomplish model-free control [
31]. Jie W proposed a fast fractional-order terminal sliding mode controller with a new perturbation estimator that applied the data-driven method RBFNN to compensate for the estimation error in the conventional sliding perturbation observer to improve the tracking accuracy and reduce the chattering [
32]. Kim SJ proposed an adaptive robust RBFNN non-singular terminal sliding mode controller to reduce swinging in the snake robot’s head where the RBFNN compensates for interference and an adaptive robust term to make up for the shortcomings of neural network control to eliminate system chattering [
33].
This study designed a new contact force control strategy based on the aerial manipulation system composed of a multirotor UAV and a multi-joint manipulator. First, to provide a fixed aerial platform for the manipulator, a non-singular global fast terminal sliding mode controller based on RBFNN was designed for accurate trajectory tracking. Then, a double-loop control scheme was designed for the compliant contact between the manipulator and the target. The outer loop used a position-based impedance controller to generate the desired trajectory, and the inner loop proposed a trajectory-tracking control algorithm based on the design concept of the UAV platform controller.
3. System Modeling
The aerial manipulation system consists of a multirotor UAV and an n-link manipulator. The system structure is shown in
Figure 1.
In
Figure 1,
represents the inertial coordinate system with the origin at
,
represents the multirotor body coordinate system with the origin at
,
represents the end-effector coordinate system with the origin at
, and
is the angle of rotation of the i-th link manipulator.
To simplify the system structure, we assume:
(1) The body of the multirotor and manipulator is rigid, and the structure is symmetrical.
(2) The masses of the multirotor and manipulator are evenly distributed, and the centers of mass coincide with the geometric centers.
Combining the multirotor and manipulator increases the control dimension of the entire system. For embedded systems such as aerial manipulators, real-time high-dimensional matrix transformation calculation is hard to achieve. Therefore, this study regards the multirotor and the manipulator as two independent subsystems. The multirotor subsystem is only used as a fixed aerial platform, while the manipulator subsystem is only used as the operating tool. The forces between them are regarded as mutual disturbances. Based on this setting, we built the models of two subsystems separately.
3.1. Multirotor Platform Modeling
Assuming that the multirotor is rigid, its dynamic equation can be described using the Newton–Euler formula as follows:
where
and
represent the position and Euler angle of the multirotor in the inertial coordinate system, respectively;
is the mass of the entire aerial manipulator;
is the acceleration of gravity;
is the unit vector along the
axis in the inertial coordinate system;
and
represent the inertia and coriolis matrix in the inertial coordinate system;
and
represent the thrust force and disturbance generated by the multirotor in the translational direction; and
and
represent the torque and disturbance received in the rotational direction.
The rotation matrix
from the multirotor body coordinate system
to the inertial coordinate system
can be expressed as
The movement process of aerial manipulators aiming at accomplishing precise contact operations is usually performed within a restricted range. This type of operation requires high stability of the multirotor platform but low requirements for its maneuverability. Therefore, when the multirotor UAV runs at a low speed and small angle, Equation (1) can be rewritten through simplification and decoupling as
where
represents the inertia matrix of the aerial manipulator;
represents the rotational inertia of the multirotor motor;
represents the total remaining speed of the multirotor motor;
is the control input of the multirotor; and
represents the lumped disturbance caused by the internal uncertainty, the external environment, and the action of the manipulator.
3.2. Manipulator Modeling
According to Newton–Euler’s theorem, the Cartesian dynamics equation of an n-DOF (Degree of Freedom) rigid robot manipulator system can be expressed as
where
is the joint angular vector of the
i-link manipulator,
represent the joint angular velocity vector and acceleration vector of the manipulator,
is the symmetric positive definite inertia matrix,
is the centrifugal force and coriolis force matrix,
is the gravity matrix,
is the joint torque control input vector,
is the torque vector of the interaction between the manipulator and the target, and
is the lumped disturbance of the manipulator.
Let
be the position vector of the end effector in the task space. Joint space can be mapped to task space through forward kinematics as follows:
where
is the mapping relationship from the joint space to the task space. Therefore, the relationship between the velocity in joint space and the velocity in task space can be described as
where the Jacobian matrix
represents the relationship between the virtual end effector speed and the virtual joint speed. By differentiating Equation (7), the acceleration term of the end effector is determined as
Then, the dynamics of the manipulator in the task space can be expressed as
3.3. Aerial Platform Attitude Compensation
The contact force between the manipulator and the target is generated by the torque of the manipulator motor, and the corresponding counter-torque acts on the aerial platform and is offset by the thrust generated by the multirotor. Since the lift of the propeller is the only source of power for the aerial manipulator in the air, it can be considered that the contact force is generated by the thrust of the multirotor. Therefore, in order for the manipulator to exert a stable contact force on the target, the multirotor platform should always stay hovering. According to Equation (3), disregarding the influence of disturbance, the equilibrium relationship of contact force exerted in the hovering state can be obtained as
In this study, the manipulator generates contact force with the vertical target in a point contact mode, so
and
. We can set the yaw angle
; then according to Equation (10), the contact force
can be calculated as
It can be seen that
is determined by the gravity
and pitch angle
of the quadrotor. Since the gravity of the aerial manipulator is constant, the value of
corresponds to the pitch angle
one-to-one. Therefore, when the desired contact force is
, the desired pitch angle
of the multirotor can be calculated as
As the aerial platform for the manipulator, changes in the attitude of the multirotor will change the relationship between the manipulator coordinate system and the inertial coordinate system. To prevent the kinematic models of the two subsystems from interfering with each other, the changes in the attitude of the multirotor should be compensated by the corresponding angle of the manipulator joint rotation so that the multirotor can be regarded as a fixed platform in the air. The above analysis is illustrated in
Figure 2.
4. Controller Design and Stability Analysis
In this part, we first designed a robust trajectory-tracking controller for the multirotor and used RBFNN to eliminate the controller’s dependence on the system model. Then, to achieve the compliance contact of the manipulator, an impedance position controller was devised to obtain the manipulator’s desired trajectory. Finally, bringing in the multirotor controller’s design theories, the manipulator’s trajectory-tracking controller was developed.
4.1. Multirotor Platform Controller Design
Taking the height controller as an example, the height error is defined as
where
is the desired height. We can design the nonsingular fast terminal sliding mode surface as
where
,
,
and
are positive odd numbers and satisfy
.
is the switching function of the error.
Taking the time derivative of Equation (14),
Equation (11) can be rewritten as follows by substituting Equation (3):
In order to promote the system state to reach the sliding surface during the entire approximation process quickly, the fast arrival law is proposed as
where
,
,
and
. According to Equations (17) and (18), the controller
is designed as
where
is the robust term of the controller; its function is to overcome the influence of external disturbance on the system trajectory and guide it to move to the sliding mode surface. We can define the Lyapunov function as
Taking the time derivative of Equation (20) and substituting Equation (17)
Substituting Equation (19) into Equation (21),
can be deduced as
When
,
, the system converges stably. According to the sliding mode control theory, the equivalent part of the designed controller is
The equivalent controller is related to the system model. In order to eliminate the impact of model uncertainty on the controller, we introduce the RBF neural network to estimate the equivalent controller. We can define the input of the RBF neural network as
, and the equivalent control in Equation (23) is the ideal RBF neural network output, which can be expressed as
where
is the ideal weight of the neural network,
is a small positive real number that represents the approximation error of the neural network to the nonlinear uncertain function, and
is the Gaussian function that nonlinear mapping of the neural network, which can be expressed as
where
and
are the center value and width of the Gaussian function, and
is the number of neurons in the hidden layer of the network. We can let
be the approximation output of the RBF neural network to the equivalent controller
:
where
is the approximation weight of the RBF neural network. We can define the error induced by the neural network estimation as
where
. Redesign
as
where
. Equation (17) can be rewritten as
We can design the Lyapunov function as
Equation (30) can be rewritten as follows by taking the time derivative:
We can define the adaptive law as
When
,
, the system is stable. The structure of the proposed nonsingular global fast terminal sliding mode controller based on RBF neural network is shown in
Figure 3.
Controllers for other system states can be designed according to the same technique. However, the horizontal states and Euler angles are coupled, and they need to be decoupled by set virtual control variables before the controller can be designed.
4.2. Manipulator Controller Design
The multirotor platform’s high-precision trajectory tracking performance can provide a steady aerial base. However, the reaction force generated by the contact between the manipulator and the target will significantly impact the stability of the entire system, making the contact force uncontrollable. In order to make the contact between the manipulator and the target compliant and the contact force change smoothly, this paper proposes a double-loop control structure. The outer loop is position-based impedance control, which converts the desired contact force into the desired position trajectory. The inner loop is a trajectory-tracking controller that accurately tracks the position trajectory generated by the outer loop.
4.2.1. Outer Loop Position-Based Impedance Control
The contact procedure of the manipulator and the target is divided into two stages. The first stage involves the manipulator approaching the target, which is free space control. The desired position is the target position, where the flying robotic arm comes into contact with the environment. The second stage is manipulator contact with the target, which is restricted space control, and the desired position is generated by the desired force. To reduce contact impact on the system, an additional impedance control loop is added beside the position control. Based on the impedance relationship model, impedance control has the advantage of having force and position in the same framework, and the relationship between them can be adjusted by changing the impedance parameters. Commonly, the mathematical model of the impedance relationship can be expressed in terms of a second-order differential equation.
where
,
,
are the required inertia, damping and stiffness matrices, respectively, and
is the contact force that is exerted by the manipulator on the target measured by the sensor.
is the error between the planned reference trajectory
and the expected trajectory
calculated based on the contact force, which can be obtained from the Laplace transform of Equation (33) as
During the two stages of the contact process, the expected trajectory of the inner position control loop is
The reference trajectory
is determined by the position and parameters of the manipulator, the impedance controller parameters, and the desired contact force
. Equation (33) can be rewritten as
The contact force is usually determined by the stiffness and damping parameters of the target, and it can be described by the following second-order nonlinear function.
where
and
are the target’s diagonal positive definite stiffness matrices and damping matrices, respectively. Taking the contact force in a single direction as an example, Equations (36) and (37) can be rewritten as
Equation (38) can be expressed as follows by computing Laplace transforms:
According to Equation (39), the planned reference position trajectory can be derived as
4.2.2. Inner Loop Trajectory Tracking Control
In position-based impedance control, the force tracking performance depends on the accuracy of the inner loop position control. Here, we use the same robust control strategy as the multirotor platform and define the position error of the manipulator as
We can design the nonsingular fast terminal sliding mode surface as
where
and
are positive definite diagonal matrices, and
and
are positive odd numbers and satisfy
. Taking the time derivative of Equation (42) results in
Let
where
, and Equation (43) can be rewritten as
Since
contains all model information, the RBF neural network can be used to approximate
to design a robust controller that does not require any model information. We can define the input of RBF neural network as
; the approximate output of the RBF neural network to the equivalent controller
is
The ideal RBF neural network equivalent control output in Equation (45) is defined as
The estimation error of the neural network is
We can define the nonsingular global fast terminal sliding mode controller as
where
and
are positive definite diagonal matrices,
is the ratio of two odd integers, and
. By substituting Equation (49), Equation (45) can be rewritten as
We can define the Lyapunov function as
Equation (51) can be rewritten as follows by taking the time derivative:
The manipulator dynamic model parameters are skewed symmetrically, so
We can define RBF neural network adaptive law as
Equation (52) can be written as follows by substituting Equations (53) and (54):
When
and
,
, the closed-loop system is stable. Based on the above analysis, the structure of the manipulator control system is shown in
Figure 4.
6. Experiments
In this section, some experiments are accomplished to verify the effectiveness of the proposed controller in exerting precise contact force on a target using the aerial manipulator. The quadrotor base of the aerial manipulator used in the experiment is a 680 mm diameter quadrotor equipped with four 15-inch propellers and a Pixhawk autopilot for low-level driver control. The manipulator is a planar three-link arm installed at the bottom of the quadrotor base. The control algorithms for the quadrotor and manipulator are executed on a Raspberry Pi 4b onboard computer. In addition, a motion-capture system and a pressure-detection system are used to measure the position, attitude, and contact force of the aerial manipulation system precisely. The photograph of the contact force experiment is pictured in
Figure 11.
Figure 12 exhibits the variation in Euler angles of the quadrotor platform over time in the experiment. It can be noticed that both controllers can quickly converge the system state to the desired trajectory. However, the state vector fluctuations of the system controlled by NGFTSMC based on RBFNN are minor compared to regular NGFTSMC, where the roll angle and pitch angle are 30%, and the yaw angle is 10%. The influence of external disturbances is not obvious in the laboratory conditions, which would be the reason that the controller performs very well. In addition, there were notable oscillations in roll and pitch at the 5th second. This is because the manipulator generates a large counter-torque at the moment of operation, which dramatically impacts the stability of the quadrotor platform. However, the rapid convergence of the controller allowed the quadrotor platform to quickly restore balance without affecting the operation of the manipulator. Moreover, weight convergence can be observed in
Figure 13.
Figure 14 illustrates the contact force between the aerial manipulator and the target measured by the pressure detection system, and
Figure 15 depicts the error between the measured and expected contact forces. It can be concluded that in the control system of NGFTSMC based on RBFNN, the contact force error can be controlled within 0.25 N, which is 30% of that of the regular NGFTSMC-controlled system. The results indicate that the proposed control scheme is effective in achieving precise contact force between the aerial manipulator and the target. Through analysis, it can be understood that the stronger the anti-interference ability of the quadrotor platform, the higher the accuracy of the contact force between the aerial manipulator and the target.
7. Conclusions
This study analyzes the characteristics of aerial contact operations and proposes a new control strategy for the aerial manipulation system. The multirotor and manipulator are controlled separately as two independent subsystems of the aerial manipulator. The multirotor subsystem exclusively serves as an aerial platform for the manipulator, providing a stable base in the air. Meanwhile, the manipulator subsystem merely performs contact force operations as an instrument. The interactions between both subsystems are regarded as mutual disturbances. First, each subsystem is modeled separately, and the mutual effects are analyzed and expressed using kinematic methods. Then, a robust sliding mode controller is developed for the aerial platform subsystem, and an adaptive RBF neural network controller is designed to eliminate the dependence on the system model through online learning. In addition, a double-loop impedance position controller is devised for the manipulator to execute compliant control of the contact force between the manipulator and the target. The simulation results indicate that the proposed control strategy has good trajectory-tracking capabilities and can accurately control the contact force. Finally, the experiment verified the effectiveness of the proposed control method, showing that the contact force error between the aerial manipulator and the target can be controlled within 0.25 N, which is 30% of the error of the comparative control scheme.
In this work, the impedance parameters of the target are known, but in unknown en-vironments, the impedance parameters of the target cannot be obtained directly. Future work will focus on using the learning method to generate the desired position only by the desired force and minimize the position error without knowing the environment or the impedance parameters.