Next Article in Journal
Introducing Mobile Collaborative Robots into Bioprocessing Environments: Personalised Drug Manufacturing and Environmental Monitoring
Previous Article in Journal
A Parallel Quantum Circuit Implementations of LSH Hash Function for Use with Grover’s Algorithm
Previous Article in Special Issue
Robust Quadratic Optimal Control for Discrete-Time Linear Systems with Non-Stochastic Noises
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Trajectory Planning of Aerial Robotic Manipulator Using Hybrid Particle Swarm Optimization

1
Autonomous Unmanned Systems Research Laboratory, Xi’an Technological University, Xi’an 710021, China
2
School of Electronic Information Engineering, Xi’an Technological University, Xi’an 710021, China
3
Department of Mechanical and Energy Engineering, Southern University of Science and Technology, Shenzhen 518005, China
*
Authors to whom correspondence should be addressed.
Appl. Sci. 2022, 12(21), 10892; https://doi.org/10.3390/app122110892
Submission received: 20 September 2022 / Revised: 16 October 2022 / Accepted: 21 October 2022 / Published: 27 October 2022

Abstract

:
The trajectory planning of an aerial robotic manipulator system is studied using Hybrid Particle Swarm Optimization (HPSO). The aerial robotic manipulator is composed of an unmanned aerial vehicle (UAV) base and a robotic manipulator. The robotic manipulator is dynamically singular. In addition, strong coupling exists between the UAV base and the robotic manipulator. To overcome the problems, the trajectory planning is studied in the join space using HPSO. HPSO combines superiorities of PSO and GA (Genetic Algorithm), prohibiting particles from becoming trapped in a local minimum. In addition, the control parameters are self-adaptive and contribute to fast searching for the global optimum. The trajectory planning problem is converted into a parameter optimization problem. Each joint trajectory is parameterized with a Bézier curve. The HPSO is implemented to optimize joint trajectories, satisfying specific objectives and imposed constraints. Numerical simulations are also carried out to validate the effectiveness of the proposed method.

1. Introduction

AErial RObotic Manipulators (AEROMs) [1,2] are combined systems, composed of mobile platforms and robotic manipulators. The mobile platform system is usually a UAV, while the robotic manipulator system includes one or several arms. The increasing demands of aerial pipeline maintenance, bridge inspection, fruit picking, etc. call for application of aerial robotic manipulators to perform tasks in aerial environment. Examples include “Aerial Cognitive Integrated Multi-task Robotic System with Extended Operation Range and Safety” [3], “Aerial Robotic Training for the Next Generation of European Infrastructure and Asset Maintenance Technologies” [4], “Hybrid Flying-rollIng with Snake-arm Robot for Contact Inspection” [5] and “Aerial Robotic System Integrating Multiple Arms” [6]. In these programs, aerial missions are performed with various categories of aerial robotic manipulators, as shown in Figure 1. In Figure 1a–c, the robotic manipulator locates on the top of UAV base, opposite to Figure 1d–f. A category of combined system is of great interest to both scientists and practitioners. As shown in Figure 1a,d, the system consists of a UAV and a single-arm robotic manipulator. This is because the modelling is with lower difficulty and the system is easily controlled. However, the combined system still exhibits some special characteristics. Strong coupling exists between the robotic manipulator and the UAV. Moreover, the manipulator is dynamically singular. Accordingly, specific trajectory planning strategies have to be investigated to cope with the aforementioned problems.
The developments of an AEROM system includes structure design, mathematical modelling, trajectory planning, control, etc. Actually, an AEROM model includes two parts, the kinematic model and the dynamic model. The trajectory planning is studied on the basis of AEROM kinematics [7,8], while the control development is based on both kinematics and dynamics [9]. The trajectory planning aims at optimizing joint trajectories, end-effector trajectories or UAV trajectories. As a matter of fact, the trajectory planning has been well developed for robots in outer space [7,8], where the satellite base is usually under free-floating mode. Two common trajectory planning techniques are respectively based on inverse kinematics and forward kinematics. For the technique using inverse kinematics, various concepts have been proposed, including Generalized Jacobian Matrix [9], Enhanced Disturbance Map [10], Path Dependent/Independent workspace [11] and Reaction Null Space [12]. However, this approach can result in singularities. This shortage is well avoided in the technique using forward kinematics, where the trajectory planning issue is transformed into an optimization issue. Intelligent Optimization Algorithms (IOAs) are utilized to solve the optimization issue. The procedure based on forward kinematics is followed. In order to perform optimization, joint trajectories are firstly parametrized with mathematical functions such as sinusoidal functions [13,14], polynomial functions [15,16], spline functions [17,18], etc. Second, a few function coefficients are evaluated according to initial conditions, including joint angles, joint velocities, joint accelerations or EE pose at initial time or final time. Third, values of unknown function coefficients are searched via IOAs, in conjunction with fitness functions and constraint conditions. Common IOAs include evolutionary algorithms like GA [19,20] and Differential Evolution (DE) algorithm [21,22], swarm intelligence algorithms like PSO [23,24] and Ant Colony Optimization [25,26], Neural Network Algorithm [27,28], etc. Fitness functions are usually minimum path length, time spent or energy cost. Constraint conditions denote limits on joint angles, joint velocities and joint accelerations.
This paper proposes a novel approach for trajectory planning of an aerial robotic manipulator, coping with multiple constraints and objectives. The Bézier curves are utilized to represent joint trajectories, with the superiority of simply coping with constraints. HPSO is implemented to search for optimal solution of the optimization problem. HPSO is an improved PSO combining the superiorities of PSO and GA. Furthermore, the control parameters of HPSO have self-adaptive characteristics.
The paper is organized as follows. Section 2 presents a kinematic model and dynamic model of the aerial robotic manipulator system. Afterwards, the trajectory planning problem is discussed in Section 3. The delineation of the problem as an optimization issue is also shown in this section. Section 4 develops the HPSO, the selection of cost functions and the handling of constraints. Section 5 tests the performance of the proposed method, including discussion about the simulation results. Conclusions are listed in Section 6.

2. Kinematics and Dynamics of Aerial Robotic Manipulator

Figure 2 shows the 2-D sketch of an AEROM system composed of n+1 bodies. The UAV mobile platform denotes the base and is remarked as body B0. The robotic manipulator is a single arm with n bodies and an EE. Adjacent bodies are connected with a revolute joint with one degree of freedom (DOF). Table 1 lists meanings of symbols and variables in Figure 2. Axes of Σ0 are respectively parallel to axes of ΣI at the initial time of the system maneuver. The axes of Σe are also parallel to the axes of Σn at the initial time. The frames Σi (i = 1, …, n) are built using the Denavit–Hartenberg (D-H) approach [29,30]. The detailed procedure is summarized as follows:
  • Align the axis Zi and the origin Oi. Zi is located at the (i+1)th joint, and Oi denotes the crosspoint of Zi and common perpendicular of Zi and Zi−1.
  • Align the axis Xi. The Xi-axis is along the common perpendicular of Zi and Zi−1, and the direction is from Ji to Ji−1.
  • Align the axis Ji according to the right-hand rule.
Along with establishment of frames Σi, four categories of D-H parameters are constructed as follows.
  • ai—The distance between Zi and Zi+1 along Xi.
  • αi—The angle from Zi to Zi+1 around Xi.
  • di—The distance between Xi−1 and Xi along Zi.
  • θi—The angle from Xi−1 to Xi around Zi.
In this paper, the AEROM system is considered as a unique entity. Each component B i (i = 0, …, n) of AEROM is assumed to be a rigid body with uniform mass distribution. The center of mass of B i is located at the geometric center C i . On the basis of Figure 2, positions of ith body centre and EE are depicted as:
r i = r 0 + b 0 + k = 1 i 1 ( a k + b k ) + a i
p e = r 0 + b 0 + k = 1 n ( a k + b k )
Taking the derivatives of r i and p e , the linear velocities of ith body centre and EE are then formulated as:
v i = r ˙ i = v b + ω b × ( r i r 0 ) + k = 1 i [ k k × ( r i p k ) ] q ˙ k
v e = p ˙ e = v b + ω b × ( p e r 0 ) + k = 1 n [ k k × ( p e p k ) ] q ˙ k
where v i R 3 , v e R 3 , v b R 3 and ω b R 3 . k i R 3 denotes the unit rotational velocity of ith joint. v b and ω b are, respectively, the linear velocity and angular velocity of the UAV base. Angular velocities of ith body centre and EE are calculated as:
ω i = ω b + k = 1 i k k q ˙ k
ω e = ω b + k = 1 n k k q ˙ k
where ω i R 3 and ω e R 3 . Combining Equations (4) and (6), EE velocity is given as follows:
χ ˙ e = v e ω e = J b v b ω b + J m q ˙
where J b R 6 × 6 and J m R 6 × n are, respectively, Jacobian matrices of the UAV base and the robotic manipulator. q = q 1 , , q n R n denotes joint configuration, where q i ( i = 1 , , n ) denotes the ith joint angle. q ˙ denotes the velocity vector of n joints.
In the first case, the pose of UAV base is invariable (i.e., position and attitude of UAV are controlled). The first term of right-hand side in Equation (7) is 0 , shown as:
χ ˙ e = J m q ˙
In the second case, pose of UAV base is free (i.e., position and attitude of UAV are not controlled). Assume gravity of each component of AEROM system is exactly compensated by corresponding rotors or servo-motors, the resultant of external force acting on the AEROM system is 0 . Then, the AEROM system satisfies the conservation of momentum, shown as follows:
H b χ ˙ b + H bm q ˙ = C
where χ ˙ b = v b ; ω b . H b R 6 × 6 is inertia matrix of UAV base and has the ortho-symmetric property. H bm R 6 × n is coupling inertia matrix of UAV base and robotic manipulator, and C is a constant vector. The constant C is usually set as 0 [7,8,31]; the same goes for this case. Then, the UAV velocity is formulated as: χ ˙ b = H b 1 H bm q ˙ . According to the Equation (7) and the Conservation of Momentum (9), the EE velocity is formulated as:
χ ˙ e = v e ω e = J m J b H b 1 H bm q ˙ = J g q ˙
The Equations (8) and (10) are, namely, differential kinematic equations of AEROM system in the above two cases. The AEROM dynamics are necessary to control the EE of robotic manipulator. The Lagrange–Euler approach [30,32,33] directly calculates the variations of the moment of inertia, vital for analysing the stability of controlling AEROM. The kinetic energy E k and the potential energy E p can be firstly obtained [32], formulated as:
E k = 1 2 χ ˙ b q ˙ T H b H bm H bm T H m T χ ˙ b q ˙
E p = i = 1 n m i G T b 0 + k = 1 i AC j - 1 AC j
where χ ˙ b = v b ; ω b . H b R 6 × 6 and H m R n × n are respectively inertia matrices of UAV base and robotic manipulator. H bm R 6 × n is the coupling inertia matrix of UAV and manipulator. AC j are matrices related to b i , p i , r i , k i , etc. m i denotes the mass of the ith body. Then, the dynamic equation of AEROM system can be derived through the Lagrange–Euler approach [33], shown as:
H b H bm H bm T H m T χ ¨ b q ¨ + C b C m + G b G m = F p τ m
where H b R 6 × 6 and H m R n × n are, respectively, inertia matrices of UAV base and robotic manipulator. H bm R 6 × n is the coupling inertia matrix of UAV and manipulator. The work [32] describes the difference between H b and H b , and the difference between H bm and H m . C b R 6 × 1 and C m R n × 1 are respectively the Coriolis force and the centrifugal force. G b R 6 × 1 and G m R n × 1 are gravity items related to UAV base and robotic manipulator. F p R 6 × 1 and τ m R n × 1 denote force/moment vectors of UAV and n joints, respectively. F p and τ m both consist of two parts, the actuator force/moment and the external force/moment. The external force/moment denotes the atmosphere influence, air flow, etc. Since this paper focuses on AEROM trajectory planning through kinematics, the AEROM dynamics are not further analyzed.

3. Trajectory Planning of Aerial Robotic Manipulator

3.1. Description of Trajectory Planning Problem

The trajectory planning problem for AEROM is studied here. The pose of UAV base is free, i.e., the second case of the aforementioned kinematics. The AEROM system has the non-holonomic characteristic, implying that the pose of AEROM relies on both inverse kinematics and coupling between UAV base and robotic manipulator. The initial, desired and actually planned poses of EE are respectively denoted as χ e in , χ e de and χ e ac . The initial, desired and actually planned poses of UAV base are respectively denoted as χ b in , χ b de and χ b ac . The initial, desired and actually planned joint configurations are respectively denoted as q in , q de and q ac . On the basis of aforementioned AEROM kinematics, the actually planned poses of EE and UAV base are respectively calculated as:
χ e ac = χ e in + t 0 t f J g q ˙ dt
χ b ac = χ b in + t 0 t f H b 1 H bm q ˙ dt
The differences between the actually planned pose and desired pose of EE and UAV base are respectively given by Equations (16) and (17). The differences between actually planned joint configuration and desired joint configuration is given by Equation (18).
δ χ e = χ e ac χ e de
δ χ b = χ b ac χ b de
δ q = q ac q de
The trajectory planning of AEROM aims to obtain appropriate joint trajectories yielding initial values and constraints:
χ b ( t 0 ) = χ b 0 , χ e ( t 0 ) = χ e 0 , χ e ( t f ) = χ e f q ( t 0 ) = q 0 , q ˙ ( t 0 ) = q ¨ ( t 0 ) = 0 q ( t f ) = q f , q ˙ ( t f ) = q ¨ ( t f ) = 0 q min q q max q ˙ min q ˙ q ˙ max q ¨ min q ¨ q ¨ max
In Equation (19), χ b 0 is the initial pose of UAV base. χ e 0 and χ e f are respectively the initial pose and the final pose of EE. q 0 and q f are the initial and the final joint configurations, respectively. In this paper, q min = q max , q ˙ min = q ˙ max , and q ¨ min = q ¨ max . According to assignments of q ˙ max and q ¨ max , the AEROM maneuver time T can be determined as [23,24]:
T max q ¯ ˙ max q ˙ max , q ¯ ¨ max q ¨ max
where q ¯ ˙ max and q ¯ ¨ max respectively denote the maximum components of vectors d q d u and d 2 q d u 2 , q ˙ max and q ¨ max respectively denote the maximum components of vectors d q d t and d 2 q d t 2 . The symbols t and u respectively denote the time and the normalization of time. Detailed explanations about t and u are provided in Section 3.3.
Actually, the relationship between χ e and q can be derived through the D-H approach or integration of Equation (10), remarked as χ e = f ( q ) . For an assignment of q denoted as q s , the equation χ es = f ( q s ) works. However, q s f 1 ( χ es ) in the case that the robotic manipulator is redundant. This is because f 1 ( χ es ) has infinite solutions. The trajectory planning requires the UAV pose, the EE pose and the joint configuration approach to their desired values, namely δ χ b 0 , δ χ e 0 and δ q 0 .

3.2. Cost Functions

For an AEROM system, a large disturbance to UAV base is infeasible during the manipulator maneuver. This is because of the accuracy requirements of EE performing tasks such as aerial refuelling and maintenance of the aerial pipe. Although the controllers can be designed to compensate the disturbance, energy is limited in an aerial environment. Efficient trajectory planning contributes to optimal joint trajectories with minimum disturbance, and contributes to saving energies indirectly. This cost function is formulated as:
Γ 1 = t 0 t f χ b ( t ) M 1 d t
where the symbol · depicts the vector norm, the symbol M depicts a weight matrix with positive definite properties. Another cost function represents angular variations of joints, formulated as:
Γ 2 = t 0 t f q ( t ) q 0 M 2 d t
The trajectory planning problem of AEROM is formulated as:
min q ( t ) Γ q ( t ) s . t . g ( q ( t ) ) < 0 h ( q ( t ) ) = 0
where g ( · ) and h ( · ) represents inequality constraints and equality constraints, respectively.

3.3. Parametrization of Joint Trajectories

The trajectory planning problem in Equation (23) is studied as a nonlinear programming (NP) problem. The NP problem considers functional requirements of UAV disturbance and EE manipulability, equality constraint of AEROM forward kinematics, and inequality constraints of joint motions. Each joint trajectory is depicted with a Bézier curve [34,35]. The Bézier curve contributes to modelling smooth curves in computer graphics, formulated as:
q i ( u ) = j = 0 m b j , m ( u ) P i j
where P i j is predefined points for the construction of a Bézier curve, b j , m ( u ) is the Berstein basis polynomial function as followed:
b j , m ( u ) = C m j ( 1 u ) m j u j , u [ 0 , 1 ]
where C m j denotes a binomial coefficient, C m j = m ! j ! ( m j ) ! . The symbol u denotes the normalization of time. The AEROM maneuver time is depicted as T = t f t 0 . Combined with the form u = t T , the joint trajectory is formulated as:
q i ( t ) = j = 0 m C m j 1 t T m j t T j P i j
The angular velocity is:
q ˙ i ( t ) = d q i d u d u d t = m T j = 0 m 1 b j , m 1 t T P i , j + 1 P i j
In this paper, the quintic Bézier curve is employed to parametrize joint trajectories, i.e., m = 5 . p i = P i 1 , , P i 5 ( i = 1 , , n ) are designed as variables of ith joint trajectory. According to aforementioned equations from (19) to (27), the elements P i j ( i = 1 , , n ; j = 0 , 1 , , 5 ) are calculated as:
P i , 0 = P i , 1 = P i , 2 = q i 0 P i , 3 = P i , 4 = P i , 5
In Equation (28), the value q i 0 is predefined. Once the parameter P i , 5 is derived, p i is determined. Namely, the ith joint trajectory is obtained.

4. Hybrid Particle Swarm Optimization

PSO, proposed by Kennedy and Eberhart [36], was inspired by motions of birds or swimming fishes. PSO is a heuristic random search method with a simple principle. It easily gets into a local optimum [37] due to smaller step size, or misses the global optimum due to larger step size. For a global optimum with high efficiency, each particle should balance the exploration ability and the exploitation ability. The exploration ability contributes to global search at initial stage, while the exploitation ability focuses on local search at final stage. In order to balance the two abilities, various particle updating mechanisms are proposed such as the dynamic adaptation, the switch mechanism and the exponential form. In this paper, HPSO with self-adaptive ability is proposed. The velocity and the position of each particle in HPSO is updated as followed:
v i , k = w i , k v i , k + c 1 i , k r 1 x b i , k x i , k + + c 2 i , k r 2 x g k x i , k x i , k = x i , k + v i , k
In Equation (29) i = 1 , , m and k = 1 , , N . m and N respectively depict the population size and the maximum iterations. The symbols v i , k and x i , k represent the velocity and the position of ith particle at kth iteration, respectively. In conjunction with the Section 3.3, the position x i , k represents a group assignment of P 1 , 5 , , P n , 5 . The constants r 1 and r 2 are uniformly distributed in the region of 0 , 1 . x b i , k represents the best position of ith particle so far, while x g k represents the best position of the population so far. w i , k , c 1 i , k and c 2 i , k are three control parameters with self-adaptive abilities. Inspired by the increasing abilities of the exponential function, w i , k , c 1 i , k and c 2 i , k are formulated as:
w i , k = w 0 w f · e w 0 w f g x b · i N + w f
c 1 i , k = c 10 c 1 f · e c 10 c 1 f g x b · i N + c 1 f
c 2 i , k = c 20 c 2 f · e c 20 c 2 f g x b · i N + c 2 f
where w 0 , c 10 and c 20 are initial values, w f , c 1 f and c 2 f are final values. The control parameters are defined in an exponential way, in order to balance the exploration ability and the exploitation ability. Furthermore, an self-adaptive strategy is introduced to adjust each control parameter. g x b = d x g k , x b i , k = x g k x b i , k represents the distance between the best position of the ith particle and the global best position.
As the iterations increase, c 1 i , k and c 2 i , k decrease while w i , k increases. Therefore, each particle has high exploration ability at early stage and high exploitation ability at final stage. Furthermore, g x b influences the variation velocities of control parameters shown in Figure 3. Large g x b makes a slow variation of ω , c 1 and c 2 , contributing to superior exploration ability of particles. However, small g x b contributes to fast variation of control parameters and makes particles exhibit superior exploitation ability. Actually, if the distance between a particle position and the global best position is large, searching through the whole space is required. Then, the particle moves towards the global best position as fast as possible. If the distance is small, searching through the local space and around the global best position is required.
Utilizing the dynamic system theory, a stable system meets the sufficient condition that the magnitude of solution is less than 1. Namely, eigenvalues of coefficient matrix in Equation (29) is less smaller than 1. Then, the convergence region of system (29) is calculated as:
Δ = { ω , c 1 , c 2 | ω < 1 , c 1 r 1 + c 2 r 2 > 0 , 4 ω 4 c 1 r 1 + c 2 r 2 + 4 > 0 }
Furthermore, the eigenvalues influence the system convergent behaviour as follows.
  • Non-oscillatory form. If both eigenvalues are real and at least one of them is positive, the dynamic system converges in the non-oscillatory behaviour.
  • Harmonic form. If both eigenvalues are complex, the dynamic system converges in the harmonic behaviour.
  • Zigzagging form. If at least one of the eigenvalues, complex or real, has negative real part, the dynamic system converges in the zigzagging behaviour.
The assignment of g x b affects control parameters in (30), (31) and (32), and thus influences the convergent behaviour of the system (29). In addition, initial assignments of control parameters, i.e., ω 0 , ω f , c 10 , c 1 f , c 20 , and c 2 f , should follow the convergent region.
Figure 4 shows the flow chart of HPSO for AEROM trajectory planning. Assignments are firstly provided, including particle number n p , precision threshold ε , maximum iterations N, maximum iterations with the same fitness value k max , etc. During the iteration process, positions of particles are updated if the terminal condition is not satisfied. It means that the optimum value is within the predefined region, or the iterations with the same optimum value are larger than predefined value k max . The position updating mechanism combines superiorities of PSO and GA, shown in Figure 5. Firstly, the velocity and the position of each particle are updated utilizing PSO with self-adaptive control parameters. Then, particles are randomly selected for mutation or crossover with predefined probabilities. Therefore, part particles are updated twice, and HPSO is prohibited from becoming trapped in a local optimum.

5. Numerical Simulations

5.1. Parameters of the AEROM System

In this section, three case studies are carried out to validate the proposed HPSO. The AEROM system consists of a 6-DOF UAV and a 6-DOF robotic manipulator with single arm, namely, n = 6 in Figure 2. Table 2 lists mass and rotational inertia parameters of the AEROM system. The length of the links are respectively 0.2 m, 0.38 m, 0.25 m, 0.32 m, 0.25 m and 0.40 m. During the search process shown in Figure 4 and Figure 5, the global best solution is derived for the construction of Bézier curves. Combining the AEROM maneuver time T through Equation (20), the joint trajectories are then derived. In this paper T = 20 s . The parameters of HPSO are followed: ω 0 = 0.9 , ω f = 0.1 , c 10 = c 2 f = 2.0 , c 20 = c 1 f = 0.1 , the particle number m = 30 , the iteration number N = 300 , the crossover probability p c = 0.75 , the mutation probability p m = 0.15 , the threshold value k max = 100 .

5.2. Simulation Results and Analysis

Numerical simulations are carried out on a stand PC under the Matlab/Simulink environment. Referring the work [20], the initial state and the desired state of AEROM are detailed joint configurations. The simulations ignoring EE trajectories refers to the following work. Actually, the end-effector trajectory can be directly derived according to the integration of kinetic equation of AEROM, or according to the D-H method.

5.2.1. Case 1

In the first case, the position and the attitude of UAV base are controlled. Therefore, the initial and the final poses of UAV base are not considered. The kinematic equation of the AEROM system is shown in Equation (8). The cost function in (24) considers angular variations of joints (22), i.e. Γ = Γ 1 . The weight matrix M 2 is assigned as M = 1 sin π 360 E 6 , where E 6 is a sixth-order unit matrix. The AEROM system is commanded to move from initial state q 0 = 0 , 30 , 30 , 20 , 50 , 30 ( deg ) to desired state q f = 10 , 0 , 60 , 10 , 30 , 20 ( deg ) . Figure 6 shows the variations of cost function. The proposed HPSO algorithm stops when k eq = 101 > 100 = k max , where N = 267 and the final cost value is 0.7362 . Figure 7 shows the time histories of joint angles, meeting aforementioned conditions. Figure 8 shows variations of joint velocities, where the components are all 0 at initial time and final time. According to the simulation results, the joints move smoothly and the robotic manipulator successfully arrives at the desired state. The error vector δ q in Equation (18) is δ q = 6.07 , 1.01 , 1.07 , 0.311 , 2.49 , 0.1 × 10 8 deg . Actually, multiple solutions exist due to the geometric construction of robotic manipulator. The selected optimal solution is just one of the multiple solutions. In addition, the represented solution can be employed for further purpose of subsequent optimization.

5.2.2. Case 2

In the second case, the position and the attitude of UAV base are not controlled, similar to the free-floating space robot [13] in outer space environment. The kinematic equation of the AEROM system is shown in Equation (10). The pose disturbance acting on UAV base is considered. The cost function in (24) includes the UAV disturbance (21) and the angular variations of joints (22), shown as Γ = Γ 1 + Γ 1 . The weight matrix M 1 is assigned as M 1 = E 3 , O 3 ; O 3 , 1 sin π 360 E 3 . The weight matrix M 2 is assigned as M 2 = 1 sin π 360 E 6 . E 3 and E 6 are respectively 3-order and 6-order unit matrices. The AEROM system is commanded to move from initial state q 0 = 5 , 10 , 10 , 20 , 10 , 20 ( deg ) to desired state q f = 10 , 20 , 0 , 0 , 0 , 40 ( deg ) . Figure 9 shows the variations of the cost function. The proposed HPSO algorithm stops when k eq = 101 > 100 = k max , where N = 278 and the final value is 1.0789 . Figure 10 shows the time histories of joint angles, meeting aforementioned conditions. Figure 11 shows the variations of joint velocities with the final value of 5.0 × 10 15 , 5.0 × 10 15 , 1.0 × 10 17 , 1.0 × 10 19 , 7.5 × 10 15 , 1.0 × 10 19 deg . Figure 12 shows the attitude and the position variations of UAV base. The actually planned UAV attitude and UAV position are respectively 5.3 × 10 3 , 5.5 × 10 3 , 6.4 × 10 3 deg and 4.1 × 10 4 , 3.3 × 10 3 , 2.7 × 10 4 m . It means the disturbance order magnitude acting on UAV base is 3 . Therefore, the planned error is within the predefined threshold range, where 5.3 × 10 3 , 5.5 × 10 3 , 6.4 × 10 3 = 9.9649 × 10 3 < ε ( 1 ) = 0.1 with the unit of degree and 4.1 × 10 4 , 3.3 × 10 3 , 2.7 × 10 4 = 3.3363 × 10 3 < ε ( 2 ) = 0.1 with the unit of meter. The error vector δ q in Equation (18) is δ q = 0.01 , 0.11 , 0.51 , 2.09 , 3.73 , 4.1 × 10 7 deg . According to the simulation results, the joints move smoothly and the robotic manipulator successfully arrives at the desired state. Furthermore, the objective of minimizing UAV pose disturbance is realized.

5.2.3. Case 3

In the third case, the position and the attitude of UAV base are not controlled. Similar to the second case, the pose disturbance acting on UAV base is considered. However, the robotic manipulator is constrained to move from initial state q 0 = 10 , 30 , 40 , 60 , 30 , 75 to desired state q f = 10 , 20 , 50 , 75 , 45 , 90 with unit of degree. Furthermore, the UAV base is required to move from initial state x b 0 = 5 ( deg ) , 5 ( deg ) , 5 ( deg ) , 0 ( m ) , 0 ( m ) , 0 ( m ) to desired state x b d e = 0 ( deg ) , 0 ( deg ) , 0 ( deg ) , 0 ( m ) , 0 ( m ) , 0 ( m ) . The cost function in (24) includes the UAV disturbance (21) and the angular variations of joints (22), shown as Γ = Γ 1 + Γ 1 . The weight matrix M 1 is assigned as M 1 = E 3 , O 3 ; O 3 , 1 sin π 360 E 3 . The weight matrix M 2 is assigned as M 2 = 1 sin π 360 E 6 . E 3 and E 6 are respectively 3-order and 6-order unit matrices. Figure 13 shows the variations of cost function. The proposed HPSO algorithm stops when k eq = 101 > 100 = k max , where N = 285 and the final cost value is 1.1895 . Figure 14 shows the time histories of joint angles, meeting aforementioned conditions. Figure 15 shows variations of joint velocities with the value of 3.97 × 10 13 , 7.79 × 10 14 , 1.54 × 10 13 , 1.01 × 10 13 , 4.73 × 10 13 , 2.26 × 10 13   deg / s at final time. Figure 16 shows the attitude and the position variations of UAV base. The actually planned UAV attitude and position are 5.77 × 10 3 , 6.21 × 10 3 , 3.56 × 10 6 deg and 1.34 × 10 5 , 4.49 × 10 6 , 8.92 × 10 6   m , respectively. It means the disturbance order magnitude acting on UAV base is 3 . Therefore, the planned error is within the predefined threshold range, where 5.77 × 10 3 , 6.21 × 10 3 , 3.56 × 10 6 = 8.4679 × 10 3 < ε ( 1 ) = 0.1 with the unit of degree and 1.34 × 10 5 , 4.49 × 10 6 , 8.92 × 10 6 = 1.6712 × 10 5 < ε ( 2 ) = 0.1 with the unit of meter. The error vector δ q in Equation (18) is δ q = 1.27 , 1.07 , 0.11 , 0.47 , 1.51 , 2.21 × 10 10 deg . According to the simulation results, the joints move smoothly and the AEROM system successfully arrives at the desired state. Conclusively, the joint trajectories in aforementioned three cases are all smooth. Furthermore, the generated results are applicable to controlling the AEROM system and meeting the requirements in Section 3.

6. Conclusions

Due to the dynamically singular factor of robotic manipulator and the strong coupling between the UAV base and the robotic manipulator, the inverse kinematics of AEROM system cannot be directly employed for trajectory planning. A novel trajectory planning method for an AEROM system is proposed in this paper, where the AEROM system consists of a UAV base and a robotic manipulator with single arm. The following factors are considered: i a specific case, where the AEROM is non-holonomic, ii each joint trajectory is depicted with a Bézier curve due to its characteristics of simplicity, smoothness and normalization, iii the AEROM maneuver time is derived through boundaries of joint velocities and accelerations, iv HPSO with self-adaptive ability is proposed to search through the global space for the construction of each Bézier curve. v multiple objectives can be simultaneously optimized utilizing the proposed method. Numerical simulations show that the minimum disturbance acting on the UAV base is realized. The optimization of multiple objectives, i.e., various cost functions, is also well performed.
Variations of physical parameters such as rotational inertia are out of consideration, which will be studied in future work. In addition, the collision avoidance issue is also one of the subjects of future work. Since the trajectory planning is studied through AEROM kinematics, AEROM dynamics are not further considered and analyzed. The AEROM control, based on both kinematics and dynamics, will be studied in a follow-up study.

Author Contributions

Conceptualization, S.Z. and C.C.; methodology, S.Z. and J.L.; writing—original-draft preparation, S.Z. and J.L.; writing—review and editing, C.C., S.G. and X.G.; supervision, C.C. and S.G.; funding acquisition, S.Z., S.G. and X.G. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the technological innovation Guidance Fund of Shaanxi Province (Grant No. 2022QFY01-16), by the Science and Technology foundation of Shaanxi Province (Grant No. 2022GY-236), by National Natural Science Foundation of China (Grant No. 62103182) and by the China Postdoctoral Science Foundation (Grant No. 2021M701548).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The authors sincerely acknowledge the technological innovation Guidance Fund of Shaanxi Province (Grant No. 2022QFY01-16), the Science and Technology foundation of Shaanxi Province (Grant No. 2022GY-236), the National Natural Science Foundation of China (Grant No. 62103182) and the China Postdoctoral Science Foundation (Grant No. 2021M701548). The authors would also thank the members of the Autonomous Unmanned Systems Research Laboratory for their useful and valuable suggestions.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
2-DTwo-Dimensional
AEROMAErial RObotic Manipulator
D-HDenavit-Hartenberg
DOFDegree Of Freedom
EEEnd Effector
GAGenetic Algorithm
HPSOHybrid Particle Swarm Optimization
IOAIntelligent Optimization Algorithm
NPNonlinear Programming
PSOParticle Swarm Optimization
UAVUnmanned Aerial Vehicle

References

  1. Ollero, A.; Tognon, M.; Suarez, A.; Lee, D.; Franchi, A. Past, present, and future of aerial robotic manipulators. IEEE T. Robot. 2022, 38, 626–645. [Google Scholar] [CrossRef]
  2. Welde, J.; Paulos, J.; Kumar, V. Dynamically feasible task space planning for underactuated aerial manipulators. IEEE Robot. Autom. Let. 2021, 6, 3232–3239. [Google Scholar] [CrossRef]
  3. AERIAL-CORE. Available online: https://aerial-core.eu/objectives/ (accessed on 22 April 2022).
  4. AERO-TRAIN. Available online: https://www.aerotrain-etn.eu/ (accessed on 19 June 2022).
  5. HYFLIERS PROJECT. Available online: https://www.oulu.fi/hyfliers/ (accessed on 28 January 2022).
  6. AEROARMS. Available online: https://aeroarms-project.eu/ (accessed on 22 June 2022).
  7. Xu, W.; Meng, D.; Liu, H.; Wang, X.; Liang, B. Singularity-free trajectory planning of free-floating multiarm space robots for keeping the base inertially stabilized. IEEE Trans. Syst. Man Cybern. Syst. 2019, 49, 2464–2477. [Google Scholar] [CrossRef]
  8. Wang, S.; Cao, Y.; Zheng, X.; Zhang, T. Collision-free trajectory planning for a 6-DoF free-floating space robot via hierarchical decoupling optimization. IEEE Robot. Autom. Let. 2022, 7, 4953–4960. [Google Scholar] [CrossRef]
  9. Umetani, Y.; Yoshida, K. Resolved motion rate control of space manipulators with generalized Jacobian matrix. IEEE Trans. Robot. Autom. 1989, 5, 303–314. [Google Scholar] [CrossRef]
  10. Dubowsky, S.; Torres, M. Path planning for space manipulators to minimize spacecraft attitude disturbances. In Proceedings of the IEEE International Conference on Robotics and Automation, Sacramento, CA, USA, 9–11 April 1991; pp. 2522–2528. [Google Scholar]
  11. Papadopoulos, E.; Dubowsky, S. Dynamic singularities in free-floating space manipulators. In Space Robotics: Dynamics and Control; Xu, Y., Kanade, T., Eds.; Springer: Boston, MA, USA, 1993; pp. 77–100. [Google Scholar]
  12. Yoshida, K.; Hashizume, K.; Abiko, S. Zero reaction maneuver: Flight validation with ETS-VII space robot and extension to kinematically redundant arm. In Proceedings of the IEEE International Conference on Robotics and Automation, Seoul, Korea, 21–26 May 2001; pp. 441–446. [Google Scholar]
  13. Zhao, S.; Zhu, Z.; Luo, J. Multitask-based trajectory planning for redundant space robotics using improved Genetic Algorithm. Appl. Sci. 2019, 9, 2226. [Google Scholar] [CrossRef] [Green Version]
  14. Zhao, S.; Siciliano, B.; Zhu, Z.; Gutié rrez-Giles, A.; Luo, J. Multi-waypoint-based path planning for free-floating space robots. Int. J. Robot. Autom. 2019, 34, 461–467. [Google Scholar] [CrossRef]
  15. Xu, W.; Li, C.; Liang, B.; Liu, Y.; Xu, Y. The cartesian path planning of free-floating space robot using particle swarm optimization. Int. J. Adv. Robot. Systm. 2008, 5, 301–310. [Google Scholar] [CrossRef] [Green Version]
  16. Xu, W.; Li, C.; Wang, X.; Liu, Y.; Liang, B.; Xu, Y. Study on non-holonomic cartesian path planning of a free-floating space robotic system. Adv. Robot. 2009, 23, 113–143. [Google Scholar] [CrossRef]
  17. Huang, P.; Xu, Y.; Liang, B. Minimum-torque path planning of space robots using genetic algorithms. Int. J. Robot. Autom. 2006, 21, 229–236. [Google Scholar] [CrossRef]
  18. Lampariello, R.; Tuong, D.; Castellini, C.; Hirzinger, G.; Peters, J. Trajectory planning for optimal robot catching in real-time. In Proceedings of the IEEE International Conference on Robotics and Automation, Shanghai, China, 9–13 May 2011; pp. 3719–3726. [Google Scholar]
  19. Seddaoui, A.; Saaj, C. Collision-free optimal trajectory generation for a space robot using genetic algorithm. Acta Astronaut. 2021, 179, 311–321. [Google Scholar] [CrossRef]
  20. Xu, W.; Liu, Y.; Liang, B.; Xu, Y.; Li, C.; Qiang, W. Non-holonomic path planning of a free-floating space robotic system using genetic algorithms. Adv. Robot. 2008, 22, 451–476. [Google Scholar] [CrossRef]
  21. Wang, M.; Luo, J.; Fang, J.; Yuan, J. Optimal trajectory planning of free-floating space manipulator using differential evolution algorithm. Adv. Space Res. 2018, 61, 1525–1536. [Google Scholar] [CrossRef]
  22. Luo, G.; Zou, L.; Wang, Z.; Lv, C.; Ou, J.; Huang, Y. A novel kinematic parameters calibration method for industrial robot based on Levenberg-Marquardt and Differential Evolution hybrid algorithm. Robot. Comput.-Integr. Manuf. 2021, 71, 102165. [Google Scholar] [CrossRef]
  23. Wang, M.; Luo, J.; Walter, U. Trajectory planning of free-floating space robot using Particle Swarm Optimization (PSO). Acta Astronaut. 2015, 112, 77–88. [Google Scholar] [CrossRef]
  24. Wang, M.; Luo, J.; Yuan, J.; Walter, U. Coordinated trajectory planning of dual-arm space robot using constrained particle swarm optimization. Acta Astronaut. 2018, 146, 259–272. [Google Scholar] [CrossRef]
  25. Miao, C.; Chen, G.; Yan, C.; Wu, Y. Path planning optimization of indoor mobile robot based on adaptive ant colony algorithm. Comput. Ind. Eng. 2021, 156, 107230. [Google Scholar] [CrossRef]
  26. Cna, B.; Dvl, A. A comparative study on ant colony optimization algorithm approaches for solving multi-objective path planning problems in case of unmanned surface vehicles. Ocean Eng. 2022, 255, 111418. [Google Scholar]
  27. Mirza, N. Application of fuzzy neural networks in robotic path planning. In Proceedings of the International Arab Conference on Information Technology (ACIT), Al Ain, United Arab Emirates, 3–5 December 2019; pp. 58–62. [Google Scholar]
  28. Nair, R.; Supriya, P. Robotic path planning using recurrent neural networks. In Proceedings of the International Conference on Computing, Communication and Networking Technologies (ICCCNT), Kharagpur, India, 1–3 July 2020; pp. 1–5. [Google Scholar]
  29. Heredia, G.; Cano, R.; Jimenez-Cano, A.; Ollero, A. Modeling and design of multirotors with multi-joint arms. In Aerial Robotic Manipulation: Research, Development and Applications; Ollero, A., Siciliano, B., Eds.; Springer: Cham, Switzerland, 2019; pp. 15–34. [Google Scholar]
  30. Orsag, M.; Korpela, C.; Oh, P.; Bogdan, S. Aerial Manipulation, 1st ed.; Springer: Cham, Switzerland, 2018; pp. 87–122. [Google Scholar]
  31. Wu, Y.; Yu, Z.; Li, C.; He, M.; Chen, Z. Reinforcement learning in dual-arm trajectory planning for a free-floating space robot. Aerosp. Sci. Technol. 2020, 98, 105657. [Google Scholar] [CrossRef]
  32. Yang, B.; He, Y.; Han, J.; Liu, G. Modeling and control of rotor-flying multi-joint manipulator. In Proceedings of the IFAC World Congress, Cape Town, South Africa, 24–29 August 2014; pp. 11024–11029. [Google Scholar]
  33. Meng, X.; He, Y.; Han, J. Survey on aerial manipulator: System, modeling, and control-corrigendum. Robotica 2020, 38, 1288–1317. [Google Scholar] [CrossRef]
  34. Farin, G. Curves and Surfaces for Computer-Aided Geometric Design: A Practical Guide, 4th ed.; Academic Press: San Diego, CA, USA, 1996; pp. 41–63. [Google Scholar]
  35. Faraway, J.; Reed, M.; Wang, J. Modelling three-dimensional trajectories by using bezier curves with application to hand motion. Appl. Stat. 2007, 56, 571–585. [Google Scholar] [CrossRef]
  36. Kennedy, J.; Eberhart, R. Particle swarm optimization (PSO). In Proceedings of the IEEE International Conference on Neural Networks, Perth, Australia, 27 November–1 December 1995; pp. 1942–1948. [Google Scholar]
  37. Liu, H.; Cai, Z.; Wang, Y. Hybridizing particle swarm optimization with differential evolution for constrained numerical and engineering optimization. Appl. Soft Comput. 2010, 10, 629–640. [Google Scholar] [CrossRef]
Figure 1. Two-dimensional (2-D) sketch of aerial robotic manipulator composed of a UAV base and a robotic manipulator, where the manipulator denotes (a,d) one single arm, (b,e) two arms or (c,f) multiple arms.
Figure 1. Two-dimensional (2-D) sketch of aerial robotic manipulator composed of a UAV base and a robotic manipulator, where the manipulator denotes (a,d) one single arm, (b,e) two arms or (c,f) multiple arms.
Applsci 12 10892 g001
Figure 2. 2-D sketch of an AEROM system, with symbols employed for the derivation of AEROM mathematical models.
Figure 2. 2-D sketch of an AEROM system, with symbols employed for the derivation of AEROM mathematical models.
Applsci 12 10892 g002
Figure 3. Variation curves of the three control parameters with different g x b , where (a) w, (b) c 1 , and (c) c 2 .
Figure 3. Variation curves of the three control parameters with different g x b , where (a) w, (b) c 1 , and (c) c 2 .
Applsci 12 10892 g003
Figure 4. Flow chart of HPSO with self-adaptive ability for AEROM trajectory planning.
Figure 4. Flow chart of HPSO with self-adaptive ability for AEROM trajectory planning.
Applsci 12 10892 g004
Figure 5. Velocity and position updating mechanisms of particles in HPSO.
Figure 5. Velocity and position updating mechanisms of particles in HPSO.
Applsci 12 10892 g005
Figure 6. The best values of cost function in case 1.
Figure 6. The best values of cost function in case 1.
Applsci 12 10892 g006
Figure 7. Angular variation curves of ith joint, where (a) i = 1 , 2 , 3 , and (b) i = 4 , 5 , 6 .
Figure 7. Angular variation curves of ith joint, where (a) i = 1 , 2 , 3 , and (b) i = 4 , 5 , 6 .
Applsci 12 10892 g007
Figure 8. Velocity variation curves of ith joint, where (a) i = 1 , 2 , 3 , and (b) i = 4 , 5 , 6 .
Figure 8. Velocity variation curves of ith joint, where (a) i = 1 , 2 , 3 , and (b) i = 4 , 5 , 6 .
Applsci 12 10892 g008
Figure 9. The best values of cost function in case 2.
Figure 9. The best values of cost function in case 2.
Applsci 12 10892 g009
Figure 10. Angular variation curves of ith joint, where (a) i = 1 , 2 , 3 , and (b) i = 4 , 5 , 6 .
Figure 10. Angular variation curves of ith joint, where (a) i = 1 , 2 , 3 , and (b) i = 4 , 5 , 6 .
Applsci 12 10892 g010
Figure 11. Velocity variation curves of ith joint, where (a) i = 1 , 2 , 3 , and (b) i = 4 , 5 , 6 .
Figure 11. Velocity variation curves of ith joint, where (a) i = 1 , 2 , 3 , and (b) i = 4 , 5 , 6 .
Applsci 12 10892 g011
Figure 12. Pose variation of UAV base, where (a) UAV attitude, and (b) UAV position.
Figure 12. Pose variation of UAV base, where (a) UAV attitude, and (b) UAV position.
Applsci 12 10892 g012
Figure 13. The best values of cost function in case 3.
Figure 13. The best values of cost function in case 3.
Applsci 12 10892 g013
Figure 14. Angular variation curves of ith joint, where (a) i = 1 , 2 , 3 , and (b) i = 4 , 5 , 6 .
Figure 14. Angular variation curves of ith joint, where (a) i = 1 , 2 , 3 , and (b) i = 4 , 5 , 6 .
Applsci 12 10892 g014
Figure 15. Velocity variation curves of ith joint, where (a) i = 1 , 2 , 3 , and (b) i = 4 , 5 , 6 .
Figure 15. Velocity variation curves of ith joint, where (a) i = 1 , 2 , 3 , and (b) i = 4 , 5 , 6 .
Applsci 12 10892 g015
Figure 16. Pose variation of UAV base, where (a) UAV attitude, and (b) UAV position.
Figure 16. Pose variation of UAV base, where (a) UAV attitude, and (b) UAV position.
Applsci 12 10892 g016
Table 1. Representation of symbols in Figure 2.
Table 1. Representation of symbols in Figure 2.
SymbolRepresentation
C sy Center of mass of AEROM system
B i  (i= 0, …, n)Body i, where B 0 denotes UAV base and B i (i= 1, …, n) denotes ith link of robotic manipulator
C i  (i= 0, …, n)Center of mass of B i
J i  (i= 0, …, n)Joint i, connecting B i 1 and B i
a i R 3  (i= 1, …, n)Vector from J i to C i
b i R 3  (i= 0, …, n)Vector from C i to J i + 1
r i R 3  (i= 0, …, n)Position of C i in inertial coordinate system
p i R 3  (i= 1, …, n)Position of J i in inertial coordinate system
r g R 3 Position of C s y in inertial coordinate system
p e R 3 Position of end effector in inertial coordinate system
Σ i  (i= 0, …, n)Coordinate system established in B i with origin O i , axes X i , Y i and Z i
Σ I Inertial coordinate system with origin O I , axes X I , Y I and Z I
Σ e Coordinate system established in end effector, with origin O e , axes X e , Y e and Z e
Table 2. Physical parameters of the AEROM system.
Table 2. Physical parameters of the AEROM system.
Mass (kg) I xx (kg · m 2 ) I xy (kg · m 2 ) I xz (kg · m 2 ) I yy (kg · m 2 ) I yz (kg · m 2 ) I zz (kg · m 2 )
UAV base80440.30.4430.326
Link 11.5 5.2 × 10 3 1.9 × 10 5 2.3 × 10 4 7.6 × 10 3 2.8 × 10 5 3.5 × 10 3
Link 21.1 3.6 × 10 3 1.1 × 10 3 1.2 × 10 2 1.2 × 10 1 3.0 × 10 4 1.1 × 10 1
Link 31.5 9.1 × 10 3 3.1 × 10 5 1.2 × 10 3 1.1 × 10 2 8.1 × 10 5 2.5 × 10 3
Link 41.0 5.4 × 10 2 5.6 × 10 4 7.4 × 10 4 4.5 × 10 2 0.1 × 10 2 0.1 × 10 2
Link 51.5 0.1 × 10 2 3.1 × 10 5 8.1 × 10 5 9.1 × 10 3 1.2 × 10 4 2.5 × 10 3
Link 64.0 2.0 × 10 2 2.0 × 10 3 1.4 × 10 3 2.3 × 10 2 3.2 × 10 3 1.0 × 10 2
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Zhao, S.; Chen, C.; Li, J.; Gao, S.; Guo, X. Trajectory Planning of Aerial Robotic Manipulator Using Hybrid Particle Swarm Optimization. Appl. Sci. 2022, 12, 10892. https://doi.org/10.3390/app122110892

AMA Style

Zhao S, Chen C, Li J, Gao S, Guo X. Trajectory Planning of Aerial Robotic Manipulator Using Hybrid Particle Swarm Optimization. Applied Sciences. 2022; 12(21):10892. https://doi.org/10.3390/app122110892

Chicago/Turabian Style

Zhao, Suping, Chaobo Chen, Jichao Li, Song Gao, and Xinxin Guo. 2022. "Trajectory Planning of Aerial Robotic Manipulator Using Hybrid Particle Swarm Optimization" Applied Sciences 12, no. 21: 10892. https://doi.org/10.3390/app122110892

APA Style

Zhao, S., Chen, C., Li, J., Gao, S., & Guo, X. (2022). Trajectory Planning of Aerial Robotic Manipulator Using Hybrid Particle Swarm Optimization. Applied Sciences, 12(21), 10892. https://doi.org/10.3390/app122110892

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop