1. Introduction
With the rapid development of mobile internet technology, multiagent systems found applications in many fields, such as unmanned aerial vehicle swarm [
1], sensor network [
2], data fusion [
3], multi-manipulator systems [
4], parallel computing [
5], multi-robot systems [
6], traffic vehicle clusters [
7], and network resource allocation [
8]. Generally, the dynamic performance of these systems is described by the Lagrange equation, and they are collectively referred to as Euler–Lagrange systems [
9]. To cooperatively accomplish an overall task, efficient teamwork among multiple agents is required. Therefore, team control of multiagent systems has become a hot research topic.
In the last few years, research hotspots related to networked Euler–Lagrange systems mainly involved consistency (cooperative) research [
10], formation control [
11], and flocking motion control [
12]. In addition, the control problem under different network topologies also received great attention [
13], such as directed graphs, undirected graphs, and switching topology.
In recent years, scenarios that require multiple agents to cooperate to complete a certain overall control task continued to emerge. In [
9], distributed finite-time coordination control for networked Euler–Lagrange systems under directed graphs was studied. In order to achieve the desired cooperative control goal in limited time, distributed synchronous control and the distributed inclusive control were adopted simultaneously, and the results were verified by simulation. The authors of [
14] addressed a robust, adaptive finite-time tracking control scheme for Euler–Lagrange systems. First, the scheme used a Gaussian error function to approximate the input saturation non-linearity, and then the lumped uncertainty term caused by uncertain model parameters and external disturbances was expressed in a linear parametric form with a single parameter. Finally, a new robust adaptive tracking control law was designed to solve the tracking control problem of uncertain Euler–Lagrange systems. Simulation results demonstrate that the proposed control scheme has finite-time convergence speed, as well as robustness to uncertainties and unknown disturbances. Huang Yi et al. [
15] studied the problem of fully distributed event-triggered optimal coordinated control for multiple Euler–Lagrange systems. In order to achieve the goal of minimizing the global cost function in a distributed manner, this study introduces a new auxiliary system as a reference model when the model parameters of the Euler–Lagrange system are unknown. Its output converges exponentially to the optimal solution of the global cost function.
With the continuous progress of computer image processing technology, cooperative control gradually transferred from the configuration space to the task space, while visual servo control attracted more and more attention, and the design of visual servo controllers defined in the task space became a research hotspot in this field [
16,
17,
18,
19]. In the task space, homogeneous transformation is often required when designing a controller according to the system’s kinematic and dynamic model. Unfortunately, in many real industrial environments, these dynamic and kinematic parameters can be difficult to obtain or can exhibit uncertainty. However, cooperative control is an effective method to deal with these uncertainties. The authors of [
20] proposed a new adaptive synchronous control (ASC) scheme for the uncertainties of the system model of a cable-driven parallel robot (CDPR) and the problems of multicable coordination. In addition to the tracking error, a new synchronization error was introduced to describe the coordinated motion relationship between adjacent cables. The adaptive rates were designed according to the linear expressions of kinematic and dynamic models. Simulation results show that the proposed scheme simultaneously suppresses the uncertainty of kinematics and dynamics, adjusts the coordinated motion of multiple cables, and completes the high-precision tracking task. The authors of [
21] studied the tracking problem of a class of heterogeneous linear minimum-phase discrete-time multiagent systems (MASs). By introducing distributed adaptive observers and reference models, the complex cooperative tracking problem of an unknown heterogeneous MAS was transformed into a reference model-to-leader cooperative tracking problem and a locally robust model reference adaptive control problem. Simulation results show that the tracking errors between the outputs of all agents and the leader’s output converge to a residual set under the designed adaptive controller. The authors of [
22] proposed a hierarchical distributed control scheme, based on local and global information, to achieve the optimal solution of the team objective function, which was used to solve the optimal consistency problem of a group of integrator systems with dynamic uncertainty. The scheme designed an optimal control law based on the neighbor information and local cost function gradient for each agent, and a compensator was derived using the Lyapunov redesign technique to deal with dynamic uncertainties. At the same time, the optimal controller was strengthened by introducing the state difference between neighbors into the compensator. Simulation results show that this scheme ensures the asymptotic convergence of the system in the sense of stability.
In reality, if communication links are unreliable, or the bandwidth is limited, communication flows are, inevitably, delayed. Thus, the communication delay has an important effect on the consistency and synchronization of multiple Euler–Lagrange systems. The authors of [
23] proposed a framework for designing robust controllers for a class of non-linear-networked control systems using non-periodic feedback information. In order to solve the uncertainty problem in system dynamics, a linear robust control law was derived using optimal control theory, and two different closed-loop systems were considered. In order to save the network bandwidth, the state and input information was transmitted periodically in the feedback loop, the event-triggered control technology was adopted to reduce the transmission cost, and two different event-triggered robust control laws were derived to stabilize the uncertain nonlinear system. The simulation results show that the designed event-triggering controller satisfies the tradeoff between control performance and network bandwidth saving in the case of uncertainty. The authors of [
24] studied the network control system used for remote control and monitoring of large complex systems, and they proposed a method of real-time detection and estimation of delayed switching attack, based on Lyapunov theory. A secure control strategy was designed to reduce the influence of delayed switching attack in real time and the influence of network delay on communication between agents. The stability of the secure control system was studied using Lyapunov theory. The performance and security control strategy of the proposed delay switching attack estimator were evaluated using simulations and semi-hardware environments. The authors of [
25] studied the distributed tracking control problem of multiple Euler–Lagrange systems with time-varying delays considering full-state constraints and input saturation. First, a distributed observer was designed, such that the follower could obtain the leader’s time-varying information. Then, the barrier Lyapunov function technique was used to enable the system error to converge to a certain range, and the influence of control input saturation was overcome using the inverse winding method. Numerical simulation results verify the effectiveness of the algorithm. The authors of [
26] studied the consistency of topological interaction groups under communication constraints and time delays. In the case of low noise, a sufficient condition for the stability of the consensus process was given. In addition, this paper also analyzes more complex cases, where noise and finite data rates worked together, revealing that the consensus process is degraded when the data rate is reduced.
From the above analysis, it can be seen that the following problems need to be solved in networked Euler–Lagrange systems: uncertainty in dynamics and kinematics, time-varying communication delays, and the measurement of the task-space velocity. When these problems are coupled, designing a suitable controller to realize cooperative synchronization of multiple agents is difficult. This paper mainly contributes to the literature as follows: (1) a cooperative tracking controller is designed for networked, uncalibrated multiple Euler–Lagrange systems with a strongly connected communication graph; (2) task-space synchronization control considering time-varying communication delay is studied; (3) the coupling effects of uncertainty, time-varying communication delay, and task-space velocity are considered.
2. Research Foundation
Lemma 1 (Barbalat Lemma) [
27]
. Suppose is a uniformly continuous function, and exists and is finite; then, there is when .
Lemma 2 [
27]
. When the following conditions are true, then the function The lower bound of V(x, t) exists;
is negative semi-definite;
is bounded.
2.1. Algebraic Graph Theory
When there is a directed path between any two vertices of a graph, the network topology is strongly connected.
In this paper, the network was composed of N Euler–Lagrange systems, and its topology was a directed digraph with strong connections. A directed graph is represented by the notation
, where
denotes non-empty vertex sets representing the nodes in the network, and
denotes the edge set describing the signal communication between the nodes of the directed graph. In addition, the edge
represents the communication path from
j to
i. When there is a directed path between any two vertices of a graph, the network topology is strongly connected [
28]. The set of neighbor nodes of the
i-th node can be represented by
. Matrix
represents the weight applied to the directed paths. Here,
, then
; otherwise,
. We assume that one node only transmits the state signals to nodes other than itself (i.e.,
). Therefore,
if , then
. The Laplacian matrix
can be defined as follows:
For a strongly connected network, L satisfies Lemma 3.
Lemma 3. If the Laplace matrix of a strongly connected topological network is L, then there exists a positive vector ),which makes the following formula true:
2.2. Modeling of Euler–Lagrange Systems
A multiple Euler–Lagrange system includes
N Euler–Lagrange subsystems.
represents the task-space position vector of the
i-th subsystem, where m represents the dimensions of the position coordinate. On the basis of the kinematic characteristics of the Euler–Lagrange subsystem, the task-space position
satisfies
where
represents the generalized coordinate position vector of the
i-th Lagrange subsystem,
n represents the generalized coordinate dimension, and
represents the non-linear mapping from the generalized coordinate position to the task-space position, which satisfies
where R is the rotation matrix, and P is the translation vector.
Differentiating Equation (3) yields the task-space velocity [
29].
where
represents the relation between the generalized coordinate space velocities and task-space velocities of the
i-th Euler–Lagrange subsystem, and it describes the kinematic properties.
A Euler–Lagrange system generally has multiple degrees of freedom, e.g., the joint angle dimension of a manipulator. The generalized coordinate space is its joint angle space. It is noteworthy that the kinematic relationships become more and more complex with the increase in dimensions. These complex kinematic relations are included in the Jacobian matrix expressed macroscopically. In fact, the Jacobian matrix has the properties described below [
29].
Property 1: The kinematic equation (Equation (5)) is linearly parameterized and the following form is obtained:
where
denotes the kinematic regression matrix, and
denotes the unknown kinematic parameter vector, which is constant.
For ease of expression, we abbreviate
to
and
to
. Furthermore, according to the Euler–Lagrange Equations (2)–(7), the dynamic equation of the
i-th subsystem can be obtained as follows:
where
represents the control input vectors of the
i-th Euler–Lagrange subsystem (e.g., the joint torque input for the
i-th manipulator),
represents the symmetric positive definite inertia matrix,
is the Coriolis and centrifugal matrix,
is the skew-symmetric matrix, and
represents the gravitational force. Any vector
∈
with proper dimensions satisfies
This property plays a crucial role in the subsequent analysis. Meanwhile, the dynamic equation (Equation (7)) satisfies the property described below.
Property 2: The following equations can be obtained by linearly parameterizing the dynamic Equation (7) of the
i-th subsystem.
where
n×1;
n×p3 represents the dynamic regression matrix, and
p3×1 is the unknown dynamic parameter vector, which is constant. Here, p3 represents the number of unknown parameters, which is related to the dimension of the generalized coordinate vector.
2.3. Description of the Problems and Control Objectives
This paper focuses on networked multiple Euler–Lagrange systems, where the network adopts a strongly connected directed topology, and its switching link between subsystems contains bounded time-varying delay from node j to i. We took the slow time-varying delay communication system as the research object, with a delay change rate less than or equal to 1. The kinematic and dynamic parameters ( and ) of Euler–Lagrange systems are usually unknown.
The overall goal of this paper was to realize the asymptotic tracking of the collectively expected task-space trajectory of all Euler–Lagrange subsystems by studying the task-space coordination tracking controller and its control algorithm with excellent performance.
3. Design of Task-Space Cooperative Tracking Controllers
From the above analysis, it can be seen that the Jacobian matrix
composed of the kinematic parameters is unknown. In order to solve this problem, our method involves using its estimated matrix
to design the controller. According to Equation (6), the following formula can be obtained:
According to Equation (10), the product
consists of two parts:
represents the regression matrix, whereas the parameter vector
is the estimate of
, which can be estimated in real time using an adaptive law. On the basis of
, we propose the following observers to estimate the task-space velocity:
where
;
denotes the control gain matrices,
represents the observation errors,
represents the tracking errors, and
represent the positive constants.
Furthermore, by differentiating
, the estimate of the velocity error can be obtained as follows:
where
. Furthermore, according to the description of the problem, we need to consider the slow time-varying delay
from node
j to
i, which satisfies the following relationship:
where
represents the time-varying delay rate, and
represents the upper bound of
. According to the above analysis, the reference generalized space and task-space velocities can be defined as follows:
where
denotes the pseudo-inverse of
,
is abbreviation of
,
are the gain coefficients of the network mutual coupling term related to the time-delay rate, and
is the estimated tracking error.
Note that, in order to guarantee asymptotic convergence in the synchronization error [
30], the mutual coupling term is considered in Equation (14). Compared with the literature [
31], the reference generalized space velocities and the reference task-space velocities of Euler–Lagrange systems proposed in this paper include the gain coefficients related to
. Its key function is to ensure that the controller achieves good performance in the presence of time-varying delay.
In addition, differentiating Equation (14) gives the following result:
In the above analysis, a generalized spatial reference velocity was defined in order to carry out stability analysis. Referring to the setup method of the sliding mode vector in [
32,
33,
34], a generalized spatial velocity sliding mode vector for Euler–Lagrange systems can be defined as follows:
By comprehensively deriving Equations (10)–(16), the following formula can be obtained:
where
represents the estimation error of unknown parameters,
By introducing Equation (17) into Equation (11), the following formula can be obtained:
Above, we analyzed the uncertainty in kinematics; next, we focus on the uncertainty in dynamics. According to Property 2, we can also estimate the dynamic parameters by following a similar method to that used for estimating the kinematic parameters.
where
represents the estimation vectors of unknown dynamic parameters, and
,
represents the estimation of the corresponding matrices and vectors of dynamic equations.
Our proposed cooperative controller is shown below.
where
,
are control gain matrices of the
i-th Euler–Lagrange subsystem. The block diagram of the cooperative controller is shown in
Figure 1.
After substituting Equation (20) into Equation (7), the following equation can be obtained:
By adding the term
to the two sides of the above equation, we obtain the following equation:
Since
, the following formula holds:
Substituting Equation (16) into the above equation, the following equation can be obtained:
After substituting Equation (9) into the above equation, the closed-loop system is given by Equation (21).
where we
as
,
as
and
as
;
is the estimation error of unknown dynamic parameter vectors.
We propose the adaptive laws for
and
as follows:
4. Stability Analysis
In this section, we analyze the asymptotic stability of the multiple Euler–Lagrange systems. For the network Lagrange system, when it has a strong connection communication topology, we hope that the designed controller (Equation (20)) can not only ensure the accuracy of the tracking error and synchronization error, but also ensure asymptotic stability under the cooperation of the adaptive laws (Equations (22) and (23)). Specifically, when and ,, where satisfies Equation (13).
First, we construct a Lyapunov-like positive definite function, as follows:
After differentiating Equation (24), the following result can be obtained:
Since
and
are constants,
,
, and
. By substituting Equations (8), (17), (18), and (21) into Equation (25), the following formula is obtained:
According to the relationship between
and
given by Equation (14), Equation (26) can be rewritten as follows:
For networked multiple Lagrange systems, we introduce the following Lyapunov−Krasovskii functional (LKF):
By differentiating Equation (28) and substituting Equations (12)–(14) and (21)–(23), the following inequality can be obtained:
Let
=
; with the aid of Lemma 2, the following formula is true:
Therefore, Equation (29) can be arranged as
According to Equations (13) and (14), we have ,. Then, holds, which means that has an upper bound. Therefore,, , , , and are bounded. Hence, , , , , and . From Equations (22) and (23), can be derived. Since , then . Furthermore, from Equation (14), we can conclude that . With , holds; then can be easily deduced. Since , , are bounded, we have by means of Equation (11). Due to the bounded , it is easy to derive using Equation (15). From Equation (21), exists. By differentiating , can be derived. Thus, is bounded. According to Lemma 1, when , exists. Therefore, for as .
Furthermore, is convergent, which means that () and , for as . Similarly, can also be derived. For strongly connected graphs, there exists , for as .
5. Numerical Simulation
To test the performance of the proposed controller, a six-DOF manipulator system in a strongly connected network was taken as an example for simulation. The image plane was considered as the task-space. First, the Laplace matrix L is given as follows:
The time-varying delays in network communication topology are defined by the following matrix:
where
,
,
, and
.
From Equations (13) and (14), and can be obtained as ,,,,,, and ,.
In this simulation, this paper took the two-link manipulator system as an example to illustrate the problem simply and effectively with the following parameters: connecting rod length, ; distance between the center of gravity of the connecting rod and the first connection, ; mass, = 0.5 kg; length of the object to be grabbed, . Since each manipulator is the same, their parameters are also the same. The vertex at the end of the grasping object away from the grasping point was chosen as the reference point.
As the actual dynamic parameters are unknown, they are estimated by the linearization method described in Properties 1 and 2. In the simulation process, we randomly set and which represent unknown dynamic and kinematic parameter vectors, respectively; the unknown parameter vectors were updated iteratively in real time through the adaptive law, thus, eventually converging to a constant vector equal to the actual value. The controller gains are . We chose the common expected trajectory on the image plane to be a circle, where , .
Figure 2,
Figure 3,
Figure 4,
Figure 5 and
Figure 6 show the simulation results, in which the convergence of the position and velocity tracking errors of the six agents on the
X- and
Y-axes are shown in
Figure 2 and
Figure 3, respectively, and the actual positions of the six agents on the
X- and
Y-axes are shown in
Figure 4.
Figure 5 shows the convergence of the
X-axis synchronization error between the two agents, and
Figure 6 shows the convergence of the kinematic parameter estimates when three different initial values are taken. The results show that the estimated values of kinematic parameters gradually converge to their actual values over time without being affected by different initial values.
The research results in this paper were compared with the case in [
34], which can only handle constant communication delay. The synchronization error curve is shown in
Figure 5. Controller 1 was proposed in [
31], whereas controller 2 was proposed in this paper. The simulation results show that the proposed controller (Equation (20)) guarantees the asymptotic convergence of the synchronization error between agents; hence, networked Euler–Lagrange systems with time-varying delays can realize synchronization in the task-space, even in the case of dynamic and kinematic uncertainties.
Note that, when estimating unknown parameters, the variation range of unknown parameters is generally determined on the basis of engineering experience, and the initial value of parameter estimation is selected within this range. In this paper, the initial value of the kinematic parameters of the robotic subsystems was randomly selected within the range [1,3].
6. Conclusions
First, a novel task-space cooperative tracking control strategy was proposed for networked, uncalibrated, multiple Euler–Lagrange systems with complex characteristics, including kinematic, dynamic uncertainty, and time-varying communication delay. By considering the influence of time-varying communication delay, a task-space reference velocity observer was proposed to solve the problem where the task-space velocity is not easy to obtain.
Second, adaptive laws for estimating uncertain kinematic and dynamic parameters were designed. Using these adaptive laws, unknown kinematic and dynamic parameters can be estimated in real time, so as to ensure that the networked, uncalibrated, multiple Euler–Lagrange system can track a collectively expected trajectory in the presence of time-varying communication delays.
Third, with the help of Lyapunov stability analysis theory, the asymptotic convergence of the tracking error and synchronization error of the system was proven. Simulation results show that the proposed task-space cooperative tracking control strategy has good control performance. This research provides an effective control scheme for the collaborative control of networked robot systems with complex characteristics, and its results lay a foundation for the real-time control of multiagent systems in the future.