1. Introduction
One of the main objectives of robotics is to create universal and adaptable machines capable of performing a variety of tasks and proactively adapting to changing conditions. While conventional robots are able to perform specific tasks with exceptional precision, speed or reliability, they find significant difficulties in adapting to other more compliant tasks as well as in operating in completely unstructured environments.
To overcome these difficulties, the new field of soft robotics has emerged, where soft elements are used to replace rigid robotic links and joints. The softness of these robots is a promising feature for improving interaction with the environment. When comparing the degrees of freedom (DoF) of a rigid manipulator versus a soft manipulator, it is observed that rigid robots move in 6 DoF (position and orientation), while soft bodies have an infinite number of DoF [
1]. This feature provides them with capabilities such as adaptability and better shock absorption.
Since soft robotics is a new, innovative and very active field of research, new designs and methods of operation are continuously emerging. However, with such different platforms and their unique attributes, it is difficult to find integrative methodologies for their modeling and control [
2].
Deformations of soft robots are difficult to predict, and actuators are often integrated into the structure, resulting in a coupled actuation [
3]. Soft materials also exhibit nonlinearities such as compliance and hysteresis, which restrict high-frequency control. Conventional control approaches assume the stiffness of the robot links, and when translated directly to the control of robots with soft links, they do not adapt well. Therefore, new control algorithms are required when working with soft robotics [
4,
5].
Concerning soft robot control, two approaches are mainly used: open loop control and closed loop control. For the open loop approach, the most common technique used is the finite element method (FEM) [
6]. This method approximates the continuous deformation of the system. For instance, in [
3], a real-time FEM control model for a pneumatic robotic manipulator is proposed. However, due to its high computational cost, FEM is often used for offline validation of analytical models and experimental results [
7]. The closed loop (feedback) allows the correction of control inaccuracies due to external agents and model uncertainties. Nevertheless, a suitable model is also very important in this case in order to find a suitable controller. The soft robot’s high complexity makes empirical or tuning rules ineffective in this case. Two different approaches can be found in the literature for closed loop control: the first focuses on the control of a soft actuator and the second focuses on the control of the complete robot structure, which integrates all actuators and soft links. For instance, some actuator control examples can be found in the control of dielectric elastomers [
8], twisted and coiled polymers [
9], or shape memory alloys [
10]. In this paper, we apply the second approach.
A greater number of different methodologies are found in the control of the complete soft system. Some examples are the use of model predictive control (MPC) together with a simplified physical model of the joint space of a pneumatic soft robotic arm [
11]; the soft robotic arm driven by 12 wires embedded inside a silicon body made at the BioRobotics Institute of Pisa, which uses a Proportional Integral Derivative (PID) control [
12]; or the soft robotic neck driven by three wires made at the RoboticsLab of the University Carlos III of Madrid, which uses a fractional order controller (FOC) [
13]. From these control techniques, fractional order controllers have demonstrated to be a good alternative to their integer order versions [
14]. Nevertheless, control remains one of the main challenges in soft robotics.
Fractional order controllers allow the exponents of the integral and derivative actions to be noninteger (fractional). This way, besides the three proportional (
), integral (
) and derivative (
) parameters defining the integer PID, a fractional order PID (FOPID) introduces two other parameters into the tuning process: the orders of the integral (
) and derivative (
) operations, respectively. This order generalization allows a higher number of control specifications to be met and a wider variety of controller design methods, from optimization to more intuitive graphical approaches [
15].
The features provided by fractional order control are useful for controlling the dynamics of soft robotic systems where robustness and precision are important. Different combinations of control actions can be selected according to each particular control problem. For instance, an example of the potential of using a fractional order PI (FOPI) for the control of a soft link is presented in [
16], where a robust pose performance is obtained. The control problem when using a fractional order PD (FOPD) for the case of a soft robotic neck is also addressed in [
17].
The aim of this paper is to develop a functional controller for the soft robotic arm shown in
Figure 1, developed at the RoboticsLab of the Universidad Carlos III of Madrid (see [
18] for details). Its innovative design is under a patenting process [
19]. The arm acts by means of a central soft element made up of NinjaFlex (thermoplastic polyurethane), which allows the flexion in two axes of rotation thanks to the tension produced by three tendons attached to the tip of the robot.
In [
18], an open loop actuation was performed on the soft arm using a kinematic approach. However, using an open loop configuration makes it difficult to perform accurate positioning and to respond to changes in the system, such as external loads. Since precision is one of the most difficult goals in soft robotics, it is important to find an improvement in control. Given the soft characteristics of the arm, when high loads are applied, it may bend excessively. This is a challenge to be faced from the control side, which will be responsible for limiting this extra bending while ensuring accurate positioning.
From these results, the need to use a closed loop configuration becomes clear. PID controllers are one of the most widespread control methodologies; over 95% of control loops are PI/PID type [
20]. This is due to advantages such as their simple implementation and the large number of tuning methods that are available and proving to be very useful for a multitude of systems. However, this simplicity may become a disadvantage when the system requires more demanding control constraints. When trying to control the soft arm under certain conditions, the response may not be stable.
Therefore, a fractional order controller is proposed for the closed loop control of this innovative soft arm, which presents different morphological characteristics with respect to other soft robot designs. Designing, prototyping and controlling this robot are very challenging problems not previously faced in the literature; this work addresses them all at once and contributes to soft robotics real-world applications, and also to the experimental application of fractional order controllers.
From the system identification perspective, a new methodology for decoupling the soft robot model is presented, which allows decomposing the system into a simpler set of subsystems. From the control system perspective, we propose a fractional order controller and demonstrate experimentally how the generalization of a robust controller as the PI into its fractional order version makes it possible to address the very challenging control problems that arise from the soft nature of the robot.
The rest of the paper is organized as follows.
Section 2 presents a detailed description of the soft arm platform and its operation.
Section 3 describes the mathematical methodology to deal with the modeling and decoupling of the system.
Section 4 details the methodology used for the system identification, and
Section 5 describes the selection of the control specifications and development of the controllers.
Section 6 analyses the results, comparing the data obtained from real experiments using different controllers and loads. Finally,
Section 7 summarizes the main conclusions of the work.
2. Description of the Soft Arm Platform
The actuation of the soft robotic arm (
Figure 1) is achieved by varying the length of each of the three tendons placed longitudinally inside its link. The tendons are routed through the vertices of the triangles and are attached to the free end of the arm and to a winch at the base. A motor is responsible for the pulling of each tendon and, therefore, for the bending of the arm.
Unlike other designs that commonly have a cylindrical shape [
21,
22], this design has a triangular morphology that allows different locking configurations. As shown in
Figure 2a,b, the maximum curvature is different when bending in the direction of the triangle vertices than when bending in the direction of the triangle edges. This property can be used for the protection of the structure when heavy loads are placed at the tip or when a high flexion of the arm is demanded, which can compromise the integrity of the robot. In addition, the configurations can be used as locks to help prevent the movement of load [
19].
The initial length of the tendons is considered equal to the height of the soft arm, which is
m in this design. These lengths are modified by the winding or unwinding of the tendon as it rotates through the actuation of the motor, a Maxon EC-max 22. The motors are controlled by Technosoft’s Intelligent Drives iPOS 4808 MX. The combination of tendon lengths provides different tip positions. The tendons are numbered and arranged for identification: tendon 1 is positioned on the Y-axis; tendons 2 and 3 are named counterclockwise, 120° apart from each other, at a distance
a from the center of the triangle, as shown in
Figure 3.
The orientation of the end-effector, in a three-dimensional environment, can be defined by the combination of the three Euler angles. In this case, Roll—the rotation defined by the Z-axis—cannot change. Data are obtained from the inertial measurement unit (IMU) (sensor 3DM-GX5-10) placed at the top of the arm. Therefore, the final orientation can be described as the combination of Pitch and Yaw, these being the rotation angles around the X and Y axis, respectively, as illustrated in
Figure 4a,b.
Therefore, the soft arm can be considered as a multiple-input multiple-output (MIMO) system with three inputs and two outputs. The inputs are the lengths of the tendons, which are controlled by motors, and the outputs are the pitch and yaw angles, which are measured by the IMU.
3. Modeling Approach
For modeling of the robotic system, a decoupling method is proposed so that the MIMO system can be modeled as two independent SISO subsystems by addressing the kinematic problem separately for the pitch () and yaw () movements. These two new subsystems are more easily identifiable, allowing us to obtain the transfer functions and for and , respectively.
To decouple the systems, as explained in [
16], the angle
is described by the following equation:
where
is the angle contribution of each actuator to the final angle around the X-axis,
is the projection factor that depends on the relative angle of each actuator,
is the variation of the initial length of each tendon and
f is a nonlinear function that describes the relationship between them. Using the above methodology, a similar equation can be formulated for
as the angle contribution of each actuator to the final angle around the Y-axis:
The resulting tip angles depend on the forces produced by the linear actuators. Therefore, given the construction of the robot, although the f-functions are nonlinear, the angles can be considered additive, resulting in the following Equations (
1) and (
2):
Equations (
3) and (
4) consider the same distribution of the actuators, and the values of
for this specific case are
,
and
. Therefore, the equations can be rewritten as
Angles and depend on the difference in tendon length. Besides, as the same type of actuator is used for each tendon, it can be assumed that the functions f relating the actuator angle and the variation of each tendon length are also similar. Based on this, variables and can be redefined as a linear combination of the tendon lengths without loss of generality. In addition, it can be observed that, when acting in , the tendon length s has no influence on the movement, and for , angles and are 0 and the length of the soft arm l is the length of the tendons at rest (no flexion).
Taking into account this redefinition of
and
, the variations in the tendon lengths can be calculated from Equations (
5) and (
6) as follows:
The results of Equations (
7)–(
9) are a system of three unknowns—
—and two equations, since Equations (
8) and (
9) are the same equation. It is then assumed that, during flexion, the curvature is constant. The assumption of constant curvature means that the entire arm will have the same angle of curvature while performing, as occurs in the arc of a circle. Considering the assumption of a constant curvature for this tendon distribution, the following Equation (
10) can be used [
23], obtaining the third equation for the three unknowns system, where the three unknowns can be related:
where
is the length of the tendon with constant curvature and
; consequently,
. By solving this system of equations, the resulting tendon lengths as a function of angles
and
are
In summary, through the decoupling process, the relationship between the tendon lengths and angles
and
has been obtained (Equations (
11)–(
13)). Lengths
will be the references to be achieved by the motors when acting to reach a pose given by the pair (
,
).
Although an important nonlinear behavior is expected due to the system and material properties, as observed in other experiments [
16], it is the aim to propose a robust control strategy based on FOC to overcome these modeling mismatches and achieve a good arm performance. It is worth mentioning that our arm design approaches constant curvature performance, and this assumption allows a significant simplification of the system model versus others that require numerous parameters to be estimated and a high computational cost when it comes to control [
2].
4. System Identification
This section describes the methodology used to identify the two SISO subsystems addressed in the previous section. The identification is achieved through the two transfer functions and introduced before, which are linear functions that use the Laplace transform to represent the dynamic and stationary behaviors of any system.
The real data used for the identification process are the velocities commanding the motors (system inputs) and the pitch and yaw angles or the arm measured by the IMU (system outputs).
The reason behind the use of a velocity input model is the asymmetry of the pitch performance and the gravity effect. As discussed above, seen from the YZ plane (
Figure 4a), a positive pitch movement is achieved by the actuation of two tendons, which are closer to the central bending axis of the soft arm, whereas a negative pitch is achieved by the other tendon further away from the bending axis. When a motor position input is used for the identification, the system presents a strong asymmetry with respect to the positive and negative pitch values
achieved, as shown in
Figure 5. The data show a nonlinear behavior that makes it impossible to formulate just one transfer function to represent the system model for the whole pitch range. This problem is avoided when using a motor velocity input, as will be discussed below, which yields a more consistent behavior in both directions and facilitates both the system identification and the later control problem.
Therefore, the identification of the systems and is now addressed considering the motor angular velocity as input in radians per second, measured by the motor encoders, and the pitch and yaw angles in degrees as outputs, respectively, measured by the IMU. This difference in units has no practical implication other than to increase the gain of the identified function. Degrees have been chosen for the output for a better visualization of the signal range, and radians per second for the motors because these are the units used by the encoders.
Since this is a system where the input is an angular velocity and the output is an angular position, the identification made is expected to contain an integrator in it. For the identification of each system, a pulse train input alternating every two seconds between the values of 3 and −3 radians per second is used, as shown in
Figure 6 for the pitch case. Since an integrator is expected, a step cannot be applied as the bending would grow without limit.
During the identification tests, the variation of the angular position of the arm tip was measured both in pitch and yaw directions. Due to the flexible nature of the arm, a slight vibration occurs in the system when an abrupt change in velocity is applied. This effect is more visible for the pitch case due to the action of gravity, as can be seen in
Figure 6. The parameters are initialized through the Instrument Variable (IV) method, and updated by means of a nonlinear least-squares search method [
24].
Once the identification data are obtained, the corresponding two transfer functions
and
are identified by defining some parameters such as the number of poles, zeros and delay [
25], which yields the following two second-order functions:
As can be observed, both transfer functions have a pole very close to the origin, which represents dynamics similar to an integrator, as expected.
5. Control Specification and Tuning
In the following, integer and fractional order control approaches will be discussed and analyzed. PI and FOPI controllers will be addressed. The PI structure has been chosen against the conventional PID due to the fact that the derivative action amplifies the vibration noise of the soft arm, and it is preferable to avoid it. Regarding the design specifications, constraints on the phase margin () and the gain crossover frequency () of the open loop control system will be imposed. These specifications are chosen because they allow us through the phase margin () to act on the damping ratio and through the gain crossover frequency () on the speed of the system response and stability.
The design of the PI controllers, which have the transfer function given in Equation (
16), has been widely discussed in the control literature [
26,
27,
28], and there are different methodologies for the tuning of the controller parameters. In this work, the PID Tuning Algorithm of [
20] has been used to obtain the parameters
and
that make it possible for the pitch
and yaw
decoupled systems to fulfill the specifications of phase margin and the gain crossover frequency.
Fractional order controllers rely on the use of noninteger orders (exponents of the integral and derivative operations in the Laplace domain) to achieve design specifications that their integer counterparts cannot meet, allowing the fulfillment of robust performance constraints. In this work, the term robustness is used to refer to the ability to cope with the action of external disturbances or loads that cause unwanted deformations in soft bodies, while providing sufficient accuracy and keeping the overshoot of the response constant to gain changes [
15].
Fractional order PID controllers are proposed as a generalization of integer order PID due to the fact that they offer a robust performance against changing plant parameters and nonlinearities, as explained in [
29]. As discussed above, the fractional order proportional integral (FOPI) variant of this controller will be used in this case, whose transfer function is
where
is the fractional order of the integral operator.
Classic tuning methods cannot be applied for fractional order controllers; therefore, other techniques have been developed such as optimization [
30], graphical approaches [
31] or others [
15]. In this work, the iso-m method [
13] will be applied, which allows for controller tuning in a simple and intuitive way while avoiding optimization problems such as local minima or graphical resolution. This approach provides all fractional order controller parameters defined in Equation (
17) for specific values of the phase margin and gain crossover frequency, but keeping the open loop system phase flat, thus meeting the desired specifications of stability and responsiveness of the system while providing a robust system performance. In the case of the soft arm, the system itself shows a variable gain during the operation, making the robust controller a need in order to achieve a constant performance for all motions.
In order to analyze and compare the performance of the controllers, tuning with different design conditions will be carried out.
Regarding the variation of the performance speed, this is achieved by the selection of different values of the gain crossover frequency . The bigger the frequency, the faster the system response. Regarding the variation of the soft arm loads, they are expected to affect the nominal model of the system, mainly changing its gain. Therefore, the controller has to perform robustly to gain changes, guaranteeing not only the system stability for the whole gain range but a constant overshoot of the time response, which will limit the undesired bending of the arm when heavy loads are carried.
5.1. The First Control Specifications: 60 and 1.5 rad/s
First, a PI controller is designed for each of the systems
and
, defined in Equations (
14) and (
15), using the PID tuning method cited before. The resulting controller parameters are shown in
Table 1, and their transfer functions are given by Equations (
18) and (
19), respectively.
Using the same specifications, the corresponding FOPI controllers are also designed using the iso-m tuning method described in [
13]. The following operations must be carried out for the iso-m controller tuning for the pitch case:
- Step 1.
The system phase and phase slope found at are and , respectively.
- Step 2.
The controller is required to contribute with a phase slope opposite to that of the system—that is, . Besides, in order to achieve the phase margin specification, the controller has to provide a phase at —that is, .
- Step 3.
Based on these two values from Step 2, the fractional order resulting from the slopes graph available in [
13] is
.
- Step 4.
Using these values,
is computed (see [
13] for more details), resulting
.
- Step 5.
Finally, the controller gain k is computed, resulting .
- Step 6.
Therefore, according to the method, the controller parameters are , and .
Following the same steps, the yaw controller was tuned, obtaining a slightly different result. The corresponding controller parameters are shown in
Table 2, and their transfer functions are given by Equations (
20) and (
21), respectively.
An approximation of the fractional order operator
is then needed in order to implement the FOPI controller in the feedback control scheme of the soft arm. One of the most common techniques is the equivalent pole-zero approximation described in [
32], based on the operator frequency response (see for example [
33]). Using this method, the resulting controller approximations are
5.2. The Second Control Specifications: 60 and 5 rad/s
These specifications imply a faster system response but keeping a similar overshoot in comparison with the first experiment. Following the previous tuning methods, the resulting PI controller parameters and transfer functions are shown in
Table 3 and Equations (
24) and (
25), respectively; and the resulting FOPI controller parameters and transfer functions are shown in
Table 4 and Equations (
26), (
27), (
28) and (
29), respectively.
6. Experimental Results
In this section, the performance of the different controllers proposed will be compared by means of their Bode and time response plots. The purpose is to test the system behavior at different speeds and with different loads placed at its tip. The system robustness will be addressed through a load test consisting of adding a 500 g disc at the tip of the arm.
6.1. First Experiment: Using Control Specifications 60 and 1.5 rad/s
The Bode plots of the open loop systems with the corresponding PI and FOPI controllers are shown in
Figure 7 for the PI case and
Figure 8 for the FOPI case.
As can be seen, the phase margin and gain crossover frequency specifications are met in all cases. However, regarding the robustness of the system, the effect of the iso-damping property can be clearly observed in the Bode phase curves of the systems with the FOPI controllers. A flat phase around the gain crossover frequency has been forced, ensuring that variations in the gain of the system will not significantly affect the phase margin and, therefore, achieving a constant overshoot.
Tests are carried out on the real system with the proposed controllers, testing the time response to a pitch step reference of
and keeping a constant yaw angle of
.
Figure 9 and
Figure 10 show the ideal time response represented as the dashed red line, the experimental response of the system without load as the blue continuous line and the experimental response with a load of 500 g as the orange continuous line.
Table 5 and
Table 6 show the response metrics of the systems with and without loads for the PI and FOPI controllers, respectively. Data related to the peak value, peak time and overshoot are presented together with the value of the root mean square error (RMSE) during the first 8 s of the response calculated as
where
is the ideal response at sample
i,
is the corresponding experimental response and
samples (8 s at 50 Hz). In addition, settling times of
s and
s have been obtained for the PI and FOPI cases, respectively.
Even if the system performance is robust for both control approaches and only slight differences can be noticed, it is remarkable that the overshoot for the FOPI case (15.1% for simulation test) is smaller and its variation is also more constrained than for the PI case (23.8% for simulation test).
In order to test the system performance under more demanding speed and trajectory conditions, a second experiment will be carried out, as described in the following section.
6.2. Second Experiment: Using Control Specifications 60 and 5 rad/s
Now, a faster performance speed is required and the gain crossover frequency is increased up to
rad/s. The Bode plots of the open loop systems with the corresponding PI and FOPI controllers are shown in
Figure 11 for the PI case and
Figure 12 for the FOPI case.
As can be seen, the phase margin and gain crossover frequency specifications are met in all the cases, and again, the robustness (iso-damping) constraint is fulfilled for the FOPI case. The phase margin for frequencies close to drops rapidly to the instability region for the PI case, whereas the specified margin is maintained over a wider range of frequencies for the FOPI case.
In order to test the system performance, an input reference has been selected for the soft arm tip involving both pitch and yaw components. The trajectory is based on a slight modification of the lemniscate of Bernoulli, with
and
following the next parametric equations:
where
d is the distance from the focus to the origin and
is the angle of the focal ratio varying by steps of 0.005 radians at a frequency of 50 Hz.
Figure 13 shows the time response of the system for the PI and FOPI cases with no load at the tip. It can be seen that both controllers perform correctly and the arm tracks the reference quite accurately.
There are three trajectory points where the arm tip is observed to slightly move away from the reference: around [−22, 2], [−5, −11] and [5, −11], where the first coordinate corresponds to the yaw angle and the second to the pitch. This is not due to the control but to the mechanical nature of the arm and its constant curvature, which forces winding and unwinding changes of the tendons when different movement regions are reached in order to correctly track the reference.
When the same test is performed with a disc of 500 g placed at the arm tip, the system shows the response of
Figure 14. The presence of load makes the PI system unable to track the reference in three of the four movement regions, and very significant oscillations are observed. However, a better performance is fulfilled for the FOPI case, where model mismatches caused by the mass are robustly faced, allowing much more accurate reference tracking and ensuring the system stability. Only slight oscillations appear in some parts of the trajectory, which could be reduced from the design stage by selecting the adequate elasticity of the soft material according to the loads to be managed.
Table 7 shows the RMSE values both for pitch and yaw trajectory components for the PI and FOPI controllers with and without load. It can be observed that, in comparison with the RMS values obtained from the first experiment, where a step trajectory was selected, the tracking error in this second experiment has been reduced. As expected, the PI performance with the 500 g load shows the worst results (more affected by the influence of gravity), whereas the FOPI performance is remarkable.
In order to asses the system behavior when a more demanding reference is used,
Figure 15 shows the PI and FOPI responses to a step input of
and
for the 500 g load case. The PI system shows a limit cycle performance, whereas the FOPI response is far from instability.
From the tests, the difficulties that arise when controlling soft robots can be appreciated. Working with masses or velocities causes the nonlinearities of the system to show up, demonstrating a performance that is difficult to handle and predict. It has been observed that for tasks without loads or where the soft body movement does not have to be fast, both PI and FOPI work properly. However, when a faster response is needed, and when loads are involved, the PI controller is not able to perform correctly, while the FOPI manages to perform much more robustly.
A video of the experimental results discussed in this section for the case of the robot supporting a load of 500 g (worst case) can be seen here:
https://vimeo.com/762360018 (accessed on 15 December 2022).
7. Conclusions
The soft arm presented is a complex platform where new problems arise that require methodologies to be used in real environments with precision. Due to deformations and nonlinearities, these platforms are difficult to model and control. This work addresses this challenge for the first time for this robotic platform.
Several conclusions can be drawn from the results presented in this paper. First of all, satisfactory results have been obtained from the system identification based on two decoupled transfer functions that accurately model the response of the arm. Second, different controllers have been developed and a comparison has been made between them based on tests such as the tracking of a trajectory with the shape of the Lemniscate curve and the performance when a load is connected to the arm tip.
In this work, controllers have been designed with the following specifications: and rad/s. PI controllers are proposed and show stable responses when acting under load, and this is also fulfilled by the FOPI controller. However, the challenge of soft robot control lies in performing tasks with faster responses. This is the reason why tests with specifications and rad/s have been carried out. In this case, the PI controller that had previously been able to perform the control correctly encounters difficulties in performing load management, not following the reference and showing an oscillatory behavior. As a novel solution for this robot, the use of the FOPI controller shows stable and robust performance, being able to perform the task demanded of the soft arm correctly.
Future works will deal with the use of machine learning techniques for the modeling and control of the soft arm in order to study how they compare with these analytical approaches.