1. Introduction
In this article, we present a research work developed in the framework of the optimal control of dynamical systems whose state is driven by ordinary differential equations [
1,
2]. This work provides a solid foundation for the design and control of new, advanced engineering systems, such as (i) underwater gliders, i.e., winged autonomous underwater vehicles (AUVs), moving by modulating their buoyancy, and their attitude in the environment, or (ii) robotic fish. Motion modelling of these two types of systems can be found in [
3,
4,
5], respectively. These systems are useful because they can be used for a variety of automated tasks in a real fluid, such as (i) transporting materials in a flow or (ii) measuring physical quantities of the flow itself, if equipped with the right sensors/tools. Controlling the movement of these robots in a real flow is therefore crucial to be sure that they work as we expect them to.
Vorticity is a useful description of a flow. A vortex is a point with circulation that generates a rotational flow field. Consider a 2D flow specified in the complex plane by
N point vortices, each located in
[
6,
7]. In this context, the motion of any passive particle advected by this flow is given by the following dynamical equation
where
is the circulation—or strength—of the
j-th vortex, and the Cartesian coordinates are specified in a complex formulation as
.
Table 1 summarises the nomenclature used throughout this article.
However, no flow is completely free of viscosity, and it is important to consider this fact. A simple way to model vortices in a viscous flow is the Lamb–Oseen formulation [
8,
9], which is the solution of the Navier–Stokes equations for an initial condition in which the full vorticity of the flow is concentrated in a single point in the plane. This originates a vorticity field that decays and is diffused radially outwards with a Gaussian profile (see [
6,
10]).
An important result about the Lamb–Oseen vortex is that it is an asymptotically stable attracting solution of the vorticity equation for any integrable initial vorticity configuration, as proven by Gallay and Wayne [
11]. The superposition of
N point vortices is such a configuration, which gave rise to the idea of the multi-Gaussian model. This model assumes that the vorticity field is a superposition of Lamb–Oseen vortices at all times, modelling the behaviour of both the diffusive term and convective term of the vorticity equations through the interaction of the vortices with each other.
More recently, Gallay [
12] has shown that under certain conditions, the solution of the Navier–Stokes equations in the inviscid limit for
-Dirac initial conditions converges to a superposition of Lamb–Oseen vortices. This provides yet another reason for the suitability of the multi-Gaussian model in the description of fluids.
The motion of a passive particle in such a model should follow the velocity field generated by the system of
N vortices, which is given by [
13]
where
is the kinematic viscosity of the flow. This is consistent with Model (
1) as we recover the inviscid equation in the limit
.
This work is a continuation of the study made by Marques et al. (2021) [
14], where the advection of passive particles is made by an (inviscid) point vortex. In [
14], it is shown that the control is explicitly time-dependent, being possible to determine it exclusively by analytical methods. Unfortunately, the same is not possible in the work we are addressing here because of the presence of the viscous terms in Equation (
2); therefore, using numerical computation is necessary. In this article, we consider the case for which the dynamic system is driven by one Lamb–Oseen vortex, and we solve a control problem that consists of moving a particle between two given points by applying the necessary conditions of optimality in the form of a maximum principle [
15]. We focus on the case where the flow is characterised by a single vortex, and we want to move a single passive particle between two points in the 2D plane by acting only on the radial component of the velocity. The inviscid case (
) has been studied by Marques et al. (2021) [
14]: it is shown that this radial control is explicitly time-dependent and that it can be determined exclusively by analytical methods. Unfortunately, this is not possible in a viscous environment where the dynamical system is driven by a Lamb–Oseen vortex. The viscous terms in the equations of motion (
2) hinder the possibility of finding an analytical solution to the problem, so one must resort to numerical computation to find approximate solutions. This article presents a first study of this problem in a viscous environment: we consider the case where the dynamical system is driven by a single Lamb–Oseen vortex, and we solve a control problem consisting of moving a particle between two given points by applying necessary optimality conditions in the form of a maximum principle [
15]. This problem follows the idea of the more general Problem 2 proposed in Protas [
16].
Section 2 and
Section 3 are devoted to the mathematical formulation of the problem. In
Section 4, we derive the optimal control and study the optimal trajectories for the passive particle for different kinematic viscosities. The conclusions and future work constitute the last section.
4. Minimum Energy Problem
Our cost function here is the total control power consumption, i.e., the energy used to move the particle,
We want to minimise the power spent to move the particle between some specified initial and final points so that the particle is at at the final time T.
To obtain the Mayer’s problem, we consider a new variable
satisfying the condition
. Our control problem can thus be formulated as follows:
In addition, we impose the radial velocity approaches zero at so that the control is smooth and differentiable during the arrival at the circular trajectory of radius . For simplicity, we will only consider the case where . The case follows analogously.
For this problem, the Pontryagin–Hamiltonian function is
and the dynamic equations for the adjoint variable are
While the differential equation for is impossible to solve analytically, from the transversality conditions, it is possible to further conclude that and that is constant ().
Thus, the Pontryagin–Hamiltonian function can be rewritten as
Furthermore, we know that the optimal control
should maximise the Hamiltonian at any time; thus,
and the optimal control should satisfy
While the angular motion of the particle follows the same dynamic equation independently of the control, it is possible to distinguish between two different behaviours for the radial motion of the passive particle:
(b) If
, then we have
If
at a certain point of the process, it means that the time
T is not sufficient to complete the transport of the particle without applying the control
. This constant control is more energy-consuming than a variable control implicitly defined by the nonlinear Equation (
17). In this scenario, we start by applying the
control for the time period
until the particle is in a state where it can be brought to the final position by applying the variable control in the remaining time
.
Unfortunately, there is no way to explicitly calculate to determine the switching points for the control. Therefore, to solve the problem, we have to take a different approach. We now analyse the case where throughout the whole process.
If the trajectory never uses the control , then we can divide the motion of the passive particle into two regimes. During the first regime of motion, the particle is pulled radially inwards by a variable control from until its radial coordinate reaches at an unspecified time . The angular motion is influenced by two different factors: the fact that the particle approaches the vortex contributes to the acceleration of the motion, while the fact that the vortex loses strength over time due to the viscosity of the fluid contributes to the deceleration of the motion.
The movement of the particle during this regime is determined by the solution of the following differential equations, valid for the time interval
:
Notice that for and that we cannot solve this problem because we do not know a priori the value of . However, assuming we could, the particle would end at the point in polar coordinates.
The second regime of the motion happens when the particle is describing a circular motion of constant radius
in the time interval
and follows the differential equations
In order to solve this problem, we have to work backwards from the final point since this second regime of motion has an actual (numerically) solvable system of differential equations. Note, however, that solving this control problem is now reduced to finding for the parameters and that give us a solution of Systems (18) and (19) with minimal energy. We first investigate how the solutions of these systems behave when we change these parameters.
In each of the following studies, the approximate solutions of the differential equations were obtained through the Runge–Kutta–Fehlberg method [
17] with a step size of
s. All results presented below use SI units. Viscosity values depend on the physical conditions of the fluid such as temperature and are typically in the range of
–
m
s
. For example, typical seawater at 20 °C has a low kinematic viscosity of about
m
s
, while typical printer inks at about 38 °C can have viscosities of up to
m
s
.
In order to check how the parameters affect the solutions of this problem, we set
m
s
,
m,
m,
,
m
s
and
s. In
Figure 1, we set
s and varied
. The large dashed circumferences correspond to circular trajectories of radius
m and
m, the open circles identify the specified initial and final points for the problem, and the red curve represents the trajectory of the particle corresponding to the second regime of motion. The blue and pink lines represent two possible trajectories for the particle in the first regime of motion, corresponding to different values for
. The black dots correspond to a variety of possible initial positions for the simulation, each for a different
. We note that the radial coordinate of the initial position increases with
and that changing this parameter alone is not sufficient to retrieve the desired initial position. Therefore,
must play a role in this.
Figure 2 is similar to
Figure 1 but now illustrates how the initial position for the simulations is affected by the parameter
. We see that for a radial coordinate equal to that of the initial position of the particle, larger values of
will result in simulated initial points with a larger angular coordinate. Thus, we can think of
as the parameter that controls the radial coordinate and
as the parameter that controls the angular coordinate for the simulated initial position.
From this behaviour, it is possible to develop a simple algorithm to solve the proposed control problem. The idea is as follows: From this behaviour, we develop a simple algorithm to solve the proposed control problem. The idea is as follows:
- (1)
Arbitrate a
. Find two distinct values
, which give rise to two curves of simulated initial positions that go under and over the initial position (like the dotted curves in
Figure 2);
- (2)
Solve Equation (
19) backwards in time from
T to
=
in order to obtain
;
- (3)
Arbitrate a . Find an interval of values for such that if and if ;
- (4)
Solve Equation (
18) backwards in time. If
, adjust
to a lower value; if
, adjust
to a higher value. Re-solve the system until
. Solve Equation (
18) backwards in time with
. If
, adjust
; if
, adjust
. Iterate the system until
.
- (5)
After attaining , check for : if , adjust to a lower value; if , adjust to a higher value; if , adjust ; if , adjust . Repeat the process from (2) until .
Using this technique, we can analyse the possible candidates for the optimal solutions to the problem and identify the one that minimises the energy spent on moving the particle. For example,
Figure 3 shows two possible solutions to the problem with
m
s
,
m,
m,
,
m
s
and
s. These two solutions are candidates that arose from the maximum principle, yet the solution shown in red has a higher energy cost than the one depicted in blue. The existence of multiple candidates arises in the case where
T is large enough to allow the particle to circle around the vortex multiple times. The optimal solution is the one in which the particle makes the fewest revolutions on the trajectory of a smaller radius, i.e., the solution in which the control is active for the most time. This is due to the quadratic cost function: it is better to pull the particle slowly inwards over a longer period of time than to pull it quickly over a shorter period of time.
Finally, we investigate the behaviour of solutions when we change the viscosity of the environment. We worked once again on the problem with
m,
m,
,
m
s
and
s. In
Table 2, we summarise the parameters
and
that we found for the optimal solution for different kinematic viscosities ranging from
m
s
to
m
s
, as well as the energy costs in each of these scenarios. For completeness, the analytical values for
m
s
are also given (from Marques et al. [
14]). Note that for low viscosity, the rounded values might be the same, but they actually differ in decimal places, which are not shown and can be computed to any desired accuracy as long as it is within the machine’s reach.
As expected, the energy cost seems to increase with viscosity, as we have to put more force into the system to move the particle through a more viscous flow. However, there are jumps in this behaviour as we can see when comparing the scenarios of
m
s
,
m
s
and
m
s
(for a visual representation of these optimal trajectories, see
Figure 4 and
Figure 5). The increase in viscosity changes the possible trajectories for the particle in their nature. In the case where
m
s
, the parameters allow for two types of solutions: one where the particle makes less than one complete turn around the vortex under the control (and then more than one full revolution around the vortex under no control) and a second where the particle makes more than one complete turn around the vortex under the control (and then less than a complete revolution around the vortex under no control). This is the same scenario as in
Figure 3, and the optimal trajectory that minimises the energy cost is the one where the control is active for the longest time. Increasing the viscosity to
m
s
is sufficient to exclude this second type of trajectory from the possible optimal trajectories, and we are left with the sole possibility of a trajectory where the particle is pushed harder and faster into a circular trajectory with the same radius as the final point and then makes more than one full revolution around the vortex while subject only to the velocity field of the flow. This increases the energy cost considerably. If we increase the viscosity further—to
m
s
—we are now in a scenario where the particle cannot reach the target point in two complete turns around the vortex, and the optimal trajectory requires only one complete revolution around the vortex. The fact that we now need one less revolution around the vortex to move the particle significantly reduces the energy cost of the process.
Thus, in fact, the energy cost of displacing a particle in this scenario increases with viscosity as long as the number of revolutions required to reach the final remains the same. If the number of turns needed to complete the process decreases, the energy cost of the displacement decreases. This is illustrated in
Figure 6, where we plot the viscosity of the flow against the energy cost for the optimal solution.
The region where the number of revolutions of optimal solutions changes is difficult to analyse, as we have no way of finding the optimal solution in the scenario where there is a time frame where the control is active. These types of solutions lie in this region. It is also not known whether it is possible to find a solution for any value of kinematic viscosity for a given problem. This is particularly difficult to analyse around the switching point of the number of revolutions of optimal solutions.