Abstract
In this paper, we focus on a new class of optimal control problems governed by a simple integral cost functional and isoperimetric-type constraints (constant level sets of some simple integral functionals). By using the notions of a variational differential system and adjoint equation, necessary optimality conditions are established for a feasible solution in the considered optimization problem. More precisely, under simplified hypotheses and using a modified Legendrian duality, we establish a maximum principle for the considered optimization problem.
Keywords:
isoperimetric-type constraints; optimal control; control Hamiltonian; variational differential system; symmetry; adjoint equation MSC:
34H05; 65K10; 90C46
1. Introduction
Currently, the optimal control theory is under continuous development. This theory is based on the optimization of some functionals with ordinary differential equations/partial differential equations (in short, ODE/PDE) constraints, all depending on the control functions (for variational control problems with first-order PDE constraints, the reader is directed to Mititelu and Treanţă [1], Treanţă [2,3], and Treanţă and Arana-Jiménez [4,5]). There are three approaches: variational calculus, the maximum principle, and dynamic programming. One of the most important approaches is the second (see Pontriaguine et al. [6]), providing necessary optimality conditions. Also, in additional conditions, from this principle one can derive the Euler-Lagrange or Hamilton equations (see Treanţă [7,8]). Noether-type theorems between symmetries and conservation laws for dynamical systems (governed by autonomous second-order Lagrangians) have been investigated in Treanţă [9]. The sufficient optimality conditions are more complicated and they have most frequently been formulated in simplified versions (see, for instance, Hestenes [10], Maurer and Pickenhain [11], Rosenblueth and Sanchez Licea [12,13], and Treanţă [14]). In [15], Agrachev et al. provided sufficient conditions for a bang-bang extremal (to be a strong local minimizer) in a Mayer control problem, where the state space and the end point constraints are finite-dimensional smooth submanifolds and the controls take values in a polyhedron and appear linearly. Caputo (see [16,17]) has developed fundamental identities linking the optimal solution functions and optimal value functions for reciprocal pairs of isoperimetric control problems. In Aronsson and Barron [18], Aronsson–Euler equations have been obtained for variational problems with holonomic, nonholonomic, isoperimetric, and isosupremic constraints on the minimizer.
Motivated and inspired by the aforementioned research works, the main aim of this paper is to formulate and prove necessary optimality conditions for a feasible solution in isoperimetric-type constrained control problems. More precisely, by using the concepts of a variational differential system, adjoint equation and a modified Legendrian duality, under simplified hypotheses, we establish a maximum principle for the considered optimal control problem.
The optimal control problems with isoperimetric constraints are governed by some basic elements: (1) the control (arising in the objective functional and isoperimetric constraints) so that any change in the control involves a change in the state , (2) the state equation (the isoperimetric constraints) provides the dependence between the control and the state, (3) the functional to be extremized, called the objective functional or the cost functional, depending on the control and the state. The goal is to find an admissible control that generates a satisfactory state and extremizes the value of the objective functional (the admissible control having this property is called optimal control in the considered optimization problem). For other ideas that are connected to this subject, the reader is directed to Evans [19], Kalaba and Spingarn [20,21], Lee and Markus [22], Barbu et al. [23], van Brunt [24], and Treanţă [25,26].
2. Problem Formulation and Auxiliary Results
In this section, we investigate the following optimization problem governed by simple integral objective functional and isoperimetric-type constraints:
such that
Our working hypotheses and notations are: is the time; the space of all functions , where , is a -class function (called the state variable), and the space of all functions , where , is a piecewise continuous function (called the control variable), satisfying and , which define the feasible set associated with ; , are -class functions; the objective functional (non-autonomous Lagrange functional) is a -class function.
Further, in order to study the previous optimal control problem, let us introduce the auxiliary variables , as follows
or, equivalently,
In this way, the isoperimetric-type constraints are substituted by constraints of ODE type.
In the following, Einstein’s summation is assumed. By considering the Lagrange multiplier, , also called co-state variable (co-state vector), we introduce a new Lagrangian
changing the aforementioned isoperimetric-type constrained optimization problem into a new optimal control problem (without isoperimetric-type constraints):
such that
where represents the set of all co-state functions (introduced in the next section).
Now, by considering the control Hamiltonian
or, equivalently,
we can rewrite the aforementioned optimal control problem under the next equivalent form:
such that
In the following, let us consider the relations formulated in . Now, we fix the control variable and the associated solution of . Denote by a differentiable variation for , fulfilling
By a derivation with respect to , for , we get the following variational differential system
By considering , we introduce the following adjoint differential equation
associated with the previous variational differential system in the sense that is a first integral, that is,
3. Main Result: Necessary Optimality Conditions for (CP)
In this section, we formulate and prove the main result of this paper. More concretely, under simplified hypotheses, we establish necessary conditions of optimality for the considered optimal control problem involving isoperimetric-type constraints. For other connected ideas to this subject, the reader is directed to Treanţă [27], where several optimization problems governed by simple, multiple, or curvilinear integral functionals (involving second-order Lagrangians) subject to ODE, PDE, or isoperimetric constraints are considered. Also, Treanţă [28] introduced a modified multidimensional optimal control problem and established the associated saddle-point optimality criteria.
In the following, we consider the control variable , with , as an optimal control for the considered optimization problem . Select and define the control variation , where is some given function (called acceptable variation) selected so that is an admissible control for all sufficiently small . We shall use this in our variational arguments.
The state variable , associated with the control function , satisfies
and . For all sufficiently small , introduce the following function
By hypothesis, is an optimal control in and, consequently, it results , for all sufficiently small . Also, the following equality
is fulfilled for any continuous function . The variations involve
and the corresponding function
For the following computations, the co-state variable is considered of -class. Considering the control Hamiltonian involving variations
it follows
By derivation with respect to , for , and using the adjoint differential equation, we have
where is the state variable corresponding to the optimal control variable . By hypothesis, it follows , for any acceptable variation . Also, the function solves the following Cauchy problem,
Now, taking into account the previous mathematical context, the results are
and, also,
Define as the set of solutions for
that is, the Lagrange multiplier is a constant ( is a constant function). Moreover,
Finally, taking into account all the previous computations, we are able to formulate a simplified maximum principle. The following theorem represents the main result of the present paper. More precisely, necessary optimality conditions are established for the considered optimal control problem involving isoperimetric-type constraints.
Theorem 1.
Let be an optimal solution in the considered optimal control problem . Then, there exists the constant co-state variable such that the relations (5–9) are fulfilled, except at discontinuities.
Remark 1.
- (i)
- The algebraic systems in and describe the critical points associated with with respect to the control variable and the state variable .
- (ii)
- The differential Equations and and the conditions formulated in , , and represent the Euler–Lagrange ODEs, respectively,corresponding to the new Lagrangian .
Further, by using the new Lagrangian and the aforementioned remark, we establish the following result.
Corollary 1.
Consider is an optimal solution associated with the optimal control problem . Then, there exists the constant co-state variable such that
and the following Euler–Lagrange ODEs associated with the Lagrangian
are satisfied, except at discontinuities.
4. Conclusions
In this paper, by using corresponding variational differential systems, adjoint equations and a modified Legendrian duality, we have derived necessary optimality conditions for a feasible point in the considered isoperimetric-type constrained optimal control problem. The main result of this work is original and complements previously known results (see, for instance, Treanţă [7,8,14,29]). The current research paper can be extended for other classes of optimal control problems such as variational control problems under uncertainty. Also, the study of sufficient optimality conditions for such optimal control problems is another topic open to research.
Funding
The APC was funded by University Politehnica of Bucharest, “PubArt“ program.
Conflicts of Interest
The author declares no conflict of interest.
References
- Mititelu, Ş.; Treanţă, S. Efficiency conditions in vector control problems governed by multiple integrals. J. Appl. Math. Comput. 2018, 57, 647–665. [Google Scholar] [CrossRef]
- Treanţă, S. On a new class of vector variational control problems. Numer. Funct. Anal. Optim. 2018, 39, 1594–1603. [Google Scholar] [CrossRef]
- Treanţă, S. KT-geodesic pseudoinvex control problems governed by multiple integrals. J. Nonlinear Convex Anal. 2019, 20, 73–84. [Google Scholar]
- Treanţă, S.; Arana-Jiménez, M. KT-pseudoinvex multidimensional control problem. Optim. Control Appl. Meth. 2018, 39, 1291–1300. [Google Scholar] [CrossRef]
- Treanţă, S.; Arana-Jiménez, M. On generalized KT-pseudoinvex control problems involving multiple integral functionals. Eur. J. Control 2018, 43, 39–45. [Google Scholar] [CrossRef]
- Pontriaguine, L.; Boltianski, V.; Gamkrelidze, R.; Michtchenko, E. Théorie Mathématique des Processus Optimaux; Edition MIR: Moscou, Russia, 1974. [Google Scholar]
- Treanţă, S. PDEs of Hamilton-Pfaff type via multi-time optimization problems. U.P.B. Sci. Bull. Ser. 2014, 76, 163–168. [Google Scholar]
- Treanţă, S. Higher-order Hamilton dynamics and Hamilton-Jacobi divergence PDE. Comput. Math. Appl. 2018, 75, 547–560. [Google Scholar] [CrossRef]
- Treanţă, S. Noether-type first integrals associated with autonomous second-order Lagrangians. Symmetry 2019, 1088, 11. [Google Scholar] [CrossRef]
- Hestenes, M.R. Calculus of Variations and Optimal Control Theory; John Wiley & Sons: New York, NY, USA, 1966. [Google Scholar]
- Maurer, H.; Pickenhain, S. Second order sufficient conditions for control problems with mixed control-state constraints. J. Optim. Theory Appl. 1995, 86, 649–667. [Google Scholar] [CrossRef]
- Rosenblueth, J.F.; Licea, G.S. A Direct Sufficiency Proof for a Weak Minimum in Optimal Control. Appl. Math. Sci. 2010, 4, 253–269. [Google Scholar]
- Rosenblueth, J.F.; Licea, G.S. Sufficient Variational Conditions for Isoperimetric Control Problems. Int. Math. Forum 2011, 6, 303–324. [Google Scholar]
- Treanţă, S. Sufficient efficiency conditions associated with a multidimensional multiobjective fractional variational problem. J. Multid. Model. Optim. 2018, 1, 1–13. [Google Scholar]
- Agrachev, A.A.; Stefani, G.; Zezza, P. Strong optimality for a bang-bang trajectory. SIAM J. Control Optim. 2002, 41, 991–1014. [Google Scholar] [CrossRef]
- Caputo, M.R. Economic characterization of reciprocal isoperimetric control problems. J. Optim. Theory Appl. 1998, 98, 325–350. [Google Scholar] [CrossRef]
- Caputo, M.R. Economic characterization of reciprocal isoperimetric control problems revisited. J. Optim. Theory Appl. 1999, 101, 723–730. [Google Scholar] [CrossRef]
- Aronsson, G.; Barron, E.N. L∞ variational problems with running costs and constraints. Appl. Math. Optim. 2012, 65, 53–90. [Google Scholar] [CrossRef]
- Evans, L.C. An Introduction to Mathematical Optimal Control Theory; Lecture Notes; Department of Mathematics, University of California: Berkeley, CA, USA, 2008. [Google Scholar]
- Kalaba, R.; Spingarn, K. Control, Identification, and lnput Optimization; Plenum: New York, NY, USA, 1982. [Google Scholar]
- Kalaba, R.; Spingarn, K. Automatic Solution of Optimal Control Problems III: Differential and Integral Constraints. Control Syst. Mag. 1984, 4, 3–8. [Google Scholar] [CrossRef]
- Lee, E.B.; Markus, L. Foundations of Optimal Control Theory; Wiley: New York, NY, USA, 1967. [Google Scholar]
- Barbu, V.; Lasiecka, I.; Tiba, D.; Vârsan, C. Analysis and Optimization of Differential Systems. In Proceedings of the International Working Conference on Analysis and Optimization of Differential Systems, IFIP TC7/WG7.2, Constanta, Romania, 10–14 September 2002; Kluwer Academic Publishers: Dordrecht, The Netherlands, 2003. [Google Scholar]
- van Brunt, B. The Calculus of Variations; Springer: Berlin/Heidelberg, Germany, 2004. [Google Scholar]
- Treanţă, S. PDE-constrained vector variational problems governed by curvilinear integral functionals. Appl. Anal. Optim. 2019, 3, 83–101. [Google Scholar]
- Treanţă, S. On Controlled Variational Inequalities Involving Convex Functionals. In Optimization of Complex Systems: Theory, Models, Algorithms and Applications. WCGO 2019, Advances in Intelligent Systems and Computing; Le Thi, H., Le, H., Pham Dinh, T., Eds.; Springer: Cham, Switzerland, 2020; Volume 991, pp. 164–174. [Google Scholar]
- Treanţă, S. Constrained variational problems governed by second-order Lagrangians. Appl. Anal. 2018. [Google Scholar] [CrossRef]
- Treanţă, S. On a modified optimal control problem with first-order PDE constraints and the associated saddle-point optimality criterion. Eur. J. Control 2019. [Google Scholar] [CrossRef]
- Treanţă, S. Multiobjective fractional variational problem on higher-order jet bundles. Commun. Math. Stat. 2016, 4, 323–340. [Google Scholar] [CrossRef]
© 2019 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).