Next Article in Journal
A New Variational Iteration Method for a Class of Fractional Convection-Diffusion Equations in Large Domains
Next Article in Special Issue
Nonlinear Gronwall–Bellman Type Inequalities and Their Applications
Previous Article in Journal
Fixed Points of Set Valued Mappings in Terms of Start Point on a Metric Space Endowed with a Directed Graph
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Discrete-Time Fractional Optimal Control

Department of Electrical Engineering, National Institute of Technology, Silchar 788010, Assam, India
*
Author to whom correspondence should be addressed.
Mathematics 2017, 5(2), 25; https://doi.org/10.3390/math5020025
Submission received: 13 December 2016 / Revised: 24 March 2017 / Accepted: 14 April 2017 / Published: 19 April 2017

Abstract

:
A formulation and solution of the discrete-time fractional optimal control problem in terms of the Caputo fractional derivative is presented in this paper. The performance index (PI) is considered in a quadratic form. The necessary and transversality conditions are obtained using a Hamiltonian approach. Both the free and fixed final state cases have been considered. Numerical examples are taken up and their solution technique is presented. Results are produced for different values of α .

1. Introduction

Fractional calculus is a generalization of classical calculus. It has been reported in the literature that systems described using fractional derivatives give more realistic behavior [1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27]. There exists many definitions of a fractional derivative [28,29,30,31,32,33]. A commonly known fractional derivatives is the Riemann-Liouville derivative, which is not always suitable for modeling physical systems because the solution of Riemann-Liouville derivative problems require unnatural initial conditions. On the other hand the Caputo fractional derivative accepts initial conditions similar to the integer order systems. Therefore, Caputo fractional derivative is preferred for modeling physical systems [5,6,14,15,16,17,18,19,20,21,22,23,24].
Fractional derivative plays important role in many areas of science and engineering. It also finds application in optimal control problems. Minimization of a given performance index subject to dynamic constraints on state and control variables is referred to as a constrained dynamic optimization problem [34,35]. This paper presents a formulation and solution scheme of a discrete-time fractional optimal control problem defined in terms of the Caputo fractional derivative.
Only limited work has been done in the area of fractional optimal control problems particularly in the discrete-time domain. In this context authors in [36,37,38,39,40] approximate fractional derivative using an approximation technique for solving differential equations defined in terms of the Caputo fractional derivative. Analysis of the Caputo derivative with the help of the infinite state approach has been presented in [41]. Several works have been published on the calculus of the variations where the fractional derivatives are taken in the sense of Caputo [42,43], Riesz-Caputo [44], and combined Caputo [45]. Malinowska et al. [46] discussed advanced methods in the fractional calculus of variations.
Fractional optimal control problems of various cases have been formulated and investigated using the fractional calculus of variations. In [47], Agrawal presented a general formulation and solution scheme for a class of fractional optimal control problems in terms of the Reimann-Liouville fractional derivative. In [48], a numerical technique for the solution of a class of fractional optimal control problems in terms of both Reimann-Liouville and the Caputo fractional derivatives is presented. Authors in [49,50] presented a pseudo-state-space-based fractional optimal control problem formulation and a solution scheme. Fixed and free final-time fractional optimal control problems are considered in [51,52]. In [53] Yuan et al. investigated fractional optimal control problems in terms of the left and the right Caputo fractional derivatives. Guo [54] formulated a second-order necessary optimality condition for fractional optimal control problems in the sense of Caputo. Optimal control of a fractional-order HIV-immune system in terms of the Caputo fractional derivative is discussed in [55]. In [56], authors proposed a fractional-order optimal control model for malaria infection in terms of the Caputo fractional derivative. In the literature we can find several methods for numerical solutions of fractional optimal control problems, including the direct numerical technique [57], central difference numerical scheme [58], quadratic numerical scheme [59], the method based on Legendre wavelets [60], modified Jacobi polynomials [61], Legendre orthonormal polynomials [62], Bernoulli polynomials [63], Bessel collocation method [64], Bezier curve method [65], neural networks [66], the Ritz method [67], etc. All of the above works consider continuous time fractional order systems.
Dzielinski and Czyronis present a general formulation and solution scheme for discrete-time fractional optimal control problems with fixed final state [68] and free final state [69] in terms of the Reimann-Liouville fractional derivative. Dynamic programming methods for solving discrete-time fractional optimal control problems have been proposed by Dzielinski and Czyronis in [70,71]. Authors in [72] proposed algorithms for discrete-time fractional optimal control problems based on dynamic programming method and discrete-time fractional calculus of variations. In [73], Al-Maaitah investigated the motion of discrete dynamical systems in terms of the Caputo fractional derivative. Malinowska et al. [74] introduced the multidimensional discrete-time fractional calculus of variations. Basic concepts and solution to state equations of the fractional discrete-time linear systems are presented in [75].
In the area of fractional optimal control, most of the existing works in the literature consider continuous time problems. Discrete-time fractional optimal control problems that exist in the literature is presented in terms of Riemann-Liouville derivative [68,69,70,71,72]. It has been observed that the Caputo fractional derivative is preferred as it requires natural initial conditions. In this paper the optimal control of the discrete-time fractional order system in terms of the Caputo fractional derivative has been considered. Both the fixed and free final state cases are considered. The necessary and transversality conditions are obtained using a Hamiltonian approach. A numerical method [68,69,72] is used for the solution of the resulting equations obtained from the formulation.

2. Problem Formulation

Consider the fractional continuous-time linear system described by [75]:
D t α 0 C x ( t ) = A x ( t ) + B u ( t )
where u is the input vector, x is the state vector, A is state matrix, B is input matrix and D t α 0 C x ( t ) is the Caputo fractional derivative.
The relation between Reimann-Liouville and Caputo fractional derivatives is [32]:
D t α 0 R L x ( t ) = D t α 0 C x ( t ) + t α γ ( 1 α ) x ( 0 )
The Grunwald-Letnikov shifted approximation of the fractional order derivative [27] is given as:
D t α 0 R L x ( k T ) = D t α 0 G L x ( k T ) 1 T α j = 0 k + 1 ( 1 ) j ( α j ) x ( k j + 1 ) T
Here we assume T = 1 .
Using Equations (1)–(3), we can obtain a fractional discrete-time system described by:
x ( k + 1 ) = j = 0 k d ( j ) x ( k j ) + B u ( k ) + k α γ ( 1 α ) x ( 0 )
where:
d ( 0 ) = A + α I ,   0 < α < 1
and:
d ( j ) = ( 1 ) j ( α j + 1 ) I ,   j = 1 , 2 , ... , k
Consider a performance index of the form:
J = x T ( N ) F x ( N ) + k = 0 N 1 ( x T ( k ) Q x ( k ) + u T ( k ) R u ( k ) )
where F 0 , Q 0 , R > 0 and N is number of discrete-time moments.
Using Lagrange multiplier concept, we can write Equation (5) as:
J a = x T ( N ) F x ( N ) + k = 0 N 1 ( x T ( k ) Q x ( k ) + u T ( k ) R u ( k ) + [ j = 0 k d ( j ) x ( k j ) + B u ( k ) + k α γ ( 1 α ) x ( 0 ) x ( k + 1 ) ] T λ ( k + 1 ) )
We can define a Hamiltonian function as follows:
H ( k ) = x T ( k ) Q x ( k ) + u T ( k ) R u ( k ) + [ j = 0 k d ( j ) x ( k j ) + B u ( k ) + k α γ ( 1 α ) x ( 0 ) ] T λ ( k + 1 )
Using Hamiltonian function in (6) and simplifying, we write augmented PI as:
J a = x T ( N ) F x ( N ) + x T ( 0 ) λ ( 0 ) x T ( N ) λ ( N ) + k = 0 N 1 [ H ( k ) x T ( k ) λ ( k ) ]
The increment J a due to the variations of x ( k ) , u ( k ) and λ ( k ) is:
δ J a = ( ( F + F T ) x ( N ) λ ( N ) ) δ x T ( N ) + k = 0 N 1 [ ( H ( k ) x T ( k ) λ ( k ) ) δ x T ( k ) + H ( k ) u T ( k ) δ u T ( k ) + ( H ( k 1 ) λ T ( k ) x ( k ) ) δ λ T ( k ) ]
The necessary condition for optimum of a functional is that the first variation vanishes, i.e., δ J a = 0 . This leads to:
H ( k ) u T ( k ) = 0 u ( k ) = [ R + R T ] 1 B T λ ( k + 1 )
λ ( k ) = k = 0 N 1 H ( k ) x T ( k ) = [ Q + Q T ] x ( k ) + j = 0 N k 1 d T ( j ) λ ( k + j + 1 )
x ( k + 1 ) = H ( k ) λ T ( k + 1 ) = j = 0 k d ( j ) x ( k j ) + B u ( k ) + k α γ ( 1 α ) x ( 0 )
Equations (10)–(12) are the necessary conditions for a constrained minimum.
The general transversality condition for fixed final time problem is:
( ( F + F T ) x ( N ) λ ( N ) ) δ x T ( N ) = 0
In the case of fixed final state x ( N ) is fixed, so the variation δ x T ( N ) is equal to zero. The transversality condition for the fixed final state problem is:
δ x T ( N ) = 0
In the case of free final state x ( N ) is free, so the variation δ x T ( N ) is not equal to zero. The transversality condition for the free final state problem is:
λ ( N ) = ( F + F T ) x ( N )
At α = 1 , the conditions Equations (10)–(12) are equivalent to the conditions of integer order discrete-time systems. Substituting α = 1 to (10)–(12), we get:
u ( k ) = [ R + R T ] 1 B T λ ( k + 1 )
λ ( k ) = [ Q + Q T ] x ( k ) + [ A + I ] T λ ( k + 1 )
x ( k + 1 ) = [ A + I ] x ( k ) + B u ( k )

3. Numerical Examples

In this section we present two numerical examples, one free final state problem and the other fixed final state problem.

3.1. Free Final State Problem

Consider a fractional discrete-time system Equation (4) with [69]:
A = [ 0.1 0.7 0.6 0.4 ] ,   B = [ 2 1 ]
Performance index Equations (5) with:
F = [ 2 1 1 2 ] ,   Q = [ 3 2 2 3 ] ,   R = [ 1 ]
and the given conditions as x ( 0 ) = [ 0.6 0.8 ] and N = 5 .
The optimal conditions for this problem are given by:
x ( k + 1 ) = j = 0 k d ( j ) x ( k j ) + [ 2 1 ] u ( k ) + k α γ ( 1 α ) [ 0.6 0.8 ]
where:
d ( j ) = ( 1 ) j ( α j + 1 ) I ,   j = 1 , 2 , ... , k λ ( k ) = [ 6 4 4 6 ] x ( k ) + j = 0 4 k d T ( j ) λ ( k + j + 1 )
u ( k ) = [ 1 0.5 ] λ ( k + 1 )
x ( 0 ) = [ 0.6 0.8 ] ,   and   λ ( 5 ) = [ 4 2 2 4 ] x ( 5 )
The state, co-state, and control Equations (19)–(21) along with the boundary conditions Equations (22) form a two-point boundary value problem (TPBVP).
Replacing u ( k ) in the Equation (19) we obtain:
x ( k + 1 ) = j = 0 k d ( j ) x ( k j ) [ 2 1 1 0.5 ] λ ( k + 1 ) + k α γ ( 1 α ) [ 0.6 0.8 ]
A general method for solving the state and co-state equations in terms of the Reimann-Liouville derivative is presented in [68,69,72]. Here, the same method is used for solving the present problem defined in terms of Caputo fractional derivatives.
The solution of state Equation (23) is:
x ( k ) = φ ( k ) [ 0.6 0.8 ] j = 0 k 1 φ ( k j 1 ) [ 2 1 1 0.5 ] λ ( j + 1 ) + j = 1 k φ ( k j ) ( j 1 ) α γ ( 1 α ) [ 0.6 0.8 ]
where:
φ ( 0 ) = I ,   φ ( k ) = j = 0 k 1 d ( j ) φ ( k j 1 )
Equation (24) in matrix form is:
[ x ( 1 ) x ( 2 ) x ( 5 ) ] = [ φ ( 1 ) φ ( 2 ) φ ( 5 ) ]    [ 0.6 0.8 ] [ φ ( 0 ) 0 0 φ ( 1 ) φ ( 0 ) 0 φ ( 4 ) φ ( 3 ) φ ( 0 ) ]    [ 2 1 1 0.5 ]    [ λ ( 1 ) λ ( 2 ) λ ( 5 ) ] + 1 γ ( 1 α ) [ 0 0 0 0 φ ( 0 ) 0 0 0 φ ( 3 ) φ ( 2 ) φ ( 0 ) 0 ] [ ( 1 ) α ( 2 ) α ( 5 ) α ]    [ 0.6 0.8 ]
The solution of co-state Equation (20) is:
[ λ ( 1 ) λ ( 5 ) ] = [ φ T ( 4 ) φ T ( 0 ) ]    [ 4 2 2 4 ] x ( 5 ) + [ 0 φ T ( 0 ) φ T ( 3 ) 0 0 φ T ( 0 ) 0 0 0 ]    [ 6 4 4 6 ]    [ x ( 0 ) x ( 4 ) ]
Using Equation (26) in Equation (25) we obtain the state vector x ( k ) . Then substituting x ( k ) into Equation (26) we get the co-state vector λ ( k ) . Once λ ( k ) is known, the control vector u ( k ) can be calculated using Equation (21). Solving the above equations we obtain the following results.
This problem is solved for different values of α . Figure 1 and Figure 2 show the state variables and Figure 3 shows the optimal control for N = 5 and different values of α . These figures show that as α 1 , the numerical solutions for both the state and control variables approach to the analytical solutions. At α = 1 , these results recover the solutions obtained with the integer order problem. While comparing these results with the results presented in [69,72] in terms of the Riemann-Liouville fractional derivative, we observe that for α = 1 the results are the same as expected.

3.2. Fixed Final State Problem

Consider a fractional discrete-time system (Equation (4)) with [68]:
A = [ 0.1 0.7 0.6 0.9 ] ,   B = [ 1 2 ] ,
A performance index (Equation (5)) with:
F = [ 4 1 1 4 ] ,   Q = [ 3 2 2 3 ] ,   R = [ 1 ]
and the given conditions as x ( 0 ) = [ 0.5 0.7 ] , x ( N ) = [ 0.06 0.05 ] , and N = 10 .
The optimal conditions for this problem are given by:
x ( k + 1 ) = j = 0 k d ( j ) x ( k j ) + [ 1 2 ] u ( k ) + k α γ ( 1 α ) [ 0.5 0.7 ] ,
λ ( k ) = [ 6 4 4 6 ] x ( k ) + j = 0 9 k d T ( j ) λ ( k + j + 1 ) ,
u ( k ) = [ 0.5 1 ] λ ( k + 1 )
and the boundary conditions are:
x ( 0 ) = [ 0.5 0.7 ] ,   and   x ( 10 ) = [ 0.06 0.05 ]
Using (31) in (29) we obtain
x ( k + 1 ) = j = 0 k d ( j ) x ( k j ) [ 0.5 1 1 2 ] λ ( k + 1 ) + k α γ ( 1 α ) [ 0.5 0.7 ]
Using a method presented in [68,69,72], we solve the problem.
The solution of state Equation (33) is:
x ( k ) = φ ( k ) [ 0.5 0.7 ] j = 0 k 1 φ ( k j 1 ) [ 0.5 1 1 2 ] λ ( j + 1 ) + j = 1 k φ ( k j ) ( j 1 ) α γ ( 1 α ) [ 0.5 0.7 ]
The Equation (34) in matrix form is:
[ x ( 1 ) x ( 2 ) x ( 10 ) ] = [ φ ( 1 ) φ ( 2 ) φ ( 10 ) ] [ 0.5 0.7 ] [ φ ( 0 ) 0 0 φ ( 1 ) φ ( 0 ) 0 φ ( 9 ) φ ( 8 ) φ ( 0 ) ]    [ 0.5 1 1 2 ]    [ λ ( 1 ) λ ( 2 ) λ ( 10 ) ] + 1 γ ( 1 α ) [ 0 0 0 0 φ ( 0 ) 0 0 0 φ ( 8 ) φ ( 7 ) φ ( 0 ) 0 ] [ ( 1 ) α ( 2 ) α ( 10 ) α ]    [ 0.5 0.7 ]
The solution of co-state Equation (30) is:
[ λ ( 1 ) λ ( 10 ) ] = [ φ T ( 9 ) φ T ( 0 ) ] λ ( 10 ) + [ φ T ( 0 ) φ T ( 8 ) 0 0 φ T ( 0 ) 0 0 0 0 ] [ 6 4 4 6 ] [ x ( 1 ) x ( 10 ) ]
Using Equation (36) in Equation (35) we can get state variables x ( 1 ) , x ( 2 ) , , x ( 10 ) in terms of λ ( 10 ) . This is fixed final state problem, so x ( 10 ) is known. Using this value we can obtain λ ( 10 ) . Once λ ( 10 ) is known, we can obtain state variable vector x ( k ) . Substituting x ( k ) and λ ( 10 ) in Equation (36) we get the co-state vector λ ( k ) . Using λ ( k ) in Equation (31) we get the control vector u ( k ) . Solving the above equations we obtain the following results.
The problem is solved for different values of α . Figure 4, Figure 5, Figure 6 and Figure 7 show the state variables, optimal control, and the minimum value of performance index for N = 10 , and different values of α . From these figures, it is clear that the amplitudes of the state variables, the control variable, and the performance index increases as α is increased, and the numerical solution approaches the analytical solution as α approaches 1. At α = 1 these results also agree with the results obtained with the integer order problem.

4. Conclusions

A discrete-time fractional optimal control problem formulation and solution scheme is presented in this paper. A general cost function is considered and the dynamical equation considered is described in terms of the Caputo fractional derivative. The Hamiltonian approach is used to obtain the necessary and transversality conditions. Both the specified and unspecified final state problems are considered, keeping the final time fixed. The state and co-state equations are solved using the numerical technique. Numerical results are presented to demonstrate the method. From the numerical results, it is clear that as α approaches to one, the numerical solution also approaches to the analytical solution. The numerical result, presented in Figure 7, also show that the performance index reduces as α is decreased. It can be concluded that the discrete-time fractional optimal control problem consideration can lead to considerable benefits than the discrete-time integer order problems.

Author Contributions

Both authors equally gave significant contribution to this work and paper and the final form of this paper is approved by both.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Dzieliński, A.; Sierociuk, D.; Sarwas, G. Some applications of fractional order calculus. Bull. Pol. Acad. Sci. Tech. Sci. 2010, 58, 583–592. [Google Scholar] [CrossRef]
  2. Dzieliński, A.; Sierociuk, D. Fractional order model of beam heating process and its experimental verification. In New Trends in Nanotechnology and Fractional Calculus Applications; Springer: Dordrecht, The Netherlands, 2010; pp. 287–295. [Google Scholar]
  3. Dzieliński, A.; Sarwas, G.; Sierociuk, D. Comparision and validation of integer and fractional order ultracapacitor models. Adv. Differ. Equ. 2011, 11, 1–15. [Google Scholar]
  4. Sierociuk, D.; Dzieliński, A.; Sarwas, G.; Petras, I.; Podlubny, I.; Skovranek, T. Modelling heat transfer in heterogeneous media using fractional calculus. Philos. Trans. R. Soc. A 2013, 371, 1–10. [Google Scholar] [CrossRef] [PubMed]
  5. Sierociuk, D.; Skovranek, T.; Macias, M.; Podlubny, I.; Petras, I.; Dzieliński, A.; Ziubinski, P. Diffusion process modeling by using fractional-order models. Appl. Math. Comput. 2015, 257, 2–11. [Google Scholar] [CrossRef]
  6. Riewe, F. Mechanics with fractional derivatives. Phys. Rev. E 1997, 55, 3581–3592. [Google Scholar] [CrossRef]
  7. Suri babu, G.; Chiranjeevi, T. Implementation of fractional order PID controller for an AVR system using GA and ACO optimization techniques. In Proceedings of the 4th ACODS-IFAC International Conference, National Institute of Technology, Tiruchirappalli, India, 1–5 February 2016; pp. 456–461. [Google Scholar]
  8. Dalir, M. Applications of fractional calculus. Appl. Math. Sci. 2010, 4, 1021–1032. [Google Scholar]
  9. Heymans, N. Fractional calculus description of non-linear viscoelastic behavior of polymers. Nonlinear Dyn. 2004, 38, 221–231. [Google Scholar] [CrossRef]
  10. Meral, F.C.; Royston, T.J.; Magin, R. Fractional calculus in viscoelasticity: An experimental study. Commun. Nomlinear Sci. Numer. Simul. 2010, 15, 939–945. [Google Scholar] [CrossRef]
  11. Katsikadelis, J.T. Generalized fractional derivatives and their applications to mechanical systems. Arch. Appl. Mech. 2015, 85, 1307–1320. [Google Scholar] [CrossRef]
  12. Angstmann, C.N.; Henry, B.I.; McGann, A.V. A fractional-order infectivity SIR model. Physica A 2016, 452, 86–93. [Google Scholar] [CrossRef]
  13. Area, I.; Batarfi, H.; Losada, J.; Nieto, J.J.; Shammakh, W.; Torres, A. On a fractional order Ebola epidemic model. Adv. Differ. Equ. 2015, 278, 1–12. [Google Scholar] [CrossRef]
  14. Diethelm, K. A fractional calculus based model for the simulation of an outbreak of dengue fever. Nonlinear Dyn. 2013, 71, 613–619. [Google Scholar] [CrossRef]
  15. González-Parra, G.; Arenas, A.J.; Chen-Charpentier, B. A fractional order epidemicmodel for the simulation of outbreaks of influenza A (H1N1). Math. Methods Appl. Sci. 2014, 37, 2218–2226. [Google Scholar] [CrossRef]
  16. Demirci, E.; Unal, A.; Özalp, N. A fractional order SEIR model with density dependent death rate. Hacet. J. Math. Stat. 2011, 40, 287–295. [Google Scholar]
  17. Ding, Y.; Ye, H. A fractional-order differential equation model of HIV infection of CD4+ T-cells. Math. Comput. Model. 2009, 50, 386–392. [Google Scholar] [CrossRef]
  18. Santos, J.P.C.; Cardoso, L.C.; Monteiro, E.; Lemes, N.H.T. A fractional-order epidemic model for bovine babesiosis disease and tick populations. Abstr. Appl. Anal. 2015, 2015. [Google Scholar] [CrossRef]
  19. Arafa, A.A.M.; Rida, S.Z.; Khalil, M. A fractional-order model of HIV infection with drug therapy effect. J. Egypt. Math. Soc. 2014, 22, 538–543. [Google Scholar] [CrossRef]
  20. Fractional Order Malaria Model with Temporary Immunity. Available online: https://arxiv.org/abs/1603.06416 (accessed on 19 April 2017).
  21. Okyere, E.; Oduro, F.T.; Amponsah, S.K.; Dontwi, I.K.; Frempong, N.K. Fractional order SIR model with constant population. Br. J. Math. Comput. Sci. 2016, 14, 1–12. [Google Scholar] [CrossRef]
  22. Al-Sulami, H.; El-Shahed, M.; Nieto, J.J.; Shammakh, W. On fractional order dengue epidemic model. Math. Probl. Eng. 2014, 2014. [Google Scholar] [CrossRef]
  23. Ahmed, E.; El-Saka, H.A. On fractional order models for hepatitis C. Nonlinear Biomed. Phys. 2010, 4, 1–3. [Google Scholar] [CrossRef] [PubMed]
  24. Gómez-Aguilar, J.F.; Yépez-Martínez, H.; Calderón-Ramón, C.; Cruz-Orduña, I.; Escobar-Jiménez, R.F.; Olivares-Peregrino, V.H. Modeling of a mass-spring-damper system by fractional derivatives with and without a singular kernel. Entropy 2015, 17, 6289–6303. [Google Scholar] [CrossRef]
  25. Caponetto, R.; Sapuppo, F.; Tomasello, V.; Maione, G.; Lino, P. Fractional-order identification and control of heating processes with non-continuous materials. Entropy 2016, 18, 398. [Google Scholar] [CrossRef]
  26. David, S.A.; Valentim, C.A., Jr. Fractional Euler-Lagrange equations applied to oscillatory systems. Mathematics 2015, 3, 258–272. [Google Scholar] [CrossRef]
  27. Meerschaert, M.M.; Tadjeran, C. Finite difference approximations for fractional advection-dispersion flow equations. J. Comput. Appl. Math. 2004, 172, 65–77. [Google Scholar] [CrossRef]
  28. Salgado, G.H.O.; Aguirre, L.A. A hybrid algorithm for Caputo fractional differential equations. Commun. Nonlinear Sci. Numer. Simul. 2016, 33, 133–140. [Google Scholar] [CrossRef]
  29. Podlubny, I. Fractional Differential Equations; Academic Press: New York, NY, USA, 1999. [Google Scholar]
  30. Shantanu, D. Functional Fractional Calculus; Springer: Heidelberg, Germany, 2011. [Google Scholar]
  31. Kilbas, A.A.; Srivastava, H.M.; Trujillo, J.J. Theory and Applications of Fractional Differential Equations; North-Holland Mathematics Studies; Elsevier: Amsterdam, The Netherlands, 2006. [Google Scholar]
  32. Li, C.; Qian, D.; Chen, Y.Q. On Riemann-Liouville and Caputo derivatives. Discret. Dyn. Nat. Soc. 2011, 2011. [Google Scholar] [CrossRef]
  33. Srivastava, H.M.; Owa, S. Univalent Functions Fractional Calculus and Their Applications; Ellis Horwood Ltd.: New York, NY, USA, 1989. [Google Scholar]
  34. Lewis, F.L.; Vrabie, D.L.; Syrmos, V.L. Optimal Control, 3rd ed.; Wiley: Hoboken, NJ, USA, 2012. [Google Scholar]
  35. Naidu, D.S. Optimal Control Systems; CRC Press: Boca Raton, FL, USA, 2003. [Google Scholar]
  36. Ren, J.; Sun, Z.-Z.; Dai, W. New approximations for solving the Caputo-type fractional partial differential equations. Appl. Math. Model. 2016, 40, 2625–2636. [Google Scholar] [CrossRef]
  37. Tavares, D.; Almeida, R.; Torres, D.F.M. Caputo derivatives of fractional variable order: Numerical approximations. Commun. Nonlinear Sci. Numer. Simul. 2016, 35, 69–87. [Google Scholar] [CrossRef]
  38. Gao, G.-H.; Sun, Z.-Z.; Zhang, H.-W. A new fractional numerical differentiation formula to approximate the Caputo fractional derivative and its applications. J. Comput. Phys. 2014, 259, 33–50. [Google Scholar] [CrossRef]
  39. Odibat, Z. Approximations of fractional integrals and Caputo fractional derivatives. Appl. Math. Comput. 2006, 178, 527–533. [Google Scholar] [CrossRef]
  40. Sambandham, B.; Vatsala, A.S. Basic results for sequential Caputo fractional differential equations. Mathematics 2015, 3, 76–91. [Google Scholar] [CrossRef]
  41. Trigeassou, J.-C.; Maamri, N.; Oustaloup, A. The caputo derivative and the infinite state approach. In Proceedings of the IFAC FDA Conference, Grenoble, France, 4–6 February 2013; pp. 587–592. [Google Scholar]
  42. Almeida, R.; Torres, D.F.M. Necessary and sufficient conditions for the fractional calculus of variations with Caputo derivatives. Commun. Nonlinear Sci. Numer. Simul. 2011, 16, 1490–1500. [Google Scholar] [CrossRef]
  43. Malinowska, A.B.; Torres, D.F.M. Generalized natural boundary conditions for fractional variational problems in terms of the Caputo derivative. Comput. Math. Appl. 2010, 59, 3110–3116. [Google Scholar] [CrossRef]
  44. Almeida, R. Fractional variational problems with the Riesz-Caputo derivative. Appl. Math. Lett. 2012, 25, 142–148. [Google Scholar] [CrossRef]
  45. Odzijewicz, T.; Malinowska, A.B.; Torres, D.F.M. Fractional variational calculus with classical and combined Caputo derivatives. Nonlinear Anal. 2012, 75, 1507–1515. [Google Scholar] [CrossRef]
  46. Malinowska, A.B.; Odzijewicz, T.; Torres, D.F.M. Advanced Methods in the Fractional Calculus of Variations; SpringerBriefs in Applied Sciences and Technology; Springer: Heidelberg, Germany, 2015. [Google Scholar]
  47. Agrawal, O.P. A general formulation and solution scheme for fractional optimal control problems. Nonlinear Dyn. 2004, 38, 323–337. [Google Scholar] [CrossRef]
  48. Biswas, R.K.; Sen, S. Numerical method for solving fractional optimal control problems. In Proceedings of the ASME 2009 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference, San Diego, CA, USA, 30 August–2 September 2009; pp. 1–4. [Google Scholar]
  49. Biswas, R.K.; Sen, S. Fractional optimal control problems: A pseudo-state-space approach. J. Vib. Control 2010, 17, 1034–1041. [Google Scholar] [CrossRef]
  50. Biswas, R.K.; Sen, S. Fractional optimal control within Caputo’s derivative. In Proceedings of the ASME 2011 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference, Washington, DC, USA, 28–31 August 2011; pp. 1–8. [Google Scholar]
  51. Biswas, R.K.; Sen, S. Fractional optimal control problems with specified final time. J. Comput. Nonlinear Dyn. 2011, 6. [Google Scholar] [CrossRef]
  52. Biswas, R.K.; Sen, S. Free final time fractional optimal control problems. J. Frankl. Inst. 2014, 351, 941–951. [Google Scholar] [CrossRef]
  53. Yuan, J.; Shi, B.; Zhang, D.; Cui, S. A formulation for fractional optimal control problems via Left and Right Caputo derivatives. In Proceedings of the 27th Chinese Control and Decision Conference, Chongqing, China, 23–25 May 2015; pp. 822–827. [Google Scholar]
  54. Guo, T.L. The necessary conditions of fractional optimal control in the sense of Caputo. J. Optim. Theory Appl. 2013, 156, 115–126. [Google Scholar] [CrossRef]
  55. Ding, Y.; Wang, Z.; Ye, H. Optimal control of a fractional-order HIV-immune system with memory. IEEE Trans. Control Syst. Technol. 2012, 20, 763–769. [Google Scholar] [CrossRef]
  56. Fractional Order Optimal Control Model for Malaria Infection. Available online: https://arxiv.org/abs/1607.01612 (accessed on 19 April 2017).
  57. Agrawal, O.P.; Baleanu, D. A Hamiltonian formulation and a direct numerical scheme for fractional optimal control problems. J. Vib. Control 2007, 13, 1269–1281. [Google Scholar] [CrossRef]
  58. Baleanu, D.; Defterli, O.; Agrawal, O.P. A central difference numerical scheme for fractional optimal control problems. J. Vib. Control 2009, 15, 583–597. [Google Scholar] [CrossRef]
  59. Agrawal, O.P. A quadratic numerical scheme for fractional optimal control problems. J. Dyn. Syst. Meas. Control 2008, 130. [Google Scholar] [CrossRef]
  60. Heydari, M.H.; Hooshmandasl, M.R.; Maalek Ghaini, F.M.; Cattani, C. Wavelets method for solving fractional optimal control problems. Appl. Math. Comput. 2016, 286, 139–154. [Google Scholar] [CrossRef]
  61. Dehghan, M.; Hamedi, E.A.; Khosravian-Arab, H. A numerical scheme for the solution of a class of fractional variational and optimal control problems using the modified Jacobi polynomials. J. Vib. Control 2016, 22, 1547–1559. [Google Scholar] [CrossRef]
  62. Ezz-Eldien, S.S.; Doha, E.H.; Baleanu, D.; Bhrawy, A.H. A numerical approach based on Legendre orthonormal polynomials for numerical solutions of fractional optimal control problems. J. Vib. Control 2017, 23, 16–30. [Google Scholar] [CrossRef]
  63. Keshavarz, E.; Ordokhani, Y.; Razzaghi, M. A numerical solution for fractional optimal control problems via Bernoulli polynomials. J. Vib. Control 2016, 22, 3889–3903. [Google Scholar] [CrossRef]
  64. Tohidi, E.; Nik, H.S. A Bessel collocation method for solving fractional optimal control problems. Appl. Math. Model. 2015, 39, 455–465. [Google Scholar] [CrossRef]
  65. Ghomanjani, F. A numerical technique for solving fractional optimal control problems and fractional Riccati differential equations. J. Egypt. Math. Soc. 2016, 24, 638–643. [Google Scholar] [CrossRef]
  66. Javad Sabouri, K.; Effati, S.; Pakdaman, M. A neural network approach for solving a class of fractional optimal control problems. Neural Process. Lett. 2017, 45, 59–74. [Google Scholar] [CrossRef]
  67. Nemati, A.; Yousefi, S.A. A numerical method for solving fractional optimal control problems using Ritz method. J. Comput. Nonlinear Dyn. 2016, 11. [Google Scholar] [CrossRef]
  68. Dzielinski, A.; Czyronis, P.M. Fixed final time optimal control problem for fractional dynamic systems-linear quadratic discrete-time case. In Advances in Control Theory and Automation; Printing House of Bialystok University of Technology: Bialystok, Poland, 2012; pp. 71–80. [Google Scholar]
  69. Dzielinski, A.; Czyronis, P.M. Fixed final time and free final state optimal control problem for fractional dynamic systems-linear quadratic discrete-time case. Bull. Pol. Acad. Sci. Tech. Sci. 2013, 61, 681–690. [Google Scholar] [CrossRef]
  70. Dzielinski, A.; Czyronis, P.M. Dynamic programming for fractional discrete-time systems. In Proceedings of the 19th World Congress IFAC Conference, Cape Town, South Africa, 24–29 August 2014; pp. 2003–2009. [Google Scholar]
  71. Czyronis, P.M. Dynamic programming problem for fractional discrete-time dynamic systems. Quadratic index of performance case. Circuits Syst. Signal Process. 2014, 33, 2131–2149. [Google Scholar] [CrossRef]
  72. Dzielinski, A.; Czyronis, P.M. Computer algorithms for solving optimization problems for discrete-time fractional systems. In Proceedings of the 2013 European Control Conference, Zurich, Switzerland, 17–19 July 2013; pp. 4009–4014. [Google Scholar]
  73. Al-Maaitah, A.F. Fractional Caputo analysis of Discrete systems. Eur. Sci. J. 2014, 10, 277–285. [Google Scholar]
  74. Malinowska, A.B.; Odzijewicz, T. Multidimensional discrete-time fractional calculus of variations. In Theoretical Developments and Applications of Non-Integer Order Systems; Lecture Notes in Electrical Engineering 357; Springer: Heidelberg, Germany, 2016. [Google Scholar]
  75. Kaczorek, T. Selected Problems of Fractional Systems Theory; Lecture Notes in Control and Information Sciences 411; Springer: Heidelberg, Germany, 2011. [Google Scholar]
Figure 1. State x 1 for the free final state problem for different α .
Figure 1. State x 1 for the free final state problem for different α .
Mathematics 05 00025 g001
Figure 2. State x 2 for the free final state problem for different α .
Figure 2. State x 2 for the free final state problem for different α .
Mathematics 05 00025 g002
Figure 3. Optimal control U o p t for the free final state problem for different α .
Figure 3. Optimal control U o p t for the free final state problem for different α .
Mathematics 05 00025 g003
Figure 4. State x 1 for the fixed final state problem for different α .
Figure 4. State x 1 for the fixed final state problem for different α .
Mathematics 05 00025 g004
Figure 5. State x 2 for the fixed final state problem for different α .
Figure 5. State x 2 for the fixed final state problem for different α .
Mathematics 05 00025 g005
Figure 6. The optimal control U o p t for the fixed final state problem for different α .
Figure 6. The optimal control U o p t for the fixed final state problem for different α .
Mathematics 05 00025 g006
Figure 7. The minimum value of the performance index J min for the fixed final state problem for different α .
Figure 7. The minimum value of the performance index J min for the fixed final state problem for different α .
Mathematics 05 00025 g007

Share and Cite

MDPI and ACS Style

Chiranjeevi, T.; Biswas, R.K. Discrete-Time Fractional Optimal Control. Mathematics 2017, 5, 25. https://doi.org/10.3390/math5020025

AMA Style

Chiranjeevi T, Biswas RK. Discrete-Time Fractional Optimal Control. Mathematics. 2017; 5(2):25. https://doi.org/10.3390/math5020025

Chicago/Turabian Style

Chiranjeevi, Tirumalasetty, and Raj Kumar Biswas. 2017. "Discrete-Time Fractional Optimal Control" Mathematics 5, no. 2: 25. https://doi.org/10.3390/math5020025

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop