Abstract
Controlled dynamic systems with an entropy operator (DSEO) are considered. Mathematical models of such systems were used to study the dynamic properties in demo-economic systems, the spatiotemporal evolution of traffic flows, recurrent procedures for restoring images from projections, etc. Three problems of the study of DSEO are considered: the existence and uniqueness of singular points and the influence of control on them; stability in “large” of the singular points; and optimization of program control with linear feedback. The theorems of existence, uniqueness, and localization of singular points are proved using the properties of equations with monotone operators and the method of linear majorants of the entropy operator. The theorem on asymptotic stability of the DSEO in “large” is proven using differential inequalities. Methods for the synthesis of quasi-optimal program control and linear feedback control with integral quadratic quality functional, and ensuring the existence of a nonzero equilibrium, were developed. A recursive method for solving the integral equations of the DSEO using the multidimensional functional power series and the multidimensional Laplace transform was developed. The problem of managing regional foreign direct investment is considered, the distribution of flows is modeled by the corresponding DSEO. It is shown that linear feedback control is a more effective tool than program control.
1. Introduction
Dynamic systems with an entropy operator (DSEOs) form a class of nonlinear systems in which the nonlinearity is described by a perturbed mathematical programming problem with an entropy objective function. DSEOs turned out to be a useful framework for studying a fairly wide range of applied problems: modeling of demo-economic systems [1], traffic flows [2,3], the labor market [4], and urban agglomerations [5]; the development of diagnostics algorithms for atmospheric waves [6] and oil-bearing strata [7]; analysis of stationary modes in dynamic image reconstruction procedures from projections in computerized tomography [8]; identification of dynamic systems [9], and others.
The mathematical class of DSEOs is based on a physical model of a dynamic system with self-reproduction of matter, energy, or information exchanged stochastically between the subsystems. Moreover, self-reproduction processes have an evolutionary nature (“slow”), whereas exchange processes occur much more intensively (“fast”). The latter processes relax in rather short periods (in the time scale of “slow” processes) to local equilibrium states. Since exchange processes are assumed to be stochastic, their locally stationary states can be described by the corresponding entropy operator.
Research into DSEOs has some history and problems examined in related areas. Apparently, the monograph [10], devoted to studying processes in urban and regional systems, was the first publication on models with an entropy operator.
A feature of DSEOs is a specific nonlinearity description in the form of the argmax function. In [11], forced periodic modes in a dynamic system with the argmin function without constraints were investigated. The paper [12] considered the convergence of iterative algorithms for finding the argmin of a continuous function.
The entropy operator in DSEOs is also described by the argmax function, but the constrained maximum of the entropy function. Constraints can be specified as a system of equalities or inequalities. In the latter case, the mathematical model of the entropy operator reduces to a perturbed mathematical programming problem, which significantly complicates the study of the operator itself and the corresponding dynamic system.
The general properties of an entropy operator with equality constraints (existence, continuity, boundedness, differentiability, the Lipschitz condition) were studied in [13].
This paper considers the dynamic properties of controlled positive DSEOs with the constrained argmax entropy function. Control in such systems affects the entropy operator. Two classes of controls are studied: program and linear feedback controls. We formulate a non-negativity theorem for the solutions of equations describing the DSEO under non-negative control and initial conditions. The problem of equilibrium states is investigated: the existence of a unique singular point is established using the method of monotonic operators [14] and bilinear majorants [15], and the sizes of a multidimensional rectangular box (a vector interval) containing this point are estimated. The sizes of the asymptotic stability domain of the singular point are estimated by the state vector norm using the method of differential inequalities [16]. Optimal control design problems in the two classes mentioned are considered using an integral quadratic criterion and constraints associated with the existence, uniqueness, and stability of the equilibrium of positive DSEOs.
The developed methods are applied to study the qualitative properties and optimize a stochastic regional exchange system for foreign direct investment.
2. Mathematical Model of Positive Controlled DSEOs
Consider a DSEO with some control applied to the entropy operator:
where the controlled entropy operator is given by
Note that in the absence control, the DSEO has zero singular point. It is stable if , and unstable if
The other notations are as follows: ⊗ means the coordinate-wise product of vectors; is a vector with constant components; is a non-negative matrix of dimensions T is a non-negative matrix of dimensions that has full rank and normalized columns:
where and denote unit column vectors of dimensions r and respectively.
The entropy has the form
The entropy operator is a vector with the components
where the vector consists of the exponential Lagrange multipliers for problem (2).
Theorem 1.
In Equation (1), and let , and for all .
Proof.
We introduce three subsets in the state space of the DSEO (1) as follows:
where
and is the ith row of the matrix S;
where
1. Consider an initial point whose components with numbers belong to the set , and those with numbers to the set . From (1) it follows that the right-hand sides of the equations with numbers are positive. Hence, the components evolving from the point will increase monotonically, remaining positive.
Now, we analyze the components . Since they belong to the set , the right-hand sides of the corresponding equations in (1) are negative. As a result, the components evolving from the point will gradually vanish, remaining positive.
2. Consider the opposite case: in the initial point the components with numbers belong to the set , and those with numbers to the set . This case is a “mirror image” of the previous one: the components will decrease, remaining non-negative, whereas the components will increase, remaining positive.
3. The set is the set of nonzero singular points, and their existence is determined by equality (10). The proof of Theorem 1 is complete. □
3. Singular Points and Their Localization
The system (1) has the trivial singular point and nonzero singular points satisfying the equations
where the entropy operator and the function have the components (5). The relationship between the exponential Lagrange multipliers and the state vector i.e., an implicit function is given by (5).
We transform Equation (11) to
where
are the components of the entropy operator and the functions are given by (5).
Next, we multiply component-wise the left- and right-hand sides of Equation (12) by the vectors and respectively. As a result,
where and .
We introduce the following notations:
Then Equation (15) can be written as
The operator maps the vector into itself. Therefore, under several useful properties (contraction, monotonicity), the equation will have a unique solution, and we may estimate the domain containing it.
Theorem 2.
Let the control function have the following properties:
for all .
Then the operator is monotonically increasing for all .
Proof.
Thus, the operator is monotonically increasing on the set . For monotonically increasing operators in Equation (17), there exists a pair of vectors such that: and for a concave operator, and and for a convex operator. Then the solution of Equation (17) belongs to the corresponding vector interval see Theorem 3.1 in [14].
The problem is estimating the boundaries of this vector interval. The null vector can be adopted as the left boundary. For estimating the right boundary (the vector we define the majorant of the operator (15).
Recall that the majorant is a vector function , such that
where
Lemma 1.
Assume that condition (3) holds, and the control function is monotonically decreasing, i.e., its Jacobian satisfies the inequality
Then the majorant (24) exists, and its components are given by
where the vector and consist of and respectively.
Proof.
Replacing the operator in (17) with its majorant (27) and (28), we obtain equations for the vector :
Hence, the right boundary of the domain locating the unique singular point of the system (1) satisfies the equation
Here, the vector consists of , and the control function is monotonically decreasing on .
As an example, consider a feedback law with the exponential control function:
We construct an approximate solution to localize the right boundary of the vector interval. The linear approximation of the exponential control function has the form
Consider a parameterized family of the following systems of equations:
The case corresponds to the so-called generating system:
Its solution is
For we obtain the original system (36). Expanding its solution into a formal power series [17] in the parameter yields
where is the kth approximation to the solution. Next, we substitute the series (39) into Equation (36) and equate the terms with the same powers of As a result, the approximations will satisfy the following chain of relations:
- the zeroth approximation,
- the first approximation,
Therefore, the approximate right boundary of the vector interval locating the singular point is
4. Stability of Nonzero Singular Point
Consider the deviation from the singular point
The differential equation for this deviation has the form
It taken into account here that
Theorem 3.
Let the following condition be satisfied:
where is the Lipschitz constant for the operator .
Then the singular point is stable in large, i.e., stable under the initial deviations
in the domain
where .
Proof.
Introducing the matrix
we consider the linear differential equation
The corresponding matricant is defined as
and its norm satisfies the upper bound
where
Using the matricant (51), we pass to the integral equation
Denote the Euclidean norm of the vectors in the form:
Consider the equality:
where
Differentiating equality (57) yields
According to the theorem on differential inequalities [16],
The solution of the first-order Equation (59) will asymptotically vanish if the initial conditions for (the norm of the deviation from the singular point belong to the domain, where the right side of the Equation (59) is negative.
Hence, the singular point will be asymptotically stable in the domain (48). □
5. Optimal Control for a Class of Positive DSEOs
It was previously seen that a control is necessary for the occurrence of nonzero singular point. However, in the process of reaching the point, the selected indicators of its quality can be performed. We will consider the integral indicators.
Consider the system (1) in which the entropy operator is described by the constrained argmax problem
This problem has the analytical solution
Here for all .
Consider the case of program control:
where is a vector of dimension r.
Equations (64) and (66) belong to the class of equations with the polynomial right-hand side. To find the solution, we employ the functional Volterra series [18,19,20]:
where:
—The vectors
have dimension
—The weight function matrices have dimensions
We substitute this series into the left- and right-hand sides of (68) and equate the terms with the same powers of As a result, we obtain the following chain of recursive equations for the images of the multidimensional Laplace transform [19,21]:
Here
Using the inverse Laplace transform, we pass to the time-varying functions in (71):
Clearly, all elements of the weight function matrices in (69) are explicitly expressed through the matrix and the control characteristics (vector) .
All matrices in these equalities are square and have dimensions and all vectors are n-dimensional; see (70).
Note that the vector linearly depends on the program control and the parameters of this dependence are positive.
Consider a quadratic optimization problem:
Here the terminal time T is known.
Next, we substitute the expression for into (77), integrate, and perform some trivial transformations. As a result, we obtain:
where the quadratic and linear form matrices are given by
and
respectively. In the equalities above,
For calculating the minimum of (77), we apply the gradient projection recursive formula:
The parameter is chosen to guarantee the convergence of this algorithm [22].
Now consider the case of linear feedback control:
The equation of the controlled DSEO (68) reduces to
Using the procedure described above, we get the following images of the weight function matrices of the series (69):
The inverse Laplace transform finally yields
For choosing the control matrix we adopt the criterion (77). In the case under consideration, it depends on the matrix C:
where is given by (87). Therefore,
where
Within the constant term, the gradient of the criterion (90) with respect to the matrix C is calculated as
The minimum of (90) can be found numerically by the gradient projection recursive formula:
The parameter is chosen to guarantee the convergence of this algorithm [22].
6. Control of Stochastic Flows of Regional Foreign Direct Investment (FDI)
Consider a regional system consisting of n regions exchanging investments [23]. Each region i has an investment appeal measured in the total cost of all projects implemented in it. Each region invests in its own projects and projects implemented in other regions (foreign direct investment, FDI).
The region’s investment appeal changes due to two processes. On the one hand, it decreases over time since the projects proposed for investment are “aging.” On the other, it grows as the result of FDI. Assume that the regions exchange their FDI stochastically and in portions.
The relative rate of change in the region’s investment appeal, is proportional to the difference between the aging and renewal functions of investment projects:
The aging function is linear one:
where are positive constants.
The renewal function is characterize by distribution of the FDI flows. As the FDI exchange is stochastic and partial, the locally stationary distribution of the FDI flows is described by the controlled entropy operator
where denotes the prior probability matrix, , and is the control vector.
The entropy-optimal distribution of the FDI flows has the form
subject to the constraint
The total FDI to region i is calculated as
Combining Equations (94), (95) and (99), we obtain the following equation for the controlled DSEO:
where , , and
Nonzero diagonal elements of this matrix mean that regions invest part of their financial resources to increase their investment appeal.
6.1. Equilibria in the System Stochastic FDI-Exchange
Consider the case of program control , where is a real positive vector. In FDI terms, this vector specifies a fixed distribution of FDI among the regions.
The equation of the system stochastic FDI-exchange with program control takes the form
Hence, the optimal program control satisfies the inequality
Now consider the case of linear feedback control:
In this case, the investment appeal equation reduces to
Its unique nonzero singular point is given by
where I is unique matrix.
Let, in terms of the norm, we have
Then
The linear inequality (112) determine the set of admissible control matrices. Notice that an elements of control matrix C may be negative.
6.2. Optimization of Stochastic FDI Exchange
We apply the general optimization procedure of controlled DSEOs (see above) to the stochastic FDI exchange process. We optimize the control function on a time horizon by the integral quadratic criterion
1. Program control . In this case, the criterion takes the form
and the integral equation describing the stochastic FDI exchange process (see (104)) reduces to
where
and the matricant is given by
We find the solution by expanding into a functional power series:
In terms of the multidimensional Laplace transform, the images of the weight function matrices are written as
where
Consider the first approximation to the solution, characterized by the matrix . Due to (119), this matrix is diagonal with the elements
where denotes the ith row of the matrix .
The weight functions of the first approximation have the form
In view of (119), the weight matrix of the second approximation is given by
Since all weight function matrices are square and diagonal, we arrive at
expressing the first approximation of depending on the variable (program control). An optimization problem for the program control can be stated as follows:
2. Linear feedback control . In this case, the criterion takes the form
and the integral equation describing the stochastic FDI exchange process (see (104)) reduces to
where the matrizer is given by (117).
The solution of this equation can be constructed in the form (118). Similar to the previous case, we apply the multidimensional Laplace transform and equate the terms with the same powers of As a result, we obtain the following chain of recursive equations for the images of the weight function matrices of the series (118):
Within the quadratic term, the solution of (127) has the image
Obviously, the control matrix C appears in the second term only (and even linearly). Therefore, within the constant terms, the criterion (126) is a quadratic form of the control matrix:
where:
The optimal linear feedback control problem can be written as
This is a quadratic programming problem with linear constraints. It can be solved by standard algorithms using the matrix gradient of the criterion (132) [24].
7. Simulation of FDI-Exchange
Consider the FDI exchange process between three countries: China (1), France (2), USA (3). Assume that the exchange is adequately described by the stochastic model from Section 6, and the linear part of the aging function is absent. The Table 1 shows the data on the investment attractiveness of these countries in terms of shares of the total number of investment projects.
Table 1.
Investment attractiveness.
1. Program control . In this case, the system equations take the form
The notations are as follows: and are the components of the program control vector; is the prior probability matrix; the vector characterizes the aging function of investment projects. We choose the following numerical values of the parameters:
The row sums of the prior probability matrix are equal to 1.
Without program control, the regional FDI flows quickly fades away, approaching the zero singular point. At the zero singular point, the investment attractiveness of the region is zero.
Therefore, when optimizing program control, it is necessary to take into account the conditions for the existence of a nonzero singular point:
The optimal program control problem is written as
where and
The values of the initial conditions are taken from Table 1, 2016.
The solution of the problem (139) takes the form:
As we can see, the solution to this problem lies in the feasible region. Optimal programmed control provides the following nonzero points of the regional equilibrium attractions:
Table 2 shows the calculated data on the investment attractiveness of these countries in the interval 2016–2019 (initial conditions from 2016) for optimal program (141). The last row of the table contains the values of the relative mean square error between the data in Table 1 (z) and Table 2 (y):
Table 2.
Calculated investment attractiveness (program control).
So, we can see that the use of program control leads to rather significant errors when compared with real data.
2. Linear feedback control . In this case, the system equations take the form
where
Here are elements of the control matrix. The numerical values of the parameters are given by (136).
The non-negativity condition for a singular nonzero point has the form:
Diagonal matrices are .
The optimal linear feedback control problem is written as
To solve this problem, a random search algorithm was used with inversion at each step of the matrix and checking the boundary of the feasible region. The calculation results are presented in Table 3.
Table 3.
Calculated investment attractiveness (feedback control).
8. Conclusions
A positive dynamical system with an entropy operator was considered. A theorem was proved on the stay of the trajectories of the system in the non-negative orthant of the state space near the initial perturbations from this subspace. Conditions for the existence, uniqueness ,and localization of a nonzero singular point were obtained under program control and feedback control. Applying the linear majorant of the entropy operator, the boundaries of the localization region were obtained.
The problem of stability of singular points was investigated. It was shown that, in the absence of control, the zero singular point was unstable, and not zero did not exist. Conditions for the existence and stability of a nonzero singular point were obtained under program control and feedback control.
A method for the synthesis of quasi-optimal control using the integral quadratic functional of quality and conditions for the existence of a singular non-zero point was developed.
The methods used in the article could be applied to study the dynamic properties and optimize the distribution system of regional flows of foreign direct investment. The advantages of using feedback control were shown.
It should be noted that the proposed method for studying program control and feedback control is based on sequential approximation of control using functional series. Therefore, the question of estimates of the accuracy of the approximation to the optimal solution remains open.
Funding
This work was supported by the Russian Science Foundation, project No. 21-11-00202.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
Not applicable.
Conflicts of Interest
The author declare no conflict of interest.
References
- Popkov, Y.S. Mathematical Demoeconomy. Integrating Demographic and Economic Approaches; De Gruyter: Vienna, Austria, 2014. [Google Scholar]
- Shvetsov, V.I.; Helbing, D. Macroscopic Dynamics of Multilane Traffic. Phys. Rev. E 1999, 59, 6328–6339. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Gasnikov, A.V.; Dorn, Y.V.; Nesterov, Y.E.; Shpirko, S.V. On the Three-Stage Version of Stable Dynamic Model of Traffic Flows. Mat. Model. 2014, 26, 34–70. (In Russian) [Google Scholar]
- Van Wissen, L.; Popkov, Y.S. Positive Dynamic Systems with Entropy Operator (Application to Labour Market Modelling). Eur. J. Oper. Res. 2006, 174, 1368–1379. [Google Scholar]
- Weidlich, W.; Popkov, Y.S.; Shvetsov, V.I. Settlement Formation Models with Entropy Operator. Ann. Reg. Sci. 1998, 32, 267–294. [Google Scholar]
- Leble, S.B.; Vereshchagin, S.D.; Vereshchagina, I.S. Algorithm for the Diagnostics of Waves and Entropy Mode in the Exponentially Stratified Atmosphere. Russ. J. Phys. Chem. B 2020, 14, 371–376. [Google Scholar] [CrossRef]
- Luckhaus, S.; Plotnikov, P.I. Entropy Solutions to the Buckley–Leverett Equations. Sib. Math. J. 2000, 41, 329–348. [Google Scholar] [CrossRef]
- Popkov, Y.S.; Rublev, M.V. Dynamic Procedures of Image Reconstruction from Projections Computer Tomography. Autom. Remote Control 2006, 67, 233–241. [Google Scholar] [CrossRef]
- Danaev, A.V.; Rusanov, V.A.; Sharshinskii, D.Y. The Entropy Maximum Principle in the Structural Identification of Dynamic Systems: An Analytical Approach. Izvestiya VUZov. Matematika 2005, 11, 16–24. (In Russian) [Google Scholar]
- Wilson, A.G. Catastrophe Theory and Bifurcation (Application to Urban and Regional Systems); Croom Helm: London, UK, 1981. [Google Scholar]
- Bobylev, N.A.; Popkov, A.Y. Forced Oscillations in Systems with Argmin Type Operators. Autom. Remote Control 2002, 63, 1707–1716. [Google Scholar] [CrossRef]
- Antipin, A.S. The Differential Controlled Gradient Method for Symmetric Extremal Mappings. Differ. Equations 1998, 34, 1020–1030. [Google Scholar]
- Popkov, Y.S.; Rublev, M.V. Estimation of a Local Lipschitz Constant of the Bq-Entropy Operator. Autom. Remote Control. 2005, 66, 1069–1080. [Google Scholar] [CrossRef]
- Krasnoselskii, M.A.; Vainikko, G.M.; Zabreiko, P.P.; Rutitskii, Y.B.; Stetsenko, V.Y. Priblizhennye Resheniya Operatornykh Uravnenii (Approximate Solutions of Operator Equations); Nauka: Moscow, Russia, 1969. (In Russian) [Google Scholar]
- Popkov, Y.S. Upper Bound Design for the Lipschitz Constant of the FG(ν,q)-entropy Operator. Mathematics 2018, 6, 73. [Google Scholar] [CrossRef] [Green Version]
- Beckenbach, E.F.; Bellman, R. Inequalities; Springer: Berlin/Heidelberg, Germany, 1961; 276p. [Google Scholar]
- Malkin, I.G. Some Problems in the Theory of Nonlinear Oscillations; U.S. Atomic Energy Commission, Technical Information Service: Washington, DC, USA; State Pub. House of Technical and Theoretical Literature: Moscow, Russia, 1959. [Google Scholar]
- Volterra, V. Theory of Functionals and Integral and Integro-Differential Equations; Dover Publications: Mineola, NY, USA, 1959. [Google Scholar]
- Vav Trees, H.L. Synthesis of Optimal Nonlinear Control Systems; The MIT Press: Cambridge, MA, USA, 1963. [Google Scholar]
- Ogunfunmi, T. Adaptive Nonlinear System Identification. The Volterra and Winer Approaches; Springer US: New York, NY, USA, 2007. [Google Scholar] [CrossRef]
- Debnath, L.; Bhatta, D. Integral Transforms and Their Applications, 2nd ed.; Chapman & Hall/CRS: New York, NY, USA, 2006. [Google Scholar]
- Polyak, B.T. Introduction to Optimization; Optimization Software, Publications Division: New York, NY, USA, 1987. [Google Scholar]
- Popkov, Y.S. Equilibria and stability of one class of positive dynamic systems with entropy operator: Application to investment dynimics modeling. Mathematics 2020, 8, 859. [Google Scholar] [CrossRef]
- Magnus, J.; Neudecker, H. Matrix Differetial Calculus with Application in Statistics and Econometrics, 3rd ed.; John Willey and Sons: Chichester, UK, 2007. [Google Scholar]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).