Next Article in Journal
Analysis of a Multi-Server Queue with Group Service and Service Time Dependent on the Size of a Group as a Model of a Delivery System
Previous Article in Journal
Gradual OCR: An Effective OCR Approach Based on Gradual Detection of Texts
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Fast Method for Estimating the Parameters of Partial Differential Equations from Inaccurate Observations

by
Gurami Tsitsiashvili
1,*,
Alexey Gudimenko
1 and
Marina Osipova
1,2
1
Institute for Applied Mathematics, Far Eastern Branch of Russian Academy of Sciences, IAM FEB RAS, Radio Str. 7, 690041 Vladivostok, Russia
2
Institute for Applied Mathematics, Far Eastern Federal University, 690922 Vladivostok, Russia
*
Author to whom correspondence should be addressed.
Mathematics 2023, 11(22), 4586; https://doi.org/10.3390/math11224586
Submission received: 4 September 2023 / Revised: 25 October 2023 / Accepted: 7 November 2023 / Published: 9 November 2023
(This article belongs to the Section Engineering Mathematics)

Abstract

:
In this paper, the problems of estimating the parameters of partial differential equations from numerous observations in the vicinity of some reference points are considered. The paper is devoted to estimating the diffusion coefficient in the diffusion equation and the parameters of one-soliton solutions of nonlinear partial differential equations. When estimating the diffusion coefficient, it was necessary to construct an estimate of the second derivative based on inaccurate observations of the solution of the diffusion equation. This procedure required consideration of two reference points when determining the first and second partial derivatives of the solution of the diffusion equation. To analyse one-soliton solutions of partial differential equations, a series of techniques have been developed that allow one to estimate the parameters of the solution itself, but not its equation. These techniques are used to estimate the parameters of one-soliton solutions of the equations kdv, mkdv, Sine–Gordon, Burgers and nonlinear Schrodinger. All the considered estimates were tested during computational experiments.

1. Introduction

Estimating the parameters of differential equations based on inaccurate observations of their solution is the attention focus of many researchers due to the great fundamental and applied significance of this problem, especially in connection with problems of engineering mathematics. The problem is considered not only in statistical terms but also in a deterministic formulation as an inverse problem for equations of mathematical physics (see, for example, [1,2,3]). The task was solved under the assumption of a large number of observations [4] over a sufficiently long period of time and in a deterministic formulation [3]. When solving deterministic inverse problems for differential equations, the question of the influence of inaccurate observations on the estimation of parameters should be noted to be not raised.
An alternative approach based on a probabilistic model of observation errors was proposed in [4,5,6,7,8]. This approach includes both a functional central limit theorem [4,5] and a two-step optimisation procedure [6,7,8]. The two-step optimisation procedure has been significantly developed and continued. The approach focuses on the use of smoothing methods to develop and estimate the differential equations, following recent developments in functional data analysis and based on the methods described in [9,10].
The development of a two-stage optimisation procedure is based on parameter estimation using nonparametric estimators [11], taking into account time-varying parameters [12] and their Bayesian estimation [13], three- and four-stage modifications of a two-stage optimisation procedure [14,15,16], consideration of errors in the autoregressive model [17] and applications to chemical kinetics models [18].
This variety of approaches is largely determined by the task specifics of estimating the parameters of differential equations. Despite the differences in the approaches used to solve this problem, the general procedure in the proposed solutions is to minimize the deviation of the solution of the original differential equation/system from its solution at estimated parameter values.
In the traditional two-stage method, the distance between the approximation of the differential equation solution by observations and its exact value on the segment (or in another area) is minimized. In our modification of the two-stage method, it is proposed at the first stage to minimize the distances between estimates of the solution values and its derivatives at several reference points. And already at the second stage, the unknown parameters are estimated using these approximations, solving a system of nonlinear equations constructed using the method of moments (see, for example, [19]).
The method of moments for estimating the parameters of differential equations is conveniently illustrated by the example of the equation x ˙ ( t ) = a x ( t ) . Let us choose a reference point t 0 and construct consistent estimates x ˙ ^ ( t 0 ) , x ^ ( t 0 ) of the values x ˙ ( t 0 ) , x ( t 0 ) . Then, the evaluation of the parameter a becomes a ^ = x ˙ ^ ( t 0 ) / x ^ ( t 0 ) . Let us call it the method of moments. In a more complex differential equation for estimating an unknown parameter, it is proposed to replace the values of the function and its derivative at the reference point with estimates using the least squares method. This paper presents the conditions under which the estimates of the function and its derivative at the reference point converge to exact values with an increase in the number of observations in the vicinity of the reference point/points. Then, the accuracy of the estimation of the parameter of the differential equation and its consistency are determined by the accuracy of the solution of the algebraic equation, which includes estimates of the function and derivative at the reference point/points (see [20] (Theorem 4)).
The results obtained in this way, in a certain sense, correlate with improved statistical pattern analysis based on Kalman filtering [21,22,23], but with fast estimation of the differential equation parameters. Estimating the value of a function and its derivative at a reference point requires a number of iterations proportional to the number of observations near this point. This can be done during observations and does not require additional time.
All the methods given in the articles referred to are based on stochastic optimisation. With a fixed step multiplier, this method does not provide convergence to the desired solution [24] (Theorem 2): “the gradient method converges on average not to the minimum point, but to some area around it”. To ensure the required convergence, it is necessary to consistently reduce the step multipliers, which makes the calculations very slow (inversely proportional to the number of iterations). And in our method, it is only required to find the root of a monotone function, for example, by dichotomous division, which is performed very quickly (as a decreasing geometric progression from the number of iterations). During computational experiments, parameters were estimated using the proposed method almost instantly (in a few seconds).
Application of analytical estimates of calculation errors based on probabilistic metrics allows us to control the accuracy of parameter estimation and to choose the number of measurements in the vicinity of control points, distances between neighbouring measurements and measurement accuracy. The use of probabilistic metrics gives an advantage when comparing the listed results and is important when designing a measuring system. The algorithm proposed allows us to control the accuracy of estimates of the function and its derivative according to the sufficient conditions of convergence in probability to their accuracy values and to choose the number of observations in the vicinity of the reference points, the distance between neighbouring observations around the reference point and the accuracy of observations. The result of such control is presented in numerical experiments, which give an affordable accuracy (several percent), especially in a nonlinear Schrodinger equation. This is important when designing a measuring system and determines the novelty of the proposed method. Such attempts to analyse observational systems are caused, in particular, by the results in the field of quantum physics (Nobel Prize on physics 2022).
The reference point number is usually equal to the number of unknown parameters [20]. In this paper, this approach allows us to construct fast running algorithms to estimate unknown parameters and apply them to estimating the parameters of partial differential equations and their solutions.
To estimate the solution based on inaccurate observations and its derivative at the reference point, the authors needed to level out both random observation errors and the deviation of the solution in a small vicinity of the reference point from the linear function. Random observation errors are leveled out by a large number of observation points in the immediate vicinity of the reference point. For this purpose, it is convenient to use linear regression analysis, which is based on the least squares method but applied to a nonlinear function. The deviation of the solution in a small neighbourhood of the reference point from the linear one is offset by the small distance between the points adjacent to the reference point. To determine the estimate error, the method of probabilistic metrics is used [25]. The distance between points adjacent to the reference point is related by a power law to the number of these points. And the power-law parameter is chosen in such a way as to ensure convergence in probability of estimates of the solution and its derivative at the reference point to exact values.
To apply this technique to estimating the parameters of partial differential equations and their solutions, it is necessary to select reference points. Using the method of moments makes it possible to significantly simplify this procedure, based on an analogy with the method of planning an experiment [26,27]. In this paper, the described modification of a two-step procedure for parameter inference in differential equations is used to estimate the diffusion coefficient in the diffusion equation and to estimate the parameters of one-soliton solutions of nonlinear partial differential equations.
In the first section, when determining the diffusion coefficient in the diffusion equation, the problem of estimating the function second derivative arises (see, for example, [28]). This problem solution needs a more complex algorithm, which requires two reference points with the distance between them being related by a power function to the number of points in the vicinity of the reference point. The power function exponent is determined by the requirement that the probability of estimating the second derivative converge to its value. Using this approach, an estimate of the diffusion coefficient is constructed and a computational experiment is carried out to confirm the sufficient accuracy of this estimate.
In the second section we consider kdv, mkdv, Sine–Gordon, Burgers, and nonlinear Schrodinger equation. One-soliton solutions of these equations are known [29,30,31,32,33,34,35] and were obtained by the Darboux transformation method [29]. However, the number of parameters in these equations is greater than the number of coefficients in them. This is because these parameters characterize certain spectral properties. The problem of reference point choosing stems from the fact that each reference point still needs to be compared with the partial derivative of the solution. Consequently, several partial derivatives can correspond to one reference point. For the equations KdV, mKdV, Sine–Gordon, and Burgers, this problem is solved quite simply, since you can take one reference point at which two partial derivatives are calculated. But for the nonlinear Schrodinger equation, the one-soliton solution of which contains four parameters [36], the task becomes more complicated, since it is necessary to select two reference points.
We find these reference points and obtain the necessary estimates for the parameters of one-soliton solutions in all of the listed nonlinear partial differential equations. The solutions obtained during the computational experiment turn out to be quite accurate.

2. Estimates of Diffusion Coefficient

2.1. Evaluation of the First Derivative

Suppose that inaccurate observations were obtained at points ± k h , h > 0 , k = 0 , 1 , , n , for the state of some physical process described by the function f ( z ) :   f ( ± k h ) + ε ( ± k h ) , k = 0.1 , , n . Here, ε ( ± k h ) , k = 0.1 , , n , are independent identically distributed random variables with zero mean and finite variance δ 2 . At first we estimate f ( 0 ) , f z ( 0 ) provided that for some Δ we have in interval [ Δ , Δ ] the inequality | f z z | < C 1 < .
Previously [37] (Theorem 3), estimates of the first derivative of the function f ( z ) and its value at z = 0 were constructed with y k = f ( k h ) + ε k :
f ^ ( 0 ) = 1 2 n + 1 k = n n y k , f ^ z ( 0 ) = 1 k = n n ( k h ) 2 k = n n y k k h .
Theorem 1. 
If δ 2 < and h = n α , then, for α > 1 , the estimate of f ^ ( 0 ) is an asymptotically unbiased and consistent estimate of the parameter f ( 0 ) . The estimate f ^ z ( 0 ) is an asymptotically unbiased estimate of the parameter f z ( 0 ) . At 1 < α < 3 / 2 , the estimate f ^ z ( 0 ) is a consistent estimate of f z ( 0 ) .
Proof of Theorem 1. 
Denote y ˜ k = f ( 0 ) + f z ( 0 ) k h + ε k and put
f ˜ ( 0 ) = k = n n y ˜ k 2 n + 1 , f ˜ z ( 0 ) = k = n n y ˜ k k h k = n n ( k h ) 2 .
Estimates of f ˜ ( 0 ) , f ˜ z ( 0 ) are obtained by the least squares method for f ( 0 ) , f z ( 0 ) of linear regression [19] and satisfy the following relations
E f ˜ ( 0 ) = f ( 0 ) , E f ˜ z ( 0 ) = f z ( 0 ) , V a r f ˜ ( 0 ) = δ 2 2 n + 1 , V a r f ˜ z ( 0 ) = δ 2 k = n n ( k h ) 2 .
Here, symbols E , V a r denote the mathematical expectation of random variable… and its variance. In turn, the following equalities are almost surely fulfilled
f ^ ( 0 ) f ˜ ( 0 ) = k = n n ( y k y ˜ k ) 2 n + 1 , f ^ z ( 0 ) f ˜ z ( 0 ) = k = n n ( y k y ˜ k ) k h k = n n ( k h ) 2 .
Moreover, the differences y k y ˜ k = f ( k h ) f ( 0 ) f z ( 0 ) k h , k = 0 , ± 1 , , ± n are deterministic quantities. Then, from the Taylor formula with a residual term in the Lagrange form, inequalities follow
| f ( k h ) f ( 0 ) f z ( 0 ) k h | C 1 ( k h ) 2 , k = 0 , ± 1 , , ± n .
From Formulas (3) and (4) for n , the relations follow
| f ^ ( 0 ) f ˜ ( 0 ) | k = n n | f ( k h ) f ( 0 ) f z ( 0 ) k h | 2 n + 1 2 C 1 h 2 k = 1 n k 2 2 n + 1 C 1 h 2 n 2 3 0 ,
| f ^ z ( 0 ) f ˜ z ( 0 ) | k = n n | ( f ( k h ) f ( 0 ) f z ( 0 ) k h ) k h | k = n n ( k h ) 2 C 1 h 3 k = 1 n k 3 k = 1 n h 2 k 2 C 1 h n 4 0 .
The Formulas (2), (5) and (6) lead to the relations
| E f ^ ( 0 ) f ( 0 ) | = | E f ^ ( 0 ) E f ˜ ( 0 ) | C 1 h 2 n 2 2 , V a r f ^ ( 0 ) = V a r f ˜ ( 0 ) ,
| E f ^ z ( 0 ) f z ( 0 ) | = | E f ^ z ( 0 ) E f ˜ z ( 0 ) | 3 C 1 h n 4 , V a r f ^ z ( 0 ) = V a r f ˜ z ( 0 ) .
Here, a n b n means that lim sup n a n / b n 1 . Then, from the condition h = n α , α > 1 , and the relations (7) and (8) we have
| E f ^ ( 0 ) f ( 0 ) | 0 , | E f ^ z ( 0 ) f z ( 0 ) | 0 , n ,
that f ^ ( 0 ) , f ^ z ( 0 ) are asymptotic unbiased estimates of f ( 0 ) , f z ( 0 ) .
From the Bieneme–Chebyshev inequality, the relations (5) and (7) and the conditions h = n α , α > 1 , we obtain for any ε > 0 , n
P ( | f ^ ( 0 ) f ( 0 ) | > ε ) P ( | f ^ ( 0 ) f ˜ ( 0 ) | + | f ˜ ( 0 ) f ( 0 ) | ) > ε ) =
= P ( | f ˜ ( 0 ) f ( 0 ) | ε | f ^ ( 0 ) f ˜ ( 0 ) | ) δ 2 ( 2 n + 1 ) ( ε | f ^ ( 0 ) f ˜ ( 0 ) | ) 2 0 .
Thus, for h = n α , α > 1 , estimate f ^ 0 is a consistent estimate of x 0 .
At the same time, from the relations (6), (8) and (9) for h = n α , 1 < α < 3 / 2 , we obtain for any ε > 0 , n
P ( | f ^ z ( 0 ) f z ( 0 ) | > ε ) P ( | f ^ z ( 0 ) f ˜ z ( 0 ) | + | f ˜ z ( 0 ) f z ( 0 ) | ) > ε ) ) =
= P ( | f ˜ z ( 0 ) f z ( 0 ) | > ε | f ^ z ( 0 ) f ˜ z ( 0 ) | ) 3 δ 2 h 2 n 3 ( ε | f ^ z ( 0 ) f ˜ z ( 0 ) | ) 2 0 .
Therefore, if the condition h = n α , 1 < α < 3 / 2 is true, the estimate f ^ z ( 0 ) is a consistent estimate of f z ( 0 ) .  □
Theorem 1 contains sufficient conditions in which estimates of function and its derivative in reference point tend in probability to their accuracy meanings. And we represent in this subsection necessary relations between number of observations around some reference point and distance between neighbour observations using probability metrics and accuracy of observations, when estimates tend in probability to their accuracy meanings.

2.2. Evaluation of the Second Derivative

In this subsection, an algorithm for estimating the second derivative is constructed. To do this, in addition to the point 0 , in the neighbourhood of which 2 n + 1 observations have been made to estimate the first derivative, it is necessary to consider the point h 1 , h 1 = n β and make 2 n + 1 observations in its neighbourhood. In order to conduct such an analysis and obtain a fairly good estimate of the second derivative, it is necessary to choose the right ratio between the parameters α , β . Inequalities are constructed between the parameters α , β , to ensure the proper quality of the evaluation of the second derivative.
To estimate the second derivative, we will use the following formula
f ^ z z ( 0 ) = f ^ z ( h 1 ) f ^ z ( 0 ) h 1 .
If the condition is met sup z 0 h n z z 0 + h n + h 1 | f z z z ( z ) | = C 2 < . Then, from the Taylor formula with a residual term in the Lagrange form, we obtain
f z ( h 1 ) f z ( 0 ) h 1 f z z ( 0 ) C 2 h 1 .
Thus, we obtain
E f ^ z ( 0 ) f z ( z 0 ) h 1 C 2 h 1 k = n n | k h | 3 k = n n ( k h ) 2 C 2 h n h 1 h n h 1 .
Therefore, from relations (11) and (12), we have
E f ^ z z ( 0 ) f z z ( 0 ) = E f ^ z ( h 1 ) E f ^ z ( 0 ) h 1 f z z ( 0 ) E f ^ z ( 0 ) f z ( 0 ) h 1 + + f z ( h 1 ) f z ( 0 ) h 1 f z z ( 0 ) + E f ^ z ( h 1 ) f z ( h 1 ) h 1 C 2 h 1 + 2 C 2 h n h 1 h 1 + h n h 1 .
It is not difficult to prove that
V a r f ^ z z ( 0 ) = V a r f ^ z ( h 1 ) h 1 + V a r f ^ z ( 0 ) h 1 2 σ 2 h 2 h 1 2 n 3 .
Assuming
h = n α , 1 < α < 3 / 2 ; h 1 = n β , 0 < β < min { α 1 , 3 / 2 α } ,
from relations (13) and (14) and Chebyshev‘s inequality for any ε > 0 and for n we have
P ( | f ^ z z ( 0 ) f z z ( 0 ) | > ε ) P ( | f ^ z z ( 0 ) E f ^ z z ( 0 ) | + | E f ^ z z ( 0 ) f z z ( 0 ) | > ε ) =
= P ( | f ^ z z ( 0 ) E f ^ z z ( 0 ) | > ε | E f ^ z z ( 0 ) f z z ( 0 ) | ) V a r f ^ z z ( 0 ) ( ε | E f ^ z z ( 0 ) f z z ( 0 ) | ) 2 0 .
This means convergence in probability (consistency of the constructed estimate)
f ^ z z ( 0 ) P f z z ( 0 ) , n .
Such complex conditions (15) of convergence in probability seem to be related to the possible presence of a phase transition and are consistent with the known results on the turbophoresis of inertial particles [38].

2.3. Numerical Experiment for Diffusion Equation

Consider the diffusion equation
u t = D 2 u x 2 .
As u ^ t ( t 0 , x 0 ) , u ^ x x ( t 0 , x 0 ) are consistent estimates of u t ( t 0 , x 0 ) , u x x ( t 0 , x 0 ) relatively, it follows from Equation (17) that
D ^ = u ^ t ( t 0 , x 0 ) u ^ x x ( t 0 , x 0 )
is a consistent estimate of the diffusion coefficient D .
The computational experiment was carried out for Equation (17) with the given boundary condition u x ( t , 0 ) = u x ( t , 1 ) = 0 , t 0 , and the initial condition u ( 0 , x ) = cos 2 π x , 0 x 1 , in the case when D = 0.01 . Via the Fourier method [35], it is not difficult to find a solution of this equation: u ( t , x ) = exp D t ( 2 π ) 2 cos 2 π x .
Suppose that inaccurate observations are obtained at the points ( t 0 ± k h , x 0 ) ,   ( t 0 , x 0 ± k h ) , ( t 0 , x 0 + h 1 ± k h ) , k = 0 , 1 , , n . Denote u ^ t ( t 0 , x 0 ) , u ^ x x ( t 0 , x 0 ) consistent estimates of partial derivatives u t ( t 0 , x 0 ) , u x x ( t 0 , x 0 ) , respectively. We believe that inaccurate observations are obtained at points ( t 0 ± k h , x 0 ) ,   ( t 0 , x 0 ± k h ) ,   ( t 0 , x 0 + h 1 ± k h ) , k = 0 , 1 , , n ,   t 0 = 0.05 , x 0 = 0.1 ,   h 1 = n 40 / 41 ,   h = n 5 / 4 ,   n = 450 , 000 :   u ( t 0 ± k h , x 0 ) + ε 1 ( ± k h ) ,   u ( t 0 , x 0 ± k h ) + ε 2 ( ± k h ) ,   u ( t 0 , x 0 + h 1 ± k h ) + ε 3 ( ± k h ) , where ε i ( ± k h ) , i = 1 , 2 , 3 , k = 0 , 1 , , n , are i.i.d.r.v.‘s distributed uniformly on the segment [ 1 / 8 , 1 / 8 ] . As a result, we obtain an estimate D ^ = 0.0113026 .

3. Estimates of One-Soliton Solution Parameters

3.1. Preliminaries

The solutions of equations, which we will deal with below, belong to the class of one-soliton solutions. Here, using the KdV equation
u t + 6 u u x + u x x x = 0
as an example, we briefly consider a simple method for obtaining such solutions. Our goal is to show that the estimating parameters of one-soliton solutions (modulo the choice of initial conditions) are the spectral parameters of appropriate linear problems. Details, as well as other methods for solving soliton equations, can be found in [29,30,31,32,33,34]. Note that the KdV equation is the first equation in which single-soliton solutions were found. It arises naturally in plasma physics, solid state physics, biology and many other areas.
The method under consideration is based on two fundamental concepts: the Lax representation (more generally, the zero curvature representation [30]) and the Darboux transformation [29]. Let us discuss these concepts in application to Equation (18).
It is well known that an arbitrary soliton equation is represented as a condition for the joint solvability of two, generally speaking, matrix linear equations. For (18), we have a system of scalar equations
L ψ = λ ψ , ψ t = A ψ ,
where L = x 2 + u and A = 4 x 3 + 6 u x + 3 u x . The solvability condition is obtained by differentiating the first equation in (19) with respect to t, then eliminating ψ t with the help of the second equation and replacing λ ψ by L ψ . This condition is written as
t L = A L L A
and is called the Lax representation.
The first equation of the system (19) is a one-dimensional stationary Schrodinger equation. Its one-fold Darboux transformation is determined by the relation
L T = T L ,
where L = x 2 + u is a transformed Schrodinger operator and T is a first-order differential operator over x. It follows from (20) that u = u 2 x 2 ln φ and T = x φ x / φ , where φ = φ ( t , x ) is the eigenvector of the operator L , corresponding to the eigenvalue λ . For example, if u = 0 , we can take
φ = cosh [ k ( x x 0 ) α ] , λ = k 2 ,
where α = α ( t ) is an arbitrary real function.
Let us now show how, using the Lax representations and Darboux transformations, we can construct a one-soliton solution of Equation (18). We require that, along with (21), the following relation is fulfilled:
A T = t T + T A ,
where A is an operator of the same type as A, but with u replaced by u . It turns out that this requirement completely defines the operator A and that the Lax representation (20) is valid for the corresponding dashed operators. The latter, in turn, means that u = u 2 x 2 ln φ , a solution of Equation (18). Choosing a function φ (22) from (23), we find α = 4 k 3 t and as a result we obtain the desired one-soliton solution (in which we replace for further convenience u by u)
u = 2 k 2 cosh 2 [ k ( x x 0 ) 4 k 3 t ] .
Multi-soliton solutions are obtained in a similar way by iterating the Darboux transformation.
Thus, using the KdV equation as an example, we have shown that the parameters of solutions of soliton equations estimated in this paper (excluding the initial conditions) are the spectral parameters of the corresponding linear problems. In the considered case, k 2 , the eigenvalue of the Schrodinger operator L, x 0 , the initial value of the coordinate x are employed. In a similar way, one-soliton solutions are sought in all the equations under consideration in this subsection.

3.2. Construction and Estimates of Parameters in One-Soliton Solutions

In this subsection, all random variables characterizing observation errors have a uniform distribution on the segment [ 1 / 8 , 1 / 8 ] .
KdV equation. Consequently for a KdV one-soliton solution we have
u t = 16 k 5 w 3 sinh ( z ) , z = k ( x 4 k 2 t x 0 ) , w = cosh ( z ) ,
u x = 4 k 3 w 3 sinh ( z ) k = u t 4 u x .
From (24), we obtain
w 2 = u t 2 u u x .
Choosing reference point ( t , x ) = ( 0 , 0 ) , we obtain
k = u t ( 0 , 0 ) 4 u x ( 0 , 0 ) , w = u t ( 0 , 0 ) 2 u ( 0 , 0 ) u x ( 0 , 0 ) , x 0 = a r c h ( w ) k .
Then, using the method of moments we obtain
k ^ = u ^ t 4 u ^ x , w ^ = u ^ t ( 0 , 0 ) 2 u ^ ( 0 , 0 ) u ^ x ( 0 , 0 ) , x ^ 0 = a r c h ( w ^ ) k ^ .
The computational experiment was carried out in the case of x 0 = k = 1 with the number n = 300 , 000 . The following results were obtained
k ^ = 0.997589 , x ^ 0 = 0.989265 .
If in the KdV equation with k = 1 we increase n from 300 , 000 to 3 , 000 , 000 , we obtain a change of estimate k ^ from 0.997589 to 1.00075 .
mKdV equation. Consider now mKdV equation
u t + 6 u 2 u x + u x x x = 0 .
This equation is used in descriptions of isotropic media dimensionally quantized films, acoustic waves in plasma and internal waves in a symmetric stratified liquid. The one-soliton solution of Equation (25) is
u ( t , x ) = s A sinh ( A ( x A 2 t x 0 ) ) , s = ± 1 ,
then
u x = s A 2 cosh ( A ( x A 2 t x 0 ) ) , u t = s A 4 cosh ( A ( x A 2 t x 0 ) ) A = u t u x .
Choosing reference point ( t , x ) = ( 0 , 0 ) , we obtain from (25)
u s A = sinh ( A x 0 ) = sinh ( A x 0 )
and so
A = u t ( 0 , 0 ) u x ( 0 , 0 ) , x 0 = 1 A a r s h u ( 0 , 0 ) s u x ( 0 , 0 ) u t ( 0 , 0 ) .
Using the method of moments, we obtain
A ^ = u ^ t ( 0 , 0 ) u ^ x ( 0 , 0 ) , x ^ 0 = 1 A ^ a r s h u ^ ( 0 , 0 ) s u ^ x ( 0 , 0 ) u ^ t ( 0 , 0 ) .
The computational experiment was carried out in the case s = 1 and for x 0 = A = 1 at the point ( x , t ) = ( 0 , 0 ) with the number n = 300 , 000 . The following results were obtained
A ^ = 1.00114 , x ^ 0 = 1.00855 .
But it is possible to improve results of numerical experiments if we assume that accuracy of observations is higher (random variables characterizing observations have a uniform distribution on the segment [ d , d ] with d < 1 / 8 ). If in the mKdV equation with A = 1 we change d from 1 / 8 to 1 / 80 , we obtain a change of estimate A ^ from 1.00114 to 1.00016 .
These experiments show that not only number n but accuracy of observations influence accuracy of estimates.
Sine–Gordon equation. Consider now the Sine–Gordon equation
φ x x φ t t = m 2 sin φ .
This equation is used in descriptions of Bloch wall motion in ferromagnetic crystals, Jackson constants in superconductivity and nonlinear optics. Its one-soliton solution is
φ ( t , x ) = 4 arctan ( exp ( m γ ( x v t ) + δ ) ) , γ 2 = 1 1 v 2 .
Denote w = exp ( m γ ( x v t ) ) + δ ; then
φ t = 4 m γ v w 1 + w 2 , φ x = 4 m γ w 1 + w 2 v = φ t φ x , γ = φ x 2 φ x 2 φ t 2 .
Choosing reference point ( t , x ) = ( 0 , 0 ) , we obtain
φ ( 0 , 0 ) = 4 arctan e δ δ = ln tan φ ( 0 , 0 ) 4 , γ = φ x 2 ( 0 , 0 ) φ x 2 ( 0 , 0 ) φ t 2 ( 0 , 0 ) .
Choosing another reference point ( t , x ) = ( 0 , 1 ) , we obtain
m γ + δ = ln tan φ ( 0 , 1 ) 4 m = 1 γ ln tan φ ( 0 , 1 ) 4 δ .
Then, we obtain
δ ^ = ln tan φ ^ ( 0 , 0 ) 4 , γ ^ = φ ^ x 2 ( 0 , 0 ) φ ^ x 2 ( 0 , 0 ) φ ^ t 2 ( 0 , 0 ) , m ^ = 1 γ ^ ln tan φ ^ ( 0 , 1 ) 4 δ ^ .
The computational experiment was carried out in the case of γ = 1.1575 , δ = 1 , m = 2 with the number n = 300 , 000 . The following results were obtained
γ ^ = 1.15352 , δ = 0.96641 , m ^ = 2.03116 .
Burgers equation. Consider Burgers equation
u t + u u x = u x x ,
Equation (27) is used in hydrodynamics, dislocation theory and visco-elasticity theory. Its one-soliton solution may be represented in the form
u ( t , x ) = a δ ( 1 tanh ( z ) ) , z = 1 2 ( a x δ a 2 t ) ,
then
u x = a 2 δ 2 cosh 2 ( z ) , u t = a 3 δ 2 2 cosh 2 ( z ) δ a = u t u x .
Choosing reference point ( t , x ) = ( 0 , 0 ) , we obtain parameters a , δ :
u t ( 0 , 0 ) = a 3 δ 2 2 , u x ( 0 , 0 ) = δ a 2 2 a = 2 u x 2 ( 0 , 0 ) u t ( 0 , 0 ) , δ = u t 2 ( 0 , 0 ) 2 u x 3 ( 0 , 0 ) .
Then, using the moments method, we obtain
a ^ = 2 u ^ x 2 ( 0 , 0 ) u ^ t ( 0 , 0 ) , δ ^ = u ^ t 2 ( 0 , 0 ) 2 u ^ x 3 ( 0 , 0 ) .
The computational experiment was carried out in the case of a = 1 , δ = 1 with the number n = 300 , 000 . The following results were obtained
a ^ = 1.00355 , δ ^ = 0.992503 .
Nonlinear Schrodinger equation. The nonlinear Schrodinger equation has the following form
i u t + u x x + ν | u | 2 u = 0 .
and is used in nonlinear optics and plasma physics. The one-soliton solution of this equation has the form [39]
u ( x , t ) = exp i r x i s t v ( x U t )
where r , s , U are constants connected by the relations:
r = U 2 s = U 2 4 α
and the function v ( q ) satisfies an ordinary differential equation of the form v ¨ α v + ν v 3 = 0 with α = r 2 s .
The one-soliton solution of this equation has the form
| u ( x U t ) | = v ( x U t ) = 2 α ν cosh 1 [ α ( x U t ) ] .
Thus, the parameter α determines the amplitude of the waves and the parameter U determines their speed. Next, we assume that the parameters of Equation (29) are equal to:
U = 1 , α = 1 , ν = 4 , ρ = α ν = 1 4 ,
the parameters of r , s are determined by the equalities (30) r = 0.5 , s = 0.75 . From Formula (31), it follows that
U = v t ( x U t ) v x ( x U t ) .
If ( x , t ) = ( 1 , 1 ) , then we obtain U = v t ( 1 , 1 ) v x ( 1 , 1 ) , where the estimate is as follows
U ^ = v ^ t ( 1 , 1 ) v ^ x ( 1 , 1 ) .
So if ( x , t ) = ( 0 , 0 ) , then 2 ρ = v 2 ( 0 , 0 ) and consequently
ρ ^ = v ^ 2 ( 0 , 0 ) 2 .
In turn, for ( x , t ) = ( 1 , 1 ) , we obtain from Formula (31) the equation
v t ( 1 , 1 ) v 2 ( 1 , 1 ) = ν 2 U sinh ( ρ ν ( 1 + U ) ) .
It follows that in order to estimate the parameter ν , it is necessary to solve the equation
v ^ t ( 1 , 1 ) v ^ 2 ( 1 , 1 ) = ν 2 U ^ sinh ρ ^ · ν ( 1 + U ^ ) .
Inserting estimates U ^ , ρ ^ from (32) and (33) into Equation (34) and solving this equation by ν , we find the estimate ν ^ . Estimates of listed parameters for the number n = 300 , 000 are U ^ = 1.03146 , ν ^ = 3.84376 , α ^ = 0.960547 , r ^ = 0.51573 , s ^ = 0.69457 .
It should be noted that most of the one-soliton solutions have the form of travelling waves. Therefore, by choosing the almost arbitrary reference point ( t 1 , x 1 ) , it is not difficult to estimate the velocity of a travelling wave through partial derivatives of the solution by the coordinates t , x at the point ( t 1 , x 1 ) . Moreover, for the nonlinear Schrodinger equation, the point ( t 2 , x 2 ) = ( 0 , 0 ) can serve as another reference point. Using this reference point allows us to estimate all the parameters of this equation. These rather simple considerations can be used to estimate the parameters of one-soliton solutions and other nonlinear partial differential equations.
When we calculate the ratio a / b with the inaccuracy estimates a ^ , b ^ (we used this calculation in all the examples from Section 3.2), the accuracy of the calculations is quite high. But when we calculate the roots of hyperbolic functions with small derivatives, the result may be worse in some (not all) numerical experiments. This is due to the inaccuracy estimates at the first step of the proposed algorithm and the small derivatives of the functions whose roots we calculate. Nevertheless, our proposed algorithm allows us to control the accuracy of estimates of the function and its derivative under the conditions of convergence in probability to their exact values and to choose the number of observations in the vicinity of the reference points, the distance between neighbouring observations around the reference point and the accuracy of observations. The result of such control is presented in numerical experiments, which give an affordable accuracy (several percent), especially in nonlinear Schrodinger equation. This is important when designing a measuring system. Similar problems have arisen, for example, when measuring hidden parameters in quantum physics (Nobel Prize on Physics, 2022).

4. Discussion

The technique of the moment method developed in this work is also applicable to estimating the parameters of functions that are not necessarily related to differential equations. This formulation of the question allows us to consider some problems of reliability theory. And finally, in some cases there is no need to estimate the parameters of differential equations, for example, in problems about solitons. It is only necessary to estimate the solution parameters of these equations. Moreover, in the problem of solitons one can consider not only one-soliton, but also multi-soliton solutions. And finally, the method proposed in this paper allows us to estimate the coefficients of nonlinear partial differential equations. This issue is especially important when solving inverse problems of mathematical physics and requires additional and more detailed consideration. In particular, for differential equation systems in a small neighbourhood of a certain point, the theorems of solution existence and uniqueness can be used (see, for example, [40,41]).

5. Conclusions

This paper considers the problem of estimating the differential equation parameters from numerous observations near certain reference points. Conditions are obtained under which the constructed estimates are consistent. The review includes both linear and nonlinear differential equations. The greatest computational difficulties arose when estimating the diffusion coefficient in Section 2. According to our data, it took several minutes to solve the problems in question in the Mathematics package. The described algorithms were quite successfully used to work with FEFU students (educational program: computer design) in the subject of systems analysis. This work mainly considers systems of differential equations with analytical solutions (with the exception of Section 3.1). But there are many differential equations and systems that cannot be solved analytically. In the future, when developing this topic, it is planned to consider such equations and systems, the solutions of which can only be obtained using computer calculations. The purpose of this article is to initiate the development of the proposed method in various directions. In particular, using high computing speed, you can choose a model of the system under consideration from several options. As considered in this work, the problems of estimating the differential equation parameters are close to the problems of Kalman filtering. This circumstance allows us to pose the question of the advisability of conducting a large number of observations in the vicinity of the reference point.

Author Contributions

Conceptualisation, methodology and formal analysis, G.T.; preliminaries to Section 2, A.G.; checking the received formulas and numerical experiments, M.O. All authors have read and agreed to the published version of the manuscript.

Funding

The research was carried out within the state assignment for IAM FEB RAS (N 075-01290-23-00).

Data Availability Statement

Data supporting reported results were obtained by M. Osipova.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Penenko, A.V. Consistent numerical schemes for solving nonlinear inverse source problems with the gradient-type algorithms and the Newton–Kantorovich methods. Numer. Anal. Appl. 2018, 11, 73–88. [Google Scholar]
  2. Penenko, A.V. The Newton–Kantorovich method in inverse source problems for production-destruction models with time series-type measurement data. Numer. Anal. Appl. 2019, 12, 51–69. [Google Scholar]
  3. Penenko, A.V.; Khassenova, Z.T.; Penenko, V.V.; Pyanova, E.A. Numerical study of a direct variational data assimilation algorithm in Almaty city conditions. Eurasian J. Math. Comput. Appl. 2019, 7, 53–64. [Google Scholar]
  4. Qi, X.; Zhao, H. Asymptotic efficiency and finite-sample properties of the generalized profiling estimation of parameters in ordinary differential equations. Ann. Stat. 2010, 38, 435–481. [Google Scholar]
  5. Jie, Z.; Hai-Lin, F. Consistent estimation of ordinary differential equation when transformation parameter is unknown. Stat. Probab. Lett. 2016, 115, 60–69. [Google Scholar]
  6. Ramsay, J.; Hooker, G. Dynamic Data Analysis; Springer: New York, NY, USA, 2017. [Google Scholar]
  7. Crassidis, J.L.; Junkins, J.L. Optimal Estimation of Dynamic Systems, 2nd ed.; Chapman and Hall/CRC Applied Mathematics and Nonlinear Science; CRC Press: London, UK; New York, NY, USA, 2011. [Google Scholar]
  8. Raol, J.R.; Girija, G.; Singh, J. Modelling and Parameter Estimation of Dynamic Systems; IET Control Engeneering Series 65; The Institution of Engineering and Technology: London, UK, 2004. [Google Scholar]
  9. Ramsay, J.O.; Silverman, B.W. Functional Data Analysis; Springer Science and Business Media: New York, NY, USA, 2005. [Google Scholar]
  10. Ramsay, J.O.; Hooker, G.; Campbell, D.; Cao, J. Parameter estimation for differential equations: A generalized smoothing approach. Stat. Methology Ser. B 2007, 69, 741–796. [Google Scholar]
  11. Brunel, N.J.-B. Parameter estimation of ODE’s via nonparametric estimators. Electron. J. Statist. 2008, 2, 1242–1267. [Google Scholar]
  12. Liang, H.; Miao, H.; Wu, H. Estimation and constant and time-varying dynamic parameters of HIV infection in a nonlinear differential model. Ann. Appl. Stat. 2010, 4, 460–483. [Google Scholar]
  13. Lixin, M.; Jiwei, Z.; Xue, Z.; Guozhong, F. Bayesian estimation of time-varying parameters in ordinary differential equation models with noisy time-varying covariates. Commun. Stat.-Simul. Comput. 2021, 50, 708–723. [Google Scholar]
  14. Husin, S.F.; Mamat, M.; Ibrahim, M.A.H.; Rivaie, M. An Efficient Three-Term Iterative Method for Estimating Linear Approximation Models in Regression Analysis. Mathematics 2020, 8, 977. [Google Scholar]
  15. Aliev, F.A.; Aliev, N.A.; Mutalimov, M.M.; Namazov, A.A. Algorithm for solving the identification problem for determining the fractional-order derivative of an oscillatory system. Appl. Comput. Math. 2020, 19, 415–422. [Google Scholar]
  16. Khalsaraei, M.; Shokri, A. A new explicit singularly P-stable four-step method for the numerical solution of second order IVPs. Iranian J. Math. Chem. 2020, 11, 17–31. [Google Scholar]
  17. Hu, Y.; Wu, S.; Feng, S.; Jin, J. Estimation in Partial Functional Linear Spatial Autoregressive Model. Mathematics 2020, 8, 1680. [Google Scholar] [CrossRef]
  18. Jyh-Shyong, C.; Chia-Chi, L.; Wei-Ling, L.; Jin-Han, D. Two-stage parameter estimation applied to ordinary differential equation models. J. Taiwan Inst. Chem. Eng. 2015, 57, 26–35. [Google Scholar]
  19. Freedman, D.A. Statistical Models: Theory and Practice; Cambridge University Press: Cambridge, UK, 2009. [Google Scholar]
  20. Tsitsiashvili, G.S.; Gudimenko, A.N.; Osipova, M.A. Mathematical and Statistical Aspects of Estimating Small Oscillations Parameters in a Conservative Mechanical System Using Inaccurate Observations. Mathematics 2023, 11, 2643. [Google Scholar] [CrossRef]
  21. Shao, J.; Zhang, X.; Chen, W.; Shen, X. Improved statistical pattern analysis monitoring for complex multivariate processes using empirical likelihood. Processes 2020, 8, 1619. [Google Scholar] [CrossRef]
  22. Hu, X.; Wei, X.; Han, J.; Zhu, X. Adaptive disturbance estimation and cancelation for ships under thruster saturation. Int. J. Robust Nonlinear Control 2020, 30, 5004–5020. [Google Scholar] [CrossRef]
  23. Wang, Z.; Xie, L.; Wan, Q. Beam space joint azimuth, elevation and delay estimation for large-scale MIMO-OFDM system. IEEE Trans. Instrum. Meas. 2023, 72, 9506412. [Google Scholar]
  24. Polyak, B.T. Convergence and convergence rate of iterative stochastic algorithms II. The Linear case. Autom. Remote. Control 1977, 4, 101–107. [Google Scholar]
  25. Zolotarev, V. Modern Theory of Summation of Random Variables; VSP: Utrecht, The Netherlands, 1997. [Google Scholar]
  26. Cox, D.R.; Reid, N. The Theory of the Design of Experiments. By Chapman and Hall/CRC; Boca Raton: London, UK; New York, NY, USA; Washington, DC, USA, 2000. [Google Scholar]
  27. Shih-Kung, L. Planning Behaviour. Theories and Experiments; Cambridge Scholars Publishing: Cambridge, UK, 2019. [Google Scholar]
  28. Thambynayagam, R.K.M. The Diffusion Handbook: Applied Solutions for Engineers; McGraw-Hill: New York, NY, USA, 2011. [Google Scholar]
  29. Matveev, V.B.; Salle, M.A. Darboux Transformations and Solitons; Springer Series in Nonlinear Dynamics; Springer: Berlin, Germany, 1991. [Google Scholar]
  30. Faddeev, L.D.; Takhtajan, L.A. Hamiltonian Methods in the Theory of Solitons, Series: Classics in Mathematics; Springer: Berlin, Germany, 2007. [Google Scholar]
  31. Novikov, S.P.; Manakov, S.V.; Pitaevskii, L.P.; Zakharov, V.E. Theory of Solitons: The Inverse Scattering Method. Monographs in Contemporary Mathematics; Springer: New York, NY, USA, 1984. [Google Scholar]
  32. Hirota, R. The Direct Method in Soliton Theory. Cambridge Tracts in Mathematics; Cambridge University Press: Cambridge, UK, 2004. [Google Scholar]
  33. Gesztesy, F.; Holden, H. Soliton Equations and Their Algebro-Geometric Solutions. Volume I: (1+1)-Dimensional Continuous Models. Series: Cambridge Studies in Advanced Mathematics; Cambridge University Press: Cambridge, UK, 2003. [Google Scholar]
  34. Manukure, S.; Booker, T. A short overview of solitons and applications. Partial. Differ. Equ. Appl. Math. 2021, 4, 100140. [Google Scholar] [CrossRef]
  35. Treves, F. Analytic Partial Differential Equations; A Series of Comprehensive Studies in Mathematics; Springer: Berlin, Germany, 2020; Volume 359. [Google Scholar] [CrossRef]
  36. Shokri, A.; Ramos, H.; Khalsaraei, M.; Aliev, F.A. Fourth derivative singularly P-stable method for the numerical solution of the Schrodinger equation. Adv. Differ. Equ. 2021, 1, 506. [Google Scholar] [CrossRef]
  37. Tsitsiashvili, G.S.; Osipova, M.A.; Kharchenko, Y.N. Estimating the coefficients of a system of ordinary differential equations based on inaccurate observations. Mathematics 2022, 10, 502. [Google Scholar] [CrossRef]
  38. Belan, S.; Fouxon, I.; Falkovich, G. Localization-delocalization transitions in turbophoresis of inertial particles. Phys. Rev. Lett. 2014, 112, 234502-1–234502-5. [Google Scholar] [CrossRef] [PubMed]
  39. Whitham, G.B. Linear and Non-Linear Waves; A Wiley-Inter Science Publication; John Willey and Sons: New York, NY, USA, 1974. [Google Scholar]
  40. Teschl, G. Ordinary Differential Equations and Dynamical Systems; American Mathematical Society: Providence, RI, USA, 2012. [Google Scholar]
  41. Hartman, P. Ordinary Differential Equations, Classics in Applied Mathematics; Society for Industrial and Applied Mathematics: Philadelphia, PA, USA, 2002. [Google Scholar]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Tsitsiashvili, G.; Gudimenko, A.; Osipova, M. Fast Method for Estimating the Parameters of Partial Differential Equations from Inaccurate Observations. Mathematics 2023, 11, 4586. https://doi.org/10.3390/math11224586

AMA Style

Tsitsiashvili G, Gudimenko A, Osipova M. Fast Method for Estimating the Parameters of Partial Differential Equations from Inaccurate Observations. Mathematics. 2023; 11(22):4586. https://doi.org/10.3390/math11224586

Chicago/Turabian Style

Tsitsiashvili, Gurami, Alexey Gudimenko, and Marina Osipova. 2023. "Fast Method for Estimating the Parameters of Partial Differential Equations from Inaccurate Observations" Mathematics 11, no. 22: 4586. https://doi.org/10.3390/math11224586

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop