1. Introduction
Recently, fractional differential equations have been used to simulate non-standard diffusive processes when an anomalous diffusion is important. We can mention models used to describe chemical and contaminant transport in heterogeneous aquifers [
1], physics [
2], medicine [
3], and image processing [
4]. More examples are given in [
5,
6].
This paper is a continuation of our previous work [
7]. Recently, much attention has been devoted to the solution of multi-dimensional parabolic problems with fractional power elliptic operators. Our activity was initiated due to some critical experience in the analysis of numerical methods for the solution of mathematical models when some/all classical differential operators are substituted by fractional differential operators. A typical approach is to construct and investigate numerical algorithms for each problem from scratch. Our aim is to propose a general framework and to specify what parts of this analysis really require new modifications of existing techniques. We split the work into three parts. The first part is based on techniques well known for the analysis of fractional power elliptic problems. The constructed discrete elliptic operators make a basis to formulate semi-discrete approximations. In the second part of the framework, fully discrete schemes are constructed. Again, we can use some classical and robust approximations of time derivatives. The stability and convergence of the discrete solutions follow directly from the existing theoretical results for classical parabolic problems. In the third part, approximations of transfer operators are constructed. Exactly this part of the framework requires additional theoretical analysis and modifications of the discrete algorithms. In this paper, we use uniform and the best uniform rational approximations. The stability and accuracy of the obtained local discrete schemes is investigated. The very efficient best rational approximation by successive interval length adjustment (BRASIL) tool [
8] is used for the computation of the best uniform rational approximations (BURAs). Deep results on BURA-type approximations for spectral fractional elliptic equations are presented in [
9]. These results make a good theoretical basis for the analysis of discrete schemes for the solution of parabolic problems with fractional elliptic operators.
Another popular technique for the solution of elliptic and parabolic fractional diffusion problems is based on the unified rational Krylov method and investigated in [
10]. The authors compare several existing pole selection strategies and provide a certified error bound to assess their quality. In addition they develop two new pole generation algorithms tailored to the framework of fractional diffusion.
One more general approach is based on a Lanczos method. The main benefit of this algorithm is that the required matrix–function–vector products are computed without ever forming the dense matrix
. A preconditioned Lanczos method can be used to accelerate the convergence of this method (see [
11] and the references given therein).
A reduced basis method for fractional diffusion operators and applications for the solution of fractional power elliptic problems is proposed in [
12].
We note that additional classes of approximation algorithms should be also considered as practical tools for the approximation of nonlocal operators; see as examples [
13] and techniques based on artificial neural networks [
14,
15].
Here, we comment briefly on a more general definition of fractional calculus. It is a powerful tool that has been recently employed to model complex biological systems and different processes with nonlinear behavior and long-term memory. The definition of the fractional-order derivative is not unique; still, there are some generally accepted and common definitions. We recommend [
16] for an excellent and deep introduction to this topic. Still, in this paper, we deal with a specific class of nonlocal problems, where, instead of fractional derivatives, a fractional power of the full elliptic operator is considered. Solutions of such models have quite different properties, and in many cases, they are optimal tools to describe the complicated real-world applications.
In this paper, we use the spectral definition of the fractional power of an elliptic operator
(the details are given in
Section 2). As it is noted in many papers, the spectral algorithm can be used for practical computations to solve parabolic-type problems with nonlocal diffusion operators. Then, the complexity of such algorithms to solve nonlocal parabolic problems is the same as for a fast Fourier transform (FFT) method targeted at standard elliptic operators. However, clearly, this strategy is computationally efficient only if the differential problem is solved in a rectangular domain, the complete set of eigenfunctions of operator
is known, in advance, and FFT-type techniques can be applied.
A more general idea is to transform nonlocal problems into the local classical differential problems. A very good review on these methods is given in [
17]. The theoretical analysis of various modifications of uniform rational approximations for the solution of elliptic problems was presented in [
18].
The rest of the paper is organized in the following way. In
Section 2, the problem is formulated. The non-stationary parabolic equation with a fractional power elliptic operator is defined. As was mentioned above, the spectral definition is used to define fractional power elliptic operators. A general framework for the analysis of discrete schemes targeted at solving such problems is formulated. The first step of this scheme is analyzed, when the nonlocal elliptic operator is approximated in a finite-dimensional space and a semidiscrete scheme is constructed. A general approach is specified for how the approximation error of this step is investigated. This technique is applied for a three-dimensional test problem.
The second step of the proposed general framework of analysis is considered in
Section 3. Fully discrete schemes are constructed. Most of the well-known implicit methods can be used to approximate the semidiscrete problem. As an example, we consider the backward Euler method. The standard approximation error and stability estimates are provided. The results of the computational experiments are presented and analyzed. They confirm a delicate interlacing of space and time discrete approximations.
In
Section 4, the third step of the general framework is considered. A time transfer operator of the fully discrete scheme depends on the nonlocal discrete operator
. The goal of this step is to approximate it by some local operator. Here, we use methods based on the best uniform rational approximations (BURAs). The required rational functions are computed by applying the BRASIL algorithm (BURA-BRASIL scheme) [
8]. The stability analysis of the obtained scheme shows that it is stable at least for sufficiently small time step sizes. In addition, a computational stability test is proposed. As an example, this criterion is applied for the 3D test problem, and it is proven that, for different popular values of fractional parameters and a broad set of time steps, the constructed BURA-BRASIL scheme is unconditionally stable. Next, the approximation accuracy of the third step of the general framework is investigated and a global error of the discrete solution is estimated. The results of computational experiments are presented and analyzed.
In
Section 5, the third step of the general framework is applied for one more approximation of the nonlocal operator, which is based on a uniform rational approximation (URA) method. The experimental stability criterion is used in the analysis, and it is proven that the URA-BRASIL scheme is unconditionally stable for the given fractional parameters and time step sizes. The approximation error analysis shows that this error does not depend on the time step size, and it can be reduced only by increasing the order
m of the rational approximation function.
In
Section 6, a stability analysis of a Crank–Nicolson-type BURA-BRASIL scheme is performed. The stability factor of the Crank–Nicolson scheme has a more complicated dependence on large eigenvalues of the discrete elliptic operator; hence, the stability analysis of the BURA-BRASIL approximation is a good test for the proposed general framework techniques.
In
Section 7, an applied problem is solved. The mathematical model describes biofilm formation. A generalized nonlocal diffusion process is included in the model. A numerical simulation is performed by using a symmetrical splitting scheme, where splitting is performed with respect to physical processes. Applying techniques of the proposed theoretical framework, it is shown that the scheme is second-order in time and space. The results of the computational experiments are presented. Some final conclusions are given in
Section 8.
2. Problem Formulation
Let H be a Hilbert space with a scalar product for . Then, the -norm is defined as .
Let
A be a self-adjoint positive definite operator,
where
I is the identity operator.
Next, we define a fractional power of this operator
with a fractional parameter
. This definition can be given in a non-unique way, and we use the spectral approach. Let us solve the standard eigen-problem:
All eigenvalues are positive:
and the set of eigenfunctions
make an orthonormal basis for
H. Then, any function
can be written as
A nonlocal operator
with fractional parameter
is defined as
Here, we note that it is possible to consider more general nonlocal operators:
where function
g satisfies some specific requirements; first of all, we require that
Here,
denotes the spectrum of
A. Such generalizations of nonlocal operators are considered for example in [
19]. In this paper, we restrict ourselves to polynomial functions
. Still, we remark that the proposed techniques of approximation can be used for more general functions than the powers of eigenvalues. Such a modification of the BURA-BRASIL approximation is described in
Section 4.
We are interested in solving the following Cauchy problem:
By using the Fourier method, it is possible to write the solution of this problem in an explicit form
, where
Semidiscrete Scheme
First, we approximate operator
by considering a finite-dimensional Hilbert space
. For simplicity, we denote a scalar product in
again as
, for
. By taking into account the spectral definition of the nonlocal operator
, we approximate the local operator
A by applying the finite-difference, finite-volume, or finite-element method. It is required to guarantee that
is again a self-adjoint positive definite operator:
where
is the discrete identity operator. Some modification of the definitions should be performed in the case of finite-element approximations. Let
,
be a basis of space
and introduce the mass
and stiffness
matrix by
respectively. Then, the discrete operator
is defined by
.
Let us solve the standard eigen-problem:
All eigenvalues are positive
and the set of eigenfunctions
make an orthonormal basis for
. Then, any function
can be written as
We use the discrete eigenfunctions to replace the fractional operator
by its discrete approximation
We approximate the problem (
1) and (
2) by the following semidiscrete Cauchy problem:
By using the Fourier method it is possible to write the solution of this problem in an explicit form
, where
In the following analysis, we always assume that there exists a sufficiently smooth solution of problem (
1) and (
2). The existence of a solution of the semidiscrete problem (
4) and (
5) is demonstrated above. Still, we are interested in estimating the approximation accuracy of this semidiscrete scheme. We restrict ourselves to the analysis of finite-difference and finite-volume schemes. Let us assume that
is a suitable representation of the exact solution of the PDE (
1) and (
2). The approximation error of the semidiscrete Equation (
4) is defined formally in a standard way (see [
20,
21]):
For nonlocal operators, we cannot use the convenient technique of Taylor expansion. The approximation error can be estimated in a different way. Let us apply the definition of nonlocal operators
and
, then we obtain
The second term can be bounded by
depending on the smoothness of the solution. Next, we formulate accuracy estimates that are sufficient to prove that the approximation error is bounded by
:
Such estimates are known for many popular approximations of elliptic problems [
21,
22,
23].
Example 1. In this example, we solve a linear fractional heat equation with a linear source term in three-dimensional space (see [7]):where This problem has the exact solution [5] A discrete approximation of the 3D diffusion operator is constructed by using the finite-volume method. A uniform space mesh is defined:
and the discrete diffusion operator is constructed: The solution of eigen-problem (3) for this operatoris well known (see [21]): As an example, we compute the global error of the solution of the semidiscrete scheme (4) and (5):for the final timeand the fractional power parameter. The computed errors confirm the second-order accuracy of the proposed approximation: Hence, by selecting a sufficiently large, we can control the space approximation error at the specified smallness level.
3. Backward Euler Method
In the second step of the proposed general framework of analysis, a fully discrete scheme is constructed. In this paper, we consider the backward Euler (BE) method.
For the simplicity of the notations, we consider a uniform time mesh:
Then, the problem (
4) and (
5) is approximated by the following BE scheme [
20]:
where
is a numerical approximation to the exact solution
of the problem (
4) and (
5), and
.
Lemma 1. If a solution of the problem (4) and (5) is sufficiently smooth, then the approximation error of the BE scheme (10) is of order . Proof. The proof is quite standard, and it is based on the Taylor expansion technique. It is sufficient to compute the residual of the discrete formula for a sufficiently smooth function . □
The stability analysis of the scheme (
10) is also simple.
Lemma 2. The BE scheme (10) is unconditionally stable. Proof. The Fourier stability analysis can be used to show that
The same estimate can be obtained by using the energy method and taking into account that operator
is positive definite, i.e.,
. We multiply Equation (
10) by
and obtain the estimate
from which the estimate (
13) follows trivially. Applying the estimates (
13) recursively, we obtain the required stability estimate (
12). □
It is easy to see that, if the solution
of (
1) is a sufficiently smooth function and an approximation error by
functions is of order
, then the error of the discrete solution of the fully discrete BE scheme (
10) can be estimated as
Such a delicate interlacing of space and time approximation errors is nicely seen from the experimental results. We solve the differential problem (
7) of Example 1.
Table 1 gives, for a sequence of decreasing time step widths
, the errors
, and the experimental convergence rates
of the discrete solution for the BE scheme (
10) in the maximum norm:
The fractional power parameter and a uniform space grid with and 400 are used in the numerical experiments.
It follows from the presented results that the convergence order of the discrete solution is close to the first, but it slowly decreases for smaller time steps. Such a behavior of the error is due to the influence of the space approximation error (see the estimate (
14)). In order to illustrate this fact, let us consider the dynamics of a modified error component:
where
is the error of the solution of the semidiscrete scheme (
4) and (
5). The values of
for
and 400 are given in (
9).
Table 2 gives for a sequence of decreasing time step widths
the errors
and the experimental convergence rates
of the discrete solution for the BE scheme (
4).
The presented results agree well with the theoretical predictions.
4. Discrete Schemes Based on Rational Approximations
In the third step of a general theoretical framework, nonlocal operators in a fully discrete scheme are approximated by some local operators. In this paper, we consider methods based on rational approximations.
We can write the BE scheme (
10) in the following form:
Then, we approximate the nonlocal operator
by a local rational operator:
where a function
is defined as
with polynomials
and
of the same degree
m. As a practical implementation of this approach, the best uniform rational approximation (BURA) method is used, where
is the best rational approximation of the function
for
. The required rational function is computed by applying the BRASIL algorithm, which is based on the barycentric rational formula [
8]. We used a free and open-source implementation of this algorithm in Python.
Here, it is important to note that only slight changes are needed if, instead of a polynomial function, we solve a problem with a more general nonlinear function
. Then, a rational approximation function
is defined for the modified function:
The constructed rational function
can be written in a partial fraction decomposition form [
7]:
Then, the following scheme is constructed:
Its implementation is efficient if all coefficients are non-positive.
The convergence analysis of the solution of the scheme (
16) is performed by using the classical technique. It is based on the stability and approximation error analysis. First, we investigate the stability of the scheme (
16). Note that
Let
m be a sufficiently large number in order to satisfy the estimate:
Then, we obtain the required stability inequality:
Remark 1. As an additional stability test of the scheme (16), it is recommended to compute the bound The stability requirement is satisfied if .
As an example, we applied this criterion for the scheme (16) and the problem (7). The results of the computational experiments confirm that the condition is satisfied for fractional power parameters , space meshes with , , and time steps , . The rational function is computed by applying the BURA-BRASIL algorithm with . Next, we investigate the approximation accuracy of the scheme (16). In this analysis, we compare with the solution of the BE scheme (10). Let us write both functions in a spectral form:where The second equation can be written as: The approximation error of the scheme (16) is defined as Let us denote the error function as ; it satisfies equations Applying these equations iteratively, we obtain the estimate Remark 2. As follows from (19), the approximation error depends not only on the accuracy with which the rational function approximates fractional powers of eigenvalues , but also on . For smooth solutions, the Fourier coefficients are bounded from above by with some constant k. Table 3 gives for a sequence of decreasing time step widths
and different values of
m the approximation errors
of the discrete solution for the BURA-BRASIL scheme (
16) in the maximum norm. It is assumed that
. The fractional power parameter
and a uniform space grid
with
and 400 are used in numerical experiments.
A more detailed analysis of the approximation errors
shows that the largest values are obtained for high spectral modes. For many applied problems, solutions depend only on a few moderate size spectral modes. Hence, we computed these errors in a reduced spectral interval
. The obtained results are presented in
Table 4. As expected, the accuracy of the approximation is improved in comparison with the results presented in
Table 3.
Next, we solve the differential problem (
7) of Example 1.
Table 5 gives for a sequence of decreasing time step widths
the errors
of the discrete solution for the BURA-BRASIL scheme (
16) in the maximum norm:
The fractional power parameter and a uniform space grid with and 400 are used in the numerical experiments.
5. URA-Type Discrete Scheme
In this section, as another application of the proposed framework of analysis, we consider a discrete scheme, which is based on the uniform rational approximation (URA) method [
24]. Let
be a self-adjoint and positive definite operator
. Our aim is to approximate the scalar function
, which can be written as a function of a new variable
:
Let
be the BURA of
on
, then we define the URA of
as
Remark 3. If an estimate of is known, then it is recommended to compute as the BURA of on . The BRASIL algorithm can be used to efficiently find coefficients of .
Then, the following URA-type discrete scheme is constructed: Let us consider the implementation algorithm. The rational function can be written in a partial fraction decomposition form The following lemma can be proven by applying simple modifications of the proof given in [24]. Lemma 3. All poles of the function are real and negative: The computation of
requires numerical solving of
m linear systems; all systems are independent and can be solved in parallel:
where functions
are solutions of the following linear systems:
All system are of the same type, and due to (
23), all shifts
are positive, and the operator
is self-adjoint and also positive.
The development of URA-type approximations is motivated by one important property of these schemes: the BURA of function is computed only once, and it can be used for different operators , time steps , and discrete approximations of the time derivative (e.g., BE or Crank–Nicolson methods). After the development of new efficient methods to construct BURA-type rational approximations, the importance of this property decreases sharply. All computational experiments of this paper were performed by using the BRASIL method.
Still, it is interesting to apply the proposed general framework of analysis to the scheme (
21). First, it follows that this scheme is stable if the stability inequality:
is satisfied. We restrict our analysis to the computation of the numerical bound:
The experimental stability requirement is satisfied if .
As an example, we applied this criterion for the scheme (
21) and the problem (
7). The results of the computational experiments confirm that the condition
is satisfied for fractional power parameters
, space meshes with
,
, and time steps
,
. The rational approximation
of function
is computed by applying the BURA-BRASIL algorithm with
for
.
Next, we consider the approximation accuracy. The approximation error of the scheme (
21) is defined as
By substituting (
20) into this equation, we obtain that
Hence, the approximation error does not depend on the time step size , and it can be reduced by increasing the order m of the rational function .
Table 6 gives for different values of
m the approximation errors
of the discrete solution for the URA-BRASIL scheme (
21) in the maximum norm. The fractional power parameter
and a uniform space grid
with
and 400 are used in the numerical experiments. The rational approximation
of function
is computed by applying the BURA-BRASIL algorithm for
.
The computational results show that the accuracy of the URA-BRASIL scheme is similar to the accuracy of the BURA-BRASIL scheme (
16). Hence, both schemes can be recommended as solvers for real-world applications. The final selection can be based on additional criteria, such as a better parallelization property [
7].
6. Stability Analysis of a Crank–Nicolson-Type BURA-BRASIL Scheme
In this section, the problem (
4) and (
5) is approximated by the following Crank–Nicolson (CN) scheme [
20]:
where
.
In order to efficiently compute the solution
, we write the CN scheme (
25) in the following form:
Then, we approximate the nonlocal operator
by a local rational operator:
The BURA-BRASIL algorithm is used to construct
. Finally, the nonlocal discrete scheme (
26) is approximated by the following local discrete scheme:
The stability factor of the CN scheme (
25) has a more complicated dependence on the large eigenvalues of
, and this factor changes the sign and converges to
. Thus, it is most important to investigate the stability of the scheme (
27). According to the proposed framework of the theoretical analysis, we should estimate the norm
This can be performed by applying the computational approach, when the stability factor
R of the scheme (
25) is computed for a specific class of operators
and fractional power parameters
:
The stability requirement is satisfied if .
As an example, we applied this criterion for the scheme (
27) and the problem (
7). The results of the computational experiments confirm that the condition
is satisfied for fractional power parameters
, space meshes with
,
, and time steps
,
. The rational function
is computed by applying the BURA-BRASIL algorithm with
.
7. Simulation of Biofilm Formation
In this section, we construct non-standard finite-volume schemes for the solution of nonlinear problems used to simulate biofilm formation. The mathematical model is generalized to include a nonlocal diffusion operator. The governing two-dimensional mathematical model is based on the Allen–Cahn equation ([
25,
26]):
where
D is the diffusion coefficient,
is the fractional power parameter, and
defines the extinction process when the initial population is too low to survive and attain the maximum capacity otherwise. If
, then we obtain the classical diffusion model.
The initial conditions are defined as
Homogeneous Dirichlet conditions are considered on the boundary points of
:
A discrete approximation of the diffusion operator is constructed in a similar way as for Example 1. A uniform space mesh is defined, and the discrete diffusion operator is constructed by using the finite-volume method.
We note that very interesting results were obtained in [
25], where the authors constructed a non-standard unconditionally positive finite-difference scheme and applied it to solve three test problems for the problem (
28). We note that this scheme has first-order accuracy in time and second-order accuracy in space.
Our goal is to construct a non-standard splitting-type discrete scheme that has second-order accuracy in time and solves a general nonlocal diffusion problem. Here, we used the techniques presented also in [
7]. As an additional bonus of the proposed general framework, we show that no additional theoretical analysis is needed to justify this splitting scheme, when the results of previous sections are already given.
We applied the symmetrical splitting technique with respect to different physical processes and obtained the following template of a discrete scheme
From this template, we can define different cases of the fully discrete scheme.
First, the dynamics of the nonlinear interaction can be resolved by using specialized solvers targeted at specific nonlinear functions. In some cases, these subproblems can even be solved exactly. For the applied problem (
28), we used the well-known symmetrical predictor–corrector method, e.g., for the step (
29), we obtain:
Second, only one subproblem with nonlocal operators is solved for each time step. We can use the Crank–Nicolson-type BURA-BRASIL scheme, which is constructed and investigated in
Section 6. On the basis of the proposed theoretical framework, we automatically obtain that the proposed scheme (
29)–(
31) is stable and a discrete solution converges to the solution of the problem (
28). The constructed scheme has second-order accuracy in time and space.
In order to illustrate the performance of the proposed scheme, we present some results on the simulation of biofilm on medical implants. This problem was also investigated in [
25,
27]. We considered an initial profile with the density function given as
where
,
,
,
,
,
,
. We also took
,
and
.
First, we compared the numerical rate of convergence in time using the new splitting-type scheme (
29)–(
31) and two schemes from the paper [
25], the results are presented in
Table 7. The results for the nonstandard finite-difference scheme (NFSD) and the classical explicit Euler scheme were taken from
Table 4. The test problem was solved for a sequence of time steps
till time
with
,
.
It follows from the presented results that the second-order convergence rate is achieved for the splitting scheme (
29)–(
31), and therefore, it enables computing more accurate approximations for the same time step.
The computational experiments also proved that, for fractional parameters
, it is sufficient to take
for the BURA-BRASIL algorithm in order to obtain the same accuracy of solutions as for the full discrete nonlocal problem (
30). We note that for the given biofilm model, the development of population mostly depends on the nonlinear reaction process, and the fractional power of diffusion has only a secondary impact.
8. Conclusions
A general framework of analysis was proposed for the analysis of solutions of parabolic problems with fractional power elliptic operators. The analysis was split into three parts, and each part dealt with a specific subproblem, which can be solved and analyzed in a simpler way.
An additional bonus of this approach is that the existing stability and convergence results can be included directly in the first and second parts of the framework. This possibility makes the proposed technique quite efficient and robust.
New stability and approximation techniques were proposed for the analysis of discrete schemes, which were constructed by using the uniform rational approximations of transfer functions. The BRASIL algorithm was used for the practical construction of such rational approximations.
The results of extended experiments were reported to illustrate the accuracy and efficiency of the proposed general framework.
The analysis of the influence of efficient parallel solvers for the stability and accuracy of the obtained algorithms can be added as the fourth part of this framework. These results will be presented in a separate paper.