Next Article in Journal
A Refined Closed-Form Solution for Laterally Loaded Circular Membranes in Frictionless Contact with Rigid Flat Plates: Simultaneous Improvement of Out-of-Plane Equilibrium Equation and Geometric Equation
Next Article in Special Issue
Overview of Identification Methods of Autoregressive Model in Presence of Additive Noise
Previous Article in Journal
Optimization of Open Queuing Networks with Batch Services
Previous Article in Special Issue
Algorithmic Differentiation of the MWGS-Based Arrays for Computing the Information Matrix Sensitivity Equations within the Problem of Parameter Identification
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Unbiased Identification of Fractional Order System with Unknown Time-Delay Using Bias Compensation Method

1
National Engineering School of Gabes, University of Gabes, Gabes 6029, Tunisia
2
Control and Energy Management Laboratory, National School of Engineering, Sfax University, Sfax 3038, Tunisia
3
Department of Mechatronics, Samara State University of Transport, 443066 Samara, Russia
4
Department of Information Systems Security, Samara National Research University, 443086 Samara, Russia
*
Author to whom correspondence should be addressed.
Mathematics 2022, 10(16), 3028; https://doi.org/10.3390/math10163028
Submission received: 6 July 2022 / Revised: 8 August 2022 / Accepted: 17 August 2022 / Published: 22 August 2022
(This article belongs to the Special Issue New Trends on Identification of Dynamic Systems)

Abstract

:
In the field of engineering, time-delay is a typical occurrence. In reality, the inner dynamics of many industrial processes are impacted by delay or after-effect events. This paper discusses the identification of continuous-time fractional order system with unknown time-delay using the bias compensated least squares algorithm. The basic concept is to remove the imposed bias by including a correction term into the least squares estimations. The suggested approach makes a significant contribution by the estimation, iteratively, of fractional order system coefficients as well as the orders and the time-delay using a nonlinear optimization algorithm. The main advantage of this method is to provide a simple and powerful algorithm with good accuracy. The suggest method performances are assessed through two numerical examples.

1. Introduction

In recent years, the use of fractional calculus has become increasingly widespread. In fact, fractional order systems have received great interest and relevance [1,2,3,4,5,6]. Examples can be found in a variety of scientific fields: in mechanics, such as dynamic models that govern the relaxation of water on a porous dyke [7], dielectric materials [8], modeling of rotor skin effect in induction machines [9], thermal diffusive phenomena [10,11,12,13], traffic in information networks [14], and muscle relaxation in biology systems [15]. The feature of fractional order differentiation is that it supplies a precious instrument for modeling real-world processes with long memory, interactions, and hereditary properties, in contrast to integer order differentiation, where such properties are neglected [16]. For these reasons, researchers are interested in modeling with fractional order differential equations [17,18].
The fractional order system identification is the foundation of the stability analysis and controller design for fractional order systems. In the literature, various methodologies for the identification of systems can be found using fractional calculus: Battagalia et al. [19] have proposed a fractional model which produces the transient thermal behavior of a system. The simplified refined instrumental variable (SRIV) method has been extended to identify both differentiation orders and coefficients of the fractional system by Malti et al. in [20]. In Ref. [21], a lithium-ion battery has been identified using the fractional state space model. Recently, in 2015, the fractional closed loop system identification emerged as an important research area. Thus, an electronic real system has been estimated in closed loop experiments in [22]. The parametric identification of fractional order nonlinear systems has been studied by Mani et al. as indicated in [23]. In Ref. [24] coefficients and fractional orders based on block pulse functions (BPF) through a two-stage algorithm has been established.
All the aforementioned work involved fractional order systems without time-delay. On the other hand, most realistic physical processes contain a time-delay. Therefore, the identification of fractional order systems with an unknown time-delay is still a challenging problem due to difficulty in formulation caused. It plays an important role in the fractional order signal processing, stability theories, and fractional order control methods [2,25]. However, at present, only a limited number of methods have been extended to identify the fractional order time-delay systems. A brief review is presented in this paragraph. The problem of identifying a fractional order transfer function with time-delay was initiated in 2010 by Peng et al. [2].
In this work, the optimal fractional derivative order and the time-delay of the transfer function model are found using harmony search, while the coefficients are obtained by solving linear least squares problems. In 2011, a frequency domain subspace identification of commensurate fractional order input time-delay systems has been established in [26]. Subsequently, the system identification problem of a Multi-Input-Multi-Output (MIMO) fractional order system with delay in state is studied in [27]. Moreover, an identification algorithm which combines the subspace method and a simulated annealing algorithm and is based on the instrumental variables method has been properly extended to handle the identification of the fractional time-delay systems in [28]. Then, Ref. [29] establishes parameter and delay estimation of fractional order models from step response. In this work, supposing that the fractional orders were known, the authors have presented an integral equation approach for fractional order system modeling. The block pulse functions (BPF) integration operational matrix was combined with the interior point algorithm to estimate the model parameters [30]. Then, utilizing polynomial modulating functions, Gao et al. have proposed a system identification method with measurements noise compensation for fractional order systems with a known delay [31]. Thereafter, a recursive identification of a MIMO fractional order Hammerstein model with time-delay is presented in [32]. Afterwords, a novel approach of fractional order time-delay system modeling based on Haar wavelet has been elaborated in [33]. In 2019, the time-domain identification of one non-integer order plus time-delay models from step response measurements was developed in [34]. More recently, coefficients and delay estimation of the general form of fractional order systems using non-ideal step inputs is detailed in [35]. Lately, in 2022, sin et al. have proposed a new method based on BPF to identify fractional order time-delay systems. Firstly, the operational matrices of BPF for fractional integral and time-delay operators are derived. Then, these operational matrices are applied to convert the fractional order system with time-delay to an algebraic equation. Finally, the system’s parameters and the time-delay are all simultaneously estimated through minimizing a quadric error function [36]. The major drawbacks of this work are that, firstly, the BPF are fixed values in their definition interval, which means that an error is produced when their integration operational matrices are used to convert a fractional order time-delay system into an algebraic equation. In addition, the initial conditions are treated as extra parameters and identified simultaneously with the system parameters, which complicates the identification procedure and can lead to inaccurate results. More importantly, the outputs of engineering systems are often noisy, which greatly affects the consistency of parameter identification.
According to the aforementioned investigations, the primary aspect of this research is first to supply an efficient method to estimate the parameters, namely both the coefficients, the differentiation orders and the time-delay. Firstly, when the differentiation orders and the time-delay are assumed to be known, the fractional order bias compensated least squares ( f b c l s ) method, is applied, which is well-known for its conceptual clarity and efficacy in the disciplines of identification and control theory [37,38]. To start this method, firstly, the parameters vector estimations are derived from the fractional order least squares ( f o l s ) method mixed with the state variable filter approach. Secondly, in order to establish estimation consistency, the bias created by least squares parameter estimations is removed. Furthermore, a specific aspect of fractional differential equation modeling is the determination of differentiation orders. This task is too tricky because the order of the model is updated and the optimization problem is nonlinear when minimizing the output error criterion. Therefore, the f b c l s method is extended to estimate both the parameters and the fractional orders differentiation. Identification is even more difficult when working with a time-delay system as the total number of parameters increases. To analyze the statistical properties of our new algorithm, Monte Carlo simulation analysis is suggested.
The remainder of this paper is organized as follows. In Section 2, the fractional order differentiation and the description of the fractional order system with time-delay are introduced. The parameter identification technique based on the least squares method and the bias correction procedure is proposed in Section 3. In Section 4, the effectiveness of the proposed method is verified by numerical simulations. Finally, conclusions are drawn in Section 5.

2. Preliminaries

2.1. Fractional Order Differentiation

Three commonly used definitions for the fractional order differentiation are Grünwald-Letnikov (G-L), Riemann-Liouville (R-L), and Caputo definitions [39]. In this paper Grünwald-Letnikov will be used to implement fractional operators:
Definition 1.
The Grünwald-Letnikov derivative approximation of the order α of function f ( t ) is described as
G L D 0 , t α f t 1 h α k = 0 t h 1 k α k f t k h , t R + ,
where h is the sampling period and α k is the Newton’s binomial generalized to fractional orders.

2.2. Fractional Order System with Time-Delay Description

For subsequent use, we introduce a brief description of Continuous-Time (CT) fractional order system with time-delay. Let us consider a linear time invariant Single-Input-Single-Ouput (SISO) time-delay system where the input u ( t ) and the output y ( t ) of the plant are connected by the following differential equation
n = 0 N a n D α n y t = m = 0 M b m D β m u t τ ,
where a n n = 0 : N , b m m = 0 : M are the linear constant coefficients; ( α n , β m ) R + are the fractional orders and τ denotes the time-delay.
If all of the differentiation orders α n and β m are multiple integers of the same order υ , the differential equation is said to be with commensurate order. It may be phrased as follows in this case
i = 0 n a a i D i υ y t = j = 0 n b b j D j υ u t τ ,
where υ denotes the commensurate order.
In order to describe the dynamical behavior of systems, the Laplace transform is often used. Expression (4) gives the Laplace transform of the Equation (3) taking into account zero initial conditions
G s = B s A s = j = 0 n b b j s j υ i = 0 n a a i s i υ e τ s .

2.3. Problem Formulation

The system considered in this paper is presented as follows:
G 0 : A 0 p χ ( t ) = B 0 p u ( t τ ) , y t = χ t + e t .
Without loss of generality, a 0 is taken equal to 1. p = d d t denotes the differentiation operator. u ( t τ ) , χ t and y ( t ) are, respectively, the delayed input signal, the system noise-free output signal, and the measured output signal. e ( t ) is an additive zero-mean white Gaussian noise corrupting the output signal and assumed to be uncorrelated with the input signal.
A 0 p , B 0 p , are polynomials in p of degree n a , n b represented as:
A 0 p = 1 + i = 1 n a a i p i υ , B 0 p = j = 0 n b b j p j υ .
Consider the parameterized model describing the system G , presented by the following equation
M : y t = i = 1 n a a i D i υ y ( t ) + j = 0 n b b j D j υ u ( t τ ) + ε ( t ) .
where
ε t = e t + i = 1 n a a i D i υ e t .
The following linear regression form explains the behavior of the fractional system’s inputs and outputs.
y t = Φ T ( t ) ρ + ε ( t ) ,
where ρ represents the parameters vector and Φ is the regression vector, which are defined, respectively, as follows
ρ = a 1 , , a n a , b 0 , , b n b R ( n a + n b + 1 ) ,
Φ T t = D υ y t , , D n a υ y t , u t τ , , D n b υ u t τ .
and ε ( t ) is the residual error.
It should be pointed out that the inevitable direct fractional differentiation of noisy output is a major problem in the fractional system identification, which leads to inaccurate estimates. Therefore, the use of a state variable filter (svf) proposed in [18] is absolutely necessary.
Suppose the svf specified by the subsequent equation
L υ p = p υ ϖ ϖ + p η ,
where υ is the fractional order differentiation, the order η is an integer chosen such that η > n a υ and ϖ denotes the filter cut-off frequency.
The filtered input and output signals u f t and y f t are determined as follows:
D j υ u f t = L j υ p u t , D i υ y f t = L i υ p y t .
So, the regression vector containing the filtered signals is represented as follows
Φ f T t = D υ y f t , , D n a υ y f t , u f t τ , , D n b υ u f t τ .
Using the filtered input and output signals, Equation (9) can be reformulated as
y f t = Φ f T ( t ) ρ + ε f ( t ) ,
where ε f ( t ) is expressed as follows
ε f t = i = 0 n a a i L i υ e t .
In reality, the purpose of this research is to identify the fractional system with an unknown time-delay from N s samples of the input and noisy output signals using the bias compensated least squares approach combined with a nonlinear optimization algorithm.

3. Fractional Order System Identification

The system identification procedure involves constructing an appropriate model from input/output data. System identification is not simply a method for constructing a model from collected data. However, a solid experimental design and prior information, if available, are required for its use. In frequency domain and time domain system identification, a fractional model structure was adopted [18,40,41]. Literature predominantly uses two groups of methodologies: equation error-based methods and output error-based methods. Numerous actual systems are capable of being represented using the fractional model: Electrode-electrolyte polarization, diffusion systems: electro-chemistry, heat transfer, and electromagnetism, nuclear reactor, charge estimation of lead acid battery, semi-infinite thermal system, thermal diffusion in a wall [16,17].
In this section, the identification of fractional order systems with an unknown time-delay is discussed. The main objective is to identify the coefficients as well as the fractional differentiation orders and the time-delay. There are two significant steps during the presented new identification algorithm:
Step 1: suppose that the commensurate order υ and time-delay τ are known, and the fractional bias compensated least squares ( f b c l s ) method is proposed to initialize the coefficients vector.
Step 2: the nonlinear optimization method based on the Levenberg-Marquardt algorithm is introduced to estimate, namely, coefficients, the differentiation order, and the time-delay.

3.1. Compensation for Measurement Noises Existing in the Output Signal

It is assumed that the fractional commensurate order υ and the time-delay τ are already known, and our goal is to estimate just the fractional differential equation coefficients. Initially, this section describes the fractional order least squares ( f o l s ) approach for identifying the fractional order systems with time-delay.
Let ε f t the filtered equation error defined as
ε f t = y f t Φ f T t ρ .
Consider the ρ ^ f o l s N s as the estimated vector of ρ generated by minimizing the 2-norm of the below criterion function
V N s ρ ^ f o l s N s = 1 N s k = 1 N s 1 ε f 2 t k , ρ ^ f o l s .
Thus, the f o l s estimate of ρ is obtained by the following equation
ρ ^ f o l s N s = k = 0 N s 1 Φ f t k Φ f T t k 1 k = 0 N s 1 Φ f t k y f t k = R Φ f Φ f 1 R Φ f ε f ,
where the auto-covariance matrix R Φ f Φ f and the cross-covariance R Φ f y f are given by the following expressions:
R Φ f Φ f = k = 0 N s 1 Φ f t k Φ f T t k .
R Φ f y f = k = 0 N s 1 Φ f t k y f t k .
Theorem 1.
Consider the consistency property of the f o l s estimator, i.e., the behavior estimates of the parameters when the number of data N s tends to infinity:
lim N s ρ ^ f o l s N s = ρ + R Φ f Φ f 1 R Φ f ε f = ρ + B ρ .
Under the sufficiently exciting condition, the Gaussian noise e ( t ) is independent with the input signal u ( t ) , the estimation error can be expressed as
B ρ = R Φ f Φ f 1 R Φ f ε f = R Φ f Φ f 1 Ξ R y f ε f ,
where the matrix Ξ = I n a 0 n b R ( n a + n b + 1 ) × n a .
Proof. 
Based on the Equation (14) the f o l s estimator (18) can be rewritten as the following form
ρ ^ f o l s N s = k = 0 N s 1 Φ f t k Φ f T t k 1 k = 0 N s 1 Φ f t k Φ f T t k ρ + ε f t k
= ρ + k = 0 N s 1 Φ f t k Φ f T t k 1 k = 0 N s 1 Φ f t k ε f t k
= ρ + R Φ f Φ f 1 R Φ f ε f .
It is clear if the input signal u ( t ) can sufficiently excite the identified system, the matrix R Φ f Φ f is invertible and the bias expression is given by the following equation
B ρ = R Φ f Φ f 1 R Φ f ε f ,
where B ρ denotes the bias introduced by the f o l s method.
Note that also the input signal u ( t ) is uncorrelated with the noise e ( t ) ; thus, R Φ f ε f can be rewritten as follows
R Φ f ε f N s = D υ y f t k ε f ( t ) D n a υ y f t k ε f ( t ) 0 0 = 1 1 0 0 R y f ε f .
Replacing Equation (26) in Equation (23), we get the following equation
ρ ^ f o l s N s = ρ + R Φ f Φ f 1 Ξ R y f ε f = ρ + B ρ .
Therefore, the bias expression is B ρ = R Φ f Φ f 1 Ξ R y f ε f .
Obviously, R y f ε f is different to zero and, thus, the bias estimate B ρ is certainly non-zero. Then, the f o l s estimator is biased.    □
The second step in our numerical scheme consists in compensating the bias introduced by the f o l s method B ρ using the f b c l s method whose principle is given by the following expression
ρ ^ f b c l s = ρ ^ f o l s B ρ = ρ ^ f o l s R Φ f Φ f 1 Ξ R y f ε f .
The primary challenge with this technique is that the f o l s method can only supply a single equation to estimate the bias B ρ . Therefore, it is essential to find other equations to solve this problem. Basically, the idea of the proposed method is to augment the nominator parameters by n a n b dimensions and the introduced parameters b j = 0 j = n b + 1 , , n a + n b . As a result, the augmented model, which is used to get an unbiased estimator, can be represented as follows
y f t = a 1 D υ y f t . . . a n a D n a υ y f t + b 0 u f t τ + b 1 D υ u f t τ + . . . + b n a + n b D n a + n b υ u f t τ .
Moreover, the filtered output signal can be expressed as follows
y f t = Φ ¯ f T t ρ ¯ + ε f ( t ) ,
and the augmented parameters vector is presented by
ρ ¯ = ρ b ¯ T ,
where the vector b ¯ T is defined as follows
b ¯ T = b n b + 1 b n b + n a = 0 0 R n a .
The augmented regression vector Φ ¯ f T t k is given by the following expression
Φ ¯ f T t k = D υ y f t k D n a υ y f t k u f t k τ D n a + n b υ u f t k τ = Φ f T t k u ¯ f T t k ,
where the vector u ¯ f T t is defined by
u ¯ f T t k = D ( n b + 1 ) υ u f t k τ D ( n a + n b ) υ u f t k τ .
Hence, the augmented estimator f o l s is computed according to
ρ ¯ ^ f o l s = ρ ¯ + R Φ ¯ f Φ ¯ f 1 Ξ ¯ R y f ε f ,
where the matrix Ξ ¯ is given by the following equation
Ξ ¯ = I n a 0 n a + n b R ( 2 n a + n b + 1 ) × n a .
Let the augmented auto-covariance matrix decompose R Φ ¯ f Φ ¯ f as follows
R Φ ¯ f Φ ¯ f = R Φ ¯ f Φ ¯ f R Φ f u ¯ f R Φ f u ¯ f R u ¯ f u ¯ f ,
and its inverse R Φ ¯ f Φ ¯ f 1 can be expressed as
R Φ ¯ f Φ ¯ f 1 = R Φ f Φ f 1 + β R Φ f Φ f 1 R Φ f u ¯ f X 1 X 1 R Φ f u ¯ f T R Φ f Φ f 1 X 1 .
where X = R u ¯ f u ¯ f R Φ f u ¯ f T R Φ f Φ f 1 R Φ f u ¯ f and β = R Φ f Φ f 1 R Φ f u ¯ f X 1 R Φ f u ¯ f T R Φ f Φ f 1 . Replacing Equation (38) in Equation (35), we get
b ¯ ^ = X 1 R Φ f u ¯ f T R Φ f Φ f 1 R Φ f y f + X 1 R u ¯ f y f = X 1 R Φ f u ¯ f T ρ ^ f o l s N s R u ¯ f y f .
As b ¯ = 0 and using Equations (31), (32) and (38), it is obvious that
b ¯ ^ = b ¯ X 1 R Φ f u ¯ f T R Φ f Φ f 1 Ξ R y f ε f = X 1 R Φ f u ¯ f T R Φ f Φ f 1 Ξ R y f ε f .
In addition, equalize the two expressions (39) and (40) results
X 1 R Φ f u ¯ f T R Φ f Φ f 1 Ξ R y f ε f = X 1 R Φ f u ¯ f T ρ ^ f o l s N s R u ¯ f y f .
It is obvious to obtain the expression of R y f ε f using the Equation (41)
R y f ε f = R Φ f u ¯ f T R Φ f Φ f 1 Ξ 1 R Φ f u ¯ f T ρ ^ f o l s N s R u ¯ f y f .
Now, it is easy to calculate the bias estimation B ρ by substituting Equation (42) in the Equation (22)
B ^ ρ = R Φ f Φ f 1 Ξ R Φ f u ¯ f T R Φ f Φ f 1 Ξ 1 R Φ f u ¯ f T ρ ^ f o l s N s R u ¯ f y f .
Consequently, the f b c l s estimator is obtained by the following equation
ρ ^ f b c l s N s = ρ ^ f o l s N s B ρ . = ρ f o l s N s R Φ f Φ f 1 Ξ R Φ f u ¯ f T R Φ f Φ f 1 Ξ 1 × R Φ f u ¯ f T ρ ^ f o l s N s R u ¯ f y f .

Convergence Analysis

In this section, we show that the f b c l s algorithm is strongly consistent. The main key to establishing the consistency of the f b c l s estimator is to demonstrate that the estimation of R y f ε f is consistent.
Theorem 2.
Consider the proposed f b c l s estimator for fractional order system identification with time-delay. We may conclude that there is a coherent convergence of the parameters
lim N s ρ ^ f b c l s ( N s ) = ρ .
Proof. 
Recalling that
lim N s R y f ε f N s = R Φ f u ¯ f T R Φ f Φ f 1 Ξ 1 × R Φ f u ¯ f T ρ ^ f o l s N s R u ¯ f y f .
replacing ρ ^ f o l s by its expression given by the Equation (27), we get
lim N s R ^ y f ε f N s = R Φ f u ¯ f T R Φ f Φ f 1 Ξ 1 × R Φ f u ¯ f T ρ + R Φ f Φ f 1 Ξ R y f ε f R u ¯ f y f .
so,
lim N s R ^ y f ε f N s = R Φ f u ¯ f T R Φ f Φ f 1 Ξ 1 R Φ f u ¯ f T ρ + R Φ f u ¯ f T R Φ f Φ f 1 Ξ 1 × R Φ f u ¯ f T R Φ ¯ f Φ ¯ f 1 Ξ R y f ε f R Φ f u ¯ f T R Φ f Φ f 1 Ξ 1 R u ¯ f y f = R y f ε f + R Φ f u ¯ f T R Φ f Φ f 1 Ξ 1 R Φ f u ¯ f T ρ R u ¯ f y f .
Since the independence between the noise e ( t ) and the input signal u t , the multiplication both side of the Equation (14) by u ¯ f t implies that
u ¯ f t y f t = u ¯ f t Φ f T ρ + u ¯ f t ε f t = u ¯ f t Φ f T ρ .
Consequently,
R u ¯ f y f = R Φ f u ¯ f t ρ .
Combining the Equations (50) and (48) and letting N s tends to infinity, we obtain
lim N s R ^ y f ε f N s = R y f ε f .
According to Equation (51), the estimation of R y f ε f is asymptotically consistent.
It then follows immediately from (27), (28), and (51). Thus, the result is shown on the following equation
lim N s ρ ^ f b c l s N s = lim N s ρ ^ f o l s N s lim N s R Φ ¯ f Φ ¯ f 1 N s Ξ R y f ε f N s
= ρ + R Φ ¯ f Φ ¯ f 1 Ξ R y f ε f R Φ ¯ f Φ ¯ f 1 Ξ R y f ε f
= ρ .
Thus, we have proved the consistency result.    □

3.2. Output Error Method for Fractional Order System with Unknown Time-Delay (FOSTD-OE)

In essence, the application of the f b c l s technique is confined to situations where the fractional orders are expected to be known beforehand. This part describes a strategy for extending the identification method introduced in the preceding section to a more realistic scenario in which fractional orders differentiation are assumed to be unknown and calculated, along with coefficients. It is based on the combination of the f b c l s method for coefficient estimation and a nonlinear algorithm for optimization of the differentiation order and the time-delay.
First of all, set ρ the parameter vector as follows
ρ = a 1 , , a n , b 0 , , b m , υ , τ .
The challenge of identifying parameters is represented as a functional minimization. Therefore, the primary objective of this approach is to reduce the residual error relative to υ and τ . In addition, the comparable order is updated repeatedly using the Levenberg-Marquardt algorithm during the computing phase. The quadratic criterion is, therefore, defined as follows
J ρ ^ = 1 2 ε ( t ) 2 ,
where ε ( t ) is the output error defined by
ε t = y ( t ) y ^ t
This iterative algorithm calculates the fractional vector parameters ρ i t e r + 1 at the iteration i t e r + 1 . The proposed algorithm is named the Fractional System with Time-Delay Output Error ( F S T D - O E ) algorithm and is described in the Algorithm 1.
Algorithm 1 F S T D - O E algorithm
Data u f t , y f t t = 1 , , N s , Maximum number of iteration.
1:
Initialization
  • iter = 0
  • Initialize υ 0 and τ 0 .
  • ρ ^ f b c l s 0 : initial model parameter vector obtained by the f b c l s method.
  • Calculate J ρ ^ ( 0 ) .
  • Initialize λ , which is a positive scalar.
2:
repeat
  • Levenberg-Marquardt algorithm estimates ρ ^ iteratively:
ρ ^ i t e r + 1 = ρ ^ i t e r H + λ I 1 J ρ ^ f b c l s ρ ^ i t e r
J ρ ^ = k = 1 K ε t k ρ ^ ε t k : Gradient H k = 1 K ε t k T ρ ^ ε t k ρ ^ : pseudo Hessian ε t k ρ ^ : Output sensitivity function λ : a tunning parameter
3:
until ρ ^ i t e r ρ ^ i t e r 1 ρ ^ i t e r 1 < δ or a maximum number of iterations is reached.
4:
return ρ ^ and the covariance matrix P ^ ρ .
According to [42] and by supposing that the F S T D - O E algorithm converges ( ρ ^ ρ ), hence, the estimation of the covariance matrix P ^ ρ can be calculated by the following equation:
P ^ ρ = σ ^ 2 H 1 .
where σ ^ 2 is, as previously, the empirical estimate of noise variance and H is the approximate Hessian given by the Equation (58).

4. Numerical Example

The purpose of this section is to demonstrate the performance of the developed identification approach through two numerical examples.
To evaluate the identification result, we define the mean squared error ( M S E ) and the best fit rate ( B F R ) , respectively, as follows
M S E = 1 N s k = 1 N s y k y ^ k ,
where y ^ is the simulated response of the estimated model.
BFR = max 1 k = 1 N d y t k y ^ t k 2 k = 1 N d y t k y ¯ 2 , 0 . 100 % ,
where y ¯ is the mean of the output signal.

4.1. Example 1

Considering the following fractional order system with an unknown time-delay
y t = a 1 D υ y t + b 0 u t τ ,
where the coefficients a 1 = 0.50 , b 0 = 1.00 , the fractional commensurate order υ = 0.7 and the time-delay τ = 0.25 s.
Figure 1 depicts the input signal u ( t ) as a pseudo random binary sequence (PRBS) with uniform distribution between [−1 1]. This example’s sample period is set at h = 0.019 s. N s = 2631 data points represents the sample size. The output observation-corrupting noise term e ( t ) is a white Gaussian noise with a fixed signal-to-noise ( S N R y ) ratio, which is generated by
S N R y = 10 log k = 1 N s y y ¯ 2 k = 1 N s e ( k ) 2 .
The parameters vector of the fractional model is given by
ρ = a 1 b 0 υ τ .
Figure 2 shows the Bode diagram of the system defined by (62).
The svf parameters are chosen respectively as: ϖ = 2 rad/s and η = 1 .
The acquired findings are described in Table 1 and Table 2, followed by a graphical representation in Figure 3, Figure 4 and Figure 5. It is evident from the values of the mean and standard deviation shown in Table 1 and the estimation error recapitulated in Table 2 that the F O S T D - O E algorithm produces unbiased parameters estimates with low M S E and standard deviation values. Therefore, the proposed algorithm gives accurate estimations in a noisy environment even if the value of the S N R is low (10 [dB]).
The error between the true output y ( t ) and y ^ ( t ) is plotted in Figure 3.
The true output y ( t ) and the simulated output sequences y ^ ( t ) of the estimated models are plotted in Figure 4.
Figure 5 presents histograms that display the distribution of estimates and provide meaningful information. It is clear that these distributions are roughly symmetric and centered on the real values, which confirms the high accuracy of this approach.
This concludes that the proposed approach offers a good tradeoff in terms of consistency, variance, and estimation error.

4.2. Example 2

In this example, the input−output representation to be identified is given by the following equation
y t = a 1 D υ y t a 2 D 2 υ y t + b 0 u t τ ,
where a 1 = 1.2 , a 2 = 1.00 , b 0 = 1.00 , υ = 0.5 and τ = 0.7 s.
The input signal used in this example is depicted in Figure 6. The sampling period h = 0.0181 s and N s = 2209 data.
The Bode diagram of the system defined by the Equation (65) is plotted in Figure 7.
The svf parameters are selected respectively as: ϖ = 1 rad/s and η = 2 .
The parameter identification results are recorded in Table 3 and Table 4 which summarize the mean, standard deviation, M S E and B F R of the 200 Monte Carlo parameter estimations for fractional models. Despite the noise in the output, it can be seen from the identification results that the proposed method effectively estimates the system parameters
The error between the true output y ( t ) and y ^ ( t ) is plotted in Figure 8.
The true output y ( t ) and the simulated output sequences y ^ ( t ) of the estimated model are plotted for the two levels of noise in Figure 9.
It is clearly shown that the proposed method has a small identification error, and that the identification result is closer to the true one.
The statistical properties of the algorithm, plotted in Figure 10, are noticeable: the average values are very close to the real parameters, with very low standard deviations and M S E and with B F R approximately equal to one. Moreover, the distribution of the parameters is symmetric for the two levels of the S N R . The identification results confirm that the proposed method is able to identify the model coefficients, orders, and time delay.
The accuracy and precision of the suggested approach to detect both coefficients, fractional order differentiation, and time-delay in the situation of a noisy output signal and even with a large number of parameters (Case of example 2:5 parameters) are validated by simulation results based on two numerical cases. This indicates that the proposed method is suitable for the identification of fractional order time-delay systems.

5. Conclusions

This paper studies the identification of the fractional order system with time-delay. It is known that the obtained coefficient estimations of the fractional order differential equation using the least squares algorithm are biased. So, the bias correction procedure is applied in this work in order to compensate this introduced bias and to obtain accurate results. This procedure is combined with a nonlinear algorithm to identify iteratively the coefficients as well as the fractional order differentiation and the time-delay. The main features of the proposed method are: its consistency, its implementation simplicity, and its faster convergence. Two numerical examples were used to illustrate the validity of the proposed guidelines and technique.
In an effort to approach more realistic assumptions, it is planned to expand this work to the scenario when the input signal is influenced by additive noise.

Author Contributions

Conceptualization, O.N.; Data curation, Z.Y.; Formal analysis, O.N.; Investigation, Z.Y. and O.N.; Resources, D.I.; Validation, D.I.; Visualization, Z.Y. and D.I.; Writing—original draft, Z.Y.; Writing—review and editing, O.N. and D.I. All authors have read and agreed to the published version of the manuscript.

Funding

This article was supported by the Federal Agency of Railway Transport (No. 122022200429-8).

Acknowledgments

The authors are grateful to the reviewers for constructive and useful comments, which made it possible to significantly improve the presentation of the results obtained.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Cois, O.; Oustaloup, A.; Poinot, T.; Battaglia, J. Fractional state variable filter for system identification by fractional model. In Proceedings of the European Control Conference (ECC), Porto, Portugal, 4–7 September 2001; pp. 2481–2486. [Google Scholar]
  2. Peng, C.; Li, W.; Wang, Y. Frequency domain identification of fractional order time delay systems. In Proceedings of the 2010 Chinese Control and Decision Conference, Xuzhou, China, 26–28 May 2010; pp. 2635–2638. [Google Scholar]
  3. Valério, D.; Sá da Costa, J. Identifying digital and fractional transfer functions from a frequency response. Int. J. Control 2011, 84, 445–457. [Google Scholar] [CrossRef]
  4. Raïssi, T.; Aoun, M. On robust pseudo state estimation of fractional order systems. In Proceedings of the International Symposium on Positive Systems, Rome, Italy, 14–16 September 2016; pp. 97–111. [Google Scholar]
  5. Yakoub, Z.; Naifar, O.; Amairi, M.; Chetoui, M.; Aoun, M.; Makhlouf, A.B. A Bias-Corrected Method for Fractional Linear Parameter Varying Systems. Math. Probl. Eng. 2022, 2022, 7278157. [Google Scholar] [CrossRef]
  6. Naifar, O.; Ben Makhlouf, A. On the stabilization and observer design of polytopic perturbed linear fractional-order systems. Math. Probl. Eng. 2021, 2021, 6699756. [Google Scholar] [CrossRef]
  7. Oustaloup, A.; Sabatier, J.; Lanusse, P.; Malti, R.; Melchior, P.; Moreau, X.; Moze, M. An overview of the CRONE approach in system analysis, modeling and identification, observation and control. IFAC Proc. Vol. 2008, 41, 14254–14265. [Google Scholar] [CrossRef] [Green Version]
  8. Reyes-Melo, M.; Martinez-Vega, J.; Guerrero-Salazar, C.; Ortiz-Mendez, U. Modelling of relaxation phenomena in organic dielectric materials. Application of differential and integral operators of fractional order. J. Optoelectron. Adv. Mater. 2004, 6, 1037–1044. [Google Scholar]
  9. Jallouli-Khlif, R.; Jelassi, K.; Melchior, P.; Trigeassou, J.C. Fractional modeling of rotor skin effect in induction machines. In Proceedings of the 4th IFAC Workshops on Fractional Differentiation and its Applications (IFAC FDA’10), Badajoz, Spain, 18–20 October 2010. [Google Scholar]
  10. Jin, B.; Kian, Y. Recovery of the order of derivation for fractional diffusion equations in an unknown medium. SIAM J. Appl. Math. 2022, 82, 1045–1067. [Google Scholar] [CrossRef]
  11. Krasnoschok, M.; Pereverzyev, S.; Siryk, S.V.; Vasylyeva, N. Regularized reconstruction of the order in semilinear subdiffusion with memory. In Proceedings of the International Conference on Inverse Problems, Shanghai, China, 12–14 October 2018; Springer: Singapore, 2018; pp. 205–236. [Google Scholar]
  12. Krasnoschok, M.; Pereverzyev, S.; Siryk, S.V.; Vasylyeva, N. Determination of the fractional order in semilinear subdiffusion equations. Fract. Calc. Appl. Anal. 2020, 23, 694–722. [Google Scholar] [CrossRef]
  13. Gu, W.; Wei, F.; Li, M. Parameter estimation for a type of fractional diffusion equation based on compact difference scheme. Symmetry 2022, 14, 560. [Google Scholar] [CrossRef]
  14. Zaborovsky, V.; Meylanov, R. Informational network traffic model based on fractional calculus. In Proceedings of the 2001 International Conferences on Info-Tech and Info-Net. Proceedings (Cat. No. 01EX479), Beijing, China, 29 October–1 November 2001; Volume 1, pp. 58–63. [Google Scholar]
  15. Ionescu, C.; Lopes, A.; Copot, D.; Machado, J.T.; Bates, J.H. The role of fractional calculus in modeling biological phenomena: A review. Commun. Nonlinear Sci. Numer. Simul. 2017, 51, 141–159. [Google Scholar] [CrossRef]
  16. Dalir, M.; Bashour, M. Applications of fractional calculus. Appl. Math. Sci. 2010, 4, 1021–1032. [Google Scholar]
  17. Sabatier, J.; Aoun, M.; Oustaloup, A.; Gregoire, G.; Ragot, F.; Roy, P. Fractional system identification for lead acid battery state of charge estimation. Signal Process. 2006, 86, 2645–2657. [Google Scholar] [CrossRef]
  18. Victor, S.; Malti, R.; Garnier, H.; Oustaloup, A. Parameter and differentiation order estimation in fractional models. Automatica 2013, 49, 926–935. [Google Scholar] [CrossRef]
  19. Battaglia, J.L.; Le Lay, L.; Batsale, J.C.; Oustaloup, A.; Cois, O. Utilisation de modèles d’identification non entiers pour la résolution de problèmes inverses en conduction. Int. J. Therm. Sci. 2000, 39, 374–389. [Google Scholar] [CrossRef]
  20. Malti, R.; Victor, S.; Oustaloup, A.; Garnier, H. An optimal instrumental variable method for continuous-time fractional model identification. IFAC Proc. Vol. 2008, 41, 14379–14384. [Google Scholar] [CrossRef] [Green Version]
  21. Wu, H.; Yuan, S.; Yin, C. A lithium-ion battery fractional order state space model and its time domain system identification. In Proceedings of the FISITA 2012 World Automotive Congress; Springer: Berlin/Heidelberg, Germany, 2013; pp. 795–805. [Google Scholar]
  22. Yakoub, Z.; Amairi, M.; Chetoui, M.; Aoun, M. On the Closed-Loop System Identification with Fractional Models. Circuits Syst. Signal Process. 2015, 34, 3833–3860. [Google Scholar] [CrossRef]
  23. Mani, A.K.; Narayanan, M.; Sen, M. Parametric identification of fractional-order nonlinear systems. Nonlinear Dyn. 2018, 93, 945–960. [Google Scholar] [CrossRef]
  24. Zhang, B.; Tang, Y.; Zhang, J.; Lu, Y. Coefficients and Orders Identification of Fractional Order Systems Based on Block Pulse Functions Through Two-Stage Algorithm. J. Dyn. Syst. Meas. Control 2022, 144, 071001. [Google Scholar] [CrossRef]
  25. Narang, A.; Shah, S.L.; Chen, T. Continuous-time model identification of fractional-order models with time delays. IET Control Theory Appl. 2011, 5, 900–912. [Google Scholar] [CrossRef] [Green Version]
  26. Wang, L.; Cheng, P.; Wang, Y. Frequency domain subspace identification of commensurate fractional order input time delay systems. Int. J. Control Autom. Syst. 2011, 9, 310–316. [Google Scholar] [CrossRef]
  27. Liao, Z.; Peng, C.; Wang, Y. A frequency-domain identification algorithm for MIMO fractional order systems with time-delay in state. In Advanced Materials Research; Trans Tech Publications Ltd.: Stafa-Zurich, Switzerland, 2012; Volume 383, pp. 4397–4404. [Google Scholar]
  28. Zhuting, Z.; Zeng, L.; Shu, L.; Cheng, P.; Yong, W. Subspace-based identification for fractional order time delay systems. In Proceedings of the 31st Chinese Control Conference, Hefei, China, 25–27 July 2012; pp. 2019–2023. [Google Scholar]
  29. Ahmed, S. Parameter and delay estimation of fractional order models from step response. IFAC-PapersOnLine 2015, 48, 942–947. [Google Scholar] [CrossRef]
  30. Tang, Y.; Li, N.; Liu, M.; Lu, Y.; Wang, W. Identification of fractional-order systems with time delays using block pulse functions. Mech. Syst. Signal Process. 2017, 91, 382–394. [Google Scholar] [CrossRef]
  31. Gao, Z.; Lin, X.; Zheng, Y. System identification with measurement noise compensation based on polynomial modulating function for fractional-order systems with a known time-delay. ISA Trans. 2018, 79, 62–72. [Google Scholar] [CrossRef] [PubMed]
  32. Moghaddam, M.J.; Mojallali, H.; Teshnehlab, M. Recursive identification of multiple-input single-output fractional-order Hammerstein model with time delay. Appl. Soft Comput. 2018, 70, 486–500. [Google Scholar] [CrossRef]
  33. Kothari, K.; Mehta, U.; Vanualailai, J. A novel approach of fractional-order time delay system modeling based on Haar wavelet. ISA Trans. 2018, 80, 371–380. [Google Scholar] [CrossRef]
  34. Alagoz, B.B.; Tepljakov, A.; Ates, A.; Petlenkov, E.; Yeroglu, C. Time-domain identification of one noninteger order plus time delay models from step response measurements. Int. J. Model. Simul. Sci. Comput. 2019, 10, 1941011. [Google Scholar] [CrossRef]
  35. Hashemniya, F.; Tavakoli-Kakhki, M.; Azarmi, R. Coefficients and Delay Estimation of the General Form of Fractional Order Systems Using Non-Ideal Step Inputs. IFAC-PapersOnLine 2020, 53, 590–597. [Google Scholar] [CrossRef]
  36. Sin, M.H.; Sin, C.; Ji, S.; Kim, S.Y.; Kang, Y.H. Identification of fractional-order systems with both nonzero initial conditions and unknown time delays based on block pulse functions. Mech. Syst. Signal Process. 2022, 169, 108646. [Google Scholar] [CrossRef]
  37. Yakoub, Z.; Chetoui, M.; Amairi, M.; Aoun, M. A bias correction method for fractional closed-loop system identification. J. Process Control 2015, 33, 25–36. [Google Scholar] [CrossRef]
  38. Lu, Y.; Tang, Y.; Zhang, X.; Wang, S. Parameter identification of fractional order systems with nonzero initial conditions based on block pulse functions. Measurement 2020, 158, 107684. [Google Scholar] [CrossRef]
  39. Li, C.; Qian, D.; Chen, Y. On Riemann-Liouville and Caputo derivatives. Discret. Dyn. Nat. Soc. 2011, 2011, 562494. [Google Scholar] [CrossRef] [Green Version]
  40. Malti, R.; Aoun, M.; Sabatier, J.; Oustaloup, A. Tutorial on system identification using fractional differentiation models. In Proceedings of the 14th IFAC Symposium on System Identification, Newcastle, Australia, 29–31 March 2006; pp. 606–611. [Google Scholar]
  41. Ivanov, D.V.; Sandler, I.L.; Kozlov, E.V. Identification of fractional linear dynamical systems with autocorrelated errors in variables by generalized instrumental variables. IFAC-PapersOnLine 2018, 51, 580–584. [Google Scholar] [CrossRef]
  42. Ljung, L. System Identification—Theory for the User, 2nd ed.; PrenticeHall: Upper Saddle River, NJ, USA, 1999; Volume 101. [Google Scholar]
Figure 1. The excitation signal.
Figure 1. The excitation signal.
Mathematics 10 03028 g001
Figure 2. The bode diagrams of the system (62).
Figure 2. The bode diagrams of the system (62).
Mathematics 10 03028 g002
Figure 3. The output error of example 1.
Figure 3. The output error of example 1.
Mathematics 10 03028 g003
Figure 4. The true and the estimated output signals of example 1.
Figure 4. The true and the estimated output signals of example 1.
Mathematics 10 03028 g004
Figure 5. The histograms of the process estimates of example 1 with the F O S T D - O E algorithm S N R y = 20 and 10 [ dB ] n m c = 200 runs.
Figure 5. The histograms of the process estimates of example 1 with the F O S T D - O E algorithm S N R y = 20 and 10 [ dB ] n m c = 200 runs.
Mathematics 10 03028 g005
Figure 6. The excitation signal of the system (65).
Figure 6. The excitation signal of the system (65).
Mathematics 10 03028 g006
Figure 7. The bode diagrams of the system (65).
Figure 7. The bode diagrams of the system (65).
Mathematics 10 03028 g007
Figure 8. The output error of example 2.
Figure 8. The output error of example 2.
Mathematics 10 03028 g008
Figure 9. The true and the estimated output signals of example 2.
Figure 9. The true and the estimated output signals of example 2.
Mathematics 10 03028 g009
Figure 10. The histograms of the process estimates of example 2 with the F S T D - O E algorithm S N R y = 20 [ dB ] n m c = 200 runs.
Figure 10. The histograms of the process estimates of example 2 with the F S T D - O E algorithm S N R y = 20 [ dB ] n m c = 200 runs.
Mathematics 10 03028 g010
Table 1. Mean and standard deviation of the fractional model parameter estimates obtained by the F S T D - O E algorithm ( n m c = 200 runs, S N R y = 20 and 10 [dB]): example 1.
Table 1. Mean and standard deviation of the fractional model parameter estimates obtained by the F S T D - O E algorithm ( n m c = 200 runs, S N R y = 20 and 10 [dB]): example 1.
SNR = 20  [dB] SNR = 10  [dB]
True ρ ^ ρ ^
a 1 0.500 0.5001 ± 0.0031 0.501 ± 0.0101
b 0 1.000 1.0002 ± 0.0035 1.0008 ± 0.0118
υ 0.700 0.6999 ± 0.0027 0.7009 ± 0.0086
τ 0.250 0.2503 ± 0.0018 0.2508 ± 0.0021
Table 2. B F R and M S E obtained by the F S T D - O E algorithm ( n m c = 200 runs, S N R y = 20 , and 10 [dB]): example 1.
Table 2. B F R and M S E obtained by the F S T D - O E algorithm ( n m c = 200 runs, S N R y = 20 , and 10 [dB]): example 1.
SNR = 20  [dB] SNR = 10  [dB]
Method MSE (%) BFR  (%) MSE  (%) BFR  (%)
F S T D - O E 0.042999.000.1698.85
Table 3. Mean and standard deviation of the fractional model parameter estimates obtained by the F S T D - O E algorithm ( n m c = 200 runs, S N R y = 20 and 10 [dB]): example 2.
Table 3. Mean and standard deviation of the fractional model parameter estimates obtained by the F S T D - O E algorithm ( n m c = 200 runs, S N R y = 20 and 10 [dB]): example 2.
SNR = 20  [dB] SNR = 10  [dB]
a 1 = 1.200 1.1969 ± 0.0603 1.1849 ± 0.099
a 2 = 1.000 0.9997 ± 0.0271 1.0101 ± 0.0947
b 0 = 1.000 0.9990 ± 0.0153 0.9982 ± 0.0470
υ = 0.500 0.5001 ± 0.0038 0.4993 ± 0.0135
τ = 0.700 0.6992 ± 0.0018 0.6986 ± 0.0030
Table 4. B F R and M S E obtained by the F S T D - O E algorithm ( n m c = 200 runs, S N R y = 20 and 10 [dB]): example 2.
Table 4. B F R and M S E obtained by the F S T D - O E algorithm ( n m c = 200 runs, S N R y = 20 and 10 [dB]): example 2.
SNR = 20  [dB] SNR = 10  [dB]
Method MSE (%) BFR  (%) MSE  (%) BFR  (%)
F S T D OE 0.34098.920.54096.02
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Yakoub , Z.; Naifar, O.; Ivanov, D. Unbiased Identification of Fractional Order System with Unknown Time-Delay Using Bias Compensation Method. Mathematics 2022, 10, 3028. https://doi.org/10.3390/math10163028

AMA Style

Yakoub  Z, Naifar O, Ivanov D. Unbiased Identification of Fractional Order System with Unknown Time-Delay Using Bias Compensation Method. Mathematics. 2022; 10(16):3028. https://doi.org/10.3390/math10163028

Chicago/Turabian Style

Yakoub , Zaineb, Omar Naifar, and Dmitriy Ivanov. 2022. "Unbiased Identification of Fractional Order System with Unknown Time-Delay Using Bias Compensation Method" Mathematics 10, no. 16: 3028. https://doi.org/10.3390/math10163028

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop