Next Article in Journal
A New Chaos-Based Image Encryption Algorithm Based on Discrete Fourier Transform and Improved Joseph Traversal
Next Article in Special Issue
Cooperative Adaptive Fuzzy Control for the Synchronization of Nonlinear Multi-Agent Systems under Input Saturation
Previous Article in Journal
Homogeneously Weighted Moving Average Control Charts: Overview, Controversies, and New Directions
Previous Article in Special Issue
Normalized Error-Based PI Controller and Its Application to the DC–DC Buck Converter
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Strictly Dissipative Condition of Continuous-Time Markovian Jump Systems with Uncertain Transition Rates

1
School of Electronic Engineering, Kumoh National Institute of Technology, Gumi-si 39177, Republic of Korea
2
Department of IT Convergence Engineering, Kumoh National Institute of Technology, Gumi-si 39177, Republic of Korea
*
Author to whom correspondence should be addressed.
Mathematics 2024, 12(5), 639; https://doi.org/10.3390/math12050639
Submission received: 23 January 2024 / Revised: 17 February 2024 / Accepted: 20 February 2024 / Published: 21 February 2024

Abstract

:
This study addresses the problem of strictly dissipative stabilization for continuous-time Markovian jump systems (MJSs) with external disturbances and generally uncertain transition rates that contain completely unknown transition rates and their bound values. A stabilization condition is obtained to guarantee strict dissipativity for the MJSs with partial knowledge in terms of the transition rates. To reduce the conservativity of the proposed condition, we used a boundary condition related to the bounds of the transition rate with slack variables. Finally, two simulation results are presented to describe the feasibility of the proposed controller.

1. Introduction

Over the past decades, there has been increasing interest in Markovian jump systems (MJSs), which effectively represent practical systems with unexpected variations [1,2,3,4,5,6]. MJSs have been studied by many researchers using stability analysis [7], controller synthesis [8,9,10], and filter design [11,12,13]. These results have contributed to the extensive application of MJSs, including power systems [14,15,16], economic systems [17,18,19,20], and manufacturing systems [21]. Because the MJSs are constructed using a group of linear systems influenced by a Markov process, the knowledge of transition probabilities for the jumping process is an important challenge. However, it is difficult to accurately determine the transition probabilities in many practical applications, leading to limitations in modeling various practical systems.
Recently, to overcome this difficulty, studies on the stabilization of MJSs with transition probabilities that contain uncertainty have attracted considerable interest concerning control theory [22,23]. Specifically, because the transition probabilities in continuous-time MJSs depend on the transition rates, many researchers have focused on how to handle uncertain transition rates for the stabilization of continuous-time MJSs. Ref. [24] proposed a state observer for MJSs with time-varying delays, where the transition probabilities were assumed to change in a polytope with vertices. Refs. [25,26] employed the boundary values of the transition rates for the controller synthesis of MJSs. Although these approaches consider the uncertainty of the transition rates, it is difficult to precisely estimate their bounds in practical systems. To address this challenge, the stabilization method of MJSs with state delays was investigated in [27] based on the partial known and unknown transition rates. However, similar to other results on the analysis and synthesis of MJSs, Ref. [27] developed a method assuming that some transition rates are precisely known. More recently, Ref. [28] introduced a new structure for the transition rates, generally uncertain transition rates (GUTRs), which contain bounds of the uncertainties of the known and unknown transition rates. The method reported in Ref. [28] has piqued the interest of researchers [29,30] concerning the stabilization problem of MJSs. These results all focus on the uncertainties of the transition rates, but there is no consideration of external disturbances. Hence, it is vital to consider the uncertain transition rates and disturbances concerning realistic system stability analysis and synthesis problems.
In contrast, the dissipativity theory has become an important approach to studying control systems concerning the stabilization problem [31,32,33,34]. Dissipativity is characterized by the input–output energy concerning the stored energy in the system and supplied energy from outside the system [35]. Furthermore, the dissipativity performance can be applied to the H and passivity performance [36]. Based on these properties, many researchers have focused on the dissipativity problem in the stabilization of interconnected systems, switched systems, and Markovian jump systems [37,38,39,40]. Ref. [37] introduced a framework for dissipativity for switched systems, employing multiple storage functions and supply rates. Ref. [38] proposed a stabilization method for Markovian jump fuzzy systems with asynchronous controllers. Ref. [39] studied dissipative filter design for singular MJSs with hybrid transition rates. Ref. [40] proposed an asynchronous dissipative controller for semi-MJSs using distribution of the sojourn time. To the best of our knowledge, the dissipativity control for continuous-time MJSs with GUTRs has not yet been analyzed, thus forming the motivation of our study.
This study attempted to design a strictly dissipative controller for MJSs with external disturbances and GUTRs that can represent all possible cases: (1) known transition rates, (2) unknown transition rates, and (3) known bounds of the transition rates but unknown exact transition rates. Following is a list of the specific contributions of this study.
  • In practice, it is necessary to consider the uncertainties in the transition rates and disturbances from outside the system. Therefore, to address this issue, we proposed a strictly dissipative controller for MJSs with external disturbances and GUTRs that have not yet been introduced.
  • To design the proposed controller, stabilization conditions were formulated using linear matrix inequalities (LMIs) with various matrix variables. Considering the strict dissipativity and GUTRs, these conditions may be conservative because of the lack of information about the transition rates. Therefore, this study introduced an appropriate weighting approach to reduce the conservatism of the stabilization condition using the known bounds of the transition rates with slack variables.
Two simulation results show the effectiveness of the proposed stabilization condition.
This paper is divided into five sections. Section 2 describes the proposed MJSs and their preliminaries. The design process of the strictly dissipative controller for MJSs with external disturbances and GUTRs is shown in Section 3. Simulation examples are presented in Section 4 to demonstrate the feasibility of the proposed method. Finally, Section 5 presents the conclusions of this study.
Notation: The notation A > B indicates that A B is a positive definite for any matrix. R n represents the n-dimensional Euclidean space. ( ) denotes an ellipsis for symmetry-induced terms in symmetric block matrices. Furthermore, He ( A ) = A + A T for any matrix A. E [ A ] is the expectation of A. L 2 [ 0 , ) means the space of square-summable sequences over [ 0 , ) .

2. System Description

Let us consider a continuous-time MJS:
x ˙ ( t ) = A ( r ( t ) ) x ( t ) + B ( r ( t ) ) u ( t ) + G ( r ( t ) ) ω ( t ) , z ( t ) = E ( r ( t ) ) x ( t ) + F ( r ( t ) ) u ( t ) + J ( r ( t ) ) ω ( t ) ,
where x ( t ) R n denotes the state, u ( t ) R m denotes the input, ω ( t ) R n ω denotes the external disturbance belonging to L 2 [ 0 , ) , and z ( t ) R n z denotes the performance output. Here, r ( t ) D = { 1 ,   2 , , M } represents a continuous-time Markov jump. To represent the Markov jump from mode i to j at time t + h , the transition probability is defined as:
P ( r ( t + h ) = j | r ( t ) = i ) = π i j h + o ( h ) if   i j 1 + π i i h + o ( h ) if   i = j ,
where π i j is the transition rate with π i j 0 , i j ; π i i = j D , i j π i j , h > 0 is the transition time interval; and lim h 0 o ( h ) h = 0 .
Then, the transition rate matrix Π , which has unknown or bounded transition rates, can be described as:
Π = [ π 11 m i n ,   π 11 m a x ] × [ π 1 M m i n ,   π 1 M m a x ] × × π M 1 m i n ,   π M 1 m a x ] × [ π M M m i n ,   π M M m a x ] ,
where π i j m i n and π i j m a x denote the minimum and maximum bounds of π i j ; × is the completely unknown transition rate; and the notation ⋱ signifies that the diagonal terms of the matrix are successively populated with the values π i j m i n and π i j m a x , where the indices i and j increase simultaneously by 1. The above transition rate matrix can represent all possible transition rates that can contain unknown, bounded, or known transition rates for π i j m i n = π i j m a x . This is called a GUTR. Therefore, the transition rate can be rewritten as:
π i j = π ˜ i j + δ π i j ,
where π ˜ i j = ( π i j m a x + π i j m i n ) / 2 , δ π i j [ Δ i j , Δ i j ] , Δ i j = ( π i j m a x π i j m i n ) / 2 .
Subsequently, depending on the transition rates, we can define the following two mode sets:
D i = { j | π i j [ π i j m i n , π i j m a x ]   are   unknown   but   bounded   for   i } ,
D ˜ i = { j | π i j   are   completely   unknown   for   i } ,
where D = D i D ˜ i . D i refers to the collection of column indices in the ith row of matrix Π , where the transition rates have known bounds, while D ˜ i denotes the collection of column indices with unknown transition rates. Here, an element of D ˜ i is given by κ l , where 1 l L and 1 L M .
For convenience, when r ( t ) = i , System (1) can be deduced as
x ˙ ( t ) = A i x ( t ) + B i u ( t ) + G i ω ( t ) , z ( t ) = E i x ( t ) + F i u ( t ) + J i ω ( t ) .
Definition 1
([41]). The system is stochastically stable when ω ( t ) 0 if the following holds:
lim t E 0 t x ( τ ) 2 d τ < .
Definition 2
([42]). Based on dissipativity theory, the quadratic energy supply rate can be described as:
R ( z ( t ) , ω ( t ) ) = z ( t ) ω ( t ) T Q S S T R z ( t ) ω ( t ) ,
where Q = Q ˜ T Q ˜ < 0 , S, and R = R T are known real matrices. For a scalar β > 0 and T > 0 , the following condition holds when x ( 0 ) = 0 :
0 T E R ( z ( t ) , ω ( t ) ) d t > β 0 T ω T ( t ) ω ( t ) d t .
Then, (1) is a strictly ( Q , S , R ) -β-dissipative system, where β represents the dissipative performance.
This study attempted to design a controller that guarantees stochastic stability for System (1) when ω ( t ) 0 and strictly ( Q , S , R ) - β -dissipativity when x ( 0 ) = 0 .

3. Main Result

This section focuses on the design of the dissipative stabilization condition for System (7) with GUTRs. First, we introduce the stability and strictly dissipative conditions for the open-loop system of System (7) with fully known transition rates. Then, the stabilization condition is introduced for strictly ( Q , S , R ) - β -dissipativity with GUTRs.

3.1. Stability Analysis for the Open-Loop System with Known Transition Rates

The following lemma provides the stochastic stability condition for the open-loop condition of System (7) based on Definition 1.
Lemma 1
([43]). The MJS is stochastically stable when u ( t ) = 0 and ω ( t ) = 0 iff there exists matrix  P i > 0  ∀ i D , such that
H e ( P i A i ) + j = 1 M π i j P j < 0 .
The following lemma gives the strict ( Q , S , R ) - β -dissipativity condition for the open-loop system of (7).
Lemma 2.
The continuous-time MJS is strictly ( Q , S , R ) -β-dissipative when u ( t ) = 0 if matrix P i > 0 for all i D and a given scalar β exists, such that
H e ( P i A i ) + j = 1 M π i j P i ( ) ( ) G i T P i + S T E i H e ( S T J i ) R + β I ( ) Q ˜ E i Q ˜ J i I < 0 .
Proof. 
Based on the proof of Lemma 1, we consider a Lyapunov function, V ( t ) = x T ( t ) P ( r ( t ) ) x ( t ) = V ( x ( t ) , r ( t ) ) , where P ( r ( t ) ) > 0 . The infinitesimal operator A of V ( x ( t ) ) is then obtained as follows:
A V ( t ) = lim h 0 E [ V ( x ( t + h ) , r ( t + h ) = j ) | x ( t ) , r ( t ) = i ] V ( x ( t ) , r ( t ) = i ) h .
Using the definition of transition probability in (2), A V ( t ) is derived as follows:
A V ( t ) = lim h 0 j = 1 M π i j V ( x ( t + h ) , j ) + V ( x ( t + h ) , i ) V ( x ( t ) , i ) h = lim h 0 V ( x ( t + h ) , i ) V ( x ( t ) , i ) h + j = 1 M π i j V ( x ( t + h ) , j ) = x T ( t ) { H e ( P i A i ) + j = 1 M π i j P j } x ( t ) .
Therefore, (11) ensures that
A V ( t ) = x T ( t ) Ψ i x ( t ) = η T ( t ) Ψ ^ i η ( t ) < 0 ,
where
Ψ i = H e ( P i A i ) + j = 1 M π i j P j , η ( t ) = x ( t ) ω ( t ) T , Ψ ^ i = H e ( P ^ i A ^ i ) + j = 1 M π i j P ^ j , A ^ i = A i G i 0 0 , P ^ i = P i 0 0 0 .
From (9) and (14), it follows that
A V ( t ) R ( t ) + β ω T ( t ) ω ( t ) = η T ( t ) Ψ ^ i E i T Q E i ( ) J i T Q E i + S T E i J i T Q J i + H e ( S T J i ) + R + β I η ( t ) = η T ( t ) Ψ ^ i 0 ( ) S T E i + H e ( S T J i ) + R + β I + ( Q ˜ E i ) T ( Q ˜ J i ) T Q ˜ E i Q ˜ J i η ( t ) .
Applying the Schur complement to (12), we obtain the following condition:
Ψ ^ i 0 ( ) S T E i + H e ( S T J i ) + R + β I + ( Q ˜ E i ) T ( Q ˜ J i ) T Q ˜ E i Q ˜ J i < 0 .
Accordingly, if condition (12) is satisfied, then
E [ A V ( t ) R ( t ) + β ω T ( t ) ω ( t ) ] < 0 .
By integral transformation, (16) leads to
E 0 T A V ( t ) d t 0 T E [ R ( t ) ] d t + 0 T β ω T ( t ) ω ( t ) d t < 0 .
By Dynkin’s formula [44], the above inequality is rewritten as
E V ( T ) V ( 0 ) 0 T E [ R ( t ) ] d t + 0 T β ω T ( t ) ω ( t ) d t < 0 .
When x ( 0 ) = 0 , we have
0 T β ω T ( t ) ω ( t ) d t 0 T E [ R ( t ) ] d t < E V ( T ) < 0 .
Therefore, Condition (10) is satisfied by (19), which means that the open-loop system of (7) is strictly ( Q , S , R ) - β -dissipative based on Definition 2. □

3.2. Controller Synthesis with GUTRs

Let us consider the following mode-dependent controller:
u ( t ) = K ( r t ) x ( t ) ,
where K ( r t ) R n × m denotes the mode-dependent control gain. The proposed controller is designed to ensure stability in systems modeled as continuous-time MJSs even in the presence of uncertain transition rates. It also minimizes the impact of external disturbances on the output. Subsequently, the closed-loop system in (7) with (20) is given as follows:
x ˙ ( t ) = A i c x ( t ) + G i ω ( t ) , z ( t ) = E i c x ( t ) + J i ω ( t ) ,
where A i c = A i + B i K i and E i c = E i + F i K i .
The following theorem provides the stabilization condition for strictly ( Q , S , R ) - β -dissipativity, and the condition is formulated in the form of LMIs.
Theorem 1.
For a given positive scalar β and i D , if matrices P ¯ i > 0 , S ¯ i > 0 and U ¯ i j > 0 , and Λ i j exist such that
Λ i j + Λ i j T > 0 , j D i
P ¯ i S ¯ i > 0 , j D ˜ i , i = j
S ¯ i ( ) P ¯ i P ¯ j > 0 , j D ˜ i , i j
S ¯ i + U ¯ i j ( ) P ¯ i P ¯ j > 0 , j D i
M i c + ϵ i π i i m a x P ¯ i ( ) N i P ¯ < 0 ,
M ˜ i c ( ) N i E P ¯ < 0 ,
where
M i c = H e ( A i P ¯ i + B i K ¯ i ) j D i π i j m a x S ¯ i + j D i 2 Δ i j ( U ¯ i j + H e ( Λ i ) ) , K ¯ i = K i P ¯ i , N i = π i κ 1 m a x P ¯ i π i κ L m a x P ¯ i T , P ¯ = diag P ¯ κ 1 , , P ¯ κ L , M ˜ i c = ( 1 , 1 ) c ( ) ( ) G i T S T ( E i P ¯ i + F i K ¯ i ) H e ( S T J i ) R + β I ( ) Q ˜ ( E i P ¯ i + F i K ¯ i ) Q ˜ J i I , ( 1 , 1 ) c = H e ( A i P ¯ i + B i K ¯ i ) + j D i 2 Δ i j U ¯ i j j D i π i j m a x S ¯ i + ϵ π i i m a x P ¯ i , ϵ i = 0 if   i D i 1 if   i D i , I = I 0 0 R n × ( n + n ω + n z ) ,
then the closed-loop system is stochastically stable and strictly ( Q , S , R ) -β-dissipative. Furthermore, the proposed controller is obtained as u ( t ) = K i x ( t ) , where K i = K ¯ i P ¯ i 1 .
Proof. 
First, we provide the proof of the stochastic stabilization conditions. From the closed-loop system in (21) and Lemma 1, we obtain the following condition:
H e ( P i A i c ) + j = 1 M π i j P j < 0 .
Using the property of the transition rate and matrix S i > 0 satisfying j = 1 M π i j S i = 0 , the following condition is derived:
H e ( P i A i c ) + j D i π i j P j + j D ˜ i π i j P j + j = 1 M π i j S i = H e ( P i A i c ) + j D i π i j T i j + j D ˜ i π i j T i j < 0 ,
where T i j = P j S i .
For i , j D , if the following inequality holds:
T i j > 0 if   i = j ,
T i j < 0 if   i j ,
then Condition (29) holds as
H e ( P i A i c ) + j D i π i j T i j < 0 .
Based on the definition of the GUTR in (4), Condition (32) can be rewritten as
H e ( P i A i c ) + j D i ( π ˜ i j Δ i j ) T i j + j D i ( δ π i j + Δ i j ) T i j < 0 .
Using only the known information on the transition rate, we adopt the upper bound of the second and last terms on the left-hand side of (33). It thus follows that
j D i ( π ˜ i j Δ i j ) T i j j D i π i j m a x T i j ,
j D i ( δ π i j + Δ i j ) T i j j D i 2 Δ i j T i j j D i 2 Δ i j U i j ,
where U i j > 0 and
T i j U i j < 0 .
Then, we can obtain the sufficient condition of (33) as follows:
H e ( P i A i c ) + j D i π i j m a x T i j + j D i 2 Δ i j U i j < 0 .
Multiplying both sides of the above inequality by P i 1 gives
H e ( A i c P ¯ i ) + j D i π i j m a x T ¯ i j + j D i 2 Δ i j U ¯ i j < 0 ,
where P ¯ i = P i 1 , T ¯ i j = P ¯ i P j P ¯ i S ¯ i , S ¯ i = P ¯ i S i P ¯ i and U ¯ i j = P ¯ i U i j P ¯ i .
Next, due to (22),
j D i ( π i j m a x π i j m i n ) H e ( Λ i j ) 0 ,
which is a weighting method with slack variables Λ i j that can reduce the conservatism of (38).
Using the S -procedure, (38), subject to (39), is formulated in terms of
M i c + ϵ π i i m a x P ¯ i + j D i , i j π i j m a x P ¯ i P j P ¯ i < 0 .
Then, Condition (40) is transformed into
M i c + ϵ π i i m a x P ¯ i N i T ( P ) N i < 0 ,
where P = diag P κ 1 , , P κ L .
Using the Schur complement, it can be demonstrated that (41) implies (26). From the above proof, we can obtain the stochastic stabilization condition of System (21).
Second, for the proof of the strictly ( Q , S , R ) - β -dissipative condition using Lemma 2, we can obtain the sufficient condition of (12) for the closed-loop system in (21):
H e ( P i A i c ) + j D k π i j m a x T i j + j D k 2 Δ i j U i j ( ) ( ) G i T P i + S T E i c H e ( S T J i ) R + β I ( ) Q ˜ E i c Q ˜ J i I < 0 ,
because H e ( P i A i c ) + j = 1 M π i j P i < H e ( P i A i c ) + j D k π i j m a x T i j + j D k 2 Δ i j U i j , as shown in (34) and (35).
Multiplying both sides of (42) with diag P ¯ i , I , I yields
M ˜ i c ( N i I ) T ( P ) ( N i I ) < 0 .
Then, using the Schur complement, it can be shown that (43) implies (27). Furthermore, from Condition (30), the LMI condition in (23) can be obtained by
P ¯ i ( P i S i ) P ¯ i < 0 .
The LMI conditions in (24) and (25) can be acquired by
P ¯ i ( P j S i ) P ¯ i > 0 ,
P ¯ i ( P j S i U i j ) P ¯ i < 0 ,
and by using the Schur complement from Conditions (31) and (36), respectively. Therefore, the closed-loop system in (21) is strictly ( Q , S , R ) - β -dissipative according to Definition 2. □
Remark 1.
The Conditions (30) and (31) maintain the stabilization condition’s inequality while removing the unknown transition rates from the condition. This approach allows for a more generalized stabilization criterion that handles uncertainties in transition rates without compromising the condition’s integrity. By employing the inequalities, we effectively decouple the stabilization condition from the specific values of the transition rates, thereby enhancing the applicability of our findings to systems with partially or completely unknown transition dynamics.
In Theorem 1, the following optimization problem provides the optimal dissipative performance bound β :
min   β s . t .   ( 22 ) ( 27 ) .
Moreover, Theorem 1 can be extended to achieve H and passivity performance as in the following cases:
  • H performance: Q ˜ = I , S = 0 , and R = γ I + β I ,
  • Passivity performance: Q = 0 , S = I , and R = 2 β I .
Remark 2.
Note that the proposed theorem is based on the LMI approach. To solve the optimization problem based on this theorem, we used the Robust Control Toolbox in MATLAB 2022. Therefore, all the computations to solve the optimization problem are off-line, which can be solved using Toolbox. When the LMIs have a solution, the controller gains and optimal dissipative performance bounds are obtained.

4. Examples

In this section, numerical and practical examples are presented to verify the effectiveness of the proposed approach.

4.1. Example 1

Consider the following numerical example, as used in [22]:
A 1 = 0.35 7.30 1.48 0.81 ,   A 2 = 0.89 3.11 1.48 0.21 , A 3 = 0.11 0.85 2.31 0.10 ,   A 4 = 0.17 1.48 1.59 0.27 , B 1 = 0.57 1.23 ,   B 2 = 0.78 0.49 ,   B 3 = 1.34 0.39 ,   B 4 = 0.38 1.07 , G 1 = 0.5 0.1 ,   G 2 = 0.15 0.0 ,   G 3 = 0.0 0.4 ,   G 4 = 0.2 0.3 , E 1 = 0.0 0.1 ,   E 2 = 0.1 0.0 ,   E 3 = 0.0 0.1 ,   E 4 = 0.1 0.0 , F 1 = F 2 = F 3 = F 4 = 0 ,   J 1 = J 2 = J 3 = J 4 = 0 , Q = 1 ,   S = 0.1 ,   R = 1 .
The transition rate matrix Π is:
Π = [ 1.5 , 1.2 ] [ 0.1 , 0.3 ] × × × × [ 0.2 , 0.4 ] [ 0.2 , 0.4 ] [ 0.5 , 0.7 ] × [ 1.6 , 1.4 ] × [ 0.3 , 0.5 ] × × × .
From the above transition matrix, we can obtain the following sets for the measurability of π i j :
D 1 = { 1 , 2 } , D ˜ 1 = { 3 , 4 } , D 2 = { 3 , 4 } , D ˜ 2 = { 1 , 2 } , D 3 = { 1 , 3 } , D ˜ 3 = { 2 , 4 } , D 4 = { 1 } , D ˜ 4 = { 2 , 3 , 4 } .
Based on the above system parameters, Figure 1a shows the state trajectories for this example, which means that this system is in an unstable open-loop condition with u ( t ) = 0 .
By solving the proposed conditions in Theorem 1, we can obtain the optimal dissipative performance, β = 0.9932 , and the proposed controller gains are
K 1 = 5.8609 10.690 ,   K 2 = 7.5336 4.0370 , K 3 = 2.2120 4.1430 ,   K 4 = 3.2756 4.2008 .
Based on these gains, Figure 1b shows the state trajectories of the closed-loop system and the mode evolution with x ( 0 ) = 0.4 , 1.2 T and ω ( t ) = 0 . Figure 2 presents the state trajectories with the mode evolution and control input under x ( 0 ) = [ 0 ,   0 ] T and ω ( t ) = e 0.2 t . From these figures, the state trajectories converge to zero as the time increases. This verifies that the proposed method guarantees the strict ( Q , S , R ) - β -dissipativity and stochastic stability of the MJS with external disturbances and GUTRs.

4.2. Example 2

Consider the following mass-spring-damper mechanical system [45]:
M y ¨ ( t ) + D y ˙ ( t ) + V ( t ) y ( t ) = ( 1 + c y ˙ 3 ( t ) ) u ( t ) + ω ( t ) ,
where y ( t ) is the position of the mass, u ( t ) is the input force, ω ( t ) is the external disturbance, M is the mass, and D is the viscous damping. Here, V ( t ) = V ( r t ) is the time-varying stiffness, which is defined as
V ( r t ) = 0.5 if   r t = 1 1.81 if   r t = 2 .
Here, we assume that M = 1 , D = 1 , c = 0 , x ( t ) = y ˙ ( t ) y ( t ) T , and z ( t ) = y ( t ) u ( t ) T . Using the above parameters, System (49) can be constructed as the following MJS:
x ˙ ( t ) = A ( r ( t ) ) x ( t ) + B ( r ( t ) ) u ( t ) + G ( r ( t ) ) ω ( t ) , z ( t ) = E ( r ( t ) ) x ( t ) + F ( r ( t ) ) u ( t ) + J ( r ( t ) ) ω ( t ) ,
where
A 1 = 1 0.5 1 0 , A 2 = 1 1.81 1 0 , B 1 = 1 0 , B 2 = 1 0 , G 1 = G 2 = 1 0 , E 1 = E 2 = 0 1 0 0 , F 1 = F 2 = 0 1 , J 1 = J 2 = J 3 = J 4 = 0 .
Table 1 lists the corresponding transition matrices for different transition rates. Here, in Cases 2 and 3, the transition matrices contain unknown transition rates for each mode, representing the asynchrony between each mode in (49). Table 2 lists the optimal performance values of the different transition matrices in Table 1. The performance values are obtained using the following conditions:
  • Dissipativity performance: Q = 1 0 0 1 , S = 0.1 0.1 , R = 1 ,
  • H performance: Q = 1 0 0 1 , S = 0 , R = ( γ + β ) 1 0 0 1 .
Table 2 demonstrates that these performance values deteriorate with the degree of asynchronous intensification in each case. Specifically, for Case 3, the following control gains can be obtained by solving the optimization problem in (47) for strictly ( Q , S , R ) - β -dissipativity:
K 1 = 1.8518 1.4186 ,   K 2 = 2.0079 1.5633 .
Based on the proposed controller employing the above gains, we obtained the state trajectories and mode evolution under x ( 0 ) = [ 1 ,   0.5 ] and ω ( t ) = e 0.3 t sin ( t ) , as shown in Figure 3a. Figure 3b represents the control input. Thus, Figure 3 shows that the controller stochastically stabilizes the MJS with external disturbances and GUTRs.
Furthermore, Figure 4 shows the energy supply rate R ( t ) and external disturbance ω ( t ) . From Figure 4, the dissipativity performance value can be obtained by 0 30 E R ( z ( t ) , ω ( t ) ) d t 0 30 ω T ( t ) ω ( t ) d t = 0.3631. Therefore, (49) satisfies the strict ( Q , S , R ) - β -dissipativity because the calculated performance value is larger than the performance bound β = 0.1379 .
Table 1. Transition matrix Π .
Table 1. Transition matrix Π .
Case 1Case 2Case 3
3 3 4 4 3 3 [ 3 , 5 ] × × × [ 3 , 5 ] ×
Table 2. Comparison of the optimal β with different transition rates.
Table 2. Comparison of the optimal β with different transition rates.
PerformanceCase 1Case 2Case 3
Dissipativity ( β )0.52770.43400.1379
H ( γ )0.47220.56600.8620

5. Conclusions

This study addressed the strictly dissipative control problem of continuous-time MJSs with external disturbances and GUTRs. The stabilization condition was derived with the mode-dependent Lyapunov function, formulated as an LMI, to guarantee stochastic stability and strict dissipativity. Furthermore, to reduce the conservatism of the derived conditions, we introduced an appropriate weighting method related to the bounds of the transition rate with slack variables. Finally, the effectiveness of the proposed approach was verified using two examples.

Author Contributions

Conceptualization, B.P.; methodology, W.L. and B.P.; validation, W.L. and B.P.; writing—original draft preparation, W.L., J.S. and B.P.; writing—review and editing, W.L., J.S. and B.P.; visualization, W.L. and B.P.; supervision, B.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF), funded by the Ministry of Education (NRF-2021R1I1A3060657).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Elliott, R.J.; Aggoun, L.; Moore, J.B. Hidden Markov Models: Estimation and Control; Springer Science & Business Media: Berlin/Heidelberg, Germany, 2008; Volume 29. [Google Scholar]
  2. Shi, P.; Li, F. A survey on Markovian jump systems: Modeling and design. Int. J. Control. Autom. Syst. 2015, 13, 1–16. [Google Scholar] [CrossRef]
  3. Anbazhagan, N.; Joshi, G.P.; Suganya, R.; Amutha, S.; Vinitha, V.; Shrestha, B. Queueing-Inventory System for Two Commodities with Optional Demands of Customers and MAP Arrivals. Mathematics 2022, 10, 1801. [Google Scholar] [CrossRef]
  4. Dudin, A.; Dudina, O.; Dudin, S.; Samouylov, K. Analysis of Single-Server Multi-Class Queue with Unreliable Service, Batch Correlated Arrivals, Customers Impatience, and Dynamical Change of Priorities. Mathematics 2021, 9, 1257. [Google Scholar] [CrossRef]
  5. Barron, Y. A stochastic card balance management problem with continuous and batch-type bilateral transactions. Oper. Res. Perspect. 2023, 10, 100274. [Google Scholar] [CrossRef]
  6. Barron, Y. Integrating Replenishment Policy and Maintenance Services in a Stochastic Inventory System with Bilateral Movements. Mathematics 2023, 11, 864. [Google Scholar] [CrossRef]
  7. Costa, O.L.V.; Fragoso, M.D. Stability Results for Discrete-Time Linear Systems with Markovian Jumping Parameters. J. Math. Anal. Appl. 1993, 179, 154–178. [Google Scholar] [CrossRef]
  8. Sworder, D. Feedback control of a class of linear systems with jump parameters. IEEE Trans. Autom. Control 1969, 14, 9–14. [Google Scholar] [CrossRef]
  9. Ji, Y.; Chizeck, H. Controllability, stabilizability, and continuous-time Markovian jump linear quadratic control. IEEE Trans. Autom. Control 1990, 35, 777–788. [Google Scholar] [CrossRef]
  10. Feng, X.; Loparo, K. Stability of linear Markovian jump systems. In Proceedings of the 29th IEEE Conference on Decision and Control, Honolulu, HI, USA, 5–7 December 1990; Volume 3, pp. 1408–1413. [Google Scholar] [CrossRef]
  11. Zhang, L.; Boukas, E.K. Mode-dependent H filtering for discrete-time Markovian jump linear systems with partly unknown transition probabilities. Automatica 2009, 45, 1462–1467. [Google Scholar] [CrossRef]
  12. Park, C.E.; Kwon, N.K.; Park, P. Optimal H filtering for singular Markovian jump systems. Syst. Control Lett. 2018, 118, 22–28. [Google Scholar] [CrossRef]
  13. Park, C.E.; Kwon, N.K.; Park, I.S.; Park, P. H filtering for singular Markovian jump systems with partly unknown transition rates. Automatica 2019, 109, 108528. [Google Scholar] [CrossRef]
  14. Ugrinovskii, V.; Pota, H.R. Decentralized control of power systems via robust control of uncertain Markov jump parameter systems. Int. J. Control 2005, 78, 662–677. [Google Scholar] [CrossRef]
  15. Li, L.; Ugrinovskii, V.A.; Orsi, R. Decentralized robust control of uncertain Markov jump parameter systems via output feedback. Automatica 2007, 43, 1932–1944. [Google Scholar] [CrossRef]
  16. Kazemy, A.; Hajatipour, M. Event-triggered load frequency control of Markovian jump interconnected power systems under denial-of-service attacks. Int. J. Electr. Power Energy Syst. 2021, 133, 107250. [Google Scholar] [CrossRef]
  17. Cogley, T.W. Optimal monetary policy under uncertainty: A Markov jump-linear-quadratic approach-Commentary. Fed. Reserve Bank St. Louis Rev. 2008, 90, 295–300. [Google Scholar]
  18. Blair, W., Jr.; Sworder, D. Feedback control of a class of linear discrete systems with jump parameters and quadratic cost criteria. Int. J. Control 1975, 21, 833–841. [Google Scholar] [CrossRef]
  19. Breuer, L. A quintuple law for Markov additive processes with phase-type jumps. J. Appl. Probab. 2010, 47, 441–458. [Google Scholar] [CrossRef]
  20. Chakravarthy, S.R.; Rao, B.M. Queuing-Inventory Models with MAP Demands and Random Replenishment Opportunities. Mathematics 2021, 9, 1092. [Google Scholar] [CrossRef]
  21. Martinelli, F. Optimality of a Two-Threshold Feedback Control for a Manufacturing System with a Production Dependent Failure Rate. IEEE Trans. Autom. Control 2007, 52, 1937–1942. [Google Scholar] [CrossRef]
  22. Shin, J.; Park, B.Y. H Control of Markovian Jump Systems with Incomplete Knowledge of Transition Probabilities. Int. J. Control. Autom. Syst. 2019, 17, 2474–2481. [Google Scholar] [CrossRef]
  23. Wang, B.; Zhu, Q. Stability analysis of discrete-time semi-Markov jump linear systems with partly unknown semi-Markov kernel. Syst. Control Lett. 2020, 140, 104688. [Google Scholar] [CrossRef]
  24. Li, S.; Xiang, Z.; Lin, H.; Karimi, H.R. State estimation on positive Markovian jump systems with time-varying delay and uncertain transition probabilities. Inf. Sci. 2016, 369, 251–266. [Google Scholar] [CrossRef]
  25. Shi, P.; Boukas, E.K. H Control for Markovian Jumping Linear Systems with Parametric Uncertainty. J. Optim. Theory Appl. 1997, 95, 75–99. [Google Scholar] [CrossRef]
  26. Xiong, J.; Lam, J. Robust H2 control of Markovian jump systems with uncertain switching probabilities. Int. J. Syst. Sci. 2009, 40, 255–265. [Google Scholar] [CrossRef]
  27. Zhang, L.; Boukas, E.K.; Lam, J. Analysis and Synthesis of Markov Jump Linear Systems With Time-Varying Delays and Partially Known Transition Probabilities. IEEE Trans. Autom. Control 2008, 53, 2458–2464. [Google Scholar] [CrossRef]
  28. Guo, Y.; Wang, Z. Stability of Markovian jump systems with generally uncertain transition rates. J. Frankl. Inst. 2013, 350, 2826–2836. [Google Scholar] [CrossRef]
  29. Li, X.; Zhang, W.; Lu, D. Stability and stabilization analysis of Markovian jump systems with generally bounded transition probabilities. J. Frankl. Inst. 2020, 357, 8416–8434. [Google Scholar] [CrossRef]
  30. Lee, W.I.; Park, B.Y. Stabilization of Markovian Jump Systems With Quantized Input and Generally Uncertain Transition Rates. IEEE Access 2021, 9, 83499–83506. [Google Scholar] [CrossRef]
  31. Willems, J.C. Dissipative dynamical systems part I: General theory. Arch. Ration. Mech. Anal. 1972, 45, 321–351. [Google Scholar] [CrossRef]
  32. Hill, D.J.; Moylan, P.J. Dissipative Dynamical Systems: Basic Input-Output and State Properties. J. Frankl. Inst. 1980, 309, 327–357. [Google Scholar] [CrossRef]
  33. Pakshin, P.V. Dissipativity of diffusion Itô processes with Markovain switching and problems of robust stabilization. Autom. Remote Control 2007, 68, 1502–1518. [Google Scholar] [CrossRef]
  34. Pakshin, P.V. Exponential dissipativeness of the random-structure diffusion processes and problems of robust stabilization. Autom. Remote Control 2007, 68, 1852–1870. [Google Scholar] [CrossRef]
  35. Willems, J.C. Dissipative Dynamical Systems. Eur. J. Control 2007, 13, 134–151. [Google Scholar] [CrossRef]
  36. Kim, S.H. Dissipative control of Markovian jump fuzzy systems under nonhomogeneity and asynchronism. Nonlinear Dyn. 2019, 97, 629–646. [Google Scholar] [CrossRef]
  37. Zhao, J.; Hill, D.J. Dissipativity Theory for Switched Systems. IEEE Trans. Autom. Control 2008, 53, 941–953. [Google Scholar] [CrossRef]
  38. Dong, S.; Wu, Z.G.; Su, H.; Shi, P.; Karimi, H.R. Asynchronous Control of Continuous-Time Nonlinear Markov Jump Systems Subject to Strict Dissipativity. IEEE Trans. Autom. Control 2019, 64, 1250–1256. [Google Scholar] [CrossRef]
  39. Tian, Y.; Wang, Z. Dissipative filtering for singular Markovian jump systems with generally hybrid transition rates. Appl. Math. Comput. 2021, 411, 126492. [Google Scholar] [CrossRef]
  40. Nguyen, N.H.A.; Kim, S.H. Asynchronous dissipative control design for semi-Markovian jump systems with uncertain probability distribution functions of sojourn-time. Appl. Math. Comput. 2021, 397, 125921. [Google Scholar] [CrossRef]
  41. Xie, S.; Xie, L.; De Souza, C.E. Robust dissipative control for linear systems with dissipative uncertainty. Int. J. Control 1998, 70, 169–191. [Google Scholar] [CrossRef]
  42. Xie, S.; Xie, L. Robust dissipative control for linear systems with dissipative uncertainty and nonlinear perturbation. Syst. Control Lett. 1997, 29, 255–268. [Google Scholar] [CrossRef]
  43. De Farias, D.P.; Geromel, J.C.; Do Val, J.B.; Costa, O.L. Output feedback control of Markov jump linear systems in continuous-time. IEEE Trans. Autom. Control 2000, 45, 944–949. [Google Scholar] [CrossRef]
  44. Oksendal, B. Stochastic Differential Equations: An Introduction with Applications; Springer Science & Business Media: Berlin/Heidelberg, Germany, 2013. [Google Scholar]
  45. Wu, H.N. Reliable Robust H Fuzzy Control for Uncertain Nonlinear Systems With Markovian Jumping Actuator Faults. J. Dyn. Syst. Meas. Control 2007, 129, 252–261. [Google Scholar] [CrossRef]
Figure 1. State trajectories for the (a) open-loop and (b) closed-loop systems under x ( 0 ) = 0.4 , 1.2 T and ω ( t ) = 0 .
Figure 1. State trajectories for the (a) open-loop and (b) closed-loop systems under x ( 0 ) = 0.4 , 1.2 T and ω ( t ) = 0 .
Mathematics 12 00639 g001
Figure 2. (a) State trajectories and (b) input trajectories for the closed-loop system under x ( 0 ) = 0 , 0 T and ω ( t ) = e 0.2 t .
Figure 2. (a) State trajectories and (b) input trajectories for the closed-loop system under x ( 0 ) = 0 , 0 T and ω ( t ) = e 0.2 t .
Mathematics 12 00639 g002
Figure 3. (a) State trajectories and (b) input trajectories under x ( 0 ) = 1 , 0.5 T and ω ( t ) = e 0.3 t sin ( t ) .
Figure 3. (a) State trajectories and (b) input trajectories under x ( 0 ) = 1 , 0.5 T and ω ( t ) = e 0.3 t sin ( t ) .
Mathematics 12 00639 g003
Figure 4. The comparison of the energy supply rate R ( t ) and ω ( t ) for x ( 0 ) = 0 .
Figure 4. The comparison of the energy supply rate R ( t ) and ω ( t ) for x ( 0 ) = 0 .
Mathematics 12 00639 g004
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Lee, W.; Shin, J.; Park, B. The Strictly Dissipative Condition of Continuous-Time Markovian Jump Systems with Uncertain Transition Rates. Mathematics 2024, 12, 639. https://doi.org/10.3390/math12050639

AMA Style

Lee W, Shin J, Park B. The Strictly Dissipative Condition of Continuous-Time Markovian Jump Systems with Uncertain Transition Rates. Mathematics. 2024; 12(5):639. https://doi.org/10.3390/math12050639

Chicago/Turabian Style

Lee, WonIl, JaeWook Shin, and BumYong Park. 2024. "The Strictly Dissipative Condition of Continuous-Time Markovian Jump Systems with Uncertain Transition Rates" Mathematics 12, no. 5: 639. https://doi.org/10.3390/math12050639

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop