Next Article in Journal
Zoology of Atlas-Groups: Dessins D’enfants, Finite Geometries and Quantum Commutation
Previous Article in Journal
Data Clustering with Quantum Mechanics
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Logical Entropy of Dynamical Systems—A General Model

1
Department of Mathematics, Zahedan Branch, Islamic Azad University, +98-9816883673 Zahedan, Iran
2
Department of Mathematics, Sirjan Branch, Islamic Azad University, 7815778989 Sirjan, Iran
3
Department of Mathematics, Faculty of Natural Sciences, Constantine the Philosopher University in Nitra, A. Hlinku 1, SK-949 01 Nitra, Slovakia
*
Author to whom correspondence should be addressed.
Mathematics 2017, 5(1), 4; https://doi.org/10.3390/math5010004
Submission received: 11 November 2016 / Revised: 23 December 2016 / Accepted: 27 December 2016 / Published: 6 January 2017

Abstract

:
In the paper by Riečan and Markechová (Fuzzy Sets Syst. 96, 1998), some fuzzy modifications of Shannon’s and Kolmogorov-Sinai’s entropy were studied and the general scheme involving the presented models was introduced. Our aim in this contribution is to provide analogies of these results for the case of the logical entropy. We define the logical entropy and logical mutual information of finite partitions on the appropriate algebraic structure and prove basic properties of these measures. It is shown that, as a special case, we obtain the logical entropy of fuzzy partitions studied by Markechová and Riečan (Entropy 18, 2016). Finally, using the suggested concept of entropy of partitions we define the logical entropy of a dynamical system and prove that it is the same for two dynamical systems that are isomorphic.

1. Introduction

The study of the concept of entropy is very important in contemporary sciences. Entropy has been applied in information theory, physics, computer sciences, statistics, chemistry, biology, sociology, general systems theory and many other fields. The classical approach in information theory is based on Shannon’s entropy [1,2]. In connection with the issue of the isomorphism of dynamical systems, using Shannon’s entropy, Kolmogorov and Sinai have defined the entropy of dynamical systems [3,4,5]. Thus, they developed a method for distinguishing non-isomorphic dynamical systems by means of which they proved the existence of non-isomorphic Bernoulli shifts. Some fuzzy generalizations of Shannon’s and Kolmogorov-Sinai’s entropy were introduced by Riečan [6,7,8,9] (see also [10]) and Markechová [11,12,13,14]. It is known that there are many possibilities for defining operations with fuzzy sets; an overview can be found in [15]. While the model of Markechová was based on the Zadeh connectives, in the model studied by Riečan, the Lukasiewicz connectives were used to define the fuzzy set operations. In [16] Riečan and Markechová introduced a general algebraic theory involving both models as special cases.
In [17,18,19] the authors deal with studying the concept of logical entropy. If P = ( p 1 , , p n ) n is a probability distribution, then the logical entropy of P is defined as the number h ( P ) = i = 1 n p i ( 1 p i ) . More details about the concept of logical entropy can be found, e.g., in [20], where the author deals, inter alia, with historical aspects of the logical entropy formula h ( P ) and investigates the relationship between the logical entropy and Shannon’s entropy. In the cited paper, the notions of logical conditional entropy, logical mutual information, logical cross entropy and logical divergence and their properties were also studied. In [21] Ebrahimzadeh defined and studied the notions of logical entropy of partitions and logical entropy of dynamical systems in quantum logics and in [22] the author introduced the notion of conditional logical entropy of dynamical systems on quantum logics. In the recently published paper [23], Markechová and Riečan deal with the study of logical entropy of fuzzy partitions and fuzzy dynamical systems.
In this paper, we provide analogies of the results of Riečan and Markechová given in [16] for the case of the logical entropy. We define the logical entropy and logical mutual information of finite partitions on an appropriate algebraic structure and prove basic properties of these measures. As a special case we obtain the logical entropy of fuzzy partitions introduced in [23]. It is noted that some investigations concerning entropy of dynamical systems and related notions in the above setup were conducted in [24,25,26,27,28,29,30,31,32,33,34,35,36,37].
The paper is organized as follows. In the next section, we give the basic definitions and some already known results used in this paper. In Section 3, the logical entropy, conditional logical entropy and logical mutual information of finite partitions on an appropriate algebraic structure are defined and basic properties of these measures are proved. In Section 4, we define the logical entropy of a dynamical system using the suggested concept of logical entropy of finite partitions. Finally, it is shown that the logical entropy of dynamical systems is invariant under isomorphisms. Our results are summarized in the final section.

2. Basic Definitions and Facts

As in [16] we shall consider the algebraic structure ( F , , , 1 F ) , where F is a non-empty partially ordered set, is a partial binary operation on F , is a binary operation on F , 1 F is a fixed element of F , and two mappings m : F [ 0 , 1 ] and s : F F , where the following conditions are satisfied:
(F1)
, are m - commutative, i.e., m ( f g ) = m ( g f ) , for any f , g F , if f g exists, then g f exists, too, and m ( f g ) = m ( g f ) ;
(F2)
, are m - associative, i.e., m ( f ( g h ) ) = m ( ( f g ) h ) , for any f , g , h F , if ( f g ) h exists, then f ( g h ) exists, too, and m ( f ( g h ) ) = m ( ( f g ) h ) ;
(F3)
, fulfil the m - distributive law, i.e., for any f , g , h F , if ( f h ) ( g h ) exists, then f g exists and m ( ( f g ) h ) = m ( ( f h ) ( g h ) ) ;
(F4)
f g f = 1 F f , for every f , g F ;
(F5)
if i = 1 n f i exists, then m ( i = 1 n f i ) = i = 1 n m ( f i ) ;
(F6)
if f , g F , f g , then m ( f ) m ( g ) ;
(F7)
if f F such that m ( f ) = m ( 1 F ) , then m ( f g ) = m ( g ) , for every g F ;
(F8)
for any f , g F , if f g exists, then s ( f ) s ( g ) exists, too, and m ( s ( f g ) ) = m ( s ( f ) s ( g ) ) ;
(F9)
s : F F is an m - preserving transformation, i.e., m ( s ( f ) ) = m ( f ) for every f F .
By a dynamical system we will understand the above described triplet ( F , m , s ) .
Some examples are presented in the following.
Example 1.
Consider a triplet ( Ω , F , m ) , where Ω is a non-empty set, F is a fuzzy σ - algebra of fuzzy subsets of Ω , i.e., F [ 0 , 1 ] Ω such that (i) 1 Ω F ; ( 1 / 2 ) Ω F ; (ii) if f F , then f = 1 Ω f F ; (iii) if f n F , n = 1 , 2 , , then n = 1 f n F , and the mapping m : F [ 0 , ) satisfies the following conditions: (iv) m ( f f ) = 1 for all f F ; (v) if { f n } n = 1 F such that f i f j (point wisely) whenever i j , then m ( n = 1 f n ) = n = 1 m ( f n ) . The above described triplet ( Ω , F , m ) is called in the terminology of Piasecki a fuzzy probability space [38]. The symbols n = 1 f n = sup n f n and n = 1 f n = inf n f n denote the fuzzy union and the fuzzy intersection of a sequence { f n } n = 1 F , respectively, in the sense of Zadeh [39]. The partial ordering relation is defined in the following way: for every f , g F , f g if and only if f ( ω ) g ( ω ) for all ω Ω . The presented σ - additive fuzzy P-measure m has all properties analogous to properties of a classical probability measure, e.g., (i) m is a non-decreasing function, i.e., if f , g F such that f g , then m ( f ) m ( g ) ; (ii) if f , g F are W-separated [40] (i.e., if f g ) , then m ( f g ) = 0 ; (iii) m ( f ) = 1 m ( f ) for every f F ; (iv) m is a dditive, i.e., if { f 1 , , f n } F such that f i f j for i j , then m ( i = 1 n f i ) = i = 1 n m ( f i ) ; (v) if g F , then m ( f g ) = m ( f ) for all f F if and only if m ( g ) = 1 . The proofs can be found in [38]. The monotonicity of fuzzy P-measure m implies that this measure transforms F into the interval [ 0 , 1 ] .
In the set F we define the operations , as follows: f g is defined whenever f g , and in this case f g = f g ; f g = f g , for every f , g F . The set F with the operations , and the mapping m satisfy all assumptions (F1)–(F7). Let us prove, e.g., (F5). Suppose that i = 1 n f i exists. Since i = 1 n f i = ( i = 1 n 1 f i ) f n , by the definition, it exists if f n + i = 1 n 1 f i 1 Ω . Hence, i = 1 n f i is defined if and only if f i 1 Ω f j ( i j ) , i.e., if { f 1 , , f n } is a system of pairwise W-separated fuzzy subsets. Since any fuzzy P-measure is additive, the equality m ( i = 1 n f i ) = i = 1 n m ( f i ) holds. Now, let τ : F F is an m preserving σ - homomorphism, i.e., τ ( f ) = ( τ ( f ) ) , τ ( n = 1 f n ) = n = 1 τ ( f n ) and m ( τ ( f ) ) = m ( f ) , for every f F and any sequence { f n } n = 1 F . Evidently, the mapping τ : F F fulfils the conditions (F8) and (F9). Therefore the system ( F , m , τ ) is a dynamical system within the meaning of our definition.
Remark 1.
In the paper by Markechová [11] the Shannon entropy of fuzzy partitions in a fuzzy probability space has been defined. Recall that the notion of fuzzy partition in the given fuzzy probability space ( Ω , F , m ) has been introduced by Piasecki in [41] as follows: any finite sequence { f 1 , , f n } of pairwise W-separated fuzzy subsets from F is called a fuzzy partition if m ( i = 1 n f i ) = 1 . The concept of Shannon’s entropy of fuzzy partitions was used to define the Kolmogorov-Sinai entropy of fuzzy dynamical systems [12]. By a fuzzy dynamical system we mean a system ( Ω , F , m , τ ) , where ( Ω , F , m ) is any fuzzy probability space and τ : F F is an m - preserving σ - homomorphism. Note that a classical dynamical system ( Ω , S , P , T ) can be considered a fuzzy dynamical system ( Ω , F , m , τ ) ; it is sufficient to put F = { I A ; A S } , where I A is the indicator of a set A S , and define the mapping m : F [ 0 , 1 ] by m ( I A ) = P ( A ) , and the mapping τ : F F by the formula:
τ ( I A ) = I A T = I T 1 ( A ) ,   I A F .
The above triplet ( Ω , F , m ) is a fuzzy probability space and τ : F F is an m - preserving σ - homomorphism. The recently published paper [23] deals with studying logical entropy of fuzzy partitions in a fuzzy probability space and logical entropy of fuzzy dynamical systems.
As mentioned above, operations with fuzzy sets can be introduced in various ways. While the previous model is based on Zadeh’s connectives, in the following model the Lukasiewicz operations are used. Recall that the union of fuzzy subsets f , g of Ω is defined by Lukasiewicz as min ( f + g , 1 ) .
Example 2.
Let ( Ω , S , P ) be a classical probability space, F be the family of all S-measurable functions f : Ω [ 0 , 1 ] , m ( f ) = Ω f d P . Further, a mapping U : F F is given satisfying the following two conditions: (i) if f F , then U ( f ) F and m ( f ) = m ( U ( f ) ) ; (ii) if f , g F and f + g 1 , then U ( f + g ) = U ( f ) + U ( g ) . In the set F we define the operation as follows: f g is defined whenever f + g 1 , and in this case f g = f + g . It is obvious that i = 1 n f i exists if and only if i = 1 n f i 1 . The operation is defined as the product of functions: f g = f g . It is not difficult to verify that the set F with the operations , and the mappings m : F [ 0 , 1 ] and U : F F satisfy all assumptions (F1)–(F9). Of course, here 1 F = 1 Ω . Let us prove, e.g., that the condition (F7) holds. If f F such that m ( f ) = m ( 1 F ) , then we have m ( f ) = m ( 1 Ω ) = 1 . Since 1 = m ( 1 Ω ) = m ( f + ( 1 f ) ) = m ( f ) + m ( 1 f ) , we get:
0 = m ( 1 f ) m ( ( 1 f ) g ) = m ( g f g ) = m ( g ) m ( f g ) ,   for   every   g F ,
and therefore m ( f g ) = m ( f g ) m ( g ) . The opposite inequality is obvious. It is easy to see that a classical dynamical system ( Ω , S , P , T ) can be embedded to the presented fuzzy model; it is sufficient to put F = { I A ; A S } , and define the mapping U : F F by the formula (1).
Remark 2.
Fuzzy analogies of Shannon’s entropy and the Kolmogorov-Sinai entropy with respect to this model were introduced by Riečan in [7] (see also [10]), and independently by Dumitrescu [26,27,28]. Dumitrescu considered a more general family F of fuzzy subsets of Ω and a mapping m : F [ 0 , 1 ] characterized axiomatically. However, by the representation theorem of Butnariu and Klement [42] there exists a probability measure P such that m ( f ) = Ω f d P , hence, the Dumitrescu theory can be reduced to the case of Riečan.

3. Logical Entropy and Logical Mutual Information of Partitions in F

We shall now introduce a general algebraic theory for the case of logical entropy. We show that the proposed general theory can be applied to the two models which were described above.
Definition 1
[16]. By a partition (in F) we mean a finite collection A = { f 1 , , f n } F such that i = 1 n f i exists, and:
m ( 1 F ) = m ( i = 1 n f i ) = i = 1 n m ( f i ) .
Definition 2
[16]. If A = { f 1 , , f n } , B = { g 1 , , g p } are two partitions in F , then we define:
A B = { f i g j ; i = 1 , , n , j = 1 , , p }  if  A B ,  and  A A = A .
We say that B is a refinement of A , and write A B , if there exists a partition I ( 1 ) , I ( 2 ) , , I ( n ) of the set { 1 , 2 , , p } such that m ( f i ) = j I ( i ) m ( g j ) , for every i = 1 , 2 , , n .
Proposition 1.
If A , B are two partitions in F , then A B is a partition in F , too.
Proof. 
Let A = { f 1 , , f n } , B = { g 1 , , g p } . Since i = 1 n f i , j = 1 p g j exist, according to the assumption ( i = 1 n f i ) ( j = 1 p g j ) also exists. Using the m - distributive law we obtain that i = 1 n j = 1 p ( f i g j ) exists, too, and m ( i = 1 n j = 1 p ( f i g j ) ) = m ( ( i = 1 n f i ) ( j = 1 p g j ) ) . Following (F5) we have:
m ( i = 1 n j = 1 p ( f i g j ) ) = i = 1 n j = 1 p m ( f i g j ) .
Moreover, by (F7)
m ( ( i = 1 n f i ) ( j = 1 p g j ) )   =   m ( j = 1 p g j ) = m ( 1 F ) .  
Proposition 2.
A A B , for every partitions A , B in F .
Proof. 
Let A = { f 1 , , f n } , B = { g 1 , , g p } . A B is indexed by { ( i , j ) ; i = 1 , , n , j = 1 , 2 , , p } , therefore we put I ( i ) = { ( i , 1 ) , , ( i , p ) } , i = 1 , 2 , , n . Since m ( 1 F ) = m ( j = 1 p g j ) = j = 1 p m ( g j ) , following (F7), (F3) and (F5), for i = 1 , 2 , , n , we obtain:
m ( f i ) = m ( ( j = 1 p g j ) f i ) = m ( j = 1 p ( g j f i ) ) = j = 1 p m ( f i g j ) = ( k , j ) I ( i ) m ( f k g j ) .
However, this indicates that A A B .
Recall that in the classical case, where partitions A , B consist of indicators only, A B is the least common refinement of A and B , i.e., every set of A or B is a union of some sets of A B . In the Markechová model, fuzzy partitions are considered wherein the fuzzy partition in the given fuzzy probability space ( Ω , F , m ) is defined as any finite sequence { f 1 , , f n } of pairwise W-separated fuzzy subsets from F such that m ( i = 1 n f i ) = 1 . Recall that in Example 1 i = 1 n f i is defined if and only if { f 1 , , f n } is a system of pairwise W-separated fuzzy subsets and in this case i = 1 n f i = i = 1 n f i . Therefore, the notion of a fuzzy partition in a fuzzy probability space coincides with the general notion of a partition from Definition 1. If A = { f 1 , , f n } , B = { g 1 , , g p } are two fuzzy partitions in a fuzzy probability space, then A B is defined as the system A B = { f i g j ; i = 1 , , n , j = 1 , , p } , which again coincides with the general notion from Definition 2 as well as the notion of a refinement. A fuzzy partition B is a refinement of A if for every fuzzy set g B there exists f A such that g f . Therefore, the general theory can be applied to the Markechová model. On the other hand, Riečan has defined a fuzzy partition as a finite system { f 1 , , f n } of fuzzy subsets of Ω such that i = 1 n f i ( ω ) = 1 , for every ω Ω , and A B as the system { f g ; f A , g B } . The definition of relation in the Riečan model is the same as in Definition 2. Since i = 1 n f i exists if and only if i = 1 n f i 1 , and 1 = m ( 1 Ω ) = m ( i = 1 n f i ) = i = 1 n m ( f i ) , the notion of fuzzy partition in the Riečan model again coincides with the general notion from Definition 1. Evidently, the general theory can be applied to the Riečan model as well.
Definition 3.
Let A = { f 1 , , f n } be a partition in F . The logical entropy of A is defined as the number:
h l ( A ) = i = 1 n m ( f i ) ( 1 m ( f i ) ) .
Evidently, h l ( A ) 0 , and from Equation (2) it immediately follows that:
h l ( A ) = m ( 1 F ) i = 1 n ( m ( f i ) ) 2 .
Definition 4.
Let A = { f 1 , , f n } , B = { g 1 , , g p } be two partitions in F . The conditional logical entropy of A given B is defined by:
h l ( A / B ) = i = 1 n j = 1 p m ( f i g j ) ( m ( g j ) m ( f i g j ) ) .
Remark 3.
Since by (F4) and (F6) it holds m ( g j ) m ( f i g j ) , i = 1 , , n , j = 1 , , p , we see that h l ( A / B ) 0 .
In the following, some basic properties of the logical entropy are presented. At first, we will prove the assertions of the following lemma which will be useful in further considerations.
Lemma 1.
Let A = { f 1 , , f n } , B = { g 1 , , g p } and C = { h 1 , , h r } be partitions in F . Then we have:
(i) 
i = 1 n j = 1 p k = 1 r m ( f i g j h k ) m ( h k ) = i = 1 n k = 1 r m ( f i h k ) m ( h k ) ;
(ii) 
i = 1 n j = 1 p m ( f i g j ) m ( g j ) = j = 1 p ( m ( g j ) ) 2 .
Proof. 
(i)
By Definition 1, we have:
m ( j = 1 p g j ) = j = 1 p m ( g j ) = m ( 1 F ) .
Hence, by (F7), (F3) and (F5), for each i , k , we obtain:
m ( f i h k ) = m ( ( j = 1 p g j ) ( f i h k ) ) = m ( j = 1 p ( f i g j h k ) ) = j = 1 p m ( f i g j h k ) .
Therefore:
i = 1 n j = 1 p k = 1 r m ( f i g j h k ) m ( h k ) = i = 1 n k = 1 r j = 1 p m ( f i g j h k ) m ( h k ) = i = 1 n k = 1 r m ( f i h k ) m ( h k ) .
(ii)
According to (F7), (F3) and (F5) we get, for each j = 1 , 2 , , p ,
m ( g j ) = m ( ( i = 1 n f i ) g j ) = m ( i = 1 n ( f i g j ) )   =   i = 1 n m ( f i g j ) .
Hence:
i = 1 n j = 1 p m ( f i g j ) m ( g j ) = j = 1 p m ( g j ) i = 1 n m ( f i g j ) = j = 1 p ( m ( g j ) ) 2 .  
Theorem 1.
Let A , B be two partitions in F . Then:
h l ( A B )   =   h l ( B ) + h l ( A / B ) .
Proof. 
Let A = { f 1 , , f n } , B = { g 1 , , g p } . According to the previous definitions and Lemma 1 we obtain:
h l ( B ) + h l ( A / B )   =   j = 1 p m ( g j ) j = 1 p ( m ( g j ) ) 2 + i = 1 n j = 1 p m ( f i g j ) ( m ( g j ) m ( f i g j ) ) = j = 1 p m ( g j ) j = 1 p ( m ( g j ) ) 2 + i = 1 n j = 1 p m ( f i g j ) m ( g j ) i = 1 n j = 1 p ( m ( f i g j ) ) 2 = j = 1 p m ( g j ) j = 1 p ( m ( g j ) ) 2 + j = 1 p ( m ( g j ) ) 2 i = 1 n j = 1 p ( m ( f i g j ) ) 2 = m ( 1 F ) i = 1 n j = 1 p ( m ( f i g j ) ) 2 =   h l ( A B ) .  
Remark 4.
According to Definition 2 as a simple consequence of Theorem 1 we obtain that h l ( A / A ) = 0 .
Theorem 2.
Let A , B be two partitions in F . Then:
(i) 
h l ( A / B ) h l ( A ) ;
(ii) 
h l ( A B ) h l ( A ) + h l ( B ) .
Proof. 
(i)
Let A = { f 1 , , f n } , B = { g 1 , , g p } . For each i = 1 , 2 , , n , we have:
j = 1 p m ( f i g j ) ( m ( g j ) m ( f i g j ) ) j = 1 p m ( f i g j ) ( j = 1 p m ( g j ) m ( f i g j ) ) = m ( f i ) ( j = 1 p m ( g j ) m ( f i g j ) ) = m ( f i ) ( m ( 1 F ) j = 1 p m ( f i g j ) ) = m ( f i ) ( m ( 1 F ) m ( f i ) ) m ( f i ) ( 1 m ( f i ) ) .
Therefore:
h l ( A / B ) = i = 1 n j = 1 p m ( f i g j ) ( m ( g j ) m ( f i g j ) ) i = 1 n m ( f i ) ( 1 m ( f i ) ) = h l ( A ) .
(ii)
By Theorem 1 and the part (i), we get:
h l ( A B ) = h l ( B )   +   h l ( A / B ) h l ( B )   +   h l ( A ) .  
In the following two theorems, chain rules for logical entropy of partitions in F are presented.
Theorem 3.
Let A , B and C be partitions in F . Then:
h l ( A B / C )   =   h l ( A / C )   +   h l ( B / C A ) .
Proof. 
Let A = { f 1 , , f n } , B = { g 1 , , g p } and C = { h 1 , , h r } . From Definition 4 and Lemma 1 it follows that:
h l ( A B / C )   =   i = 1 n j = 1 p k = 1 r m ( f i g j h k ) ( m ( h k ) m ( f i g j h k ) ) = i = 1 n j = 1 p k = 1 r m ( f i g j h k ) m ( h k ) i = 1 n j = 1 p k = 1 r ( m ( f i g j h k ) ) 2 = i = 1 n k = 1 r m ( f i h k ) m ( h k ) i = 1 n k = 1 r ( m ( f i h k ) ) 2 + i = 1 n k = 1 r ( m ( f i h k ) ) 2 i = 1 n j = 1 p k = 1 r ( m ( f i g j h k ) ) 2 = h l ( A / C ) + i = 1 n j = 1 p k = 1 r m ( f i g j h k ) m ( f i h k ) i = 1 n j = 1 p k = 1 r ( m ( f i g j h k ) ) 2 = h l ( A / C ) + h l ( B / C A ) .
Theorem 4.
Let A 1 , A 2 , , A n and C be partitions in F . Then, for n = 2 , 3 , , the following equalities hold:
(i) 
h l ( A 1 A 2 A n ) = h l ( A 1 ) + i = 2 n h l ( A i / k = 1 i 1 A k ) ;
(ii) 
h l ( i = 1 n A i / C ) = h l ( A 1 / C ) + i = 2 n h l ( A i / ( k = 1 i 1 A k ) C ) .
Proof. 
(i)
According to Theorem 1 we have:
h l ( A 1 A 2 ) = h l ( A 1 ) + h l ( A 2 / A 1 ) .
Therefore, using Theorem 3 we get:
h l ( A 1 A 2 A 3 ) = h l ( A 1 ) + h l ( A 2 A 3 / A 1 ) = h l ( A 1 ) + h l ( A 2 / A 1 ) + h l ( A 3 / A 2 A 1 ) = h l ( A 1 ) + i = 2 3 h l ( A i / k = 1 i 1 A k ) .
Now let us suppose that the result is true for a given n N . Then:
h l ( A 1 A 2 A n A n + 1 ) = h l ( A 1 A 2 A n ) + h l ( A n + 1 / A 1 A 2 A n ) = h l ( A 1 ) + i = 2 n h l ( A i / k = 1 i 1 A k ) + h l ( A n + 1 / A 1 A 2 A n ) = h l ( A 1 ) + i = 2 n + 1 h l ( A i / k = 1 i 1 A k ) .
(ii)
For n = 2 , using Theorem 3 we obtain:
h l ( A 1 A 2 / C ) = h l ( A 1 / C ) + h l ( A 2 / A 1 C ) .
Suppose that the result is true for a given n N . Then:
h l ( A 1 A 2 A n A n + 1 / C ) = h l ( i = 1 n A i / C ) + h l ( A n + 1 / A 1 A n C ) = h l ( A 1 / C ) + i = 2 n h l ( A i / ( k = 1 i 1 A k ) C ) + h l ( A n + 1 / ( k = 1 n A k ) C ) = h l ( A 1 / C ) + i = 2 n + 1 h l ( A i / ( k = 1 i 1 A k ) C ) .  
Definition 5
[36]. Let A , B be two partitions in F . We write A B if, for each f i A and for each g j B , m ( f i g j ) = m ( g j ) or m ( f i g j ) = 0 . We write A = ˙ B if and only if A B and B A .
Theorem 5.
Let A , B be partitions in F . Then:
(i) 
A B implies h l ( A ) h l ( B ) ;
(ii) 
h l ( A ) h l ( A B ) ;
(iii) 
h l ( A B ) max ( h l ( A ) ; h l ( B ) ) ;
(iv) 
A B if and only if h l ( A / B ) = 0 ;
(v) 
A = ˙ B implies h l ( A ) = h l ( B ) .
Proof. 
Let A = { f 1 , , f n } , B = { g 1 , , g p } .
(i)
If A B , then by the assumption there exists a partition I ( 1 ) , I ( 2 ) , , I ( n ) of the set { 1 , 2 , , p } such that m ( f i ) = j I ( i ) m ( g j ) ,   i = 1 , 2 , , n . Therefore, we have:
j = 1 p ( m ( g j ) ) 2 i = 1 n ( m ( f i ) ) 2 .
Thus, by Equation (3) we get:
h l ( A ) = m ( 1 F ) i = 1 n ( m ( f i ) ) 2 m ( 1 F ) j = 1 p ( m ( g j ) ) 2 = h l ( B ) .
(ii)
Since A A B (see Proposition 2), the property is a consequence of (i).
(iii)
It immediately follows from the property (ii).
(iv)
Suppose that A B . Since, by definition, for i = 1 , 2 , , n , j = 1 , 2 , , p , m ( f i g j ) = m ( g j ) or m ( f i g j ) = 0 , we get:
h l ( A / B ) = i = 1 n j = 1 p m ( f i g j ) ( m ( g j ) m ( f i g j ) ) = 0 .
Conversely, let h l ( A / B ) = 0 , i.e., we assume that:
i = 1 n j = 1 p m ( f i g j ) ( m ( g j ) m ( f i g j ) ) = 0 .
Since, m ( f i g j ) 0 , and by (F4) and (F6) m ( g j ) m ( f i g j ) , for i = 1 , 2 , , n , j = 1 , 2 , , p , we have:
m ( f i g j ) ( m ( g j ) m ( f i g j ) ) = 0 ,  for  i = 1 , 2 , , n ,   j = 1 , 2 , , p ,
which implies
m ( f i g j ) = m ( g j )  or  m ( f i g j ) = 0 ,  for  i = 1 , 2 , , n ,   j = 1 , 2 , , p .
This means that A B .
(v)
Since A B , by the part (iii) h l ( A / B ) = 0 . So (see Theorem 1), we have:
h l ( A / B ) = h l ( A B ) h l ( B ) = 0 ,
and therefore:
h l ( A B ) = h l ( B ) .
Similarly, B A implies:
h l ( B / A ) = h l ( B A ) h l ( A ) = 0 ,
thus:
h l ( B A ) = h l ( A ) .
Since h l ( A B ) = h l ( B A ) , the proof is completed. ☐
Definition 6.
If A , B are two partitions in F , then the logical mutual information of A and B is defined by the formula:
I l ( A , B ) = h l ( A ) h l ( A / B ) .
Remark 5.
As a simple consequence of Equation (4) we have:
I l ( A , B ) = h l ( A ) + h l ( B ) h l ( A B ) .
Subsequently we see that I l ( A , B ) = I l ( B , A ) and I l ( A , A ) = h l ( A ) . From Equation (6), the property (ii) of Theorem 2, and (ii) of Theorem 5 we get that 0 I l ( A , B ) min ( h l ( A ) , h l ( B ) ) .
Definition 7.
Let A , B and C be partitions in F . Then the logical conditional mutual information of A and B given C is defined by the formula:
I l ( A , B / C ) = h l ( A / C ) h l ( A / B C ) .
Theorem 6 (Chain rules for logical mutual information).
Let A 1 , A 2 , , A n and C be partitions in F . Then, for n = 2 , 3 , , it holds:
I l ( i = 1 n A i , C ) = I l ( A 1 , C ) + i = 2 n I l ( A i , C / k = 1 i 1 A k ) .
Proof. 
By Equation (5), Theorem 4, and Equation (7), we obtain:
I l ( i = 1 n A i , C ) = h l ( i = 1 n A i ) h l ( i = 1 n A i / C ) = h l ( A 1 ) + i = 2 n h l ( A i / k = 1 i 1 A k ) h l ( A 1 / C ) i = 2 n h l ( A i / ( k = 1 i 1 A k ) C ) = I l ( A 1 , C ) + i = 2 n ( h l ( A i / k = 1 i 1 A k ) h l ( A i / ( k = 1 i 1 A k ) C ) ) = I l ( A 1 , C ) + i = 2 n I l ( A i ,   C   / k = 1 i 1 A k ) .  
Theorem 7.
If partitions A = { f 1 , , f n } , B = { g 1 , , g p } in F are independent, i.e., m ( f i g j ) = m ( f i ) m ( g j ) , for i = 1 , 2 , , n , j = 1 , 2 , , p , then:
I l ( A , B ) = h l ( A ) h l ( B ) .
Proof. 
Let A = { f 1 , , f n } , B = { g 1 , , g p } be independent partitions in F . By simple calculation we obtain:
I l ( A , B ) = h l ( A ) + h l ( B ) h l ( A B ) =   1 i = 1 n ( m ( f i ) ) 2 + 1 j = 1 p ( m ( g j ) ) 2 1 + i = 1 n j = 1 p ( m ( f i g j ) ) 2 =   1 i = 1 n ( m ( f i ) ) 2 j = 1 p ( m ( g j ) ) 2 + i = 1 n ( m ( f i ) ) 2 j = 1 p ( m ( g j ) ) 2 =   ( 1 i = 1 n ( m ( f i ) ) 2 ) ( 1 j = 1 p ( m ( g j ) ) 2 ) = h l ( A ) h l ( B ) .  
Corollary 1.
If partitions A , B in F are independent, then:
1 h l ( A B ) = ( 1 h l ( A ) ) ( 1 h l ( B ) ) .
Proof. 
By simple calculation we get:
( 1 h l ( A ) ) ( 1 h l ( B ) ) = 1 h l ( A ) h l ( B ) + h l ( A ) h l ( B ) = 1 h l ( A ) h l ( B ) + I l ( A , B ) = 1 h l ( A ) h l ( B ) + h l ( A ) + h l ( B ) h l ( A B ) = 1 h l ( A B ) .

4. Logical Entropy of Dynamical Systems

Let any dynamical system ( F , m , s ) be given. If A = { f 1 , , f n } is a partition in F , then it is easy to verify that the system s A = { s ( f 1 ) , , s ( f n ) } is a partition in F , too. Namely, i = 1 n s ( f i ) exists, since i = 1 n f i exists, and by (F8) and (F9) we have:
m ( i = 1 n s ( f i ) ) = m ( s ( i = 1 n f i ) ) = m ( i = 1 n f i ) = m ( 1 F ) = m ( i = 1 n f i ) = i = 1 n m ( f i ) = i = 1 n m ( s ( f i ) ) .
Define s 2 = s s and put s k = s s k 1 , k = 1 , 2 , , where s 0 is an identical mapping on F .
Theorem 8.
Let ( F , m , s ) be a dynamical system, A , B be partitions in F . Then the following properties are satisfied:
(i) 
A B implies s A s B ;
(ii) 
h l ( s k A ) = h l ( A ) , k = 0 , 1 , 2 , .... ;
(iii) 
if s is invertible, then h l ( s k ( A ) ) = h l ( A ) , k = 0 , 1 , 2 , .... ;
(iv) 
h l ( s k A / s k B ) = h l ( A / B ) , k = 0 , 1 , 2 , .... ;
(v) 
h l ( i = 0 n 1 s i A ) = h l ( A ) + j = 1 n 1 h l ( A / i = 1 j s i A ).
Proof. 
Let A = { f 1 , , f n } , B = { g 1 , , g p } .
(i)
Suppose A B , i.e., there exists a partition I ( 1 ) , I ( 2 ) , , I ( n ) of the set { 1 , 2 , , p } such that m ( f i ) = j I ( i ) m ( g j ) , i = 1 , 2 , , n . By (F9) we have:
m ( s ( f i ) ) = j I ( i ) m ( s ( g j ) ) , i = 1 , 2 , , n .
However, this indicates that s A s B .
(ii)
Since m ( s ( f ) ) = m ( f ) for every f F , we have m ( s k ( f i ) ) = m ( f i ) , i = 1 , 2 , , n , k = 0 , 1 , 2 , .... Hence:
h l ( s k A ) = m ( 1 F ) i = 1 n ( m ( s k ( f i ) ) ) 2 = m ( 1 F ) i = 1 n ( m ( f i ) ) 2 = h l ( A ) ,   k = 0 , 1 , 2 , ....
(iii), (iv)
The proof is analogous to the proof of (ii).
(v)
We shall prove the assertion by mathematical induction. The assertion is valid for n = 2 according to Theorem 1 and the previous part of this theorem. Assume that the assertion holds for a given n N . Since by the part (ii) we have:
h l ( i = 1 n s i A ) =   h l ( s ( i = 0 n 1 s i A ) )   =   h l ( i = 0 n 1 s i A ) ,
by Theorem 1 and the induction assumption we get:
h l ( i = 0 n s i A ) = h l ( ( i = 1 n s i A A   =   h l ( i = 1 n s i A ) + h l ( A / i = 1 n s i A ) =   h l ( i = 0 n 1 s i A ) + h l ( A / i = 1 n s i A ) =   h l ( A ) + j = 1 n 1 h l ( A / i = 1 j s i A ) + h l ( A / i = 1 n s i A ) =   h l ( A ) + j = 1 n h l ( A / i = 1 j s i A ) .
The proof is completed. ☐
The aim of this section is to provide the definition of entropy of dynamical system ( F , m , s ) . The possibility of this definition is based on Proposition 3; in order to prove it we will need the assertion of Lemma 2.
Lemma 2.
Let { a n } n = 1 be a sequence of nonnegative real numbers such that a n + m a n + a m for every n , m N . Then lim n 1 n a n exists.
Proof. 
The proof can be found in [43].
Proposition 3.
Let ( F , m , s ) be a dynamical system. Then, for every partition A in F , lim n 1 n h l ( i = 0 n 1 s i A ) exists.
Proof. 
Denote a n = h l ( i = 0 n 1 s i A ). According to subadditivity of logical entropy (Theorem 2, (ii)) and the part (ii) of Theorem 8, we get:
a n + m = h l ( i = 0 n + m 1 s i A ) h l ( i = 0 n 1 s i A ) + h l ( i = n n + m 1 s i A ) = a n + h l ( i = 0 m 1 s n + i A ) = a n + h l ( s n ( i = 0 m 1 s i A ) ) = a n + h l ( i = 0 m 1 s i A ) = a n + a m .
By the previous lemma lim n 1 n h l ( i = 0 n 1 s i A ) exists. ☐
Definition 8.
Let ( F , m , s ) be a dynamical system, A be a partition in F . The logical entropy of s with respect to A is defined by:
h l ( s , A )   =   lim n 1 n h l ( i = 0 n 1 s i A ) .
The logical entropy of a dynamical system ( F , m , s ) is defined by the formula:
h l ( s ) = sup { h l ( s , A ) ; A   is   a   partition   in   F } .
Theorem 9.
Let ( F , m , s ) be a dynamical system, A , B be partitions in F . Then the following properties are satisfied:
(i) 
h l ( s , A ) 0 ;
(ii) 
A B implies h l ( s , A ) h l ( s , B ) ;
(iii) 
h l ( s , A ) = h l ( s , i = 0 r s i A ) , r = 1 , 2 , ....
Proof. 
(i)
This property is obvious.
(ii)
The assumption A B implies the relation i = 0 n 1 s i A i = 0 n 1 s i B , n = 1 , 2 , .... Thus, according to the part (i) of Theorem 5, we have the inequality h l ( i = 0 n 1 s i A ) h l ( i = 0 n 1 s i B ) , n = 1 , 2 , .... Therefore, h l ( s , A ) h l ( s , B ) .
(iii)
By simple calculations we obtain:
h l ( s , i = 0 r s i A )   =   lim n 1 n h l ( j = 0 n 1 s j ( i = 0 r s i A ) ) = lim n r + n n 1 r + n h l ( i = 0 r + n 1 s i A ) =   lim n 1 r + n h l ( i = 0 r + n 1 s i A ) =   h l ( s , A ) .  
Definition 9.
We say that two dynamical systems ( F 1 , m 1 , s 1 ) , ( F 2 , m 2 , s 2 ) are isomorphic if there exists a bijective mapping ψ : F 1 F 2 satisfying the following conditions:
(i) 
the diagram:
F 1 s 1 F 1 ψ ψ F 2 s 2 F 2
is commutative, i.e., ψ ( s 1 ( f ) ) = s 2 ( ψ ( f ) ) , for every f F 1 ;
(ii) 
ψ ( f g ) = ψ ( f ) ψ ( g ) , for every f , g F 1 ;
(iii) 
for any f , g F 1 , f g exists if and only if ψ ( f ) ψ ( g ) exists, and in this case ψ ( f g ) = ψ ( f ) ψ ( g ) ;
(iv) 
m 1 ( 1 F 1 ) = m 2 ( 1 F 2 ) ;
(v) 
m 1 ( f ) = m 2 ( ψ ( f ) ) , for every f F 1 .
In the following theorem we show that the logical entropy of dynamical systems is invariant under any isomorphism. In order to prove it the following assertion is needed.
Lemma 3.
Let ( F 1 , m 1 , s 1 ) , ( F 2 , m 2 , s 2 ) be isomorphic dynamical systems wherein a mapping ψ : F 1 F 2 represents their isomorphism. Then, for the inverse ψ 1 : F 2 F 1 , the following properties are satisfied:
(i) 
ψ 1 ( f g ) = ψ 1 ( f ) ψ 1 ( g ) , for every f , g F 2 ;
(ii) 
for any f , g F 2 , if f g exists, then ψ 1 ( f ) ψ 1 ( g ) exists, too, and ψ 1 ( f g ) = ψ 1 ( f ) ψ 1 ( g ) ;
(iii) 
m 1 ( ψ 1 ( f ) ) = m 2 ( f ) , for every f F 2 ;
(iv) 
m 1 ( ( ψ 1 s 2 ) ( f ) ) = m 1 ( ( s 1 ψ 1 ) ( f ) ) , for every f F 2 .
Proof. 
Since ψ : F 1 F 2 is bijective, for every f , g F 2 , there exist f , g F 1 such that ψ 1 ( f ) = f , ψ 1 ( g ) = g .
(i)
We get:
ψ 1 ( f g ) = ψ 1 ( ψ ( f ) ψ ( g ) ) = ψ 1 ( ψ ( f g ) ) = f g = ψ 1 ( f ) ψ 1 ( g ) .
(ii)
Let f , g F 2 such that f g exists. Then ψ 1 ( f g ) exists because ψ is surjective. Calculate:
ψ 1 ( f g ) = ψ 1 ( ψ ( f ) ψ ( g ) ) = ψ 1 ( ψ ( f g ) ) = f g = ψ 1 ( f ) ψ 1 ( g ) .
(iii)
Let f F 2 . Then:
m 2 ( f ) = m 2 ( ψ ( f ) ) = m 1 ( f ) = m 1 ( ψ 1 ( f ) ) .
(iv)
Let f F 2 . Then we have:
m 1 ( ( ψ 1 s 2 ) ( f ) ) = m 1 ( ψ 1 ( s 2 ( f ) ) ) = m 2 ( s 2 ( f ) ) = m 2 ( f ) ,
and:
m 1 ( ( s 1 ψ 1 ) ( f ) ) = m 1 ( s 1 ( ψ 1 ( f ) ) ) = m 1 ( ψ 1 ( f ) ) = m 2 ( f ) .
Hence, the equality m 1 ( ( ψ 1 s 2 ) ( f ) ) = m 1 ( ( s 1 ψ 1 ) ( f ) ) holds. ☐
Theorem 10.
If dynamical systems ( F 1 , m 1 , s 1 ) , ( F 2 , m 2 , s 2 ) are isomorphic, then:
h l ( s 1 ) = h l ( s 2 ) .
Proof. 
Let a mapping ψ : F 1 F 2 represents an isomorphism of dynamical systems ( F 1 , m 1 , s 1 ) , ( F 2 , m 2 , s 2 ) . If A = { f 1 , , f n } is a partition in F 1 , then ψ ( A ) = { ψ ( f 1 ) , , ψ ( f n ) } is a partition in F 2 . Indeed, i = 1 n ψ ( f i ) exists, since i = 1 n f i exists and by Definition 9 we have:
m 2 ( i = 1 n ψ ( f i ) ) = m 2 ( ψ ( i = 1 n f i ) ) = m 1 ( i = 1 n f i ) = m 1 ( 1 F 1 ) = m 2 ( 1 F 2 ) .
On the other hand, we have:
m 2 ( i = 1 n ψ ( f i ) ) = m 1 ( i = 1 n f i ) = i = 1 n m 1 ( f i ) = i = 1 n m 2 ( ψ ( f i ) ) .
Calculate:
h l ( ψ ( A ) ) = i = 1 n m 2 ( ψ ( f i ) ) ( 1 m 2 ( ψ ( f i ) ) ) = i = 1 n m 1 ( f i ) ( 1 m 1 ( f i ) ) = h l ( A ) .
Hence, using the conditions (i), (ii) from Definition 9 we get:
h l ( s 2 , ψ ( A ) ) = lim n 1 n h l ( i = 0 n 1 s 2 i ψ ( A ) ) = lim n 1 n h l ( i = 0 n 1 ψ ( s 1 i A ) ) = lim n 1 n h l ( ψ ( i = 0 n 1 s 1 i A ) ) = lim n 1 n h l ( i = 0 n 1 s 1 i A ) = h l ( s 1 , A ) .
Therefore:
{ h l ( s 1 , A ) ; A is   a   partition   in   F 1 } { h l ( s 2 , B ) ; B is   a   partition   in   F 2 } ,
and consequently:
h l ( s 1 ) = sup { h l ( s 1 , A ) ; A   is   a   partition   in   F 1 } sup { h l ( s 2 , B ) ; B   is   a   partition   in   F 2 } = h l ( s 2 ) .
The opposite inequality is obtained in a similar way. If B = { g 1 , , g n } is a partition in F 2 , then it is easy to verify that ψ 1 ( B ) = { ψ 1 ( g 1 ) , , ψ 1 ( g n ) } is a partition in F 1 . Indeed, since i = 1 n g i exists according to the property (ii) from Lemma 3 i = 1 n ψ 1 ( g i ) exists, too. Moreover, we have:
m 1 ( i = 1 n ψ 1 ( g i ) ) = m 1 ( ψ 1 ( i = 1 n g i ) ) = m 2 ( i = 1 n g i ) = m 2 ( 1 F 2 ) = m 1 ( 1 F 1 ) ,
and:
m 1 ( i = 1 n ψ 1 ( g i ) ) = m 2 ( i = 1 n g i ) = i = 1 n m 2 ( g i ) = i = 1 n m 1 ( ψ 1 ( g i ) ) .
By means of (iii) from the previous lemma we get:
h l ( ψ 1 ( B ) ) = i = 1 n m 1 ( ψ 1 ( g i ) ) ( 1 m 1 ( ψ 1 ( g i ) ) ) = i = 1 n m 2 ( g i ) ( 1 m 2 ( g i ) ) = h l ( B ) .
Thus, according to the previous lemma:
h l ( s 1 , ψ 1 ( B ) ) = lim n 1 n h l ( i = 0 n 1 s 1 i ψ 1 ( B ) ) = lim n 1 n h l ( i = 0 n 1 ψ 1 ( s 2 i B ) ) = lim n 1 n h l ( ψ 1 ( i = 0 n 1 s 2 i B ) ) = lim n 1 n h l ( i = 0 n 1 s 2 i B ) = h l ( s 2 , B ) .
Therefore:
{ h l ( s 2 , B ) ; B is   a   partition   in   F 2 } { h l ( s 1 , A ) ; A is   a   partition   in   F 1 } .
This result implies the inequality:
sup { h l ( s 2 , B ) ; B is   a   partition   in   F 2 } sup { h l ( s 1 , A ) ; A is   a   partition   in   F 1 } ,
i.e., it holds h l ( s 2 ) h l ( s 1 ) . The proof is completed. ☐

5. Discussion

In the year 2013, classical logical entropy was discussed by Ellerman [20] as an alternative measure of information. In the paper by Markechová and Riečan [23], the notions of logical entropy and logical mutual information of fuzzy partitions in the given fuzzy probability space were introduced and studied. By means of the suggested concept of entropy of fuzzy partitions the authors have defined the logical entropy of fuzzy dynamical systems. Thereby they obtained a new tool for distinction of non-isomorphic fuzzy dynamical systems, since, as it is proved in Theorem 12 of the cited paper, the logical entropy of fuzzy dynamical systems coincides on isomorphic fuzzy dynamical systems. It is noted that the definition of fuzzy dynamical systems ( Ω , F , m , τ ) considered in [23] is based on Zadeh’s connectives.
In this paper, we generalize the results of Markechová and Riečan concerning the logical entropy. We have introduced the general model for the logical entropy which includes—besides other cases—the mentioned case of the logical entropy of fuzzy dynamical systems ( Ω , F , m , τ ) . We have defined the notions of logical entropy and logical mutual information of finite partitions on an appropriate algebraic structure and proved basic properties of these measures. Using the suggested concept of logical entropy of partitions, we have defined the logical entropy of dynamical systems and proved that the logical entropy of dynamical systems is invariant under any isomorphism (Theorem 10). From Example 1 it follows that the presented results are generalizations of the results of [23]; inter alia, Theorem 12 of [23] stating that the logical entropy of fuzzy dynamical systems is invariant under any isomorphism is a special case of Theorem 10. It is shown that the suggested general theory can be applied to the Riečan model of fuzzy dynamical systems ( Ω , F , m , U ) described in Example 2, and to the classical case as well. Note that in the Riečan approach the Lukasiewicz connectives were used to define the fuzzy set operations. Accordingly, all obtained results are valid also for the case of fuzzy dynamical systems ( Ω , F , m , U ) defined by Riečan. In particular, from the presented algebraic theory it follows that the logical entropy of fuzzy dynamical systems ( Ω , F , m , U ) is invariant under any isomorphism.
Probably one of the most important results of the theory of invariant measures for practical purposes is the Kolmogorov-Sinai Theorem on generators [43]. A fuzzy analogy of the Kolmogorov-Sinai Theorem on generators for fuzzy dynamical systems ( Ω , F , m , τ ) was proved in [12], and an analogy of this theorem for fuzzy dynamical systems ( Ω , F , m , U ) is provided in [9] (see also [10]). The aim of our further research is to provide an analogy of this theorem for the case of logical entropy.

Acknowledgments

The authors thank the editor and the referees for their valuable comments and suggestions.

Author Contributions

All authors contributed equally and significantly to the study and preparation of the article. They have read and approved the final manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Shannon, C.E. A Mathematical Theory of Communication. Bell Syst. Tech. J. 1948, 27, 379–423. [Google Scholar] [CrossRef]
  2. Gray, R.M. Entropy and Information Theory; Springer: Berlin/Heidelberg, Germany, 2009. [Google Scholar]
  3. Kolmogorov, A.N. New Metric Invariant of Transitive Dynamical Systems and Automorphisms of Lebesgue Spaces. Dokl. Russ. Acad. Sci. 1958, 119, 861–864. [Google Scholar]
  4. Sinai, Y.G. Ergodic Theory with Applications to Dynamical Systems and Statistical Mechanics; Springer: Berlin/Heidelberg, Germany, 1990. [Google Scholar]
  5. Sinai, Y.G. On the Notion of Entropy of a Dynamical System. Dokl. Russ. Acad. Sci. 1959, 124, 768–771. [Google Scholar]
  6. Riečan, B. An entropy construction inspired by fuzzy sets. Soft Comput. 2003, 7, 486–488. [Google Scholar]
  7. Riečan, B. On a type of entropy of dynamical systems. Tatra Mount. Math. Publ. 1992, 1, 135–140. [Google Scholar]
  8. Riečan, B. On some modifications of the entropy of dynamical systems. Atti Sem. Math. Fis. Univ. Modena 1994, 42, 157–166. [Google Scholar]
  9. Riečan, B. On the entropy and generators of dynamical systems. Appl. Math. 1996, 41, 161–168. [Google Scholar]
  10. Markechová, D.; Riečan, B. Entropy of Fuzzy Partitions and Entropy of Fuzzy Dynamical Systems. Entropy 2016, 18, 19. [Google Scholar] [CrossRef]
  11. Markechová, D. Entropy of Complete Fuzzy Partitions. Math. Slovaca 1993, 43, 1–10. [Google Scholar]
  12. Markechová, D. The entropy of fuzzy dynamical systems and generators. Fuzzy Sets Syst. 1992, 48, 351–363. [Google Scholar] [CrossRef]
  13. Markechová, D. A note to the Kolmogorov-Sinai entropy of fuzzy dynamical systems. Fuzzy Sets Syst. 1994, 64, 87–90. [Google Scholar] [CrossRef]
  14. Markechová, D. Entropy and mutual information of experiments in the fuzzy case. Neural Netw. World 2013, 23, 339–349. [Google Scholar] [CrossRef]
  15. Dubois, D.; Prade, M. A review of fuzzy set aggregation connectives. Inf. Sci. 1985, 36, 85–121. [Google Scholar] [CrossRef]
  16. Riečan, B.; Markechová, D. The entropy of fuzzy dynamical systems, general scheme, and generators. Fuzzy Sets Syst. 1998, 96, 191–199. [Google Scholar] [CrossRef]
  17. Rao, C.R. Diversity and dissimilarity coefficients. A unified approach. Theor. Popul. Biol. 1982, 21, 24–43. [Google Scholar] [CrossRef]
  18. Good, I.J. Comment (on Patil and Taillie: Diversity as a Concept and its Measurement). J. Am. Stat. Assoc. 1982, 77, 561–563. [Google Scholar]
  19. Patil, G.P.; Taillie, C. Diversity as a Concept and its Measurement. J. Am. Stat. Assoc. 1982, 77, 548–561. [Google Scholar] [CrossRef]
  20. Ellerman, D. An Introduction to Logical Entropy and Its Relation to Shannon Entropy. Int. J. Semant. Comput. 2013, 7, 121–145. [Google Scholar] [CrossRef]
  21. Ebrahimzadeh, A. Logical entropy of quantum dynamical systems. Open Phys. 2016, 14, 1–5. [Google Scholar] [CrossRef]
  22. Ebrahimzadeh, A. Quantum conditional logical entropy of dynamical systems. Ital. J. Pure Appl. Math. 2016, 36, 879–886. [Google Scholar]
  23. Markechová, D.; Riečan, B. Logical Entropy of Fuzzy Dynamical Systems. Entropy 2016, 18, 157. [Google Scholar] [CrossRef]
  24. Mesiar, R.; Rybárik, J. Entropy of Fuzzy Partitions—A General Model. Fuzzy Sets Syst. 1998, 99, 73–79. [Google Scholar] [CrossRef]
  25. Mesiar, R. The Bayes formula and the entropy of fuzzy probability spaces. Int. J. Gen. Syst. 1990, 4, 67–71. [Google Scholar]
  26. Dumitrescu, D. Fuzzy measures and the entropy of fuzzy partitions. J. Math. Appl. 1993, 176, 359–373. [Google Scholar] [CrossRef]
  27. Dumitrescu, D. Entropy of fuzzy process. Fuzzy Sets Syst. 1993, 55, 169–177. [Google Scholar] [CrossRef]
  28. Dumitrescu, D. Entropy of a fuzzy dynamical system. Fuzzy Sets Syst. 1995, 70, 45–57. [Google Scholar] [CrossRef]
  29. Khare, M. Fuzzy σ-algebras and conditional entropy. Fuzzy Sets Syst. 1999, 102, 287–292. [Google Scholar] [CrossRef]
  30. Khare, M.; Roy, S. Entropy of quantum dynamical systems and sufficient families in orthomodular lattices with Bayessian state. Commun. Theor. Phys. 2008, 50, 551–556. [Google Scholar] [CrossRef]
  31. Rahimi, M.; Riazi, A. On local entropy of fuzzy partitions. Fuzzy Sets Syst. 2014, 234, 97–108. [Google Scholar] [CrossRef]
  32. Rahimi, M.; Assari, A.; Ramezani, F. A Local Approach to Yager Entropy of Dynamical Systems. Int. J. Fuzzy Syst. 2015, 1, 1–10. [Google Scholar] [CrossRef]
  33. Srivastava, P.; Khare, M.; Srivastava, Y.K. M-Equivalence, entropy and F-dynamical systems. Fuzzy Sets Syst. 2001, 121, 275–283. [Google Scholar] [CrossRef]
  34. Ebrahimi, M.; Mohamadi, N. The entropy function on an algebraic structure with infinite partition and m-preserving transformation generators. Appl. Sci. 2010, 12, 48–63. [Google Scholar]
  35. Ebrahimzadeh, A.; Ebrahimi, M. Entropy of Dynamical Systems on Weights of a Graph. J. Mahani Math. Res. Center 2013, 2, 53–63. [Google Scholar]
  36. Ebrahimzadeh, A.; Ebrahimi, M. The entropy of countable dynamical systems. UPB Sci. Bull. Ser. A 2014, 76, 107–114. [Google Scholar]
  37. Hu, Q.; Yu, D.; Xie, Z.; Liu, J. Fuzzy probabilistic approximation spaces and their information measures. IEEE Trans. Fuzzy Syst. 2006, 14, 191–201. [Google Scholar]
  38. Piasecki, K. Probability of fuzzy events defined as denumerable additive measure. Fuzzy Sets Syst. 1985, 17, 271–284. [Google Scholar] [CrossRef]
  39. Zadeh, L.A. Fuzzy Sets. Inf. Control 1965, 8, 338–358. [Google Scholar] [CrossRef]
  40. Piasecki, K. New concept of separated fuzzy subsets. In Proceedings of the Polish Symposium on Interval and Fuzzy Mathematics, Poznan, Poland, 26–29 August 1983; Albrycht, J., Wiśniewski, H., Eds.; Wydaw. Politechniki Poznańskiej: Poznan, Poland, 1985; pp. 193–195. [Google Scholar]
  41. Piasecki, K. Fuzzy partitions of sets. BUSEFAL 1986, 25, 52–60. [Google Scholar]
  42. Butnariu, D.; Klement, E.P. Triangular Norm-Based Measures and Games with Fuzzy Coalitions; Kluwer Academic Publishers: Dordrecht, The Netherlands, 1993. [Google Scholar]
  43. Walters, P. An Introduction to Ergodic Theory; Springer: New York, NY, USA, 1982. [Google Scholar]

Share and Cite

MDPI and ACS Style

Ebrahimzadeh, A.; Giski, Z.E.; Markechová, D. Logical Entropy of Dynamical Systems—A General Model. Mathematics 2017, 5, 4. https://doi.org/10.3390/math5010004

AMA Style

Ebrahimzadeh A, Giski ZE, Markechová D. Logical Entropy of Dynamical Systems—A General Model. Mathematics. 2017; 5(1):4. https://doi.org/10.3390/math5010004

Chicago/Turabian Style

Ebrahimzadeh, Abolfazl, Zahra Eslami Giski, and Dagmar Markechová. 2017. "Logical Entropy of Dynamical Systems—A General Model" Mathematics 5, no. 1: 4. https://doi.org/10.3390/math5010004

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop