Next Article in Journal
Increased Sample Entropy in EEGs During the Functional Rehabilitation of an Injured Brain
Previous Article in Journal
Beyond Boltzmann–Gibbs–Shannon in Physics and Elsewhere
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Entropy and Semi-Entropies of LR Fuzzy Numbers’ Linear Function with Applications to Fuzzy Programming

1
School of Management, Shanghai University, Shanghai 200444, China
2
School of Economics and Management, Tongji University, Shanghai 200082, China
*
Author to whom correspondence should be addressed.
Entropy 2019, 21(7), 697; https://doi.org/10.3390/e21070697
Submission received: 14 June 2019 / Revised: 11 July 2019 / Accepted: 12 July 2019 / Published: 16 July 2019
(This article belongs to the Section Multidisciplinary Applications)

Abstract

:
As a crucial concept of characterizing uncertainty, entropy has been widely used in fuzzy programming problems, while involving complicated calculations. To simplify the operations so as to broaden its applicable areas, this paper investigates the entropy within the framework of credibility theory and derives the formulas for calculating the entropy of regular LR fuzzy numbers by virtue of the inverse credibility distribution. By verifying the favorable property of this operator, a calculation formula of a linear function’s entropy is also proposed. Furthermore, considering the strength of semi-entropy in measuring one-side uncertainty, the lower and upper semi-entropies, as well as the corresponding formulas are suggested to handle return-oriented and cost-oriented problems, respectively. Finally, utilizing entropy and semi-entropies as risk measures, two types of entropy optimization models and their equivalent formulations derived from the proposed formulas are given according to different decision criteria, providing an effective modeling method for fuzzy programming from the perspective of entropy. The numerical examples demonstrate the high efficiency and good performance of the proposed methods in decision making.

1. Introduction

Fuzzy programming (FP), a technique incorporating the concept of fuzziness in programming models, has extensive applications in the field of operations research (i.e., project planning [1,2], manufacturing [3,4], investment problems [5], etc.) due to its advantage in handling problems with ambiguity and vagueness, which are commonly met in practice. In the existing literature, various types of FP problems with fuzzy parameters and/or fuzzy variables [6] have been studied. To characterize the relationships between the variables, numerous statistical measures are utilized (e.g., expectation, variance), among which fuzzy entropy has had attention paid to it and has been widely accepted as an important measurement for weighing information quantity and denoting the uncertainty.
The birth of fuzzy entropy can be traced back to Zadeh [7], who initialized the fundamental fuzzy entropy, the weighted Shannon entropy [8], in an endeavor to enlarge the domain of applicability of classical entropy, and the superior performance of measuring the degree of fuzziness has made it a research hotpot under fuzzy environments quickly. Since then, various types of fuzzy entropy were put forward subsequently. De Luca and Termini [9] suggested the notion of entropy and four requirements that a fuzzy entropy measure should comply with, giving a way to measure the “indefiniteness”. A class of entropies in finite fuzzy sets and their properties were presented by Trillas and Riera [10]. Kosko [11] developed a general entropy measure based on an intuitive ratio of distances. Pal and Pal [12,13] introduced three types of entropy along with their applications to highlight their applicability to various problems (see also [14,15,16,17]).
Indeed, the above-mentioned measures are available with their own objectives and merits. However, they were based on the possibility measure presented in Zadeh [18,19], which fails the intuitive and significant property of self-duality and describes the uncertainty arising from linguistic ambiguity rather than information deficiency [20]. Considering that, Li and Liu [21] introduced a novel definition of fuzzy entropy in view of the self-dual credibility measure raised by Liu and Liu [22] to depict the uncertainty induced by information deficiency. Inspired by this new concept, theoretical research [20,23,24], as well as real applications [25,26,27,28,29,30,31] on credibility-based entropy have increased rapidly.
In the applications of entropy within the framework of credibility theory, portfolio optimization has occupied more than half of them. For instance, Huang [25,26] formulated some credibility-based mean-entropy models by employing fuzzy entropy as a risk measure and compared them with other models. Li et al. [29] introduced a credibilistic minimum entropy estimation in the application of fuzzy portfolio selection. Zhou et al. [31] developed a time-consistent multi-period rolling portfolio optimization model based on the credibilistic entropy. Since entropy expresses both high and low extreme uncertainty, whereas only one side is disliked in decision making, it can be improved and applied in more areas besides portfolio selection. In this paper, the lower and upper semi-entropies are set forth to deal with the two types of decision-making problems, that is return-oriented problems that focus on the downside uncertainty that may decrease the return, and cost-oriented problems, which care more about the upside uncertainty that may increase the cost, respectively.
On the other hand, in terms of theoretical research, the definitions of various types of entropy have been highly concerned, whereas the research on calculations is far more than enough. In view of this, the inverse credibility distributions (ICD) of some specific arithmetical operations based on the credibility measure introduced by Zhou et al. [32] are utilized in the present work to calculate the entropy and semi-entropies of the well-known LR fuzzy numbers, a type of fuzzy number defined by Dubois and Prade [33]. Aggregating the results into the FP models with entropy or semi-entropies as risk measures, four mean-entropy or mean-semi-entropy optimization models are formulated. Owning to the favorable linearity of the ICD demonstrated by Liu [34] and Yao and Ke [35], the formulas for calculating the entropy and semi-entropies of a linear function are derived for transforming the proposed optimization models into the equivalent forms, which can be solved in a much easier way. To verify and compare the practical applications of the proposed formulas and models, two common decision-making problems, portfolio selection and R&D product investment, are illustrated.
In summary, this paper is dedicated to broadening the application areas of the credibility-based entropy and to provide a framework for solving FP problems from the perspective of entropy and semi-entropies, which are calculated by a simplified method. The reminder of this paper is as follows. Section 2 reviews several concepts related to LR fuzzy numbers with some examples. Section 3 introduces the definition of credibility-based entropy, whereafter the entropies of regular LR fuzzy numbers and their linear functions are proposed and some related theorems are proven. Subsequently, the corresponding parts of semi-entropy are described in Section 4, in which the definitions of lower and upper semi-entropies are given so as to quantify one side uncertainty. The entropy optimization models are set forth and exemplified in Section 5. Finally, some conclusions are summarized in Section 6.

2. Preliminaries

In the following, some necessary concepts and operational laws of fuzzy set theory, which lay the foundation for the following sections, are reviewed successively, including the LR fuzzy numbers, credibility function (CF), credibility distribution (CD), inverse credibility distribution (ICD), and expected value.
Definition 1
(Dubois and Prade [33]). The left (or right) shape function L (or R) of an LR fuzzy number is a decreasing function from R + [ 0 , 1 ] satisfying the conditions below:
(1) 
L ( 0 ) = 1 ;
(2) 
L ( x ) < 1 , x > 0 ;
(3) 
L ( x ) > 0 , x < 1 ;
(4) 
L ( 1 ) = 0 [ o r L ( x ) > 0 , x and L ( + ) = 0 ] .
Definition 2
(Dubois and Prade [36]). A fuzzy number δ is said to be of the LR type if the membership function (MF) is:
μ ( x ) = L σ x α , i f   x σ R x σ β , i f   x > σ ,
where α , β > 0 are the left spread and right spread, and the real number σ is called the mean value. Typically, δ is denoted as ( σ , α , β ) L R .
For the ease of distinguishing the definitions from the examples, the LR fuzzy number δ in Definition 2 is illustrated with some frequently-used ones with different types of MFs and the same parameter setting ( a , b , c ) in Examples 1–4, in which a , b , c stand for the mean value, the left spread, and the right spread, respectively.
Example 1.
If L ( x ) = R ( x ) = max { 1 x , 0 } , then δ is a triangular fuzzy number and satisfies δ T ( a , b , c ) L R with the MF (see Figure 1a):
μ ( x ) = x a + b b , i f   a b x < a a + c x c , i f   a x < a + c 0 , o t h e r w i s e .
Example 2.
A parabolic fuzzy number with L ( x ) = R ( x ) = max { 1 x 2 , 0 } is denoted as δ P ( a , b , c ) L R with the MF (see Figure 1b):
μ ( x ) = 1 a x b 2 , i f   a b x < a 1 x a c 2 , i f   a x < a + c 0 , o t h e r w i s e .
Example 3.
A normal fuzzy number with L ( x ) = R ( x ) = max { ( 1 x ) 2 , 0 } is denoted as δ N ( a , b , c ) L R , and the MF μ is (see Figure 1c):
μ ( x ) = 1 a x b 2 , i f   a b x < a 1 x a c 2 , i f   a x < a + c 0 , o t h e r w i s e .
Example 4.
Let L ( x ) = max { 1 x 2 , 0 } and R ( x ) = max { ( 1 x ) 2 , 0 } . Then, a mixture fuzzy number δ M ( a , b , c ) L R has the MF (see Figure 1d):
μ ( x ) = 1 a x b 2 , i f   a b x < a 1 x a c 2 , i f   a x < a + c 0 , o t h e r w i s e .
Assume that α is a real number and δ is a fuzzy number with the MF μ . With the consideration of self-duality, Liu and Liu [22] initialized that the fuzzy event { δ α } has the credibility of:
Cr { δ α } = 1 2 ( sup x α μ ( x ) + 1 sup x > α μ ( x ) ) .
Accordingly, the CD and CF of a fuzzy number were defined as follows.
Definition 3
(Liu [22], Li [37]). Let δ be a fuzzy number. The CD Φ : R [ 0 , 1 ] and the CF v : R [ 0 , 1 ] of δ are defined, respectively, as:
Φ ( x ) = Cr { δ x } , v ( x ) = Cr { δ = x } ,
In other words, Φ ( x ) refers to the credibility that the value of the fuzzy number δ is equal to or less than x, and v ( x ) is the credibility that the value of δ is equal to x.
Remark 1.
Regarding an LR fuzzy number δ ( σ , α , β ) L R with the MF μ in Equation (1), its CD can be worked out in view of Equations (6) and (7) as:
Φ ( x ) = 1 2 L σ x α , i f   x σ 1 1 2 R x σ β , i f   x > σ .
and the CF v of δ is:
v ( x ) = 1 2 L σ x α , i f   x σ 1 2 R x σ β , i f   x > σ .
It can be seen from Equation (8) that the CD of δ is a nondecreasing function, and Zhou et al. [32] proved that there are some favorable properties if it is a continuous and strictly increasing function. To study this special case, some new concepts concerning regular LR fuzzy numbers, as well as some related operational laws were raised by Zhou et al. [32].
Definition 4
(Zhou et al. [32]). It is said that an LR fuzzy number δ is regular if its CD Φ is regular, i.e., Φ is continuous and strictly increasing on { x | 0 < Φ ( x ) < 1 } , and the inverse function (IF) Φ 1 is called the ICD of δ.
Zhou et al. [32] further verified that the LR fuzzy number δ ( σ , α , β ) L R is regular when the shape functions are continuous and strictly decreasing, and its ICD is derived from Equation (8) as:
Φ 1 ( γ ) = σ α L 1 ( 2 γ ) , if γ 0.5 σ + β R 1 ( 2 2 γ ) , if γ > 0.5 .
Apparently, according to Definition 4, the four types of fuzzy numbers in the examples above (Examples 1–4) are regular.
Next, the operational law of calculating the ICD of a strictly monotone function with independent regular LR fuzzy numbers was provided.
Theorem 1
(Zhou et al. [32]). Let δ 1 , δ 2 , ⋯, δ n be independent regular LR fuzzy numbers; their CDs are, respectively, Φ 1 , Φ 2 , ⋯, Φ n . If f ( x 1 , x 2 , , x n ) is a strictly increasing function with regard to x 1 , x 2 , ⋯, x m and a strictly decreasing function with regard to x m + 1 , x m + 2 , ⋯, x n , then δ = f ( δ 1 , δ 2 , , δ n ) is a regular LR fuzzy number and has the ICD:
Φ 1 ( γ ) = f ( Φ 1 1 ( γ ) , , Φ m 1 ( γ ) , Φ m + 1 1 ( 1 γ ) , , Φ n 1 ( 1 γ ) ) .
Definition 5
(Liu and Liu [22]). Let δ be a fuzzy number. Then, its expected value can be defined by:
E [ δ ] = 0 + Cr { δ t } d t 0 Cr { δ t } d t ,
provided that at least one of the two integrals is finite.
Theorem 2
(Liu and Liu [38]). Let δ 1 and δ 2 be independent fuzzy numbers with finite expected values. Then, for any real numbers λ 1 and λ 2 , we have:
E [ λ 1 δ 1 + λ 2 δ 2 ] = λ 1 E [ δ 1 ] + λ 2 E [ δ 2 ] .
Theorem 3
(Zhou et al. [32]). Let δ be a regular LR fuzzy number. If there exists the expected value of δ, then:
E [ δ ] = 0 1 Φ 1 ( γ ) d γ
where Φ 1 is the ICD of δ.

3. The Entropy of a Linear Function with LR Fuzzy Numbers

In this section, the definition of entropy for fuzzy numbers is introduced, and then, the equivalent formulas of calculating the entropy of a regular LR fuzzy number and a linear function of regular LR fuzzy numbers are performed by virtue of the ICD. To verify the performance of the proposed formulas, some examples are illustrated.

3.1. The Definition of Entropy

Within the framework of credibility theory, Li and Liu [21] defined the entropy of a continuous fuzzy number as follows.
Definition 6
(Li and Liu [21]). Let δ be a continuous fuzzy number with a CF v. Then, the entropy of δ can be defined as:
H [ δ ] = + S v ( x ) d x ,
where the function S ( t ) = t ln t ( 1 t ) ln ( 1 t ) , as shown in Figure 2.
Example 5.
Given that δ T ( a , b , c ) L R is a triangular fuzzy number in Example 1 and Figure 1a, on the basis of Equations (9) and (15), the entropy of δ can be deduced as:
H [ δ ] = a b a S 1 2 × 1 a x b d x + a a + c S 1 2 × 1 x a c d x = 0 0.5 2 b S t d t 0.5 0 2 c S t d t = b + c 2 .
Example 6.
Let δ P ( a , b , c ) L R be a parabolic fuzzy number in Example 2 and Figure 1b. It follows from Equations (9) and (15) that the entropy of δ is:
H [ δ ] = a b a S 1 2 1 2 a x b 2 d x + a a + c S 1 2 1 2 x a c 2 d x = 0 0.5 b 1 2 t 1 2 S t d t + 0 0.5 c 1 2 t 1 2 S t d t = 1 6 b + c 8 π 2 ln 2 .

3.2. The Entropy of a Regular LR Fuzzy Number

On the basis of the relationship between CF and CD, the entropy of a continuous fuzzy number can be calculated by means of its CD. In addition, for a regular LR fuzzy number whose ICD exists, the entropy can be figured out in a simple and convenient way. In this section, the calculating formulas are elaborated and proven as follows.
Theorem 4.
Given that δ is a continuous fuzzy number and its entropy exists, then the entropy is:
H [ δ ] = + S ( Φ ( x ) ) d x ,
where Φ is the CD of δ.
Proof of Theorem 4.
Denote Φ ( x ) and v ( x ) as the CD and CF of a continuous fuzzy number ( σ , α , β ) L R , respectively. Based on Definition 3, it can be concluded that:
Φ ( x ) = v ( x ) , i f   x σ 1 v ( x ) , i f   x > σ .
By virtue of the equation S ( t ) = S ( 1 t ) and Definition 6, we have:
H [ δ ] = + S v ( x ) d x = σ S v ( x ) d x + σ + S 1 v ( x ) d x = + S ( Φ ( x ) ) d x .
 □
Theorem 5.
Let δ be a regular LR fuzzy number. Then, the entropy of δ can be calculated as:
H [ δ ] = 0 1 Φ 1 ( γ ) ln γ 1 γ d γ ,
where Φ 1 is the ICD of δ.
Proof of Theorem 5.
With a view toward Theorem 4, the entropy can be expressed as:
H [ δ ] = + S Φ ( x ) d x = 0 0 Φ ( x ) S ( γ ) d γ d x + 0 Φ ( x ) 1 S ( γ ) d γ d x ,
where S ( γ ) = ( γ ln γ ( 1 γ ) ln ( 1 γ ) ) = ln γ 1 γ . By using the Fubini theorem, we have:
H [ δ ] = 0 Φ ( 0 ) Φ 1 ( γ ) 0 S ( γ ) d x d γ + Φ ( 0 ) 1 0 Φ 1 ( γ ) S ( γ ) d x d γ = 0 1 Φ 1 ( γ ) S ( γ ) d γ = 0 1 Φ 1 ( γ ) ln γ 1 γ d γ .
 □
Compared with Definition 6 and Theorem 4, the formula put forward by Theorem 5 excludes the function S ( t ) and therefore has an advantage in reducing computational complexity, though it is only applicable to regular LR fuzzy numbers.
Example 7.
According to Equation (10), the ICD of a normal fuzzy number δ N ( a , b , c ) L R in Example 3 and Figure 1c can be derived as:
Φ 1 ( γ ) = a b + b 2 γ , i f   γ 0.5 a + c c 2 2 γ , i f   γ > 0.5 .
and then, it follows from Theorem 5 that the entropy of δ is:
H [ δ ] = 0 0.5 a b + b 2 x ln x 1 x d x + 0.5 1 a + c c 2 2 x ln x 1 x d x = ( b + c ) 0.5 1 ln x d x ( b + c ) 0 0.5 ln x d x + ( b + c ) 0 1 u 2 ln u 2 2 u 2 d u = ( b + c ) ln 2 + 4 3 4 2 3 ln ( 1 + 2 ) .
Example 8.
With a view toward Equation (10), the ICD of a mixture fuzzy number δ M ( a , b , c ) L R in Example 4 and Figure 1d can be figured out as:
Φ 1 ( γ ) = a b 1 2 γ , i f   γ 0.5 a + c c 2 2 γ , i f   γ > 0.5 .
and then, it follows from Theorem 5 that the entropy of δ is:
H [ δ ] = 0 0.5 a b 1 2 x ln x 1 x d x + 0.5 1 a + c c 2 2 x ln x 1 x d x = c ln 2 b 0 1 u 2 ln 1 u 2 1 + u 2 d u + c 0 1 u 2 ln u 2 2 u 2 d u = c ln 2 + 4 3 4 2 3 ln ( 1 + 2 ) b ln 2 3 4 3 + π 6 .

3.3. The Entropy of a Linear Function

Seeing that Liu [34] and Yao and Ke [35] have uncovered the evidence to support the linearity property of the entropy in uncertain sets, to verify the existence of this desirable property in the credibility-based entropy, the formula of calculating the entropy of a linear function constructed by regular LR fuzzy numbers is considered in this section and presented in the following form.
Theorem 6.
Suppose that δ 1 , δ 2 , , δ n are independent regular LR fuzzy numbers, and f ( x 1 , x 2 , , x n ) = λ 1 x 1 + λ 2 x 2 + + λ n x n , where λ 1 , λ 2 , , λ n are real numbers. Then, the entropy of δ = f ( δ 1 , δ 2 , , δ n ) is:
H [ δ ] = | λ 1 | H [ δ 1 ] + | λ 2 | H [ δ 2 ] + + | λ n | H [ δ n ] .
Proof of Theorem 6.
For simplicity, we only prove the case of n = 2 and δ = f ( δ 1 , δ 2 ) . Denote the ICDs of δ , δ 1 , and δ 2 by Φ 1 , Φ 1 1 , and Φ 2 1 , respectively.
Case (a): If λ 1 > 0 , λ 2 > 0 , then f is a strictly increasing function of x 1 and x 2 . By Theorem 1, we have:
Φ 1 ( γ ) = f ( Φ 1 1 ( γ ) , Φ 2 1 ( γ ) ) .
In view of Theorem 5, we can deduce that:
H [ f ( δ 1 , δ 2 ) ] = 0 1 λ 1 Φ 1 1 ( γ ) + λ 2 Φ 2 1 ( γ ) ln γ 1 γ d γ = λ 1 0 1 Φ 1 1 ( γ ) ln γ 1 γ d γ + λ 2 0 1 Φ 2 1 ( γ ) ln γ 1 γ d γ = λ 1 H [ δ 1 ] + λ 2 H [ δ 2 ] = | λ 1 | H [ δ 1 ] + | λ 2 | H [ δ 2 ] .
Case (b): If λ 1 > 0 , λ 2 < 0 , then f is strictly increasing with regard to x 1 and strictly decreasing with regard to x 2 . On the basis of Theorem 1, we have:
Φ 1 ( γ ) = f ( Φ 1 1 ( γ ) , Φ 2 1 ( 1 γ ) ) .
According to Theorem 5, it can be derived that:
H [ f ( δ 1 , δ 2 ) ] = 0 1 ( λ 1 Φ 1 1 ( γ ) + λ 2 Φ 2 1 ( 1 γ ) ) ln γ 1 γ d γ = λ 1 0 1 Φ 1 1 ( γ ) ln γ 1 γ d γ + λ 2 0 1 Φ 2 1 ( 1 γ ) ln γ 1 γ d γ = λ 1 0 1 Φ 1 1 ( γ ) ln γ 1 γ d γ λ 2 0 1 Φ 2 1 ( γ ) ln γ 1 γ d γ = λ 1 H [ δ 1 ] λ 2 H [ δ 2 ] = | λ 1 | H [ δ 1 ] + | λ 2 | H [ δ 2 ] .
Analogously, the same results can be reached for the other two cases (i.e., λ 1 < 0 , λ 2 > 0 and λ 1 < 0 , λ 2 < 0 ). In addition, if λ 1 = 0 or λ 2 = 0 , the same results can be obtained easily. That is, for any real numbers λ 1 and λ 2 , the equation H [ f ( δ 1 , δ 2 ) ] = | λ 1 | H [ δ 1 ] + | λ 2 | H [ δ 2 ] holds. □
By using Equation (21), the only thing that needs to be done for calculating the entropy of a linear function is calculating the entropy of each independent fuzzy number, whether the fuzzy numbers are of the same type or not.
Example 9.
Let δ 1 T ( a 1 , b 1 , c 1 ) L R and δ 2 T ( a 2 , b 2 , c 2 ) L R be two independent triangular fuzzy numbers, and f ( δ 1 , δ 2 ) = 3 δ 1 + 5 δ 2 . In light of Equations (16) and (21), the entropy of f ( δ 1 , δ 2 ) is:
H [ f ( δ 1 , δ 2 ) ] = 3 H [ δ 1 ] + 5 H [ δ 2 ] = 3 × b 1 + c 1 2 + 5 × b 2 + c 2 2 = 3 b 1 + 3 c 1 + 5 b 2 + 5 c 2 2 .
Example 10.
Let δ 1 T ( a 1 , b 1 , c 1 ) L R be a triangular fuzzy number and δ 2 M ( a 2 , b 2 , c 2 ) L R be a mixture fuzzy number, and f ( δ 1 , δ 2 ) = 3 δ 1 5 δ 2 . In accordance with Theorem 6 and the results of Equations (16) and (20), the entropy of f ( δ 1 , δ 2 ) is:
H [ f ( δ 1 , δ 2 ) ] = 3 H [ δ 1 ] 5 H [ δ 2 ] = 3 × b 1 + c 1 2 + 5 × c 2 ln 2 4 3 + 4 2 3 ln ( 1 + 2 ) b 2 l n 2 3 4 3 + π 6 = 1 6 9 b 1 + 9 c 1 + 10 c 2 3 ln 2 4 + 4 2 ln ( 1 + 2 ) 5 b 2 ( 2 ln 2 8 + π ) .

4. The Semi-Entropies of a Linear Function with LR Fuzzy Numbers

This section firstly gives the definitions of the lower semi-entropy proposed by Zhou et al. [39] and the upper semi-entropy suggested in the present work. After that, some formulas via the ICDs are proposed for calculating the lower and upper semi-entropies of a regular LR fuzzy number and a linear function with regular LR fuzzy numbers, and some examples are given.

4.1. The Definitions of Semi-Entropies

To quantify the downside uncertainty, Zhou et al. [39] put forward the concept of semi-entropy (hereinafter referred to as lower semi-entropy) in portfolio selection problems as follows.
Definition 7
(Zhou et al. [39]). Let δ be a continuous fuzzy number with expected value e and CF v. Then, its lower semi-entropy can be expressed as:
H S [ δ ] = + S ( v ( x ) ) d x ,
where S ( t ) = t ln t ( 1 t ) ln ( 1 t ) , and:
v ( x ) = v ( x ) , i f   x e 0 , i f   x > e .
Since S ( 0 ) = 0 , the lower semi-entropy of the fuzzy number δ can be simplified as the following specification:
H S [ δ ] = e S ( v ( x ) ) d x .
While investors in finance focus their attention on the downside uncertainty, decision makers in engineering care more about the upside uncertainty that may increase the cost. On this account, a concept of upper semi-entropy is proposed in this paper.
Definition 8.
Suppose that δ is a continuous fuzzy number with expected value e and CF v. Then, its upper semi-entropy can be expressed as:
H S [ δ ] + = + S ( v ( x ) + ) d x ,
where S ( t ) = t ln t ( 1 t ) ln ( 1 t ) and:
v ( x ) + = 0 , i f   x e v ( x ) , i f   x > e .
Since S ( 0 ) = 0 , the upper semi-entropy of the fuzzy number δ can be simplified as the following specification:
H S [ δ ] + = e + S ( v ( x ) ) d x .
Corollary 1.
Let δ be a continuous fuzzy number. We have:
H [ δ ] = H S [ δ ] + H S [ δ ] + .
Proof of Corollary 1.
It follows from Definitions 6–8 and Equations (15), (24), and (27) immediately. □
Example 11.
Given that δ T ( a , b , c ) L R is a triangular fuzzy number in Example 1 and Figure 1a, then the expected value of δ can be deduced easily as e = 1 4 ( 4 a b + c ) by Theorem 3.
If e a , in view of Equations (9), (16), (24), and (28), we have:
H S [ δ ] = a b e S 1 2 1 a x b d x = 0 m 2 b S ( t ) d t = b T ( m ) , H S [ δ ] + = H [ δ ] H S [ δ ] = b + c 2 b T ( m ) 2 ,
where T ( x ) = ( 1 x ) 2 ln ( 1 x ) x 2 ln x + x and m = 3 b + c 8 b .
If e > a , it can be figured out that:
H S [ δ ] + = e a + c S 1 2 1 x a c d x = 0 n 2 c S ( t ) d t = c T ( n ) , H S [ δ ] = H [ δ ] H S [ δ ] + = b + c 2 c T ( n ) 2 ,
where T ( x ) = ( 1 x ) 2 ln ( 1 x ) x 2 ln x + x and n = b + 3 c 8 c .

4.2. The Semi-Entropy of a Regular LR Fuzzy Number

Similar to the entropy of a regular LR fuzzy number, the lower and upper semi-entropies can be also derived via the CD and ICD.
Theorem 7.
Let δ be a continuous fuzzy number with CD Φ. Then, its lower and upper semi-entropies can be calculated, respectively, as:
H S [ δ ] = e S ( Φ ( x ) ) d x ,
H S [ δ ] + = e + S ( Φ ( x ) ) d x .
Proof of Theorem 7.
Assume that e , σ , v are the expected value, mean value, and CF of a continuous fuzzy number δ , respectively.
If e σ , on the basis of Equations (18), (22), and (23), we can deduce that:
H S [ δ ] = e S v ( x ) d x = e S Φ ( x ) d x .
Similarly, if e > σ , we have:
H S [ δ ] = σ S v ( x ) d x + σ e S 1 v ( x ) d x = e S ( Φ ( x ) ) d x .
The formula for the upper semi-entropy in Equation (30) can be proven in a similar way. □
Theorem 8.
Let δ be a regular LR fuzzy number with ICD Φ 1 and expected value e. Then, the lower and upper semi-entropies of δ can be calculated as:
H S [ δ ] = 0 Φ ( e ) ( Φ 1 γ ) e ln γ 1 γ d γ , i f   e 0 0 Φ ( e ) Φ 1 ( γ ) ln γ 1 γ d γ + e Φ ( e ) 1 ln γ 1 γ d γ , i f   e > 0 ,
H S [ δ ] + = e 0 Φ ( e ) ln γ 1 γ d γ + Φ ( e ) 1 Φ 1 ( γ ) ln γ 1 γ d γ , i f   e 0 Φ ( e ) 1 ( Φ 1 γ ) e ln γ 1 γ d γ , i f   e > 0 .
Proof of Theorem 8.
Following Theorem 7, the lower semi-entropy of δ is:
H S [ δ ] = e S ( v ( x ) ) d x = e S ( Φ ( x ) ) d x .
If e 0 , by the Fubini theorem, we can further obtain that:
H S [ δ ] = e 0 Φ ( x ) S ( γ ) d γ d x = 0 Φ ( e ) Φ 1 ( γ ) e S ( γ ) d x d γ = 0 Φ ( e ) Φ 1 ( γ ) e ln γ 1 γ d γ .
If e > 0 , we have:
H S [ δ ] = 0 0 Φ ( x ) S ( γ ) d γ d x + 0 e Φ ( x ) 1 S ( γ ) d γ d x = 0 Φ ( 0 ) Φ 1 ( γ ) 0 S ( γ ) d x d γ + Φ ( 0 ) Φ ( e ) 0 Φ 1 ( γ ) S ( γ ) d x d γ + Φ ( e ) 1 0 e S ( γ ) d x d γ = 0 Φ ( e ) Φ 1 ( γ ) ln γ 1 γ d γ + e Φ ( e ) 1 ln γ 1 γ d γ .
A similar procedure could be adapted easily to deduce Equation (32). □
Similar to Theorem 5, Theorem 8 gives a formula for calculating the semi-entropies with relatively less complexity compared with Definitions 7 and 8 and Theorem 7.
Example 12.
Assume that δ N ( 1 , 2 , 3 ) L R is a normal fuzzy number in Example 3 and Figure 1c. Then, the expected value of δ is e = 1 6 ( 6 a b + c ) = 7 6 by Theorem 3.
According to Equation (10) and Theorem 8, e > 0 and Φ ( e ) = 19 36 > 0 . 5 , we have:
H S [ δ ] = 0 0.5 ( a b + b 2 x ) ln x 1 x d x + 0.5 Φ ( e ) ( a + c c 2 2 x ) ln x 1 x d x + e Φ ( e ) 1 ln x 1 x d x = 0 0.5 ( 2 2 x 1 ) ln x 1 x d x + 0.5 19 36 ( 4 3 2 2 x ) ln x 1 x d x + 7 6 19 36 1 ln x 1 x d x = 0.844 , H S [ δ ] + = Φ ( e ) 1 ( a + c c 2 2 x e ) ln x 1 x d x = 19 36 1 ( 17 6 3 2 2 x ) ln x 1 x d x = 0.978 .

4.3. The Semi-Entropies of a Linear Function

Theorem 9.
Let δ 1 , δ 2 , ⋯, δ n be independent regular LR fuzzy numbers with ICDs Φ 1 1 , Φ 2 1 , , Φ n 1 , respectively, and λ 1 , λ 2 , , λ m 0 , λ m + 1 , λ m + 2 , , λ n 0 be real numbers. Then, the lower and upper semi-entropies of δ = λ 1 δ 1 + λ 2 δ 2 + + λ n δ n can be calculated as Equations (31) and (32), respectively, where the ICD of δ is:
Φ 1 ( γ ) = λ 1 Φ 1 1 ( γ ) + + λ m Φ m 1 ( γ ) + λ m + 1 Φ m + 1 1 ( 1 γ ) + + λ n Φ n 1 ( 1 γ ) ,
and the expected value of δ is e = 0 1 Φ 1 ( γ ) d γ .
Proof of Theorem 9.
It follows from Theorems 1 and 8 immediately. □
Example 13.
Let δ 1 T ( 1 , 2 , 3 ) L R be a triangular fuzzy number and δ 2 N ( 1 , 2 , 3 ) L R be a normal fuzzy number. In view of Equation (10), the ICDs of δ 1 and δ 2 can be derived, respectively, as:
Φ 1 1 ( γ ) = 4 γ 1 , i f   γ 0.5 6 γ 2 , i f   γ > 0.5 , Φ 2 1 ( γ ) = 2 2 γ 1 , i f   γ 0.5 4 3 2 2 γ , i f   γ > 0.5 .
The ICD of δ = δ 1 δ 2 is:
Φ 1 ( γ ) = Φ 1 1 ( γ ) Φ 2 1 ( 1 γ ) = 4 γ + 3 2 γ 5 , i f   γ 0.5 6 γ 2 2 2 γ 1 , i f   γ > 0.5 .
According to Theorem 3, the expected value of δ is:
e = 0 1 Φ 1 ( γ ) d γ = 1 12 .
By Equations (34) and (35), Φ ( e ) = 0.512 . On the basis of Equations (31) and (32), the lower semi-entropy of δ is:
H S [ δ ] = 0 Φ ( e ) Φ 1 ( γ ) ln γ 1 γ d γ + e Φ ( e ) 1 ln γ 1 γ d γ = 0 0.5 ( 4 γ + 3 2 γ 5 ) ln γ 1 γ d γ + 0.5 0.512 ( 6 γ 2 2 2 γ 1 ) ln γ 1 γ d γ + 1 12 0.512 1 ln γ 1 γ d γ = 2.1513 ,
and the upper semi-entropy of f δ is:
H S [ δ ] + = Φ ( e ) 1 ( Φ 1 ( γ ) e ) ln γ 1 γ d γ = 0.512 1 6 γ 2 2 2 γ 13 12 ln γ 1 γ d γ = 2.1713 .
In the cases where δ 1 , δ 2 , ⋯, δ n are of the same type, that is they have the same shape functions L and R, but with different parameter settings ( a i , b i , c i ) , i = 1 , 2 , , n , it is well-known that δ = λ 1 δ 1 + λ 2 δ 2 + + λ n δ n is also a fuzzy number with the same shape functions, and the parameters a, b, and c can be deduced by a i , b i , c i , and λ i . For example, when λ i 0 , we have:
a = i = 1 n λ i a i , b = i = 1 n λ i b i , c = i = 1 n λ i c i .
Thereafter, the semi-entropies of δ can be calculated directly by Equations (31) and (32). This method can reduce calculation load greatly especially when the size n is large.
Example 14.
Let δ 1 T ( 1 , 2 , 1 ) L R , δ 2 T ( 3 , 1 , 2 ) L R , δ 3 T ( 2 , 2 , 1 ) L R , and δ 4 T ( 1 , 2 , 2 ) L R be four independent triangular fuzzy numbers. Then, δ = δ 1 + δ 2 + δ 3 + δ 4 is still a triangular fuzzy number with δ T ( 3 , 7 , 6 ) L R . Consequently, in light of Theorem 3 and Equation (10), the expected value of δ is e = 11 4 , and its ICD is:
Φ 1 ( γ ) = 14 γ 4 , i f   γ 0.5 12 γ 3 , i f   γ > 0.5 .
Accordingly, we have Φ ( e ) = 23 48 . By Equations (31) and (32), the lower semi-entropy of δ is:
H S [ δ ] = 0 Φ ( e ) Φ 1 ( γ ) ln γ 1 γ d γ + e Φ ( e ) 1 ln γ 1 γ d γ = 0 23 48 ( 14 γ 4 ) ln γ 1 γ d γ + 11 4 23 48 1 ln γ 1 γ d γ = 3.3268 ,
and the upper semi-entropy of δ is:
H S [ δ ] + = Φ ( e ) 1 Φ 1 ( γ ) e ln γ 1 γ d γ = 23 48 0.5 14 γ 27 4 ln γ 1 γ d γ + 0.5 1 12 γ 23 4 ln γ 1 γ d γ = 3.1733 .

5. Entropy Optimization Models

Fuzzy programming (FP), which aims to find optimal solutions under a set of linear or nonlinear objectives and constraints involving fuzzy parameters or variables, is an important optimization technique in both theory and application. Some indicators such as mean and variance are employed to characterize and defuzzify the models. In this section, the entropy and semi-entropies are used in FP models as alternative measures of characterizing the uncertainty with regard to return and cost-oriented problems.

5.1. Mean-Entropy and Mean-Semi-Entropy Optimization Models in Return-Oriented Problems

For a decision maker with a given input, achieving more returns at lower risks is the main purpose while making decisions among multiple alternatives. Generally, the decision maker has an expectation of the return, but little knowledge of predicting the risk due to information vagueness and imprecision. Using fuzzy parameters to express the returns of the alternatives and entropy to denote the risks, the general paradigm of a mean-entropy optimization model aiming to minimize the risk under certain expected constraints can be described as follows,
min H [ f ( x , δ ) ] subject   to : E [ f ( x , δ ) ] α E [ g i ( x , δ ) ] 0 , i = 1 , 2 , , n ,
where f ( x , δ ) is the overall return with x = ( x 1 , x 2 , , x p ) as decision variables and δ = ( δ 1 , δ 2 , , δ m ) as fuzzy parameters, g i ( x , δ ) , i = 1 , 2 , , n , are the constraint functions, and α is a predetermined constant denoting the lower limit of the expected overall return.
Considering that entropy measures bilateral risks, minimizing the entropy will certainly sacrifice high returns. For a decision maker who focuses on the downside risk only and is willing to get high returns, a mean-semi-entropy model with the objective to minimize the lower semi-entropy is more appropriate. The model satisfying certain expected return constraints is shown below,
min H S [ f ( x , δ ) ] subject   to : E [ f ( x , δ ) ] α E [ g i ( x , δ ) ] 0 , i = 1 , 2 , , n ,
where H S [ f ( x , δ ) ] is the lower semi-entropy of the overall return.
In particular, if f and g i , i = 1 , 2 , , n , are linear functions of independent and regular fuzzy parameters δ k , i.e.,
f ( x , δ ) = f 0 ( x ) + k = 1 m f k ( x ) δ k , g i ( x , δ ) = g i 0 ( x ) + k = 1 m g i k ( x ) δ k ,
then Model (36) can be transformed into the following form based on Theorems 2 and 6,
min H [ δ 1 ] | f 1 ( x ) | + H [ δ 2 ] | f 2 ( x ) | + + H [ δ m ] | f m ( x ) | subject   to : f 0 ( x ) + E [ δ 1 ] f 1 ( x ) + E [ δ 2 ] f 2 ( x ) + + E [ δ m ] f m ( x ) α g i 0 ( x ) + E [ δ 1 ] g i 1 ( x ) + E [ δ 2 ] g i 2 ( x ) + + E [ δ m ] g i m ( x ) 0 , i = 1 , 2 , , n ,
where H [ δ k ] and E [ δ k ] are the entropies and expectations of δ k , k = 1 , 2 , , m , respectively. Since the entropy of a constant is 0, f 0 ( x ) is eliminated in the objective function.
Likewise, the equivalent model of Model (37) by Theorem 9 can be depicted as:
min H S [ f ( x , δ ) ] subject   to : f 0 ( x ) + E [ δ 1 ] f 1 ( x ) + E [ δ 2 ] f 2 ( x ) + + E [ δ m ] f m ( x ) α g i 0 ( x ) + E [ δ 1 ] g i 1 ( x ) + E [ δ 2 ] g i 2 ( x ) + + E [ δ m ] g i m ( x ) 0 , i = 1 , 2 , , n ,
where H S [ f ( x , δ ) ] herein is an integral expression of f k ( x ) . When the CDs Φ k and the expected values e k of δ k are known, it can be expressed as Equation (31).

5.2. Mean-Entropy and Mean-Semi-Entropy Optimization Models in Cost-Oriented Problems

For cost-oriented problems under uncertain environments, a decision maker usually wants to keep the costs within reasonable boundaries with the risks controllable rather than minimize the costs for unpredictable risks. In such a situation, using fuzzy parameters to express the costs of the choices and entropy to measure the risks, then the general paradigm of a mean-entropy optimization model with the objective of entropy minimization under certain expected constraints is:
min H [ f ( x , δ ) ] subject   to : E [ f ( x , δ ) ] β E [ g i ( x , δ ) ] 0 , i = 1 , 2 , , n ,
where f ( x , δ ) is the overall cost, g i ( x , δ ) are constraint functions, and β is a predetermined constant denoting the upper limits of the expected cost.
Compared with the lower semi-entropy measuring the downside risk that the return is less than the expected value, the upper semi-entropy weighing the upside risk that the cost exceeds the expected value is more applicable in this case. Thus, the mean-semi-entropy optimization model of minimizing the upper semi-entropy can be established to handle cost-oriented problems as follows,
min H S [ f ( x , δ ) ] + subject   to : E [ f ( x , δ ) ] β E [ g i ( x , δ ) ] 0 , i = 1 , 2 , , n ,
where H S [ f ( x , δ ) ] + is the upper semi-entropy of the overall cost.
Similarly, when f ( x , δ ) and g i ( x , δ ) are linear with respect to fuzzy parameters δ k , Models (40) and (41) can be transformed into:
min H [ δ 1 ] | f 1 ( x ) | + H [ δ 2 ] | f 2 ( x ) | + + H [ δ m ] | f m ( x ) | subject   to : f 0 ( x ) + E [ δ 1 ] f 1 ( x ) + E [ δ 2 ] f 2 ( x ) + + E [ δ m ] f m ( x ) β g i 0 ( x ) + E [ δ 1 ] g i 1 ( x ) + E [ δ 2 ] g i 2 ( x ) + + E [ δ m ] g i m ( x ) 0 , i = 1 , 2 , , n
and:
min H S [ f ( x , δ ) ] + subject   to : f 0 ( x ) + E [ δ 1 ] f 1 ( x ) + E [ δ 2 ] f 2 ( x ) + + E [ δ m ] f m ( x ) β g i 0 ( x ) + E [ δ 1 ] g i 1 ( x ) + E [ δ 2 ] g i 2 ( x ) + + E [ δ m ] g i m ( x ) 0 , i = 1 , 2 , , n ,
where H [ δ k ] and E [ δ k ] are the entropies and expectations of δ k , k = 1 , 2 , , m , respectively, and H S [ f ( x , δ ) ] + herein is an integral expression of f k ( x ) like Equation (32) when Φ k and e k are known.
In brief, when the objective and constraints are linear functions of the fuzzy parameters, the generalized FP models above can be transformed into their equivalent forms like Model (38), (39), (42), or (43). Since the CDs Φ i of the fuzzy parameters tend to be known in practice, the expectations E [ δ i ] and entropies H [ δ i ] (semi-entropies H S [ f ] , H S [ f ] + ) in these models can be derived by the proposed calculation formulas in advance, and then, the models turn into crisp linear or nonlinear programming models not including uncertain operators and can be solved by classical mathematical optimization methods or algorithms readily with the help of software.

5.3. Numerical Examples

In this section, a portfolio selection problem and a project selection problem are illustrated to show the solution framework of the two types of entropy optimization models, respectively. The results are solved by MATLAB 2015a.
Example 15.
This example is illustrated to compare the performance and differences of the mean-entropy and mean-semi-entropy optimization models for return-oriented problems, where the fuzzy parameters δ i are triangular fuzzy numbers.
Suppose that an investor would like to build a portfolio from four stocks in which Stock 1 is a junk equity with large downside risks, Stock 2 is a plain and stable equity, Stock 3 is a blue chip, and Stock 4 is a growth equity. Denote by δ i the fuzzy return of stock i, and the parameters of the four stocks are presented in Table 1, in which the expected values and entropies are calculated by Equations (13) and (16).
Denote by a the lower limit of the expected overall return. In this example, the investor expects to minimize the uncertainty of obtaining a return greater than a. Thus, the entropy optimization models in light of Models (36) and (37) are:
min H [ δ 1 x 1 + δ 2 x 2 + δ 3 x 3 + δ 4 x 4 ] subject   to : E [ δ 1 x 1 + δ 2 x 2 + δ 3 x 3 + δ 4 x 4 ] a x 1 + x 2 + x 3 + x 4 = 1 x i 0 , i = 1 , 2 , 3 , 4 and : min H S [ δ 1 x 1 + δ 2 x 2 + δ 3 x 3 + δ 4 x 4 ] subject   to : E [ δ 1 x 1 + δ 2 x 2 + δ 3 x 3 + δ 4 x 4 ] a x 1 + x 2 + x 3 + x 4 = 1 x i 0 , i = 1 , 2 , 3 , 4 ,
respectively, where x i is the proportion allocated to stock i.
Since the overall return δ 1 x 1 + δ 2 x 2 + δ 3 x 3 + δ 4 x 4 is linear with respect to δ i , i = 1 , 2 , 3 , 4 , the equivalent formulations according to Models (38) and (39) and Table 1 are:
min 3.5 x 1 + 2 x 2 + 3.5 x 3 + 6 x 4 subject   to : 1.75 x 1 + 2.5 x 2 + 3.75 x 3 + 3 x 4 a x 1 + x 2 + x 3 + x 4 = 1 x i 0 , i = 1 , 2 , 3 , 4 and : min H S [ δ 1 x 1 + δ 2 x 2 + δ 3 x 3 + δ 4 x 4 ] subject   to : 1.75 x 1 + 2.5 x 2 + 3.75 x 3 + 3 x 4 a x 1 + x 2 + x 3 + x 4 = 1 x i 0 , i = 1 , 2 , 3 , 4 .
Obviously, the mean-entropy model on the left is a linear programming, which can be precisely solved by a software package. The mean-semi-entropy model on the right is a nonlinear programming in which the objective can be explicitly expressed by Equation (31) since δ 1 x 1 + δ 2 x 2 + δ 3 x 3 + δ 4 x 4 is also a triangular fuzzy number whose parameters are linear functions of x i , i = 1 , 2 , 3 , 4 , and therefore, it can be easily solved by the MATLAB toolbox.
With the help of MATLAB 2015a, the optimal portfolios under the mean-entropy and mean-semi-entropy models with different lower limits of the expected overall returns a can be obtained as shown in Table 2 and Figure 3. It can be seen from the left side of Table 2 that the coefficients of x 1 and x 4 are all 0, i.e., only stocks 2 and 3 are included in the optimal portfolio, and the lower limit of the expected overall return merely influences the proportion allocated to them. The results can well explain that entropy represents the uncertainty of both high and low extreme returns, thereby the mean-entropy optimization model excludes Stock 1, which has the potential to lose 60%, and Stock 4, which can potentially reach a return of 90% simultaneously.
As shown in the right side of Table 2 and Figure 3, the optimal portfolios under the semi-entropy optimization model are more distributed, since Stock 4 is included in the portfolios and the proportions allocated to it are more than 20%. Besides, the higher return the investor expects, the higher the proportion allocated to Stock 4 is, indicating that investors who expect higher returns are willing to take higher risks and buy fluctuating stocks. Nevertheless, Stocks 2 and 3 still occupy the majority of the investments, and the coefficients of x 1 are still zero, which is in line with the actual decision-making mode that investors tend to invest large amounts of money in stable assets and reserve a small percentage for risky investments except for junk stocks, which may cause heavy losses, but gain little profits, then realize steady appreciation. The results imply that using semi-entropy as a risk measure can perfectly get rid of junk stocks and does not miss potentially high-return stocks. What is more, owing to the higher expected return of Stock 4, the expected return of the portfolio obtained by the mean-semi-entropy model is higher than that of the mean-entropy model at each lower limit. Note that since entropy measures bilateral uncertainty, yet lower semi-entropy weighs downside risks, the entropies are naturally larger than the semi-entropies, as shown in Table 2.
Example 16.
This example is used to illustrate the entropy and semi-entropy optimization models of cost-oriented problems, where the fuzzy parameters δ i are triangular fuzzy numbers.
Consider a company that plans to develop some new products. There are four products whose R&D costs are supposed to be triangular fuzzy numbers. Let x i denote the proportion allocated to product i for i = 1 , 2 , 3 , 4 , respectively, δ i the fuzzy cost of developing product i, and b the upper limit of the expected total cost. The parameters of the four products are represented in Table 3, in which the expected values and entropies are calculated by Equations (13) and (16).
In this example, if the company hopes to pay a total cost less than the upper limit b and minimize the uncertainty of the expenditure simultaneously, then the entropy optimization models are:
min H [ δ 1 x 1 + δ 2 x 2 + δ 3 x 3 + δ 4 x 4 ] subject   to : E [ δ 1 x 1 + δ 2 x 2 + δ 3 x 3 + δ 4 x 4 ] b x 1 + x 2 + x 3 + x 4 = 1 x i 0 , i = 1 , 2 , 3 , 4 and : min H S [ δ 1 x 1 + δ 2 x 2 + δ 3 x 3 + δ 4 x 4 ] subject   to : E [ δ 1 x 1 + δ 2 x 2 + δ 3 x 3 + δ 4 x 4 ] b x 1 + x 2 + x 3 + x 4 = 1 x i 0 , i = 1 , 2 , 3 , 4 .
Further, according to Models (42) and (43) and Table 3, the equivalent formulations of the above models are:
min 3.5 x 1 + 2 x 2 + 5 x 3 + 5.5 x 4 subject   to : 7.25 x 1 + 8.5 x 2 + 11.5 x 3 + 7.75 x 4 b x 1 + x 2 + x 3 + x 4 = 1 x i 0 , i = 1 , 2 , 3 , 4 and : min H S [ δ 1 x 1 + δ 2 x 2 + δ 3 x 3 + δ 4 x 4 ] + subject   to : 7.25 x 1 + 8.5 x 2 + 11.5 x 3 + 7.75 x 4 b x 1 + x 2 + x 3 + x 4 = 1 x i 0 , i = 1 , 2 , 3 , 4 .
Similar to Example 15, the left model is a linear programming, and the right one is a nonlinear programming. By using MATLAB 2015a, the comparative results are obtained and shown in Table 4 and Figure 4. As we can see, no matter how much the upper limit is, the mean-entropy model keeps selecting Product 1, which has the potential to reach the lowest cost at three million dollars, and Product 2, which is most stable with the same maximum cost as Product 1. Besides, the higher the total cost that can be tolerated, the higher the proportion allocated to Product 2 is, since the expected total cost is closer to the expected cost of Product 2 and entropy dominates. By contrast, in the schemes obtained by the mean-semi-entropy optimization model, Product 1 accounts for more proportion, and Product 4 is included. As mentioned before, Product 1 is better than Product 2 from the perspective of cost; therefore, it is a better choice to invest more in Product 1. On the other hand, with the increase of the proportion distributed to Product 1, the total expected cost is decreased, and there are more chances to select the fluctuating Product 4. The semi-entropy optimization model can reach a much lower minimum total cost and therefore is recommended.
Together, we can see from the foregoing numerical examples that the results of the mean-entropy and mean-semi-entropy models are quite different, despite that they both rule out the alternatives with undesirable extreme values. Specifically, the mean-entropy model tends to construct concentrative schemes with stable alternatives, since entropy takes both sides of derivation as risks and excludes the alternatives with favorable extreme values mistakenly. Conversely, the mean-semi-entropy model prefers more distributive schemes, as semi-entropies measuring one-side risks retain the favorable extreme ones. As a consequence, the expectations of the mean-semi-entropy models are more desirable, i.e., the schemes derived from the mean-semi-entropy models have higher expected overall returns and lower expected total costs than those of the mean-entropy models.

5.4. Discussion

As shown above, entropy and semi-entropies can extensively serve as risk measures in FP for decision-making problems, whereas solving these models is incredibly complicated since the existing formulas are functions with uncertain measures. In comparison, based on the simplified calculation formulas proposed in this paper, the models are easily solved. Besides, when the objective and constraints in the optimization models are linear functions of the fuzzy numbers, the models can be defuzzified to the equivalent forms and solved by software more directly. Since lower and upper semi-entropies characterize bilateral uncertainty better, the mean-semi-entropy models turn out to be more reasonable with more distributed schemes, according to the results of Examples 15 and 16.

6. Conclusions

In the present work, we mainly concentrated on simplifying the calculations of entropy and semi-entropies in fuzzy environments and applying them in FP modeling as measures of weighing the uncertainty. All the fuzzy numbers δ in this paper were set as the regular LR type, which is most commonly used, and f was assumed to be a strictly monotone function of all the fuzzy numbers. The related work of the present work is summarized in Table 5, in which the contributions of this study (i.e., the concept of upper semi-entropy, the formulas of calculating the entropy and semi-entropies via the ICDs, the mean-entropy and mean-semi-entropy optimization models, as well as their equivalent models) are bold and colored.
To be specific, on the theoretical side, with the purpose of increasing the efficiency and expanding the application scope of these measures, some formulas for calculating the entropies and semi-entropies of a linear function with fuzzy numbers via the ICDs were proposed and verified. Compared with the formula via CF as Equation (15) (see Definition 6), calculating entropy by Equation (19) via ICD was simplified since the function S in the original definition was removed. Accordingly, the entropy of a linear function λ 1 δ 1 + λ 2 δ 2 + + λ n δ n can be calculated readily based on Equation (21). Besides, in comparison with the lower semi-entropy as Equation (22) proposed by Zhou et al. [39], which weighs downside risks, Equation (31) gives a simplified calculation formula similar to Equation (19) for entropy, and the formula for calculating the semi-entropy of a linear function can be expressed explicitly as Equation (31). Inspired by the lower semi-entropy, the concept of upper semi-entropy (Equation (25)) for measuring upside risk was put forward for the first time, and the calculating formula was derived as Equation (32).
With regard to the applications, contrary to Model (36) with a narrow application range and an incredibly complicated solving process induced by uncertain measures, two types of entropy optimization models by the calculation formulas above were formulated from a new perspective. First, Model (36) was generalized to all the return-oriented problems, and by the simplified formula Equation (19), it could be solved by a software package. Besides, owing to the good characterization of downside risks by lower semi-entropy, Model (37), which is supported by Equation (31), was proposed for comparison. When the objective and the constraints in the optimization models are linear functions of the fuzzy numbers, the models can be defuzzified to the equivalent forms as models (38) and (39) following from Equations (21) and (31) and solved by software directly. On the other hand, in terms of the cost-oriented problems, the models were formulated in a similar way. The mean-semi-entropy models were demonstrated to be more reasonable (refer to Examples 15 and 16).
To sum up, the primary results of this paper include the following aspects: (1) a formula for calculating the entropy of a regular LR fuzzy number via the CD and ICD was put forward, and it was verified that the entropy can be figured out in a simple way with the formula; (2) a formula for calculating the entropy of the widely-used linear function was proposed, which is quite general and can be extended to the cases where the fuzzy numbers are of different types; (3) the concepts of lower and upper semi-entropies, which have the advantage of measuring the one-side uncertainty, were introduced, and the corresponding formulas to calculate that of a linear function with regular LR fuzzy numbers were raised; (4) from the perspective of cost and return, respectively, two types of generalized entropy optimization models were proposed, and the equivalent formulations with regard to the special cases where the objective and constraints are linear functions of the fuzzy parameters were given, providing an effective method to modeling FP problems via entropy and semi-entropies.

Author Contributions

Formal analysis, C.H. and H.L.; methodology, C.H. and M.Z.; supervision, J.Z.; validation, M.Z. and H.L.; visualization, C.H. and H.L.; writing, original draft, H.L.; writing, review and editing, J.Z.; funding acquisition, J.Z.

Funding

This research was funded by the National Natural Science Foundation of China under Grant Number 71872110.

Acknowledgments

We thank the anonymous reviewers for their helpful suggestions, which led to substantial improvements of the paper.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
CDcredibility distribution
CFcredibility function
FPfuzzy programming
ICDinverse credibility distribution
MFmembership function

References

  1. Ehsani, E.; Kazemi, N.; Olugu, E.U.; Eric, H.; Grosse, E.H.; Schwindl, K. Applying fuzzy multi-objective linear programming to a project management decision with nonlinear fuzzy membership functions. Neural Comput. Appl. 2017, 28, 2193–2206. [Google Scholar] [CrossRef]
  2. Zhang, Q.; Zhou, J.; Wang, K.; Pantelous, A.A. An effective solution approach to fuzzy programming with application to project scheduling. Int. J. Fuzzy Syst. 2018, 20, 2383–2398. [Google Scholar] [CrossRef]
  3. Su, T. A fuzzy multi-objective linear programming model for solving remanufacturing planning problems with multiple products and joint components. Comput. Ind. Eng. 2017, 110, 242–254. [Google Scholar] [CrossRef]
  4. Su, T.; Wu, C.; Yang, H. An analysis of energy consumption and cost-effectiveness for overhead crane drive systems by using fuzzy multi-objective linear programming. J. Intell. Fuzzy Syst. 2018, 35, 6241–6253. [Google Scholar] [CrossRef]
  5. Yin, D. Application of interval valued fuzzy linear programming for stock portfolio optimization. Appl. Math. 2018, 9, 101–113. [Google Scholar] [CrossRef]
  6. Zadeh, L.A. Fuzzy sets. Inf. Control 1965, 8, 338–353. [Google Scholar] [CrossRef] [Green Version]
  7. Zadeh, L.A. Probability measures of fuzzy events. J. Math. Anal. Appl. 1968, 23, 421–427. [Google Scholar] [CrossRef]
  8. Shannon, C.E. A mathematical theory of communication. Bell Syst. Tech. J. 1948, 27, 379–423. [Google Scholar] [CrossRef]
  9. De Luca, A.; Termini, S. A definition of nonprobabilistic entropy in the setting of fuzzy sets theory. Inf. Control 1972, 20, 301–312. [Google Scholar] [CrossRef]
  10. Trillas, E.; Riera, T. Entropies in finite fuzzy sets. Inf. Sci. 1978, 15, 159–168. [Google Scholar] [CrossRef]
  11. Kosko, B. Fuzzy entropy and conditioning. Inf. Sci. 1986, 40, 165–174. [Google Scholar] [CrossRef]
  12. Pal, N.R.; Pal, S.K. Object-background segmentation using new definitions of entropy. IEE Proc. E (Comput. Digit. Tech.) 1989, 136, 284–295. [Google Scholar] [CrossRef] [Green Version]
  13. Pal, N.R.; Pal, S.K. Higher order fuzzy entropy and hybrid entropy of a set. Inf. Sci. 1992, 61, 211–231. [Google Scholar] [CrossRef] [Green Version]
  14. Zhou, R.; Cai, R.; Tong, G. Applications of entropy in finance: A review. Entropy 2013, 15, 4909–4931. [Google Scholar] [CrossRef]
  15. Gao, J.; Liu, H. A risk-free protection index model for portfolio selection with entropy constraint under an uncertainty framework. Entropy 2017, 19, 80. [Google Scholar] [CrossRef]
  16. Zhou, R.; Liu, X.; Yu, M.; Huang, K. Properties of risk measures of generalized entropy in portfolio selection. Entropy 2017, 19, 657. [Google Scholar] [CrossRef]
  17. Gao, R.; Ralescu, D.A. Elliptic entropy of uncertain set and its applications. Int. J. Intell. Syst. 2018, 33, 836–857. [Google Scholar] [CrossRef]
  18. Zadeh, L.A. Fuzzy sets as a basis for a theory of possibility. Fuzzy Sets Syst. 1978, 1, 3–28. [Google Scholar] [CrossRef]
  19. Zadeh, L.A. A theory of approximate reasoning. Mach. Intell. 1979, 9, 149–194. [Google Scholar]
  20. Chen, X.; Dai, W. Maximum entropy principle for uncertain variables. Int. J. Fuzzy Syst. 2011, 13, 232–236. [Google Scholar]
  21. Li, P.; Liu, B. Entropy of credibility distributions for fuzzy variables. IEEE Trans. Fuzzy Syst. 2008, 16, 123–129. [Google Scholar]
  22. Liu, B.; Liu, Y. Expected value of fuzzy variable and fuzzy expected value models. IEEE Trans. Fuzzy Syst. 2002, 10, 445–450. [Google Scholar]
  23. Gao, X.; You, C. Maximum entropy membership functions for discrete fuzzy variables. Inf. Sci. 2009, 179, 2353–2361. [Google Scholar] [CrossRef]
  24. Chen, X.; Dai, W. Entropy of function of uncertain variables. Math. Comput. Model. 2012, 55, 754–760. [Google Scholar]
  25. Huang, X. Mean-entropy models for fuzzy portfolio selection. IEEE Trans. Fuzzy Syst. 2008, 16, 1096–1101. [Google Scholar] [CrossRef]
  26. Huang, X. A review of credibilistic portfolio selection. Fuzzy Optim. Decis. Mak. 2009, 8, 263–281. [Google Scholar] [CrossRef]
  27. Yang, L.; Li, K.; Gao, Z. Train timetable problem on a single-line railway with fuzzy passenger demand. IEEE Trans. Fuzzy Syst. 2009, 17, 617–629. [Google Scholar] [CrossRef]
  28. Lau, H.C.W.; Jiang, Z.; Ip, W.H.; Wang, D.W. A credibility-based fuzzy location model with Hurwicz criteria for the design of distribution systems in B2C e-commerce. Comput. Ind. Eng. 2010, 59, 873–886. [Google Scholar] [CrossRef]
  29. Li, X.; Qin, Z.; Ralescu, D.A. Credibilistic parameter estimation and its application in fuzzy portfolio selection. Iran. J. Fuzzy Syst. 2011, 8, 57–65. [Google Scholar]
  30. Ning, Y.; Ke, H.; Fu, Z. Triangular entropy of uncertain variables with application to portfolio selection. Methodol. Appl. 2015, 19, 2203–2209. [Google Scholar] [CrossRef]
  31. Zhou, J.; Li, X.; Kar, S.; Zhang, G.; Yu, H. Time consistent fuzzy multi-period rolling portfolio optimization with adaptive risk aversion factor. J. Amb. Intel. Hum. Comp. 2017, 8, 651–666. [Google Scholar] [CrossRef]
  32. Zhou, J.; Yang, F.; Wang, K. Fuzzy arithmetic on LR fuzzy numbers with applications to fuzzy programming. J. Intell. Fuzzy Syst. 2016, 30, 71–87. [Google Scholar] [CrossRef]
  33. Dubois, D.; Prade, H. Operations on fuzzy numbers. Int. J. Syst. Sci. 1978, 9, 613–626. [Google Scholar] [CrossRef]
  34. Liu, B. Membership functions and operational law of uncertain sets. Fuzzy Optim. Decis. Mak. 2012, 11, 387–410. [Google Scholar] [CrossRef]
  35. Yao, K.; Ke, H. Entropy operator for membership function of uncertain set. Appl. Math. Comput. 2014, 242, 898–906. [Google Scholar] [CrossRef]
  36. Dubois, D.; Prade, P. Possibility Theory; Springer: Boston, MA, USA, 1988. [Google Scholar]
  37. Li, X. Credibilistic Programming; Springer: Berlin, Germany, 2013. [Google Scholar]
  38. Liu, Y.; Liu, B. Expected value operator of random fuzzy variable and random fuzzy expected value models. Int. J. Uncertain Fuzz. 2003, 11, 195–215. [Google Scholar] [CrossRef]
  39. Zhou, J.; Li, X.; Pedrycz, W. Mean-semi-entropy models of fuzzy portfolio selection. IEEE Trans. Fuzzy Syst. 2016, 24, 1627–1636. [Google Scholar] [CrossRef]
Figure 1. Membership functions (MFs) of the fuzzy numbers in Equations (2)–(5) in Examples 1–4. (a) Triangular T ( a , b , c ) L R , (b) parabolic P ( a , b , c ) L R , and (c) normal N ( a , b , c ) L R , (d) mixture M ( a , b , c ) L R .
Figure 1. Membership functions (MFs) of the fuzzy numbers in Equations (2)–(5) in Examples 1–4. (a) Triangular T ( a , b , c ) L R , (b) parabolic P ( a , b , c ) L R , and (c) normal N ( a , b , c ) L R , (d) mixture M ( a , b , c ) L R .
Entropy 21 00697 g001
Figure 2. The function S ( t ) in Definition 6.
Figure 2. The function S ( t ) in Definition 6.
Entropy 21 00697 g002
Figure 3. Optimal portfolios and expected overall returns of the portfolios derived by the mean-entropy and mean-semi-entropy optimization models under different lower limits a in Example 15. The bars in two (three) colors stand for the allocation schemes in the mean-entropy (mean-semi-entropy) model, and the line in brown (green) represents the expected return of each portfolio.
Figure 3. Optimal portfolios and expected overall returns of the portfolios derived by the mean-entropy and mean-semi-entropy optimization models under different lower limits a in Example 15. The bars in two (three) colors stand for the allocation schemes in the mean-entropy (mean-semi-entropy) model, and the line in brown (green) represents the expected return of each portfolio.
Entropy 21 00697 g003
Figure 4. Optimal schemes and corresponding expected total costs obtained by the mean-entropy and mean-semi-entropy optimization models under different upper limits b in Example 16. The bars in two (three) colors stand for the allocation schemes in the mean-entropy (mean-semi-entropy) model, and the line in brown (green) represents the expected return of each scheme.
Figure 4. Optimal schemes and corresponding expected total costs obtained by the mean-entropy and mean-semi-entropy optimization models under different upper limits b in Example 16. The bars in two (three) colors stand for the allocation schemes in the mean-entropy (mean-semi-entropy) model, and the line in brown (green) represents the expected return of each scheme.
Entropy 21 00697 g004
Table 1. Parameter settings, ranges of returns, expected values and entropies of δ 1 , δ 2 , δ 3 , δ 4 in Example 15. The fuzzy numbers are all triangular fuzzy numbers in units of ten percent (e.g., the return of Stock 1 ranges from 60 % 10 % ).
Table 1. Parameter settings, ranges of returns, expected values and entropies of δ 1 , δ 2 , δ 3 , δ 4 in Example 15. The fuzzy numbers are all triangular fuzzy numbers in units of ten percent (e.g., the return of Stock 1 ranges from 60 % 10 % ).
No.Fuzzy NumberRangeExpected ValueEntropy
1 δ 1 T ( 1 , 5 , 2 ) L R [ 6 , 1 ] 1.75 3.50
2 δ 2 T ( 2 , 1 , 3 ) L R [ 1 , 5 ] 2.50 2.00
3 δ 3 T ( 3 , 2 , 5 ) L R [ 1 , 8 ] 3.75 3.50
4 δ 4 T ( 3 , 6 , 6 ) L R [ 3 , 9 ] 3.00 6.00
Table 2. Comparative results of the entropy optimization models in Example 15, including optimal portfolios, expected overall returns, and entropies (semi-entropies). With different expected returns a, the mean-entropy model keeps selecting Stocks 2 and 3 only, whereas the mean-semi-entropy model includes Stocks 2, 3, and 4 in the portfolios.
Table 2. Comparative results of the entropy optimization models in Example 15, including optimal portfolios, expected overall returns, and entropies (semi-entropies). With different expected returns a, the mean-entropy model keeps selecting Stocks 2 and 3 only, whereas the mean-semi-entropy model includes Stocks 2, 3, and 4 in the portfolios.
aMean-Entropy ModelMean-Semi-Entropy Model
x 1 x 2 x 3 x 4 MeanEntropy x 1 x 2 x 3 x 4 MeanLower Semi-Entropy
2.9000.680.3202.902.4800.480.280.242.971.54
3.0000.600.4003.002.6000.400.360.243.071.61
3.1000.520.4803.102.7200.320.420.263.151.69
3.2000.440.5603.202.8400.200.490.313.271.83
3.3000.360.6403.302.9600.120.550.323.351.91
3.4000.280.7203.403.0800.030.620.343.452.01
Table 3. Parameter settings, expected values, and entropies of δ 1 , δ 2 , δ 3 , δ 4 in Example 16. The fuzzy numbers are all triangular fuzzy numbers in units of millions of dollars (e.g., the R&D cost of Product 1 ranges from 3 million–10 million dollars).
Table 3. Parameter settings, expected values, and entropies of δ 1 , δ 2 , δ 3 , δ 4 in Example 16. The fuzzy numbers are all triangular fuzzy numbers in units of millions of dollars (e.g., the R&D cost of Product 1 ranges from 3 million–10 million dollars).
No.Fuzzy NumberRangeExpected ValueEntropy
1 δ 1 T ( 8 , 5 , 2 ) L R [ 3 , 10 ] 7.25 3.50
2 δ 2 T ( 9 , 3 , 1 ) L R [ 6 , 10 ] 8.50 2.00
3 δ 3 T ( 10 , 2 , 8 ) L R [ 8 , 18 ] 11.50 5.00
4 δ 4 T ( 8 , 6 , 5 ) L R [ 2 , 13 ] 7.75 5.50
Table 4. Comparative results of the entropy optimization models in Example 16, including optimal schemes, expected total costs, and entropies (semi-entropies). With different upper limits b, the mean-entropy model keeps selecting Products 1 and 2 only, whereas the mean-semi-entropy model selects Products 1, 2, and 4.
Table 4. Comparative results of the entropy optimization models in Example 16, including optimal schemes, expected total costs, and entropies (semi-entropies). With different upper limits b, the mean-entropy model keeps selecting Products 1 and 2 only, whereas the mean-semi-entropy model selects Products 1, 2, and 4.
bMean-Entropy ModelMean-Semi-Entropy Model
x 1 x 2 x 3 x 4 MeanEntropy x 1 x 2 x 3 x 4 MeanUpper Semi-Entropy
7.900.480.52007.902.720.500.4600.047.841.26
8.000.400.60008.002.600.470.4800.057.871.25
8.100.320.68008.102.480.420.5200.067.931.24
8.200.240.76008.202.360.280.6600.068.111.14
8.300.160.84008.302.240.170.7700.068.241.08
8.400.080.92008.402.120.080.8500.078.341.03
Table 5. A summary of the calculation formulas and fuzzy programming models in this paper.
Table 5. A summary of the calculation formulas and fuzzy programming models in this paper.
MeansObjectMethodologyMechanismCharacteristic
Calculation formulasCr-based entropyEquation (15)Credibility functionComplex operation
Equations  (19) and (21)Inverse credibility distributionSimplified operation and favorable property of linear functions
Semi-entropiesEquation (22)Credibility functionLower semi-entropy targeting to downside risks (complex operation)
Equations (25), (31) and (32)Inverse credibility distributionInitializing concept of upper semi-entropy (simplified operation)
Fuzzy programming modelsReturn-orientedModel (36)Equation (15)Model with uncertain measures (solved only by custom algorithms)
Models (37)–(39)Equations (19), (21), (31)Mean-semi-entropy model and crisp equivalent forms (easily solved)
Cost-orientedModels (40)–(43)Equations (19), (21), (32)Novel perspective and equivalent models with simple solving process

Share and Cite

MDPI and ACS Style

Zhou, J.; Huang, C.; Zhao, M.; Li, H. Entropy and Semi-Entropies of LR Fuzzy Numbers’ Linear Function with Applications to Fuzzy Programming. Entropy 2019, 21, 697. https://doi.org/10.3390/e21070697

AMA Style

Zhou J, Huang C, Zhao M, Li H. Entropy and Semi-Entropies of LR Fuzzy Numbers’ Linear Function with Applications to Fuzzy Programming. Entropy. 2019; 21(7):697. https://doi.org/10.3390/e21070697

Chicago/Turabian Style

Zhou, Jian, Chuan Huang, Mingxuan Zhao, and Hui Li. 2019. "Entropy and Semi-Entropies of LR Fuzzy Numbers’ Linear Function with Applications to Fuzzy Programming" Entropy 21, no. 7: 697. https://doi.org/10.3390/e21070697

APA Style

Zhou, J., Huang, C., Zhao, M., & Li, H. (2019). Entropy and Semi-Entropies of LR Fuzzy Numbers’ Linear Function with Applications to Fuzzy Programming. Entropy, 21(7), 697. https://doi.org/10.3390/e21070697

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop