Calibration Invariance of the MaxEnt Distribution in the Maximum Entropy Principle

Abstract

The maximum entropy principle consists of two steps: The first step is to find the distribution which maximizes entropy under given constraints. The second step is to calculate the corresponding thermodynamic quantities. The second part is determined by Lagrange multipliers’ relation to the measurable physical quantities as temperature or Helmholtz free energy/free entropy. We show that for a given MaxEnt distribution, the whole class of entropies and constraints leads to the same distribution but generally different thermodynamics. Two simple classes of transformations that preserve the MaxEnt distributions are studied: The first case is a transform of the entropy to an arbitrary increasing function of that entropy. The second case is the transform of the energetic constraint to a combination of the normalization and energetic constraints. We derive group transformations of the Lagrange multipliers corresponding to these transformations and determine their connections to thermodynamic quantities. For each case, we provide a simple example of this transformation.

1. Introduction

The maximum entropy principle (MEP) is one of the most fundamental concepts in equilibrium statistical mechanics. It was originally proposed by Jaynes [1,2] in order to connect information entropy introduced by Shannon and thermodynamic entropy introduced by Clausius, Boltzmann, and Gibbs. Although the MEP was originally introduced for the case of Shannon entropy, with the advent of generalized entropies [3,4,5,6,7,8,9,10,11,12,13,14,15,16,17] the natural effort was to apply the maximum entropy principle beyond the case of Shannon entropy. Another question that arose naturally is whether the MEP can be applied to other than ordinary linear constraints. Examples of the constraints that might be considered in connection with the MEP are escort constraints [18,19,20], Kolmogorov–Nagumo means [21,22], or more exotic types of constraints [23]. It brought some discussion about the applicability of the principle for the case of generalized entropies [24,25] and nonlinear constraints and its thermodynamic interpretation [26,27,28,29,30]. Indeed, MEP is not the only one extremal principle in statistical physics, let us mention, e.g., the principle of maximum caliber [31] which is useful in non-equilibrium physics. In this paper, we stick, however, to MEP, as it is the most widespread principle and the theory of generalized thermostatistics has been mainly focused on MEP. For a recent review of other principles, see also in [32]. For the discussion between entropy arising from information theory and thermodynamics, see in [33]. For the sake of simplicity, let us consider canonical ensemble, i.e., fluctuations in internal energy. For the case of the grand-canonical ensemble, one can obtain similar results to the ones presented in this paper for the case of a chemical potential $\mu$.

In order to grasp the debate about the applicability of the MEP, let us emphasize that the MEP consists of two main parts:

(I)

Finding a distribution (MaxEnt distribution) that maximizes entropy under given constraints.

(II)

Plugging the distribution into the entropic functional and calculating physical quantities as thermodynamic potentials, temperature, or response coefficients (specific heat, compressibility, etc.).

The first part is rather a mathematical procedure of finding a maximum subject to constraints. This is done by the method of Lagrange multipliers, by defining a Lagrange function in the form

$$Lagrangefunction=entropy-\left(Lagrangemultiplier\right)·\left(constraint\right)$$

The Lagrange multipliers’ role at this stage is to ensure fulfillment of constraints as they are determined from the set of equations obtained from the maximization of the Lagrange function. This procedure is known in statistics as Softmax, a method used to infer distribution from given data. Shore and Johnson [34,35] therefore studied MEP as a statistical inference procedure and established a set of consistency axioms. Shore and Johnson’s work heated a debate about whether MEP for generalized entropies can be also understood as a statistical inference method satisfying the consistency requirements [24,36,37,38,39,40,41]. In [42], it was shown that the class of entropies satisfying the original Shore–Johnson axioms is wider than previously thought. Moreover, in [43], the connection between Shore–Johnson axioms and Shannon–Khinchin axioms was investigated and the equivalence of information theory and statistical inference axiomatics was established.

In the second part, the physical interpretation of entropy starts to arise. Similar to the case of Lagrangian mechanics, where the Lagrangian is the difference between kinetic and potential energy and the Lagrange multipliers play the role of the normal force to the constraints, here the entropy becomes a thermodynamic state variable. For Shannon entropy and linear constraints, the Lagrange multipliers become inverse temperature and free entropy, respectively.

The main aim of this paper is to discuss the relation between points (I) and (II). In the first part, it is possible to find a class of entropic functionals and constraints leading to the same MaxEnt distribution. However, in the second part, different entropy and/or constraints lead to different thermodynamics and different relations between physical quantities and Lagrange multipliers. The two main messages of this paper are listed below.

(i)

For each MaxEnt distribution, there exists the whole class of entropies and constraints leading to generally different thermodynamics.

(ii)

It is possible to establish transformation relations of Lagrange parameters (and subsequently the thermodynamic quantities) for classes of entropies and constraints giving the same MaxEnt distribution.

We call the latter transformation relation calibration invariance of the MaxEnt distribution. A straightforward consequence is that in order to fully determine the statistical properties of a thermal system in equilibrium, it is not enough to measure the statistical distribution of energies.

The rest of the paper is organized as follows. In the next section, we briefly discuss the main aspects of MEP for the case of general entropic functional and general constraints. In the following two sections, we introduce two simple transformations of entropic functional (Section 3) and constraints (Section 4) that lead to the same MaxEnt distribution and derive transformations between the Lagrange multipliers. These transformations form a group. After the general derivation, we provide a few simple examples for each case. The last section is devoted to conclusions.

2. Maximum Entropy Principle in Statistical Physics

Maximum entropy principle is the way of obtaining the representing probability distribution from the limited amount of information. Our aim is to find the probability distribution of the system $P={\left\{p_i\right\}}_{i=1}^n$ under the set of given constraints. In the simplest case, the principle can be formulated as follows.

Maximum entropy principle:Maximize entropy $S\left(P\right)$ under the normalization constraint $f_0\left(P\right)=0$, and energy constraint $f_E\left(P\right)=0$.

The normalization condition is considered in the regular form, i.e., $f_0\left(P\right)={\sum }_i{p}_i-1=\langle 1\rangle -1$. Moreover, we have a class of constraints, which originally described the average energy of the system. Therefore, we call them energy constraints. We consider only one energy constraint, for simplicity, although there can be more constraints, and they do not have to consider only internal energy but also other thermodynamic quantities. In the original formulation, the energy constraint is linear in probabilities, i.e.,

$$f_E\left(P\right)=\sum _i{p}_i{E}_i-E=\langle E\rangle -E,$$

(1)

but it can be generally any nonlinear function of probabilities—escort means provide an example. A large class of energy constraints can be written in a separable form, which means that $f_E\left(P\right)=\mathcal{E}\left(P\right)-E$, i.e., in the form expressing the “expected” internal energy (macroscopic variable) as a function of probability distribution (microscopic variable). This class of constraints plays a dominant role in the thermodynamic systems.

In order to find a solution of the Maximum entropy principle, we use a common method of Lagrange multipliers, which can be done through maximization of Lagrange function:

$$\mathcal{L}(P;\alpha ,\beta )=S\left(P\right)-\alpha f_0\left(P\right)-\beta f_E\left(P\right)$$

(2)

The maximization procedure leads to the set of equations

$$\begin{array}{ccc}\hfill \frac{\partial \mathcal{L}(P;\alpha ,\beta )}{\partial p_i}& =& 0\forall i\in \{1,\dots ,n\}\hfill \\ \hfill \frac{\partial \mathcal{L}(P;\alpha ,\beta )}{\partial \alpha }& =& f_0\left(P\right)=0\hfill \\ \hfill \frac{\partial \mathcal{L}(P;\alpha ,\beta )}{\partial \beta }& =& f_E\left(P\right)=0\hfill \end{array}$$

(3)

from which we determine the resulting MaxEnt distribution. In order to obtain a unique solution, we require that the entropic functional should be a Schur-concave symmetric function [42].

As a consequence, we obtain the values of Lagrange multipliers $\alpha$ and $\beta$. From the strictly mathematical point of view, Lagrange multipliers are just auxiliary parameters to be solved from the set of Equation (3). However, in physics, Lagrange parameters also have a physical interpretation. In Lagrangian mechanics, Lagrange parameters play the role of normal force to the constraints. Similarly, in ordinary statistical mechanics based on Shannon entropy $H\left(P\right)=-{\sum }_i{p}_i\log p_i$ and linear constraints (1), the Lagrange multipliers have the particular physical interpretation:

$$\begin{array}{ccc}\hfill \beta & =& \frac{1}{T}\left(\mathrm{inverse}\mathrm{temperature}\right),\hfill \end{array}$$

(4)

$$\begin{array}{ccc}\hfill \alpha & =& S-\frac{1}{T}E\left(\mathrm{free}\mathrm{entropy}\right).\hfill \end{array}$$

(5)

Note that the free entropy is, similarly to Helmholtz free energy, a Legendre transform of entropy w.r.t. internal energy. For the case of ordinary thermodynamics (Shannon entropy and linear constraints), it is equal to the logarithm of the partition function.

This interpretation is valid only in this case. In the case, when we use different entropy functional or different constraints, these relation between Lagrange multipliers and thermodynamic quantities are no longer valid. This is even the case, when the resulting MaxEnt distribution is the same.

The main aim of this paper is to show how the invariance of MaxEnt distribution affects the Lagrange multipliers and their relations to thermodynamic quantities. Let us now solve Equation (3). The first set of equations leads to

$$\frac{\partial S\left(P\right)}{\partial p_i}-\alpha \frac{\partial f_0\left(P\right)}{\partial p_i}-\beta \frac{\partial f_E\left(P\right)}{\partial p_i}=0.$$

(6)

Let us assume the normalization in the usual way which leads to $\frac{\partial f_0\left(P\right)}{\partial p_i}=1$. Moreover, let us consider separable energy constraint, so $\frac{\partial f_E\left(P\right)}{\partial p_i}=\frac{\partial \mathcal{E}\left(P\right)}{\partial p_i}$. The resulting probability distribution can be expressed as

$$p_i^{\star }={\frac{\partial S}{\partial p_i}}^{(-1)}\left[\alpha +\beta \frac{\partial \mathcal{E}\left(P\right)}{\partial p_i}\right].$$

(7)

where ${}^{(-1)}$ denotes inverse function of $\partial S/\partial p_i$ (provided it exists and is unique). We can express $\alpha$ by multiplying the equation by $p_i$ and summing over i, which leads to

$$\alpha =〈{\nabla }_{P}S\left(P\right)〉-\beta 〈{\nabla }_P\mathcal{E}\left(P\right)〉$$

(8)

where $\langle X\rangle ={\sum }_i{x}_i{p}_i$ and ${\nabla }_P=(\frac{\partial }{\partial p_1},\dots ,\frac{\partial }{\partial p_n})$. By plugging back to the previous equation, we can get $\beta$ as

$$\beta =\frac{{\Delta }_i(\nabla S\left(P\right))}{{\Delta }_i(\nabla \mathcal{E}\left(P\right))}$$

(9)

where ${\Delta }_i\left(X\right)=x_i-\langle X\rangle$ is the difference from the average.

The solution of Equation (3) depends on the internal energy E. However, in thermodynamics it is natural to invert the relation $\beta =\beta \left(E\right)$ and express the relevant quantities in terms of $\beta$, so $E=E\left(\beta \right)$. With that, we can calculate dependence of entropy on $\beta$:

$$\frac{\partial S}{\partial \beta }=\sum _i\frac{\partial S}{\partial p_i}\frac{\partial p_i}{\partial \beta }=\sum _i\left(\alpha +\beta \frac{\partial \mathcal{E}\left(P\right)}{\partial p_i}\right)\frac{\partial p_i}{\partial \beta }=\beta \sum _i\frac{\partial f_E}{\partial p_i}\frac{\partial p_i}{\partial \beta }=\beta \left(-\frac{\partial f_E}{\partial E}\frac{\partial E}{\partial \beta }\right)$$

(10)

For separable energy constraints, $\frac{\partial f_E}{\partial E}=-1$, so we obtain the well-known relation

$$\frac{\partial S}{\partial \beta }=\beta \frac{\partial E}{\partial \beta }\Rightarrow \beta =\frac{\partial S}{\partial E}.$$

(11)

Let us now define the Legendre conjugate of entropy called free entropy (also called Jaynes parameter [44] or Massieu function [45]):

$$\psi =S-\frac{\partial S}{\partial E}E=S-\beta E$$

(12)

Free entropy is connected to Helmholtz free energy as $\psi =-\beta F$. The difference between $\alpha$ and $\psi$ can be expressed as

$$\psi -\alpha =\left(S-\langle {\nabla }_{P}S\rangle \right)-\beta (E-\langle {\nabla }_P\mathcal{E}\rangle )$$

(13)

Therefore, we can understand the difference $\psi -\alpha$ as the Legendre transform of $\psi$ with respect to P. From this, we see that the difference between $\psi$ and $\alpha$ is a constant (not depending on thermodynamic quantities), if two independent conditions are fulfilled, i.e., $E=\langle {\nabla }_P\mathcal{E}\left(P\right)\rangle$ and $S=\langle {\nabla }_{P}S\rangle +a$. The former constraint leads to linear energy constraints, while the latter one leads to the the conclusion that the entropy must be in trace form $S\left(P\right)={\sum }_{i}g\left(p_i\right)$. Moreover, the function g has to fulfill the following equation,

$$g\left(x\right)-ax=x{g}^{\prime }\left(x\right)$$

(14)

leading to $g\left(x\right)=-ax\log \left(x\right)+bx$ which is equivalent to Shannon entropy.

In the next sections, we will explore how the transformation of the entropy and the energy constraint that leaves the MaxEnt distribution invariant affects the Lagrange multipliers and their relation to thermodynamic quantities.

3. Calibration Invariance of MaxEnt Distribution with Entropy Transformation

The simplest transformation of Lagrange functional that leaves the MaxEnt distribution invariant is to consider an arbitrary increasing function of entropy, i.e., we replace $S\left(P\right)$ by $c\left(S\right(P\left)\right)$, where $c^{\prime }\left(x\right)>0$. Let us note that this transform preserves the uniqueness of the MEP because it is easy to show that if $S\left(P\right)$ is Schur-concave, $c\left(S\right(P\left)\right)$ is also Schur-concave [42] which is a sufficient condition for uniqueness of the MaxEnt distribution.

In this case, the Lagrange equations are adjusted as follows,

$$c^{\prime }\left(S\left(P\right)\right)\frac{\partial S\left(P\right)}{\partial p_i}-{\alpha }_c\frac{\partial f_0\left(P\right)}{\partial p_i}-{\beta }_c\frac{\partial \mathcal{E}\left(P\right)}{\partial p_i}=0$$

(15)

leading to

$${\alpha }_c=c^{\prime }\left(S\left(P\right)\right)〈{\nabla }_{P}S\left(P\right)〉-{\beta }_c〈{\nabla }_P\mathcal{E}\left(P\right)〉$$

(16)

and

$${\beta }_c=c^{\prime }\left(S\left(P\right)\right)\frac{{\Delta }_i\left({\nabla }_{P}S\left(P\right)\right)}{{\Delta }_i\left({\nabla }_P\mathcal{E}\left(P\right)\right)}$$

(17)

so we get that the function c causes rescaling of $\alpha$ and $\beta$, so

$$\begin{array}{c}\hfill {\alpha }_c=c^{\prime }\left(S\left(P\right)\right)\alpha \end{array}$$

(18)

$$\begin{array}{c}\hfill {\beta }_c=c^{\prime }\left(S\left(P\right)\right)\beta \end{array}$$

(19)

while its ratio remains unchanged, i.e., ${\alpha }_c/{\beta }_c=\alpha /\beta$. Actually, the set of increasing functions conform a group of Lagrange multipliers, because it is easy to show that the Lagrange parameters related to the entropy $c_1(c_2\left(S\left(P\right)\right)$

$${\beta }_{c_1\circ c_2}=c_1^{\prime }(c_2\left(S\left(P\right)\right)·c_2^{\prime }\left(S\left(P\right)\right)\beta =c_1^{\prime }(c_2\left(S\left(P\right)\right){\beta }_{c_2}$$

(20)

which can be described as the group operation $(c_1\circ c_2)\mapsto c_1^{\prime }\left(c_2\right)·c_2^{\prime }$.

An important property of this transformation is that it changes the extensive–intensive duality of the conjugated pair of thermodynamic variables and the respective forces while it maintains the distribution. Notably, by changing the entropic functional from extensive (i.e., $S\left(n\right)\sim U\left(n\right)$) to non-extensive, it changes $\beta$ from intensive (i.e., size-independent, at least in the thermodynamic limit) to non-intensive, i.e., explicitly size-dependent. This point has been discussed in connection with q-non-extensive statistical physics of [29,30] and the relation to the zeroth law of thermodynamics was shown in [46]. As one can see from the example below, although Rényi entropy and Tsallis entropy have the same maximizer, the corresponding thermodynamics is different. While Rényi entropy is additive (and therefore extensive for systems where $U\left(n\right)\sim n$) and the temperature is intensive, Tsallis entropy is non-extensive, and the corresponding temperature explicitly depends on the size of the system.

Let us finally mention that the difference between free entropy and Lagrange parameter $\alpha$ transforms as

$${\psi }_c-{\alpha }_c=(c\left(S\right)-c^{\prime }\left(S\right)\langle {\nabla }_{P}S\left(P\right)\rangle -c^{\prime }\left(S\right)\beta (E-\langle {\nabla }_P\mathcal{E}\left(P\right)\rangle )=c^{\prime }\left(S\right)\left(\psi -\alpha \right)+(c\left(S\right)-c^{\prime }\left(S\right)·S).$$

(21)

While free entropy and other thermodynamic potentials are transformed, the heat change remains invariant under this transformation:

$$đQ_c=T_c\mathrm{d}c\left(S\right)=\frac{T}{c^{\prime }\left(S\right)}{c}^{\prime }\left(S\right)\mathrm{d}S=T\mathrm{d}S=đQ.$$

(22)

Example 1.

We exemplify the calibration invariance on two popular examples of closely related entropies.

• Rényi entropy and Tsallis entropy: Two most famous examples of generalized entropies are Rényi entropy $R_q\left(P\right)=\frac{1}{1-q}\ln \left({\sum }_i{p}_i^q\right)$ and Tsallis entropy $S_q\left(P\right)=\frac{1}{1-q}\left({\sum }_i{p}_i^q-1\right)$. Their relation can be expressed as

  $$R_q\left(P\right)=c_q\left(S_q\left(P\right)\right)=\frac{1}{1-q}\ln \left[(1-q)S_q\left(P\right)+1\right]$$

  (23)
  and therefore we obtain that

  $$c_q^{\prime }\left(S_q\left(P\right)\right)=\frac{1}{1+(1-q)S_q}=\frac{1}{{\sum }_i{p}_i^q}.$$

  (24)
  The difference between free entropy and α can be obtained as

  $${\psi }_R-{\alpha }_R=\frac{1}{{\sum }_i{p}_i^q}({\psi }_S-{\alpha }_S)+\left(R_q\left(P\right)-\frac{S_q\left(P\right)}{{\sum }_i{p}_i^q}\right).$$

  (25)
  One can therefore see that even though Rényi and Tsallis entropy lead to the same MaxEnt distribution, their thermodynamic quantities, such as temperature or free entropy, are different. Whether the system follows Rényi or Tsallis entropy depends on additional facts, as e.g., (non)-extensitivity and (non)-intensivity of thermodynamic quantities.
• Shannon entropy and Entropy power: A similar example is provided with Shannon entropy $H\left(P\right)={\sum }_i{p}_i\ln 1/p_i$ and entropy power $\mathcal{P}\left(P\right)={\prod }_i{\left(1/p_i\right)}^{p_i}$. The relation between them is simply

  $$H\left(P\right)=c\left(\mathcal{P}\right(P\left)\right)=\log \left(\mathcal{P}\right(P\left)\right),$$

  (26)
  so we obtain that

  $$c^{\prime }\left(\mathcal{P}\left(P\right)\right)=1/\left(\mathcal{P}\left(P\right)\right)=\exp (-H\left(P\right)).$$

  (27)
  For the difference between free entropy and α, we obtain that

  $$0={\psi }_H-{\alpha }_H=\frac{1}{\mathcal{P}\left(P\right)}\left({\psi }_{\mathcal{P}}-{\alpha }_{\mathcal{P}}\right)+\left(H\left(P\right)-1\right)$$

  (28)
  from which we get that

  $${\psi }_{\mathcal{P}}-{\alpha }_{\mathcal{P}}=\mathcal{P}\left(P\right)\left(1-\log \mathcal{P}\left(P\right)\right).$$

  (29)
  Therefore, we see that even that the MaxEnt distribution remains unchanged, the relation between α and free energy is different.

4. Calibration Invariance of MaxEnt Distribution with Constraints Transformation

Similarly, one can uncover the invariance of the MaxEnt distribution when the constraints are transformed in a certain way. Generally, if two sets of constraints define the same domain, the resulting Maximum entropy principle should lead to equivalent results. We will not be so general, but we focus on a specific situation, which might be quite interesting for thermodynamic applications. Let us remind two conditions, which we assume: normalization $f_0\left(P\right)=0$ and energy constraint $f_E\left(P\right)=0$. Let us investigate the latter. Similarly to the previous case, it is possible to take any function g of $f_E\left(P\right)$, for which $g\left(y\right)=0$ if $y=0$. More generally, we can also take into account the normalization constraint and replace the original energy condition by

$$g(f_0\left(P\right),f_E\left(P\right))=0$$

(30)

for any $g(x,y)$, for which $g(x,y)=0\Rightarrow y=0$. Let us investigate the Maximum entropy principle for this case. We can express the Lagrange function as

$$\mathcal{L}\left(P\right)=S\left(P\right)-{\alpha }_g{f}_0\left(P\right)-{\beta }_{g}g(f_0\left(P\right),f_E\left(P\right))$$

(31)

which leads to a set of equations

$$\frac{\partial S\left(P\right)}{\partial p_i}-{\alpha }_g\frac{\partial f_0\left(P\right)}{\partial p_i}-{\beta }_g\left[G^{(1,0)}\frac{\partial f_0\left(P\right)}{\partial p_i}+G^{(0,1)}\frac{\partial \mathcal{E}\left(P\right)}{\partial p_i}\right]=0$$

(32)

where $G^{(1,0)}=\frac{\partial g(x,y)}{\partial x}{|}_{(0,0)}$ and $G^{(0,1)}=\frac{\partial g(y,x)}{\partial x}{|}_{(0,0)}$. We take again into account that $\frac{\partial f_0\left(P\right)}{\partial p_i}=1$, multiply the equations by $p_i$ and some over i. This gives us

$${\alpha }_g=〈{\nabla }_{P}S\left(P\right)〉-{\beta }_g\left[G^{(1,0)}+G^{(0,1)}〈{\nabla }_P\mathcal{E}\left(P\right)〉\right].$$

(33)

By plugging ${\alpha }_g$ back, we end with relation for ${\beta }_g$:

$${\beta }_g=\frac{1}{G^{(0,1)}}\frac{{\Delta }_i\left({\nabla }_{P}S\left(P\right)\right)}{{\Delta }_i\left({\nabla }_P\mathcal{E}\left(P\right)\right)}.$$

(34)

For ${\alpha }_g$ we end with

$${\alpha }_g=〈{\nabla }_{P}S\left(P\right)〉-\frac{{\Delta }_i\left({\nabla }_{P}S\left(P\right)\right)}{{\Delta }_i\left({\nabla }_P\mathcal{E}\left(P\right)\right)}〈\nabla f_E\left(P\right)〉\left[1+\frac{G^{(1,0)}}{G^{(0,1)}}\frac{1}{〈{\nabla }_P\mathcal{E}\left(P\right)〉}\right].$$

(35)

Thus, we end again with rescaling of ${\alpha }_g$ and ${\beta }_g$, which reads

$$\begin{array}{c}\hfill {\alpha }_g(\alpha ,\beta )=\alpha -\frac{G^{(1,0)}}{G^{(0,1)}}\beta ,\end{array}$$

(36)

$$\begin{array}{c}\hfill {\beta }_g\left(\beta \right)=\frac{\beta }{G^{(0,1)}}.\end{array}$$

(37)

The ratio of Lagrange multipliers is also transformed, so we get

$$\frac{{\alpha }_g}{{\beta }_g}=G^{(0,1)}\frac{\alpha }{\beta }-G^{(1,0)}.$$

(38)

Again, the set of all functions fulfilling the aforementioned condition conform a group. The group operation can be described by the relation between coefficients $G^{(1,0)}$ and $G^{(0,1)}$ for the composite function $g(x,y)=g_1(x,g_2(x,y))$. We obtain that

$$\begin{array}{ccc}\hfill G^{(1,0)}& =& G_1^{(1,0)}+G_1^{(0,1)}{G}_2^{(1,0)}\hfill \end{array}$$

(39)

$$\begin{array}{ccc}\hfill G^{(0,1)}& =& G_1^{(0,1)}{G}_2^{(0,1)}\hfill \end{array}$$

(40)

which leads to group relations

$$\begin{array}{ccc}\hfill {\alpha }_g(\alpha ,\beta )& =& {\alpha }_{g_1}({\alpha }_{g_2}(\alpha ,\beta ),{\beta }_{g_2}\left(\beta \right))-\frac{G_1^{(1,0)}}{G_1^{(0,1)}}{\beta }_{g_2}\left(\beta \right)\hfill \end{array}$$

(41)

$$\begin{array}{ccc}\hfill {\beta }_g\left(\beta \right)& =& \frac{{\beta }_{g_2}\left(\beta \right)}{G_1^{(0,1)}}.\hfill \end{array}$$

(42)

Example 2.

Here we mention two simple examples of the aforementioned transformation.

• Energy shift:Under this scheme, we can assume the constant shift in the energy spectrum. Let us rewrite the constraint $f\left(P\right)$ in the following form,

  $$f_E\left(P\right)=\sum p_i{E}_i-E=\sum p_i(E_i-E^{\prime })-(E-E^{\prime })$$

  (43)
  which allows us to identify the function $g(x,y)$ as

  $$g(x,y)=y-E^{\prime }x+E^{\prime }$$

  (44)

  We obtain $G^{(1,0)}=-E^{\prime }$ and $G^{(0,1)}=1$, which means that ${\alpha }^{\prime }=\alpha -\beta E^{\prime }$.
• Latent escort means:Apart from linear means, it is possible to use some generalized approaches. One of these examples is provided by so-called escort mean:

  $$E_q={\langle E\rangle }_q=\frac{{\sum }_i{p}_i^q{E}_i}{{\sum }_i{p}_i^q}$$

  (45)

  which for $q=1$ becomes an ordinary linear mean, when $P={\left\{p_i\right\}}_{i=1}^n$ are normalized to one. When we use this class of means in the Maximum entropy principle, the normalization is enforced by the normalization condition $f_0\left(P\right)=0$, therefore for $q=1$ we obtain the same results. Nevertheless, by taking $q=1$ for the results with escort distribution, the energy constraint is actually expressed as

  $$\frac{\sum p_i{E}_i}{\sum p_i}-E$$

  (46)

  can be understood in the same way as considered before in this section, i.e., as a combination of a normalization constraint and energy constraint. In this case the function g has the following form,

  $$g(x,y)=\frac{y+E}{x+1}-E.$$

  (47)
  Therefore, we obtain that $G^{(1,0)}=-E$ and $G^{(0,1)}=1$, which correspond to the previous example for $E^{\prime }=E$. Therefore, the latent energy mean can be understood in terms of MaxEnt procedure as the shift of the energy spectrum by its average energy.

5. Conclusions

In this paper, we have discussed the calibration invariance of MEP, which means that for a given MaxEnt distribution, there exists a whole class of entropies and constraints that lead to different thermodynamics (Thermodynamic quantities and response coefficients generally have different behavior. For example, from intensive temperature we can obtain temperature that explicitly depends on the size of the system). We have stressed that the MEP procedure consists of two parts, where the first part, consisting of determining the MaxEnt distribution, is rather a mathematical tool, while the second part, making connection between Lagrange multipliers and thermodynamic quantities, is a specific for application of MEP in statistical physics. Indeed, the paper does not cover all possible transformations leading to the same MaxEnt distribution (let us mention, at least, the additive duality of Tsallis entropy, where maximizing $S_{2-q}$ with linear constraint leads to the same result as maximizing $S_q$ with escort constraints [47]). The main lesson of this paper is that in order to fully determine a thermal system in equilibrium, we need to measure not only probability distribution, but also all relevant thermodynamic quantities (as entropy). Moreover, the transformation between Lagrange parameters and its connection to thermodynamic potentials can be useful in situations when one is not certain about the exact form of entropy.