Abstract
We use an m-vicinity method to examine Ising models on hypercube lattices of high dimensions . This method is applicable for both short-range and long-range interactions. We introduce a small parameter, which determines whether the method can be used when calculating the free energy. When we account for interaction with the nearest neighbors only, the value of this parameter depends on the dimension of the lattice . We obtain an expression for the critical temperature in terms of the interaction constants that is in a good agreement with the results of computer simulations. For , our theoretical estimates match the numerical results both qualitatively and quantitatively. For , our method is sufficiently accurate for the calculation of the critical temperatures; however, it predicts a finite jump of the heat capacity at the critical point. In the case of the three-dimensional lattice (), this contradicts the commonly accepted ideas of the type of the singularity at the critical point. For the four-dimensional lattice (), the character of the singularity is under current discussion. For the dimensions the m-vicinity method is not applicable.
1. Introduction
Statistical physics provides effective methods of analysis, allowing us to investigate large systems of elementary “agents” and to determine macroscopic characteristics—in particular, the free energy based on interactions between the “agents”. If we know the free energy—by means of computer simulations or theoretical calculations—we can calculate such properties of the system as the internal energy, magnetization, heat capacity, and susceptibility. The singularities of the temperature dependences of these characteristics define the critical temperatures at which the internal restructurings take place in the system and phase transitions occur.
Such results (even if they are not quite accurate) are important, and not only for physicists. In the second half of the 1980s, the statistical physics methods were applied to estimate the storage capacity of the Hopfield neural network. Later on, a lot of investigations in the field of neural science based on the statistical physics followed (see, for example, [1,2,3]). At the same time, the statistical physics methods became popular in the combinatorial optimization problems [4,5,6]. Starting from the mid-1990s, a new scientific branch named econophysics appeared. In econophysics, the statistical physics methods are the main instruments for analyzing economic models [7,8].
Physics provides a wide variety of methods for the calculation of the free energy, from computer simulations (where one uses the Metropolis or the Wang-Landau algorithms [9,10,11]) to cumbersome theoretical approaches of the type of the renormalization group or the transfer-matrix methods [12,13,14].
In the present paper, we sum up the results obtained when developing the m-vicinity method (at first, we called it “the n-vicinity method”, but then it became clear that the more appropriate term was “the m-vicinity method”) for analysis of the Ising systems. Our method allows us to calculate the free energy for an arbitrary connection matrix. We present a review of our results for the Ising models on hypercubic lattice of the dimensions , and . The dimensions and are absent in this list because this method is not applicable for such lattices.
There is an enormous number of papers of theoretical or numerical studies on the behavior of spin systems on specific types of lattices. Here, we cite only the papers that we used in the course of our work. Cubic lattices are studied, for example, in [9,15,16,17,18,19]. Four-dimensional lattices are discussed in [20,21,22]. Studies on higher-dimensional systems are very rare. Our single source on was [23].
In the next section, we justify the main approximation of our method. It consists of the substitution of the Gaussian distribution in place of the unknown state distribution of the given Hamiltonian.
In Section 3, we show that the Gaussian approximation is the first-order term in the expansion of the density of states in a perturbation theory series in a small parameter . In the case of the planar lattice (d = 2), , and this value is not sufficiently small. When the lattice dimension increases, the value of decreases quickly, and the Gaussian approximation works very well.
In Section 4, we present in detail our results obtained with the aid of Gaussian approximation of the density of states. The mean and the variance of the Gaussian distribution that we use coincide with the first and the second moments of the density of states of the given system. We define the boundaries of the method applicability and obtain analytical expressions for the critical characteristics of the system. In particular, they are the critical value of the inverse temperature and the jump of the heat capacity. Our analytical results match quite accurately with the results of computer simulations. We find out that the higher the dimension of the lattice, the better our estimates; when , the relative error is of the order of the tenth or the hundredth percent.
In Section 5, we check whether the account of the second-order terms of the perturbation theory improves our results for the critical temperature. Here, we approximate the density of states with a distribution whose first three moments coincide with the moments of the state distribution of the system. (To do this a more advanced knowledge of the mathematical statistics is necessary [24,25].) We find that, while the role of second order parameters is negligible, we can achieve almost perfect agreement with computer simulations by introducing an adjustable parameter.
In Section 6, we present a detailed comparison of the theoretical results and computer simulations for the Ising model on the cubic lattice (). For such a lattice, we examine the role of the long-range interaction; in particular, we discuss the interactions with the next-nearest neighbors and the next-next-nearest neighbors.
Finally, in Section 7, we sum up the strengths and weaknesses of the m-vicinity method. The details of the calculations are in the Appendix A.
2. Main Approximation of m-Vicinity Method
Let us examine the Ising model on a multidimensional cubic lattice, which is a system of spins , situated at the nods of a hypercubic lattice. In what follows, we assume the periodic boundary conditions.
The Hamiltonian of the system is
where is a connection matrix, H is a magnetic field, and m is a magnetization of the state . The partition function of the system is
where is the inverse temperature, the summation is carried out over all the values of the energy , and is the density of states (the degeneracy of the energy states).
In the general case, we do not know the energy distribution . It seems that we can define it with the aid of the central limit theorem. Indeed, the value of E is the sum of weakly connected random variables, and the Gaussian distribution
describes correctly the central part of the distribution . However, Equation (1) is not applicable at the tails of the true distribution, while the tails provide the main contribution to the formation of the phase transition. Many authors mentioned this fact (see [15]). The m-vicinity method allows us to overcome this difficulty. The essence of the method is as follows. We divide the set of configurations into subsets , which will be called the m-vicinities. The m-vicinity contains all the configurations with the same magnetization . These configurations differ from the configuration of the ground state by opposite signs of spins, where and the number of such configurations is equal to .
The density is the energy distribution for a given m-vicinity, and the partition function of the system is
In the general case, we do not know the true distribution . However, we do know the exact values of its mean energy and its variance, which we denote as (see Appendix A or [26,27,28]). In the case of the Ising model on the hypercube, these expressions in the limit are sufficiently simple,
where is the energy of the ground state of the Ising Hamiltonian.
Let us explain the purpose of dividing the whole set of configurations into m-vicinities. In the vicinity , the energy behaves as a random value and due to the central limit theorem, we can approximate accurately the central part of by Gaussian distribution with the mean and the variance :
It is evident that the sum differs from the Gaussian distribution (1) and it better describes the tails of the true distribution.
Let us note here that in the limit , we can replace the exponent in Equation (4) by a delta function . Then Equation (2) takes the classical form known from the mean field theory, which provides the Bragg–Williams results [29]. However, the value of differs from zero for all the types of the connection matrices (an exclusion is the case of the complete graph when all the matrix elements are equal—see Equation (A4)) and the replacement of the Gaussian (4) by the delta function is not correct. It is the account for the value that leads to a much better agreement of theoretical estimates and results of simulations. Of course, the distribution is not purely Gaussian since its higher odd moments are not equal to zero (see Appendix A); however, their contribution is sufficiently small. In what follows, we analyze when the Gaussian approximation (4) is applicable and how a deviation of the density of states from Equation (4) influences the results. In the next section, we show that expression (4) is the first-order term of the perturbation theory in a small parameter , where is an effective number of neighbors (see Equation (16)).
3. Small Parameter in m-Vicinity Method
The basis of the m-vicinity method is the abovementioned approximate description of the density of states. To analyze the approximation, we briefly repeat the calculations of the paper [30]. The starting point is as follows. We do not know a true energy distribution but we do know the first moments of this distribution. In particular, we know the mean and the variance (3). Let us define the small parameter allowing us to expand the function in a perturbation theory series.
We present in the form
where is an unknown function and use the Stirling formula to replace the summation in (2) by integration. Then, up to an insignificant constant, we obtain the partition function of the form
where
Let us estimate the integral (5) using the saddle point method. The equations for the saddle point are
The solutions of these equations and are the spontaneous magnetization and the internal energy, respectively. Substituting these values in Equation (6), we obtain the free energy .
Now, we turn to defining the small parameter of the m-vicinity method. Since the magnetic field H does not influence the distribution , we set here . We write the function as a perturbation theory series in the vicinity of point :
The quantities up to a sign coincide with the semi-invariants of the distribution (see Appendix A).
The main idea of the m-vicinity method is the possibility to restrict ourselves by accounting for just a few first terms of the series (8). We can do this only if and in this case the m-vicinity method is sufficiently accurate. Let us clarify that we are not interested in the values of over the whole region of definition of the parameters and . We have to know the expansion (8) only in a small vicinity of the saddle point, which is close to the values and . Consequently, the small parameter we are looking for is
The smallness of the parameter is the condition for applicability of the m-vicinity method.
In [30], there is a detailed analysis of the values of this parameter for different models. Here, we restrict ourselves with an estimate of by means of the reverse-reasoning method. Suppose the parameter is small and it is sufficient to use only the first term of the series (8) and set . Then the second of the Equation (7) takes a simple form and we can rewrite the first of the Equation (7) as follows:
We are interested in the behavior of the quantity , where is the root of Equation (9). The value of reaches its maximum at the critical point (see [30]). In the limit (), Equation (9) takes the form
The solution of this equation is
and . Consequently, the m-vicinity method is applicable when the small parameter . According to Equation (10), it is necessary that or .
A detailed analysis shows (see [27]) that a stricter inequality or defines the framework of the m-vicinity method. In another case, we obtain a jump of the spontaneous magnetization at the critical point, and this contradicts the known results.
We would like to mention here that when analyzing the dependence of our results on the lattice dimension , we see that the ratio depends on the effective number of the neighbors introduced below in Equation (16). This parameter defines the number of interactions that we take into account. We can rewrite Equation (10) in terms of ; then . From this equation, it follows that when the value of . Consequently, when q increases, the value of the small parameter decreases quite rapidly and the accuracy of the m-vicinity method increases.
In Figure 1, we show the dependence of on when we account for the nearest neighbors only (in this case ). For a planar lattice, . Obviously, it is problematic to use it as a small parameter. Moreover, for a planar lattice, the inequality is not satisfied. Next, for a cubic lattice, the last inequality is satisfied and the value of is more appropriate as a small parameter. Again, when increases, the value of decreases, and the accuracy of the method increases accordingly.
Figure 1.
Small parameter as function of dimension of Ising model with interaction of nearest neighbors.
Summing up, we can say that the Gaussian approximation is the first order of the perturbation theory in the small parameter .
4. First Order of Perturbation Theory: Gaussian Approximation
In this section, we use the Gaussian approximation (4) for the distribution . If in Equations (6)–(8) we set , Equation (6) becomes
the equations for the saddle point (7) are
Eliminating the variable from these equations, we obtain an equation of state
This equation differs from the well-known equation of Bragg and Williams [29] by a term proportional to . After a transformation of Equation (11), with the account for Equations (12) and (13), we obtain the expression for the free energy:
that defines as a function of and . In Equation (14), the spontaneous magnetization is the solution of Equation (13). Again, by setting , we recover the known result from the mean field theory.
We would like to point out that the equality is true only when we account for the interaction with the nearest neighbors. Then the inequality excludes the one- and two-dimensional Ising models from the consideration. Consequently, in this case, we can use the -vicinity method only for the spatial dimensions .
4.1. Critical Point
In this subsection, we set and define the critical temperature under this assumption. For this purpose, we rewrite Equation (13) as
where we introduce dimensionless characteristics
The defined variables (16) are convenient since in Equation (15), the only parameter that depends on the type of the lattice is .
When (), Equation (15) takes the form
Now, with the account of Equation (16), we obtain the expression for the critical temperature
The critical value of depends only on the number , and this parameter depends on the mean and the variance of the elements of the connection matrix. Since is a characteristic of the interactions that we take into account, we regard it as an effective number of the neighbors. In particular, if we account for an isotropic interaction with the nearest neighbors only, , , and is the dimension of the lattice. Note that in this case, is exactly equal to the number of spins with which the given spin interacts. Then Equation (18) describes pretty well the results of computer simulations for all the dimensions, which we examined (see Figure 2 and Table 1).
Figure 2.
Critical temperature vs. and account for interactions with nearest neighbors only: solid line corresponds to Equation (18); circles are simulations [9,21,23]; dashed line is result of mean field theory.
Table 1.
Critical temperatures and relative errors for the lattice dimensions . Results of mean field theory are also shown.
4.2. Analytical Expressions
Let us list the basic thermodynamic characteristics that we obtained from Equations (11)–(14).
(1) The interval . When and , from the above-mentioned equations, we obtain that the free energy, the internal energy, and the heat capacity are
respectively.
(2) The interval . To obtain the analytical expressions for the values , , and , we solve Equation (15) for :
and transform Expressions (12) and (14) to the forms
Here, is the energy variance that is related to the heat capacity via . The expression (23) is a result of differentiating the second of Equation (12) with respect to variable .
If we regard the magnetization as an independent variable and consider the values of , , and as functions of m, then Equations (20)–(23) define implicitly the dependence of , , and on the inverse temperature at the interval .
4.3. Critical Parameters
To examine the behavior of the thermodynamic characteristics near the critical point, we introduce a relative inverse temperature
Omitting intermediate calculations, we only present the most important critical dependences.
(1) From Equations (19)–(23), it follows that at the free energy and the internal energy are continuous functions, and the heat capacity has a jump. Indeed, when Equation (23) holds, and in the limit () we obtain
where is defined by Equation (18). Comparing this expression with Equation (19), we see that at the energy variance has a jump and consequently the heat capacity also has a jump:
For the lattice dimensions d = 5, 6, and 7, the authors of [23] used computer simulations to estimate the jumps of the heat capacity. The comparison of their results with the values following from Equation (25) shows:
.
We see that Equation (25) provides very good agreement with the computer simulations; the larger is, the better this agreement.
(2) When , the value of the spontaneous magnetization near the critical point () obtained from Equation (15) is
This expression differs from the dependence
that is valid for the two-dimensional Ising model (q = 4); however, it qualitatively coincides with the expressions and obtained in the framework of the van der Waals theory [13] and the mean field theory, respectively. Note that our result tends to the result of the mean field theory in the limit . It is also worthwhile to note that Equation (26) predicts a larger magnetization than the mean field theory, for any . If (), the van der Waals magnetization is less than the value (26) and when (), it is larger than the value (26).
(3) From Equation (13), it follows that at the critical point, the susceptibility has a jump
Comparing with the analogous expression of the mean field theory, we see that an extra factor appears in Equation (27), and it tends to 1 when . As opposed to the mean field theory [13], in Equation (27), is the effective number of the neighbors (16).
(4) It is easy to see that our model satisfies the similarity hypothesis. Indeed, when we expand expression (13) in small parameters, and , we obtain the dependence that can be rewritten in the classical form with the critical exponent and the scaling function
4.4. Magnetization Distribution
The integral
defines the probability of finding the system in a state with the magnetization m. In the Gaussian approximation we use here, is defined by Equation (4). We estimate this integral with the aid of the saddle point method. The value of is accurate to a normalization constant
In Figure 3a, we show the typical behavior of the curves (30). As we might expect, after crossing the critical point, the bimodal distribution replaces the unimodal distribution. We can use Equation (30) when analyzing the Binder cumulant (see [31]). In Figure 3b, we show the curves for cubic lattices whose linear sizes are 8, 10, and 12. We are interested in the value of the cumulant at the critical point. To calculate we use the Taylor expansion of the function in Equation (30):
where
Figure 3.
Magnetization: (a) distribution of magnetization for three-dimensional Ising model () for different inverse temperatures ; (b) dependence of Binder cumulant on for three-dimensional lattices with L = 8, 10, and 12. Markers show values of where bimodal distribution replaces unimodal.
This expansion is useful when and the value of is noticeably nonzero only when . In this case, the distribution (30) takes the form
which allows us to calculate the normalization constant easily as well as the mean values and . It is not difficult to see that when , we can consider the distribution as purely Gaussian in full agreement with the results of [31]. However, when we have and at the critical point, the distribution takes the form . Using this expression to calculate the critical value of the Binder cumulant [31] in the limit we obtain
It is interesting that in the limit the value does not depend on any parameters of the model (the lattice type, the character of the long-range interaction, and so on). Although we obtained this result in the framework of the Gaussian approximation (4), it has a general character. Indeed, let be an unknown function, and integration (29) results in expression (30) where is also an unknown function. By a symmetry argument, it follows that only even powers of m are present in the Taylor expansion of this function. At the critical point, the second derivative of function equals to zero (the bimodal distribution replaces the unimodal) and the Taylor series starts from the term . We assume that the function has no singularities and its derivatives are finite. Then, we can leave only the term in the exponent of the distribution . The reason is that when integrating over the account for the terms of the higher orders leads to corrections of the order . In other words, we can present the magnetization distribution as where is an unknown, which is canceled out in the calculation of and does not influence the final form of expression (32).
4.5. Density of States
In Section 4.2, we derived Equations (19)–(23), which allowed us to obtain implicitly the logarithmic density of states
using the Legendre relations. When changes from 0 to , the value of changes from 0 to and for each we obtain a pair of values and . In such a way, we generate the function , which we suppose to be symmetric: . In Figure 4a, we present the comparison of our results with computer simulations.
Figure 4.
(a) Logarithmic density of states: solid line—Wang-Landau algorithm for cubic lattice of size L = 40; dashed line—calculation by Formulas (19)–(23) and Legendre relations. (b) Solid line is modulus of relative error for calculations when using Legendre relations; dashed line is relative error of Equation (34).
Let us determine an explicit form of the dependence . The integral
defines the density of states or, in other words, the number of states with the energy . Here ; and are non-essential constants. Therefore, the logarithmic density of states is , where is the saddle point, which is a solution of the equation . After some transformations, we can write this equation as
From this equation, it follows that
where is defined by Equation (18) and
Equation (35) is an approximate result obtained taking into account that the left-hand side of Equation (33) contributes significantly to the solution of this equation only when . Under this condition Equation (33) reduces to a cubic equation for the quantity . The solution of this equation has the form (35). The approximate solution (34) differs by fractions of a percent from the exact solution obtained by means of the Legendre relations (see Figure 4b).
5. Second Order of Perturbation Theory: Account for Third Moment
In this section, we analyze what happens if, when approximating the distribution , we account for the third moment. We examine only the simplest case, supposing that all the nonzero elements of the connection matrix are equal (). Otherwise, the obtained expressions are too cumbersome, and it is very difficult to analyze them. We restrict ourselves only by first two terms of the series expansion (8) and set
We define the coefficient from the following considerations. It is necessary that the third moment of our approximation coincides with the third moment of the true distribution : . In the Appendix A, we show that for this, it is necessary that the coefficient is equal to the third semi-invariant of the distribution : . In the Appendix A, we also obtain the expression for the third moment of the distribution , which is equal to . Here is the effective number of the neighbors (see Equation (16)).
Then
and expression (6) for the function takes the form ():
We recall that , , , and .
The system of equations that define the saddle point has the form
where . The first of the equations of (37) provides the relation
Moreover, by direct calculations, we obtain
and substituting these equalities in the second Equation (37), we finally have
Generally speaking, for deriving an equation relating and it is necessary to solve Equation (38) and to determine and substitute it into Equation (39). Analyzing this equation, it would be possible to define the region of applicability of the m-vicinity approximation with account for the third moment and to obtain an expression for the critical temperature. It is rather difficult to solve this problem analytically. This is the reason why we restrict ourselves by analyzing the influence of the third moment on the value of the critical temperature defined by Equation (39) when .
When , from Equation (38) it follows that . Then the second term in the right-hand side of Equation (39) tends to and this equation itself takes the form . By virtue of the expressions for and we obtain the equation for the critical value of the inverse temperature :
If in this equation we set , we obtain Equation (17) that corresponds to the above-discussed case of the Gaussian approximation. We introduce the parameter since in what follows, we will use it as a fitting parameter.
Solving Equation (40) for numerically, we see the worse agreement of the obtained results with the computer simulations (see Table 1). Previously (see [24], Section 17.6) it was mentioned that an account for higher moments does not always lead to an increase in the quality of an approximation. You can expect such a result only for a narrow class of distributions. This question was under analysis when studying the Gram–Charlier and the Edgeworth series expansions [24,25]. In particular, it turned out that when we omit the higher order terms of the infinite series (8), the error is of the order of the first omitted term. To compensate this error, we use the fitting parameter . The author of [24] (s.17.6) suggests using this receipt if the optimal value of k gives a better agreement with all the numerical values. The questions of convergence of an infinite series are of secondary importance when solving a specific problem.
With those arguments in mind, we found that an agreement with the best numerical results is better when . In this case, the solution of Equation (40) takes the form
where
For d = 3, the best agreement is reached when . It turned out that this value of k is optimal for all examined dimensions: the solutions of Equation (41) with the same fitting parameter provide a very good agreement with the computational data for the lattices of all the dimensions (). As we see from Table 1, accounting for the third moment and introduction of the fitting parameter reduce the relative error
by 1 to 2 orders of magnitude, and it becomes comparable with the computational error. When we account for the interactions with the second and third neighbors, the introduction of the third moment also improves the agreement with the computer simulations significantly (see the next section).
6. Comparison with Computer Simulations: Three-Dimensional Ising Model
To estimate the accuracy and the correctness of the obtained equations, we performed computer simulations using the Metropolis algorithm and the algorithm of Wang and Landau [11]. We restricted ourselves to the examination of the three-dimensional Ising model supposing that for lattices of higher dimensions (), the agreement with the numerical results would be only better. In the course of our simulations, we explored the functions , , and . This allowed us to define the dependence of the critical temperature on , to calculate the logarithmic density of states , and to analyze how the magnetization distribution changed when the inverse temperature increased.
Recently, there is a strong interest in an account for interactions with the second and the third neighbors (see, for example, [32,33]). However, we do not know any analytical estimates for the critical temperatures. Our Equation (18) is quite accurate for such problems too.
We use the Metropolis algorithm to examine the three-dimensional lattices of the linear sizes = 20, 32, and 64 with periodic boundary conditions. We look for the dependences of the critical parameters on the effective number of neighbors . We suppose that all the interaction constants with the 6 nearest neighbors are equal to one (). We start with varying the value of the constant of interaction with the 12 next-nearest neighbors from 0 to 1, and this means that changes from 6 to 18. Then we fix the value and vary the interaction constant with the 8 next-next-nearest neighbors from 0 to 1 so that changes from 18 to 26. The initial state of the system is random. To bring the system to a state close to equilibrium for a given temperature, at the first Monte Carlo steps, we do not accumulate the statistical data. We flip spins according to the Metropolis algorithm in the order of their sequence in the lattice. After each flip, we measure the values of the energy and the magnetization. The total number of the Monte Carlo steps is . We vary the inverse temperature with the step size for , with the step size for , and with the step size for . We define the critical point as the point of maximum of the energy variance . At this point we fix the values of , as well as other values. We also use the Metropolis algorithm to calculate the energy and magnetization moments near the critical temperatures. In Table 2, we present the numerical data for .
Table 2.
Values measured at .
This calculation had two goals. The first was to analyze the role of the next terms of the expansion series (8). The second goal was to examine the influence of the account for the next-nearest and the next-next-nearest neighbors on the character of the dependence and find if the type of the singularity at the critical point changed to a finite jump.
6.1. Dependence
In Figure 5a, we show the dependence of on . We compare the numerical values (the upper solid line) with those that follow from Equation (18) for the Gaussian approximation (the lower solid line). As we see, the solid curves have similar shapes, and when we scale the theoretical curve by a factor of , they practically merge. Such a coincidence cannot be accidental. From Equation (18) it follows that in the Gaussian approximation, the curve has singularities at and :
Figure 5.
(a) Dependence of critical temperature on effective number of neighbors for three-dimensional Ising model: upper solid line presents computer simulation data for ; dashed line that merges with upper solid line is calculation with account for third moment (see Equation (42)); lower solid curve corresponds to Gaussian approximation (see Equation (18)); dotted line is that follows from mean field theory. (b) Relative error: lower dashed line corresponds to account for third moment (42); solid line corresponds to Gaussian approximation (18); upper dotted line corresponds to mean field theory.
The curve obtained by means of computer simulations shows the same singularities. In our simulations, we check this statement very accurately, changing in the vicinities of these points with a very small step size ().
Agreement of the numerical results with our theory becomes much better when we account for the third moment in Equation (36) and solve numerically the equation for the saddle point (37) (accounting for Equations (A4) and (A11) of the Appendix A). In this case, the relative error does not exceed a fraction of a percent. When we account for interactions beyond the nearest neighbors, the expression for the third moment becomes so cumbersome that it does not allow us to obtain analytical expressions for the critical temperature analogous to Equations (40) and (41). On the other hand, we can use a simple empirical formula
where is the critical value given by formula (41), accounting for the nearest neighbors only (). Comparing the solid and dashed lines in Figure 5b, we see that expression (42) describes the computer simulations much better than formula (18)—in comparison with the Gaussian approximation, the relative error decreases by an order of magnitude; it decreases nearly by two orders of magnitude comparing with the mean field theory.
6.2. Dependence
Our analysis shows that in the case of a three-dimensional Ising model, our account for the next-nearest and the next-next-nearest neighbors does not qualitatively change the behavior of the heat capacity at the critical point. Next, when the number of spins N increases, the peak of the curve only increases and the character of the singularity remains the same for all .
The dependences of the heat capacity on the critical temperature calculated numerically differ significantly from the ones defined by Equations (19) and (23). This means that we cannot use Equations (21)–(23) to describe the dependences . Equation (25) that defines the finite jump of the heat capacity and works well when is not applicable in the three-dimensional case.
In Figure 6, we show the dependences of the maximal energy variance on the effective number of neighbors. From the figure it is obvious that, first, the energy variance at the critical point increases when increases. Second, we see that with an increase in the lattice size the differences between the computer simulations and the theoretical curve grow quickly. Nevertheless, the dependences of on repeat qualitatively the theoretical curve (compare solid and dashed lines in Figure 6).
Figure 6.
Dependence vs. : solid line—Equation (24); dashed lines—computer simulations for (bottom-to-top).
The situation with the lattices of larger dimensions is quite the opposite. Let us discuss it here shortly. The larger the dimension of the lattice, the better the theoretical expressions (21)–(23) describe the numerical results for the heat capacity in the vicinity of the critical point. When , the agreement is good, both qualitatively and quantitatively.
In Figure 7, the dashed lines are the theoretical curves (Equations (21)–(23)); the solid lines are the results of computer simulations. For , the value of (see [21]), and for the dimensions and , we use the data from [23]. We see that our formulas describe the numerical results pretty well. When increases, the agreement of the theory and the simulations improves notably; when the theoretical and the numerical curves almost merge. In the same figure, we also present the graph for ; however, to date, there is no real understanding of what happens in the four-dimensional case. We do not know for sure if there is a jump of the heat capacity or an infinite singularity. In the same figures, we show the curves obtained in the framework of the mean field theory. We see that our approximation describes the results of the numerical experiments much better.
Figure 7.
Heat capacity vs. for = 4, 5, 6, 7. Computer simulations—solid lines; theory (Equations (19) and (23))—dashed lines. Data for and are from [21]; curves for = 5, 6, and 7 are numerical results [23]. Dotted line in figures for = 5, 6, 7 represents mean field theory.
6.3. Magnetization Distribution and Logarithmic Density of States
With the aid of the Metropolis algorithm, we calculated the magnetization distribution near the critical temperature for the three-dimensional Ising model, taking into account the nearest neighbors only ( = 8, 10, and 12). To increase the accuracy of the Monte Carlo method, we performed steps. To fix the inverse temperature where the bimodal distribution replaces the unimodal, we used the step size . For , we present the curves of the magnetization distribution in Figure 3a. The obtained distributions allow us to calculate the Binder cumulants (see [10,31]). In Figure 3b, the curves intersect at a point . This value of defines the critical temperature for the infinite lattice. At the curves in Figure 3b, the square markers are the points where the bimodal distributions replace the unimodal. At these points, the cumulants are approximately equal to 0.29, and this value is sufficiently close to the value predicted by Equation (32). When increases, these points shift to the point of the curves intersection that corresponds to the critical value in the asymptotic limit .
To obtain the density of states, we used the algorithm of Wang and Landau [11]. We performed the calculations for the cubic lattice of the size without parallel computing and only accounting for the interaction with the nearest neighbors. As a criterion of the flatness of the histogram of visited states, we adopted the condition that all the values of the histogram had to be larger than 80% of its mean value. When this condition was satisfied, the algorithm reduced the modification factor according to the formula . The simulations stopped when the modification factor became less than .
In Figure 4a, we present the graphs of the logarithmic density of states calculated numerically as well as the ones based on the equations of Section 2. The density of states calculated using Equations (19)–(23) and the Legendre relations was in a good agreement with the numerical data. We see that the maximal obtained error, which is about 0.7%, corresponds to the critical energy . The results of the approximate formula (34) are somewhat less accurate; however, in these calculations, the deviation from the numerical results is also less than 0.8% (see Figure 4b).
7. Discussion
We used the m-vicinity method to investigate the Ising model on -dimensional hypercube lattices for . (We recall that this method is not applicable for the lattices of lower dimensions.) The m-vicinity consists of all the configurations of the same magnetization m. We based our method on the series expansion of the logarithm density of states in the m-vicinities (Section 2). In the main part of the paper, we discuss the interaction with the nearest neighbors. Only in Section 6, for a cubic lattice, we analyzed both the short-range and long-range interactions.
When we account only for an isotropic interaction of the nearest neighbors, the small parameter is (see Equation (10)). The value of this parameter decreases from 0.366 when to 0.159 when (see Figure 1). Not surprisingly, the agreement between the theoretical results and computer simulations becomes better when the dimension of the lattice increases.
Summing up, we would like to list the main features of the m-vicinity method.
(1) The first order of the perturbation theory is equivalent to the Gaussian approximation of the true density of states in the m-vicinities supposing that the first two moments of the density of states and its Gaussian approximation coincide.
In this case, we obtained the simple analytical expression (18) for the critical value of the inverse temperature, which described quite accurately the results of computer simulations for different lattices (see Figure 2). When , the relative error between the theoretical estimate and the computer simulations is 2.39%. When increases, the relative error decreases to 0.18% for (see Table 1).
In the framework of the same approximation, we obtained analytical expressions (19)–(23) that define implicitly the dependence of the free energy and its derivatives on the temperature. Based on these results, we calculated the dependence of the heat capacity on the inverse temperature . As it follows from Figure 7, for , the obtained graphs match the curves obtained numerically [23]. The values of the critical exponents that follow from Equations (25)–(28) coincide with the known mean field results. For , Equation (25) predicts a finite jump of the heat capacity whose value is only less than the value obtained by computer simulations [23].
(2) The second order of the perturbation theory requires going beyond the Gaussian approximation and accounting for the third moment in the expansion (36). We suppose that the first three moments of the approximate and the true distributions coincide. However, this does not automatically improve the agreement of the theoretical estimates of the critical temperature and its numerical values. The reason is an irregular convergence of the Gram–Charlier and the Edgeworth series expansions [24]. The agreement improves significantly when we introduce the fitting parameter that is the same for all the dimensions (see Section 5). After that, the second order perturbation Formula (41) describes the computer simulations within a fraction of the percent (see Table 1). From Figure 5, it follows that the same is true when we also account for the interactions with the next-nearest and the next-next-nearest neighbors.
(3) The results of our analysis show that when the dimension of the Ising model , the m-vicinity method describes the properties of the system pretty well, both qualitatively and quantitatively. When , the type of the singularity of heat capacity still remains unclear [20,22]. Consequently, the question about the applicability of the m-vicinity method in this case remains open.
In the case , the approach discussed here is incorrect because it predicts a finite jump of the heat capacity at the critical point and the classical values of critical exponents. This result contradicts the widely accepted concept of the singularity at the critical point in the modern phase-transitions theory. Nevertheless, this method allows one to calculate the critical temperature quite accurately (see Table 1) as well as to describe its dependence on the number of the neighbors (see Figure 5 and Equations (41) and (42)). We conclude that when our theory provides good results for the dependences of the free energy and the logarithmic density of states but not for their derivatives. Indeed, when for we use Equations (34) and (35) to calculate the logarithmic density of states, the result is in a good agreement with the computer simulations data. From Figure 4 we see a notable deviation from the numerical curve () only in a narrow vicinity of the point .
(4) Finally, we would like to note that a good agreement of the theoretical results for the density of states with the data of computer simulations allows us to use the obtained expressions as an initial approximation for the Wang-Landau algorithm. We hope that our results will allow one to speed the algorithm up and to increase its accuracy.
Author Contributions
Conceptualization, B.K.; methodology, B.K. and L.L.; software, V.E.; validation, L.L. and V.E.; formal analysis, B.K. and L.L.; investigation, V.E.; writing—original draft preparation, B.K.; writing—review and editing, B.K. and L.L.; funding acquisition, B.K. All authors have read and agreed to the published version of the manuscript.
Funding
This work was supported by State Program of Scientific Research Institute for System Analysis, Russian Academy of Sciences, project no. 0065-2019-0003.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
Not applicable.
Acknowledgments
The authors are grateful to Inna Kaganowa for help when preparing this paper.
Conflicts of Interest
The authors declare no conflict of interest.
Appendix A. Calculation of the First Moments of Energy Distribution
Previously, we described in detail how to calculate the moments of the distribution of the energy states belonging to the vicinity [26,27,28]. In these papers, we obtained the exact expressions for the first two moments of the energy distribution that are the mean and the variance . For a finite system and a general connection matrix , we presented these expressions in finitely combinatorial forms. In the case of the Ising connection matrix for a -dimensional hypercube, we, in addition, found and in an asymptotic limit when the number of spins tends to infinity. Next, we show how to obtain the combinatorial and the asymptotic formulas for the third moment .
Appendix A.1. Notations
In what follows, for the sake of simplicity when averaging over the m-vicinities , we sometimes will omit the subscript m. For example, if a state belongs to an m-vicinity and is the energy of the state , we will write the first three moments as
We are interested in calculating the second and third central moments—the variance and the semi-invariant :
Usually, the energy of the state includes a normalization coefficient . In what follows, we for simplicity omit this coefficient and write the energy as
After obtaining the final expressions for the moments, we have to multiply , and by , , and , respectively.
Appendix A.2. Connection Matrix of General Form
Suppose that the connection matrix has a general form and the configuration is the ground state whose energy is .
To calculate the energy moments , , it is necessary to present as a sum of terms which contain only the products of spin variables with non-repeating indices. For example, we can write the expressions for and as
where and are tensors, whose components are nonzero and equal to one only if they do not contain the repeating indices.
In the m-vicinity, we can present the variables as , where takes the value with the probability of and it takes the value with the probability . (We remind that .) This allows us to easily perform the averaging over the m-vicinities. For example:
When writing Equation (A2), we used easily verifiable formulas , , and :
In Equation (A3), the constant in the numerator of the last expression is equal to
The same as when calculating in Equation (A2), we can obtain the second and the third energy moments and show that the averaging over leads to the following equalities:
where is a local field acting on the i-th spin belonging to state . The matrix in the expression for the third moment is .
The expressions (A3) and (A4) provide us with the most general formulas for the first, second, and third moments of the distribution of energies of the states from the m-vicinity in terms of the elements of the connection matrix . (If it is necessary to use the normalized expression for the energy , see the note after Equation (A1).)
Appendix A.3. Ising Model on Hypercube
In this subsection, we analyze the Ising model with the short-range interaction, when only the nearest spins interact, and other elements of the connection matrix are equal to zero. Let the nonzero matrix elements be equal to a constant . We factor out this constant in all our calculations. Then, there are ones in each row of the matrix , all the other matrix elements are equal to zero, and the ground state is a configuration .
It is easy to see that the following equations
hold. Then the expressions (A4) take the form
To obtain asymptotic expressions for the moments (), at first it is necessary to obtain the asymptotic expressions for the coefficients , , and , expanding them with respect to the small parameter :
here, is the magnetization of the state .
Next, substituting the obtained expressions into Equation (A5) and leaving the leading terms, we obtain the asymptotic expressions for the first three moments
The final answer we obtain after multiplying , , and by , , and , respectively; here, .
Appendix A.4. Asymptotic Form of Coefficient
Starting from Equation (8), we use the series expansion of the unknown function in the variable :
Since we do not know the function itself, we also do not know the series expansion coefficients , where However, we do know the first three moments of the energy distribution (A5) and this allows us to define the coefficient of the expansion (A7). Indeed, Equations (A5) and (A6) define the general form of the third moment:
We restrict ourselves with the first two terms in the right-hand side of Equation (A7) and substitute the expressions (A5)–(A7) into the integral in the right-hand side of Equation (A8). Then
It is easy to see that the main contribution to the integral (A9) comes from the region , where the cubic term of the exponent of the integrand is negligible small . Then expanding the exponent, we have
After simple calculations, equating expression (A10) and the third of the expressions (A6), we obtain, with an accuracy up to the terms of the order of ,
In the same way, it is also possible to calculate the coefficients of the higher order. However, even the expression for is so cumbersome that we do not present it here.
References
- Müller, B.; Reinhardt, J.; Strickland, M.T. Neural Networks—An Introduction; Springer: Berlin/Heidelberg, Germany, 1995. [Google Scholar]
- Dotsenko, V. An Introduction to the Theory of Spin Glasses and Neural Networks; World Scientific: Singapore, 1994. [Google Scholar]
- Karandashev, I.; Kryzhanovsky, B.; Litinskii, L. Weighted patterns as a tool to improve the Hopfield model. Phys. Rev. E 2012, 85, 41925. [Google Scholar] [CrossRef] [PubMed]
- Fu, Y.; Anderson, P.W.J. Application of statistical mechanics to NP-complete problems in combinatorial optimization. Physics A 1986, 19, 1605. [Google Scholar] [CrossRef]
- Theoretical Computer Science. 2001, Volume 265, p. 3. Available online: https://dblp.org/db/journals/tcs/tcs265.html (accessed on 10 November 2021).
- Hartmann, A.K.; Weight, M. Phase Transitions in Combinatorial Optimization Problems; WILEY-VCH Verlag GmbH & Co: Weinheim, Germany, 2006. [Google Scholar]
- Yakovenko, V.M.; Rosser, J.B., Jr. Colloquium: Statistical mechanics of money, wealth, and income. Rev. Modern Phys. 2009, 81, 1703. [Google Scholar] [CrossRef]
- Galam, S. Sociophysics: A Physicist’s Modeling of Psycho-Political Phenomena; Springer: New York, NY, USA, 2012. [Google Scholar]
- Häggkvist, R.; Rosengren, A.; Lundow, P.H.; Markström, K.; Andrén, D.; Kundrotas, P. On the Ising model for the simple cubic lattice. Adv. Phys. 2007, 56, 653. [Google Scholar] [CrossRef]
- Landau, D.P.; Binder, K. A Guide to Monte Carlo Simulations in Statistical Physics; Cambridge Univ. Press: Cambridge, UK, 2000. [Google Scholar]
- Wang, F.; Landau, D.P. Efficient, Multiple-Range Random Walk Algorithm to Calculate the Density of States. Phys. Rev. Lett. 2001, 86, 2050. [Google Scholar] [CrossRef]
- Patashinskii, A.Z.; Pokrovskii, V.L. Fluctuation Theory of Phase Transitions; Pergamon Pr.: Oxford, UK, 1979. [Google Scholar]
- Baxter, R.J. Exactly Solved Models in Statistical Mechanics; Academic Press: London, UK, 1982. [Google Scholar]
- Dmitriev, A.; Katrakhov, V.; Kharchenko, Y. Root Transfer Matrices in Ising Models; Nauka: Moscow, Russian, 2004. (In Russian) [Google Scholar]
- Dixon, J.M.; Tuszynski, J.A.; Carpenter, E.J. Analytical expressions for energies, degeneracies and critical temperatures of the 2D square and 3D cubic Ising models. Physics A 2005, 349, 487. [Google Scholar] [CrossRef]
- Ferrenberg, A.M.; Xu, J.; Landau, D.P. Pushing the limits of Monte Carlo simulations for the three-dimensional Ising model. Phys. Rev. E 2018, 97, 043301. [Google Scholar] [CrossRef]
- Ron, D.; Brandt, A.; Swendsen, R.H. Surprising convergence of the Monte Carlo renormalization group for the three-dimensional Ising model. Phys. Rev. E 2017, 95, 053305. [Google Scholar] [CrossRef]
- Butera, P.; Comi, M. Critical universality and hyperscaling revisited for Ising models of general spin using extended high-temperature series. Phys. Rev. B 2002, 65, 144431. [Google Scholar] [CrossRef]
- Murtazaev, A.K.; Ramazanov, M.K.; Kassan-Ogly, F.A.; Kurbanova, D.R. Phase transitions in the antiferromagnetic Ising model on a body-centered cubic lattice with interactions between next-to-nearest neighbors. JETP 2015, 120, 110. [Google Scholar] [CrossRef]
- Blöte, H.W.J.; Swendsen, R.H. Critical behavior of the four-dimensional Ising model. Phys. Rev. B 1980, 22, 4481. [Google Scholar] [CrossRef]
- Lundow, P.H.; Markstrom, K. Critical behavior of the Ising model on the four-dimensional cubic lattice. Phys. Rev. E 2009, 80, 031104. [Google Scholar] [CrossRef]
- Akiyama, S.; Kuramashi, Y.; Yamashita, T.; Yoshimura, Y. Phase transition of four-dimensional Ising model with tensor network scheme. arXiv 2019, arXiv:1911.12954. [Google Scholar]
- Lundow, P.H.; Markstrom, K. The discontinuity of the specific heat for the 5D Ising model. Nucl. Phys. B 2015, 895, 305. [Google Scholar] [CrossRef][Green Version]
- Cramer, H. Mathematical Methods of Statistic; Princeton Univ. Press: Princeton, NJ, USA, 1999. [Google Scholar]
- Kendall, M.G.; Stuart, A. The Advanced Theory of Statistic: Distribution Theory; Charles Griffin & Comp. Lim.: London, UK, 1958. [Google Scholar]
- Kryzhanovsky, B.V.; Litinskii, L.B. Generalized Bragg-Williams equation for systems with arbitrary long-range interaction. Dokl. Math. 2014, 90, 784. [Google Scholar] [CrossRef]
- Kryzhanovsky, B.; Litinskii, L. Applicability of n-vicinity method for calculation of free energy of Ising model. Physics A 2017, 468, 493. [Google Scholar] [CrossRef]
- Kryzhanovsky, B.; Litinskii, L. Generalized approach to description of energy distribution of spin system. Opt. Mem. Neur. Nets. 2015, 24, 165. [Google Scholar] [CrossRef]
- Bragg, W.L.; Williams, E.J. The effect of thermal agitation on atomic arrangement in alloys. Proc. R. Soc. A 1934, 145, 699. [Google Scholar]
- Kryzhanovsky, B.V. Approximation of the n-vicinity method. Dokl. Phys. 2019, 64, 280. [Google Scholar] [CrossRef]
- Binder, K. Finite size analysis of Ising model block distribution functions. Z. Phys. B 1981, 43, 119. [Google Scholar] [CrossRef]
- dos Anjos, R.A.; Viana, J.R.; de Sousa, J.R.; Plascak, J.A. Three-dimensional Ising model with nearest- and next-nearest-neighbor interactions. Phys. Rev. E 2007, 76, 022103. [Google Scholar] [CrossRef] [PubMed]
- Murtazaev, A.K.; Ramazanov, M.K.; Kurbanova, D.R.; Badiev, M.K.; Abuev, Y.K. A study of the critical properties of the Ising model on body-centered cubic lattice taking into account the interaction of next behind nearest neighbors. Phys. Solid State 2017, 59, 1103. [Google Scholar] [CrossRef]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).






