Next Article in Journal
Quantum Nonlocality: How Does Nature Do It?
Previous Article in Journal
Theories of Relativistic Dissipative Fluid Dynamics
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Small and Simple Systems That Favor the Arrow of Time

by
Ralph V. Chamberlin
Department of Physics, Arizona State University, Tempe, AZ 85287-1504, USA
Entropy 2024, 26(3), 190; https://doi.org/10.3390/e26030190
Submission received: 10 January 2024 / Revised: 17 February 2024 / Accepted: 19 February 2024 / Published: 23 February 2024
(This article belongs to the Section Thermodynamics)

Abstract

:
The 2nd law of thermodynamics yields an irreversible increase in entropy until thermal equilibrium is achieved. This irreversible increase is often assumed to require large and complex systems to emerge from the reversible microscopic laws of physics. We test this assumption using simulations and theory of a 1D ring of N Ising spins coupled to an explicit heat bath of N Einstein oscillators. The simplicity of this system allows the exact entropy to be calculated for the spins and the heat bath for any N , with dynamics that is readily altered from reversible to irreversible. We find thermal-equilibrium behavior in the thermodynamic limit, and in systems as small as N = 2 , but both results require microscopic dynamics that is intrinsically irreversible.

1. Introduction

The second law of thermodynamics is the fundamental barrier that prevents us from going back in time. Indeed, this “2nd law” causes the unidirectional increase in entropy needed for the “arrow of time” [1,2,3,4,5,6] and the maximum in entropy needed for thermal equilibrium. Because other basic laws of physics are reversible, the 2nd law dominates our daily lives. However, most (but not all [7,8,9]) scientists believe that irreversible behavior emerges from reversible microscopic dynamics only when systems are large and complex. As an early example, Ludwig Boltzmann often sought to obtain the irreversible 2nd law from large systems of gas particles governed by reversible Newtonian dynamics, with mixed success. His goal was to justify the maximum in entropy needed for thermal equilibrium, now embodied by Boltzmann’s factor p e E / k T , where Boltzmann’s constant ( k ) connects the energy ( E ) to an ideal heat bath at temperature T . (An ideal heat bath is effectively infinite, with weak but essentially instantaneous thermal coupling to the system [10].) Although experiments must ultimately decide the range of 2nd law behavior [11,12,13,14], the models described here have the advantage of dynamics that is easily altered from reversible to irreversible, system sizes that are precisely fixed, and entropy of the entire system (including heat bath) that can be calculated exactly at every step.
Computer simulations provide unique insight into how macroscopic behavior emerges from microscopic dynamics [15,16,17]. In fact, the first molecular dynamics (MD) simulations on a digital computer surprised Enrico Fermi and his team by showing that small anharmonic systems governed by Newton’s laws fail to reach thermal equilibrium [18]. Although MD simulations of larger systems usually exhibit thermal-equilibrium averages [19,20], when Fermi’s ideas are extended to study dynamics, many systems have energy fluctuations that diverge from standard statistical mechanics as T 0 [21]. This disconnect between Boltzmann’s factor and Newton’s laws arises when conservation of local energy overwhelms the weak coupling to the heat bath. Here, we study a similar disconnect between Boltzmann’s factor and thermal behavior in systems that are simple enough to allow exact calculation of all contributions to entropy. We find that in this simple system the 2nd law requires steps that are intrinsically irreversible, yielding the arrow of time in small and simple systems and a minimal model for maximum entropy.

2. Models

All systems studied here are based on the Ising model, consisting of interacting binary degrees of freedom (“spins”) on a periodic lattice [22]. We start with the one-dimensional (1D) Ising model having N spins in a 1D “ring” (to avoid anomalous endpoints). The potential energy is U = J i = 1 N b i σ i σ i + 1 . Here, J is an interaction energy and b i governs whether this interaction (“bond”) occurs between neighboring spins at lattice sites i and i + 1 , with b N connecting spins at the ends of the ring ( i = N and i = 1 ). Bonded spins ( b i = 1 ) have interaction energy J if they are aligned or + J if they are anti-aligned, with b i = 0 if they are unbonded. In the standard Ising model, b i = 1 for all spins. Here, most simulations have b i = 0 intermittently, so that the number of non-interacting bonds is N 0 = N i = 1 N b i N / 2 , to ensure maximum entropy and thermal equilibrium in stable nanothermodynamics [23,24]. Intermittent b i = 0 also adds complexity via a third energy value between neighboring spins, which is needed for the arrow of time.
Thermal behavior of 1D Ising-like spins can be treated analytically for systems of any size using Boltzmann’s entropy [25]:
S U / k = ln N ! 2 N 0 N N 0 N x ! N 0 ! N x ! .
Here, N x is the number of + J bonds between anti-aligned spins, leaving N N 0 N x as the number of J bonds between aligned spins. Note that the term 2 N 0 is a consequence of N 0 independent segments of spins (having non-bonded endpoints) in the ring, which is replaced by 2 N 0 + 1 when there are free boundaries or when N 0 = 0 [26]. However, the likelihood of having no broken bonds ( N 0 = 0 ) is negligible if N 10 and T is not too low because the system rarely fluctuates far from the N 0 / N = 0.5 value that maximizes the entropy of mixing. At the energies investigated here, equilibrium values are: N 0 / N = 0.43 0.49 . In terms of the bond types appearing in Equation (1), the potential energy becomes:
U / J = ( N N 0 2 N x ) .
We study 1D Ising-like spins by adapting the Creutz model [27]. In the Creutz model, Ising spins exchange energy with an explicit heat bath of “demons” (Einstein oscillators) having the same energy spacing between discrete levels. In our adaptation, there is one demon fixed to each spin site. The demon at site j serves as a local source of energy, K j = J n j , where the number of energy units in the demon ( n j ) is a non-negative integer, yielding K j 0 that is characteristic of a kinetic energy. Summing over all sites gives K = j = 1 N K j . The rules of the model ensure that total energy ( E = U + K ) is always exactly conserved.
The Creutz model utilizes the dynamics of cellular automata [28] to yield Monte-Carlo (MC) thermal statistics from a microcanonical simulation [29]. Cellular automata are useful as [30] “(i)…computational tools” for the efficient study of simplified models, “(ii)…fully discrete dynamical systems… (that) are relevant to physics only so far as dynamical systems are relevant to physics”, or “(iii)…original models for actual physical phenomena, possibly competing with existing continuum models”. An example of (iii) is [31]. Our Creutz-like model is (i) useful as a computational tool but may also be (ii) as relevant to physics as other dynamical systems. Like most microcanonical MD simulations, the Creutz model is assumed to reach thermal equilibrium without explicit use of detailed balance or Boltzmann’s factor. Indeed, a modified Creutz model has been found to match MD simulations of a classical fluid [32]. Of special interest is when the Creutz model is made reversible [29]. Unlike most MD simulations, where round-off errors and sensitivity to initial conditions often yield divergent trajectories [15,33], the discrete states of the Creutz model allow simulations to be run for an unlimited number of steps; then, if reversed, after the same number of steps the system returns to its exact initial state. Although many types of cellular automata also show unlimited reversibility, the Creutz model has an explicit heat bath that yields thermal statistics for small systems and thermodynamic behavior for large systems, but only if the dynamics is intrinsically irreversible.
Unlike most MC simulations that utilize a fixed temperature from an ideal heat bath, simulations of the Creutz model have fixed energy so that T is found from thermal averages. Consider N sources of K . If each K j was coupled to an ideal heat bath, its average energy would be given by Bose–Einstein statistics K = J / ( e J / k T 1 ) . Inverting this equation yields the average temperature: k T = J / ln ( 1 + J / K ) . Although finite-size effects in small systems corrode the concept of T , the exact Boltzmann’s entropy for N sources of K can be written for systems of any size [34]:
S K / k = ln K + N 1 ! K ! N 1 ! .
In fact, we find accurate thermal averages for N 2 by counting the ways that E = U + K can be distributed between U and K . Specifically, the entropies Equations (1) and (3) yield the multiplicities W U = e S U / k and W K = e S K / k , which have joint probabilities:
p U , K = ( W U W K ) / U , K ( W U W K ) .
Table 1 gives key properties of the N = 2 system having total energy E / N J 1 . Even in a relatively short simulation, all possible spin states and bonds are likely to occur, with weighted averages given in the bottom row of Table 1. Similar tables can be constructed for systems having other sizes and energies, but such tables become unwieldy for large systems.

3. Results

We simulate Creutz-like models as described in Appendix A. The main part of Figure 1 shows the total entropy density as a function of time for various simulations of a system having N = 2 × 10 6 and E / N J 1 . Figure 1A–C shows, respectively, the behavior at the beginning, near the middle (vertical scale × 10 5 , with a common offset), and the end of the simulations. The upper three sets of data in Figure 1A,C also have an expanded vertical scale ( × 10 2 , with a common offset). Two sets of simulations are reversible. The first set (green and grey lines) has dynamics of each step that is governed by the nearest source of K (“local K ”). The second set (blue and cyan lines) has sources of K located throughout the lattice, which are chosen using randomly-ordered (but fixed) arrays (“global K ”). The other sets of simulations (red and magenta lines) are irreversible, with global K chosen using new random numbers for every step. Main colors (green, blue, and red) come from the initial simulation, with spins always starting in the same low entropy state. Secondary colors (grey, cyan, and magenta) come from averaging three subsequent simulations of each type, alternating between reversible and irreversible dynamics, with spins starting in the final state of the previous simulation. All reversible simulations (green, grey, blue, and cyan) start and end in the same state, whereas irreversible simulations (red and magenta) show no tendency to return to their initial state. Horizontal lines in Figure 1B show that when averaged over all intermediate steps, entropy increases slightly with increasing randomness for the initial simulations (solid), while subsequent simulations (dashed) show a sharp increase from dynamics that is reversible (grey and cyan), to irreversible dynamics (magenta). Black lines in Figure 1A,C come from the initial simulation of a similar system, with global K and reversible dynamics but no broken bonds. The peak entropy densities of all other simulations are about k ln ( 2 ) higher, as is expected from the entropy of mixing when broken bonds are allowed. Such large increases in entropy indicate that the 2nd law favors intermittent interactions between particles, consistent with the thermodynamic heterogeneity measured in most types of materials [35,36,37].
Four lines in Figure 1A (black, green, blue, and red) show that the entropy during each initial simulation rises sharply from an initial state, with rates that increase with increasing randomness. Specifically, for the entropy to reach 95 % of the maximum value, irreversible dynamics (red) requires a single sweep, whereas reversible dynamics requires seven sweeps with global K (blue) and eleven sweeps with local K (green); in contrast, systems with no broken bonds (black) never approach this maximum. Two lines in Figure 1A,C (red and magenta) show that systems with intrinsic randomness are irreversible. All other lines are reversible, precisely following every step back in time, even after more than 2.62 × 10 11 steps.
Figure 1B displays these same simulations over an intermediate interval of times with the vertical scale × 10 5 . Although initial simulations (green, blue, and red) have considerable overlap in their fluctuations, their time-averaged entropies (solid horizontal lines) increase significantly with increasing randomness (standard errors are less than the line thickness). Furthermore, subsequent simulations exhibit a large jump in entropy from dynamics that is reversible (grey and cyan) to irreversible dynamics (magenta), which is even clearer when time-averaged (dashed horizontal lines). Thus, Figure 1 establishes that the total entropy from irreversible dynamics is significantly and persistently higher than that from reversible dynamics. Moreover, because each reversible simulation in the averaged behavior is subsequent to an irreversible simulation, spins that start in a high-entropy state evolve to lower entropy if the dynamics becomes reversible.
The inset in Figure 1 shows power-spectral densities (PSD) as a function of relative frequency ( f ) using the same sets of simulations and line colors given in the main part of the figure. Each PSD is found by taking the squared absolute value of the Fourier transform of K . The two sets of irreversible simulations (magenta) often overlap, giving a measure of the uncertainty. These PSD decrease monotonically with increasing f for 10 log f > 30 , consistent with the overdamped relaxation shown by the irreversible simulations in Figure 1A. Lines from reversible simulations having local K (grey) and global K (cyan) overlap only at high frequencies. Both have a minimum at 10 log f 38 , then increase monotonically with increasing f, reaching a peak value at the highest f, consistent with the fast oscillations shown by the reversible simulations in Figure 1A,C. The PSD from reversible dynamics utilizing local K (grey) shows 1/f-like behavior for 10 log f < 25 , indicative of slow energy diffusion at long times.
Figure 2A shows moving averages of the total entropy from the simulations of Figure 1, with Figure 2B,C from the separate entropies of K and U , respectively. Each symbol comes from averaging 10 4 sweeps, which is positioned at the median time. Global K is used for both reversible dynamics (black squares) and irreversible dynamics (red circles). Open symbols come from initial simulations, with closed symbols coming from averaging three sets of subsequent simulations. Error bars (visible when larger than the symbol size) give the standard error from averaging the subsequent simulations. Total entropies (Figure 2A) of the initial reversible simulation (open squares) are nearly as high as the initial irreversible simulation (open circles), consistent with the same simulations in Figure 1B (blue and red lines, respectively). Entropies of subsequent reversible simulations in Figure 2A (filled squares) are sharply lower than those of irreversible simulations (filled circles), which is again consistent with the behavior in Figure 1B (cyan and magenta lines, respectively). The total entropy in Figure 2A tracks the entropy of K in Figure 2B but mirrors the entropy of U in Figure 2C, so that the reduction in entropy for reversible dynamics comes from the explicit heat bath. Thus, this behavior cannot be seen in simulations utilizing the Metropolis algorithm where the entropy of the bath is not known. Our results are consistent with MD simulations showing deviations from standard statistical mechanics [21], which is attributable to the explicit conservation of energy and intrinsic reversibility of Newton’s laws.
Now let us focus on the behavior during the middle third of Figure 2. During these middle times, all simulations have the average rate of bond-change attempts reduced to 1/10th the rate for spin-change attempts. Note that the total entropy is significantly altered only for reversible dynamics. Interestingly, this total entropy is reduced during the initial simulation but is increased during subsequent simulations. Thus, reversible dynamics yields non-equilibrium steady states with entropy that depends on the relative time scales of the dynamics and on the initial conditions [38,39]. In contrast, entropy is significantly and consistently higher for irreversible dynamics.
Symbols in Figure 2D show the time dependences of the ratio of probabilities from adjacent levels in K . Specifically, these are as follows: ln p n / p n + 1 with n = 0 (squares), n = 1 (circles), n = 2 (up triangles), and n = 3 (down triangles). Thus, if Boltzmann’s factor can be used for K , each symbol gives K / k T , where K = K n + 1 K n = J . Overlapping red symbols indicate that a single T applies to all levels only for irreversible dynamics of large systems. Black symbols show that reversible dynamics requires one value of effective T for n = 0 and n = 2 , and another value for n = 1 and n = 3 , with additional values for middle times when bond-change rates are reduced. The concept of a single T also fails for irreversible dynamics in smaller systems ( N = 128 , green symbols), but such finite-size effects are expected when a fixed total energy is insufficient to thermally occupy higher energy levels. Thus, Boltzmann’s factor applies only in the thermodynamic limit, and only if the dynamics is intrinsically irreversible.
Figure 3 displays various entropy densities, and their differences, as a function of N . The main plot has logarithmic axes with 2 N 2 × 10 6 , while the inset has linear axes with 2 N 16 . Line and symbol colors identify the total energy during each simulation (see legends). The uppermost lines (dash-dotted) show that S i r r / N k increases with increasing N , approaching a constant value at large N . Symbols in the inset show that S i r r / N k (circles) from simulations coincide with S t h e o / N k (squares) from summing the entropies of all states weighted by their multiplicities, similar to those given in Table 1. The inset also shows S i r r S t h e o / S t h e o (triangles) as percentages. Although Boltzmann’s factor does not describe such small systems, if the dynamics is intrinsically irreversible, thermal equilibrium from the entropy-weighted sum over all states remains valid down to N = 2 . Of course, thermal equilibrium fails for N = 1 because there is no randomness in choosing the single source of K .
Symbols in the main part of Figure 3 show the size dependence of the difference between entropies, ( S i r r S r e v ) / N k = S / N k . Symbol color and type identify the total energy and heat bath, given in the legend. Lines, from fits to the data using S / N k = s / N + c with s and c constants, show general agreement with the behavior from local (dashed) and global (solid) K . Irreversible dynamics increases the entropy, S > 0 , except for three blue triangles (two filled and one open) missing from Figure 3 where N = 1   o r   4 × 10 4 with E / N J 2 . Having S < 0 can be understood from Figure 2D by the number of values of effective T needed to describe the dynamics, which changes from many values for small systems (green symbols), to two values for large reversible systems (black symbols), and to only one value for irreversible dynamics (red symbols). More importantly, even as N 2 where S / N k ~ 0.02 , the inset shows that S i r r closely matches the calculated multiplicity, while S r e v is several standard deviations higher. Most importantly, linear fits to all data sets at N 4 × 10 5 (green dotted lines) have positive slopes ( S / N k increases with increasing N ), which is opposite to the behavior needed for S r e v to approach S i r r in the thermodynamic limit.

4. Discussion

Three issues that could cause reversible simulations to deviate from thermal equilibrium are: non-ergodic dynamics, persistent oscillations, and lack of detailed balance. All three issues appear in the dynamics given in Table A1 (Appendix B) for the simple system of Table 1 ( N = 2 and E / N J 1 ). The first column of Table A1 shows five initial configurations, all with K = 4 and σ i = 1 ; five other configurations having σ i = 1 are equivalent and hence not shown. The numbers in square brackets below each configuration give the values of [ K 1 | K 2 ] governing spins σ 1 and σ 2 , and their respective bonds, b 1 and b 2 . Each row in Table A1 shows a full cycle of the time evolution for reversible dynamics with local K , which differs only slightly from global K since N = 2 . Each time sweep contains a fixed sequence of two pairs of time steps: energy K 1 applied to step 1A (attempt to change σ 1 ) and step 1B (attempt to change b 1 ), with K 2 applied to steps 2A and 2B (attempts to change σ 2 and b 2 ).
Figure 4 shows the time dependences of total K for all distinct configurations of the N = 2 and E / N J 1 system with reversible dynamics, from the top three rows of Table A1. First, note that the simulations are non-ergodic, e.g., the state K = 0 is reached only if the initial configuration is [ 4 | 0 ] (black squares). Next, note that all configurations are recurrent, returning to their initial configuration with σ i = 1 after periods of 20, 24, and 16 steps for K 1 K 2 = [ 4 | 0 ] , [ 3 | 1 ] , and [ 2 | 2 ] , respectively. These oscillations are undamped, which is attributable to the simplicity of the N = 2 system, similar to the persistent oscillations that prevent MD simulations of simple systems from reaching thermal equilibrium [18,19,20]. Larger systems with reversible dynamics have damped oscillations, as shown in Figure 1. By analogy to MD simulations of large systems showing similar oscillations [21], deviations from standard statistical mechanics arise when conservation of local energy overwhelms the necessarily weak coupling to the heat bath. We identify these oscillations, which occur only if the dynamics is reversible, as the primary source of deviations from maximum entropy in the thermodynamic limit, N 10 4 . Finally, note that the N = 2 system does not obey detailed balance. Specifically, from counting the fraction of times each value of K appears in all cycles of Table A1, we find probabilities of 0.237, 0.288, 0.263, 0.172, and 0.040 for K = 4, 3, 2, 1, and 0, respectively; in contrast, Table 1 gives the theoretical probabilities needed for maximum entropy: p U , K 0.208, 0.333, 0.25, 0.167, and 0.042. These two sets of probabilities differ by 3–15%, which is somewhat more than the 2–4% differences in entropy shown in Figure 3 for N = 2 and E / N J 1 . All three of these issues likely contribute to the failure of reversible dynamics to reach maximum entropy. The issue of a lack of detailed balance dominates for small N . The issue of underdamped oscillations persists into the thermodynamic limit. The issue of non-ergodic behavior is most relevant to the dependence on initial conditions shown in Figure 2A. Intrinsic randomness in the sequence of chosen spins and sources of K allows flexibility in the dynamics that ensures ergodicity, detailed balance, and overdamped relaxations needed for the system to yield maximum entropy, a well-defined temperature, and thermal-equilibrium probabilities of each configuration.
Two additional differences between reversible and irreversible dynamics are the size and randomness of the heat bath. Reversible dynamics with local K utilizes a single source ( K i ) for spin σ i and bond b i , whereas global K utilizes two sources, which are K j σ for σ i and K j b for b i . In both cases, to facilitate reversibility, fixed arrays of sources are used throughout the simulation. Irreversible dynamics also has two versions, one utilizing K j for σ i and b i and the other having K j σ for σ i and K j b for b i , with all sources chosen randomly each time. Although the probabilities that the same sources govern subsequent attempts to change σ i and b i differ greatly, 1 / N   versus 1 / N 2 respectively, both irreversible versions give equivalent behavior. Thus, the key feature in the bath that causes reversible dynamics to deviate from thermal equilibrium is that every attempt to change σ i and b i is governed by the same source(s) of K . Note that similar differences in the size and randomness of the heat bath arise in MD and MC simulations. Specifically, particles in MD simulations usually interact with a finite set of nearby neighbors that tend to continue their interactions for several steps; in contrast, particles in MC simulations receive thermal energy from an ideal heat bath that is effectively infinite, with zero chance that the bath will be correlated over subsequent steps. Indeed, at least in the thermodynamic limit, our Creutz-like model shares some similarities with other types of simulations: reversible dynamics yields deviations from standard statistical mechanics similar to MD simulations [21], whereas irreversible dynamics yields Boltzmann statistics consistent with MC simulations.
Intrinsic randomness for the 2nd law in our simulations comes from a random number generator. We speculate about possible sources of this randomness in real systems. One possibility is that local sources of K have weak but effectively instantaneous coupling to an ideal heat bath, but this mechanism is inconsistent with MD simulations [21] and experimental evidence from most types of materials [37]. Another possibility is that intrinsic irreversibility and the 2nd law in real systems come from wavefunction collapse [1,3,8,9]. If an analogy can be made, in our model each step involves one spin coupling to its heat bath, so that N = 2 may be related to a double-slit experiment. Then, during reversible dynamics the choice of K follows a randomly-ordered (but fixed) sequence, analogous to a priori knowledge about which slit passes the particle. In contrast, irreversible dynamics involves intrinsic randomness in the choice of K , analogous to an irreversible wavefunction collapse when a particle is measured as it passes through a slit.

5. Conclusions

Our simulations reveal some unanticipated results regarding the thermal behavior of simple systems. Intrinsically random steps are needed for maximum entropy in systems of all sizes. Specifically, intrinsically random steps are needed to validate Boltzmann’s factor and yield a well-defined temperature in the thermodynamic limit N 10 4 . Similarly, systems as small as N = 2 can be accurately described by the concept of entropy for a weighted sum over all states, but only if there is intrinsic randomness in the choice of K . One mechanism contributing to deviations from standard statistical mechanics for reversible dynamics is that conservation of local energy can overwhelm any weak coupling to an idealized heat bath, as it does for fluctuations in MD simulations [21]. If the behavior of such simplistic simulations can be extended to more-realistic systems, our results suggest that intrinsic local randomness may be needed to yield maximum entropy for the 2nd law of thermodynamics and irreversible dynamics for the arrow of time.

Funding

This research received no external funding.

Data Availability Statement

The original contributions presented in the study are included in the article. Further inquiries can be directed to the author.

Acknowledgments

I gratefully acknowledge insightful input from Sumiyoshi Abe, Ernst G. Bauer, Ruth E. Kastner, Aiden Lewis, Vladimiro Mujica, and George H. Wolf. I also thank Research Computing at Arizona State University for use of their facilities.

Conflicts of Interest

The author declares no conflicts of interest.

Appendix A

We simulate Creutz-like models as follows. The spins are initialized into a low-energy configuration having a long segment of neighboring spins oriented up, then an equally long segment oriented down. This configuration allows simulations at relatively low energies without the risk of freezing all spins into their fully-aligned state. K is initialized by adding one unit of energy to a randomly-chosen site, n j n j + 1 , then repeating until the total energy reaches the set value for the simulation, E = U + K .
Each step in the simulation involves an attempt to change the alignment of one spin, σ i , accompanied by an attempt to change the state of the bond associated with the spin, b i . Changes that may occur include inverting the spin and making or breaking the bond. Changes occur if, and only if, energy can be conserved. For example, if inverting spin σ i increases U , the source K j must be sufficient to keep n j 0 after the change, consistent with demons acting as sources of kinetic energy. Alternatively, if inverting σ i does not increase U the step always proceeds, with any reduction in U going to K j . Such steps are repeated N times to yield a single sweep. The sweeps are repeated many times, often yielding ~ 10 11 steps per simulation. For post-processing evaluation, a set of several quantities is recorded in a file. Each recorded set includes a moving average of U / N , K / N , N 0 / N , and p n for the lowest eight levels of K . For convenience, file size is limited to a total of 2 17 = 131,072 sets of data per simulation. For short simulations (or large systems), the data set is recorded after every sweep, whereas for long simulations of smaller systems each quantity may be averaged over 10, 100, 1000, or 10,000 sweeps before recording.
We intermix reversible and irreversible simulations to study both types of dynamics. Specifically, the first simulation is reversible, so that the system returns to its far-from-equilibrium starting state at the end of the simulation. The second simulation continues from the final state of the first simulation, redistributes K , then proceeds irreversibly. The third simulation continues from the final state of the second simulation, redistributes K , then proceeds using reversible dynamics. Such simulations are repeated to yield 6–10 simulations. Initial evolutions of reversible and irreversible dynamics come from the 1st and 2nd simulations, respectively. Averaged behavior comes from averaging subsequent simulations, e.g., 3rd, 5th, 7th, and 9th simulations for reversible dynamics and 4th, 6th, 8th, and 10th simulations for irreversible dynamics.
For intrinsic randomness we utilize the Mersenne Twister pseudo-random number generator [40] that is seeded randomly for effectively random behavior. Separate random numbers are found for choosing the site ( i ), the source ( K j for changing σ i and b i ), and the order of spin-first or bond-first attempts. Other simulations utilize an additional random number: K j σ for changing σ i and K j b for changing b i . Because all such simulations show similar behavior, we identify the crucial ingredient to be the intrinsic randomness yielding a continually varying choice of which source of K is used for each attempt.
All algorithms used for simulating reversible dynamics involve creating arrays of randomly-ordered (but fixed) sequences of sites, with each site occurring once (and only once) in each array. The sequences are chosen randomly to reduce correlations but are fixed so that the dynamics can be reversed. The “local K ” algorithm utilizes a single array for the site to be updated at each step, with the single K i at that site governing the attempt to change first the spin ( σ i ) and then its bond ( b i ). The “global K ” algorithm utilizes a second randomly-ordered array for K j σ to change σ i , and a third randomly-ordered array for K j b to change b i , with alternating spin-first or bond-first attempts. The entropy increases slightly by this tripling in the number of randomly-ordered arrays. Such a small increase suggests that no reversible algorithm can match the maximum entropy of irreversible dynamics. Reversal occurs at the midpoint of each simulation by reversing the order of every attempt, analogous to techniques used to study Loschmidt’s paradox.

Appendix B

Table A1. Time evolutions for distinct N = 2 systems having total energy E / N J 1 . Each column shows configurations of low-energy ( ), high-energy ( × ), or no-energy ( ) bonds; with spins that may be up ( ) or down ( ). Numbers in brackets give both sources of K , [ K 1 | K 2 ] , for each configuration.
Table A1. Time evolutions for distinct N = 2 systems having total energy E / N J 1 . Each column shows configurations of low-energy ( ), high-energy ( × ), or no-energy ( ) bonds; with spins that may be up ( ) or down ( ). Numbers in brackets give both sources of K , [ K 1 | K 2 ] , for each configuration.
InitialSweep 1Sweep 2Sweep 3
Step 1AStep 1BStep 2AStep 2BStep 1AStep 1BStep 2AStep 2BStep 1AStep 1BStep 2A
[ 4 | 0 ] × × [ 0 | 0 ] × [ 1 | 0 ] [ 1 | 2 ] [ 1 | 1 ] [ 1 | 1 ] × [ 0 | 1 ] [ 0 | 3 ] [ 0 | 4 ] [ 0 | 4 ] [ 0 | 4 ] × × [ 0 | 0 ]
[ 3 | 1 ] [ 3 | 1 ] [ 2 | 1 ] [ 2 | 1 ] [ 2 | 0 ] [ 2 | 0 ] × [ 1 | 0 ] [ 1 | 2 ] [ 1 | 3 ] [ 1 | 3 ] [ 4 | 0 ] × [ 0 | 1 ]
[ 2 | 2 ] [ 2 | 2 ] [ 1 | 2 ] × [ 1 | 0 ] [ 1 | 1 ] [ 1 | 1 ] [ 2 | 1 ] [ 2 | 1 ] [ 2 | 2 ] [ 2 | 2 ] [ 1 | 2 ] × [ 1 | 0 ]
[ 1 | 3 ] [ 1 | 3 ] [ 0 | 3 ] × [ 0 | 1 ] [ 0 | 2 ] [ 0 | 2 ] [ 1 | 2 ] × [ 1 | 0 ] × [ 1 | 0 ] [ 3 | 0 ] [ 2 | 0 ] [ 2 | 0 ]
[ 0 | 4 ] [ 0 | 4 ] [ 0 | 4 ] × × [ 0 | 0 ] × [ 0 | 1 ] [ 2 | 1 ] [ 1 | 1 ] [ 1 | 1 ] × [ 1 | 0 ] [ 4 | 0 ] [ 4 | 0 ] [ 4 | 0 ]
Sweep 3Sweep 4Sweep 5Sweep 6
Step 2BStep 1AStep 1BStep 2AStep 2BStep 1AStep 1BStep 2AStep 2BStep 1AStep 1BStep 2A
× [ 0 | 1 ] [ 2 | 1 ] [ 1 | 1 ] [ 1 | 1 ] × [ 1 | 0 ] [ 3 | 0 ] [ 4 | 0 ] [ 4 | 0 ] [ 4 | 0 ]
[ 0 | 2 ] [ 0 | 2 ] [ 1 | 2 ] × [ 1 | 0 ] × [ 1 | 0 ] [ 3 | 0 ] [ 2 | 0 ] [ 2 | 0 ] [ 2 | 0 ] [ 2 | 0 ] [ 3 | 0 ] [ 3 | 0 ]
[ 1 | 1 ] [ 1 | 2 ] [ 2 | 1 ] [ 2 | 1 ] [ 2 | 2 ]
[ 2 | 0 ] [ 2 | 0 ] [ 3 | 0 ] [ 3 | 0 ] [ 3 | 1 ] [ 3 | 1 ] [ 2 | 1 ] [ 2 | 1 ] [ 2 | 0 ] [ 2 | 0 ] × [ 1 | 0 ] [ 1 | 2 ]
[ 4 | 0 ] × × [ 0 | 0 ] × [ 1 | 0 ] [ 1 | 2 ] [ 0 | 1 ] [ 1 | 1 ] × [ 0 | 1 ] [ 0 | 3 ] [ 0 | 4 ]

References and Notes

  1. Davies, P.C.W. The Physics of Time Asymmetry; University of California Press: Oakland, CA USA, 1974. [Google Scholar]
  2. Lebowitz, J.L. Boltzmann’s entropy and time’s arrow. Phys. Today 1993, 46, 32–38. [Google Scholar] [CrossRef]
  3. Albert, D.Z. Time and Chance; Harvard University Press: Cambridge, MA, USA, 2000. [Google Scholar]
  4. Schollwöck, U. Why does time have a future? The physical origins of the arrow of time. Configurations 2015, 23, 177–195. [Google Scholar] [CrossRef]
  5. ‘t Hooft, G. Time, the arrow of time, and quantum mechanics. Front. Phys. 2018, 6, 1–10. [Google Scholar] [CrossRef]
  6. Roduner, E.; Kruger, T.P.J. The origin of irreversibility and thermalization in thermodynamic processes. Phys. Rep. 2022, 944, 1–43. [Google Scholar] [CrossRef]
  7. Wehrl, A. General properties of entropy. Rev. Mod. Phys. 1978, 50, 221–260. [Google Scholar] [CrossRef]
  8. Kastner, R.E. On quantum collapse as a basis for the second law of thermodynamics. Entropy 2017, 19, 106. [Google Scholar] [CrossRef]
  9. Kastner, R.E. Decoherence and the transactional interpretation. Int. J. Quant. Found. 2020, 6, 24–39. [Google Scholar]
  10. Feynman, R.P. Statistical Mechanics; Perseus Books: Reading, MA, USA, 1998; p. 1. [Google Scholar]
  11. Batalhão, T.B.; Souza, A.M.; Sarthour, R.S.; Oliveira, I.S.; Paternostro, M.; Lutz, E.; Serra, R.M. Irreversibility and the arrow of time in a quenched quantum system. Phys. Rev. Lett. 2015, 115, 190601. [Google Scholar] [CrossRef] [PubMed]
  12. Zhang, J.W.; Rehan, K.; Li, M.; Li, J.C.; Chen, L.; Su, S.-L.; Yan, L.-L.; Zhou, F.; Feng, M. Single-atom verification of the information-theoretical bound of irreversibility at the quantum level. Phys. Rev. Res. 2020, 2, 033082. [Google Scholar] [CrossRef]
  13. Jayaseelan, M.; Manikandan, S.K.; Jordan, A.N.; Bigelow, N.P. Quantum measurement arrow of time and fluctuation relations for measuring spin of ultracold atoms. Nat. Commun. 2021, 12, 1847. [Google Scholar] [CrossRef] [PubMed]
  14. Lynn, C.W.; Holmes, C.M.; Bialek, W.; Schwab, D.J. Decomposing the local arrow of time in interacting systems. Phys. Rev. Lett. 2022, 129, 118101. [Google Scholar] [CrossRef] [PubMed]
  15. Schroeder, D.V. Interactive molecular dynamics. Am. J. Phys. 2015, 83, 210–218. [Google Scholar] [CrossRef]
  16. Hoover, W.G.; Hoover, C.G.; Smith, E.R. Nonequlibrium time reversibility with maps and walks. Entropy 2022, 24, 78. [Google Scholar] [CrossRef]
  17. Veszeli, M.T.; Vattay, G. Relaxation of the Ising spin system coupled to a bosonic bath and the time dependent mean field equation. PLoS ONE 2022, 17, e0264412. [Google Scholar] [CrossRef] [PubMed]
  18. Fermi, E.; Pasta, J.R.; Ulam, S. Report LA-1940; Los Alamos Scientific Laboratory: Los Alamos, NM, USA, 1955. [Google Scholar]
  19. Livi, R.; Pettini, M.; Ruffo, S.; Sparpaglione, M.; Vulpiani, A. Equipartition threshold in nonlinear large Hamiltonian systems: The Fermi-Pasta-Ulam model. Phys. Rev. A 1985, 31, 1039–1045. [Google Scholar] [CrossRef] [PubMed]
  20. Matsuyama, H.J.; Konishi, T. Multistage slow relaxation in a Hamiltonian system: The Fermi-Pasta-Ulam model. Phys. Rev. E 2015, 92, 022917. [Google Scholar] [CrossRef] [PubMed]
  21. Chamberlin, R.V.; Mujica, V.; Izvekov, S.; Larentzos, J.P. Energy localization and excess fluctuations from long-range interactions in equilibrium molecular dynamics. Physica A 2020, 540, 123228. [Google Scholar] [CrossRef]
  22. Niss, M. History of the Lenz-Ising model 1950–1965: From irrelevance to relevance. Arch. Hist. Exact Sci. 2009, 63, 243–287. [Google Scholar] [CrossRef]
  23. Chamberlin, R.V.; Clark, M.R.; Mujica, V.; Wolf, G.H. Multiscale thermodynamics: Energy, entropy, and symmetry from atoms to bulk behavior. Symmetry 2021, 13, 721. [Google Scholar]
  24. Chamberlin, R.V. On “Nanoscale thermodynamics needs the concept of a disjoining chemical potential”, by W. Dong. Nat. Commun. 2023, 10, 1038. [Google Scholar] [CrossRef]
  25. Our S U / k in Eq. (1) is similar to S m c / k in Table 3 of Ref. [23]. However, η in S c / k is replaced by N 0 here, and 2 η + 1 is replaced by 2 N 0 (except when N 0 = 0 ) for periodic boundary conditions.
  26. As an example, consider N = 2 and N x = 0 so that the multiplicity in Eq. (1) becomes 2 ! 2 N 0 2 N 0 ! N 0 ! . If N 0 = 0 , then the special expression 2 N 0 + 1 = 2 is needed for the two orientations of a fully-aligned system. If N 0 = 1 , then the general expression 2 ! 2 N 0 = 4 yields the correct multiplicity for the periodic boundary condition that prevents additional configurations. Similarly, if N 0 = 2 the general expression 2 N 0 = 4 yields the correct multiplicity for the four degenerate alignments of two unbonded spins.
  27. Creutz, M. Microcanonical Monte Carlo simulations. Phys. Rev. Lett. 1983, 50, 1411–1414. [Google Scholar] [CrossRef]
  28. Kari, J. Theory of cellular automata: A survey. Theor. Comput. Sci. 2005, 334, 3–33. [Google Scholar] [CrossRef]
  29. Creutz, M. Deterministic Ising dynamics. Ann. Phys. 1986, 167, 62–72. [Google Scholar] [CrossRef]
  30. Vichniac, G.Y. Simulating physics with cellular automata. Physica 1984, 10D, 96–116. [Google Scholar] [CrossRef]
  31. ‘t Hooft, G. The Cellular Automaton Interpretation of Quantum Mechanics; Springer: Cham, Switzerland; Heidelberg, Germany, 2016. [Google Scholar]
  32. Levesque, D.; Verlet, L. Molecular dynamics and time reversibility. J. Stat. Phys. 1993, 72, 519–537. [Google Scholar] [CrossRef]
  33. Komatsu, N.; Abe, T. Noise-driven numerical irreversibility in molecular dynamics technique. Comp. Phys. Commun. 2005, 171, 187–196. [Google Scholar] [CrossRef]
  34. Callen, H.B. Thermodynamics and an Introduction to Thermostatistics, 2nd ed.; John Wiley & Sons: Hoboken, NJ, USA, 1985. [Google Scholar]
  35. Böhmer, R.; Chamberlin, R.V.; Diezemann, G.; Geil, B.; Heuer, A.; Hinze, G.; Kuebler, S.C.; Richert, R.; Schiener, B.; Sillescu, H.; et al. Nature of the non-exponential primary relaxation in structural glass-formers probed by dynamically selective experiments. J. Non-Cryst. Solids 1998, 235–237, 1–9. [Google Scholar] [CrossRef]
  36. Richert, R. Heterogeneous dynamics in liquids: Fluctuations in space and time. J. Phys. Condens. Matt. 2002, 14, R703–R738. [Google Scholar] [CrossRef]
  37. Chamberlin, R.V. The big world of nanothermodynamics. Entropy 2015, 17, 52–57. [Google Scholar] [CrossRef]
  38. Zhang, F.; Isbister, D.J.; Evans, D.J. Multiple nonequilibrium steady states for one-dimensional heat flow. Phys. Rev. E 2001, 64, 021102. [Google Scholar] [CrossRef] [PubMed]
  39. Iwatsuka, T.; Fukai, Y.T.; Takeuchi, K.A. Direct evidence for universal statistic of stationary Kardar-Parisi-Zhang interfaces. Phys. Rev. Lett. 2020, 124, 250602. [Google Scholar] [CrossRef] [PubMed]
  40. Matsumoto, M.; Nishimura, T. Mersenne Twister: A 623-dimensionally equidistributed pseudo-random number generator. ACM Trans. Model. Comput. Simul. 1998, 8, 3–30. [Google Scholar] [CrossRef]
Figure 1. Main figures show entropy density as a function of time at the beginning (A), ending (C), and intermediate (B) times of simulations having N = 2 × 10 6 and E / N J 1 . Line color identifies the types of dynamics and heat bath for initial simulations (main axis) and when averaged over subsequent simulations on an expanded scale of × 10 2 in (A,C) and × 10 5 in (B), with a common offset in each case. Specifically, red (magenta) lines show initial (averaged) behavior of irreversible simulations. Initial (averaged) reversible dynamics using local K is shown by the green (grey) lines, whereas dynamics using global K is shown by the blue (cyan) lines. Horizontal lines in (B) show time-averaged values of each type. Black lines in (A,C) are also from reversible dynamics using global K , but with no broken bonds. The inset shows power-spectral densities as a function of relative frequency on a double-logarithmic plot, with line color matching that in the main figures.
Figure 1. Main figures show entropy density as a function of time at the beginning (A), ending (C), and intermediate (B) times of simulations having N = 2 × 10 6 and E / N J 1 . Line color identifies the types of dynamics and heat bath for initial simulations (main axis) and when averaged over subsequent simulations on an expanded scale of × 10 2 in (A,C) and × 10 5 in (B), with a common offset in each case. Specifically, red (magenta) lines show initial (averaged) behavior of irreversible simulations. Initial (averaged) reversible dynamics using local K is shown by the green (grey) lines, whereas dynamics using global K is shown by the blue (cyan) lines. Horizontal lines in (B) show time-averaged values of each type. Black lines in (A,C) are also from reversible dynamics using global K , but with no broken bonds. The inset shows power-spectral densities as a function of relative frequency on a double-logarithmic plot, with line color matching that in the main figures.
Entropy 26 00190 g001
Figure 2. Moving averages of entropy density from the simulations shown in Figure 1 for spins (C), bath (B), and combined (A). Symbol style identifies dynamics as reversible (black squares) or irreversible (red circles), from initial simulations (open) or from averaging over subsequent simulations (filled), and with error bars from the standard error. During the middle third of each simulation, the average rate of bond-change attempts is reduced to 1/10th the rate of spin-change attempts. (D) Moving averages of the ratio of probabilities between adjacent energy levels in K . Symbol shape identifies the levels as follows: n = 0 (squares), n = 1 (circles), n = 2 (up triangles), and n = 3 (down triangles). Black and red symbols are from the simulations shown in (AC) having reversible and irreversible dynamics, respectively. Green symbols are from irreversible dynamics in a system having N = 128 .
Figure 2. Moving averages of entropy density from the simulations shown in Figure 1 for spins (C), bath (B), and combined (A). Symbol style identifies dynamics as reversible (black squares) or irreversible (red circles), from initial simulations (open) or from averaging over subsequent simulations (filled), and with error bars from the standard error. During the middle third of each simulation, the average rate of bond-change attempts is reduced to 1/10th the rate of spin-change attempts. (D) Moving averages of the ratio of probabilities between adjacent energy levels in K . Symbol shape identifies the levels as follows: n = 0 (squares), n = 1 (circles), n = 2 (up triangles), and n = 3 (down triangles). Black and red symbols are from the simulations shown in (AC) having reversible and irreversible dynamics, respectively. Green symbols are from irreversible dynamics in a system having N = 128 .
Entropy 26 00190 g002
Figure 3. Entropies, and their differences, as a function of N on a double-logarithmic scale (main figure) and a linear scale (inset). Colors identify the total energy, as given in the legends. In the main figure, dash-dotted lines show S i r r / N k from irreversible simulations; symbols show S / N k = S i r r S r e v / N k , with the bath for reversible dynamics from local K (open) or global K (filled). Error bars are from the standard error of the mean. Lines show best fits to S / N k = s / N + c for local (dashed) and global (solid) K . Dotted lines show best fits to log S / N k = a + b log ( N ) for N 4 × 10 5 , yielding an average of b = 0.028 ± 0.005 . The inset shows behavior of small systems. Symbols give S i r r / N k from simulations (squares) and S t h e o / N k from counting all multiplicities (circles). Triangles show the percent difference between theory and simulation, ( S i r r S t h e o ) / S t h e o , using the right-hand scale, with colors corresponding to energies given in the legend.
Figure 3. Entropies, and their differences, as a function of N on a double-logarithmic scale (main figure) and a linear scale (inset). Colors identify the total energy, as given in the legends. In the main figure, dash-dotted lines show S i r r / N k from irreversible simulations; symbols show S / N k = S i r r S r e v / N k , with the bath for reversible dynamics from local K (open) or global K (filled). Error bars are from the standard error of the mean. Lines show best fits to S / N k = s / N + c for local (dashed) and global (solid) K . Dotted lines show best fits to log S / N k = a + b log ( N ) for N 4 × 10 5 , yielding an average of b = 0.028 ± 0.005 . The inset shows behavior of small systems. Symbols give S i r r / N k from simulations (squares) and S t h e o / N k from counting all multiplicities (circles). Triangles show the percent difference between theory and simulation, ( S i r r S t h e o ) / S t h e o , using the right-hand scale, with colors corresponding to energies given in the legend.
Entropy 26 00190 g003
Figure 4. Total kinetic energy as a function of time from reversible simulations of three initial distributions of K , given in the legend, corresponding to the first three rows in Table A1 (Appendix B).
Figure 4. Total kinetic energy as a function of time from reversible simulations of three initial distributions of K , given in the legend, corresponding to the first three rows in Table A1 (Appendix B).
Entropy 26 00190 g004
Table 1. Properties of an N = 2 system having total energy E / N J 1 . The first column shows representative configurations for low-energy ( ), high-energy ( × ), or no-energy ( ) bonds; with spins that may be up ( ) or down ( ). The next four columns give the number of no-energy ( N 0 ) and high-energy ( N x ) bonds, U / J (Equation (2)) and S U / k (Equation (1)). The next two columns give K = E U and S K / k (Equation (3)). The final two columns give S E = S U + S K and p U , K (Equation (4)). The bottom row gives weighted averages.
Table 1. Properties of an N = 2 system having total energy E / N J 1 . The first column shows representative configurations for low-energy ( ), high-energy ( × ), or no-energy ( ) bonds; with spins that may be up ( ) or down ( ). The next four columns give the number of no-energy ( N 0 ) and high-energy ( N x ) bonds, U / J (Equation (2)) and S U / k (Equation (1)). The next two columns give K = E U and S K / k (Equation (3)). The final two columns give S E = S U + S K and p U , K (Equation (4)). The bottom row gives weighted averages.
Configuration N 0 N x U / J S U / k K / J S K / k S E / k p U , K
00 2 l n ( 2 ) 4 l n ( 5 ) l n ( 10 ) 10/48
× × 022 l n ( 2 ) 0 l n ( 1 ) l n ( 2 ) 2/48
10 1 l n ( 4 ) 3 l n ( 4 ) l n ( 16 ) 16/48
× 111 l n ( 4 ) 1 l n ( 2 ) l n ( 8 ) 8/48
200 l n ( 4 ) 2 l n ( 3 ) l n ( 12 ) 12/48
Average/N−0.250.6065041.250.5937881.2002914
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Chamberlin, R.V. Small and Simple Systems That Favor the Arrow of Time. Entropy 2024, 26, 190. https://doi.org/10.3390/e26030190

AMA Style

Chamberlin RV. Small and Simple Systems That Favor the Arrow of Time. Entropy. 2024; 26(3):190. https://doi.org/10.3390/e26030190

Chicago/Turabian Style

Chamberlin, Ralph V. 2024. "Small and Simple Systems That Favor the Arrow of Time" Entropy 26, no. 3: 190. https://doi.org/10.3390/e26030190

APA Style

Chamberlin, R. V. (2024). Small and Simple Systems That Favor the Arrow of Time. Entropy, 26(3), 190. https://doi.org/10.3390/e26030190

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop