1. Introduction
The Fluctuation–Dissipation Relation (FDR) is as simple as it is profound [
1]. For a particle in a fluid we have
On the left-hand side of this equation, D is the diffusion coefficient of the particle, is Boltzmann’s constant, and T is the absolute temperature. The product has the dimension of energy and it is the characteristic “quantum” of Brownian motion. On the right-hand side, denotes the mobility, i.e., where v is the average speed of the particle in the fluid when it is subjected to a force F.
On the molecular level, there are other manifestations of the FDR. Take a resistor with a conductance
G. With no net current flowing, there is still a fluctuating voltage between the two ends of the resistor due to the Brownian motion of the charge carriers (generally electrons) inside the resistor. Conductance can be viewed as the electrical equivalent of mobility, i.e.,
, with
V being the voltage and
I being the current. With this realization, it is not hard to understand that the mean square of the fluctuating current,
, is related to the conductance
G through
. The relation
, where
is the frequency window, is known as the Johnson–Nyquist relation [
2].
Thinking of it more abstractly, the FDR connects characteristics of internal fluctuations on the left-hand side of Equation (
1) with a first-order, linear response to external prompting on the right-hand side of Equation (
1). The equation relates the first moment upon application of a perturbing force to the second moment in the absence of such a force. A more all-encompassing formulation of the FDR is due to Green and Kubo [
3].
For the FDR to apply, it is essential that the system is close to equilibrium. Equilibrium means that there is no identifiable arrow of time. A system at equilibrium displays time-reversal symmetry. About a century ago, Lars Onsager formulated the notion of microscopic reversibility, which is short for “time reversibility of microscopic dynamics” [
4,
5]. It means that any trajectory in a configuration space from an initial point
to a final point
is traversed in one direction as often as it is in the opposite direction. Much of the first-order theory that describes systems that are close to equilibrium, such as Onsager’s reciprocal relation for coupled energy flows, is based on the idea that microscopic reversibility still applies in case of small deviation from equilibrium [
4,
5].
Considerable research effort has been directed towards formulating an FDR for a system that is far away from equilibrium. In the late 1990s, the Jarzynski Equation gave insight into the response of a system when nonequilibrium is imposed beyond a regime where linear perturbation theory applies [
6,
7]. The Jarzynski Equality has an elegant simplicity, and soon after its discovery, it also turned out remarkably accurate in quantitatively accounting for the results of micromanipulation experiments with biomolecules [
8].
The work towards a nonequilibrium FDR has commonly taken an approach that is similar to the one that led to the Jarzynski Equation [
9,
10]. The guiding idea has been to let nonequilibrium events happen in a bath that is at equilibrium and that has a temperature. Temperature is a collective property and actually only makes sense if the collective is at equilibrium.
But what if the bath is the very source of nonequilibrium?
In liquid water at room temperature, an individual water molecule collides about
times per second. For time intervals
that are significantly larger than a picosecond, the displacement of such a water molecule is the result of many collisions. The Central Limit Theorem [
1] applies in that case, and the displacement in
follows the Gaussian distribution that is associated with equilibrium.
Through numerical simulation, Kanazawa et al. recently showed that in active media, i.e., media with artificial self-propelled colloids or swimming microorganisms, displacements of passive tracers follow not a Gaussian, but an
-stable distribution [
11].
Where a Gaussian distribution results for a process that is the cumulative effect of stochastic processes with a
finite standard deviation, an
-stable distribution results when
infinite standard deviations come into play. The analytic expression for the
-stable distribution is huge and cumbersome, but in Fourier space, a concise formula ensues. For a symmetric, zero-centered
-stable distribution, the generating function is:
Here, c is a scale factor and is the so-called stability index (). For , the Gaussian distribution is actually retrieved and for , the -stable distribution is the simple and well-known Cauchy distribution, i.e., .
Nonequilibrium is commonly characterized by frequently occurring “outliers” [
12,
13,
14,
15,
16,
17]. If “outliers” means a Brownian trajectory with an overabundance of very large steps, then replacing the Gaussian distribution by an
-stable distribution is the next sensible move in the modeling.
It is in the asymptotics, i.e., the behavior at
, that we find the most salient difference between a Gaussian and an
-stable distribution. For the Gaussian distribution, the convergence follows
and is rapid (note here that for
, the scale factor
c is the standard deviation divided by
). For the
-stable distribution, the tail follows a power law:
. The slow convergence of the power-law tail leads to an infinite standard deviation and is also behind the more frequent occurrence of outliers [
18,
19].
2. Overdamped Particle in a Potential Well Subjected to IID -Stable Noise
Consider a particle in a potential
that is subjected to
-stable noise. We have for the Langevin Equation for the position
of an overdamped particle:
In the course of a simulation with timesteps of length
, a noise contribution
at the
i-th step is taken as
, where
is the
i-th random number in the sequence of steps. The random numbers
are drawn from an
-stable distribution with a scale factor of one. They are independent and identically distributed (IID). The
in the exponent of
guarantees that the diffused distance scales correctly if different
’s are taken. Equation (
3) furthermore shows how the scale factor is effectively an amplitude. For Gaussian noise, i.e.,
, the scale factor
c is the usual
, where
D is the diffusion coefficient. The variable
denotes the coefficient of friction. The coefficient of friction is the inverse of the aforementioned mobility
, i.e.,
. The left- and right-hand sides of Equation (
3) have the dimension of force. We consider a small segment of a trajectory going from
to
. Multiplying with
, we obtain the involved energies:
. Here, the term on the left-hand side indicates the amount of energy that is “dissipated out” in time
. The term in square brackets on the right-hand side denotes the net force on the particle. The net force is made up of the force due to the potential,
, and the force due to agitation by the bath. Multiplying the net force by the distance
over which the force is applied, we obtain the work performed on the particle over the segment
. Writing
, substituting
on the right-hand side, and using
again, we find:
This equation again describes the energy traffic for the particle in a time interval
. On the left-hand side, the first term is the dissipated energy and the second term is the energy associated with going up or down in the potential. The twofold expression on the right-hand side describes the energy that is “fluctuated into the particle.” The second term would be the only contribution in case of a flat potential. The first term accounts for the interplay between the random kicks,
, and the deterministic
. If the Brownian kick and the deterministic force are in the opposite direction and such that they balance each other out, then the right-hand-side terms in Equation (
4) will add up to zero and the particle will not move.
For the case of
, Equation (
4) readily reduces to something more familiar. On the left-hand side, the existence of a basin of attraction implies that the changes
will ultimately average to zero. Furthermore, we have
and
in this case. As the kicksizes
are not correlated to
, we also have
on the right-hand-side. The Gaussian case,
, also leads to
. With
and invoking the FDR,
, we then obtain:
This equation tells us that the long-time average of the energy that is fluctuated into the particle is
per timestep. Note that in the continuum limit,
, an infinite amount of energy flows through each particle in the system in any finite amount of time. The Langevin Equation, however, is an abstraction. As was mentioned before, in actual reality there is about a picosecond between subsequent collisions of an individual water molecule, and this puts a lower limit on the value of
. Equation (
5) has proven fruitful in the analysis of Brownian ratchets [
20,
21].
A lot more infinities start accumulating once we make
. For
, the variance
diverges. Effectively, this means that the bath has no temperature. No FDR can be formulated in this case. For
,
is zero-centered, but does not converge. This leads to further problems in working with Equation (
4). However, most real-life instances of Lévy noise involve values of
that are between 1 and 2 [
12,
13,
14,
15,
16,
17].
Below we propose a way to “fix” the -divergence for small deviations from equilibrium. The idea is inspired by the violation of time-reversal symmetry that Lévy noise causes for a particle in a potential well. We will derive some simple formulae that we will check against the results of numerical simulation.
3. Nonequilibrium and Time-Reversal Asymmetry in a Parabolic Well
If
is a flat potential, then Equation (
3) describes a simple 1D random walk. Both for
and
, we then have time-reversal symmetry. If one were to make a movie of the moving particle, it would afterwards not be possible to determine whether the movie is played forward or backward. However, when the Brownian particle is in a 1D potential well, a different situation arises. When subjected to white Gaussian noise, Onsager’s microscopic reversibility has to apply, i.e., we still have time-reversal symmetry. When, on the other hand, the particle in the 1D potential well is subjected to Lévy noise, time-reversal symmetry is violated. Below, we will explain this violation and elaborate on it. Based on the developed insights, we will formulate a measure for the time-reversal-symmetry breaking and we will derive approximate FDR relations for a nonequilibrium bath.
Consider the situation with the parabolic well,
with
, as depicted in
Figure 1a. Let the Brownian fluctuations make the particle go up the parabola to a considerable height
outside the basin of attraction. As the basin of attraction of the potential, we take the interval around the minimum where the particle spends around 90% of its time. In case of Gaussian noise, we have microscopic reversibility. The most likely Brownian kick has a magnitude of zero. Therefore, the most likely downslide is a series of such “zero” kicks and the most likely upslide is, perhaps unintuitively, the exact reverse. The deterministic downslide follows
. This leads to
. If we let the downslide run from
all the way back back to
, then we have for the dissipated energy
. In principle, the downslide to
takes infinitely long. However, if we take as the endpoint a location
in the basin of attraction, then we have for the time
to reach
:
. With a discretized time, this corresponds to
timesteps.
With Gaussian noise, the most likely upslide and most likely downslide both take
n steps. In Ref. [
22], it is shown rigorously that in case of Lévy noise, the most likely upslide takes one step and the most likely downslide takes
n steps. Reference [
22], furthermore, works out the case of
(when the
-stable distribution is actually the Cauchy distribution) in great detail. Given what is observed in
Figure 1b, it is not hard to intuit the apparent violation of time-reversal symmetry. The noisy particle will spend most of its time in the basin of attraction near the bottom of the well. A Lévy jump makes the particle “shoot up” in one step. Afterwards, it will slide down as if in equilibrium. Doing the upslide in one step (i.e., doing it
n times as fast as the deterministic downslide) leads to the dissipation of
n times as much energy. This can be readily seen from the integral that gives the dissipated energy:
.
Figure 1b affirms the insight formulated in the previous paragraph. The one-step Lévy jumps are conspicuous, and so are the slower subsequent relaxations back to the bottom of the well.
For a potential with curvature, there is a problem when simulating the motion of a particle that is subjected to Lévy noise. Imagine that the particle in
Figure 1a is to the left of
, and imagine next that it receives a large Lévy kick to the right. In a simple Euler scheme with a timestep
, we would have the deterministic force on the particle,
, be in the positive direction for the entire interval, even when the particle is actually “climbing” the potential on the part of the potential where
. For a parabolic potential, the solution to this “large kick problem” is straightforward. Through scaling of
t and
x, the Langevin Equation
can be brought into a form
[
23]. We take
. Upon discretization of
, we let the kick at
have a value
. We then take the curvature of the potential into account by simply taking the solution of
as describing what occurs between
and
. This leads to
.
Figure 1b,c was obtained using the latter expression at every timestep.
After taking the data from a computer simulation (with a time interval
) or from a real-life system (sampled at a time interval
), we can express the deviation from microscopic reversibility as follows:
where
and
are the fraction of descending steps and the fraction of ascending steps, respectively. Descending steps are steps for which
and ascending steps are steps for which
(cf. Equation (
4)). Time reversal turns ascending steps into descending steps and descending steps into ascending steps. So it is obvious that
in case of microscopic reversibility. No arrow of time can exist at equilibrium and
must ensue for any system at equilibrium. The parameter
r indicates the level of symmetry breaking and can be thought of as an order parameter. Gaussian noise (
) leads to
on any shape potential, even if the potential is not a simple well.
Figure 1c shows
r as a function of the stability index
for a Lévy-noise-subjected particle in a parabolic potential. Curves are drawn for different values of the time interval
. For Lévy noise, there is a power-law tail and a divergent variance for any
, where
is small and positive. For
, the Gaussian is recovered. Nevertheless, the convergence to
as
approaches 2 appears smooth.
From
Figure 1c, it is also obvious that there is a strong dependence on the timestep
. It is for the green curve in
Figure 1c, i.e.,
, that we get the fastest departure from
. This apparent optimum is not hard to understand. In a parabola
, the deterministic downslide starting at
is described by
. In other words, there is a characteristic time
for the downslide. If
, then the particle will generally be back in the basin of attraction after one timestep. The shooting up and sliding down will not be resolved in that case. Suppose next that
. With
and
, we then have
. This leads to the noise-term being dominant and the contribution due to the slope being negligible. What this means in practice for the downslide is that it will take a very large number of steps,
, to get back to the basin of attraction after a Lévy jump. A number
of these steps will be ascending and a number
will be descending. The difference
will be small relative to
and will lead to
. In between
and
there will be a maximum for the value of
r.
Figure 1c shows that with a timestep,
, that is about one tenth of the characteristic time,
, an optimal resolution of the nonequilibrium features is obtained. The parameter
r for a Lévy particle in a harmonic potential is further explored in Ref. [
23].
“… when all the fast things have happened, but the slow things have not.” That is how Richard Feynman once described equilibrium [
24]. The observations in the previous paragraph on the Lévy particle’s relaxation to the basin of attraction put an interesting take on Feynman’s premise for the case of our nonequilibrium system. If we take
, we are indeed not sampling sufficiently fast to see the relaxation happen and we are then looking at the
that characterizes equilibrium. However, if we take
, we are sampling
too fast and also do not see the relaxation happen as sampling too fast likewise leads to
, i.e., the equilibrium result. So “
… when the fast things happen, but we are sampling too fast to see it" would also describe equilibrium.
4. Corrections on the FDR for a Small Deviation from Microscopic Reversibility
As we saw earlier, with Gaussian noise, time-reversal symmetry implies that ascent and descent are, on average, equally fast. With Lévy noise, the most likely trajectory from the basin of attraction to a position high above the minimum takes one timestep. The subsequent most likely descent follows the deterministic pattern that would also ensue if there were equilibrium. Below, we analyze such breaking of time-reversal symmetry in a close-to-equilibrium condition. We will come to an intuitive understanding and associated approximate relations. Ultimately, we will derive how the FDR looks for a small deviation from equilibrium.
Consider a small interval
on the
x-axis. With a coefficient of friction
, the energy that is dissipated if
is crossed at a speed
v is
. Over a long time-interval,
is traversed equally often in both directions. Let
be the speed on the downslide and let
be the speed on the upslide. Close to equilibrium means that
is sufficiently small to justify a first-order approximation. With the upslide speed corrected by a multiplicative factor
, the number of ascending steps gets a multiplicative factor
relative to the number of descending steps. This leads to:
If
is traversed first at an upslide-speed
and next, on the way back to the basin of attraction, at a speed
, then the dissipated energy is:
The energy
is what would be dissipated if, in case of microscopic reversibility, we traverse the two directions with the same speed
. The higher speeds on the upslides, i.e., the violation of microscopic reversibility, lead to the
correction factor:
For a corrected Energy-FDR, we thus find:
This equation can be seen as an adjusted form of Equation (
5) for the case of a small violation of time-reversal symmetry, as quantified by the parameter
r. Note that the temperature
is still in the formula. On the right-hand side, the small
r leads to a small amount of extra power being “fluctuated in”. This power is included in what gets dissipated.
In principle, temperature is a characteristic of a system that is at thermodynamic equilibrium. Nevertheless, even in a nonequilibrium setup, we can associate the temperature with the average kinetic energy of the particles, i.e.,
in case of a 1D system. Let upslide and downslide cover the same distance
. In that case, the upslide speed,
, is held for a shorter time than the downslide speed
. This will lead to the average actually being smaller than
. However, this is a second-order effect in
(see the short derivation in the
Appendix A). At first order, we thus have:
. If all of the involved particles have the same mass
m, and taking the average of the square as the square of the average, we come to a lowest-order approximation:
. With
, this leads to
The Kubo relation expresses the diffusion coefficient
D as the time correlation of the velocity:
[
25]. With the insights developed in this paragraph, we find that this leads to
Equations (
11) and (
12) express, in terms of
r, what the effect of the time-reversal-symmetry breaking is on the temperature and the diffusion. Equations (
10)–(
12) constitute the main result of this work.
5. A Stochastic Simulation with an Artificial Violation of Microscopic Reversibility
In this section, we view the violation of time-reversal symmetry from a different perspective. We rederive Equations (
11) and (
12) and check the theoretical results with a stochastic simulation.
Consider
Figure 2. We take two points,
and
, on the parabolic potential of
Figure 1a. The point
is in the basin of attraction and the distance between the points is such that it takes more than one timestep to cover the trajectory. Say it would take
n steps to go from
to
on a deterministic downslide. As discussed before, at equilibrium, the most likely upslide trajectory is the reverse of the deterministic downslide and also takes
n steps. With the violation of microscopic reversibility that was discussed in the previous section, a mismatch arises. If the upslide speeds carry a factor
, then the
n steps will bring the particle further up in the potential. Instead of the equilibrium distance
, a distance
would be covered and the point
would be reached.
For the equilibrium situation, there is an elegant relation connecting any trajectory
to its time-reverse
. Let
and
be the probabilities of the underlying sequences of steps for
and
. We have [
26]:
The right-hand side of the equation is recognized as the Boltzmann factor, i.e., the ratio of the population densities at
and
. With Equation (
13) we see that upslide and downslide ultimately occur equally often, i.e., we have microscopic reversibility.
With the small deviation from microscopic reversibility, we obtain the slightly mismatched situation: the starting point of the trajectory
is a small distance away from the endpoint of
. What is a single point
in the equilibrium state is a small segment at nonequilibrium. It is not unreasonable to hypothesize that the value of the probability density that, at equilibrium, corresponds to
is achieved halfway between
and
at nonequilibrium. This point is indicated in
Figure 2 with an open circle.
It is obvious that the augmentation of the upslides (cf.
Figure 2) leads to a widening of the distribution. The standard deviation will increase, but it will not become infinite as with
-stable distributions. In other words, we move towards the
situation without blowing up the standard deviation and other moments.
With Equation (
3) and Gaussian noise, the stationary probability distribution for the position in a parabolic potential
is a zero-average Gaussian with a standard deviation of
[
1]. With the small violation of microscopic reversibility characterized by
, we expect that the probability density will still “look” very Gaussian, but it will have a standard deviation of
(cf.
Figure 2). So the Gaussian will be stretched by a multiplicative factor
.
With
, we see that
gets a multiplicative factor
upon going to nonequilibrium. This means that
D gets, at first order, a factor
, i.e., we retrieve Equation (
12). With the FDR,
, we see that Equation (
11) follows concurrently.
The ideas put forward in the previous paragraphs can be readily checked through a Langevin simulation. The simulation is based on a Euler scheme using Equation (
3). The coefficient of friction
and the diffusion coefficient
D are set equal to one, and we also pick
. The Euler scheme thus computes the increments and new positions using
and
, respectively, where
is the
i-th random number drawn from a Gaussian distribution with a zero average and a standard deviation of one. A breaking of time-reversal symmetry similar to the one brought about by Lévy jumps is applied by simply augmenting the climbing steps by a small fraction
. However, care must be taken here, as
is only obtained when some supplementary conditions are implemented.
Following the simple criterion for “climbing” formulated with Equation (
6), the augmentation would also apply inside the basin of attraction. This would lead to the Gaussian distribution becoming bimodal, i.e., the distribution turning into one with with two maxima. Bimodal distributions have been observed more commonly in the context of Lévy noise in a potential well [
27,
28,
29]. The bimodality is intriguing and worth further study, but here, we wish to stop it from occurring and maintain the Gaussian shape. We thus only apply the augmentation outside the basin of attraction, i.e., on the
i-th step if
and
. With this procedure, we “fatten” the tail of the position distribution without causing bimodality or bringing about an infinite standard deviation.
Figure 3 shows how for
, i.e., almost two standard deviations from the center, we obtain the
that the theory predicts. For a Gaussian distribution with a unit standard deviation, the interval between
and
contains 94% of the probability.
6. Discussion
Extension of the FDR to nonequilibrium is a challenge that has been taken up by many, and different approaches have been tried [
10,
30,
31]. Our starting point is a Lévy-noise-subjected particle in a quadratic potential well. The quadratic potential well is generic in the sense that along any potential profile
, the first term in the expansion around a minimum at
is generally quadratic, i.e.,
.
Lévy noise is characterized by the occurrence of frequent outliers. In everyday data-processing practice, however, the reasoning is often in the opposite direction: upon observation of frequent outliers it is inferred that the underlying noise must be Lévy. Subsequent theoretical analysis is then commonly greatly impaired by the divergent integrals that are associated with Lévy noise. In the face of these infinities, relating data and theory is no longer straightforward.
At that point, it makes sense to take a step back and realize that infinity is an abstraction. In the aforementioned setup of Kanazawa et al. [
11], for instance, the liquid in an experimental realization has to be in a container, and it is obvious that no Lévy jump will ever be larger than the size of the container. Silva et al. [
17] followed the spatial fluctuations of a cytoskeletal network and found fat tails in the ensuing distribution. Here likewise, the container size imposes a natural cutoff on the jump size. An infinite standard deviation is just as unrealistic as
in our Equation (
5).
With finite standard deviations, the Central Limit Theorem should apply again. This idea was what motivated Mantegna and Stanley as they took
n different truncated
-stable distributions [
32]. They added the results of draws from these
n distributions and found that convergence to a Gaussian occurs with increasing
n, but it is very slow. Note that the position distribution that we arrive at in
Section 5 is still Gaussian, but that it has just been artificially widened by the augmentation of the climbing steps.
In this article, we started with the observation that time-reversal symmetry is violated for a Lévy-noise-subjected particle in a harmonic well. The particle tends to “shoot up” and “slide down.” We quantified the “degree of violation” with a parameter r. For the Lévy-noise-subjected particle in a harmonic well, the standard deviation and the higher moments diverge. There is no temperature and no FDR. We devised a way to artificially implement a small amount of violation of the time-reversal symmetry. In this Discussion section, we explained why it is sensible and realistic to keep all the involved moments finite. Our scheme does not give rise to divergent integrals and leads to simple expressions for a corrected FDR. The correction only involves the parameter r.
A possible experimental verification of Equations (
10) and (
12) would entail a setup with an energy input; an energy input leading to a bath with particles whose motion violates time-reversal symmetry. Through following that motion with a probe, the
r could possibly be established. The power dissipation or the diffusion coefficient could next be established independently.