Next Article in Journal
A Comparison of Partial Information Decompositions Using Data from Real and Simulated Layer 5b Pyramidal Cells
Next Article in Special Issue
Bath Engineering Enhanced Quantum Critical Engines
Previous Article in Journal
A New Perspective on Cooking Stove Loss Coefficient Assessment by Means of the Second Law Analysis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Energy Cost of Dynamical Stabilization: Stored versus Dissipated Energy

by
Armen E. Allahverdyan
1,2,* and
Edvard A. Khalafyan
3
1
Alikhanian National Laboratory, Yerevan Physics Institute, 2 Alikhanian Brothers Street, Yerevan 0036, Armenia
2
Cosmology Center, Yerevan State University, 1 A. Manoogian Street, Yerevan 0025, Armenia
3
Department of Applied Mathematics and Informatics, Moscow Institute of Physics and Technology, State University, 141701 Dolgoprudny, Moscow Oblast, Russia
*
Author to whom correspondence should be addressed.
Entropy 2022, 24(8), 1020; https://doi.org/10.3390/e24081020
Submission received: 7 July 2022 / Accepted: 20 July 2022 / Published: 24 July 2022
(This article belongs to the Special Issue Thermodynamics in Quantum and Mesoscopic Systems)

Abstract

:
Dynamical stabilization processes (homeostasis) are ubiquitous in nature, but the needed energetic resources for their existence have not been studied systematically. Here, we undertake such a study using the famous model of Kapitza’s pendulum, which has attracted attention in the context of classical and quantum control. This model is generalized and rendered autonomous, and we show that friction and stored energy stabilize the upper (normally unstable) state of the pendulum. The upper state can be rendered asymptotically stable, yet it does not cost any constant dissipation of energy, and only a transient energy dissipation is needed. Asymptotic stability under a single perturbation does not imply stability with respect to multiple perturbations. For a range of pendulum–controller interactions, there is also a regime where constant energy dissipation is needed for stabilization. Several mechanisms are studied for the decay of dynamically stabilized states.

1. Introduction

Dynamical stabilization is an important concept in physics (particle trapping, Floquet engineering) [1,2,3,4], control theory (vibrational stabilization and robotics) [5,6,7,8], biology (homeostasis) [9,10,11,12], animal locomotion [13,14], and population dynamics (polymorphism in time-dependent environments) [15,16]. The meaning of this concept is that certain relevant parameters (concentrations, coordinates) are stabilized against external perturbations by active and frequently self-regulating means. This is achieved via specific engines or controllers, and no stability exists without their action.
Is there an energy cost for dynamic stabilization, and how is it estimated? This question is obviously relevant to controlling methods. A general explanation for homeostasis in biology is that it offers energetically cheaper realizations of physiological functions [9], which leads to asking about its own energy costs.
In order to study the energy cost problem, we chose a simple but nontrivial model that exhibits dynamical stabilization. This is the driven nonlinear pendulum whose upper (normally unstable state) can be stabilized by a sufficiently fast external force thereby defying gravity. Such models were first studied by Stephenon [17], and then by Kapitza [18,19]; see [20] for a review. They still produce new physical results [21,22,23] and have interesting applications [1,2,3,4,5,6,7,8,13,14].
Our first step is to replace the external field with a controller degree of freedom in order to render the driven pendulum autonomous. This ensures finite energies and accounts of all relevant degrees of freedom; see Section 2. The autonomous pendulum predicts the two following scenarios for the dynamical stabilization of the unstable state. Within the first scenario, the state is asymptotically stable. There are two factors behind this strong notion of stabilization: the energy stored in the controller that ensures the needed effective potential, and the friction acting on the pendulum (obviously, friction is necessary for asymptotic stability). There are no permanent energy costs here, i.e., once the asymptotically stable state is reached, the interaction with the controller is automatically switched off. There is only a moderate transient dissipation of energy during relaxation. The interaction emerges online together with an external perturbation.
However, the notion of asymptotic stability is not sufficient for characterizing this scenario of dynamic stabilization. Contrary to passively stabilized systems, asymptotic stability does not guarantee stability under a sequence of well-separated perturbations acting within the attraction basin. For characterizing this more general notion of stability, we again need the concept of stored energy.
The second scenario predicted by the model is realized when the back-reaction from pendulum to controller is sizeable. Here, asymptotic stability is replaced by a metastable stabilization that has a finite (though possibly long) lifetime because the controller steadily dissipates the stored energy for supporting the metastable state. Once this energy is lower than a certain threshold, the metastable state suddenly decays with dissipating away all the energy. Therefore, dynamic stabilization within this scenario requires permanent energy costs.
Thus, the model provides conceptual tools and scenarios for addressing the energy cost problem in more general (especially biological) dynamic stabilization situations.
This paper is organized as follows. The generalized Kapitza’s model is formulated in Section 2 and is approximately solved in Section 3. We show that the asymptotic stability of the inverted pendulum is determined (among other factors) by the energy stored in the controller. This extends the stability criterion presented in [18,19,20]. In Section 4, we confirm the analytic bound and numerically work out two basic scenarios of dynamic stability. Section 4.2 discusses a new scenario of noise-induced metastability. Our results are summarized in Section 5, where we also discuss possible biological implications of our research.

2. Pendulum and Controller

As a result of its numerous applications, Kapitza’s pendulum can be introduced in a variety of contexts. For clarity, we introduce its generalization within a mechanical picture; cf. [19]. Consider a pendulum moving on ( x , y ) plane in a homogeneous gravity field g; see Figure 1. The pendulum is a material point with mass m fixed at one end of a rigid rod with length l. Let the coordinates and velocities of the mass be
x = l sin φ , x ˙ d x d t = l cos φ · φ ˙ ,
y = ξ 0 l cos φ , y ˙ d y d t = ξ ˙ 0 + l sin φ · φ ˙ ,
where ξ 0 refers to the vertical (along y axes) motion of the opposite end of the road. The Lagrangian of the autonomous system with coordinates ( x , y , ξ ) reads
L = m 2 [ x ˙ 2 + y ˙ 2 ] m g y + μ 2 ξ ˙ 0 2 k 2 ξ 0 2 ,
where μ is the mass of ξ 0 , and we assumed a harmonic potential k 2 ξ 0 2 for ξ 0 . Putting (1) and (2) into (3), denoting ξ = ξ 0 + m g k , and dropping a constant term from the Lagrangian, we find
L = m l 2 2 φ ˙ 2 + μ + m 2 ξ ˙ 2 + m l ξ ˙ φ ˙ sin φ + m g l cos φ k 2 ξ 2 ,
which implies Lagrangian equations of motion d d t L q ˙ = L q with coordinates q = ( φ , ξ ) and velocities q ˙ = ( φ ˙ , ξ ˙ ) :
φ ¨ + g l sin φ = 1 l sin φ · ξ ¨ ,
ξ ¨ + ω 2 ξ = ϵ [ cos φ · φ ˙ 2 + sin φ · φ ¨ ] ,
ω 2 k / ( μ + m ) , ϵ l / ( 1 + μ m ) ,
where ω is the frequency of ξ , while ϵ characterizes the back-reaction of x on ξ . From (3) and (6), whenever μ m , i.e., controller ξ is much heavier than the pendulum, we can neglect the left-hand side of (6) and revert to the usual (nonautonomous) driven pendulum. This, however, does not suffice for the full understanding of energy costs, which arise due to the very back-reaction of x on ξ .
Equations (5) and (6) are deduced from the time-independent Lagrangian (4); hence, they are conservative and reversible. The conserved energy related to (4) reads:
E = φ ˙ L φ ˙ + ξ ˙ L ξ ˙ L = m l 2 2 φ ˙ 2 + μ + m 2 ξ ˙ 2 + m l ξ ˙ φ ˙ sin φ m g l cos φ + k 2 ξ 2 .
We now add a friction with parameter γ > 0 to (5), writing it as
φ ¨ + g l sin φ + γ φ ˙ = 1 l sin φ · ξ ¨ .
As seen below, this friction is a means of stabilizing the motion of φ . We did not add a friction to the controller degree of freedom ξ , since this achieves no constructive goal besides providing an additional channel for loosing energy. We also mostly neglect random noises acting on φ , i.e., we do not study Langevin equations. The influence of a random noise is discussed in Section 4.2.
Energy (8) governed by (6) and (9) decays in time, as it should:
d E d t = m l 2 γ φ ˙ 2 0 .
As confirmed below, it is useful to separate energy E in (8) into two contributions, those describing the motion of ξ and φ :
E = E φ + E ξ , E ξ = μ + m 2 ξ ˙ 2 + k 2 ξ 2 .

3. Solving the Model via Slow and Fast Variables

To solve nonlinear (6) and (9), we apply both the separation of time scales and perturbation theory. We assumed that ω in (6) is a large parameter, i.e., ξ oscillates fast. Next, we separate φ as [19]:
φ = Φ + ζ , ζ Φ
where Φ is slow, and ζ is fast and also small compared with Φ . Then, from (6), (9), and (12), after expanding over ζ and keeping the first nonvanishing term only, we obtain:
Φ ¨ + ζ ¨ + g l sin Φ + ζ g l cos Φ + γ Φ ˙ + γ ζ ˙ = 1 l sin Φ · ξ ¨ 1 l cos Φ · ζ ξ ¨ ,
ξ ¨ + ω 2 ξ = ϵ [ ( cos Φ ζ sin Φ ) ( Φ ˙ + ζ ˙ ) 2 + ( sin Φ + ζ cos Φ ) ( Φ ¨ + ζ ¨ ) ] .
Assuming that γ 1 ω , and noting that, for fast variables, ζ ˙ , ζ ¨ , ξ ˙ , and ξ ¨ are large, we can equalize fast and large components in (13) and (14):
ζ ¨ + γ ζ ˙ = 1 l sin Φ · ξ ¨ ,
ξ ¨ + ω 2 ξ = ϵ sin Φ · ζ ¨ ,
ζ ( 0 ) = 0 ,
where initial condition (17) is imposed without loss of generality; cf. (12). In (16) we particularly neglected the factor ϵ cos Φ · ζ ˙ 2 , because it is quadratic over ζ . Equations (15) and (16) do not contain the contribution ζ g l cos Φ coming from the potential m g l cos φ [cf. (13)], since this contribution is not sufficiently fast, i.e., (15) and (16) involve only time-derivatives of ζ .
Equation (15) can be integrated over the time. A constant of integration should be put to zero, since ζ and ξ ˙ are oscillating in time, with their time average being zero. Hence, the integration of (15) implies
ζ ˙ ( 0 ) = sin Φ l ξ ˙ ( 0 ) .
Equations (15) and (16) are linear over unknown variables ζ and ψ , and they can be solved via the Laplacean transform (see Appendix A). Now, we can average (13) over fast oscillations:
Φ ¨ + g l sin Φ + γ Φ ˙ + 1 l cos Φ · ζ ( t ) ξ ¨ ( t ) ¯ = 0 ,
where . . . ¯ means time averaging over fast oscillations. Factor ζ ( t ) ξ ¨ ( t ) ¯ in (19) is worked out in Appendix A. It contributes to an effective (generally time-dependent) potential Π ( Φ ) :
Φ ¨ + γ Φ ˙ = Φ Π ( Φ ) .
The form of this potential is simplified if we assume that a slow variable β sin 2 Φ 1 + μ m holds β 1 due to μ m 1 (weak back-reaction), and take the first nonvanishing term over β ; see Appendix A. This approximation is only supported when slow variable Φ relaxes to π or to 0. Eventually, we have a simplified form of the effective potential:
Π = g l cos Φ ω 2 γ 2 + ω 2 · ξ ˙ 2 ( 0 ) + ω 2 ξ 2 ( 0 ) 8 l 2 · cos 2 Φ .
Now, Φ = π is stable, i.e., Φ Π ( Φ ) | Φ = π = 0 and Φ 2 Π ( Φ ) | Φ = π > 0 , if:
ξ ˙ 2 ( 0 ) + ω 2 ξ 2 ( 0 ) 2 g l > 1 + γ 2 ω 2 .
Larger values of ω expectedly increase the stability domain. However, larger values of friction constant γ decrease it. Hence, friction plays a double role in this system, since the very relaxation of Φ ( t ) (e.g., Φ ( t ) π ) is achieved due to friction. Note that the authors in [23] studied the inverted pendulum with friction and deduced an effective potential that is akin to (21) (and even contains higher-order terms), but does not contain friction explicitly since the latter was assumed to be small.
Equations (20) and (21) imply that, when Φ = π is a stable rest point, we obtain that the slow part Φ ( t ) of the angle variable φ ( t ) convergence due to the friction: Φ ( t ) π , if Φ ( 0 ) is in the attraction basin of Φ = π . What happens to the fast part ζ ( t ) of φ ( t ) ? This is a convoluted question that we numerically clarify below. Our results in Appendix A show that, when derivation (12)–(18) applies, i.e., both time-scale separation and the perturbation over β hold, we obtain ζ ( t ) 0 together with Φ ( t ) π ; see (A5). This was indeed observed numerically, as seen below. However, there is also a regime that is not described by (12)–(18), where Φ ( t ) π for sufficiently long but finite times, and where ζ ( t ) stays nonzero; see below for details. This regime is realized when back-reaction parameter ϵ is sufficiently large. As we emphasized, the above analytic derivations do not hold for this case. Eventually, the fact of large back-reaction leads to decaying of the Φ = π state, i.e., Φ = π turns out to be a metastable state.
Lastly, the left-hand side of (22) is just the initial dimensionless energy of ξ ; cf. (7) and (11). We call this quantity the initial stored energy, and (22) was obtained for vanishing back-reaction ϵ 0 .

4. Scenarios of (De-)Stabilization for the Inverted Pendulum

4.1. Asymptotic Stability and Stability with Respect to Several Perturbations

Figure 2a shows the solution of (6) and (9) when condition (22) holds. State φ = π is indeed asymptotically stabilized, φ ( t ) π at least when Φ ( 0 ) is sufficiently close to π , i.e., when φ ( 0 ) is in the attraction basin of π . This relaxation was accompanied by the energy dissipation. The decaying (dissipating) quantity here is mostly the stored energy 1 2 g l [ ξ ˙ 2 ( t ) + ω 2 ξ 2 ( t ) ] , i.e., the dimensionless energy related to E ξ in (11). Once φ approaches π sufficiently close, the coupling between ξ and φ is switched off; recall the discussion after (22). This means that the stored energy is not dissipated anymore and stays constant for subsequent times; see Figure 2a. Thus, we confirmed that the originally unstable fixed point of the pendulum can be rendered asymptotically stable without permanent energy costs, but with only transient energy dissipation.
For parameters of Figure 2a, point φ = π is asymptotically stable with a well-defined attraction basin, i.e., it is stable with respect to a single perturbation, which refers to initial state φ ( 0 ) = 0.93 π , φ ˙ ( 0 ) = 0 , and specific initial state ( ξ ( 0 ) , ξ ˙ ( 0 ) ) of ξ ; see Figure 2a. It is necessary to generalize the notion of asymptotic stability because it is unrealistic to consider only a single perturbation. Let us assume that, after φ ( t ) relaxed to π , we apply at some random time τ (which is larger than the relaxation time) yet another (second) perturbation φ = π φ ( 0 ) = φ ( τ ) within the same attraction basin, i.e., φ ( 0 ) = 0.93 for parameters of Figure 2b. The initial state of ξ is then reset as ( ξ ( τ ) , ξ ˙ ( τ ) ) . Hence, we now run the dynamics anew with initial states φ ( 0 ) = 0.93 π , φ ˙ ( 0 ) = 0 , ξ ( τ ) and ξ ˙ ( τ ) .
For the parameters of Figure 2a, φ = π is unstable after the second perturbation. The issue here is that the back-reaction ϵ is sufficiently large; hence, the second perturbation alters the controlling degree of freedom ξ ( t ) and dries out its stored energy, which already decreased after the first perturbation. If, for parameters of Figure 2a, we decrease ϵ from 0.8 to 0.1 , φ becomes stable to many well-separated (in the above sense) perturbations coming at random times. One reason for this is that the stored-energy decrease within one perturbation is smaller. Another reason that numerically clearly differs from the first one is that the motion of ξ becomes more stable with respect to resetting the initial conditions of φ during the perturbation.

4.2. Random Noise

Above, we assumed multiple strong and well-separated (in time) perturbation. Another way of implementing multiple perturbations is to include external noise in (9). Let us add to the right-hand side of (9) white Gaussian random noise:
σ f ( t ) , f ( t ) = 0 , f ( t ) f ( t ) = δ ( t t ) ,
where σ is the noise intensity. The modified (9) then becomes the Langevin equation (for φ ( t ) ). In contrast to strong and well-separated (in time) perturbations, (23) allows for uncorrelated, densely located perturbations that are (most probably) weak if σ is small.
Figure 3a shows that a weak-random noise monotonously dries out the stored energy; hence, the stability of φ = π is lost after a sufficiently long time. Figure 3b shows that the same scenario hold for stronger noise, though in somewhat blurred form and for a shorter lifetime of the metastable state. For parameters of Figure 3a and σ = 0 , φ = π is asymptotically stable with respect to 10–11 strong, well-separated perturbations.
This metastability under noise differs from the well-known noise-induced escape from a local energy minimum to a deeper minimum. There, a sufficiently strong random kick brings the system to the attraction basin of the deeper minimum. In contrast, here, the attraction basin is not changed (and no strong kicks are to be waited for). Rather, the stored energy needed for maintaining the stability is drained out and the very local minimal state is destroyed. Hence, what we described here constitutes a new type of noise-induced metastability that deserves further study.

4.3. Metastability

For parameters of Figure 2a, if back-reaction ϵ is larger than 0.8 , another interesting scenario takes place: the notion of asymptotic stability with respect a single perturbation is lost and replaced by metastability; see Figure 2b.
Now, small oscillations of φ ( t ) around Φ = π persist and do not decay in time; cf. (12). According to (10), these oscillations slowly drain out the initial stored energy 1 2 g l [ ξ ˙ 2 ( 0 ) + ω 2 ξ 2 ( 0 ) ] , and when it gets sufficiently low, the metastable state Φ = π suddenly decays to the global energy minimum φ = φ ˙ = ξ = ξ ˙ = 0 ; see Figure 2b. During this sudden decay, the whole stored energy is dissipated away. In the metastability time window, energy E φ related to φ stays constant; see (11) and Figure 2b.
The transition between regimes in Figure 2a,b, i.e., between the truly stable and the metastable state takes place for a critical value of the back-reaction parameter ϵ c . For parameters of Figure 2a,b, we have ϵ c 0.86075 . We checked numerically that the lifetime of the metastable state could be very large for ϵ approaching ϵ c from above. Hence, this time can be arbitrary large for ϵ ϵ c + 0 .
The transition between regimes in Figure 2a,b is described for the initial fixed conditions of φ : φ ( 0 ) = 0.93 π ( φ ˙ ( 0 ) = 0 ), i.e., for a fixed attraction basin of the stabilized state. If these initial conditions are changed by rendering φ ( 0 ) closer to the stability point π (i.e., the attraction basin is shrunk), then the transition from the stable to metastable regime takes place at a larger value of ϵ or does not take place at all. Likewise, if the attraction basin is enlarged, the transition taken place for smaller ϵ . For example, if φ ( 0 ) = 0.92 π ( φ ˙ ( 0 ) = 0 ), then the transition takes place at ϵ c 0.6536 , while for φ ( 0 ) = 0.935 π ( φ ˙ ( 0 ) = 0 ), the solution is stable for all ϵ < 1 , which is the physical range of ϵ for parameters of Figure 2a,b; cf. (7). The stabilization with the largest attraction basin demands vanishing values of ϵ . In particular, for parameters of Figure 2a, no stabilization of the φ = π state occurs for | φ ( 0 ) | < 0.64105 π ( φ ˙ ( 0 ) = 0 ), while for | φ ( 0 ) | 0.64105 π the stabilization demands ϵ 0 .
The metastability in Figure 3a,b is different from that in Figure 2b because, in the latter case, the metastability is due to a strong back-reaction and not permanently acting perturbations.

5. Summary and Discussion

The purpose of this work is to understand energy costs of dynamical stabilization (homeostasis): a process that stabilizes an unstable state due to an active controlling process. To this end, one needs plausible models with a well-established history of physical [1,2,3,4,17,18,19,20,21,22,23] and control-theoretic [5,6,7,8,13,14] applications. Here, we studied the inverted (Kapitza’s) pendulum model, where the upper (normally unstable) state is stabilized by a fast motion of a controlling degrees of freedom. Usually, this degree of freedom is replaced by an external field. Here, we modeled it explicitly because we wanted to study an autonomous system with full control of energy and its dissipation. Our main results are summarized as follows.
The unstable state of the pendulum can be asymptotically stabilized with a finite attraction basin and without permanent energy dissipation because the controller–pendulum interaction is automatically switched off once the pendulum is stabilized. There is only a transient dissipation of a small amount of energy related to the stabilization. This regime is reached when both the back-reaction of the pendulum to the controller is sufficiently small and the controller oscillates sufficiently fast, i.e., it has sizeable stored energy.
However, the notion of asymptotic stability was not sufficient: we needed to study stability with respect to multiple perturbations. We implemented two scenarios for multiple perturbations: strong, widely separated in time perturbations, and weak white noise acting on the pendulum. An asymptotically stable state may not be stable with respect to several perturbations. The latter type of stability is achieved only if the back-reaction to the controller is small. In the second scenario, weak white noise led to the noise-driven decay of a metastable state. This decay differed in several ways from the usual noise-driven escape. There is a need for further, more systematic research on this effect.
When the back-reaction was larger, the very notion of asymptotic stability was lost and replaced by metastability. The stabilization was then temporary (metastable), because small oscillations around the stabilized state do not decay. They dry out the stored energy of the controller, and once it is lower than some threshold, the metastable state decays. In this case, a constant dissipation rate was needed for supporting the metastable state.
The energy cost problem was actively studied for the case of adaptation [24]. Here, stability was required with respect to external changes of intensive variables; e.g., temperature and chemical potential [24,25,26,27,28]. Adaptation should be distinguished from the proper dynamical stabilization (homeostasis) [29]. Adaptation is about the stability of intensive variables (e.g., temperature) and relates to structural changes in the system, while homeostasis does not. Hence, adaptation is thermodynamically restricted by the Le Chatelier–Braun principle, whereas homeostasis is not [26,29,30]. Existing approaches to the energy cost of adaptation show that the energy is to be dissipated continuously if an adaptive state is maintained [25,26,27,28]. In that sense, adaptation is similar to proofreading and motor transport, biological processes that are essentially nonequilibrium and demand constant dissipation of energy; see [31] for a review. The question of relating dynamical stabilization and adaptation more directly remains open; so far, the two concepts have been quite separate.
Conceptual tools gained from the physical model should be useful for studying the energy cost of biological examples of dynamical stabilization (homeostasis) [9,10,11,12]. Biological and physiological discussions imply that homeostasis is needed for controlling (and providing advantages for) metabolic processes in organisms [9,10,11,12]. This demands asking about the proper energy costs of the homeostasis itself. Such costs can be substantial, e.g., humming birds (colibri), for which energy saving is crucial, fall at night into a torpor state that is different from normal sleep. In this state several homeostatic mechanisms including internal energy regulation are ceased. Thereby birds are able to save a substantial amount of energy: an increase of 60 % of the normal usage [32].
Since realistic models of homeostasis are derived from systems biology [9,24,33], they frequently lack a physical form that allows for us to ask questions about energy balance, let alone its dissipation. Nonetheless, some analogies can be drawn and might prove useful in future research. We saw that the energy stored in the controlling degree of freedom can be the main resource of homeostasis. In that respect, it is similar to the energy stored in the living organism, one of the major concepts in biological thermodynamics [34,35,36,37,38,39,40]. It also relates to adaptation energy introduced in physiology [24]; cf. [29] for a critical discussion. The stored energy is phenomenologically employed in dynamic energy budget theory (DEBT) [39,40] and applied for estimating metabolic flows of concrete organisms.
This concept is not yet well-formalized, but some of its qualitative features are known. The stored energy is not the usual free energy, since the latter is present in equilibrium as well. From the viewpoint of a modern thermodynamics, the notion of stored energy resembles energy kept at a certain negative temperature because it is capable of doing work in a cyclic process [41]. For the inverted pendulum, the stored energy is mechanical (not chemical) and relates to an oscillating degree of freedom, but it is also capable of performing cyclic work. The inverted pendulum demonstratess how stored energy relates to stabilizing unstable states.

Author Contributions

Conceptualization, A.E.A.; Formal analysis, A.E.A.; Funding acquisition, A.E.A.; Investigation, E.A.K.; Software, E.A.K.; Visualization, E.A.K.; Writing—original draft, A.E.A. and E.A.K. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the SCS of Armenia, grants no. 20TTAT-QTa003 and 21AG-1C038. A.E.A. was partially supported by a research grant from the Yervant Terzian Armenian National Science and Education Fund (ANSEF) based in New York, USA.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

We thank K. Hovhannisyan for useful remarks.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A. Derivation of the Effective Potential

Here we explain how to solve Equations (15) and (16), and deduce the effective potential from that solution. Define from (7)
β ϵ sin 2 Φ l = sin 2 Φ 1 + μ m < 1 ,
and solve (15) and (16) via the Laplace transform as:
ξ ^ ( s ) = ( 1 β ) a ( s ) ( s 2 + ω 2 ) ( s + γ ) β s 3 , ζ ^ ( s ) = sin Φ l ( 1 β ) b ( s ) ( s 2 + ω 2 ) ( s + γ ) β s 3 ,
a ( s ) = ( s + γ ) ξ ˙ ( 0 ) + s ( s + γ 1 β ) ξ ( 0 ) , b ( s ) = s ξ ˙ ( 0 ) ξ ( 0 ) ω 2 1 β
where in addition to initial condition (17) we also employed (18).
The inverse Laplacian transform taken from (A2) reads
ξ ( t ) = e s 1 t a ( s 1 ) ( s 2 s 1 ) ( s 3 s 1 ) + e s 2 t a ( s 2 ) ( s 1 s 2 ) ( s 3 s 2 ) + e s 3 t a ( s 3 ) ( s 1 s 3 ) ( s 2 s 3 ) ,
ζ ( t ) = sin Φ l e s 1 t b ( s 1 ) ( s 2 s 1 ) ( s 3 s 1 ) + e s 2 t b ( s 2 ) ( s 1 s 2 ) ( s 3 s 2 ) + e s 3 t b ( s 3 ) ( s 1 s 3 ) ( s 2 s 3 ) ,
where s 1 , s 2 and s 3 solve
s 3 + γ s 2 1 β + ω 2 s 1 β + ω 2 γ 1 β = ( s s 1 ) ( s s 2 ) ( s s 3 ) = 0 .
Without loss of generality, we take the following parametrization:
s 1 = Γ , s 2 = γ ˜ + i ω ˜ , s 3 = γ ˜ i ω ˜ ,
Γ > 0 , γ ˜ 0 .
Now, we calculate ζ ( t ) ξ ¨ ( t ) ¯ . Hence, when taking the product ζ ( t ) ξ ¨ ( t ) all oscillating terms with frequency ω ˜ are to be neglected:
ζ ( t ) ξ ¨ ( t ) ¯ = sin Φ l s 1 2 a ( s 1 ) b ( s 1 ) e 2 Γ t [ ( γ ˜ Γ ) 2 + ω ˜ 2 ] 2 + ( s 2 2 a ( s 2 ) b ( s 3 ) + s 3 2 a ( s 3 ) b ( s 2 ) ) e 2 γ ˜ t 4 ω ˜ 2 [ ( γ ˜ Γ ) 2 + ω ˜ 2 ] .
If in (A1), β 0 due to μ / m 1 , we can keep in (A6) only the simplest nonzero order putting there β = 0 . This approximation is supported if slow variable Φ tends to π , i.e., β gets additional smallness. Now, (A6) reads ( s + γ ) ( s 2 + ω 2 ) = 0 , i.e., we obtain via (A7):
Γ = γ , γ ˜ = 0 , ω ˜ = ω .
This means that the term e 2 Γ t in (A9) can be neglected, and we have
ζ ( t ) ξ ¨ ( t ) ¯ = sin Φ [ ξ ˙ 2 ( 0 ) + ω 2 ξ 2 ( 0 ) ] l ω 2 2 ( γ 2 + ω 2 ) .
Equation (A11) leads us to (19) and (21).

References

  1. Paul, W. Electromagnetic traps for charged and neutral particles. Rev. Mod. Phys. 1990, 62, 531–540. [Google Scholar] [CrossRef]
  2. Cook, R.J.; Shankland, D.G.; Wells, A.L. Quantum theory of particle motion in a rapidly oscillating field. Phys. Rev. A 1985, 31, 565–567. [Google Scholar] [CrossRef] [PubMed]
  3. Gilary, I.; Moiseyev, N.; Rahav, S.; Fishman, S. Trapping of particles by lasers: The quantum Kapitza pendulum. J. Phys. A 2003, 36, L409–L415. [Google Scholar] [CrossRef]
  4. Bukov, M.; D’Alessio, L.; Polkovnikov, A. Universal high-frequency behavior of periodically driven systems: From dynamical stabilization to Floquet engineering. Adv. Phys. 2015, 64, 139–226. [Google Scholar] [CrossRef] [Green Version]
  5. Bullo, F. Averaging and vibrational control of mechanical systems. SIAM J. Control Optim. 2002, 41, 542–562. [Google Scholar] [CrossRef] [Green Version]
  6. Thomsen, J.J. Some general effects of strong high-frequency excitation: Stiffening, biasing and smoothening. J. Sound Vib. 2002, 253, 807–831. [Google Scholar] [CrossRef]
  7. Erneux, T. Nonlinear stability of a delayed feedback controlled container crane. J. Vib. Control 2007, 13, 603. [Google Scholar] [CrossRef]
  8. Pathak, K.; Franch, J.; Agrawal, S.K. Velocity and position control of a wheeled inverted pendulum by partial feedback linearization. IEEE Trans. Rob. 2005, 21, 505. [Google Scholar] [CrossRef]
  9. Nijhout, H.F.; Best, J.A.; Reed, M.C. Systems biology of robustness and homeostatic mechanisms. Wiley Interdiscip. Rev. Syst. Biol. Med. 2019, 11, e1440. [Google Scholar] [CrossRef]
  10. Billman, G.E. Homeostasis: The dynamic self-regulating that maintains health and buffers against disease. In Handbook of Systems and Complexity in Health; Strumberg, J.P., Martin, C.M., Eds.; Springer: New York, NY, USA, 2013; pp. 159–170. [Google Scholar]
  11. Soodak, H.; Iberall, A. Homeokinetics: A physical science for complex systems. Science 1978, 201, 579–582. [Google Scholar] [CrossRef]
  12. Viktorov, V.A.; Novoseltsev, V.N.; Shumakov, V.I. Control in and for biosystems. IFAC Proc. Vol. 1984, 17, 2985–3002. [Google Scholar] [CrossRef]
  13. Morasso, P.; Cherif, A.; Zenzeri, J. Quiet standing: The Single Inverted Pendulum model is not so bad after all. PLoS ONE 2019, 14, e0213870. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Milton, J.; Cabrera, J.L.; Ohira, T.; Tajima, S.; Tonosaki, Y.; Eurich, C.W.; Campbell, S.A. The time-delayed inverted pendulum: Implications for human balance control. CHAOS 2009, 19, 026110. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Allahverdyan, A.E.; Hu, C.-K. Replicators in a Fine-Grained Environment: Adaptation and Polymorphism. Phys. Rev. Lett. 2009, 102, 058102. [Google Scholar] [CrossRef] [Green Version]
  16. Allahverdyan, A.E.; Babajanyan, S.G.; Hu, C.-K. Polymorphism in rapidly changing cyclic environment. Phys. Rev. E 2019, 100, 032401. [Google Scholar] [CrossRef] [Green Version]
  17. Stephenson, A. On an induced stability. Philos. Mag. 1908, 15, 233–236. [Google Scholar] [CrossRef] [Green Version]
  18. Kapitza, P.L. Dynamic stability of the pendulum with vibrating suspension point. Sov. Phys. JETP 1951, 21, 588–597. (In Russian) [Google Scholar]
  19. Landau, L.D.; Lifshitz, E.M. Mechanics; Pergamon: Oxford, UK, 1960. [Google Scholar]
  20. Butikov, E.I. On the dynamic stabilization of an inverted pendulum. Am. J. Phys. 2001, 69, 755–768. [Google Scholar] [CrossRef]
  21. Acheson, D.J. Multiple-nodding oscillations of a driven inverted pendulum. Proc. R. Soc. Lond. A 1995, 448, 89–95. [Google Scholar]
  22. Blackburn, J.A.; Smith, H.J.T.; Gronbech-Jensen, N. Stability and Hopf bifurcations in an inverted pendulum. Am. J. Phys. 1992, 60, 903–908. [Google Scholar] [CrossRef]
  23. Rahav, S.; Geva, E.; Fishman, S. Time-independent approximations for periodically driven systems with friction. Phys. Rev. E 2005, 71, 036210. [Google Scholar] [CrossRef] [Green Version]
  24. Gorban, A.N.; Tyukina, T.A.; Pokidysheva, L.I.; Smirnova, E.I. Dynamic and thermodynamic models of adaptation. Phys. Life Rev. 2021, 37, 17–64. [Google Scholar] [CrossRef] [PubMed]
  25. Lan, G.; Sartori, P.; Neumann, S.; Sourjik, V.; Tu, Y. The energy-speed-accuracy trade-off in sensory adaptation. Nat. Phys. 2012, 8, 422–428. [Google Scholar] [CrossRef] [PubMed]
  26. Allahverdyan, A.E.; Wang, Q.A. Adaptive machine and its thermodynamic costs. Phys. Rev. E 2013, 87, 032139. [Google Scholar] [CrossRef] [Green Version]
  27. Sartori, P.; Tu, Y. Free energy cost of reducing noise while maintaining a high sensitivity. Phys. Rev. Lett. 2015, 115, 118102. [Google Scholar] [CrossRef] [PubMed]
  28. Allahverdyan, A.E.; Babajanyan, S.G.; Martirosyan, M.H.; Melkikh, A.V. Adaptive Heat Engine. Phys. Rev. Lett. 2016, 117, 030601. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Allahverdyan, A.E. Energy dissipation and storage in adaptation and homeostasis. Comment on “Dynamic and thermodynamic models of adaptation” by A.N. Gorban et al. Phys. Life Rev. 2021, 38, 137–139. [Google Scholar] [CrossRef] [PubMed]
  30. Gilmore, R. Le Chatelier reciprocal relations and the mechanical analog. Am. J. Phys. 1983, 51, 733–743. [Google Scholar] [CrossRef]
  31. Mehta, P.; Lang, A.H.; Schwab, D.J. Landauer in the age of synthetic biology: Energy consumption and information processing in biochemical networks. J. Stat. Phys. 2016, 162, 1153. [Google Scholar] [CrossRef] [Green Version]
  32. Kruger, K.; Prinzinger, R.; Schuchmann, K.-L. Torpor and metabolism in hummingbirds. Comp. Biochem. Physiol. Part A Physiol. 1982, 73, 679–689. [Google Scholar] [CrossRef]
  33. Ashby, W.R. Design for a Brain: The Origin of Adaptive Behaviour; Chapman & Hall: London, UK, 1960. [Google Scholar]
  34. Bauer, E.S. Theoretical Biology; VIEM: Moscow, Russia, 1935. (In Russian) [Google Scholar]
  35. McClare, C.W.F. In defence of the high energy phosphate bond. J. Theor. Biol. 1972, 35, 233–246. [Google Scholar] [CrossRef]
  36. Jaynes, E.T. The Muscle as an Engine. Unpublished Manuscript. 1983. Available online: https://bayes.wustl.edu/etj/articles/muscle.pdf (accessed on 14 December 2014).
  37. Blumenfeld, L.A.; Tikhonov, A.N. Biophysical Thermodynamics of Intracellular Processes: Molecular Machines of the Living Cell; Springer Science & Business Media: Berlin/Heidelberg, Germany, 2012. [Google Scholar]
  38. Arshavsky, I.A. Focus for develoment: The energy rule of skeletal muscles. Dev. Psychobiol. 1974, 7, 291–295. [Google Scholar] [CrossRef] [PubMed]
  39. Jusup, M.; Sousa, T.; Domingos, T.; Labinac, V.; Marn, N.; Wang, Z.; Klanjscek, T. Physics of metabolic organization. Phys. Life Rev. 2017, 20, 1–39. [Google Scholar] [CrossRef] [Green Version]
  40. Sousa, T.; Mota, R.; Domingos, T.; Kooijman, S.M. Thermodynamics of organisms in the context of dynamic energy budget theory. Phys. Rev. E 2006, 74, 051901. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  41. Allahverdyan, A.E.; Balian, R.; Nieuwenhuizen, T.M. Maximal work extraction from finite quantum systems. Europhys. Lett. 2004, 67, 565. [Google Scholar] [CrossRef] [Green Version]
Figure 1. A schematic representation of the inverted pendulum. Angle φ is defined such that the upper (normally unstable) position refers to φ = π . The end point of the pendulum moves vertically with coordinate ξ that is subject to a harmonic potential; cf. (3).
Figure 1. A schematic representation of the inverted pendulum. Angle φ is defined such that the upper (normally unstable) position refers to φ = π . The end point of the pendulum moves vertically with coordinate ξ that is subject to a harmonic potential; cf. (3).
Entropy 24 01020 g001
Figure 2. (a) Angle variable φ (black, upper curve) and controller ξ (blue, oscillating curve) as the numerical solutions of (6) and (9) versus time t. Red curve (in the middle) is the scaled energy η = E μ + m that includes stored energy 1 2 [ ξ ˙ 2 + ω 2 ξ 2 ] ; cf. (8) and (22). Parameters in (6) and (9) are: ϵ = 0.8 , ξ ˙ ( 0 ) = 2 ( ξ ( 0 ) = 0 ), φ ( 0 ) = 0.93 π ( φ ˙ ( 0 ) = 0 ), ω = 4 , γ = 3 , m = g = l = 1 . It is seen that φ quickly stabilizes at φ = π , which is normally an unstable state. The stabilization process takes a relatively small amount of energy. After stabilization, φ and ξ decouple; ξ continues oscillating, and scaled energy η is then constant in time. Stability Condition (22) holds (the difference between its LHS and RHS is 0.4375 ). (b) The same parameters as in (a), but back-reaction parameter ϵ = 0.9 is slightly larger. We also display η φ = E μ + m 1 2 ξ ˙ 2 ω 2 2 ξ 2 (green curve, third from top), where η φ is the (scaled) energy related to the angle variable only; cf. (8). There is a rather long ( t 150 ) period of metastability accompanied by a slow dissipation of energy. After this, stability is lost: φ quickly relaxes to the minimal φ = 0 of the potential, and ξ loses all its energy and eventually stops moving (i.e., ξ ( t ) 0 ). The whole stored energy dissipates. The physical reason of scenario in (b) is that fast oscillations around φ = π do not disappear, i.e., they persist in the metastable state, continuously dissipate energy [cf. (10)], and once the initial energy decreases sufficiently, φ and ξ (relatively) suddenly move to global energy minima φ = φ ˙ = ξ = ξ ˙ = 0 . Energy 1 2 ξ ˙ 2 + ω 2 2 ξ 2 stored in ξ decays in time. To confirm this, (b) also shows the scaled energy ζ φ related to φ . It stays constant in time for the whole metastability period; see the green curve. A similar scenario happens, when the initial condition φ ( 0 ) is out of the attraction basin of φ = π . However, here φ ( t ) never reaches π .
Figure 2. (a) Angle variable φ (black, upper curve) and controller ξ (blue, oscillating curve) as the numerical solutions of (6) and (9) versus time t. Red curve (in the middle) is the scaled energy η = E μ + m that includes stored energy 1 2 [ ξ ˙ 2 + ω 2 ξ 2 ] ; cf. (8) and (22). Parameters in (6) and (9) are: ϵ = 0.8 , ξ ˙ ( 0 ) = 2 ( ξ ( 0 ) = 0 ), φ ( 0 ) = 0.93 π ( φ ˙ ( 0 ) = 0 ), ω = 4 , γ = 3 , m = g = l = 1 . It is seen that φ quickly stabilizes at φ = π , which is normally an unstable state. The stabilization process takes a relatively small amount of energy. After stabilization, φ and ξ decouple; ξ continues oscillating, and scaled energy η is then constant in time. Stability Condition (22) holds (the difference between its LHS and RHS is 0.4375 ). (b) The same parameters as in (a), but back-reaction parameter ϵ = 0.9 is slightly larger. We also display η φ = E μ + m 1 2 ξ ˙ 2 ω 2 2 ξ 2 (green curve, third from top), where η φ is the (scaled) energy related to the angle variable only; cf. (8). There is a rather long ( t 150 ) period of metastability accompanied by a slow dissipation of energy. After this, stability is lost: φ quickly relaxes to the minimal φ = 0 of the potential, and ξ loses all its energy and eventually stops moving (i.e., ξ ( t ) 0 ). The whole stored energy dissipates. The physical reason of scenario in (b) is that fast oscillations around φ = π do not disappear, i.e., they persist in the metastable state, continuously dissipate energy [cf. (10)], and once the initial energy decreases sufficiently, φ and ξ (relatively) suddenly move to global energy minima φ = φ ˙ = ξ = ξ ˙ = 0 . Energy 1 2 ξ ˙ 2 + ω 2 2 ξ 2 stored in ξ decays in time. To confirm this, (b) also shows the scaled energy ζ φ related to φ . It stays constant in time for the whole metastability period; see the green curve. A similar scenario happens, when the initial condition φ ( 0 ) is out of the attraction basin of φ = π . However, here φ ( t ) never reaches π .
Entropy 24 01020 g002
Figure 3. (a) Angle φ (blue, piecewise constant curve) as the numerical solution of (6) and (9) versus time t, where to the RHS of (9) we added white noise f ( t ) with intensity σ = 0.1 ; see (23). Here, η = E μ + m (orange, decaying curve) is the scaled energy; cf. (8). Parameters in (6) and (9) are: ϵ = 0.4 , ξ ˙ ( 0 ) = 4 ( ξ ( 0 ) = 0 ) , φ ( 0 ) = 0.93 π ( φ ˙ ( 0 ) = 0 ) , ω = 4 , γ = 3 , m = g = l = 1 . It is seen that ϕ is stabilized around π in a metastable state whose lifetime is 500 . During this lifetime, energy η slowly decays till it is below some critical value, and then the metastable state suddenly decays. (b) The same as in (a), but for a stronger noise σ = 1.25 . Metastable decay is smeared, but still clearly visible.
Figure 3. (a) Angle φ (blue, piecewise constant curve) as the numerical solution of (6) and (9) versus time t, where to the RHS of (9) we added white noise f ( t ) with intensity σ = 0.1 ; see (23). Here, η = E μ + m (orange, decaying curve) is the scaled energy; cf. (8). Parameters in (6) and (9) are: ϵ = 0.4 , ξ ˙ ( 0 ) = 4 ( ξ ( 0 ) = 0 ) , φ ( 0 ) = 0.93 π ( φ ˙ ( 0 ) = 0 ) , ω = 4 , γ = 3 , m = g = l = 1 . It is seen that ϕ is stabilized around π in a metastable state whose lifetime is 500 . During this lifetime, energy η slowly decays till it is below some critical value, and then the metastable state suddenly decays. (b) The same as in (a), but for a stronger noise σ = 1.25 . Metastable decay is smeared, but still clearly visible.
Entropy 24 01020 g003
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Allahverdyan, A.E.; Khalafyan, E.A. Energy Cost of Dynamical Stabilization: Stored versus Dissipated Energy. Entropy 2022, 24, 1020. https://doi.org/10.3390/e24081020

AMA Style

Allahverdyan AE, Khalafyan EA. Energy Cost of Dynamical Stabilization: Stored versus Dissipated Energy. Entropy. 2022; 24(8):1020. https://doi.org/10.3390/e24081020

Chicago/Turabian Style

Allahverdyan, Armen E., and Edvard A. Khalafyan. 2022. "Energy Cost of Dynamical Stabilization: Stored versus Dissipated Energy" Entropy 24, no. 8: 1020. https://doi.org/10.3390/e24081020

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop