1. Introduction
The thermodynamics and statistical physics of particles at equilibrium is a standard part of the undergraduate curriculum. The First and Second Law of Thermodynamics are powerful concepts that lead the way to the explanation of many real-life phenomena. Further development led to notions such as the Boltzmann Distribution, the Fluctuation-Dissipation Theorem, Onsager’s Reciprocal Relation, and Microscopic Reversibility [
1]. Even setups that are close-to-equilibrium can often be successfully analyzed with these ideas. No general theory, however, is available for systems that are far-from-equilibrium. None of the above laws and notions apply in that case.
Imagine a liquid in which “active” particles are suspended. Such “active” particles can be bacteria that propel themselves, i.e., swim. These can also be particles that are manipulated through fields from the outside. Obviously, energy is pumped into such systems and no First Law or any of the concepts mentioned in the previous paragraph applies. Over the last two decades, setups with active particles have been the subject of much experimental and theoretical research.
There are many different ways to model the movements of active particles. One can, for instance, assume that the particle has the same speed all the time and that the change of the direction of motion follows a diffusion equation [
2]. The “Run-and-Tumble” model is a more discrete version of this and it is inspired by the way that
Escherichia coli bacteria move [
3]. Here the particle or bacteria covers a finite-length straight segment at a constant speed. After coming to a stop, it lingers for a moment. It “tumbles” and then picks a new random direction for the next run. There are also different ways to let the active particle interact with the wall of the reservoir in which it swims.
In our analysis below, we focus on the 2D random walk: At every timestep, a direction is picked randomly and a displacement is drawn from a zero-centered distribution (cf.
Figure 1). We let the random walks happen in a confinement. Whenever the particle hits the wall, it comes to a standstill. Subsequently, it only moves away from the wall again if a random displacement makes it move inside the circular confinement.
If displacements are drawn from a zero-average Gaussian distribution, we eventually see a homogeneous distribution of particle positions over the entire domain. However, if we instead draw distances from a so-called
-stable distribution (sometimes called a Lévy-stable distribution) [
4,
5,
6,
7], a nonhomogeneous distribution develops.
The Gaussian distribution has an exponential tail, i.e.,
as
. Here
denotes the standard deviation of the Gaussian. The rapid convergence to zero of the exponential tail means that the probability to make a big jump is very small and effectively negligible.
Figure 1a shows this clearly.
For an
-stable distribution, the asymptotic behavior is described by a power law:
Here
is the so-called stability index for which we have
. For
, the Gaussian is re-obtained. The power law converges slower than the exponential. A result of this is that outliers, i.e., large “Lévy jumps”, regularly occur (see
Figure 1b). Ultimately, the Lévy walk resembles a run-and-tumble walk, but, following Equation (
1), the Lévy jumps have no characteristic length and the average length of a Lévy jump actually diverges.
The Central Limit Theorem [
8] tells us that the Gaussian distribution is what ensues when an outcome is the result of multiple stochastic inputs. However, the theorem only applies if all of the constituent stochastic inputs have a
finite standard deviation. For stochastic inputs with infinite standard deviations, the
-stable distribution is what results.
The
-stable distribution is a standard feature of the
Mathematica software package and the programming for a simulation as the one leading to
Figure 1b is a matter of just a few lines of code. The probability density of the
-stable distribution is given by a big and cumbersome formula [
9] and we will not elaborate on it.
Alpha-stable distributions do not just provide a good model for the behavior of active particles. It turns out that power-law tails commonly occur in systems that are far-from-equilibrium with no active particles involved. Almost 60 years ago, Benoit Mandelbrot discovered that variations in the price of cotton futures follow a distribution with an
power-law tail [
10,
11]. More power-law tails and
-stable distributions were identified in the 1990s [
12,
13,
14] when desktop computers became available that could rapidly and easily perform the necessary data processing. As of yet, there is no complete and general theory to explain how and why
-stable distributions are connected to far-from-equilibrium. In this sense, the
-stable distributions are like
-noise [
11,
15]. The connection of far-from-equilibrium with
-stable distributions and
-noise is still for the most part, a phenomenological one.
Nevertheless, as mentioned above, nonequilibrium characteristics do emerge when, instead of Gaussian noise, Lévy noise is added to particle dynamics. Take a particle doing Brownian motion on a potential
. Microscopic reversibility means that every trajectory
from an initial position
to a final position
and taking a time
, is traversed equally often in forward and backward direction. Microscopic reversibility is an equilibrium feature that is implied by the fact that there can be no arrow of time for a system at equilibrium, i.e., there must be time-reversal symmetry. In 1953, Onsager and Machlup gave mathematical rigor to this idea when they proved that with Gaussian noise, the most likely trajectory up a potential barrier is the reverse of the most likely trajectory down that same barrier [
16,
17,
18]. It can also be rigorously proven that for Lévy noise, the most likely trajectory up a potential barrier is not the reverse of the most likely trajectory down a potential slope [
19]. The presence of Lévy noise breaks the time-reversal symmetry that is implicit in equilibrium [
20].
For the setup that is depicted in
Figure 1b, the violation of time-reversal symmetry is in the interaction of the particle with the wall. Elastic collisions have time-reversal symmetry and had we taken the particle in
Figure 1b to collide elastically with the wall, forward and backward trajectories would have been indistinguishable. Lévy jumps are rare, but because of their length, they are likely to end at the wall. Once the particle is located at the wall, the probability that the first subsequent step is already a Lévy jump away from the wall is small. Moreover, only a step that leads to a movement inside the reservoir will be processed in the simulation. Thus, the particle can “linger” near the wall after hitting it. In the end it appears as if it is easier to get to the wall than it is to get away from it, i.e., it looks as if there is reduced mobility near the wall.
Figure 2 shows how this is the case on a 1D interval.
In the previous paragraph, we put the finger on something that applies generally for active particles in a confinement. They do not distribute homogeneously, but instead accumulate near a wall. It furthermore appears that the accumulation is stronger if the wall has a stronger inward curvature [
21]. Active particles tend to get stuck in nooks and corners of a confinement and even more so if the nooks and corners are tighter. This is the phenomenon that we will elaborate on below.
The way Lévy particles distribute on a confined 1D segment (cf.
Figure 2) can be described with a Fractional Fokker–Planck Equation [
22]. The steady-state solution of that equation is available [
23]. We show in
Appendix A how this solution readily generalizes to higher dimensional setups. Below we examine how Lévy particles distribute over two connected reservoirs where one reservoir is a scaled down version of the other. We will see a deviation from the homogeneous distribution that is obtained when the noise is Gaussian and when equilibrium theory applies.
Suppose we have a volume V with N indistinguishable particles in it. We partition the initially empty V into two reservoirs of a volume each. Next the particles are inserted. Each reservoir has a probability of to receive each particle. Eventually, the probability for all particles to end up in one particular reservoir is . The probability for an equal distribution over the two reservoirs is . The binomial coefficient grows very rapidly with N.
The reason that the air in a room never spontaneously concentrates in one half of the room is that there is just one way to put all molecules in one chosen half and
ways to distribute them equally. In other words, the macrostate in which all air is concentrated in one particular half of the room has
one microstate and the macrostate with a homogeneous air distribution over the entire room has
microstates. The entropy of a macrostate can be defined as a scalar value that is proportional to the logarithm of the number of microstates of that macrostate [
1]. In this case, it is obvious that the homogeneous distribution leads to maximal entropy.
With a partition and a pump it is, of course, possible to bring all of the air molecules to one half of the room. Such a process requires energy and with standard thermodynamics, the involved energies can be calculated. That energy-consuming, active particles can accumulate in a smaller subvolume does not violate laws of nature, and it is also possible to calculate the entropy change associated with such accumulation. We will perform such a calculation.
The ultimate goal would be a Lévy-noise-equivalent of entropy. This would be a quantity that takes its extreme value when Lévy-noise-subjected particles reach a steady state distribution. The Kullback–Leibler divergence [
24] is a positive scalar value that can be thought of as a “distance” between two given distributions. The Kullback–Leibler divergence between the steady state distribution and another distribution could be a good candidate. With tools like Noether’s Theorem, alternative formulations of active-particle statistical mechanics and of the Fractional Fokker–Planck Equation have been derived [
25,
26], with work in this direction appearing to be promising.
No general formalism is developed in this article, but we present a setup where the entropy decrease associated with the accumulation can be readily described with simple and intuitive formulae. The nonhomogeneous steady-state distributions that develop in the presence of nonequilibrium noise can be interpreted as dissipative structures [
27]. The deviation from homogeneity decreases the entropy. However, active particles pump energy into the system and the dissipative structure ultimately facilitates a steady-state dissipation of energy and production of entropy.
2. The 1D and 2D Random Walk in a Confined Domain
For a particle in 1D, Brownian motion is commonly described with a Langevin equation:
where
is the time-dependent position of the particle,
,
D is the diffusion coefficient, and
is a stochastic function that describes the effect of collisions with molecules in the medium. To account for the effect of such collisions, a random number
is drawn at the
i-th timestep. In a simulation with finite timesteps of
, we then take
. If
is large enough to contain a significant number of collisions, then the aforementioned Central Limit Theorem [
8] can be invoked to justify drawing the
’s from a zero-average Gaussian distribution. Upon taking
, we readily come to the traditional equation for the average squared distance that is diffused in a time interval
:
.
The equation
does not contain a characteristic timescale. It is in order for the scale-free diffusion equation to ensue that we need to “adjust” the
’s and take
in Equation (
2).
In case of the 1D Lévy flight, we have for the stochastic ordinary-differential-equation and its discretized version, respectively:
Now the values for
are drawn from a symmetric, zero-centered
-stable distribution with a value of one for its scale factor. The Lévy flight is still scale-free, but because
for
, there is no longer a traditional diffusion equation and
is a mere scale factor.
Figure 1 shows simulations of 2D random walks. At every timestep, a direction is chosen randomly from a flat distribution between zero and
. The displacement is the result of a random draw from a Gaussian distribution (
Figure 1a) or from an
-stable distribution (
Figure 1b). Both the Gaussian walk and Lévy walk are isotropic, i.e., taken from the center of the circle, all directions are equivalent. A generalization to more than 2 dimensions is readily formulated and simulated. The random walks then occur inside a ball with a finite radius. Whenever the domain boundary is hit, the particle comes to a standstill. For
, the random walk is symmetric under time reversal. However, as was already mentioned in the Introduction, for
the time-reversal symmetry is broken. It is not hard to understand why this is the case. When the particle is followed in forward time, we will often see a Lévy jump that makes the particle come to a standstill at the domain boundary. More rare will be a large jump from the domain boundary into the interior. When a movie of the moving particle is played backward, it will be the other way round. The forward and backward played movie are distinguishable.
Figure 2 shows the position distribution that results after a many-step 1D simulation on
for
. For
, a flat distribution results. However for
, the Lévy jumps that terminate at
and the decreased mobility there lead to an increased probability density near
. The Langevin Equation, Equation (
3), can be equivalently formulated as a fractional Fokker–Planck Equation for the evolution of a probability distribution, i.e.,
. The stationary distribution is then obtained as the solution of the ordinary differential equation that results when the left hand side is set equal to zero. The fractional derivatives are nontrivial, but in Ref. [
23], a solution for the 1D case is presented:
where
denotes the gamma function.
Figure 2 shows this solution together with the results of the Langevin simulation. In
Appendix A, we show with symmetry arguments that the normalized
-form generalizes to the
nD case, with
r being the distance from the center of the ball.
It is worth noting that the U-shaped function as in Equation (
4) and
Figure 2 has been encountered in other systems in stochastic dynamics. For
, the Lévy stable distribution is actually the Cauchy distribution,
. For
and upon taking
, Equation (
4) turns into
, where
. This is called the arcsine distribution because the cumulative distribution yields an arcsine:
. In 1939, it was the same Paul Lévy who derived that the arcsine distribution emerges in the following case [
28]. Let a 1D Brownian walk of duration
t start at
. Next look at the fraction of time that the Brownian particle spends on the positive semi-axis. It is found that these fractions follow an arcsine distribution. This is called the arcsine law. Recently it has been discovered that arcsine laws occur more generally [
29]. Driven mesoscopic systems are obviously out-of-equilibrium, but also in such systems, an arcsine law results when one considers, for instance, fractions of time that a current stays above its average value. Arcsine laws in nonequilibrium setups is currently a much researched topic [
30,
31] and Equation (
4) may be a manifestation of something deeper and more general.
4. Discussion
In this article we explored a significant consequence of a bath in which particles velocities are Lévy-stable distributed. With the ordinary Gaussian velocity distribution that is associated with equilibrium systems, the maximization of entropy leads to particles homogeneously distributing in the confined domain. With a Lévy-stable distribution for the velocities, larger concentrations occur near the walls and in the smaller cavities. We have analytic expressions for the distribution of Lévy particles in the circular and the spherical domain. For the two connected reservoirs as depicted in
Figure 3, we have derived a good approximation for the concentration difference between the reservoirs at steady state. We have presented an accounting of the entropies, and ensuing energies, for such divergence from equilibrium.
We have interpreted the nonhomogeneous particle distribution (cf.
Figure 5) as a dissipative structure, i.e., a lower-entropy arrangement of particles that facilitates a larger dissipation of energy and concurrent larger production of entropy. There is nothing about heat conduction in the equations. However, it is tempting to hypothesize that with the particles being closer to the surface area, the system would be better able to transfer heat to the environment and do so at a larger rate.
In the 1990s, experiments were performed in which DNA, RNA, and proteins were manipulated on the molecular scale. This commonly involved breaking of molecular bonds. The involved energies were significantly larger than the
that can be considered as the quantum of thermal energy. In such far-from-equilibrium processes, Onsager’s reciprocal relations and other close-to-equilibrium concepts are no longer valid. Fortunately, at about the same time, theory was developed to handle fluctuations in far-from-equilibrium conditions. The Fluctuation Theorem [
34] and the Jarzynski Equation [
35,
36] could very accurately account for the results of experiments in which microscopic beads were pulled by optical tweezers [
37] and experiments in which RNA was forcibly unfolded [
38,
39]. However, it should be realized that the Fluctuation Theorem and the Jarzynski Equation apply when far-from-equilibrium events take place
in an equilibrium bath with a temperature. In many experiments and real-life systems, the bath is the very
source of nonequilibrium. The Fluctuation Theorem and the Jarzynski Equation are of no help in that case and new theory needs to be developed. An obstacle here is constituted by the fact that there is no equivalent of temperature for the Lévy-stable distribution of velocities that is commonly associated with the nonequilibrium bath. For a Gaussian velocity distribution, the standard deviation is proportional to the square root of the temperature. However for a Lévy-stable distribution, the standard deviation diverges and, technically, the temperature works out to be infinite. In this article we have tried to contribute to the development of description and understanding of what can happen in nonequilibrium baths.
As was explained in the Introduction, baths consisting of Lévy particles lead to similar physics as baths in which active particles are suspended. In both cases there is a continuous input of energy into the system and there is no longer a Fluctuation-Dissipation Theorem to guide the understanding and description. Swimming bacteria are a prime example of active particles. That swimming
Escherichia coli bacteria can indeed be accumulated in cavities as has been experimentally demonstrated [
40].
In a recent paper, results are presented of a numerical simulation of an active-particles-containing liquid [
41]. A passive particle in this liquid was followed as a probe. This passive particle turned out to display Lévy-stable distributed displacements. What was simulated in this work was merely the Navier–Stokes equations and that passive particles exhibit these Lévy-stable distributed displacements is therefore a purely hydrodynamic effect due to active-particle-activity. That interesting and unexpected hydrodynamics can develop in liquids with immersed swimming bacteria has also been experimentally established [
42].
The density profiles in
Figure 2 and
Figure 5 are mindful of the coffee ring effect. When a coffee drop on a surface evaporates, the stain that is left behind is darkest towards the edge [
43]. This effect is common with liquids that carry solutes. There are technological applications where it is important to control the coffee ring effect. The simple explanation for the effect goes as follows. The drop has the shape of a disk. It has a fixed radius and the height of the drop vanishes near the edge. With a uniform evaporation across the surface area of the drop, there must be a net outward radial flow to replenish lost fluid near the contact line. Solute is carried along with this flow and ultimately deposited near the contact line. Much theoretical, numerical, and experimental research has been devoted to the effect in the last quarter century (see Ref. [
44] and references therein). It is common to use equilibrium concepts like Einstein’s Fluctuation-Dissipation theorem when trying to account for the phenomenon. However, an evaporating drop is not in a thermodynamic equilibrium. It is certainly possible that solute particles exhibit the large jumps that are commonly encountered in nonequilibrium systems. The accumulation at the edge could then also be due to the mechanism that we discussed in this article.
In plasma physics, it is common to assume that the particles in a dense plasma follow the well-known Maxwell–Boltzmann distribution for particle speeds [
1]. However, this equilibrium assumption may not always be valid, especially if the plasma is short lived and associated with an energy pulse. At Lawrence Livermore Lab, a table-top-size construction was developed to generate pulses of fast neutrons from high-energy deuterium collisions in plasma. Such collisions lead to the nuclear reaction D + D
3He + n [
45]. In the experiments, it appears that the number of produced neutrons exceeds the theoretical predictions by more than an order of magnitude. The reason for this is most likely that the Maxwell–Boltzmann distribution only applies at thermodynamic equilibrium.
Plasmas in which energy is converted or transferred are of course not in a thermodynamic equilibrium. In containers with plasma, a homogeneous distribution is therefore unlikely and accumulation at the edge as described in this work is possible. This is important because it means that fusion reactions in a plasma will occur at different rates at different positions. Through feedback mechanisms, such inhomogeneities may rapidly augment and possibly develop into serious instabilities.
Engineered microswimmers is probably the field where our results could ultimately be most applicable. There are good methods and technologies for manipulating suspended micrometer size particles from the outside with acoustic, magnetic, or optic signals (see e.g., Refs. [
46,
47]). Today the exciting new developments are in the medical application of such microrobots. Clinical uses for imaging, sensing, targeted drug delivery, microsurgery, and artificial insemination are envisaged and researched [
48]. The microswimmers and microrobots are particles that are operating in a very noisy environment. Accumulations as described and explained in this article are likely to be encountered.