Cellular Automata
Cellular Automata
t appears that the basic laws of physics relevant to everyday phenomena are now known. Yet there are many
I everyday natural systems whose complex structure and behavior have so far defied even qualitative analysis. For
example, the laws that govern the freezing of water and the conduction of heat have long been known, but
analyzing their consequences for the intricate patterns of snowflake growth has not yet been possible. While many
complex systems may be broken down into identical components, each obeying simple laws, the huge number of
components that make up the whole system act together to yield very complex behavior.
In some cases this complex behavior may be simulated numerically with just a few components. But in most cases
the simulation requires too many components, and this direct approach fails. One must instead attempt to distill
the mathematical essence of the process by which complex behavior is generated. The hope in such an
approach is to identify fundamental mathematical mechanisms that are common to many different
natural systems. Such commonality would correspond to universal features in the behavior of
very different complex natural systems.
To discover and analyze the mathematical basis for the generation of complexity,
one must identify simple mathematical systems that capture the essence of
the process. Cellular automata are a candidate class of such systems. This
article surveys their, nature and properties, concentrating on funda-
mental mathematical features. Cellular automata prorrlise to
provide mathematical models for a wide variety of
complex phenomema, from turbulence in fluids to
patterns in biological growth. The general
features of their behavior discussed here
should form a basis for future
detailed studies of such
specific systems.
The Nature of Cellular Automata
and a Simple Example
......
• rules that specify the value of each site in
~ terms of the values of neighboring sites.
Cellular automata may thus be considered as
•• a(l+l)
i
= a (l) +
i- I
a(l)
i+l
mod 2 , (I)
I
•
cording to this rule, the value of a particular
site is given by the sum modulo 2 (or,
equivalently, the Boolean algebra "exclusive
or") of the values of its left- and right-hand
~ found.
I
Fractal Patterns Grown from Cellular Au-
tomata. First of all, consider evolution ac-
Fig. 2. A few time steps in the evolution of the simple cellular automaton difrned by
Eq. 1, starting from a "seed" containing a single nonzero site. Successive lines are
M~
~
ordered or structureless initial states. The
cellular automaton in Fig. 4 is a simple ., .I;.
~
(I-;: ;'d ~ u: ~ ~ ,,(
(
example of such a self-organizing system.
The mathematical basis of this behavior is , ~ ~
11t(,
;.- i;:!:
'.
~ ~
~l
",".lZI;J ...
l~ .I!lCA.'
Fig. 4. Evolution of the simple cellular automaton difrned by Eq. 1,from a disordered
'IW!t.
~~ZI
....... ~
~
~
Fig. 4, one follows the overall evolution of an initial state in which each site is taken to have value 0 or 1 with equal, independent
ensemble of many different initial states. probabilities. Evolution of the cellular automaton even from such a random initial
p It is convenient when investigating global state yields some simple structure.
• properties to consider finite cellular autom-
ata that contain a finite number N of sites
whose values are subject to periodic bound-
I
•
possible values, as it does for the rule of Eq.
1, there are a total of 2N possible states, or
configurations, for the complete finite cellu-
lar automaton. The global evolution of the
Fig. 6. The global state transition graph increases those for others. For example, after
for afinite cellular automaton consisting just one time step the probabilities for states
of twelve sites arranged around a circle on the periphery of the state transition graph
and evolving according to the simple rule in Fig. 6 are reduced to zero; such states
of Eq. 1. Each node in the graph repre- may be given as initial conditions, but may
never be generated through evolution of the
sents one of the 4096 possible states, or
cellular automaton. After many time steps
sequences of the twelve site values, of the
only a small number of all the possible
cellular automaton. Each node is joined configurations actuaJly occur. Those that do
by a directed line to a successor node occur may be considered to lie on "attrac-
60 Copies that corresponds to the state obtained by tors" of the cellular automaton evolution.
one time step of cellular automaton Moreover, if the attractor states have special
evolution. The state transition graph "organized" features, these features will ap-
consists of many disconnected pieces, pear spontaneously in the evolution of the
many of identical structure. Only one cellular automaton. The possibility of self-
copy of each structurally identical piece organization is therefore a consequence of
is shown explicitly. Possible paths the irreversibility of the cellular automaton
evolution, and the structures obtained
through the state transition graph rep-
through self-organization are determined by
resent possible trajectories in the state
the characteristics of the attractors.
space of the cellular automaton. The
The irreversibility of cellular automaton
6 Copies merging of these trajectories reflects the
evolution revealed by Fig. 6 is to be con-
irreversibility of the cellular automaton trasted with the intrinsic reversibility of sys-
evolution. Any initial state of this tems described by conventional thermo-
cellular automaton ultimately evolves to dynamics. At a microscopic level the trajec-
an "attractor" represented in the graph tories representing the evolution of states in
by a cycle. For this particular cellular such systems never merge: each state has a
automaton all collfigurations evolve to unique predecessor, and no information is
attractors in at most three time steps. lost with time. Hence a completely dis-
(From O. Martin, A. Odlyzko, and S. ordered ensemble, in which all possible states
occur with equal probabilities, remains dis-
Wolfram, "A 1gebraic Properties of
ordered forever. Moreover, if nearby states
4 Copies Cellular Automata," Bell Laboratories
are grouped (or "coarse-grained") together,
report (January 1983) and to be pub-
as by imprecise measurements, then with
lished in Communications in Mathemat- time the probabilities for different groups of
ical Physics.) states will tend to equality, regardless of their
initial values. In this way such systems tend
automaton from the initial state represented of the state transition graph). The merging of with time to complete disorder and max-
by that particular node. The state transition trajectories implies that information is lost in imum entropy, as prescribed by the second
graph of Fig. 6 shows all possible trajectories the evolution of the cellular automaton: law of thermodynamics. Tendency to dis-
in state space for a cellular automaton with knowledge of the state attained by the sys- order and increasing entropy are universal
twelve sites evolving according to the simple tem at a particular time is not sufficient to features of intrinsically reversible systems in
rule of Eq. 1. determine its history uniquely, so that the statistical mechanics. Irreversible systems,
A notable feature of Fig. 6 is the presence evolution is irreversible. Starting with an such as the cellular automaton of Figs. 2, 3,
of trajectories that merge with time. While initial ensemble in which all configurations and 4, counter this trend, but universal laws
each state has a unique successor in time, it occur with any distribution of probabilities, have yet to be found for their behavior and
may have several predecessors or no pred- the irreversible evolution decreases the for the structures they may generate. One
ecessors at all (as for states on the periphery probabilities for some configurations and hopes that such general laws may ultimately
H be abstracted from an investigation of the ing for each configuration a characteristic II N~2(2k+ I ) 2II N~2k+ I
~
= .
I
formed, then the values of sites generated power of 2 that divides N (for example,
the particular cellular automaton rule given
from a single nonzero initial site would Di12) = 4).
by Eq. 1. This rule may be generalized in
simply be the integers appearing in Pascal's Since a finite cellular automaton evolves
• triangle of binomial coefficients. The pattern deterministically with a finite total number of
several ways. One family of rules is obtained
!
by allowing the value of a site to be an
of nonzero sites in Figs. 2 and 3 is therefore possible states, it must ultimately enter a
arbitrary function of the values of the site
::,. the pattern of odd binomial coefficients in cycle in which it visits a sequence of states
itself and of its two nearest neighbors on the
Pascal's triangle. (See Stephen Wolfram, repeatedly. Such cycles are manifest as
previous time step:
"Geometry of Binomial Coefficients," to be closed loops in the state transition graph.
published in American Mathematical The algebraic analysis of Martin et al. shows
Monthly.) that for the cellular automaton of Eq.1 the a (l+ l ) = F(a(I)I ' a(I) , a(I» ) .
I 1- I i+ l
This algebraic approach may be extended maximal cycle length II (of which all other
to determine the structure of the state tran- cycle lengths are divisors) is given for even N
sition diagram of Fig. 6. (See O . Martin, A. by A convenient notation illustrated in Fig. 7,
Odlyzko, and S. Wolfram, "Algebraic assigns a "rule number" to each of the 256
Properties of Cellular Automata," Bell Labo- rules of this type. The rule number of Eq. I is
ratories report (January 1983) and to be 90 in this notation.
published in Communications in Mathemati- Further generalizations allow each site in
cal Physics.) The analysis proceeds by writ- or a cellular automaton to take on an arbitrary
,•
I•
!
Fig. 8. Evolution of some typical cellular automata from on the values of sites up to r sites distant on both sides.
disordered initial states. Each group of six patterns shows the Different colors represent different site values: black cor-
evolution of various rules with particular values of k and r. responds to a value of 0, red to 1, green to 2, blue to 3, and
Sites take on k possible values, and the value of a site depends yellow to 4. Thefact that these and other examples exhibit only
I such that the co~cient of 2j in the binary decomposition of C and J. Condon of Bell Laboratoriesfor their help in preparing
gives the value attained by a site if its neighborhood had total these and other color pictures of cellular automata.)
value j on the previous time step. These examples are labeled
by code number and behavior class. (/ am gratiful to R. Pike
value O. Such cellular automata are of prac- random. In fact, as mentioned for the exam- but the corresponding configurations are
tical importance for digital image processing : ple of Eq. 1, they may exhibit important self- not). Instead, the configurations of an infinite
they may be used to select and enhance organizing behavior. In addition and again in cellular automaton form a Cantor set. Figure
particular patterns of pixels. After a suffi- contrast to class 2 cellular automata, the 10 illustrates two constructions for a Cantor
ciently long time any class 2 cellular automa- statistical properties of the states generated set. In construction (a) of Fig. 10, one starts
ton evolves to a state consisting of blocks by many time steps of class 3 cellular with the set of real numbers in the interval 0
containing nonzero sites separated by re- automaton evolution are the same for almost to I. First one excludes the middle third of
gions of zero sites. The blocks have a simple all possible initial states. The large-time the interval, then the middle third of each
form, typically consisting of repetitions of behavior of a class 3 cellular automaton is interval remaining, and so on. In the limit the
particular site values or sequences of site therefore determined by these common set consists of an infinite number of discon-
values (such as 101010 ... ). The blocks statistical properties. nected points. If positions in the interval are
either do not change with time (yielding The configurations of an infinite cellular represented by ternimals (base 3 fractions,
vertical stripes in the patterns of Fig. 8) or automaton consist of an infinite sequence of analogous to base 10 decimals), then the
cycle between a few states (yielding "railroad site values. These site values could be con- construction is seen to retain only points
track" patterns). sidered as digits in a real number, so that whose positions are represented by ternimals
While class 2 cellular automata evolve to each complete configuration would cor- containing no l 's (the point 0.2202022 is
give persistent structures with small periods, respond to a single real number. The topol- therefore included; 0.2201022 is excluded).
class 3 cellular automata exhibit chaotic ogy of the real numbers is, however, not An important feature of the limiting set is its
aperiodic behavior, as shown in Fig. 8. exactly the same as the natural one for the self-similarity, or fractal form : a piece of the
Although chaotic, the patterns generated by configurations (the binary numbers set, when magnified, is indistinguishable
class 3 cellular automata are not completely 0.111111 . .. and 1.00000... are identical, from the whole. This self-similarity is math-
equation Z3 - Z2 + 2z - 1 = O. (See D. A.
Lind, "Applications of Ergodic Theory and
2
Sofic Systems to Cellular Automata," Uni-
3
versity of Washington preprint (April 1983)
4
and to be published in Physica D; see also
5
Martin et ai., op. cit.) The greater the
6
? ;
irreversibility in the cellular automaton evo-
lution, the smaller is the dimension of the
8
9
Cantor set corresponding to the attractors
for the evolution. If the set of attractors for a
cellular automaton has dimension 1, then
essentially all the configurations of the
cellular automaton may occur at large times.
Fig. 11. Time evolution of the probabilities for each of the 1024 possible configura- If the attractor set has dimension less than 1,
tions of a typical class 3 cellular automaton with k = 2 and r = 1 and of size 10, then a vanishingly small fraction of all
possible configurations are generated after
starting from an initial ensemble in which each possible configuration occurs with
many time steps of evolution. The attractor
equal probability. The configurations are specified by integers whose binary digits
sets for most class 3 cellular automata have
form the sequence of site values. The probability for a particular configuration is given
dimensions less than 1. For those class 3
on successive lines in a vertical column: a dot appears at a particular time step if the cellular automata that generate regular pat-
configuration occurs with nonzero probability at that time step. In the initial ensemble terns, the more regular the pattern, the
all configurations occur with equal nonzero probabilities, and dots appear in all smaller is the dimension of the attractor set;
positions. The cellular automaton evolution modifies the probabilities for the these cellular automata are more irreversible
configurations, making some occur with zero probability and yielding gaps in which and are therefore capable of a higher degree
no dots appear. This "thinning" is a consequence of the irreversibility of the cellular of self-organization.
automaton evolution and is reflected in a decrease of entropy with time. In the limit of The dimension of a set of cellular automa-
cellular automata of infinite size, the configurations appearing at large times form a ton configurations is directly proportional to
Cantor set. For the rule shown (rule 18 in the notation of Fig. 7) the limiting the limiting entropy (or information) per site
of the sequence of site values that make up
dimension of this Cantor set isfound to be approximately 0.88.
the configurations. (See Patrick Billingsley,
Ergodic Theory and Information, John
purposes, is based on self-similarity. Take starting from such a disordered initial Wiley & Sons, 1965.) If the dimension of the
the Cantor set of construction (a) in Fig. 10. ensemble. As expected from the irre- set was 1, so that all possible sequences of
Contract the set by a magnification factor versibility of cellular automaton evolution, site values could occur, then the entropy of
k - m• By virtue of its self-similarity, the whole exemplified by the state transition graph of these sequences would be maximal. Di-
set is identical to a number, say M(m), of Fig. 6, different configurations attain dif- mensions lower than 1 correspond to sets in
copies of this contracted copy. For large m, ferent probabilities as evolution proceeds, which some sequences of site values are
M(m) ::::: kdm, where again d is defined as the and the probabilities for some configurations absent, so that the entropy is reduced. Thus
set dimension. decrease to zero. This phenomenon is mani- the dimension of the attractor for a cellular
With these definitions the dimension of the fest in the "thinning" of configurations on automaton is directly related to the limiting
Cantor set of all possible configurations for successive time steps apparent in Fig. 11. entropy attained in its evolution, starting
an infinite one-dimensional cellular automa- The set of configurations that survive with from a disordered ensemble of initial states.
ton is I. A disordered ensemble, in which nonzero probabilities after many time steps Dimension gives only a very coarse
each possible configuration occurs with of cellular automaton evolution constitutes measure of the structure of the set of con-
equal probability, thus has dimension 1. the "attractors" for the evolution. This set is figurations reached at large times in a
Figure II shows the behavior of the again a Cantor set; for the example of Fig. cellular automaton. Formal language theory
probabilities for the configurations of a typi- 11 its dimension is log2K ~ 0.88, where K ~ may provide a more complete characteriza-
cal cellular automaton as a function of time, 1. 755 is the real solution of the polynomial tion of the set. "Languages" consist of a set
'\
.~ ~ ~
~
... ..
. [;.. ' .......
:~
.~ I
Fig. 13. Persistent structures exhibited by the class 4 cellular structures are almost sufficient to demonstrate a universal
automaton of Fig. 12 as it evolves from initial states with computation capability for the cellular automaton.
nonzero sites in a region of twenty or fewer sites. These
gressively more distant initial site values in simple patterns. In addition, the propagating configurations must encode all possible pro-
the evolution of a class 3 cellular automaton. structures allow site values at one position to grams.
The solutions to this final class of differential affect arbitrarily distant sites after a suffi- The only known method of proving that a
equations tend to "strange" or "chaotic" ciently long time. No analogous behavior system may act as a universal computer is to
attractors (see Robert Shaw, "Strange At- has yet been found in a continuous show that its computational capabilities are
tractors, Chaotic Behavior, and Information dynamical system. equivalent to those of another system al-
Flow," Zeitschrift fur Naturforschung The complexity apparent in the behavior ready classified as a universal computer. The
36A(1981):80), which form Cantor sets in of class 4 cellular automata suggests the Church-Turing thesis states that no system
direct analogy with those found in class 3 conjecture that these systems may be may have computational capabilities greater
cellular automata. The correspondence be- capable of universal computation. A com- than those of universal computers. The thesis
tween classes of behavior found in cellular puter may be regarded as a system in which is supported by the proven equivalence of
automata and those found in continuous definite rules are used to transform an initial computational models such as Turing ma-
dynamical systems supports the generality of sequence of, say, l's and O's to a final chines, string-manipulation systems, ideal-
these classes. Moreover, the greater mathe- sequence of 1's and O's. The initial sequence ized neural networks, digital computers, and
matical simplicity of cellular automata sug- may be considered as a program and data cellular automata. While mathematical sys-
gests that investigation of their behavior may stored in computer memory, and part of the tems with computational power beyond that
elucidate the behavior of continuous final sequence may be considered as the of universal computers may be imagined, it
dynamical systems. result of the computation. Cellular automata seems likely that no such systems could be
may be considered as computers; their initial built with physical components. This conjec-
A Universal Computation Class configurations represent programs and initial ture could in principle be proved by showing
of Cellular Automata data, and their configurations after a long that all physical systems could be simulated
time contain the results of computations. by a universal computer. The main obstruc-
Figure 12 shows patterns obtained by A system is a universal computer if, given tion to such a proof involves quantum me-
evolution from disordered initial states ac- a suitable initial program, its time evolution chanics.
cording to a class 4 cellular automaton rule. can implement any finite algorithm. (See A cellular automaton may be proved
Complicated behavior is evident. In most Frank S. Beckman, Mathematical Founda- capable of universal computation by identify-
cases all sites eventually "die" (attain value tions of Programming, Addison-Wesley Pub- ing structures that act as the essential com-
0). In some cases, however, persistent struc- lishing Co., 1980.) A universal computer ponents of digital computers, such as wires,
tures that survive for an infinite time are need thus only be "reprogrammed," not NAND gates, memories, and clocks. The
generated, and a few of these persistent "rebuilt," to perform each possible calcula- persistent structures illustrated in Fig. 13
structures propagate with time. Figure 13 tion. (All modern general-purpose electronic provide many of the necessary components,
shows all the persistent structures generated digital computers are, for practical purposes, strongly suggesting that the cellular automa-
from initial states with nonzero sites in a universal computers; mechanical adding ma- ton of Figs. 12 and 13 is a universal
region of twenty or fewer sites. Unlike the chines were not.) If a cellular automaton is to computer. One important missing compo-
periodic structures of class 2 cellular au- be a universal computer, then, with a fixed nent is a "clock" that generates an infinite
tomata, these persistent structures have no rule for its time evolution, different initial sequence of "pulses"; starting from an initial
Fig. 14. Simulation networkfor symmetric cellular automaton Simulations are included in the network shown only when the
rules with k = 2 and r = 1. Each rule is specified by the number necessary blocks are three or fewer sites long. Rules 90 and
obtained as shown in Fig. 7, and its behavior class is indicated 150 are additive class 3 rules, rule 204 is the identity rule, and
by shades of gray: light gray corresponds to class 1, medium rules 170 and 240 are ltift- and right-shift rules, respectively.
gray to class 2, and dark gray to class 3. Rule A is considered Attractive simulation paths are indicated by bold lines.
to simulate rule B if there exist blocks of site values that evolve (Network courtesy of J. Milnor.)
under rule A as single sites would evolve under rule B.
technology on a single silicon wafer (the one- cellular automata, should be considered first. empirical result. Techniques from computa-
dimensional homogeneous structure makes tion theory may provide a basis, and ulti-
defects easy to map out). Conventional pro- mately a proof, of this result.
gramming methodology is, of course, of little A Basis for Universality? The first crucial observation is that with
utility for such a system. The development of special initial states one cellular automaton
a new methodology is a difficult but impor- may behave just like another. In this way
tant challenge. Perhaps tasks such as image The existence of four classes of cellular one cellular automaton may be considered to
processing, which are directly suitable for automata was presented above as a largely "simulate" another. A single site with a