Control of Swarms Based On Hydrodynamic Models
Control of Swarms Based On Hydrodynamic Models
Abstract— We address the problem of pattern generation formation control are applied in [6] and [7] but in these cases
in obstacle-filled environments by a swarm of mobile robots. proofs of stability of the given formation are not discussed.
Decentralized controllers are devised by using the Smoothed The use of artificial potential fields to address the pattern
Particle Hydrodynamics (SPH) method. The swarm is modelled
as an incompressible fluid subjected to external forces. Actual generation task in the absence of obstacles is discussed in [8]
robot issues such as finite size and nonholonomic constraints are and [9]. In these works, scalable approaches are derived and
also addressed. Collision avoidance guarantees are discussed. proofs of convergence and stability are given. The problem
Finally, in the absence of obstacles, we prove for the first time of staying connected during the task is also considered in [9].
stability and convergence of controllers based on the SPH. In contrast to the others, in this work we use the Smo-
I. INTRODUCTION othed Particle Hydrodynamics method to model the swarm
emulating an incompressible fluid in an obstacle-filled envi-
The focus of this work is on using analogies with fluid ronment. We deal with static obstacles by computing a global
dynamics models to control swarms of robots. The main potential function and using virtual particles. The incompres-
motivation stems from the fact that a great variety of charac- sible fluid model allows for a loose way of controlling the
teristics desirable for a large group of robots may be observed connectivity of the swarm. We provide a decentralized and
in fluids. Some examples of such characteristics are: (i) fluids scalable approach which relies only on local information.
are easily deformed, (ii) fluids can easily flow around objects, Moreover, there is no need to label the agents in the swarm.
and (iii) the flow field variables and also the fluid phase can
be easily manipulated in order to design desired behaviors. II. SMOOTHED PARTICLE HYDRODYNAMICS
Other works have already mimicked fluid behaviors to The Smoothed Particle Hydrodynamics (SPH) is a mesh-
control large groups of robots. The authors of [1] used free particle numerical method. It is a particle numerical
Stokesian Dynamics. By using this technique the robots method since it employs a set of finite number of disordered
had the behavior of particles suspended in a fluid and the discrete particles to represent the state of the simulated
group shape could be controlled without losing the group system. It is mesh-free due to the fact that it is not necessary
coherence. In [2] the kinetic theory of gases was used to to generate a mesh to provide connectivity of the particles.
sweep a group of robots through a bounded region. Additionally, SPH is considered a Lagrangian method, which
In this work we are interested in the so-called pattern means that the individual particles are modelled in space and
generation problem, which may be stated as follows: in time in contrast to Eulerian methods that model the flux
Given N robots and any initial spatial distribution, the of material through a control volume fixed in space.
geometry of the environment with static obstacles defining a The continuum governing equations of fluid dynamics
compact domain Ω ⊂ R2 , and a curve Γ : I → Ω, where capture three salient phenomena: (i) conservation of mass;
I ⊂ R, find a controller which enables the robots, without (ii) conservation of momentum; and (iii) conservation of
colliding with static obstacles and each other, to form Γ. energy. For inviscid compressible fluids, in the absence of
Possible applications of an efficient solution to this task heat flux, the Lagrangian description is given by:
are surveillance and cordoning off of hazardous areas. We Dρ
are interested in a decentralized solution which scales from = −ρ∇ · v , (1)
Dt
tens to hundreds of robots. Some approaches as in [3] Dv ∇P
assume that each robot knows the positions of all the others. =− , (2)
Dt ρ
To achieve scalability, it is more interesting to have an
approach that relies only on local information. Approaches De P
=− ∇·v, (3)
that depend on labelling the robots are also hard to scale Dt ρ
since it may be difficult to uniquely identify agents in the where ρ is density, v is velocity, e is the internal energy per
swarm. Approaches based on leader-follower controllers are unit of mass, P is the hydrostatic pressure, ∇ is the gradient
examples of this class [4], [5]. Behavior-based techniques for operator, ∇ · () is the divergence, and D/Dt is the total
time derivative which is physically the time rate of change
L. C. A. Pimenta, R. C. Mesquita, and G. A. S. Pereira are with
the Department of Electrical Engineering, Universidade Federal de Minas following a moving fluid element.
Gerais, Belo Horizonte, MG, 31270-901, Brazil. {lucpim, renato, In the SPH method, the continuum equations of fluid
gpereira}@cpdee.ufmg.br dynamics are converted to a set of ordinary differential
N. Michael and V. Kumar are with the GRASP Laboratory, Uni-
versity of Pennsylvania, Philadelphia, PA 19104, USA. {nmichael, equations, where each one controls the evolution of an attri-
kumar}@seas.upenn.edu bute of a specific particle. This conversion is performed by
Authorized licensed use limited to: UNIVERSIDADE FEDERAL DE MINAS GERAIS. Downloaded on August 19, 2009 at 12:09 from IEEE Xplore. Restrictions apply.
1.8
(10)
1
ρ0
W
0.8
0.4
1949
Authorized licensed use limited to: UNIVERSIDADE FEDERAL DE MINAS GERAIS. Downloaded on August 19, 2009 at 12:09 from IEEE Xplore. Restrictions apply.
(a) (b)
1950
Authorized licensed use limited to: UNIVERSIDADE FEDERAL DE MINAS GERAIS. Downloaded on August 19, 2009 at 12:09 from IEEE Xplore. Restrictions apply.
[xdi , ydi ]T and radius R = R + d. The SPH particles are where ei is the part of the internal energy related to
also placed at the points [xdi , ydi ]T . Since our controllers conservative forces such that:
were devised for robots fully actuatedin their acceleration
we compute the integral [ẋdi , ẏdi ]T = ui (q)dt. dei 1 Pi Pj
= m + 2 vij · ∇i Wij (23)
dt 2 j ρ2i ρj
D. Virtual Particles
When controlling multiple robots, due to the presence of and e0 is the minimum internal energy which is obtained
inter-particle forces, bi , the external force, fi , may be not when vi = 0 and ρi = ρ0 for all i. Consider also the set
enough to avoid collisions. We add virtual particles right Ωc = {x ∈ X|V (q, v) ≤ c}, where X is the state space
at the boundaries of the configuration space such that we defined by x = [qT1 v1T . . . qTN vN ] . Given the set S with
T T
can guarantee collision avoidance. In fact, we want to take boundary determined by the desired pattern Γ and the system
advantage of the collision avoidance property provided by the of robots defined in Proposition 1 with initial conditions x0 ∈
artificial viscosity. There are several ways of implementing Ωc , the system converges to an invariant set, ΩI ⊂ Ωc , such
this virtual particle idea. One option is to create a virtual that the points in ΩI minimize the measure function φS .
particle at the closest boundary point, p. Then we adapt the
term bi in (16) such that: Proof: Since V is continuous, we conclude that Ωc is
closed for some c > 0. Also, due to the fact that φS + i (ei −
Pi Pj e0 ) ≤ c and vT v ≤ c we conclude that Ωc is compact.
bi =− mj 2 + ρ2 + Πij ∇i Wij (h)
ρ i j (20) We have that
j
de
− λΠip ∇i Wip (h ) , V̇ = (k∇φTi q̇i + viT v̇i ) + i
. (24)
dt
where λ is a positive constant, j iterates only through the N i i
particles that represent real robots, and p refers to the virtual By using (15) and (23), and the fact that ∇i Wij =
particle. Due to the fact that the size of the robot is already −∇j Wji and Πij = Πji
taken into account in the configuration space, we use R = 0 1
in (18). Note that the virtual particle does not change the V̇ = − ζviT vi − mΠij vij
T
∇i Wij ≤ 0.
density ρi and also does not have its own density. The other i i
2 j
terms necessary to compute Πip are ρip = ρi and cip = ci .
By using the LaSalle’s Invariance Principle, we conclude
Another option is to assign virtual particles to each cell
that for any x0 ∈ Ωc the system converges asymptotically
with obstacle in a local occupancy grid. This option was
to the largest invariant set ΩI = {x ∈ X|V̇ = 0}, which
found to be the most robust during experiments.
corresponds to vi = 0 ∀i with ΩI ⊂ Ωc . Since ΩI contains
IV. ANALYSIS all equilibrium points in Ωc and based on the Proposition 1
Our stability and convergence analysis is built upon the we conclude that all points in ΩI minimize φS .
results in [9]. The next four results correspond to our version
of the Results 4.1 to 4.4 in [9]. We assume obstacle-free Proposition 3 Consider the set ΩS defined by
environments and fi in (15) is given by −∇φ, where φ is
ΩS = {x|φ(qi ) = 0, vi = 0, ρi = ρ0 ∀i} , (25)
the shape function in (14). We also assume that the robots
are represented by identical SPH particles with mass m. where φ is a shape function. Given the system of N robots
Before presenting our results we define the function φS (q) defined in Proposition 1, the set ΩS is a stable submanifold
as a measure of performance that should be minimized: and ΩS ⊂ ΩI .
φS (q) = k φ(qi ). (21) Proof: Since vi = 0 for all i, ΩS ⊂ ΩI . The potential
i
energy of the system is given by U = φS + i ei . We need
Proposition 1 Given a system of N point robots with dyna- to show that the hessian of U , HU = HφS + H i ei , is
mics q̈i = ui (q, t) and a control law determined by (15), positive semi-definite when qi ∈ Γ and ρi = ρ0 ∀i.
where fi = −∇φ and φ is a shape function, the system It is proved in [9] that the 2N ×2N matrix HφS is positive
equilibrium points are at an extremum of φS . semi-definite when φ(qi ) = 0. Therefore, we need to prove
that H i ei ≥ 0 when ρi = ρ0 . By using ∇i Wij = −∇j Wji
Proof: Since the system is in equilibrium we have q̈ = in (23) we can write after some algebra
0
and q̇ = 0. We have also Πij = 0 and ui = 0. Therefore,
∂ n en
i i = 0. Since ∇i Wij =
u −∇j Wij , we have i ui = Pi Pj
= m 2 + ρ2 ∇i Wij . (26)
k i ∇φi = 0. However, k i ∇φi = 0 is the necessary ∂qi ρi j
j
condition for φS to be at an extremum.
After using the state equation (10), computing the second
Proposition 2 Consider the positive semi-definite function: derivatives, and using ρi = ρ0 , we can obtain
1
V = φS + (ei − e0 ) + vT v , (22) m2 γσ
2 H i ei = AAT ≥ 0 , (27)
i ρ20
1951
Authorized licensed use limited to: UNIVERSIDADE FEDERAL DE MINAS GERAIS. Downloaded on August 19, 2009 at 12:09 from IEEE Xplore. Restrictions apply.
where σ is a positive constant and
W1k
k ∂ ∂x1 ∂W 12
... ∂W 1N
∂ W1k ∂ W12 . . .
∂x1 ∂x1
W1N
k ∂y1 ∂y1 ∂ ∂y1
A=
..
.
..
.
..
.
..
.
.
WN k
∂W N1
∂ WN 2
. . . ∂
∂xN ∂xN k W ∂xN
∂W∂yN
N1
∂ WN 2
∂yN . . . k ∂ ∂yN
Nk
1952
Authorized licensed use limited to: UNIVERSIDADE FEDERAL DE MINAS GERAIS. Downloaded on August 19, 2009 at 12:09 from IEEE Xplore. Restrictions apply.
2.5
1.5
0.5
y (m)
0
−0.5
−1
−1.5
−2
−2.5
−3 −2 −1 0 1 2 3 4
x (m)
(a) (b)
(a) (b)
2.5
1.5
0.5
y (m)
−0.5
−1
−1.5
−2
−2.5
−3 −2 −1 0 1 2 3 4
x (m)
(c) (d)
(c) (d)
2.5
1.5
1
Fig. 6. Simulation with 15 robots from a starting configuration (Fig. 6(a))
0.5 to the goal (Fig. 6(d)), with intermediate configurations (Figs. 6(b) and 6(c)).
y(m)
−0.5
−1
−1.5
−2
W911NF-05-1-0219, and the NSF ITR Grant 0324977.
−2.5
−3 −2 −1 0 1 2 3 4
R EFERENCES
x (m)
(e) (f)
[1] M. Shimizu, A. Ishiguro, T. Kawakatsu, Y. Masubuchi, and M. Doi,
2.5
“Coherent swarming from local interaction by exploiting molecular
2 dynamics and stokesian dynamics methods,” in Proc. IEEE/RSJ Int.
1.5
1
Conf. Intel. Robots and Systems, vol. 2, 2003, pp. 1614 – 1619.
0.5 [2] W. Kerr and D. F. Spears, “Robotic simulation of gases for a
y (m)
−0.5
surveillance task,” in Proc. IEEE/RSJ Int. Conf. Intel. Robots and
−1
−1.5
Systems, 2005, pp. 2905–2910.
−2 [3] K. Sugihara and I. Suzuki, “Distributed algorithms for formation of
−2.5
−3 −2 −1 0
x (m)
1 2 3 4 geometric patterns with many mobile robots,” Journal of Robotic
Systems, vol. 13, no. 3, pp. 127–139, 1996.
(g) (h) [4] J. P. Desai, J. P. Ostrowski, and V. Kumar, “Modeling and control of
formations of nonholonomic mobile robots,” IEEE Trans. Robot. and
2.5
Automat., vol. 17, no. 6, pp. 905–908, 2001.
2
1.5
[5] H. C.-H. Hsu and A. Liu, “Multiple teams for mobile robot formation
1
0.5
control,” in Proceedings of the IEEE International Symposium on
Intelligent Control, 2004, pp. 168–173.
y (m)
−0.5
−1
[6] T. Balch and R. C. Arkin, “Behavior-based formation control for
−1.5 multirobot teams,” IEEE Trans. Robot. and Automat., vol. 14, no. 6,
−2
−2.5
pp. 926–939, 1998.
−3 −2 −1 0 1 2 3 4
x (m)
[7] Z. Cao, M. Tan, S.Wang, Y. Fan, and B. Zhang, “The optimization
(i) (j) research of formation control for multiple mobile robots,” in Proc.
of the 4th World Congress on Intel. Control and Automat., 2002, pp.
1270–1274.
Fig. 5. Experimental Results. A team of seven robots, starting from an [8] L. Chaimowicz, N. Michael, and V. Kumar, “Controlling swarms of
initial configuration (Fig. 5(a)), control around an obstacle (Figs. 5(c), 5(e), robots using interpolated implicit functions,” in Proc. IEEE Int. Conf.
and 5(g)) to a goal circular formation (Fig. 5(i)). The results in the Robot. Automat., Barcelona, Spain, April 2005, pp. 2498–2503.
configuration space are also shown in Figs. 5(b), 5(d), 5(f), 5(h), and 5(j). [9] M. A. Hsieh and V. Kumar, “Pattern generation with multiple robots,”
in Proc. IEEE Int. Conf. Robot. Automat., Orlando, USA, May 2006,
geometrically complicate domains. By adapting the artificial pp. 2442–2447.
viscosity term and also by including virtual particles we [10] J. J. Monaghan, “Smoothed particle hydrodynamics,” Annual Review
of Astronomy and Astrophysics, vol. 30, pp. 543–574, 1992.
were able to guarantee that the robots are driven safely. [11] ——, “Simulating free surface flow with SPH,” Journal of Computa-
For obstacle-free environments we used shape functions and tional Physics, vol. 110, pp. 399–406, 1994.
proved stability and convergence of our controllers. [12] J. R. Perkinson and B. Shafai, “A decentralized control algorithm for
scalable robotic swarms based on mesh-free particle hydrodynamics,”
Our approach is scalable and there is no need for labelling in Proc. of the IASTED Int. Conf. on Robot. and Applications, 2005,
the robots. The approach is also robust to dynamic deletion pp. 1–6.
and addition of agents. Since the robots try to keep the [13] L. C. A. Pimenta, M. L. Mendes, R. C. Mesquita, and G. A. S. Pereira,
“Fluids in electrostatic fields: An analogy for multi-robot control,”
density of the fluid model constant, this approach allows for IEEE Trans. on Magnetics, vol. 43, no. 4, pp. 1765 – 1768, 2007.
a loose way of controlling the group connectivity. [14] N. Michael, J. Fink, and V. Kumar, “Experimental testbed for large
multi-robot teams: Verification and validation,” IEEE Robotics and
VII. ACKNOWLEDGMENTS Automation Magazine, Mar. 2008, to Appear.
[15] B. Gerkey, R. T. Vaughan, and A. Howard, “The Player/Stage project:
The authors would like to acknowledge the financial Tools for multi-robot and distributed sensor systems,” in Proc. of the
support of CNPq – Brazil, ARO MURI SWARMS Grant Int. Conf. on Advanced Robotics, 2003, pp. 317–323.
1953
Authorized licensed use limited to: UNIVERSIDADE FEDERAL DE MINAS GERAIS. Downloaded on August 19, 2009 at 12:09 from IEEE Xplore. Restrictions apply.