An Insight Into The Algorithms On Real-Time People Tracking and Counting System
An Insight Into The Algorithms On Real-Time People Tracking and Counting System
ABSTRACT
People tracking and counting system is being widely used in INPUT VIDEO
modern days in the video surveillance for security purpose. In SEQUENCES
the recent, many algorithms have been proposed and
developed in designing the system. But there always been
confusions of using these algorithms based on their limitations
MOVING OBJECT
and benefits. This paper provides a review on the methods
that are used in the people tracking and counting system DETECTION
considering their limitations, benefits, speed and accuracy. In
designing an efficient real time people tracking and counting
system, designers can be effectively guided by this review TRACKING
work.
Keywords
object detection, background modeling, tracking, counting, COUNTING
counting lines. ALGORITHMS
1. INTRODUCTION
People tracking and counting system is of great importance Fig. 1 People tracking and counting system
for surveillance purpose. At past, people involved in the
counting process and later with the development of electronic As seen from the above blocks, a short description of the
devices, the counting process was somewhat reliable. But both people counting system can be given as that the real-time
of them were not fully efficient, as there contained errors, and input video is taken from a camera. This video is further
also tracking could not be done with those processes. processes to detect to moving object. Then features are
extracted from the processed video for tracking and counting
So, to sort out those difficulties, computer vision techniques purpose.
have been used in the people counting system to give proper
counting process and tracking. People tracking and counting This review work is organized into five sections. Section 2
process involves many phrases such as detection of moving describes the background subtraction techniques. Various
objects, feature extraction, morphological processing, tracking tracking algorithms are described in Section 3. Section 4
and counting. For every process, there involves many describes the counting process. In Section 5, a proposed
algorithms to carry out the processes efficiently. Both the model has been described based on the advantages and
expert and the newcomer to this area can beconfused about limitations of these algorithms. Conclusive remarks are
the benefits and limitations of each step. This paper provides a described in Section 6.
thorough review of the main methods and their advantages 2. MOVING OBJECT DETECTION
and disadvantages based on speed and accuracy.
In a video sequence, one of the important steps is to
The design process of people counting system has been
detect the moving objectin the scene from static
described as the block given below. Different researchers use
cameras.Several methods for performing moving the object
different algorithms for their design. The blocks shown
detection have been proposed. All of these methods are used
consist of the algorithms that are widely used in the tracking
to estimate the background model effectively from the
and counting process.
temporal sequence of the frames.In this section, different
algorithms for detecting the moving objects have been
discussed. Some of the widely used object detection
techniques are as:
1
International Journal of Computer Applications (0975 – 8887)
Volume 46– No.5, May 2012
2
International Journal of Computer Applications (0975 – 8887)
Volume 46– No.5, May 2012
Where α is the learning rate, Mk,t is 1 if match is found and 0 wheret is a given threshold. This approach can compensate for
if not match is found. The µ and σparameters for unmatched the changes such a shadows, climatic change, light intensity
distributions remain the same. For the match distributions etc. It can also offer less computational cost.
these parameters are updated as follows:
3
International Journal of Computer Applications (0975 – 8887)
Volume 46– No.5, May 2012
IN LINE IN LINE
4. COUNTING ALGORITHMS
To count the number of people entering or leaving a room,
Fig. 2 Fig. 3
different counting algorithms have been developed. For the
counting process to be accurate, different techniques are being
implemented. In this paper, some of the good counting
Equivalent Lines
algorithms are discussed.
Direction of Motion
In recent years, many computer vision based approaches for
people counting and tracking to deal various applications are
proposed. Researchers are trying to develop robust
background modeling algorithm to recognize the background
and track the moving object. Honglian Ma and Huchuan Lu et
Counting Zone
al. in [16] proposed a multiple people segmentation method
Fig. 4
based on the bi-directional projection histogram of grayscale
of frame differencing image. The insufficiency of this system
Fig.2: Single line counting technique Fig.3: Two line
is to only use the projection information of gray value as the
counting technique. Fig.4: Multiple lines method
detection criterion. The error in counting may occur, if the
projection information of other motion targets is similar to the
People whoever crossed this In Line as marked by the arrow
human targets. A.J.Schofield et al. [17] proposed a method to
head are counted as number of persons going in. Similarly,
count people in video images by using the neural networks.
this is for the people going out after crossing the Out Line in
They use RAM based neural network classifier to identify
the given direction. To detect and track moving people, Kim
section of background scene in each test image. Kenji Terada
et al. in [21] proposed a real-time scheme, where they used
et al. in [9] proposed a counting method in which they use
bounding box to enclose each person. The approximated
template process to detect the direction of the moving objects.
convex hull of each individual in the tracking area is obtained
From the moving direction information space time image
to provide more accurate tracking information.
generated. Then by counting the people data, the number of
incoming and outgoing person is counted. Chao-Ho (Thou-
Javier Barandiaran et al. [22] used more than two lines, i.e.
Ho) Chen et al. in [18] proposed a scheme to count the
multiple lines to count the number of people going in or
number of people entering and leaving a bus by using a
coming out within the range of the camera. The lines are
zenithal camera. They firstly divided the captured frame into
virtual and placed perpendicularly to the direction of the
many blocks then blocks with similar motion vectors regarded
motion of the people.The counting is performed by each line
as belonging to same object. Hartono Septian et al. in[19]
individually and the length must be bigger than half of a
proposed a method to count number of people, where they
person's width. Pixels are getting accumulated when someone
first detect the person as blobs and represents as binary masks
crosses the lines. To determine the direction of movement,
then a correlation based algorithm is applied to track the
people, Javier Barandiaran used Lucas-Kanade method
person in consecutive frames.
around the counting zone.
Researchers use techniques such as single line counting or 5. A PROPOSED MODEL
multiple lines counting for the counting process. Tsong-Yi All the algorithms for all the steps of a people counting
Chen et al. [20] proposed a counting algorithm where a single system have been discussed in above. All these algorithms are
camera is mounted at the top of the room. The algorithm used widely used. But all these algorithms are not used considering
a single line in the screen as the counting zone. The persons their advantages, speed and limitations. Based on these
crossing this line are counted as going in or coming out of the properties, a model is proposed for the designing of people
room. He took the object’s perimeter and area as the most tracking and counting system.
attainable features, for single image, for counting purpose.
They have also put a suggestion for distinguishing the In the moving object detection algorithm, it cannot be said
overlapping persons when it occurs in the frame. Analyzing that all the algorithms are good. The simplest of them is frame
the processed image, many features, such as the height, width, difference method. One of the main reasons is that of its
area, gravity center, contour, shape and pixels’ number, can modest computational load. Another is that the background
be obtained. From all these, only a few features of interest are model is highly adaptive to the changes in background, as it
selected to analysis. depends solely on the previous frame, which makes it faster
4
International Journal of Computer Applications (0975 – 8887)
Volume 46– No.5, May 2012
than any other methods. The frame difference method has also [6] Stauffer C, Grimson W. E. L., “Adaptive Background
the capability to subtract out extraneous background noise Mixture Models for Real-Time Tracking”, Proceedings
(such as waving of leaves), much better than the more of conference on Computer Vision and Pattern
complex approximate median and mixture of Gaussians Recognition (Cat. No PR00149). IEEE Computer Society
methods. Vol. 2, pp. 246-252, June 1999.
For the tracking systems that are discussed, Kalman filter [7] A. Elgammal, D. Harwood and L. S. Davis, “Non-
tracking is one of the simplest and fastest tracking algorithms Parametric Model for Background Subtraction”, Proc.
that is used in this system. The advantage of Kalman filter- ECCV 2000, pp. 751-767, June 2000.
based techniques lies in their efficiency and in the high [8] M. Piccardi, “Background subtraction techniques: a
accuracy that can be obtained. It is predictive and adaptive as review”, IEEE International conference on Systems, man
it looks forward with an estimate of the covariance and mean and Cybernetics, pp. 3099-3104, 2004.
of the time series one step into the future, whereas in mean-
shift algorithm, the implementation in software takes a long [9] N. M. Oliver, B. Rosario and A. P. Pentland, “A
time which is about 15 fps. Bayesian Computer Vision System for Modeling Human
Interactions”, IEEE Trans. on Pattern Anal. and Machine
For the counting process, the two line counting process can be Intell., Col. 25, No. 11, pp. 1499-1504, 2003.
found more reliable compared to others. In this system, two [10] Tsong-Yi Chen, Chao-Ho Chen, Da-Jinn Wang and
virtual lines are drawn such that the distance from bottom Tsang-Jie Chen, “Real-Time Counting Method for a
edge to the IN LINE and from top edge to the OUT LINE is Crowd of Moving People”, Sixth International
greater than the bounding box of the person entering or Conferenceon Intelligent Information Hiding and
leaving the room. Using all these algorithms, a real time Multimedia Signal Processing, pp. 643-646, 2010.
people counting system can be designed based on their
accuracy, speed etc. [11] Raul Rojas, “The Kalman Filter”, available on
www.robocup.mi.fu-berlin.de/buch/kalman.pdf, pp. 1-7.
6. CONCLUSION [12] BerilSirmacek and Peter Reinartz, “KALMAN FILTER
In this paper, a review of the algorithms that are widely used BASED FEATURE ANALYSIS FOR TRACKING
in real-time people tracking and counting system have been PEOPLE FROMAIRBORNE IMAGES”, Proc. ISPRS
described. This can help many of researchers to select the XXXVIII.
appropriate algorithm in designing the system in real-time
field based on the advantages and limitations. We have also [13] D. Comaniciu, V.Ramesh and P.Meer, “Kernel Based
proposed a system for real time tracking and counting which Object Tracking”,IEEE Trans. Pattern Analysis and
may be useful to the researchers. Based on the proposed Machine Intelligence, Vol. 25, No. 5, 564-575, 2003.
system given above, it gives less computational time and also [14] D.Comaniciu and P.Meer, “Mean-shift Analysis and
tracking can be done effectively in real-time purpose. Applications”, The Proc. of the 7th IEEE International
Conference on Computer Vision, Vo. 2, pp. 1197-1203,
7. ACKNOWLEDGEMENT 1999.
This research is being carried out at Central Electronics [15] Tao Liu, Xiaping Cheng, “Improved Mean Shift
Engineering Research Institute (CEERI), Pilani, India as part Algorithm for Moving Object Tracking”, 2nd
of our project “Supra Institutional Project on Technology International Conference on Computer Engineering and
Development for smart systems‟. Authors would like to thank Technology(ICCET), Vol. 1, pp. 575-578, 2010.
Director, CEERI for his active encouragement and support
[16] Honglian Ma and Huchuan Lu Mingxiu Zhang, “A Real-
8. REFERENCES time Effective System for Tracking Passing People
[1] Xiao Benxian, Lu Cheng, Chen Hao, Yu Yanfeng and Using a Single Camera”, Proc. Of the 7th World Congress
Chen Rongbao, “Moving object detection and on Intelligent Control and Automation, June 25-27, 2008,
recognition based on the frame difference algorithm and Chongging, China, pp. 6173-6177.
moment invariant features”, 27th Chinese Control [17] A. J. Schofield, P. A. Mehta, T. J. Stonham, “A System
Conference (CCC), pp. 578-581, 2008. for Counting People in Video images using Neural
[2] C. Wren, A. Azarbayejani, T. Darrell, and A. P. Networks to identify the Background scene”, Journal of
Pentland, “Pfinder: Real-time Tracking of the Human Pattern Recognition, Vol. 29, Issue no. 8, pp. 1421-1428,
Body”, IEEE Trans. on Pattern Anal. And Machine 1996.
Intell., Vol. 19, No. 7, pp. 780-785, 1997. [18] C.H. Chen,Y.C. Chang, T.Y. Chen, D.J. Wang,“People
[3] D. Koller, J. Weber, T. Huang, J. Malik, G. Ogasawara, Counting System for Getting In/Out of a Bus Based on
B.Rao and S. Russell, “Towards Robust AutomaicTraffic Video Processing” IEEE Computer Society, Eighth
Scene Analysis in Real-Time”, Proc. ICPR’94, pp. 126- International Conference on Intelligent Systems Design
131, Nov. 1994. and Applications, pp. 565-569, 2008.
[4] B.P.L. Lo and S.A. Velastin, “Automatic Congestion [19] S. Hartono, T. Ji, T. Yap-Peng, “People Counting by
Detection System for Underground Platforms”, Proc. Video Segmentation and Tracking”, 9th international
ISIMP 2001, pp. 158-161, May 2001. Conference on Control, Automation, Robotics and
Vision, pp. 1-4, 2006.
[5] R. Cucchiara, C. Grana, M. Piccardi and A. Prati,
“Detecting Moving Objects, Ghosts and Shadows in [20] Tsong-Yi Chen, Chao-Ho Chen, Da-Jinn Wang and
Video Streams”, IEEE Trans. On Pattern Anal. and Tsang-Jie Chen, “Real-Time Counting Method for a
Machine Intell., Vol. 25, No. 10, pp. 1337-1442, 2003. Crowd of Moving People”, Sixth International
5
International Journal of Computer Applications (0975 – 8887)
Volume 46– No.5, May 2012
Conference on Intelligent Information Hiding and [22] Javier Barandiaran, Berta Murguia and Fernando Boto,
Multimedia Signal Processing, pp. 643-646, 2010. “Real-Time People Counting Using Multiple Lines”,
IEEE Ninth International Workshop on Image Analysis
[21] J. W. Kim, K. S. Choi ,B. D. Choi, S. J.Ko, “Real-time for Multimedia Interactive Services, pp. 159-162, 2008.
Vision-based people counting system for security door”,
International Technical Conference on Circuits/Systems
Computers and Communications, pp. 1416-1419, 2002.