Abstract
For intelligent video surveillance, the adaptive tracking of multiple moving objects is still an open issue. In this paper, a new multi-object tracking method based on video frames is proposed. A type of particle filtering combined with the SIFT (Scale Invariant Feature Transform) is proposed for motion tracking, where SIFT key points are treated as parts of particles to improve the sample distribution. Then, a queue chain method is adopted to record data associations among different objects, which could improve the detection accuracy and reduce the computational complexity. By actual road tests and comparisons, the system tracks multi-objects with better performance, e.g., real time implementation and robust against mutual occlusions, indicating that it is effective for intelligent video surveillance systems.















Similar content being viewed by others
Explore related subjects
Discover the latest articles and news from researchers in related subjects, suggested using machine learning.Notes
All sequences can be download form http://www.umiacs.umd.edu/~knkim/UMD-BGS/index.html#Download
All sequences can be download form http://www.cvg.cs.rdg.ac.uk/cgi-bin/PETSMETRICS/page.cgi?dataset.
All sequences can be download form http://i2lwww.ira.uka.de/image_sequences
References
Arulampalam S, Maskell S, Gordon N, Clapp T (2002) A tutorial on particle filters for on-line nonlinear/nongaussian bayesian tracking. IEEE Trans Signal Process 50(2):174–188
Ba HX, Zhao ZG, Yang F, Cao L (2004) JPDA in multisensor multitarget tracking. J Syst Simul 16(7):1563–1566
Babu RV, Perez P, Bouthemy P (2007) Robust tracking with motion estimation and local kernel-based color modeling. Image Vis Comput 25(8):1205–1216
Belcher C, Du Y (2009) Region-based SIFT approach to iris recognition. Opt Lasers Eng 47(1):139–147
Betke M, Haritaoglu E, Davis LS (2000) Real-time multiple object detection and tracking from a moving object. Machine Vision and Applications 2(2):69–83
Breitenstein MD, Reichlin F, Leibe B, Koller-Meier E, Gool LV (2009) Robust tracking-by-detection using a detector confidence particle filter. In: Proceedings of IEEE International Conference on Computer Vision, Kyoto, Japan, 1515–1522
Cai YZ, Freitas N, Little J (2006) Robust visual tracking for multiple targets. In: Proc. the 9th European Conference on Computer Vision (ECCV), Graz, Austria, vol.4, pp. 107–118
Comaniciu D, Meer P (2002) Mean Shift: a robust approach toward feature space analysis. IEEE Trans Pattern Anal Mach Intell 24(5):603–619
Comaniciu D, Ramesh V (2000) Mean shift and optimal prediction for efficient object tracking. In: Proc. IEEE inter-national conference on image processing, Vancouver, Canada, vol.3, pp.70–73
Comaniciu D, Ramesh V, Meer P (2003) Kernel-based object tracking. IEEE Trans Pattern Anal Mach Intell 25(5):564–577
Cox IJ, Hingorani SL (1996) An efficient implementation of reid’s multiple hypothesis tracking algorithm and its evaluation for the purpose of visual tracking. IEEE Trans Pattern Anal Mach Intell 18(2):138–150
Dahlkamp H, Nagel H-H, Ottlik A, Reuter P (2007) A framework for model-based tracking experiments in image sequences. Int J Comput Vision 73(2):139–157
Fazli S, Pour HM, Bouzari H (2009) “Particle Filter Based Object Tracking with Sift and Color Feature,” Second International Conference on Machine Vision, pp. 89–93
Gao T, Liu ZH, Zhang J (2009) Feature particles tracking for the moving object. Studies in computational intelligence: opportunities and challenges for next-generation applied intelligence, vol.214, pp. 39–44
Gao T, Liu ZG, Zhang J (2009) Redundant discrete wavelet transforms based moving object recognition and tracking. J Syst Eng Electron 20(5):1115–1123
Gao T, Liu ZH, Yue SH, Zhang J, Mei JQ, Gao WC (2010) Robust background subtraction in traffic video sequence. J Cent S Univ Technol 17(1):187–195
Guan YP, Gu WK (2006) Automatic and robust shadow segmentation from two-dimensional scenes. Acta Electronica Sin 34(4):624–627
Gupte S, Masoud O, Martin RFK, Papanikolopoulos NP (2002) IEEE Transactions on Intelligent Transportation Systems 3(1):37–47
Hue C, Le Cadre J-P, Perez P (2002) Tracking multiple objects with particle filtering. IEEE Trans Aerosp Electron Syst 38(3):791–812
Jin YG, Mokhtarian F (2007) Variational particle filter for multi-object tracking. In: Proc. IEEE 11th International Conference on Computer Vision (ICCV), Rio de Janeiro, Brazil, pp.1–8
Kilger M (1992) A shadow handler in a video-based real-time traffic monitoring system. In: Proceedings of IEEE workshop on applications of computer vision, Palm Springs, California, USA, pp.11–18
Lee DS (2005) Effective Gaussian mixture learning for video background subtraction. IEEE Trans Pattern Anal Mach Intell 27(5):827–832
Lei BJ, Xu LQ (2006) Real-time out-door video surveillance with robust foreground extraction and object tracking via multi-state transition management. Pattern Recognit Lett 27(15):1816–1825
Lin MX, Xu XH (2006) Multiple object visual tracking from a moving object. In: Proc. the sixth international conference on intelligent systems design and applications, Jinan, China, vol.2, pp. 373–378
Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vision 60(2):91–110
Niu CF, Liu YS (2008) Improved mean-shift object tracking method. Opto Electron Eng 35(3):26–29
Okuma K, Taleghani A, Freitas N, Little J, Lowe D (2004) A boosted particle filter: multitarget detection and tracking. In: Proc. the 8th European conference on computer vision (ECCV), Prague, Czech Republic, vol.1, pp. 28–39
Ottlik A, Nagel H-H (2008) Initialization of model-based vehicle tracking in video sequences. Int J Comput Vision 80(2):211–225
Pinkiewicz T, Williams R, Purser J (2008) Application of the particle filter to tracking of fish in aquaculture research. In: Proc. Digital Image Computing: Techniques and Applications (DICTA), Canberra, pp. 457–464.
Reckleitis I (2003) A particle filter tutorial for mobile robot localization. In: Proc. the international conference on robotics and automation, vol. 42, pp.1–36
Ross D, Lim J, Yang MH (2004) Adaptive probabilistic visual tracking with incremental subspace update. In: Proc. the 8th European Conference on Computer Vision (ECCV), Prague, Czech Republic, vol.2, pp.470–482
Ross DA, Lim J, Lin RS, Yang MH (2008) Incremental learning for robust visual tracking. Int J Comput Vision 77(1–3):125–141
Rowe D, Reid I, Gonzàlez J, Villanueva JJ (2006) Unconstrained multiple-people tracking. In: Proc. the 28th DAGM symposium, Berlin, Germany, pp 505–514
M. Shehata, M. Pervez, T. Burr, J. Cai, W. Badawy, A. Radmanesh (2006) On eliminating static shadow false alarms in automatic incident detection systems. In: Proceedings of the IEEE Intelligent Transportation Systems Conference, Toronto, 2006, pp.759–764.
Sidenbladh H (2003) Multi-target particle filtering for the probability hypothesis density. In: Proc. The sixth international conference on information fusion, pp.1110–1117
Song X, Wang LP, Wang P, Shen ZK (2007) IR target tracking based on improved mean shift method. J Infrared Millimeter Waves 26(6):429–432
Stauer C, Grimson W (2000) Learning patterns of activity using real-time tracking. IEEE Trans Pattern Anal Mach Intell 22(8):747–757
Stauffer C, Grimson WEL (1999). Adaptive background mixture models for real time tracking. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Colorado, USA, no.2, pp. 246–252.
Sun ZH, Zhu SA (2008) Real-time segmentation and tracking technique of multiple moving objects in video sequence. J Zhejiang Univ Eng Sci 42(9):1631–1635
Wang FS, Zhao QJ (2008) A new particle filter for nonlinear filtering problems. Chin J Comput 31(2):346–352
Wu P, Kong LF, Zhao F, Li X (2008). Particle filter tracking based on color and SIFT features. In: Proceedings of international conference on audio, language and image processing, pp. 932–937
Yang J, Zhao ZM (2007) Shadow processing method based on normalized RGB color model. Opto Electron Eng 34(12):92–96
Yang CL, Yu YL, Liu GS (2000) Data association algorithm in multi-target tracking. J Syst Eng Electron 22(3):11–15
Author information
Authors and Affiliations
Corresponding author
Additional information
This work is supported by the National Science Foundation of China under Grant No. 70773008, Program for New Century Excellent Talents in University under Grant No. NCET-10-0048, Fok Ying Tung Education Foundation under Grant No. 121079, and the Science Foundations of Tianjin under Grant No. 10ZCKFSF01100.
Rights and permissions
About this article
Cite this article
Gao, T., Li, G., Lian, S. et al. Tracking video objects with feature points based particle filtering. Multimed Tools Appl 58, 1–21 (2012). https://doi.org/10.1007/s11042-010-0676-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-010-0676-y