Abstract
Due to their fast response capability, low cost and without danger to personnel safety since there is no human pilot on-board, unmanned aerial vehicles (UAVs) with vision-based systems have great potential for monitoring and detecting forest fires. This paper proposes a novel forest fire detection method using both color and motion features for processing images captured from the camera mounted on a UAV which is moving during the whole mission period. First, a color-based fire detection algorithm with light computational demand is designed to extract fire-colored pixels as fire candidate regions by making use of chromatic feature of fire and obtaining fire candidate regions for further analysis. As the pose variations and low-frequency vibrations of UAV cause all objects and background in the images are moving, it is challenging to identify fires defending on a single motion based method. Two types of optical flow algorithms, a classical optical flow algorithm and an optimal mass transport optical flow algorithm, are then combined to compute motion vectors of the fire candidate regions. Fires are thereby expected to be distinguished from other fire analogues based on their motion features. Several groups of experiments are conducted to validate that the proposed method can effectively extract and track fire pixels in aerial video sequences. The good performance is anticipated to significantly improve the accuracy of forest fire detection and reduce false alarm rates without increasing much computation efforts.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Yuan, C., Zhang, Y. M., Liu, Z. X.: A survey on technologies for automatic forest fire monitoring, detection and fighting using UAVs and remote sensing techniques. Can. J. Forest Res. 45(7), 783–792 (2015)
Kolarić, D., Skala, K., Dubravić, A.: Integrated system for forest fire early detection and management. Period. Biol. 110(2), 205–211 (2008)
Martinez-de Dios, J. R., Arrue, B. C., Ollero, A., Merino, L., Gómez-Rodríguez, F.: Computer vision techniques for forest fire perception. Image Vision Comput. 26(4), 550–562 (2008)
Gonzalez, J. R., Palahi, M., Trasobares, A., Pukkala, T.: A fire probability model for forest stands in Catalonia (North-East Spain). Ann. For. Sci. 63(2), 169–176 (2006)
Lin, H., Liu, Z., Zhao, T., Zhang, Y.: Early warning system of forest fire detection based on video technology. In: International Symposium on Linear Drives for Industry Applications, pp 751–758 (2014)
Everaerts, J.: The use of unmanned aerial vehicles (UAVs) for remote sensing and mapping. Int. Arch. Photogramm. 37, 1187–1192 (2008)
Berni, J. A., Zarco-Tejada, P. J., Suárez, L., Fereres, E.: Thermal and narrowband multispectral remote sensing for vegetation monitoring from an unmanned aerial vehicle. IEEE Trans. Geosci. Remote Sens. 47(3), 722–738 (2009)
Yuan, C., Liu, Z. X., Zhang, Y. M.: UAVS-based forest fire detection and tracking using image processing techniques. In: International Conference on Unmanned Aircraft Systems, pp 639–643 (2015)
Yuan, C., Liu, Z. X., Zhang, Y. M.: Vision-based forest fire detection in aerial images for firefighting using UAVs. In: International Conference on Unmanned Aircraft Systems, pp 1200–1205 (2016)
Sharifi, F., Zhang, Y. M., Aghdam, A. G.: A distributed deployment strategy for multi-agent systems subject to health degradation and communication delays. J. Intell. Rob. Syst. 73(1–4), 623–633 (2014)
Merino, L., Caballero, F., Martínez-de-Dios, J.R., Maza, I., Ollero, A.: An unmanned aircraft system for automatic forest fire monitoring and measurement. J. Intell. Robot. Syst. 65(1-4), 533–548 (2012)
Liu, Z. X., Yuan, C., Zhang, Y. M., Luo, J.: A learning-based fault tolerant tracking control of an unmanned quadrotor helicopter. J. Intell. Robot. Syst., 1–18 (2015)
Liu, Z. X., Yu, X., Yuan, C., Zhang, Y. M.: Leader-follower formation control of unmanned aerial vehicles with fault tolerant and collision avoidance capabilities. In: International Conference on Unmanned Aircraft Systems, pp 1025–1030 (2015)
Ollero, A., Arrue, B. C., Martínez-de-Dios, J.R., Murillo, J.J.: Techniques for reducing false alarms in infrared forest-fire automatic detection systems. Control Eng. Practice. 7(1), 123–131 (1999)
Ferruz, J., Ollero, A.: Real-time feature matching in image sequences for nonstructured environments: applications to vehicle guidance. J. Intell. Robot. Syst. 28(1–2), 85–123 (2000)
Merino, L., Caballero, F., Martínez-de-Dios, J.R., Ferruz, J., Ollero, A.: A cooperative perception system for multiple UAVs: Application to automatic detection of forest fires. J. Field Robot. 23(3-4), 165–184 (2006)
Maza, I., Caballero, F., Capitán, J., Martínez-de-Dios, J.R., Ollero, A.: Experimental results in multi-UAV coordination for disaster management and civil security applications. J. Intell. Robot. Syst. 61(1-4), 563–585 (2010)
Ambrosia, V. G., Wegener, S., Zajkowski, T., Sullivan, D. V., Buechel, S., Enomoto, F., Lobitz, B., Johan, S., Brass, J., Hinkley, E.: The Ikhana unmanned airborne system (UAS) western states fire imaging missions: from concept to reality (2006–2010). Geocarto Int. 26(2), 85–101 (2011)
Martínez-de-Dios, J.R., Merino, L., Caballero, F., Ollero, A.: Automatic forest-fire measuring using ground stations and unmanned aerial systems. Sensors 11(6), 6328–6353 (2011)
Bradley, J. M., Taylor, C. N.: Georeferenced mosaics for tracking fires using unmanned miniature air vehicles. J. Aerosp. Comput. Inf. Commun. 8(10), 295–309 (2011)
Celik, T., Ozkaramanl, H., Demirel, H.: Fire pixel classification using fuzzy logic and statistical color model. In: IEEE International Conference on Acoustic Speech Signal Processing, vol. 1, pp 1205–1208 (2007)
Chen, T., Wu, P., Chiou, Y.: An early fire-detection method based on image processing. In: IEEE International Conference on Image Processing, pp 1707–1710 (2004)
Toreyin, B. U., Dedeoglu, Y., Cetin, A. E.: Flame detection in video using hidden Markov models. In: IEEE International Conference on Image Processing, vol. 2, pp 1230–1233 (2005)
Celik, T., Demirel, H., Ozkaramanli, H., Uyguroglu, M.: Fire detection using statistical color model in video sequences. J. Visual Commun. Image Represent. 18(2), 176–185 (2007)
Celik, T., Demirel, H.: Fire detection in video sequences using a generic color model. Fire Saf. J. 44(2), 147–158 (2009)
Gunay, O., Tasdemir, K., Toreyin, B. U., Cetin, A. E.: Video based wildfire detection at night. Fire Saf. J. 44(6), 860–868 (2009)
Gunay, O., Toreyin, B. U., Kose, K., Cetin, A. E.: Entropy-functional-based online adaptive decision fusion framework with application to wildfire detection in video. IEEE Trans. Image Process. 21 (5), 2853–2865 (2012)
Phillips, W., Shah, M., Lobo, N. V.: Flame recognition in video. In: IEEE Workshop on Applications of Computer Vision, pp 224–229 (2000)
Ko, B. C., Cheong, K. H., Nam, J. Y.: Fire detection based on vision sensor and support vector machines. Fire Saf. J. 44(3), 322–329 (2009)
Rodríguez-Canosa, G. R., Thomas, S., del Cerro, J., Barrientos, A., MacDonald, B.: A real-time method to detect and track moving objects (DATMO) from unmanned aerial vehicles (UAVs) using a single camera. Remote Sens. 4(4), 1090–1111 (2012)
Miller, A., Babenko, P., Hu, M., Shah, M.: Person Tracking in UAV Video. Lecture Notes in Computer Science. Springer, Berlin/Heidelberg (2008)
Huang, C. H., Wu, Y. T., Kao, J. H., Shih, M. Y., Chou, C. C.: A hybrid moving object detection method for aerial images. In: Pacific-Rim Conference on Multimedia, pp 357–368 (2010)
Suganuma, N., Kubo, T.: Fast dynamic object extraction using stereovision based on occupancy grid maps and optical flow. In: IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), pp 978–983 (2011)
Mueller, M., Karasev, P., Kolesov, I., Tannenbaum, A.: Optical flow estimation for flame detection in videos. IEEE Trans. Image Process. 22(7), 2786–2797 (2013)
Horn, B. K., Schunck, B. G.: Determining optical flow. Artif. Intell. 17(1-3), 185–203 (1981)
Cetin, A. E., Dimitropoulos, K., Gouverneur, B., Grammalidisb, N., Gunaya, O., Habiboglua, Y. H., Töreyind, B. U., Verstockte, S.: Video fire detection–review. Digital Signal Process. 23(6), 827–1843 (2013)
Stevens, B. L., Lewis, F. L.: Aircraft Control and Simulation. Wiley (2003)
Katić, D., Vukobratović, M.: Survey of intelligent control techniques for humanoid robots. J. Intell. Robot. Syst. 37(2), 117–141 (2003)
Amit, Y.: 2D Object Detection and Recognition: Models, Algorithms, and Networks. MIT Press, Chicago: Cambridge, Mass (2002)
Utkin, V. I.: Sliding Modes in Control and Optimization. Springer Science & Business Media (2013)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yuan, C., Liu, Z. & Zhang, Y. Aerial Images-Based Forest Fire Detection for Firefighting Using Optical Remote Sensing Techniques and Unmanned Aerial Vehicles. J Intell Robot Syst 88, 635–654 (2017). https://doi.org/10.1007/s10846-016-0464-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10846-016-0464-7