Abstract
This paper addresses the problem of self-calibration and motion recovery from a single snapshot obtained under a setting of two mirrors. The mirrors are able to show five views of an object in one image. In this paper, the epipoles of the real and virtual cameras are firstly estimated from the intersection of the bitangent lines between corresponding images, from which we can easily derive the horizon of the camera plane. The imaged circular points and the angle between the mirrors can then be obtained from equal angles between the bitangent lines, by planar rectification. The silhouettes produced by reflections can be treated as a special circular motion sequence. With this observation, technique developed for calibrating a circular motion sequence can be exploited to simplify the calibration of a single-view two-mirror system. Different from the state-of-the-art approaches, only one snapshot is required in this work for self-calibrating a natural camera and recovering the poses of the two mirrors. This is more flexible than previous approaches which require at least two images. When more than a single image is available, each image can be calibrated independently and the problem of varying focal length does not complicate the calibration problem. After the calibration, the visual hull of the objects can be obtained from the silhouettes. Experimental results show the feasibility and the preciseness of the proposed approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Fitzgibbon, A.W., Cross, G., Zisserman, A.: Automatic 3D Model Construction for Turn-Table Sequences. In: Koch, R., Van Gool, L. (eds.) SMILE 1998. LNCS, vol. 1506, pp. 155–170. Springer, Heidelberg (1998)
Forbes, K., Nicolls, F., de Jager, G., Voigt, A.: Shape-from-silhouette with two mirrors and an uncalibrated camera. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3952, pp. 165–178. Springer, Heidelberg (2006)
Forbes, K., Voigt, A., Bodika, N.: Visual hulls from single uncalibrated snapshots using two plannar mirrors. In: Proc. 15th South African Workshop on Pattern Recognition (2004)
Francois, A.R.J., Medioni, G.G., Waupotitsch, R.: Reconstructing mirror symmetric scenes from a single view using 2-view stereo geometry. In: International Conference on Pattern Recognition, vol. 4, pp. 12–16 (2002)
Fujiyama, S., Sakaue, F., Sato, J.: Multiple view geometries for mirrors and cameras. In: International Conference on Pattern Recognition, pp. 45–48 (August 2010)
Gentle, J.E.: Numerical Linear Algebra for Applications in Statistics. Springer (1998)
Gluckman, J.M., Nayar, S.K.: Planar catadioptric stereo: Geometry and calibration. In: Proc. Conf. Computer Vision and Pattern Recognition.
Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2000)
Hernndez, C., Schmitt, F., Cipolla, R.: Silhouette coherence for camera calibration under circular motion. IEEE Trans. on Pattern Analysis and Machine Intelligence 29(2), 343–349 (2007)
Hu, B., Brown, C.M., Nelson, R.C.: Multiple-view 3-d reconstruction using a mirror. Technical Report TR863 (May 2005)
Huang, P.H., Lai, S.H.: Contour-based structure from reflection. In: Proc. Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 379–386 (June 2006)
Jiang, G., Tsui, H.T., Quan, L., Zisserman, A.: Geometry of single axis motions using conic fitting. IEEE Trans. on Pattern Analysis and Machine Intelligence 25(10), 1343–1348 (2003)
Liebowitz, D., Zisserman, A.: Metric rectification from perspective images of planes. In: Proc. Conf. Computer Vision and Pattern Recognition, pp. 482–488 (1998)
Mariottini, G.L., Scheggi, S., Morbidi, F., Prattichizzo, D.: Catadioptric stereo with planar mirrors: multiple-view geometry and camera localization. In: Visual Servoing via Advanced Numerical Methods, pp. 3–21 (2010)
Mendonça, P.R.S., Wong, K.-Y.K., Cipolla, R.: Camera Pose Estimation and Reconstruction from Image Profiles under Circular Motion. In: Vernon, D. (ed.) ECCV 2000. LNCS, vol. 1843, pp. 864–877. Springer, Heidelberg (2000)
Mendonça, P.R.S., Wong, K.-Y.K., Cipolla, R.: Epipolar geometry from profiles under circular motion. IEEE Trans. on Pattern Analysis and Machine Intelligence 23(6), 604–616 (2001)
Niem, W.: Robust and fast modelling of 3d natural objects from multiple views. In: SPIE Proceedings - Image and Video Processing II, vol. 2182, pp. 388–397 (1994)
Rurainsky, J., Eisert, P.: Mirror-based multi-view analysis of facial motions. In: Prof. of International Conference on Image Processing, vol. 3, pp. 73–76 (2007)
Smith, B.M., Stork, D.G., Zhang, L.: Three-dimensional reconstruction from multiple reflected views within a realist painting: An application to scott frasers three way vanitas. In: The 21st Annual IST/SPIE Symposium on Electronic Imaging, vol. 7239 (January 2009)
Zhang, H., Wong, K.-Y.K.: Self-calibration of turntable sequences from silhouettes. IEEE Trans. on Pattern Analysis and Machine Intelligence 31(1), 5–14 (2009)
Zhang, H., Wong, K.-Y.K., Zhang, G., Liang, C., Zhang, G.: 1d camera geometry and its application to the self-calibration of circular motion sequences. IEEE Trans. on Pattern Analysis and Machine Intelligence 30(12), 2243–2248 (2008)
Zhang, H., Zhang, G., Wong, K.-Y.K.: Auto-calibration and motion recovery from silhouettes for turntable sequences. In: Proc. British Machine Vision Conference, Oxford, UK, vol. I, pp. 79–88 (September 2005)
Zhang, Z.Y.: A flexible new technique for camera calibration. IEEE Trans. on Pattern Analysis and Machine Intelligence 22(11), 1330–1334 (2000)
Zhang, Z.Y., Tsui, H.T.: 3d reconstruction from a single view of an object and its image in a plane mirror. In: International Conference on Pattern Recognition, vol. II, pp. 1174–1176 (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhang, H., Shao, L., Wong, KY.K. (2013). Self-calibration and Motion Recovery from Silhouettes with Two Mirrors. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds) Computer Vision – ACCV 2012. ACCV 2012. Lecture Notes in Computer Science, vol 7727. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37447-0_1
Download citation
DOI: https://doi.org/10.1007/978-3-642-37447-0_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-37446-3
Online ISBN: 978-3-642-37447-0
eBook Packages: Computer ScienceComputer Science (R0)