Abstract
In this paper we confront the problem of uncalibrated view synthesis, i.e. rendering novel images from two, or more images without any knowledge on camera parameters. The method builds on the computation of planar parallax and focuses on the application of converting a monocular image sequence to a 3D stereo video, a problem that requires the positioning of the virtual camera outside the actual motion trajectory. The paper addresses both geometric and practical issues related to the rendering. We validate our method by showing both quantitative and qualitative results.
Chapter PDF
Similar content being viewed by others
References
Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., Süsstrunk, S.: SLIC Superpixels Compared to State-of-the-art Superpixel Methods. IEEE Trans. on Patt. Analysis and Machine Intell. 34(11), 2274–2282 (2012)
Avidan, S., Shashua, A.: Novel view synthesis by cascading trilinear tensors. IEEE Trans Vis. and Comp. Graph. 4(4), 293–306 (1998)
Cheng, C.C., Li, C.T., Huang, P.S., Lin, T.K., Tsai, Y.M., Chen, L.G.: A block-based 2D-to-3D conversion system with bilateral filter. In: Int. Conf. on Consumer Electronics, pp. 1–2 (2009)
Choi, B.T., Lee, S.H., Ko, S.J.: New frame rate up-conversion using bi-directional motion estimation. IEEE Trans. on Consumer Electronics 46(3), 603–609 (2000)
Criminisi, A., Pérez, P., Toyama, K.: Region filling and object removal by exemplar-based image inpainting. IEEE Trans. on Image Proc. 13(9), 1200–1212 (2004)
Fragneto, P., Fusiello, A., Magri, L., Rossi, B., Ruffini, M.: Uncalibrated view synthesis with homography interpolation. In: 2\(^{nd}\) Joint 3DIM/3DPVT Conf., pp. 270–277 (2012)
Fusiello, A.: Specifying virtual cameras in uncalibrated view synthesis. IEEE Trans. on Circuits and Systems for Video Technology 17(5), 604–611 (2007)
Fusiello, A., Irsara, L.: An uncalibrated view-synthesis pipeline. In: Proc. Int. Conf. on Image Analysis and Proc., pp. 609–614 (2007)
Fusiello, A., Irsara, L.: Quasi-euclidean epipolar rectification of uncalibrated images. Machine Vis. and Appl. 22(4), 663–670 (2011)
Gigengack, F., Jiang, X.: Improved uncalibrated view synthesis by extended positioning of virtual cameras and image quality optimization. In: Zha, H., Taniguchi, R., Maybank, S. (eds.) ACCV 2009, Part II. LNCS, vol. 5995, pp. 438–447. Springer, Heidelberg (2010)
Hampel, F.R., Ronchetti, E.M., Rousseeuw, P.J., Stahel, W.A.: Robust statistics: the approach based on influence functions, vol. 114. John Wiley & Sons (2011)
Hirschmuller, H., Scharstein, D.: Evaluation of cost functions for stereo matching. In: IEEE Conf. on Comp. Vis. and Patt. Rec., pp. 1–8 (2007)
Irani, M., Anandan, P.: Parallax geometry of pairs of points for 3d scene analysis. In: Buxton, B.F., Cipolla, R. (eds.) ECCV 1996. LNCS, vol. 1064, pp. 17–30. Springer, Heidelberg (1996)
Jung, Y.J., Baik, A., Kim, J., Park, D.: A novel 2D-to-3D conversion technique based on relative height-depth cue. In: IS&T/SPIE Electronic Imaging, pp. 72371U–72371U (2009)
Kolmogorov, V., Monasse, P., Tan, P.: Kolmogorov and Zabihs Graph Cuts Stereo Matching Algorithm. Image Processing on Line 4, 220–251 (2014)
Laveau, S., Faugeras, O.: 3-d scene representation as a collection of images and foundamental matrices. In: Proc. Int. Conf. Patt. Rec., 1, pp. 689–691 (1994)
Lee, S.H., Kwon, O., Park, R.H.: Weighted-adaptive motion-compensated frame rate up-conversion. IEEE Trans. on Consumer Electronics 49(3), 485–492 (2003)
Malapelle, F., Fusiello, A., Rossi, B., Piccinelli, E., Fragneto, P.: Uncalibrated dynamic stereo using parallax. In: Proc. Int. Symp. on Image and Signal Proc. and Analysis (2013)
Perona, P., Malik, J.: Scale-space and edge detection using anisotropic diffusion. IEEE Trans. on Patt. Analysis and Machine Intell. 12(7), 629–639 (1990)
Ramachandran, G., Rupp, M.: Multiview synthesis from stereo views. In: Int. Workshop on Systems, Signals and Image Proc., pp. 341–345 (2012)
Sawhney, H.S.: 3D geometry from planar parallax. In: IEEE Conf. on Comp. Vis. and Patt. Rec., pp. 929–934 (1994)
Shashua, A., Navab, N.: Relative affine structure: Canonical model for 3D from 2D geometry and applications. IEEE Trans. on Patt. Analysis and Machine Intell. 18(9), 873–883 (1996)
Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. on Image Proc. 13(4), 600–612 (2004)
Zhang, G., Hua, W., Qin, X., Wong, T.T., Bao, H.: Stereoscopic video synthesis from a monocular video. IEEE Trans. on Vis. and Comp. Graph. 13(4), 686–696 (2007)
Zhang, G., Jia, J., Wong, T.T., Bao, H.: Consistent depth maps recovery from a video sequence. IEEE Trans. on Patt. Analysis and Machine Intell. 31(6), 974–988 (2009)
Zhang, L., Vázquez, C., Knorr, S.: 3D-TV content creation: automatic 2D-to-3D video conversion. IEEE Trans. on Broadcasting 57(2), 372–383 (2011)
Zhu, C., Zhao, Y., Yu, L., Tanimoto, M.: 3D-TV System with Depth-image-based Rendering. Springer (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Malapelle, F., Fusiello, A., Rossi, B., Fragneto, P. (2015). Novel View-Synthesis from Multiple Sources for Conversion to 3DS. In: Murino, V., Puppo, E. (eds) Image Analysis and Processing — ICIAP 2015. ICIAP 2015. Lecture Notes in Computer Science(), vol 9279. Springer, Cham. https://doi.org/10.1007/978-3-319-23231-7_41
Download citation
DOI: https://doi.org/10.1007/978-3-319-23231-7_41
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-23230-0
Online ISBN: 978-3-319-23231-7
eBook Packages: Computer ScienceComputer Science (R0)
