Abstract
In this paper, we describe how geometrically correct and visually realistic shadows may be computed for objects composited into a single view of a target scene. Compared to traditional single view compositing methods, which either do not deal with the shadow effects or manually create the shadows for the composited objects, our approach efficiently utilizes the geometric and photometric constraints extracted from a single target image to synthesize the shadows consistent with the overall target scene for the inserted objects. In particular, we explore (i) the constraints provided by imaged scene structure, e.g. vanishing points of orthogonal directions, for camera calibration and thus explicit determination of the locations of the camera and the light source; (ii) the relatively weaker geometric constraint, the planar homology, that models the imaged shadow relations when explicit camera calibration is not possible; and (iii) the photometric constraints that are required to match the color characteristics of the synthesized shadows with those of the original scene. For each constraint, we demonstrate the working examples followed by our observations. To show the accuracy and the applications of the proposed method, we present the results for a variety of target scenes, including footage from commercial Hollywood movies and 3D video games.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Agarwala, A., A., Salesin, D.H., Seitz, S.M.: Keyframe-based tracking for rotoscoping and animation. ACM Trans. Graph. 23(3), 584–591 (2004)
Apostoloff, N.E., Fitzgibbon, A.: Bayesian video matting using learnt image priors. In: Proc. IEEE CVPR, pp. 407–414 (2004)
Barrow, H., Tenenbaum, J.: Recovering intrinsic scene character-istics from images. Academic Press (1978)
Cao, X., Shah, M.: Camera calibration and light source estimation from images with shadows. In: Proc. IEEE CVPR, pp. 918–923 (2005)
Caprile, B., Torre, V.: Using vanishing points for camera calibra-tion. Int. J. Comput. Vision 4(2), 127–140 (1990)
Chen, Q., Wu, H., Wada, T.: Camera calibration with two arbitrary coplanar circles. In: Proc. ECCV, pp. 521–532 (2004)
Chuang, Y.: New models and methods for matting and compositing. Ph.D. thesis, University of Washington (2004)
Crow, F.C.: Shadow algorithms for computer graphics. In: Proc. of SIGGRAPH, pp. 242–248 (1977)
Finlayson, G., Drew, M., Lu, C.: Intrinsic images by entropy minimization. In: Proc. ECCV, pp. 582–595 (2004)
Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press (2004)
Hasenfratz, J., Lapierre, M., Holzschuch, N., Sillion, F.: A survey of real-time soft shadows algorithms. Computer Graphics Forum 22(4), 753–774 (2003)
Kersten, D., Mamassian, P., Knill, D.C.: Moving cast shadows induce apparent motion in depth. Perception 26(2), 171–192 (1997)
Li, Y., Lin, S., Lu, H., Shum, H.: Multiple-cue illumination estimation in textured scenes. In: Proc. IEEE ICCV, pp. 1366–1373 (2003)
Li, Y., Sun, J., Tang, C.K., Shum, H.Y.: Lazy snapping. ACM Trans. Graph. 23(3), 303–308 (2004)
Liebowitz, D., Zisserman, A.: Combining scene and auto-calibration constraints. In: Proc. IEEE ICCV, pp. 293–300 (1999)
Nadimi, S., Bhanu, B.: Physical models for moving shadow and object detection in video. IEEE Trans. Pattern Anal. Mach. Intell. 26(8), 1079–1087 (2004)
Petrovic, L., Fujito, B., Williams, L., Finkelstein, A.: Shadows for cel animation. In: Proc. ACM SIGGRAPH, pp. 511–516 (2000)
Rother, C., Kolmogorov, V., Blake, A.: grabcut : interactive fore-ground extraction using iterated graph cuts. ACM Trans. Graph. 23(3), 309–314 (2004)
Sato, I., Sato, Y., Ikeuchi, K.: Stability issues in recovering illumination distribution from brightness in shadows. In: Proc. IEEE CVPR, pp. 400–407 (2001)
Smith, A.R., Blinn, J.F.: Blue screen matting. In: Proc. ACMSIG-GRAPH, pp. 259–268 (1996)
Springer, C.E.: Geometry and Analysis of Projective Spaces. Free-man (1964) 23. Tappen, M.F., Freeman, W.T., Adelson, E.H.: Recovering intrinsic images from a single image. In: Advances in Neural Information Processing Systems (2002)
Sun, J., Jia, J., Tang, C., Shum, H.: Poisson matting. ACM Trans. Graph. 23(3), 315–321 (2004)
Tappen, M.F., Freeman, W.T., Adelson, E.H.: Recovering intrinsic images from a single image. In: Advances in Neural Information Processing Systems (2002)
Weiss, Y.: Deriving intrinsic images from image sequences. In: Proc. IEEE ICCV, pp. 68–75 (2001)
Wright, S.: Digital Compositing for Film and Video. Focal Press (2001)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Cao, X., Shen, Y., Shah, M. et al. Single view compositing with shadows. Visual Comput 21, 639–648 (2005). https://doi.org/10.1007/s00371-005-0335-x
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-005-0335-x