Abstract
This paper presents an optimization framework for estimating the motion and underlying physical parameters of a rigid body in free flight from video. The algorithm takes a video clip of a tumbling rigid body of known shape and generates a physical simulation of the object observed in the video clip. This solution is found by optimizing the simulation parameters to best match the motion observed in the video sequence. These simulation parameters include initial positions and velocities, environment parameters like gravity direction and parameters of the camera. A global objective function computes the sum squared difference between the silhouette of the object in simulation and the silhouette obtained from video at each frame. Applications include creating interesting rigid body animations, tracking complex rigid body motions in video and estimating camera parameters from video.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
D. Baraff. Fast contact force computation for nonpenetrating rigid bodies. In Computer Graphics, Proceedings of SIGGRAPH 94, pages 23–34, 1994.
K.S. Bhat, M. Saptharishi, and P.K. Khosla. Motion detection and segmentation using image mosaics. IEEE International Conference on Multimedia and Expo., 2000.
B.E. Bishop and M.W. Spong. Vision-based control of an air hockey playing robot. IEEE Control Systems, pages 23–32, June 1999.
C. Bregler. Learning and recognizing human dynamics in video sequences. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pages 8–15, June 1997.
S. Chandrashekhar and R. Chellappa. Passive navigation in a partially known environment. Proc. IEEE Workshop on Visual Motion, pages 2–7, 1991.
S. Chenney and D.A. Forsyth. Sampling plausible solutions to multi-body constraint problems. In Computer Graphics, Proceedings of SIGGRAPH 00, pages 219–228, 2000.
Q. Delamarre and O. Faugeras. 3d articulated models and multi-view tracking with silhouettes. In Proc. of the Seventh International Conference on Computer Vision, IEEE, pages 716–721, 1999.
O. Faugeras, Q.T Luong, and T. Papadopoulo. The Geometry of Multiple Images. MIT Press, 2001.
B.K. Ghosh and E.P. Loucks. A perspective theory for motion and shape estimation in machine vision. SIAM Journal of Control and Optimization, 33(5):1530–1559, 1995.
W.E. Grimson. Object recognition by computer: the role of geometric constraints. MIT Press, 1990.
C. Harris. Tracking with rigid models. In A. Blake and A. Yuille, editors, Active Vision, chapter 4, pages 59–73. The MIT Press, 1992.
R. Hartley and A. Zisserman. Multiple View Geometry in Computer Vision. Cambridge University Press, 2000.
D. Jacobs and R. Basri. 3-d to 2-d pose determination with regions. International Journal of Computer Vision, 34(2/3):123–145, 1999.
P.K. Khosla. Estimation of robot dynamics parameters: Theory and application. International Journal of Robotics and Automation, 3(1):35–41, 1988.
Y. Masutani, T. Iwatsu, and F. Miyazaki. Motion estimation of unknown rigid body under no external forces and moments. IEEE International Conference on Robotics and Automation, 2:1066–1072, 1994.
D. Metaxas and D. Terzopoulos. Shape and nonrigid motion estimation through physics-based synthesis. IEEE Trans. Pattern Analysis and Machine Intelligence, 15(6):580–591, 1993.
A. Pentland and B. Horowitz. Recovery of nonrigid motion and structure. IEEE Trans. Pattern Analysis and Machine Intelligence, 13(7):730–742, July 1991.
J. Popovic. Interactive Design of Rigid-Body Simulation for Computer Animation. Ph.D Thesis, CMU-CS-01-140, Carnegie Mellon University, July 2001.
J. Popovic, S.M. Seitz, M. Erdmann, Z. Popovic, and A. Witkin. Interactive manipulation of rigid body simulations. In Computer Graphics, Proceedings of SIGGRAPH 00, pages 209–218, 2000.
A.A. Rizzi and D.E. Koditschek. An active visual estimator for dexterous manipulation. IEEE Transactions on Robotics and Automation, 12(5):697–713, 1996.
J. Schick and E.D. Dickmanns. Simultaneous estimation of 3d shape and motion of objects by computer vision. Proc. IEEE Workshop on Visual Motion, pages 256–261, 1991.
K. Symon. Mechanics, Third Edition. Addison-Wesley Publishing Company, Reading, Massachussetts, 1971.
C. Tomasi and T. Kanade. Shape and motion from image streams under orthography: a factorization method. International Journal of Computer Vision, 9(2):137–154, November 1992.
C. Wren. Understanding Expressive Action. Ph.D Thesis, Massachusetts Institute of Technology, March 2000.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bhat, K.S., Seitz, S.M., Popović, J., Khosla, P.K. (2002). Computing the Physical Parameters of Rigid-Body Motion from Video. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds) Computer Vision — ECCV 2002. ECCV 2002. Lecture Notes in Computer Science, vol 2350. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-47969-4_37
Download citation
DOI: https://doi.org/10.1007/3-540-47969-4_37
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43745-1
Online ISBN: 978-3-540-47969-7
eBook Packages: Springer Book Archive