Cited By
View all- Chen HElzer PKao O(2006)Integrating a Real-Time Captured Object into Mixed RealityProceedings of the 2006 International Conference on Cyberworlds10.1109/CW.2006.25(17-24)Online publication date: 28-Nov-2006
Novel view generation for a real-time captured video object
Authors: 
Hua Chen, Peter F. ElzerAuthors Info & Claims
Hua Chen, Peter F. ElzerAuthors Info & ClaimsPages 83 - 86
Abstract
This paper describes a novel method of real-time novel view synthesis for an object that is observed by two fixed video cameras in a natural environment. Without reconstructing the 3D model of the object, the view of the object corresponding to a virtual camera that moves between the two real cameras is generated by applying a view morphing process to the object region in the image pair captured in real-time. Using the captured live video frames, the proposed method can not only generate realistic novel views in real-time, but also ensure a natural and smooth image transition between the two cameras. It can be used in a variety of Mixed Reality (MR) applications to integrate live video objects into virtual environments. Experimental results verify the validity of the proposed approach.
References
[1]
S. Avidan and A. Shashua. Novel view synthesis in tensor space. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pages 1034--1040, 1997.
[2]
H. Chen. Real-time video object extraction for Mixed Reality applications. Papierflieger, Clausthal-Zellerfeld, Germany, 2006.
[3]
S. E. Chen. Quicktime VR - an image-based approach to virtual environment navigation. In Proceedings of ACM SIGGRAPH, pages 29--38, 1995.
[4]
S. E. Chen and L. Williams. View interpolation for image synthesis. In Proceedings of ACM SIGGRAPH, pages 279--288, 1993.
[5]
P. Elzer and K.-H. Sauermann. Das clausthaler labor fuer 'plant design and virtual manufacturing'. In Proceedings of the Workshop on Real-Time Systems and Programming - PEARL, pages 1118, 2001.
[6]
A. Fusiello, E. Trucco, and A. Verri. A compact algorithm for rectification of stereo pairs. Machine Vision and Applications, 12(1):16--22, July 2000.
[7]
R. Hartley. In defense of the eight-point algorithm. IEEE transactions on Pattern Analysis and Machine Intelligence, 19(6):580--593, June 1997.
[8]
N. Inamoto and H. Saito. Intermediate view generation of soccer scene from multiple videos. In Proceedings of the 16th International Conference on Pattern Recognition, pages 713--716, 2002.
[9]
T. Kanade, P. Rander, and P. J. Narayanan. Virtualized reality: Constructing virtual worlds from real scenes. IEEE Multimedia, 4(1):34--47, Jan. 1997.
[10]
M. H. Klapman. Extended view morphing. U.S. Patent 6,674,461, B(1), January 2004.
[11]
W. Matusik, C. Buehler, R. Raskar, and etc. Image-based visual hulls. In Proceedings of ACM SIGGRAPH, pages 369--374, 2000.
[12]
S. Moezzi, A. Katkere, D. Kuramura, and etc. Reality modeling and visualization from multiple video sequences. IEEE Computer Graphics and Applications, 16(6):5863, November 1996.
[13]
S. Prince, A. Cheok, F. Farbiz, and etc. 3d live: Real time captured content for mixed reality. In Proceedings of International Symposium on Mixed and Augmented Reality, pages 7--13, 2002.
[14]
S. M. Seitz and C. R. Dyer. View morphing. In Proceedings of ACM SIGGRAPH, pages 21--30, 1996.
[15]
K. Tamagawa, T. Yamada, T. Ogi, and etc. Developing a 2.5D video avatar. IEEE Signal Processing Magazine, 18(3):35--42, May 2001.
[16]
K. Timm. Real-time video view morphing. In Proceedings of ACM SIGGRAPH, Sketches and Applications program, 2003.
[17]
M. Trajkovie. Interactive calibration of a Pan-Tilt-Zoom (PTZ) camera for surveillance applications. In Proceedings of Asian Conference Computer Vision, 2002.
Index Terms
- Novel view generation for a real-time captured video object
Recommendations
Real-time 3D video avatar in mixed reality: an implementation for immersive telecommunication
Symposium: virtual reality simulationThis article presents an implementation of a real-time dynamic 3D avatar from multiview cameras for immersive telecommunication. Immersive telecommunication is a new challenging field that enables a user to share a virtual space with remote participants,...
Real time 3D avatar for interactive mixed reality
VRCAI '04: Proceedings of the 2004 ACM SIGGRAPH international conference on Virtual Reality continuum and its applications in industryThis paper presents real-time reconstruction of dynamic 3D avatar for interactive mixed reality. In computer graphics, one of the main goals is the combination of virtual scenes with real-world scenes. However, the views of the real world objects are ...
Generation of high-quality depth maps using hybrid camera system for 3-D video
In this paper, we present a hybrid camera system combining one time-of-flight depth camera and multiple video cameras to generate multi-view video sequences and their corresponding depth maps. In order to obtain the multi-view video-plus-depth data ...
Comments
Information & Contributors
Information
Published In
November 2006
400 pages
ISBN:1595933212
DOI:10.1145/1180495
- General Chairs:
- Mel Slater,
- Yoshifumi Kitamura,
- Program Chairs:
- Ayellet Tal,
- Angelos Amditis,
- Yiorgos Chrysanthou
Copyright © 2006 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 01 November 2006
Check for updates
Author Tags
Qualifiers
- Article
Conference
VRST06: The ACM Symposium on Virtual Reality Software and Technology 2006
November 1 - 3, 2006
Limassol, Cyprus
Acceptance Rates
Overall Acceptance Rate 66 of 254 submissions, 26%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 417Total Downloads
- Downloads (Last 12 months)6
- Downloads (Last 6 weeks)0
Reflects downloads up to 20 Feb 2025
Other Metrics
Citations
Cited By
View all- Chen HElzer PKao O(2006)Integrating a Real-Time Captured Object into Mixed RealityProceedings of the 2006 International Conference on Cyberworlds10.1109/CW.2006.25(17-24)Online publication date: 28-Nov-2006
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in