Tags

Type your tag names separated by a space and hit enter

Space-time light field rendering.
IEEE Trans Vis Comput Graph. 2007 Jul-Aug; 13(4):697-710.IT

Abstract

In this paper, we propose a novel framework called space-time light field rendering, which allows continuous exploration of a dynamic scene in both space and time. Compared to existing light field capture/rendering systems, it offers the capability of using unsynchronized video inputs and the added freedom of controlling the visualization in the temporal domain, such as smooth slow motion and temporal integration. In order to synthesize novel views from any viewpoint at any time instant, we develop a two-stage rendering algorithm. We first interpolate in the temporal domain to generate globally synchronized images using a robust spatial-temporal image registration algorithm followed by edge-preserving image morphing. We then interpolate these software-synchronized images in the spatial domain to synthesize the final view. In addition, we introduce a very accurate and robust algorithm to estimate subframe temporal offsets among input video sequences. Experimental results from unsynchronized videos with or without time stamps show that our approach is capable of maintaining photorealistic quality from a variety of real scenes.

Links

Publisher Full Text

Authors+Show Affiliations

Wang H
Georgia Institute of Technology, Atlanta, GA 30332-0760, USA. whmin@cc.gatech.edu
Sun M
No affiliation info available
Yang R
No affiliation info available

MeSH

AlgorithmsArtificial IntelligenceComputer GraphicsComputer SimulationImage EnhancementImage Interpretation, Computer-AssistedImaging, Three-DimensionalInformation Storage and RetrievalLightingModels, TheoreticalNumerical Analysis, Computer-AssistedUser-Computer Interface

Pub Type(s)

Journal Article
Research Support, Non-U.S. Gov't
Research Support, U.S. Gov't, Non-P.H.S.

Language

eng

PubMed ID

17495330

Citation

Wang, Huamin, et al. "Space-time Light Field Rendering." IEEE Transactions On Visualization and Computer Graphics, vol. 13, no. 4, 2007, pp. 697-710.
Wang H, Sun M, Yang R. Space-time light field rendering. IEEE Trans Vis Comput Graph. 2007;13(4):697-710.
Wang, H., Sun, M., & Yang, R. (2007). Space-time light field rendering. IEEE Transactions On Visualization and Computer Graphics, 13(4), 697-710.
Wang H, Sun M, Yang R. Space-time Light Field Rendering. IEEE Trans Vis Comput Graph. 2007 Jul-Aug;13(4):697-710. PubMed PMID: 17495330.
* Article titles in AMA citation format should be in sentence-case
TY - JOUR T1 - Space-time light field rendering. AU - Wang,Huamin, AU - Sun,Mingxuan, AU - Yang,Ruigang, PY - 2007/5/15/pubmed PY - 2007/7/19/medline PY - 2007/5/15/entrez SP - 697 EP - 710 JF - IEEE transactions on visualization and computer graphics JO - IEEE Trans Vis Comput Graph VL - 13 IS - 4 N2 - In this paper, we propose a novel framework called space-time light field rendering, which allows continuous exploration of a dynamic scene in both space and time. Compared to existing light field capture/rendering systems, it offers the capability of using unsynchronized video inputs and the added freedom of controlling the visualization in the temporal domain, such as smooth slow motion and temporal integration. In order to synthesize novel views from any viewpoint at any time instant, we develop a two-stage rendering algorithm. We first interpolate in the temporal domain to generate globally synchronized images using a robust spatial-temporal image registration algorithm followed by edge-preserving image morphing. We then interpolate these software-synchronized images in the spatial domain to synthesize the final view. In addition, we introduce a very accurate and robust algorithm to estimate subframe temporal offsets among input video sequences. Experimental results from unsynchronized videos with or without time stamps show that our approach is capable of maintaining photorealistic quality from a variety of real scenes. SN - 1077-2626 UR - https://www.unboundmedicine.com/medline/citation/17495330/Space_time_light_field_rendering_ L2 - https://doi.ieeecomputersociety.org/10.1109/TVCG.2007.1019 DB - PRIME DP - Unbound Medicine ER -