TY - GEN
T1 - Augmented reality for 3D TV using depth camera input
AU - De Sorbier, François
AU - Takaya, Yuki
AU - Uematsu, Yuko
AU - Daribo, Ismael
AU - Saito, Hideo
N1 - Copyright:
Copyright 2011 Elsevier B.V., All rights reserved.
PY - 2010
Y1 - 2010
N2 - This paper presents a capture system based on a depth camera that is used for an augmented reality application. Most of depth cameras are unable to capture the color information corresponding to the same viewpoint. A color is then added besides the depth camera and we applied a transformation algorithm to match the depth map with the color camera's viewpoint. Then, using a depth image based rendering (DIBR) approaches, it becomes possible to synthesize new virtual views from the 2D-plus-depth data. We also address some research issues in the generation of the virtual view is to deal with the newly exposed areas, appearing as holes and denoted as occlusions, which may be revealed in each warped image. The color image and its corresponding enhanced depth image are then combined to produce a mesh representing the real scene. It is used to easily integrate virtual objects in the real scene. Finally, the result can be rendered to create the input image required by a auto-stereoscopic screen.
AB - This paper presents a capture system based on a depth camera that is used for an augmented reality application. Most of depth cameras are unable to capture the color information corresponding to the same viewpoint. A color is then added besides the depth camera and we applied a transformation algorithm to match the depth map with the color camera's viewpoint. Then, using a depth image based rendering (DIBR) approaches, it becomes possible to synthesize new virtual views from the 2D-plus-depth data. We also address some research issues in the generation of the virtual view is to deal with the newly exposed areas, appearing as holes and denoted as occlusions, which may be revealed in each warped image. The color image and its corresponding enhanced depth image are then combined to produce a mesh representing the real scene. It is used to easily integrate virtual objects in the real scene. Finally, the result can be rendered to create the input image required by a auto-stereoscopic screen.
KW - 3D TV
KW - Augmented reality
KW - Auto-stereoscopic display
KW - Depth image based rendering
KW - Depth video
UR - http://www.scopus.com/inward/record.url?scp=78651450319&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=78651450319&partnerID=8YFLogxK
U2 - 10.1109/VSMM.2010.5665956
DO - 10.1109/VSMM.2010.5665956
M3 - Conference contribution
AN - SCOPUS:78651450319
SN - 9781424490264
T3 - 2010 16th International Conference on Virtual Systems and Multimedia, VSMM 2010
SP - 117
EP - 123
BT - 2010 16th International Conference on Virtual Systems and Multimedia, VSMM 2010
T2 - 2010 16th International Conference on Virtual Systems and Multimedia, VSMM 2010
Y2 - 20 October 2010 through 23 October 2010
ER -