TY - GEN
T1 - Illumination-Aware Digital Image Compositing for Full-length Human Figures
AU - Ohkawara, Masaru
AU - Fujishiro, Issei
N1 - Funding Information:
The present work has been financially supported in part by a JSPS KAKENHI Grant-in-Aid for Scientific Research (A) No. 21H04916.
Publisher Copyright:
© 2021 IEEE.
PY - 2021
Y1 - 2021
N2 - In this paper, a novel compositor to realize illumination-Aware digital image compositing is proposed. Digital image compositing is a technique to re-synthesize a single image from multiple visual elements. Assembling separated visual elements leads to highly efficient content creation at risk of losing visual coherence. Visual coherence has two types: positional and illumination. Compositing while maintaining illumination coherence is considered a challenging task, because light transport information is needed to reproduce global illumination effects-color bleeding, soft shadows, caustics, and so on. The pipeline of the proposed compositor incorporates shape reconstruction, as well as global illumination simulation and relighting; thus, the compositor can reproduce background-To-foreground color bleeding and soft shadows. It is empirically evaluated that the proposed compositor compares favorably with rendering both in terms of quality and speed. Because it is in principle impossible to render the foreground and background elements together, the proposed compositor is inevitably selected to generate images with the two types of visual coherence. This leads to efficient construction of photorealistic cyberworlds.
AB - In this paper, a novel compositor to realize illumination-Aware digital image compositing is proposed. Digital image compositing is a technique to re-synthesize a single image from multiple visual elements. Assembling separated visual elements leads to highly efficient content creation at risk of losing visual coherence. Visual coherence has two types: positional and illumination. Compositing while maintaining illumination coherence is considered a challenging task, because light transport information is needed to reproduce global illumination effects-color bleeding, soft shadows, caustics, and so on. The pipeline of the proposed compositor incorporates shape reconstruction, as well as global illumination simulation and relighting; thus, the compositor can reproduce background-To-foreground color bleeding and soft shadows. It is empirically evaluated that the proposed compositor compares favorably with rendering both in terms of quality and speed. Because it is in principle impossible to render the foreground and background elements together, the proposed compositor is inevitably selected to generate images with the two types of visual coherence. This leads to efficient construction of photorealistic cyberworlds.
KW - digital image compositing
KW - image processing
KW - perception
KW - visual coherence
UR - http://www.scopus.com/inward/record.url?scp=85123359397&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85123359397&partnerID=8YFLogxK
U2 - 10.1109/CW52790.2021.00011
DO - 10.1109/CW52790.2021.00011
M3 - Conference contribution
AN - SCOPUS:85123359397
T3 - Proceedings - 2021 International Conference on Cyberworlds, CW 2021
SP - 17
EP - 24
BT - Proceedings - 2021 International Conference on Cyberworlds, CW 2021
A2 - Sourin, Alexei
A2 - Rosenberger, Christophe
A2 - Sourina, Olga
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2021 International Conference on Cyberworlds, CW 2021
Y2 - 28 September 2021 through 30 September 2021
ER -