TY - GEN
T1 - 360-Degree Image Completion by Two-Stage Conditional Gans
AU - Akimoto, Naofumi
AU - Kasai, Seito
AU - Hayashi, Masaki
AU - Aoki, Yoshimitsu
N1 - Publisher Copyright:
© 2019 IEEE.
PY - 2019/9
Y1 - 2019/9
N2 - The latest generative adversarial networks (GANs) can generate realistic high resolution images. However, to the best of our knowledge, there are no GANs for generating 360-degree images. Therefore, this paper proposes the novel problem setting that by using a known area from the 360-degree image as an input, the remainder of the image can be completed with the GANs. To do so, we propose the approach of two-stage generation using network architecture with series-parallel dilated convolution layers. Moreover, we present how to rearrange images for data augmentation, simplify the problem, and make inputs for training the 2nd stage generator. Our experiments show that these methods generate the distortion seen in 360-degree images in the outlines of buildings and roads, and their boundaries are clearer than those of baseline methods. Furthermore, we discuss and clarify the difficulty of our proposed problem. Our work is the first step towards GANs predicting an unseen area within a 360-degree space.
AB - The latest generative adversarial networks (GANs) can generate realistic high resolution images. However, to the best of our knowledge, there are no GANs for generating 360-degree images. Therefore, this paper proposes the novel problem setting that by using a known area from the 360-degree image as an input, the remainder of the image can be completed with the GANs. To do so, we propose the approach of two-stage generation using network architecture with series-parallel dilated convolution layers. Moreover, we present how to rearrange images for data augmentation, simplify the problem, and make inputs for training the 2nd stage generator. Our experiments show that these methods generate the distortion seen in 360-degree images in the outlines of buildings and roads, and their boundaries are clearer than those of baseline methods. Furthermore, we discuss and clarify the difficulty of our proposed problem. Our work is the first step towards GANs predicting an unseen area within a 360-degree space.
KW - 360 degrees
KW - Generative adversarial networks
KW - extrapolation
KW - image completion
UR - http://www.scopus.com/inward/record.url?scp=85076803906&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85076803906&partnerID=8YFLogxK
U2 - 10.1109/ICIP.2019.8803435
DO - 10.1109/ICIP.2019.8803435
M3 - Conference contribution
AN - SCOPUS:85076803906
T3 - Proceedings - International Conference on Image Processing, ICIP
SP - 4704
EP - 4708
BT - 2019 IEEE International Conference on Image Processing, ICIP 2019 - Proceedings
PB - IEEE Computer Society
T2 - 26th IEEE International Conference on Image Processing, ICIP 2019
Y2 - 22 September 2019 through 25 September 2019
ER -