TY - CHAP
T1 - Video Avatar Communication Among HMD Users in Metaverse Environment
AU - Ogi, Tetsuro
AU - Sumida, Kazuma
AU - Kida, Yuki
N1 - Publisher Copyright:
© 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.
PY - 2023
Y1 - 2023
N2 - In recent years, the Metaverse has been attracting attention as online communication tool. But the avatar that represents the user’s figure in the Metaverse cannot express the facial expression of the user, because it is usually constructed with CG model. In order to solve such problems, this research proposes video avatar that uses live video image of the user as an avatar in the Metaverse environment. However, for the users wearing HMDs, facial expressions cannot be seen, because most of their faces are covered by headset. Therefore, a method of reconstructing a whole face image from the face image wearing an HMD was developed by using the machine learning technology, and the effectiveness of this method was evaluated through the experiments.
AB - In recent years, the Metaverse has been attracting attention as online communication tool. But the avatar that represents the user’s figure in the Metaverse cannot express the facial expression of the user, because it is usually constructed with CG model. In order to solve such problems, this research proposes video avatar that uses live video image of the user as an avatar in the Metaverse environment. However, for the users wearing HMDs, facial expressions cannot be seen, because most of their faces are covered by headset. Therefore, a method of reconstructing a whole face image from the face image wearing an HMD was developed by using the machine learning technology, and the effectiveness of this method was evaluated through the experiments.
UR - http://www.scopus.com/inward/record.url?scp=85169073412&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85169073412&partnerID=8YFLogxK
U2 - 10.1007/978-3-031-40978-3_34
DO - 10.1007/978-3-031-40978-3_34
M3 - Chapter
AN - SCOPUS:85169073412
T3 - Lecture Notes on Data Engineering and Communications Technologies
SP - 316
EP - 324
BT - Lecture Notes on Data Engineering and Communications Technologies
PB - Springer Science and Business Media Deutschland GmbH
ER -