Easy extrinsic calibration of vr system and multi-camera based marker-less motion capture system

Kosuke Takahashi, Dan Mikami, Mariko Isogawa, Siqi Sun, Yoshinori Kusachi

研究成果: Conference contribution

1 被引用数 (Scopus)

抄録

This paper proposes a novel easy extrinsic calibration algorithm for an off-The-shelf VR system and a multi-camera based marker-less motion capture system. To realize interactions between 3D user motions and virtual objects reconstructed from multi-view videos in a common 3D space, the extrinsic calibration of the VR system and the multiple cameras must be conducted beforehand. This calibration, which involves estimating the pose and position of each coordinate system, is a key technology for handling 3D information in a system with various type of input sources. In general, extrinsic calibration is carried out by identifying and utilizing some common 3D points. However, since most of off-The-shelf VR systems do not include any imaging device, it is difficult to apply conventional automatic calibration approaches as there are no common points shared with the cameras. Against this problem, this paper introduces an easy calibration algorithm by generating corresponding points from the trajectories of the user's motion with VR devices and 3D human pose reconstructed from multi-view videos. Our study provides the following two contributions; (1) our method does not need to introduce additional devices, such as a chessboard and (2) our method does not need manual processes as the extrinsic parameters are automatically estimated. We demonstrate the performance of the proposed method in a practical scenario.

本文言語English
ホスト出版物のタイトルAdjunct Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019
出版社Institute of Electrical and Electronics Engineers Inc.
ページ83-88
ページ数6
ISBN(電子版)9781728147659
DOI
出版ステータスPublished - 2019 10月
外部発表はい
イベント18th IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019 - Beijing, China
継続期間: 2019 10月 142019 10月 18

出版物シリーズ

名前Adjunct Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019

Conference

Conference18th IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019
国/地域China
CityBeijing
Period19/10/1419/10/18

ASJC Scopus subject areas

  • コンピュータ サイエンスの応用
  • 人間とコンピュータの相互作用
  • メディア記述

フィンガープリント

「Easy extrinsic calibration of vr system and multi-camera based marker-less motion capture system」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル