メインナビゲーションにスキップ 検索にスキップ メインコンテンツにスキップ

Real-Time Dynamic Digital Twin Generation Using Multiple First-Person Views

  • Hiroki Yazaki
  • , Shinnosuke Hirokawa
  • , Ryosuke Hori
  • , Hideo Saito
  • , Azusa Sawada
  • , Manabu Nakanoya

研究成果: Conference contribution

抄録

The growing interest in the Metaverse drives demand for digital twins that accurately replicate physical environments. While capturing real-time human dynamics in static environments is essential for immersion, it is limited by the scalability of conventional motion capture. Furthermore, multi-user spatial consistency is challenging when using only first-person view (FPV) streams. We propose a real-time system generating dynamic digital twins from multiple FPV videos. Our method achieves robust localization by integrating a pre-scanned 3D Gaussian Splatting map, ORB-SLAM3, and YOLO-based dynamic object removal. We integrate individual motion synthesis with spatial synchronization; leveraging Ego-Poser for full-body reconstruction, we unify disparate streams into a global coordinate system. Experimental results show our system operates at 30 to 60 FPS, enabling synchronized visualization of multiple 3D human models in a photorealistic environment.

本文言語English
ホスト出版物のタイトルProceedings - 2026 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2026
出版社Institute of Electrical and Electronics Engineers Inc.
ページ718-724
ページ数7
ISBN(電子版)9798319505293
DOI
出版ステータスPublished - 2026
イベント2026 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2026 - Daegu, Korea, Republic of
継続期間: 2026 3月 21 → 2026 3月 25

出版物シリーズ

名前Proceedings - 2026 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2026

Conference

Conference2026 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2026
国/地域Korea, Republic of
CityDaegu
Period26/3/21 → 26/3/25

ASJC Scopus subject areas

  • コンピュータ サイエンスの応用
  • 人間とコンピュータの相互作用
  • メディア記述
  • コンピュータ グラフィックスおよびコンピュータ支援設計

フィンガープリント

「Real-Time Dynamic Digital Twin Generation Using Multiple First-Person Views」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル