Silhouette-Based 3D Human Pose Estimation Using a Single Wrist-Mounted 360° Camera

Ryosuke Hori, Ryo Hachiuma, Mariko Isogawa, Dan Mikami, Hideo Saito

Research output: Contribution to journalArticlepeer-review

3 Citations (Scopus)

Abstract

In this paper, we propose a framework for 3D human pose estimation using a single 360° camera mounted on the user's wrist. Perceiving a 3D human pose with such a simple setup has remarkable potential for various applications (e. g., daily-living activity monitoring, motion analysis for sports training). However, no existing method has tackled this task due to the difficulty of estimating a human pose from a single camera image in which only a part of the human body is captured, and because of a lack of training data. We propose a method for translating wrist-mounted 360° camera images into 3D human poses. Since we are the first to try this task, we cannot use existing datasets. To address this issue, we use synthetic data to build our own dataset. This solution, however, creates a different problem, that of a domain gap between synthetic data for training and real image data for inference. To resolve this problem, we propose silhouette-based synthetic data generation created for this task. Extensive experiments comparing our method with several baseline methods demonstrated the effectiveness of our silhouette-based pose estimation approach.

Original languageEnglish
Pages (from-to)54957-54968
Number of pages12
JournalIEEE Access
Volume10
DOIs
Publication statusPublished - 2022

Keywords

  • 360 ° camera
  • 3D human pose estimation
  • Data synthesis
  • Domain adaptation
  • Silhouette

ASJC Scopus subject areas

  • General Computer Science
  • General Materials Science
  • General Engineering

Fingerprint

Dive into the research topics of 'Silhouette-Based 3D Human Pose Estimation Using a Single Wrist-Mounted 360° Camera'. Together they form a unique fingerprint.

Cite this