BridgedReality: A Toolkit Connecting Physical and Virtual Spaces through Live Holographic Point Cloud Interaction

Mark Armstrong, Lawrence Quest, Yun Suen Pai, Kai Kunze, Kouta Minamizawa

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The recent emergence of point cloud streaming technologies has spawned new ways to digitally perceive and manipulate live data of users and spaces. The graphical rendering limitations prevent state-of-the-art interaction techniques from achieving segmented bare-body user input to manipulate live point cloud data. We propose BridgedReality, a toolkit that enables users to produce localized virtual effects in live scenes, without the need for an HMD nor any wearable devices or virtual controllers. Our method uses body tracking and an illusory rendering technique to achieve large scale, depth-based, real time interaction with multiple light field projection display interfaces. This toolkit circumvented time-consuming 3D object classification, and packaged multiple proximity effects in a format understandable by middle schoolers. Our work can offer a foundation for multidirectional holographic interfaces, GPU simulated interactions, teleconferencing and gaming activities, as well as live cinematic quality exhibitions.

Original languageEnglish
Title of host publicationProceedings - SIGGRAPH Asia 2021 Posters, SA 2021
EditorsStephen N. Spencer
PublisherAssociation for Computing Machinery, Inc
ISBN (Electronic)9781450386876
DOIs
Publication statusPublished - 2021 Dec 14
EventSIGGRAPH Asia 2021 Posters - Computer Graphics and Interactive Techniques Conference - Asia, SA 2021 - Tokyo, Japan
Duration: 2021 Dec 142021 Dec 17

Publication series

NameProceedings - SIGGRAPH Asia 2021 Posters, SA 2021

Conference

ConferenceSIGGRAPH Asia 2021 Posters - Computer Graphics and Interactive Techniques Conference - Asia, SA 2021
Country/TerritoryJapan
CityTokyo
Period21/12/1421/12/17

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction

Fingerprint

Dive into the research topics of 'BridgedReality: A Toolkit Connecting Physical and Virtual Spaces through Live Holographic Point Cloud Interaction'. Together they form a unique fingerprint.

Cite this