CheekInput: Turning your cheek into an input surface by embedded optical sensors on a head-mounted display

Koki Yamashita, Takashi Kikuchi, Katsutoshi Masai, Maki Sugimoto, Bruce H. Thomas, Yuta Sugiura

Research output: Chapter in Book/Report/Conference proceedingConference contribution

38 Citations (Scopus)

Abstract

In this paper, we propose a novel technology called "CheekInput" with a head-mounted display (HMD) that senses touch gestures by detecting skin deformation. We attached multiple photo-reflective sensors onto the bottom front frame of the HMD. Since these sensors measure the distance between the frame and cheeks, our system is able to detect the deformation of a cheek when the skin surface is touched by fingers. Our system uses a Support Vector Machine to determine the gestures: pushing face up and down, left and right. We combined these 4 directional gestures for each cheek to extend 16 possible gestures. To evaluate the accuracy of the gesture detection, we conducted a user study. The results revealed that CheekInput achieved 80.45 % recognition accuracy when gestures were made by touching both cheeks with both hands, and 74.58 % when by touching both cheeks with one hand.

Original languageEnglish
Title of host publicationProceedings - VRST 2017
Subtitle of host publication23rd ACM Conference on Virtual Reality Software and Technology
EditorsStephen N. Spencer
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450355483
DOIs
Publication statusPublished - 2017 Nov 8
Event23rd ACM Conference on Virtual Reality Software and Technology, VRST 2017 - Gothenburg, Sweden
Duration: 2017 Nov 82017 Nov 10

Publication series

NameProceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST
VolumePart F131944

Other

Other23rd ACM Conference on Virtual Reality Software and Technology, VRST 2017
Country/TerritorySweden
CityGothenburg
Period17/11/817/11/10

Keywords

  • OST-HMD
  • Photo-reflective sensor
  • Skin interface

ASJC Scopus subject areas

  • Software

Fingerprint

Dive into the research topics of 'CheekInput: Turning your cheek into an input surface by embedded optical sensors on a head-mounted display'. Together they form a unique fingerprint.

Cite this