Object-wise 3d gaze mapping in physicalworkspace

Kakeru Hagihara, Keiichiro Taniguchi, Irshad Abibouraguimane, Yuta Itoh, Keita Higuchi, Jiu Otsuka, Maki Sugimoto, Yoichi Sato

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)


skill in human communication. Eye behavior is an important, yet implicit communication cue. In this work, we focus on enabling people to see the users' gaze associated with objects in the 3D space, namely, we present users the history of gaze linked to real 3D objects. Our 3D gaze visualization system automatically segments objects in the workspace and projects user's gaze trajectory onto the objects in 3D for visualizing user's intention. By combining automated object segmentation and head tracking via the firstperson video from a wearable eye tracker, our system can visualize user's gaze behavior more intuitively and efficiently compared to 2D based methods and 3D methods with manual annotation. We performed an evaluation of the system to measure the accuracy of object-wise gaze mapping. In the evaluation, the system achieved 94% accuracy of gaze mapping onto 40, 30, 20, 10-centimeter cubes. We also conducted a case study of through a case study where the user looks at food products, we showed that our system was ableto predict products that the user is interested in.

Original languageEnglish
Title of host publicationProceedings of the 9th Augmented Human International Conference, AH 2018
PublisherAssociation for Computing Machinery
VolumePart F134484
ISBN (Electronic)9781450354158
Publication statusPublished - 2018 Feb 6
Event9th Augmented Human International Conference, AH 2018 - Seoul, Korea, Republic of
Duration: 2018 Feb 72018 Feb 9


Other9th Augmented Human International Conference, AH 2018
Country/TerritoryKorea, Republic of


  • 3D gaze
  • 3D segmentation
  • Gaze mapping

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software


Dive into the research topics of 'Object-wise 3d gaze mapping in physicalworkspace'. Together they form a unique fingerprint.

Cite this