Classification of spontaneous and posed smiles by photo-reflective sensors embedded with smart eyewear

Chisa Saito, Katsutoshi Masai, Maki Sugimoto

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Citations (Scopus)

Abstract

Smile is one of the representative emotional expressions which is observed frequently in daily life and essential for various non-verbal communications. People make spontaneous smiles and intentional ones. It is important to guess properly whether a person is making a smile spontaneously or intentionally to understand the meaning of smiles. In this study, we propose a smile classification system with smart eyewear that equips photo-reflective sensors and examines whether we can distinguish two types of smiles; spontaneous smiles caused by funny videos and posed smiles evoked by instructions. We extract geometric features: reflection intensity distribution of sensors and temporal features in a time axis. By applying for Support Vector Machine, we observed 94.6% as the mean accuracy among 12 participants when we used both geometric and temporal features with user-dependent training. The result suggested that we can distinguish between spontaneous and posed smile by the sensors embedded with the smart eyewear.

Original languageEnglish
Title of host publicationTEI 2020 - Proceedings of the 14th International Conference on Tangible, Embedded, and Embodied Interaction
PublisherAssociation for Computing Machinery, Inc
Pages46-52
Number of pages7
ISBN (Electronic)9781450361071
DOIs
Publication statusPublished - 2020 Feb 6
Event14th International Conference on Tangible, Embedded, and Embodied Interaction, TEI 2020 - Sydney, Australia
Duration: 2020 Feb 92020 Feb 12

Publication series

NameTEI 2020 - Proceedings of the 14th International Conference on Tangible, Embedded, and Embodied Interaction

Conference

Conference14th International Conference on Tangible, Embedded, and Embodied Interaction, TEI 2020
Country/TerritoryAustralia
CitySydney
Period20/2/920/2/12

Keywords

  • Sensor
  • Smile classification
  • Wearable device

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Information Systems
  • Software

Fingerprint

Dive into the research topics of 'Classification of spontaneous and posed smiles by photo-reflective sensors embedded with smart eyewear'. Together they form a unique fingerprint.

Cite this