Poster: Mapping natural facial expressions using unsupervised learning and optical sensors on smart eyewear

Katsutoshi Masai; Kai Kunze; Yuta Sugiura; Maki Sugimoto

doi:10.1145/3267305.3267562

Poster: Mapping natural facial expressions using unsupervised learning and optical sensors on smart eyewear

Katsutoshi Masai, Kai Kunze, Yuta Sugiura, Maki Sugimoto

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Our communication highly depends on nonverbal clues, especially on facial expressions. This paper presents the mapping of spontaneous facial expressions in daily conversation using the optical sensors on smart eyewear and unsupervised learning method(Self-Organizing Map) to see the potentially detectable expressions. We had the case study of five to ten minutes of the unscripted communications with five users. It showed that our system could map the various facial expressions of the users such as social smile and the smile of enjoyment. The study also demonstrated that the map trained with the datasets of five users could categorize the similar expressions of each user into the shared clusters among the users.

Original language	English
Title of host publication	UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers
Publisher	Association for Computing Machinery, Inc
Pages	158-161
Number of pages	4
ISBN (Electronic)	9781450359665
DOIs	https://doi.org/10.1145/3267305.3267562
Publication status	Published - 2018 Oct 8
Event	2018 Joint ACM International Conference on Pervasive and Ubiquitous Computing, UbiComp 2018 and 2018 ACM International Symposium on Wearable Computers, ISWC 2018 - Singapore, Singapore Duration: 2018 Oct 8 → 2018 Oct 12

Publication series

Name	UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers

Other

Other	2018 Joint ACM International Conference on Pervasive and Ubiquitous Computing, UbiComp 2018 and 2018 ACM International Symposium on Wearable Computers, ISWC 2018
Country/Territory	Singapore
City	Singapore
Period	18/10/8 → 18/10/12

Keywords

Facial Expression
Unsupervised Learning
Wearable Computing

ASJC Scopus subject areas

Software
Human-Computer Interaction
Information Systems

Access to Document

10.1145/3267305.3267562

Cite this

Masai, K., Kunze, K., Sugiura, Y., & Sugimoto, M. (2018). Poster: Mapping natural facial expressions using unsupervised learning and optical sensors on smart eyewear. In UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers (pp. 158-161). (UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers). Association for Computing Machinery, Inc. https://doi.org/10.1145/3267305.3267562

Poster: Mapping natural facial expressions using unsupervised learning and optical sensors on smart eyewear. / Masai, Katsutoshi; Kunze, Kai ; Sugiura, Yuta et al.
UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers. Association for Computing Machinery, Inc, 2018. p. 158-161 (UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Masai, K, Kunze, K , Sugiura, Y & Sugimoto, M 2018, Poster: Mapping natural facial expressions using unsupervised learning and optical sensors on smart eyewear. in UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers. UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers, Association for Computing Machinery, Inc, pp. 158-161, 2018 Joint ACM International Conference on Pervasive and Ubiquitous Computing, UbiComp 2018 and 2018 ACM International Symposium on Wearable Computers, ISWC 2018, Singapore, Singapore, 18/10/8. https://doi.org/10.1145/3267305.3267562

Masai K, Kunze K , Sugiura Y , Sugimoto M. Poster: Mapping natural facial expressions using unsupervised learning and optical sensors on smart eyewear. In UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers. Association for Computing Machinery, Inc. 2018. p. 158-161. (UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers). doi: 10.1145/3267305.3267562

Masai, Katsutoshi ; Kunze, Kai ; Sugiura, Yuta et al. / Poster : Mapping natural facial expressions using unsupervised learning and optical sensors on smart eyewear. UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers. Association for Computing Machinery, Inc, 2018. pp. 158-161 (UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers).

@inproceedings{861067cc10704b9b996205f593f8109c,

title = "Poster: Mapping natural facial expressions using unsupervised learning and optical sensors on smart eyewear",

abstract = "Our communication highly depends on nonverbal clues, especially on facial expressions. This paper presents the mapping of spontaneous facial expressions in daily conversation using the optical sensors on smart eyewear and unsupervised learning method(Self-Organizing Map) to see the potentially detectable expressions. We had the case study of five to ten minutes of the unscripted communications with five users. It showed that our system could map the various facial expressions of the users such as social smile and the smile of enjoyment. The study also demonstrated that the map trained with the datasets of five users could categorize the similar expressions of each user into the shared clusters among the users.",

keywords = "Facial Expression, Unsupervised Learning, Wearable Computing",

author = "Katsutoshi Masai and Kai Kunze and Yuta Sugiura and Maki Sugimoto",

note = "Funding Information: This research is supported by JSPS KAKENHI (YYK8F20) and JST CREST (JPMJCR14E1). Publisher Copyright: {\textcopyright} Copyright held by the owner/author(s).; 2018 Joint ACM International Conference on Pervasive and Ubiquitous Computing, UbiComp 2018 and 2018 ACM International Symposium on Wearable Computers, ISWC 2018 ; Conference date: 08-10-2018 Through 12-10-2018",

year = "2018",

month = oct,

day = "8",

doi = "10.1145/3267305.3267562",

language = "English",

series = "UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers",

publisher = "Association for Computing Machinery, Inc",

pages = "158--161",

booktitle = "UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers",

}

TY - GEN

T1 - Poster

T2 - 2018 Joint ACM International Conference on Pervasive and Ubiquitous Computing, UbiComp 2018 and 2018 ACM International Symposium on Wearable Computers, ISWC 2018

AU - Masai, Katsutoshi

AU - Kunze, Kai

AU - Sugiura, Yuta

AU - Sugimoto, Maki

N1 - Funding Information: This research is supported by JSPS KAKENHI (YYK8F20) and JST CREST (JPMJCR14E1). Publisher Copyright: © Copyright held by the owner/author(s).

PY - 2018/10/8

Y1 - 2018/10/8

N2 - Our communication highly depends on nonverbal clues, especially on facial expressions. This paper presents the mapping of spontaneous facial expressions in daily conversation using the optical sensors on smart eyewear and unsupervised learning method(Self-Organizing Map) to see the potentially detectable expressions. We had the case study of five to ten minutes of the unscripted communications with five users. It showed that our system could map the various facial expressions of the users such as social smile and the smile of enjoyment. The study also demonstrated that the map trained with the datasets of five users could categorize the similar expressions of each user into the shared clusters among the users.

AB - Our communication highly depends on nonverbal clues, especially on facial expressions. This paper presents the mapping of spontaneous facial expressions in daily conversation using the optical sensors on smart eyewear and unsupervised learning method(Self-Organizing Map) to see the potentially detectable expressions. We had the case study of five to ten minutes of the unscripted communications with five users. It showed that our system could map the various facial expressions of the users such as social smile and the smile of enjoyment. The study also demonstrated that the map trained with the datasets of five users could categorize the similar expressions of each user into the shared clusters among the users.

KW - Facial Expression

KW - Unsupervised Learning

KW - Wearable Computing

UR - http://www.scopus.com/inward/record.url?scp=85058294541&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85058294541&partnerID=8YFLogxK

U2 - 10.1145/3267305.3267562

DO - 10.1145/3267305.3267562

M3 - Conference contribution

AN - SCOPUS:85058294541

T3 - UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers

SP - 158

EP - 161

BT - UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers

PB - Association for Computing Machinery, Inc

Y2 - 8 October 2018 through 12 October 2018

ER -

Poster: Mapping natural facial expressions using unsupervised learning and optical sensors on smart eyewear

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this