A Thumb Tip Wearable Device Consisting of Multiple Cameras to Measure Thumb Posture

Naoto Ienaga; Wataru Kawai; Koji Fujita; Natsuki Miyata; Yuta Sugiura; Hideo Saito

doi:10.1007/978-3-030-21074-8_3

A Thumb Tip Wearable Device Consisting of Multiple Cameras to Measure Thumb Posture

Naoto Ienaga, Wataru Kawai, Koji Fujita, Natsuki Miyata, Yuta Sugiura, Hideo Saito

Department of Information and Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Today, cameras have become smaller and cheaper and can be utilized in various scenes. We took advantage of that to develop a thumb tip wearable device to estimate joint angles of a thumb as measuring human finger postures is important in terms of human-computer interface and to analyze human behavior. The device we developed consists of three small cameras attached at different angles so the cameras can capture the four fingers. We assumed that the appearance of the four fingers would change depending on the joint angles of the thumb. We made a convolutional neural network learn a regression relationship between the joint angles of the thumb and the images taken by the cameras. In this paper, we captured the keypoint positions of the thumb with a USB sensor device and calculated the joint angles to construct a dataset. The root mean squared error of the test data was 6.23° and 4.75° .

Original language	English
Title of host publication	Computer Vision – ACCV 2018 Workshops - 14th Asian Conference on Computer Vision, 2018, Revised Selected Papers
Editors	Gustavo Carneiro, Shaodi You
Publisher	Springer Verlag
Pages	31-38
Number of pages	8
ISBN (Print)	9783030210731
DOIs	https://doi.org/10.1007/978-3-030-21074-8_3
Publication status	Published - 2019
Event	14th Asian Conference on Computer Vision, ACCV 2018 - Perth, Australia Duration: 2018 Dec 2 → 2018 Dec 6

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	11367 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	14th Asian Conference on Computer Vision, ACCV 2018
Country/Territory	Australia
City	Perth
Period	18/12/2 → 18/12/6

Keywords

Human computer interaction
Pose estimation
Wearable device

ASJC Scopus subject areas

Theoretical Computer Science
Computer Science(all)

Access to Document

10.1007/978-3-030-21074-8_3

Cite this

Ienaga, N., Kawai, W., Fujita, K., Miyata, N., Sugiura, Y., & Saito, H. (2019). A Thumb Tip Wearable Device Consisting of Multiple Cameras to Measure Thumb Posture. In G. Carneiro, & S. You (Eds.), Computer Vision – ACCV 2018 Workshops - 14th Asian Conference on Computer Vision, 2018, Revised Selected Papers (pp. 31-38). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11367 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-030-21074-8_3

A Thumb Tip Wearable Device Consisting of Multiple Cameras to Measure Thumb Posture. / Ienaga, Naoto; Kawai, Wataru; Fujita, Koji et al.
Computer Vision – ACCV 2018 Workshops - 14th Asian Conference on Computer Vision, 2018, Revised Selected Papers. ed. / Gustavo Carneiro; Shaodi You. Springer Verlag, 2019. p. 31-38 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11367 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Ienaga, N, Kawai, W, Fujita, K, Miyata, N, Sugiura, Y & Saito, H 2019, A Thumb Tip Wearable Device Consisting of Multiple Cameras to Measure Thumb Posture. in G Carneiro & S You (eds), Computer Vision – ACCV 2018 Workshops - 14th Asian Conference on Computer Vision, 2018, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11367 LNCS, Springer Verlag, pp. 31-38, 14th Asian Conference on Computer Vision, ACCV 2018, Perth, Australia, 18/12/2. https://doi.org/10.1007/978-3-030-21074-8_3

Ienaga N, Kawai W, Fujita K, Miyata N, Sugiura Y , Saito H. A Thumb Tip Wearable Device Consisting of Multiple Cameras to Measure Thumb Posture. In Carneiro G, You S, editors, Computer Vision – ACCV 2018 Workshops - 14th Asian Conference on Computer Vision, 2018, Revised Selected Papers. Springer Verlag. 2019. p. 31-38. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-21074-8_3

Ienaga, Naoto ; Kawai, Wataru ; Fujita, Koji et al. / A Thumb Tip Wearable Device Consisting of Multiple Cameras to Measure Thumb Posture. Computer Vision – ACCV 2018 Workshops - 14th Asian Conference on Computer Vision, 2018, Revised Selected Papers. editor / Gustavo Carneiro ; Shaodi You. Springer Verlag, 2019. pp. 31-38 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{f74633f22206494db549f7e59445e8d8,

title = "A Thumb Tip Wearable Device Consisting of Multiple Cameras to Measure Thumb Posture",

abstract = "Today, cameras have become smaller and cheaper and can be utilized in various scenes. We took advantage of that to develop a thumb tip wearable device to estimate joint angles of a thumb as measuring human finger postures is important in terms of human-computer interface and to analyze human behavior. The device we developed consists of three small cameras attached at different angles so the cameras can capture the four fingers. We assumed that the appearance of the four fingers would change depending on the joint angles of the thumb. We made a convolutional neural network learn a regression relationship between the joint angles of the thumb and the images taken by the cameras. In this paper, we captured the keypoint positions of the thumb with a USB sensor device and calculated the joint angles to construct a dataset. The root mean squared error of the test data was 6.23° and 4.75° .",

keywords = "Human computer interaction, Pose estimation, Wearable device",

author = "Naoto Ienaga and Wataru Kawai and Koji Fujita and Natsuki Miyata and Yuta Sugiura and Hideo Saito",

note = "Funding Information: Acknowledgements. This work was supported by JST AIP-PRISM Grant Number JPMJCR18Y2, Grant-in-Aid for JSPS Research Fellow Grant Number JP17J05489. Publisher Copyright: {\textcopyright} 2019, Springer Nature Switzerland AG.; 14th Asian Conference on Computer Vision, ACCV 2018 ; Conference date: 02-12-2018 Through 06-12-2018",

year = "2019",

doi = "10.1007/978-3-030-21074-8_3",

language = "English",

isbn = "9783030210731",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "31--38",

editor = "Gustavo Carneiro and Shaodi You",

booktitle = "Computer Vision – ACCV 2018 Workshops - 14th Asian Conference on Computer Vision, 2018, Revised Selected Papers",

}

TY - GEN

T1 - A Thumb Tip Wearable Device Consisting of Multiple Cameras to Measure Thumb Posture

AU - Ienaga, Naoto

AU - Kawai, Wataru

AU - Fujita, Koji

AU - Miyata, Natsuki

AU - Sugiura, Yuta

AU - Saito, Hideo

N1 - Funding Information: Acknowledgements. This work was supported by JST AIP-PRISM Grant Number JPMJCR18Y2, Grant-in-Aid for JSPS Research Fellow Grant Number JP17J05489. Publisher Copyright: © 2019, Springer Nature Switzerland AG.

PY - 2019

Y1 - 2019

N2 - Today, cameras have become smaller and cheaper and can be utilized in various scenes. We took advantage of that to develop a thumb tip wearable device to estimate joint angles of a thumb as measuring human finger postures is important in terms of human-computer interface and to analyze human behavior. The device we developed consists of three small cameras attached at different angles so the cameras can capture the four fingers. We assumed that the appearance of the four fingers would change depending on the joint angles of the thumb. We made a convolutional neural network learn a regression relationship between the joint angles of the thumb and the images taken by the cameras. In this paper, we captured the keypoint positions of the thumb with a USB sensor device and calculated the joint angles to construct a dataset. The root mean squared error of the test data was 6.23° and 4.75° .

AB - Today, cameras have become smaller and cheaper and can be utilized in various scenes. We took advantage of that to develop a thumb tip wearable device to estimate joint angles of a thumb as measuring human finger postures is important in terms of human-computer interface and to analyze human behavior. The device we developed consists of three small cameras attached at different angles so the cameras can capture the four fingers. We assumed that the appearance of the four fingers would change depending on the joint angles of the thumb. We made a convolutional neural network learn a regression relationship between the joint angles of the thumb and the images taken by the cameras. In this paper, we captured the keypoint positions of the thumb with a USB sensor device and calculated the joint angles to construct a dataset. The root mean squared error of the test data was 6.23° and 4.75° .

KW - Human computer interaction

KW - Pose estimation

KW - Wearable device

UR - http://www.scopus.com/inward/record.url?scp=85068437647&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85068437647&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-21074-8_3

DO - 10.1007/978-3-030-21074-8_3

M3 - Conference contribution

AN - SCOPUS:85068437647

SN - 9783030210731

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 31

EP - 38

BT - Computer Vision – ACCV 2018 Workshops - 14th Asian Conference on Computer Vision, 2018, Revised Selected Papers

A2 - Carneiro, Gustavo

A2 - You, Shaodi

PB - Springer Verlag

T2 - 14th Asian Conference on Computer Vision, ACCV 2018

Y2 - 2 December 2018 through 6 December 2018

ER -

A Thumb Tip Wearable Device Consisting of Multiple Cameras to Measure Thumb Posture

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this