Reconstruction of facial shape from freehand multi-viewpoint snapshots

Seiji Suzuki; Hideo Saito; Masaaki Mochimaru

doi:10.1007/978-3-642-10520-3_61

Reconstruction of facial shape from freehand multi-viewpoint snapshots

Seiji Suzuki, Hideo Saito, Masaaki Mochimaru

Department of Information and Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

2 Citations (Scopus)

Abstract

We propose a method that can reconstruct both a 3D facial shape and camera poses from freehand multi-viewpoint snapshots. This method is based on Active Shape Model (ASM) using a facial shape database. Most ASM methods require an image in which the camera pose is known, but our method does not require this information. First, we choose an initial shape by selecting the model from the database which is most suitable to input images. Then, we improve the model by morphing it to fit the input images. Next, we estimate the camera poses using the morphed model. Finally we repeat the process, improving both the facial shape and the camera poses until the error between the input images and the computed result is minimized. Through experimentation, we show that our method reconstructs the facial shape within 3.5 mm of the ground truth.

Original language	English
Title of host publication	Advances in Visual Computing - 5th International Symposium, ISVC 2009, Proceedings
Pages	641-650
Number of pages	10
Edition	PART 2
DOIs	https://doi.org/10.1007/978-3-642-10520-3_61
Publication status	Published - 2009
Event	5th International Symposium on Advances in Visual Computing, ISVC 2009 - Las Vegas, NV, United States Duration: 2009 Nov 30 → 2009 Dec 2

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Number	PART 2
Volume	5876 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Other

Other	5th International Symposium on Advances in Visual Computing, ISVC 2009
Country/Territory	United States
City	Las Vegas, NV
Period	09/11/30 → 09/12/2

ASJC Scopus subject areas

Theoretical Computer Science
Computer Science(all)

Access to Document

10.1007/978-3-642-10520-3_61

Cite this

Suzuki, S., Saito, H., & Mochimaru, M. (2009). Reconstruction of facial shape from freehand multi-viewpoint snapshots. In Advances in Visual Computing - 5th International Symposium, ISVC 2009, Proceedings (PART 2 ed., pp. 641-650). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5876 LNCS, No. PART 2). https://doi.org/10.1007/978-3-642-10520-3_61

Reconstruction of facial shape from freehand multi-viewpoint snapshots. / Suzuki, Seiji; Saito, Hideo; Mochimaru, Masaaki.
Advances in Visual Computing - 5th International Symposium, ISVC 2009, Proceedings. PART 2. ed. 2009. p. 641-650 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5876 LNCS, No. PART 2).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Suzuki, S, Saito, H & Mochimaru, M 2009, Reconstruction of facial shape from freehand multi-viewpoint snapshots. in Advances in Visual Computing - 5th International Symposium, ISVC 2009, Proceedings. PART 2 edn, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 2, vol. 5876 LNCS, pp. 641-650, 5th International Symposium on Advances in Visual Computing, ISVC 2009, Las Vegas, NV, United States, 09/11/30. https://doi.org/10.1007/978-3-642-10520-3_61

Suzuki S, Saito H, Mochimaru M. Reconstruction of facial shape from freehand multi-viewpoint snapshots. In Advances in Visual Computing - 5th International Symposium, ISVC 2009, Proceedings. PART 2 ed. 2009. p. 641-650. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 2). doi: 10.1007/978-3-642-10520-3_61

Suzuki, Seiji ; Saito, Hideo ; Mochimaru, Masaaki. / Reconstruction of facial shape from freehand multi-viewpoint snapshots. Advances in Visual Computing - 5th International Symposium, ISVC 2009, Proceedings. PART 2. ed. 2009. pp. 641-650 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 2).

@inproceedings{53c704985e2743e9add6ee0bc42ae6fa,

title = "Reconstruction of facial shape from freehand multi-viewpoint snapshots",

abstract = "We propose a method that can reconstruct both a 3D facial shape and camera poses from freehand multi-viewpoint snapshots. This method is based on Active Shape Model (ASM) using a facial shape database. Most ASM methods require an image in which the camera pose is known, but our method does not require this information. First, we choose an initial shape by selecting the model from the database which is most suitable to input images. Then, we improve the model by morphing it to fit the input images. Next, we estimate the camera poses using the morphed model. Finally we repeat the process, improving both the facial shape and the camera poses until the error between the input images and the computed result is minimized. Through experimentation, we show that our method reconstructs the facial shape within 3.5 mm of the ground truth.",

author = "Seiji Suzuki and Hideo Saito and Masaaki Mochimaru",

year = "2009",

doi = "10.1007/978-3-642-10520-3_61",

language = "English",

isbn = "364210519X",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

number = "PART 2",

pages = "641--650",

booktitle = "Advances in Visual Computing - 5th International Symposium, ISVC 2009, Proceedings",

edition = "PART 2",

}

TY - GEN

T1 - Reconstruction of facial shape from freehand multi-viewpoint snapshots

AU - Suzuki, Seiji

AU - Saito, Hideo

AU - Mochimaru, Masaaki

PY - 2009

Y1 - 2009

N2 - We propose a method that can reconstruct both a 3D facial shape and camera poses from freehand multi-viewpoint snapshots. This method is based on Active Shape Model (ASM) using a facial shape database. Most ASM methods require an image in which the camera pose is known, but our method does not require this information. First, we choose an initial shape by selecting the model from the database which is most suitable to input images. Then, we improve the model by morphing it to fit the input images. Next, we estimate the camera poses using the morphed model. Finally we repeat the process, improving both the facial shape and the camera poses until the error between the input images and the computed result is minimized. Through experimentation, we show that our method reconstructs the facial shape within 3.5 mm of the ground truth.

AB - We propose a method that can reconstruct both a 3D facial shape and camera poses from freehand multi-viewpoint snapshots. This method is based on Active Shape Model (ASM) using a facial shape database. Most ASM methods require an image in which the camera pose is known, but our method does not require this information. First, we choose an initial shape by selecting the model from the database which is most suitable to input images. Then, we improve the model by morphing it to fit the input images. Next, we estimate the camera poses using the morphed model. Finally we repeat the process, improving both the facial shape and the camera poses until the error between the input images and the computed result is minimized. Through experimentation, we show that our method reconstructs the facial shape within 3.5 mm of the ground truth.

UR - http://www.scopus.com/inward/record.url?scp=72449141106&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=72449141106&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-10520-3_61

DO - 10.1007/978-3-642-10520-3_61

M3 - Conference contribution

AN - SCOPUS:72449141106

SN - 364210519X

SN - 9783642105197

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 641

EP - 650

BT - Advances in Visual Computing - 5th International Symposium, ISVC 2009, Proceedings

T2 - 5th International Symposium on Advances in Visual Computing, ISVC 2009

Y2 - 30 November 2009 through 2 December 2009

ER -

Reconstruction of facial shape from freehand multi-viewpoint snapshots

Abstract

Publication series

Other

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this