Head pose-invariant eyelid and iris tracking method

Kimimasa Tamura, Kiyoshi Hashimoto, Yoshimitsu Aoki

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)


These days, there is more demand for a camera-based gaze estimation method for new interfaces and new marketing measurement tools. Considering these applications, the system should track a new user without any operation such as calibration. It should also admit user's natural head pose changes. Previous methods, however, need a calibration procedure before execution and have less accuracy in a head moving situation. In this paper, we propose a method which tracks the user's eyelids and iris automatically and accurately. Our method is a pretreatment of gaze estimation without any calibration and head pose restraint. First of all, we track the facial feature points from an input face image and estimate its head pose, extracting the eye region image. On the eye region image, we track the eyelid shape based on an eyelid shape model generated beforehand from PCA. Finally we track the iris inside the eyelid based on the eyeball model. The eyelid and iris tracking is processed by Particle Filter. An evaluation against a database including head pose changes confirmed that the accuracy of eyelid and iris tracking was improved compared with previous methods.

Original languageEnglish
Pages (from-to)19-27
Number of pages9
JournalElectronics and Communications in Japan
Issue number2
Publication statusPublished - 2016 Feb 1


  • 3D reconstruction
  • ASM
  • eyelid tracking
  • gaze estimation
  • interface
  • iris tracking

ASJC Scopus subject areas

  • Signal Processing
  • General Physics and Astronomy
  • Applied Mathematics
  • Electrical and Electronic Engineering
  • Computer Networks and Communications


Dive into the research topics of 'Head pose-invariant eyelid and iris tracking method'. Together they form a unique fingerprint.

Cite this