3D head pose tracking using a particle filter with nose template matching

Hitoshi Kubota, Masami Takeshi, Hideo Saito

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)


In this paper, we propose a method for real-time tracking of the driver's head pose in a real vehicle environment by using multiple NIR cameras. In order to achieve real-time performance and high accuracy, the head pose is estimated with six degrees of freedom by a particle filter with a restricted state space. First, the 3D position of the nostrils is measured by template matching of stereo images. Because the nostrils are the darkest area in the captured NTR images, we can detect the position of the nose robustly and very precisely. From the 3D position of the nose, we can make an initial estimate of the head pose. Then, each hypothesis is updated by prior probability with the constraint of the nose position. Thus, it is possible to reduce the number of particles while maintaining accuracy. Experimental results indicate that this method is effective for head pose tracking.

Original languageEnglish
Pages (from-to)34-42
Number of pages9
JournalElectronics and Communications in Japan
Issue number1
Publication statusPublished - 2011 Jan 1


  • driver
  • head pose tracking
  • nose hole
  • particle filter
  • template matching
  • view direction tracking

ASJC Scopus subject areas

  • Signal Processing
  • Physics and Astronomy(all)
  • Computer Networks and Communications
  • Electrical and Electronic Engineering
  • Applied Mathematics


Dive into the research topics of '3D head pose tracking using a particle filter with nose template matching'. Together they form a unique fingerprint.

Cite this