Automatic eyeglasses replacement for a 3d virtual try-on system

Takumi Kobayashi, Yuta Sugiura, Hideo Saito, Yuji Uema

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)


This paper presents a 3D virtual eyeglasses try-on system for practical use. For fitting eyeglasses in a shop, consumers wish to look at themselves in a mirror while trying on various eyeglass styles. However, for people who need to wear eyeglasses for correcting problems with eyesight, it is impossible for them to clearly observe their face in the mirror without wearing eyeglasses. This makes fitting them for new eyeglasses difficult. This research proposes a virtual try-on system that can be used while wearing eyeglasses.We replace the user's eyeglasses in the input video with new eyeglasses virtually. Moreover, a fast and accurate face tracking tool enables our system to automatically display 3D virtual glasses following a user's head motion. Experimental results demonstrate that the proposed method can render virtual glasses naturally while the user is wearing real eyeglasses.

Original languageEnglish
Title of host publicationProceedings of the 10th Augmented Human International Conference, AH 2019
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450365475
Publication statusPublished - 2019 Mar 11
Event10th Augmented Human International Conference, AH 2019 - Reims, France
Duration: 2019 Mar 112019 Mar 12

Publication series

NameACM International Conference Proceeding Series


Conference10th Augmented Human International Conference, AH 2019


  • Augmented reality
  • Eyeglasses removal
  • Mixed reality
  • Virtual try-on

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications


Dive into the research topics of 'Automatic eyeglasses replacement for a 3d virtual try-on system'. Together they form a unique fingerprint.

Cite this