Accurate 3D face reconstruction via prior constrained structure from motion

Matthias Hernandez, Tal Hassner, Jongmoo Choi, Gerard Medioni

نتاج البحث: نشر في مجلةمقالةمراجعة النظراء


We propose a novel structure from motion (SfM) based method for reconstructing the 3D shapes of faces appearing in unconstrained videos. SfM techniques were studied since the early days of computer vision and their limitations are well known. In particular, they are unsuited for the low resolution scenes typical of videos of faces in the wild. To address this, we propose using a parametric face representation as a shape prior to constrain the estimated 3D face shape. Our proposed reconstruction method explores the space around the prior, modifying its 3D shape along with the estimated, per frame cameras and expressions in a manner designed to maximize photometric consistency across video frames yet produce face shapes. Our tests show that this process is both faster and provides superior 3D reconstruction accuracy when compared to existing alternatives.

اللغة الأصليةالإنجليزيّة
الصفحات (من إلى)14-22
عدد الصفحات9
دوريةComputers and Graphics
مستوى الصوت66
المعرِّفات الرقمية للأشياء
حالة النشرنُشِر - أغسطس 2017

ملاحظة ببليوغرافية

Funding Information:
This research is based upon work supported in part by the Office of the Director of National Intelligence (ODNI), Intelligence Advanced Research Projects Activity (IARPA), via IARPA 2014?14071600011. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of ODNI, IARPA, or the U.S. Government. The U.S. Government is authorized to reproduce and distribute reprints for Governmental purpose notwithstanding any copyright annotation thereon. Preprint.

Publisher Copyright:
© 2017 Elsevier Ltd


أدرس بدقة موضوعات البحث “Accurate 3D face reconstruction via prior constrained structure from motion'. فهما يشكلان معًا بصمة فريدة.

قم بذكر هذا