On face segmentation, face swapping, and face perception

Yuval Nirkin, Iacopo Masi, Anh Trǎn Tuǎn, Tal Hassner, Gérard Medioni

פרסום מחקרי: פרק בספר / בדוח / בכנספרסום בספר כנסביקורת עמיתים

תקציר

We show that even when face images are unconstrained and arbitrarily paired, face swapping between them is quite simple. To this end, we make the following contributions. (a) Instead of tailoring systems for face segmentation, as others previously proposed, we show that a standard fully convolutional network (FCN) can achieve remarkably fast and accurate segmentations, provided that it is trained on a rich enough example set. For this purpose, we describe novel data collection and generation routines which provide challenging segmented face examples. (b) We use our segmentations for robust face swapping under unprecedented conditions. (c) Unlike previous work, our swapping is robust enough to allow for extensive quantitative tests. To this end, we use the Labeled Faces in the Wild (LFW) benchmark and measure the effect of intra- and inter-subject face swapping on recognition. We show that our intra-subject swapped faces remain as recognizable as their sources, testifying to the effectiveness of our method. In line with established perceptual studies, we show that better face swapping produces less recognizable inter-subject results. This is the first time this effect was quantitatively demonstrated by machine vision systems.

שפה מקוריתאנגלית
כותר פרסום המארחProceedings - 13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018
מוציא לאורInstitute of Electrical and Electronics Engineers Inc.
עמודים98-105
מספר עמודים8
מסת"ב (אלקטרוני)9781538623350
מזהי עצם דיגיטלי (DOIs)
סטטוס פרסוםפורסם - 5 יוני 2018
אירוע13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018 - Xi'an, סין
משך הזמן: 15 מאי 201819 מאי 2018

סדרות פרסומים

שםProceedings - 13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018

כנס

כנס13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018
מדינה/אזורסין
עירXi'an
תקופה15/05/1819/05/18

הערה ביבליוגרפית

Publisher Copyright:
© 2018 IEEE.

טביעת אצבע

להלן מוצגים תחומי המחקר של הפרסום 'On face segmentation, face swapping, and face perception'. יחד הם יוצרים טביעת אצבע ייחודית.

פורמט ציטוט ביבליוגרפי