Deepfakes and beyond: A Survey of face manipulation and fake detection

The free access to large-scale public databases, together with the fast progress of deep learning techniques, in particular Generative Adversarial Networks, have led to the generation of very realistic fake content with its corresponding implications towards society in this era of fake news. This su...

Full description

Bibliographic Details
Authors: Tolosana Moranchel, Rubén, Vera Rodríguez, Rubén, Fiérrez Aguilar, Julián, Morales Moreno, Aythami, Ortega García, Javier
Format: article
Publication Date:2020
Country:España
Institution:Universidad Autónoma de Madrid
Repository:Biblos-e Archivo. Repositorio Institucional de la UAM
Language:English
OAI Identifier:oai:repositorio.uam.es:10486/702969
Online Access:http://hdl.handle.net/10486/702969
https://dx.doi.org/10.1016/j.inffus.2020.06.014
Access Level:Open access
Keyword:Benchmark
Databases
Deepfakes
Face manipulation
Face recognition
Fake news
Media forensics
Telecomunicaciones
Description
Summary:The free access to large-scale public databases, together with the fast progress of deep learning techniques, in particular Generative Adversarial Networks, have led to the generation of very realistic fake content with its corresponding implications towards society in this era of fake news. This survey provides a thorough review of techniques for manipulating face images including DeepFake methods, and methods to detect such manipulations. In particular, four types of facial manipulation are reviewed: i) entire face synthesis, ii) identity swap (DeepFakes), iii) attribute manipulation, and iv) expression swap. For each manipulation group, we provide details regarding manipulation techniques, existing public databases, and key benchmarks for technology evaluation of fake detection methods, including a summary of results from those evaluations. Among all the aspects discussed in the survey, we pay special attention to the latest generation of DeepFakes, highlighting its improvements and challenges for fake detection. In addition to the survey information, we also discuss open issues and future trends that should be considered to advance in the field