Open Access Open Access  Restricted Access Subscription Access

Beyond the Illusion: Next-Gen Deep Learning for Deepfake Detection

Navneet Panchayan, Ranjit Ranjan, Mohit Kumar, Amit Gupta Lavatre, Dr. Partha Roy

Abstract


Over the past few months, it became possible to create credible face exchanges in videos, almost completely without traces of manipulation, using free deep learning-based software tools. These are called "DeepFake" videos. Digital video manipulations have been present for several decades due to the good use of visual effects. Recent advances in deep learning have increased realism in fake content and accessibility in which this can be created. AI-synthesized media, popularly referred to as "Deep Fakes", or simply "DF". Now, it has become an easy task to produce such DF using artificially intelligent tools. But the major challenge is that which concerns the detection of these DF. For the reason that training of the algorithm to spot the DF is not simple. We have gone a step further to detect the DF using Convolutional Neural Network and Recurrent neural Network. The system will use a Convolution Neural network to extract frame-level features. These characteristics are used to train an RNN, learning how to classify whether a video has been manipulated, and detecting temporal inconsistencies between the frames that are introduced by the DF creation tools. Expected result for a large set of fakes is collected from that standard data set. In this benchmark task, we demonstrate the competitiveness of our system to show results with the use of a simple architecture.


Full Text:

PDF

References


Yuezun Li, Siwei Lyu, “ExposingDF Videos By Detecting Face Warping Artifacts,” in arXiv: 1811.00656v3.

Yuezun Li, Ming-Ching Chang and Siwei Lyu “Exposing AI Created Fake Videos by Detecting Eye Blinking” in arxiv.

Huy H. Nguyen , Junichi Yamagishi, and Isao Echizen “ Using capsule networks to detect forged images and videos ”.

Hyeongwoo Kim, Pablo Garrido, Ayush Tewari and Weipeng Xu “Deep Video Portraits” in arXiv: 1901.02212v2.

Umur Aybars Ciftci, ˙Ilke Demir, Lijun Yin “Detection of Synthetic Portrait Videos using Biological Signals” in arXiv: 1901.02212v2.

Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Generative adversarial nets. In NIPS, 2014.

David G¨uera and Edward J Delp. Deepfake video detection using recurrent neural networks. In AVSS, 2018.

Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition. In CVPR, 2016.

An Overview of ResNet and its Variants : https://towardsdatascience.com/an-overview-of-resnet- and-its-variants-5281e2f56035

Long Short-Term Memory: From Zero to Hero with Pytorch: https://blog.floydhub.com/long-short-term- memory-from-zero-to-hero-with-pytorch/Sequence Models And LSTM Networks


Refbacks

  • There are currently no refbacks.