Open Access Open Access  Restricted Access Subscription Access

A Survey on Deepfake Analysis and Recognition using Deep Learning

Deepak N R, Mohamed Aweez Akram, Mohammed Adnan K, Mohammed Shibil, Shameema Banu R

Abstract


The recent advancements in the field of artificial intelligence, deep learning and image processing, has led to the rise of a software called deepfake. It is a tool that can produce extreme transformations in human faces like aging, gender swap, etc., and can make someone say and do things which never happened in reality. The resulting content produced are utterly realistic, which can be highly dangerous and may have the potential of altering the truth and eroding trust by giving false reality. Deepfakes can have negative or positive implications on society. It can be used in different domains like advertising, creative arts, film production, video games, etc., to name a few. But it could also pose huge security threats like influence the public opinion during elections, perpetrate fraud or blackmail someone. Current solutions can be used to recognize only specific manipulation techniques like splicing, colouring, etc., and results provided have poor accuracy. Hence, there is a need for automated tools competent of detecting fake multimedia content.


Full Text:

PDF

References


Boulkenafet, Z., Komulainen, J., & Hadid, A. (2016). Face spoofing detection using colour texture analysis. IEEE Transactions on Information Forensics and Security, 11(8), 1818-1830.

Jin, Z., Cao, J., Zhang, Y., Zhou, J., & Tian, Q. (2016). Novel visual and statistical image features for microblogs news verification. IEEE transactions on multimedia, 19(3), 598-608.

Bappy, J. H., Simons, C., Nataraj, L., Manjunath, B. S., & Roy-Chowdhury, A. K. (2019). Hybrid LSTM and encoder–decoder architecture for detection of image forgeries. IEEE Transactions on Image Processing, 28(7), 3286-3300.

Guo, Y., Cao, X., Zhang, W., & Wang, R. (2018). Fake colorized image detection. IEEE Transactions on Information Forensics and Security, 13(8), 1932-1944.

Mayer, O., & Stamm, M. C. (2018). Accurate and efficient image forgery detection using lateral chromatic aberration. IEEE Transactions on information forensics and security, 13(7), 1762-1777.

Moreira, D., Bharati, A., Brogan, J., Pinto, A., Parowski, M., Bowyer, K. W., ... & Scheirer, W. J. (2018). Image provenance analysis at scale. IEEE Transactions on Image Processing, 27(12), 6109-6123.

Mi, Z., Jiang, X., Sun, T., & Xu, K. (2020). GAN-Generated Image Detection With Self-Attention Mechanism Against GAN Generator Defect. IEEE Journal of Selected Topics in Signal Processing, 14(5), 969-981.

Neves, J. C., Tolosana, R., Vera-Rodriguez, R., Lopes, V., Proença, H., & Fierrez, J. (2020). Ganprintr: Improved fakes and evaluation of the state of the art in face manipulation detection. IEEE Journal of Selected Topics in Signal Processing, 14(5), 1038-1048.

Song, C., Zeng, P., Wang, Z., Li, T., Qiao, L., & Shen, L. (2019). Image forgery detection based on motion blur estimated using convolutional neural network. IEEE Sensors Journal, 19(23), 11601-11611.

Verdoliva, L. (2020). Media forensics and deepfakes: an overview. IEEE Journal of Selected Topics in Signal Processing, 14(5), 910-932.


Refbacks

  • There are currently no refbacks.