Open Access Open Access  Restricted Access Subscription Access

MULTIMEDIA DEEPFAKE DETECTION

Prof. Nisha Rose, Lijina K, Fathimathul Jumana, Sayana K, Gopichandana V

Abstract


In tech-enabled communities, social media allows users to access multimedia content easily. With recent advancements in computer vision and natural language processing, machine learning (ML) and deep learning (DL) models have evolved. With advancements in generative adversarial networks (GAN), it has become possible to create synthetic media of a person or use some person’s contents to fit other environments. Deepfakes are fake media generated using advanced tools and applications, which may mislead people and create an issue of trust within communities. Detecting fakes is crucial and essential for maintaining trust in the digital world. This paper aims to review the current landscape of deepfake generation, detections, methodologies, and implementation based on certain factors. It also gives an idea about the risks, accuracy, and efficiency related to each work. This paper analyzes a variety of methods put out in recent literature to provide a thorough evaluation of the body of research on deepfake detection and also proposes a system. We rigorously divide these strategies into three categories: feature-based, temporal-based, and deep feature-based. We next evaluate each technique’s detection accuracy, computing efficiency, and ability to adjust to changing deepfake methods. Important issues are discussed in our comparison analysis.


Full Text:

PDF

References


Jerry John, Ms. Bismin V. Sherif, ”Comparative Analysis on Different DeepFake Detection Methods and Semi Supervised GAN Architecture for DeepFake Detection” -Proceedings of the Sixth International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC-2022). IEEE Xplore Part Number: CFP22OSV-ART; ISBN: 978-1-6654-6941-8

Preeti, Manoj Kumar , Hitesh Kumar Sharma - ”A GAN- Based Model of Deepfake Detection in Social Media” - Peer- review under responsibility of the scientific committee of the International Conference on Machine Learning and Data Engineering

Moaiad Ahmed Khder, Mohammed Mansoor Saeed- “Artificial Intelligence into Multimedia Deepfakes Creation and Detection” - 2023 International Conference on IT Innovation and Knowledge Discovery (ITIKD).

Preeti Sharma, Manoj Kumar, Hitesh Kumar Sharma , ”GAN- CNN Ensemble: A Robust Deepfake Detection Model of Social Media Images Using Minimized Catastrophic Forgetting and Generative Replay Technique”-International Conference on Machine Learning and Data Engineering (ICMLDE 20

Haewon Byeon , Mohammad Shabaz b, Kapil Shrivastava- “Deep learning model to detect deceptive generative adversarial network generated images using multimedia forensic”-

D. Pan, L. Sun, R. Wang, X. Zhang, and R. O. Sinnott, “Deep- fake detection through deep learning,” in 2020 IEEE/ACM In- ternational Conference on Big Data Computing, Applications and Technologies (BDCAT). IEEE, 2020, pp. 134–143.

M. S. Rana, B. Murali, and A. H. Sung, “Deepfake detection using machine learning algorithms,” in 2021 10th International Congress on Advanced Applied Informatics (IIAI-AAI).IEEE, 2021, pp. 458–463.

A. Doshi, A. Venkatadri, S. Kulkarni, V. Athavale, A Jagarlapudi, S. Suratkar, and F. Kazi, “Realtime deepfake detection using video vision transformer,” in 2022 IEEE Bombay Section Signature Conference (IBSSC). IEEE, 2022, pp. 1–6.

H. Zhao, W. Zhou, D. Chen, T. Wei, W. Zhang, and N. Yu, “Multi-attentional deepfake detection,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021, pp. 2185–2194.

D. M. Montserrat, H. Hao, S. K. Yarlagadda, S. Baireddy, R. Shao, J. Horv´ath, E. Bartusiak, J. Yang, D. Guera, F. Zhu et al., “Deepfakes detection with automatic face weighting,”in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, 2020, pp. 668–669.


Refbacks

  • There are currently no refbacks.