Open Access Open Access  Restricted Access Subscription Access

DEEP FAKE DETECTION USING MACHINE LEARNING

Arsha Anish, Shebin Shouckath Kolliyath, Sneha Joshy, Athira K, Revathy A S

Abstract


The recent proliferation of free, deep learning-based tools has democratized the creation of high-fidelity “deepfake” videos, where facial exchanges exhibit minimal manipulation artifacts. While advancements in visual effects have facilitated video manipulation for decades, deep learning has ushered in an era of unprecedented realism and accessibility for generating such “AI-synthesized media.” While crafting deepfakes is now relatively straightforward, their detection remains a significant challenge due to the complexities involved in training algorithms to recognize these subtle manipulations. This paper presents a novel deepfake detection method employing a combined convolutional neural network (CNN) and recurrent neural network (RNN) architecture. The CNN extracts frame-level features, and these features are subsequently fed into an RNN trained to classify videos as manipulated or authentic. The RNN’s ability to learn temporal dependencies allows it to effectively detect inconsistencies between frames, often introduced by deepfake creation tools. We evaluate our system on a comprehensive dataset of synthetic videos and demonstrate competitive performance, highlighting the potential of our relatively simple architecture in addressing this critical challenge.

 


Full Text:

PDF

References


Li, Y., & Lyu, S. (2019). Exposing deepfake videos by detecting face warping artifacts. arXiv preprint arXiv:1811.00656.

Agarwal, S., Farid, H., Gu, Y., He, M., Nagano, K., & Li, H. (2019). Protecting world leaders against deep fakes. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (pp. 38-45).

Yang, X., Li, Y., & Lyu, S. (2019). Exposing deep fakes using inconsistent head poses. ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE.

Chugh, S., Schuh, E., Jain, D. K., Kim, H., & Dogra, A. (2020). Not made for each other—Audio-Visual Dissonance- Based Deepfake Detection and Localization. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

Mittal, P., Agrawal, A., Choukse, A., Sharma, S., Pilli, E. S., & Velastin, S. A. (2020). Emotions Don’t Lie: An Audio-Visual Deepfake Detection Method using Affective Cues. Proceedings of the 28th ACM International Conference on Multimedia.

Matern, F., Riess, C., & Stamminger, M. (2019). Exploiting visual artifacts to expose deepfakes and face manipulations. In 2019 IEEE Winter Applications of Computer Vision Workshops (WACVW) (pp. 83-92). IEEE.

Guera, D., & Delp, E. J. (2018, November). Deepfake video detection using recurrent neural networks. In 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) (pp. 1-6). IEEE.

Korshunov, P., & Marcel, S. (2018). Deepfakes: a new threat to face recognition? Assessment and detection. arXiv preprint arXiv:1812.08685.


Refbacks

  • There are currently no refbacks.