Preprint / Version 1

Deepfake Face Detection Using Transfer Learning With EfficientNet-B4

##article.authors##

  • Kavin Kumar Monta Vista High School

DOI:

https://doi.org/10.58445/rars.3910

Keywords:

Deepfake detection, Face forgery detection, EfficientNet-B4

Abstract

Deepfake media, synthetic videos generated by deep learning models, are a growing threat to information integrity, public trust, and personal privacy. This study presents a deepfake face detection system using a fine-tuned EfficientNet-B4 convolutional neural network trained on the Celeb-DF-v2 benchmark dataset. A balanced data pipeline was constructed with equal amounts of real and fake data to train, validate, and test the model. The model was trained with targeted fine tuning of the top three convolution blocks, weight decay, label smoothing, and dropout. It was finally optimized using an adaptive learning rate scheduler. The system achieves a test accuracy of 94.04% and an AUC-ROC of 0.9844 on Celeb-DF-v2, averaged across two reproducible runs. Grad-CAM visualizations confirm that the model attends to meaningful facial regions rather than artifacts in the background. To assess generalization, a second model trained on a combined Celeb-DF-v2 and FaceForensics++ set achieved 88.87% accuracy and 0.9514 AUC-ROC across both benchmarks, substantially recovering the cross-dataset performance lost by the single-dataset model. These results are competitive in comparison to published baselines on Celeb-DF-v2 and demonstrate how principled transfer learning with targeted regularization can achieve near state-of-the-art deepfake detection.

References

H. Farid, “Image Forgery Detection, “ IEEE Signal Processing Magazine, vol. 26, no.2, pp. 16-25, 2009.

https://doi.org/10.1109/MSP.2008.931079

A. Rossler, D Cozzolino, L. Verdoliva, C. Riess, J. Thies, and M. Nießner, “FaceForensics++: Learning to Detect Manipulated Facial Images,” in Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2019, pp. 1-11.

https://arxiv.org/abs/1901.08971

B. Zi, M. Chang, J. Chen, X. Ma, and Y. Jiang, “WildDeepfake: A Challenging Real-World Dataset for Deepfake Detection,” in Proceedings of the ACM International Conference on MultiMedia, 2020, pp. 2383-2390.

https://doi.org/10.1145/3394171.3413769

M. Tan and Q. Le, “Efficientnet: Rethinking Model Scaling for Convolutional Neural Networks,” in Proceedings of the International Conference on Machine Learning (ICML), 2019, pp. 6105-6114.

https://arxiv.org/abs/1905.11946

Y. Li, X. Yang, P. Sun, H. Qi, and S. Lyu, “Celeb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 3207-3216.

https://arxiv.org/abs/1909.12962

R. R. Selvaraju, M. Cogswell, A. Das, R. Vedantam, D. Parikh, and D. Batra, “Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization,” in Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2017, pp. 618-626.

https://arxiv.org/abs/1610.02391

J. Yan, Y. Luo, C. Zhao, T. Ju, Z. Huang, Y. He, H. Fan, B. Li, and S. Lyu, “DeepfakeBench: A Comprehensive Benchmark of Deepfake Detection,” in Advances in Neural Information processing Systems (NeurIPS), 2023.

https://arxiv.org/abs/2307.01426

M. Sundararajan, A. Taly and Q. Yan, “Axiomatic Attribution for Deep Networks,” in Proceedings of the International Conference on Machine Learning (ICML), 2017, pp. 3319-3328

https://arxiv.org/abs/1703.01365

K. Simonyan, A. Vedaldi, and A. Zisserman, “Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps,” in Workshop at the International Conference on Learning Representations (ICLR), 2014.

https://arxiv.org/abs/1312.6034

Downloads

Posted

2026-08-20