通过视觉细节增强自修正,提升人脸伪造检测的准确与可解释性。
CorrDetail: Visual Detail Enhanced Self-Correction for Face Forgery Detection

- 引入错误引导提问机制,自动修正伪造细节识别
- 在Celeb-DFv2数据集上达到98.7%准确率,优于现有方法
- 适合需要高精度与可解释性的安全防护场景
随着图像生成技术的快速发展,人脸深度伪造广泛出现,对安全领域构成严峻挑战,亟需高效检测方法。现有检测技术主要分为基于视觉的方法和多模态方法:前者缺乏伪造细节解释,后者易产生幻觉。为此,本文提出视觉细节增强自修正框架CorrDetail,通过错误引导提问机制纠正真实伪造细节,避免生成虚假信息。同时引入细粒度视觉增强模块,提供更精准的伪造线索,并设计融合决策策略,结合视觉补偿与模型偏差减少,提升极端样本判别能力。实验表明,CorrDetail在性能上达到当前最优,在Celeb-DFv2数据集上准确率达98.7%,且具备强泛化能力。
原文摘要 · Abstract (English)
With the swift progression of image generation technology, the widespread emergence of facial deepfakes poses significant challenges to the field of security, thus amplifying the urgent need for effective deepfake detection.Existing techniques for face forgery detection can broadly be categorized into two primary groups: visual-based methods and multimodal approaches. The former often lacks clear explanations for forgery details, while the latter, which merges visual and linguistic modalities, is more prone to the issue of hallucinations.To address these shortcomings, we introduce a visual detail enhanced self-correction framework, designated CorrDetail, for interpretable face forgery detection. CorrDetail is meticulously designed to rectify authentic forgery details when provided with error-guided questioning, with the aim of fostering the ability to uncover forgery details rather than yielding hallucinated responses. Additionally, to bolster the reliability of its findings, a visual fine-grained detail enhancement module is incorporated, supplying CorrDetail with more precise visual forgery details. Ultimately, a fusion decision strategy is devised to further augment the model's discriminative capacity in handling extreme samples, through the integration of visual information compensation and model bias reduction.Experimental results demonstrate that CorrDetail not only achieves state-of-the-art performance compared to the latest methodologies but also excels in accurately identifying forged details, all while exhibiting robust generalization capabilities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。