用不确定性驱动主动学习提升伪造人脸检测的可靠性
Evidence-based Decision Modeling for Synthetic Face Detection with Uncertainty-driven Active Learning
- 基于狄利克雷分布建模类别证据,显式捕捉预测不确定性
- 在未知样本上准确率提升15%,优于当前最优方法
- 减少标注成本,适合数据稀缺场景下的实际部署
随着深度生成模型的快速发展,伪造人脸图像被广泛用于非法活动。尽管现有伪造人脸检测方法已取得显著进展,但其依赖Softmax激活函数,存在固有的过度自信问题,导致在遇到分布外(OOD)图像时预测不可靠,且无法衡量模型不确定性。同时,多数方法需大量高质量标注数据,限制了其在多样场景中的应用。为此,我们提出EMSFD(基于证据决策的伪造人脸检测与不确定性驱动主动学习),通过狄利克雷分布建模类别证据,将模型不确定性显式融入预测过程。训练中,利用估计的不确定性从无标签数据池中优先选择更具信息量的样本进行标注,降低标注成本并提升模型泛化能力。大量实验表明,该方法显著增强了检测可解释性,在多个基准上相比现有最先进(SOTA)方法准确率提升15%,验证了其优越的检测性能与泛化能力。代码已开源:https://github.com/hzx111621/EMSFD。
原文摘要 · Abstract (English)
With the rapid development of deep generative models, forged facial images are massively exploited for illegal activities. Although existing synthetic face detection methods have achieved significant progress, they suffer from the inherent limitation of overconfidence due to their reliance on the Softmax activation function. Thus, these methods often lead to unreliable predictions when encountering unknown Out-of-Distribution (OOD) images, and cannot ascertain the model's uncertainty in its prediction. Meanwhile, most existing methods require massive high-quality annotated data, which greatly limits their practicability across diverse scenarios. To address these limitations, we propose EMSFD (Evidence-based decision Modeling for Synthetic Face Detection with uncertainty-driven active learning), an approach designed to enhance detection reliability and generalizability. Specifically, EMSFD models class evidence using the Dirichlet distribution and explicitly incorporates model uncertainty into the prediction process. Furthermore, during training, the estimated uncertainty is exploited to prioritize more informative samples from the unlabeled pool for annotation, thereby reducing labeling cost and improving model generalization. Extensive experimental evaluations demonstrate that our method enhances the interpretability of synthetic face detection. Meanwhile, our method yields a 15\% increase in accuracy compared to existing state-of-the-art (SOTA) baselines, which demonstrates the superior detection performance and generalizability of our approach. Our code is available at: https://github.com/hzx111621/EMSFD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。