arXiv:2605.08574cs.CVcs.LG2026-05

提升合成图像检测的可靠性,让模型在不确定时主动放弃判断。

Post-hoc Selective Classification for Reliable Synthetic Image Detection

论文配图:Post-hoc Selective Classification for Reliable Synthetic Image Detection
图 1 · 摘自论文原文
  • 从中间层提取特征,改进置信度计算方法
  • 在常见数据偏移下,置信度准确率提升69.55%(AURC下降)
  • 无需重训练,适合实际部署的后处理方案

随着合成图像日益逼真,可靠检测技术亟需应对滥用风险。尽管深度神经网络在分布内表现良好,但在实际部署中面对常见协变量偏移时可靠性差,导致检测准确率下降。为降低误判风险,本文采用事后选择性分类(SC)策略,允许检测器在置信度低时放弃预测。针对无需重训练的后处理方法,我们发现传统基于对数几率的置信度函数在偏移下表现异常,甚至劣于随机猜测。为此,提出可靠的合成图像检测框架ReSIDe:首先从中心匹配视角推广对数几率概念至中间层,使基于对数几率的置信度函数可应用于任意层;其次设计偏好优化算法,通过最小化风险-覆盖率曲线下面积(AURC)上界,聚合多层置信度得到最终估计。大量实验表明,ReSIDe显著提升多种对数几率类置信度函数在常见协变量偏移下的选择性分类性能,最高实现69.55%的AURC降幅。

原文摘要 · Abstract (English)

As synthetic images become increasingly realistic, reliable synthetic image detection techniques are of pressing need to prevent their misuse. Despite satisfactory in-distribution performance, deep neural network-based synthetic image detectors (SIDs) lack reliability in deployment and often fail in the presence of common covariate shifts, resulting in poor detection accuracy. To avoid the risk caused by potential errors, we adopt a selective classification (SC) strategy by allowing SIDs to abstain from making low confidence predictions. For practicality, we focus on post-hoc methods which perform confidence estimation on a given SID without retraining. However, we show that conventional logit-based confidence score functions (CSFs) exhibit pathological behavior under covariate shifts, leading to SC performance close to or even worse than random guessing. To address this, we propose a simple yet effective SC framework for Reliable Synthetic Image Detection (ReSIDe). First, we generalize the notion of logits to an SID's intermediate layers from a centroid matching perspective, extending the use of logit-based CSFs to any layer of an SID. Then, we introduce a preference optimization algorithm that aggregates confidence scores extracted from different layers to a final confidence estimate by minimizing an upper bound of the area under the risk-coverage curve (AURC). Extensive experimental results show that ReSIDe significantly boosts the SC performance of various logit-based CSFs under common covariate shifts, achieving up to 69.55% AURC reduction.

图像检测置信度估计选择性分类合成内容

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。