提出检测框架,量化AI生成图像检测器的转换偏差
BIAS-ID: A Framework for Analyzing Transformation Biases in AI-Generated Image Detectors
- 构建透明分析框架,识别检测器对图像变换的依赖偏差
- 六款主流检测器在两个数据集上均显显著偏差
- 适合关注检测器可靠性与公平性的研究人员
随着网络上有害AI生成图像激增,可靠区分真实图像与生成图像已成为紧迫研究课题。尽管许多检测方法在受控环境下表现良好,但在真实数据上常失效。潜在根源在于检测器训练数据中的细微偏差,导致其依赖虚假相关性而非真实取证特征。虽然已有研究指出此问题,但尚无统一评估协议。本文首先厘清偏差与鲁棒性不足的区别,随后提出BIAS-ID框架,用于分析和量化AI生成图像检测器中的转换偏差。我们在两个数据集上对六种检测器进行评估,发现多个前沿方法严重受偏差影响。结果强调了在开发可靠检测器时进行偏差感知评估的重要性。
原文摘要 · Abstract (English)
Given the surge of harmful AI-generated imagery online, reliably distinguishing authentic images from generated ones has become an urgent research topic. While many proposed detection methods perform well under controlled settings, they often collapse when tested on real-world data. A potential root cause are subtle biases in the detectors' training data. As a result, detectors may rely on spurious correlations instead of learning true forensic artifacts. While a recent line of work has identified the problem, there is not yet an established protocol to evaluate how biased a detector actually is. In this work, we therefore take a step back: First, we discuss what it means for a detector to be biased, and how this differs from a lack of robustness. Second, we propose BIAS-ID, a transparent framework for analyzing and quantifying the presence of transformation biases in AI-generated image detectors. We validate our framework by performing an evaluation of six detectors across two datasets, revealing that several state-of-the-art detection methods are strongly affected by biases. Our results highlight the importance of bias-aware evaluation for developing reliable AI-generated image detectors.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。