复现7篇AIGC检测论文,发现方法难复现主因是细节缺失和过拟合。
Exploration of Reproducible Generated Image Detection
- 复现经典检测方法,验证关键步骤与参数影响
- 跨生成器测试时性能骤降,暴露泛化能力不足
- 建议公开完整实验细节,提升方法可复现性
尽管AI生成内容(AIGC)图像检测技术发展迅速,但其仍面临可复现性差和泛化能力不足的核心问题,制约了实际应用。本研究回顾了7篇关键AIGC检测论文,构建轻量级测试数据集,并复现其中代表性检测方法。结果表明:严格遵循原始论文核心流程时,基本性能可被复现;但一旦预处理破坏关键特征或在不同生成器间测试,性能显著下降。根本原因在于:多数论文省略了预处理步骤、参数设置等隐含细节;且检测方法过度依赖特定生成器的专属特征,而非学习通用的AIGC内在特征。该研究为提升AIGC检测技术的可复现性提供了实证依据,并建议研究者更全面披露实验细节,验证方法的泛化能力。
原文摘要 · Abstract (English)
While the technology for detecting AI-Generated Content (AIGC) images has advanced rapidly, the field still faces two core issues: poor reproducibility and insufficient gen eralizability, which hinder the practical application of such technologies. This study addresses these challenges by re viewing 7 key papers on AIGC detection, constructing a lightweight test dataset, and reproducing a representative detection method. Through this process, we identify the root causes of the reproducibility dilemma in the field: firstly, papers often omit implicit details such as prepro cessing steps and parameter settings; secondly, most detec tion methods overfit to exclusive features of specific gener ators rather than learning universal intrinsic features of AIGC images. Experimental results show that basic perfor mance can be reproduced when strictly following the core procedures described in the original papers. However, de tection performance drops sharply when preprocessing dis rupts key features or when testing across different genera tors. This research provides empirical evidence for improv ing the reproducibility of AIGC detection technologies and offers reference directions for researchers to disclose ex perimental details more comprehensively and verify the generalizability of their proposed methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。