提出分层回溯精炼框架,提升生成图像检测的准确性与泛化能力。
HRR: Hierarchical Retrospection Refinement for Generated Image Detection
- 设计多尺度风格回溯模块,增强模型对不同尺寸和风格图像的适应性。
- 引入相关性稀疏加法机机制,有效过滤冗余特征,提升检测精度。
- 适用于跨模型、跨风格的生成图像检测,尤其适合实际应用场景。
生成式人工智能存在滥用风险,生成图像检测成为研究重点。现有方法多针对特定生成模型,强调合成区域定位,却忽视了图像尺寸和风格对模型学习的干扰。本文旨在解决根本问题:图像真实与否?为此提出基于扩散模型的生成图像检测框架HRR。设计多尺度风格回溯模块,促使模型生成细节丰富且真实的多尺度表示,缓解数据集风格与生成模型带来的学习偏差。同时,基于相关性稀疏加法机原理,设计特征精炼模块,降低冗余特征影响,捕捉数据内在结构与模式,从而提升模型泛化能力。大量实验表明,HRR在生成图像检测任务中持续显著优于当前最优方法。
原文摘要 · Abstract (English)
Generative artificial intelligence holds significant potential for abuse, and generative image detection has become a key focus of research. However, existing methods primarily focused on detecting a specific generative model and emphasizing the localization of synthetic regions, while neglecting the interference caused by image size and style on model learning. Our goal is to reach a fundamental conclusion: Is the image real or generated? To this end, we propose a diffusion model-based generative image detection framework termed Hierarchical Retrospection Refinement~(HRR). It designs a multi-scale style retrospection module that encourages the model to generate detailed and realistic multi-scale representations, while alleviating the learning biases introduced by dataset styles and generative models. Additionally, based on the principle of correntropy sparse additive machine, a feature refinement module is designed to reduce the impact of redundant features on learning and capture the intrinsic structure and patterns of the data, thereby improving the model's generalization ability. Extensive experiments demonstrate the HRR framework consistently delivers significant performance improvements, outperforming state-of-the-art methods in generated image detection task.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。