arXiv:2603.27800cs.CV2026-03被引 3

通过数据与特征多样性提升生成图像检测泛化能力

Diversity Matters: Dataset Diversification and Dual-Branch Network for Generalized AI-Generated Image Detection

  • 用特征域相似性过滤剔除冗余样本,增强训练集多样性
  • 双分支网络融合像素与频域CLIP特征,捕捉语义与结构线索
  • 在跨模型、跨数据集测试中显著优于现有方法

生成对抗网络(GAN)、扩散模型等合成技术的快速发展,导致大量AI生成图像泛滥,引发虚假信息、版权侵犯和数字安全等问题。然而,由于生成模型与数据分布的极大多样性,实现通用且鲁棒的检测仍是重大挑战。本文提出「Diversity Matters」框架,强调数据多样性和特征域互补性。该方法引入特征域相似性过滤机制,剔除类别间与类别内高度相似的样本,确保训练集更具代表性。同时设计双分支网络,联合使用像素域与频域的CLIP特征,协同捕捉语义与结构信息,提升对未见生成模型及对抗条件的泛化能力。在多个基准数据集上的实验表明,所提方法在跨模型与跨数据集场景下的性能显著优于现有方法。研究凸显了数据与特征多样性在构建可靠合成内容检测器中的关键作用。

原文摘要 · Abstract (English)

The rapid proliferation of AI-generated images, powered by generative adversarial networks (GANs), diffusion models, and other synthesis techniques, has raised serious concerns about misinformation, copyright violations, and digital security. However, detecting such images in a generalized and robust manner remains a major challenge due to the vast diversity of generative models and data distributions. In this work, we present \textbf{Diversity Matters}, a novel framework that emphasizes data diversity and feature domain complementarity for AI-generated image detection. The proposed method introduces a feature-domain similarity filtering mechanism that discards redundant or highly similar samples across both inter-class and intra-class distributions, ensuring a more diverse and representative training set. Furthermore, we propose a dual-branch network that combines CLIP features from the pixel domain and the frequency domain to jointly capture semantic and structural cues, leading to improved generalization against unseen generative models and adversarial conditions. Extensive experiments on benchmark datasets demonstrate that the proposed approach significantly improves cross-model and cross-dataset performance compared to existing methods. \textbf{Diversity Matters} highlights the critical role of data and feature diversity in building reliable and robust detectors against the rapidly evolving landscape of synthetic content.

图像检测生成模型数据多样性双分支网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。