arXiv:2604.27903cs.CV2026-04

提升合成图像检测的泛化能力,有效识别未见过的生成器伪造图像。

HiMix: Hierarchical Artifact-aware Mixup for Generalized Synthetic Image Detection

论文配图:HiMix: Hierarchical Artifact-aware Mixup for Generalized Synthetic Image Detection
图 1 · 摘自论文原文
  • 通过分层混合策略生成真实与虚假图像间的连续过渡样本。
  • 在多个基准上实现顶尖性能,对未见伪造手法的识别率显著提升。
  • 适合需要高泛化能力的合成内容安全检测场景。

生成模型的快速发展使得合成图像愈发逼真多样,给可靠的合成图像检测(SID)带来严峻挑战。现有检测器通常在有限且有偏的数据集上训练,难以泛化到未知生成器。为此,我们提出HiMix框架,通过扩展训练分布并增强特征中的伪影感知能力来提升泛化性。具体而言,基于Mixup的分布增强(MDA)模块构建真实与虚假图像间的连续过渡样本,提升低置信度区域覆盖,使模型接触更具挑战性的样本;像素级混合操作平滑扰动语义,增强对低层次伪影的敏感性。此外,分层伪影感知表示(HAR)模块通过跨层融合与粗到细特征整合,从全局和局部层面聚合伪影信息,从而在多种分布下提取判别性伪造特征。大量实验表明,HiMix在多个基准上达到当前最优性能,实现了更清晰的输出逻辑值,显著提升了对未见伪造手法的泛化能力。

原文摘要 · Abstract (English)

The rapid evolution of generative models has enabled the creation of highly realistic and diverse synthetic images, posing significant challenges to reliable and generalizable Synthetic Image Detection (SID). However, existing detectors are typically trained on limited and biased datasets, resulting in poor generalization to unseen generators. To address this issue, we propose HiMix, a unified framework that enhances generalization by expanding the training distribution and promoting artifact-aware representations. Specifically, the Mixup-driven Distributional Augmentation (MDA) module constructs continuous transitional samples between real and fake images, improving coverage of low-confidence regions and exposing the model to more challenging samples, while the pixel-wise mixup operation smoothly perturbs semantics to enhance sensitivity to low-level artifacts. Moreover, the Hierarchical Artifact-aware Representation (HAR) module aggregates artifact information from both global and local levels through cross-layer integration and coarse-to-fine feature fusion, enabling the extraction of discriminative forgery representations under diverse distributions. Extensive experiments across multiple benchmarks demonstrate that HiMix achieves state-of-the-art performance, establishing well-separated logits for improved generalization to unseen forgeries.

图像检测生成对抗伪影分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。