arXiv:2512.06746cs.CVcs.AI2025-12被引 3

通过任务-模型对齐,提升AI生成图像检测的泛化能力。

AlignGemini: Generalizable AI-Generated Image Detection Through Task-Model Alignment

  • 将检测任务拆分为语义一致性与像素伪影两类,分别用不同模型专攻。
  • 在真实场景数据上平均准确率提升9.5%,且训练数据更简化。
  • 适合需要高泛化性的AIGI检测应用,如内容审核与安全验证。

视觉语言模型(VLMs)被广泛用于检测AI生成图像(AIGI),但将其转化为可靠检测器成本高昂,且常出现幻觉和泛化性能差的问题。我们通过实证分析发现两个一致现象:以语义监督微调的VLM能提升语义区分能力并良好泛化到未见数据;而以像素伪影监督微调的VLM则泛化能力弱。这揭示了根本的任务-模型错配:VLM擅长高层语义推理,缺乏对低层像素伪影的归纳偏置;而传统视觉模型虽能捕捉像素级伪影,却对语义不一致敏感度不足。因此,我们提出将AIGI检测分解为两个正交子任务:语义一致性检查与像素伪影检测。忽略任一任务都会导致系统性误检。基于此,我们提出任务-模型对齐原则,并构建双分支检测器AlignGemini:一个仅用语义监督训练的VLM分支,一个仅用像素伪影监督训练的视觉模型分支。通过强制分工,两分支互补提取线索。在真实场景基准测试中,使用简化训练数据,AlignGemini平均准确率提升9.5%。结果表明,任务-模型对齐是实现可泛化AIGI检测的有效范式。

原文摘要 · Abstract (English)

Vision Language Models (VLMs) are increasingly used for detecting AI-generated images (AIGI). However, converting VLMs into reliable detectors is resource-intensive, and the resulting models often suffer from hallucination and poor generalization. To investigate the root cause, we conduct an empirical analysis and identify two consistent behaviors. First, fine-tuning VLMs with semantic supervision improves semantic discrimination and generalizes well to unseen data. Second, fine-tuning VLMs with pixel-artifact supervision leads to weak generalization. These findings reveal a fundamental task-model misalignment. VLMs are optimized for high-level semantic reasoning and lack inductive bias toward low-level pixel artifacts. In contrast, conventional vision models effectively capture pixel-level artifacts but are less sensitive to semantic inconsistencies. This indicates that different models are naturally suited to different subtasks. Based on this insight, we formulate AIGI detection as two orthogonal subtasks: semantic consistency checking and pixel-artifact detection. Neglecting either subtask leads to systematic detection failures. We further propose the Task-Model Alignment principle and instantiate it in a two-branch detector, AlignGemini. The detector combines a VLM trained with pure semantic supervision and a vision model trained with pure pixel-artifact supervision. By enforcing clear specialization, each branch captures complementary cues. Experiments on in-the-wild benchmarks show that AlignGemini improves average accuracy by 9.5 percent using simplified training data. These results demonstrate that task-model alignment is an effective principle for generalizable AIGI detection.

图像检测VLM泛化能力生成内容

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。