arXiv:2608.15238cs.CV2026-08中稿 · ECCV

用统一框架让大模型同时学视觉特征和语言解释,提升假图检测准确率。

UC-VLM: Consistency-Driven Learning for AI-Generated Image Detection with Vision-Language Large Models

论文配图:UC-VLM: Consistency-Driven Learning for AI-Generated Image Detection with Vision-Language Large Models
图 1 · 摘自论文原文
  • 自动优化指令,仅用真假标签训练,无需人工写提示或理由。
  • 在GenImage上达96.1%准确率,比最强基线高4.6%。
  • 适合需要高精度、少人工标注的假图检测场景。

视觉-语言大模型(VLLMs)在生成图像检测中具有潜力,因其可同时输出预测与自然语言解释。然而,现有方法多仅微调语言分支,忽视低层视觉取证特征,且依赖手工提示或人工标注理由,限制可扩展性。本文提出UC-VLM,一种仅需二元监督的统一多阶段框架:首先自动识别有效指令变体,再在多阶段训练中复用同一二元标签——(i) 视觉判别目标增强对非语义取证线索的敏感度;(ii) 标签条件生成目标利用二元标签监督文本输出。该设计将弱二元监督转化为视觉路径与语言输出的共享信号。核心创新在于:统一多阶段二元监督框架,一致复用真实标签进行视觉适应与条件文本生成,并通过自动优化指令降低提示敏感性,无需人工撰写提示或理由。实验表明,UC-VLM在GenImage上平均准确率达96.1%,超过最强基线4.6%;在Chameleon上,基于ProGAN/SDV1.4训练,分别达到69.6%/77.9%准确率,优于最佳基线11.2%/15.3%。

原文摘要 · Abstract (English)

Vision-Language Large Models (VLLMs) are promising for AI-generated image (AIGI) detection because they can produce both a prediction and a natural-language output. However, most existing VLLM-based detectors primarily fine-tune the language side while giving limited attention to low-level visual forensic cues. They also often depend on manually crafted prompts or human-annotated rationales, which limits scalability.We present UC-VLM, a unified multi-stage framework for AIGI detection that relies solely on binary supervision. UC-VLM first identifies effective instruction variants automatically. It then reuses the same binary label within a multi-stage training framework: (i) a visual discrimination objective that strengthens sensitivity to non-semantic forensic cues, and (ii) a label-conditioned generation objective that uses the binary label to supervise textual outputs. This design turns weak binary supervision into a shared supervision signal for both the visual pathway and the language output. Our key novelty is a unified multi-stage binary-supervised framework that consistently reuses the same authenticity labels for visual adaptation and label-conditioned text generation, while leveraging automatically optimized instructions to reduce prompt sensitivity without requiring human-written rationales or hand-crafted prompts.Experiments show that UC-VLM achieves 96.1% average accuracy on GenImage, exceeding the strongest prior result by 4.6%, and obtains 69.6% / 77.9% accuracy on Chameleon under ProGAN / SDV1.4 training, surpassing the best baseline by 11.2% / 15.3%, respectively.

假图检测多模态自监督大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。