arXiv:2608.07863cs.CVeess.IV2026-08

通过视觉问答检测高分辨率生成图像,识别更准。

LHSDet: High-Resolution AI-Generated Image Detection via Visual Question Answering

论文配图:LHSDet: High-Resolution AI-Generated Image Detection via Visual Question Answering
图 1 · 摘自论文原文
  • 将检测任务转为视觉问答,融合图文信息提升敏感度
  • 设计三分支结构,捕捉局部纹理与全局特征,准确率显著提升
  • 无需预训练数据,对新生成模型泛化能力强,适合安全监管场景

随着扩散模型和自回归模型的发展,生成图像的保真度和分辨率已接近真实图像。然而,现有检测方法常对图像下采样,忽略高分辨率生成图像中的关键低级纹理细节,导致性能受限。同时,不断涌现的未知生成模型使大规模预训练数据难以获取。为此,本文提出一种新型高分辨率生成图像检测器LHSDet。将检测任务建模为视觉问答问题,利用微调的视觉-语言框架充分挖掘视觉与文本模态间的互补信息。针对现有视觉-语言模型默认视觉编码器不适用于生成图像检测的问题,重新设计视觉编码器以更好捕捉生成图像中的低层与高层伪影。此外,引入语义级文本分支实现多模态特征融合。LHSDet采用三分支架构:低层视觉分支通过非重叠块聚合局部纹理线索,高层视觉分支基于SigLIP2提取全局感知特征,语义级文本分支使用BLIP-2生成描述性标题。大量实验表明,LHSDet在多种生成模型(包括扩散与自回归模型)上均表现出高精度与强鲁棒性。

原文摘要 · Abstract (English)

Driven by advances in diffusion models and autoregressive models, the fidelity and resolution of AI-generated images now rival those of real images. However, existing AI-generated image detection methods often downsample the images, inevitably overlooking critical low-level texture details in high-resolution AI-generated images, therefore limiting their detection performance. In addition, the ceaseless emergence of unknown generative models makes large-scale pre-training datasets inaccessible. To address these challenges, we propose a novel high-resolution AI-generated image detector, termed LHSDet. Specifically, we formulate the AI-generated image detection task as a Visual Question Answering problem, leveraging a fine-tuned vision-language framework to fully exploit the complementary information between visual and textual modalities. Recognizing that the default visual encoder of existing vision-language models is not tailored for AI-generated image detection, we redesign a visual encoder to better capture both the low-level and high-level artifacts inherent in AI-generated images. Furthermore, we incorporate a semantic-level textual branch to enable multi-modal feature fusion and detection. Consequently, LHSDet employs a triple-branch architecture to extract complementary multi-modal features: a low-level visual branch that aggregates non-overlapping patches for local texture cues, a high-level visual branch based on SigLIP2 for global perception feature extraction, and a semantic-level textual branch that generates captions using BLIP-2. Extensive experimental results demonstrate that LHSDet achieves high detection accuracy and robust performance across diverse generative models, including both diffusion and autoregressive models.

图像检测视觉问答生成伪造多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。