TruEye可精确定位图像中AI生成的人像与场景,区分五类合成内容。
TruEye: Fine-Grained Detection of AI-Generated Human Subjects in Images

- 采用双流注意力机制分离人与场景特征,保持像素级空间对应
- 在6个数据集上准确率超现有模型,对未见生成图像泛化能力强
- 推理速度比依赖大模型的方案快100倍以上,适合实时检测
AI生成图像正大量传播于网络,部分被用于欺诈与社会工程攻击。现有检测器易过拟合训练过的生成器,将检测视为黑箱二分类,或依赖昂贵的大语言模型解释结果。本文提出TruEye,一种新型细粒度检测与定位模型,可识别图像中AI生成或篡改的人像与场景。不同于传统仅给出真伪标签的检测器,TruEye首次区分五类合成内容,包括真实人物被合成到其从未出现过的现实场景中这一最具挑战性的情况。核心为掩码条件下的双流Transformer,分别处理人与场景令牌,同时保留局部空间对应关系。每一流内设专门推理机制,区域门控交叉注意力确保主体与背景语义一致,令牌级监督与全局分类实现鲁棒且可解释的预测,无需调用大语言模型。通过限制流内注意力仅作用于语义一致的令牌,TruEye推理速度比基于大模型的竞品快100倍以上。在6个数据集及新构建的FineSyn数据集上的实验表明,TruEye在准确性、推理速度和对未见生成/篡改图像的泛化能力上均优于现有最佳方法。
原文摘要 · Abstract (English)
AI generated images are proliferating across the Internet. While some are used for entertainment, others are weaponized for fraud and social engineering attacks on social media users. Existing detectors overfit to generators seen during training, treat detection as opaque binary classification, or rely on costly Large Language Models (LLMs) to explain their outputs. In this paper, we present TruEye, a novel model for fine grained detection and localization of AI manipulated or AI generated humans and scenes. Unlike conventional detectors that assign a single authenticity label, TruEye is the first to distinguish among five compositional categories of synthetic content, including the most challenging case in which a real human is composited into a real scene where they were never physically present. At its core is a mask conditioned dual stream transformer that separates human and scene tokens while preserving patch level spatial correspondence. Specialized reasoning within each stream and region gated cross attention enforce semantic coherence between subject and background, while token level supervision and global compositional classification yield robust, interpretable predictions without invoking an LLM. By restricting intra stream attention to semantically coherent tokens, TruEye also runs over $100\times$ faster than LLM based competitors. Experiments on 6 datasets and our newly curated FineSyn dataset, show that TruEye surpasses state of the art detectors with higher accuracy, faster inference, and stronger generalization to unseen AI generated or manipulated images.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。