统一检测多种伪造图像,自动选择模型并生成解释报告。
UniShield: An Adaptive Multi-Agent Framework for Unified Forgery Image Detection and Localization
- 多智能体架构:感知代理选模型,检测代理整合专家
- 跨领域检测性能领先,优于单一专用模型
- 适合需要自适应、可解释的伪造图像检测场景
随着图像生成技术的快速发展,合成图像日益逼真,带来虚假信息和欺诈等社会风险。图像伪造检测与定位(FIDL)对于维护信息真实性和社会安全至关重要。尽管现有领域专用检测方法表现优异,但其实际应用受限于专一性强、跨域泛化差,且缺乏集成自适应框架。为此,我们提出UniShield——一种基于多智能体的统一系统,可跨图像篡改、文档篡改、DeepFake及AI生成图像等多种领域实现伪造检测与定位。UniShield创新性地融合感知代理与检测代理:感知代理智能分析图像特征,动态选择适配检测模型;检测代理将各类专家检测器整合为统一框架,并生成可解释报告。大量实验表明,UniShield在多项指标上超越现有统一方法与领域专用检测器,展现出卓越的实用性、自适应性与可扩展性。
原文摘要 · Abstract (English)
With the rapid advancements in image generation, synthetic images have become increasingly realistic, posing significant societal risks, such as misinformation and fraud. Forgery Image Detection and Localization (FIDL) thus emerges as essential for maintaining information integrity and societal security. Despite impressive performances by existing domain-specific detection methods, their practical applicability remains limited, primarily due to their narrow specialization, poor cross-domain generalization, and the absence of an integrated adaptive framework. To address these issues, we propose UniShield, the novel multi-agent-based unified system capable of detecting and localizing image forgeries across diverse domains, including image manipulation, document manipulation, DeepFake, and AI-generated images. UniShield innovatively integrates a perception agent with a detection agent. The perception agent intelligently analyzes image features to dynamically select suitable detection models, while the detection agent consolidates various expert detectors into a unified framework and generates interpretable reports. Extensive experiments show that UniShield achieves state-of-the-art results, surpassing both existing unified approaches and domain-specific detectors, highlighting its superior practicality, adaptiveness, and scalability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。