用智能代理框架提升视觉合规检查的准确性和适应性
CompAgent: An Agentic Framework for Visual Compliance Verification
- 引入动态工具选择机制,结合多模态大模型与视觉分析工具
- 在UnsafeBench上达76% F1,比当前最优提升10%
- 适合内容审核、广告合规等需灵活应对政策变化的场景
视觉合规验证是计算机视觉中关键但研究不足的问题,尤其在媒体、娱乐和广告领域,内容需遵循复杂且动态演变的政策规则。现有方法依赖特定任务的深度学习模型,需人工标注数据,成本高且泛化能力差。尽管多模态大语言模型具备广泛现实知识和政策理解能力,却难以精细推理视觉细节或有效应用结构化合规规则。本文提出首个用于视觉合规验证的智能体框架CompAgent,通过集成目标检测器、人脸分析器、NSFW检测器和图像描述模型等视觉工具,并引入规划智能体根据合规策略动态选择工具。合规验证智能体则融合图像、工具输出与政策上下文进行多模态推理。在公开基准上的实验表明,CompAgent优于专用分类器、直接提示大模型及精心设计的路由基线,在UnsafeBench数据集上达到最高76% F1分数,较最先进方法提升10%。结果证明了智能体规划与鲁棒工具增强推理在实现可扩展、高精度、可适应的视觉合规验证中的有效性。
原文摘要 · Abstract (English)
Visual compliance verification is a critical yet underexplored problem in computer vision, especially in domains such as media, entertainment, and advertising where content must adhere to complex and evolving policy rules. Existing methods often rely on task-specific deep learning models trained on manually labeled datasets, which are costly to build and limited in generalizability. While recent Multimodal Large Language Models (MLLMs) offer broad real-world knowledge and policy understanding, they struggle to reason over fine-grained visual details and apply structured compliance rules effectively on their own. In this paper, we propose CompAgent, the first agentic framework for visual compliance verification. CompAgent augments MLLMs with a suite of visual tools-such as object detectors, face analyzers, NSFW detectors, and captioning models-and introduces a planning agent that dynamically selects appropriate tools based on the compliance policy. A compliance verification agent then integrates image, tool outputs, and policy context to perform multimodal reasoning. Experiments on public benchmarks show that CompAgent outperforms specialized classifiers, direct MLLM prompting, and curated routing baselines, achieving up to 76% F1 score and a 10% improvement over the state-of-the-art on the UnsafeBench dataset. Our results demonstrate the effectiveness of agentic planning and robust tool-augmented reasoning for scalable, accurate, and adaptable visual compliance verification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。