arXiv:2605.20682cs.CV2026-05

用智能工具动态分析工业缺陷,零样本检测更准更稳。

IndusAgent: Reinforcing Open-Vocabulary Industrial Anomaly Detection with Agentic Tools

论文配图:IndusAgent: Reinforcing Open-Vocabulary Industrial Anomaly Detection with Agentic Tools
图 1 · 摘自论文原文
  • 构建带专家先验的结构化数据集,引导模型理解工业场景。
  • 动态调用裁剪、增强等工具,精准定位细微异常。
  • 仅在必要时调用工具,兼顾准确率与效率,适合工业质检场景。

多模态大语言模型在跨场景零样本理解上表现优异,但在开放词汇工业缺陷检测中常因领域偏差推理和虚构结构推断而受限。为此,我们提出IndusAgent,一种工具增强的智能体框架。首先构建包含全局视觉、高分辨率局部块和专家正常性先验的结构化数据集Indus-CoT,用于指导模型在严谨工业检测轨迹上的微调。基于此,IndusAgent动态调度外部工具,包括动态区域裁剪、高频特征增强和先验检索,主动解决视觉模糊并分离细微缺陷。此外,引入门控强化学习目标,联合优化缺陷分类、定位精度、类型推理和工具使用效率,确保仅在有益时才调用工具。在五个工业缺陷基准(MVTec-AD、VisA、MPDD、DTD、SDD)上的大量评估表明,IndusAgent在所有现有方法中达到最先进的零样本性能,验证了其鲁棒性与泛化能力。

原文摘要 · Abstract (English)

Multimodal large language models (MLLMs) have shown remarkable capability in bridging visual perception and textual reasoning, enabling zero-shot understanding across diverse industrial scenarios. However, their performance in open-vocabulary industrial anomaly detection (IAD) is often limited by domain-misaligned reasoning and hallucinated structural inferences. To address these challenges, we propose \textbf{IndusAgent}, a tool-augmented agentic framework for open-vocabulary IAD. Specifically, we first construct \textbf{Indus-CoT}, a structured dataset that integrates global visual observations, high-resolution local patches, and expert normalcy priors, providing supervision for fine-tuning the model on rigorous industrial inspection trajectories. Building on this, IndusAgent dynamically orchestrates a set of external tools, including dynamic region cropping, high-frequency feature enhancement, and prior retrieval, thus enabling the agent to actively resolve visual ambiguities and disentangle subtle anomalies. Furthermore, we introduce a gated reinforcement learning objective that jointly optimizes anomaly classification, localization accuracy, anomaly type reasoning, and efficient tool usage, ensuring that tool invocation occurs only when beneficial. Extensive evaluations on five industrial anomaly benchmarks, including MVTec-AD, VisA, MPDD, DTD, and SDD, demonstrate that IndusAgent achieves state-of-the-art zero-shot performance among all existing methods, validating our robustness and generalization capacity.

工业检测缺陷识别智能体多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。