arXiv:2608.29783cs.CV2026-08

用对比推理提升工业缺陷检测,实现更精准的异常识别。

InspectorGPT: A Comparative Reasoning Enhanced VLM for Comprehensive Industrial Anomaly Detection

论文配图:InspectorGPT: A Comparative Reasoning Enhanced VLM for Comprehensive Industrial Anomaly Detection
图 1 · 摘自论文原文
  • 通过对比正常图与待检图进行推理,增强缺陷识别能力。
  • 在多个未见数据集上表现超越基线模型,支持像素级分割。
  • 适合需要高精度缺陷检测的智能制造场景。

工业缺陷检测是现代制造的关键环节。传统无监督方法依赖建模正常特征分布,难以泛化至未知类别。近期方法虽引入视觉语言模型(VLM)实现零样本检测,但基于推理的微调常导致异常判别性能下降,部分模型甚至劣于原始VLM。现有方法仅提供文本判断或粗略框选,缺乏像素级分割。人类检测逻辑提示:异常通过对比有缺陷与无缺陷参考图发现。受此启发,我们提出InspectorGPT,一种以对比推理为核心的VLM框架。给定一张正常参考图和查询图像,InspectorGPT通过比较识别差异,执行多任务并生成详细推理过程。通过链式思维(CoT)微调与针对性可验证奖励的组相对策略优化(GRPO)内化该能力。进一步提出InspectorGPT-Seg实现像素级异常掩码。分割监督虽提升判别力却削弱语义推理,联合训练难以平衡,因此分枝独立训练后采用任务向量融合。大量实验表明,其在多维度性能与未见基准上均显著优于现有方法,验证了对比推理在综合工业检测中的有效性。

原文摘要 · Abstract (English)

Industrial anomaly detection is a critical component of modern manufacturing. Most traditional unsupervised methods rely on modelling normal feature distributions, inherently limiting generalization to unknown categories. To improve generalizability, some recent methods incorporate vision-language models (VLMs) for zero-shot detection via text prompts. However, we observe that reasoning-oriented post-training can cause anomaly discrimination to collapse, with some fine-tuned models performing worse than their base VLMs. Existing methods also provide only textual decisions or coarse boxes, without pixel-level segmentation. A more explicit detection principle comes from human inspection: anomalies are identified by comparing a query image with a defect-free reference. Inspired by this, we propose InspectorGPT, a VLM framework centered on comparative reasoning. Given a normal reference and a query image, InspectorGPT compares them to identify discrepancies and perform multiple inspection tasks with detailed reasoning. We internalize this capability through Chain-of-Thought (CoT) fine-tuning and Group Relative Policy Optimization (GRPO) with tailored, verifiable rewards. We further introduce InspectorGPT-Seg for pixel-level anomaly masks. Segmentation supervision improves anomaly discrimination but weakens semantic reasoning, while joint training fails to balance them. We therefore train the two branches separately and combine them through task-vector fusion. Extensive experiments demonstrate superior multi-dimensional performance and generalization to unseen benchmarks, validating comparative reasoning for comprehensive industrial inspection.

缺陷检测视觉语言模型对比推理像素分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。