小模型也能做逻辑异常推理,还更清晰可解释。
LAD-Reasoner: Tiny Multimodal Models are Good Reasoners for Logical Anomaly Detection
- 用3亿参数的微型多模态模型,分两阶段训练实现逻辑推理。
- 在MVTec LOCO数据集上性能媲美720亿参数大模型。
- 无需复杂提示工程,自动生成简洁可读的推理过程。
工业异常检测亟需深入的逻辑异常分析能力,以识别物体间、数量与空间布局间的异常关系。现有方法依赖大型外部推理模块或复杂流程,影响实际部署与可解释性。为此,我们提出新任务「逻辑异常检测推理」(RLAD),并设计轻量级框架LAD-Reasoner——基于Qwen2.5-VL 3B的定制化小型多模态语言模型。采用两阶段训练:先通过监督微调(SFT)提升细粒度视觉理解,再用组相对策略优化(GRPO)强化逻辑异常检测与输出结构质量。奖励信号同时来自检测准确率和输出结构合理性,无需构建思维链(CoT)数据。在MVTec LOCO AD数据集上的实验表明,尽管模型规模显著更小,其准确率与F1分数仍与Qwen2.5-VL-72B相当,且生成的推理过程更简练、更易理解。该统一设计减少对大模型与复杂流水线的依赖,提供透明可解释的逻辑异常洞察。代码与数据将公开。
原文摘要 · Abstract (English)
Recent advances in industrial anomaly detection have highlighted the need for deeper logical anomaly analysis, where unexpected relationships among objects, counts, and spatial configurations must be identified and explained. Existing approaches often rely on large-scale external reasoning modules or elaborate pipeline designs, hindering practical deployment and interpretability. To address these limitations, we introduce a new task, Reasoning Logical Anomaly Detection (RLAD), which extends traditional anomaly detection by incorporating logical reasoning. We propose a new framework, LAD-Reasoner, a customized tiny multimodal language model built on Qwen2.5-VL 3B. Our approach leverages a two-stage training paradigm that first employs Supervised Fine-Tuning (SFT) for fine-grained visual understanding, followed by Group Relative Policy Optimization (GRPO) to refine logical anomaly detection and enforce coherent, human-readable reasoning. Crucially, reward signals are derived from both the detection accuracy and the structural quality of the outputs, obviating the need for building chain of thought (CoT) reasoning data. Experiments on the MVTec LOCO AD dataset show that LAD-Reasoner, though significantly smaller, matches the performance of Qwen2.5-VL-72B in accuracy and F1 score, and further excels in producing concise and interpretable rationales. This unified design reduces reliance on large models and complex pipelines, while offering transparent and interpretable insights into logical anomaly detection. Code and data will be released.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。