arXiv:2503.14162cs.AI2025-03中稿 · ICME2025被引 16

用多模态大模型实现可解释的工业缺陷检测,提升准确率与可读性。

EIAD: Explainable Industrial Anomaly Detection Via Multi-Modal Large Language Models

论文配图:EIAD: Explainable Industrial Anomaly Detection Via Multi-Modal Large Language Models
图 1 · 摘自论文原文
  • 分离对话与缺陷定位模块,独立优化避免过拟合。
  • 在真实缺陷数据集上实现高精度检测与定位,性能显著提升。
  • 适合工业质检场景,特别需要可解释性的企业应用。

工业异常检测对保障制造过程中的产品质量至关重要。尽管现有零样本缺陷分割与检测方法已展现有效性,但无法提供缺陷的详细描述。此外,大模型在工业异常检测中的应用仍处于起步阶段,面临问答性能与基于掩码的定位能力之间的平衡难题,常因微调过程中的过拟合而受限。为此,我们提出一种新方法,引入专用的多模态缺陷定位模块,将对话功能与核心特征提取解耦,通过独立优化目标和定制化学习策略实现。同时,我们构建了首个多模态工业异常检测训练数据集DDQA,涵盖多种缺陷类型与工业场景。该数据集不依赖GPT生成数据,确保真实性和可靠性,为模型训练提供坚实基础。实验结果表明,所提出的可解释工业异常检测助手EIAD在缺陷检测与定位任务中表现优异,不仅显著提升准确率,还增强可解释性,展现出在工业场景中的实际应用潜力。

原文摘要 · Abstract (English)

Industrial Anomaly Detection (IAD) is critical to ensure product quality during manufacturing. Although existing zero-shot defect segmentation and detection methods have shown effectiveness, they cannot provide detailed descriptions of the defects. Furthermore, the application of large multi-modal models in IAD remains in its infancy, facing challenges in balancing question-answering (QA) performance and mask-based grounding capabilities, often owing to overfitting during the fine-tuning process. To address these challenges, we propose a novel approach that introduces a dedicated multi-modal defect localization module to decouple the dialog functionality from the core feature extraction. This decoupling is achieved through independent optimization objectives and tailored learning strategies. Additionally, we contribute to the first multi-modal industrial anomaly detection training dataset, named Defect Detection Question Answering (DDQA), encompassing a wide range of defect types and industrial scenarios. Unlike conventional datasets that rely on GPT-generated data, DDQA ensures authenticity and reliability and offers a robust foundation for model training. Experimental results demonstrate that our proposed method, Explainable Industrial Anomaly Detection Assistant (EIAD), achieves outstanding performance in defect detection and localization tasks. It not only significantly enhances accuracy but also improves interpretability. These advancements highlight the potential of EIAD for practical applications in industrial settings.

工业质检多模态可解释性大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。