构建工业缺陷理解新数据集与模型,提升多类型缺陷识别能力。
MAU-GPT: Enhancing Multi-type Industrial Anomaly Understanding via Anomaly-aware and Generalist Experts Adaptation
- 设计新型专家适配机制,融合异常感知与通用知识
- 在多领域缺陷任务上超越现有方法,最高提升12.3%
- 适合工业质检自动化与智能检测系统开发者
随着工业制造规模扩大,自动化细粒度产品图像分析对质量控制至关重要。现有方法受限于数据覆盖不足和跨复杂缺陷模式的泛化能力差。为此,我们提出MAU-Set,一个涵盖多个工业领域的多类型工业缺陷理解综合数据集,具有从二分类到复杂推理的层级任务结构。同时建立严格评估协议以实现公平全面的模型评测。在此基础上,我们进一步提出MAU-GPT,一种专为工业缺陷理解设计的领域自适应多模态大模型。其采用新颖的AMoE-LoRA机制,统一整合异常感知与通用专家适配,显著增强对多样化缺陷类别的理解与推理能力。大量实验表明,MAU-GPT在所有领域均持续优于先前最先进方法,展现出可扩展、自动化的工业检测潜力。
原文摘要 · Abstract (English)
As industrial manufacturing scales, automating fine-grained product image analysis has become critical for quality control. However, existing approaches are hindered by limited dataset coverage and poor model generalization across diverse and complex anomaly patterns. To address these challenges, we introduce MAU-Set, a comprehensive dataset for Multi-type industrial Anomaly Understanding. It spans multiple industrial domains and features a hierarchical task structure, ranging from binary classification to complex reasoning. Alongside this dataset, we establish a rigorous evaluation protocol to facilitate fair and comprehensive model assessment. Building upon this foundation, we further present MAU-GPT, a domain-adapted multimodal large model specifically designed for industrial anomaly understanding. It incorporates a novel AMoE-LoRA mechanism that unifies anomaly-aware and generalist experts adaptation, enhancing both understanding and reasoning across diverse defect classes. Extensive experiments show that MAU-GPT consistently outperforms prior state-of-the-art methods across all domains, demonstrating strong potential for scalable and automated industrial inspection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。