用文本语义指导多模态工业缺陷检测,提升定位精度
Text-Guided Multimodal Unified Industrial Anomaly Detection

- 引入文本语义引导跨模态对齐,增强特征匹配
- 在无监督下实现多类别缺陷检测,准确率领先
- 适合需要通用缺陷识别的工业质检场景
基于RGB-3D多模态数据的工业异常检测已成为智能质检主流范式。现有无监督方法存在两大瓶颈:缺乏高层语义引导导致跨模态对齐模糊,以及RGB到3D特征映射中几何建模不足。为此,我们提出一种由文本语义引导的统一多模态工业异常检测框架。该框架包含两个核心模块:几何感知跨模态映射器,用于保持模态转换中的几何结构;对象条件文本特征适配器,用于将多模态特征与语义先验对齐。此外,我们建立统一学习范式,打破‘一模型一类别’限制,实现单模型对多种类别的精确异常检测。在MVTec 3D-AD和Eyecandies数据集上的大量实验表明,该方法在无监督条件下实现了分类与定位的最先进性能。
原文摘要 · Abstract (English)
Industrial anomaly detection based on RGB-3D multimodal data has emerged as a mainstream paradigm for intelligent quality inspection. However, existing unsupervised methods suffer from two critical limitations: ambiguous cross-modal alignment caused by the lack of high-level semantic guidance and insufficient geometric modeling for RGB-to-3D feature mapping. To address these issues, we propose a unified multimodal industrial anomaly detection framework guided by text semantics. The framework consists of two core modules: a Geometry-Aware Cross-Modal Mapper to preserve geometric structure during modality conversion, and an Object-Conditioned Textual Feature Adaptor to align multimodal features with semantic priors. Furthermore, we establish a unified learning paradigm for multimodal industrial anomaly detection, which breaks the one-model-one-class constraint and enables accurate anomaly detection across diverse classes using a single model. Extensive experiments on the MVTec 3D-AD and Eyecandies datasets demonstrate that our method achieves state-of-the-art performance in classification and localization under unsupervised settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。