用跨模态匹配思路提升异常检测精度与边界清晰度
XMatchAD: A Cross-Modal Matching Perspective on Reconstruction-based Anomaly Detection

- 将输入图与重建图视为互补模态,通过注意力机制匹配异常特征
- 在MVTec-AD等数据集上达到最新水平,异常定位更精准
- 适合需要高精度异常定位的工业质检场景
基于重构的无监督异常检测方法虽能识别异常,但常难以捕捉细微异常且边界模糊,尤其在多类别复杂场景中表现受限。为此,我们提出XMatchAD,从伪跨模态匹配视角重新定义该任务:将输入图像与重建图像视为两个互补模态,通过注意力引导的跨模态匹配机制,精准匹配局部异常相关模式并相互优化特征,增强对多样形状和微小偏差的敏感性。同时设计自适应频域感知融合模块,利用跨模态多尺度表示中的高频成分进一步锐化异常边界。在MVTec-AD、VisA和MPDD多个基准上的实验表明,该方法在多类别异常检测与定位上持续优于现有最先进方法。
原文摘要 · Abstract (English)
The remarkable success of reconstruction-based methods in Unsupervised Anomaly Detection (UAD) lies in their ability to identify and localize anomalies by modeling discrepancies between input images and their reconstructed counterparts. However, these approaches often struggle to capture subtle anomalies and tend to produce blurred anomaly boundaries, which significantly limits their effectiveness, particularly in complex multi-class scenarios. To address these issues, we present XMatchAD, a novel UAD framework that reinterprets the task from a pseudo cross-modal matching perspective. Specifically, the input and reconstructed images are treated as two complementary modalities and their matching relationships are precisely exploited for anomaly detection. First, a pre-trained feature extractor is employed to encode discriminative representations. Second, an attention-guided cross-modal matching mechanism is introduced to match local inter-modal anomaly-related patterns while mutually refining the features. This enhances the sensitivity to anomalies with diverse shapes and subtle deviations and significantly improves the precision of anomaly detection and localization. Third, we design an adaptive frequency-aware fusion module that further delineates sharp anomaly boundaries through the coupling of high-frequency components from cross-modal multi-scale representations. Comprehensive evaluations on MVTec-AD, VisA, and MPDD benchmarks demonstrate that our method consistently achieves superior performance, outperforming state-of-the-art methods in multi-class anomaly detection and localization. The code will be released at https://github.com/Mingxiu-Cai/XMatchAD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。