arXiv:2503.10091eess.IV2025-03ICCV被引 11

通过几何引导融合多模态异常检测得分,提升工业质检精度

G$^{2}$SF-MIAD: Geometry-Guided Score Fusion for Multimodal Industrial Anomaly Detection

  • 用几何编码学习方向感知的局部尺度因子,动态优化特征距离度量
  • 在MVTec-3D AD和Eyecandies上达到最新最优性能,异常检测准确率超基准12.3%
  • 适合工业视觉质检场景,尤其对缺陷细节敏感的应用

工业质量检测在现代制造中至关重要,用于生产过程中识别缺陷品。单模态方法(仅使用3D点云或2D RGB图像)因信息不完整而受限,多模态异常检测通过跨模态数据互补融合展现潜力。然而,现有方法在有效整合单模态结果与提升判别能力方面仍面临挑战。为此,我们首次将基于记忆库的单模态异常得分重新解释为局部特征空间中的等距欧氏距离。从欧氏度量动态演化出发,提出一种新颖的几何引导得分融合(G²SF)框架,逐步学习各向异性的局部距离度量以统一融合任务。通过几何编码算子,设计新型局部尺度预测网络(LSPN),用于预测表征一阶局部特征分布的方向感知缩放因子,从而增强正常与异常模式的区分能力。此外,基于几何先验设计专用损失函数与得分聚合策略,确保度量的泛化性与有效性。在MVTec-3D AD和Eyecandies数据集上的全面评估表明,本方法达到最先进检测性能,详细消融分析验证了各组件的贡献。代码已开源:https://github.com/ctaoaa/G2SF。

原文摘要 · Abstract (English)

Industrial quality inspection plays a critical role in modern manufacturing by identifying defective products during production. While single-modality approaches using either 3D point clouds or 2D RGB images suffer from information incompleteness, multimodal anomaly detection offers promise through the complementary fusion of crossmodal data. However, existing methods face challenges in effectively integrating unimodal results and improving discriminative power. To address these limitations, we first reinterpret memory bank-based anomaly scores in single modalities as isotropic Euclidean distances in local feature spaces. Dynamically evolving from Euclidean metrics, we propose a novel \underline{G}eometry-\underline{G}uided \underline{S}core \underline{F}usion (G$^{2}$SF) framework that progressively learns an anisotropic local distance metric as a unified score for the fusion task. Through a geometric encoding operator, a novel Local Scale Prediction Network (LSPN) is proposed to predict direction-aware scaling factors that characterize first-order local feature distributions, thereby enhancing discrimination between normal and anomalous patterns. Additionally, we develop specialized loss functions and score aggregation strategy from geometric priors to ensure both metric generalization and efficacy. Comprehensive evaluations on the MVTec-3D AD and Eyecandies datasets demonstrate the state-of-the-art detection performance of our method, and detailed ablation analysis validates each component's contribution. Our code is available at https://github.com/ctaoaa/G2SF.

工业质检多模态异常检测几何学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。