arXiv:2508.20492cs.CV2025-08被引 4

融合2D与3D模型,动态加权提升3D点云异常检测精度

IAENet: An Importance-Aware Ensemble Model for 3D Point Cloud-Based Anomaly Detection

  • 用2D预训练模型和3D专家模型构建集成框架,动态评估各模态贡献
  • 在MVTec 3D-AD上实现新最优,误报率显著降低
  • 适合工业质检场景,对低误报率要求高的应用尤其适用

表面异常检测对工业制造中的产品质量至关重要。尽管2D图像方法已取得显著进展,基于3D点云的检测仍因缺乏类似2D的强大预训练基础模型而研究不足。为此,我们提出重要性感知集成网络(IAENet),通过集成2D预训练专家与3D专家模型,协同利用其优势。然而,直接融合不同模态预测存在挑战:劣质模态可能拖累整体性能。为此,我们设计了新颖的重要性感知融合(IAF)模块,动态评估各源贡献并重加权异常分数。此外,我们提出了关键损失函数,显式引导IAF优化,使其既能整合源专家的集体知识,又保留各自独特优势,从而提升检测性能。在MVTec 3D-AD数据集上的大量实验表明,IAENet达到新的最优水平,且误报率显著降低,展现出良好的工业部署价值。

原文摘要 · Abstract (English)

Surface anomaly detection is pivotal for ensuring product quality in industrial manufacturing. While 2D image-based methods have achieved remarkable success, 3D point cloud-based detection remains underexplored despite its richer geometric cues. We argue that the key bottleneck is the absence of powerful pretrained foundation backbones in 3D comparable to those in 2D. To bridge this gap, we propose Importance-Aware Ensemble Network (IAENet), an ensemble framework that synergizes 2D pretrained expert with 3D expert models. However, naively fusing predictions from disparate sources is non-trivial: existing strategies can be affected by a poorly performing modality and thus degrade overall accuracy. To address this challenge, We introduce an novel Importance-Aware Fusion (IAF) module that dynamically assesses the contribution of each source and reweights their anomaly scores. Furthermore, we devise critical loss functions that explicitly guide the optimization of IAF, enabling it to combine the collective knowledge of the source experts but also preserve their unique strengths, thereby enhancing the overall performance of anomaly detection. Extensive experiments on MVTec 3D-AD demonstrate that our IAENet achieves a new state-of-the-art with a markedly lower false positive rate, underscoring its practical value for industrial deployment.

3D异常检测点云多模态融合工业质检

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。