arXiv:2412.13461cs.CVcs.AI2024-12AAAI被引 45

通过挖掘点云内部空间特征,提升3D异常检测精度。

Look Inside for More: Internal Spatial Modality Perception for 3D Anomaly Detection

  • 设计内部空间感知模块,从点云内部提取全局特征。
  • 在Real3D-AD上实现物体级3.2%、像素级13.1%的AUROC提升。
  • 适合需要高精度3D异常检测的工业质检与自动驾驶场景。

3D异常检测近年来成为计算机视觉的重要方向。尽管已有多种先进方法取得良好性能,但通常只关注3D样本的外部结构,难以利用样本内部蕴含的信息。受‘为何不往内部看’这一直觉启发,我们提出一种简单有效的方法——内部空间模态感知(ISMP),以充分探索点云内部视角的特征表示。具体而言,所提出的ISMP包含一个关键感知模块——空间洞察引擎(SIE),可将点云复杂的内部信息抽象为关键全局特征。此外,为更好对齐结构信息与点数据,我们设计了增强的关键点特征提取模块,以强化空间结构特征表达;同时引入新型特征过滤模块,降低噪声与冗余特征,进一步对齐精确的空间结构。大量实验验证了该方法的有效性,在Real3D-AD基准上实现了物体级3.2%和像素级13.1%的AUROC提升。值得注意的是,SIE具备强泛化能力,已在分类与分割任务中得到理论证明与实证验证。

原文摘要 · Abstract (English)

3D anomaly detection has recently become a significant focus in computer vision. Several advanced methods have achieved satisfying anomaly detection performance. However, they typically concentrate on the external structure of 3D samples and struggle to leverage the internal information embedded within samples. Inspired by the basic intuition of why not look inside for more, we introduce a straightforward method named Internal Spatial Modality Perception~(ISMP) to explore the feature representation from internal views fully. Specifically, our proposed ISMP consists of a critical perception module, Spatial Insight Engine~(SIE), which abstracts complex internal information of point clouds into essential global features. Besides, to better align structural information with point data, we propose an enhanced key point feature extraction module for amplifying spatial structure feature representation. Simultaneously, a novel feature filtering module is incorporated to reduce noise and redundant features for further aligning precise spatial structure. Extensive experiments validate the effectiveness of our proposed method, achieving object-level and pixel-level AUROC improvements of 3.2\% and 13.1\%, respectively, on the Real3D-AD benchmarks. Note that the strong generalization ability of SIE has been theoretically proven and is verified in both classification and segmentation tasks.

3D异常检测点云分析空间感知工业质检

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。