arXiv:2502.11307cs.CVcs.AI2025-02被引 4

用双提示词让模型一模型通吃多类3D异常检测,性能更优。

Exploiting Point-Language Models with Dual-Prompts for 3D Anomaly Detection

  • 设计双提示机制,结合文本与点云动态提示
  • 在Anomaly-ShapeNet上检测与定位提升8.7%~17%
  • 无需每类训练一模型,适合工业多场景部署

3D点云异常检测在精密制造等工业领域至关重要。现有方法通常需为每类训练独立模型,内存开销大且灵活性差。本文提出基于双提示的点语言模型框架PLANE,利用多模态提示扩展预训练点语言模型(PLM)在3D异常检测中的泛化能力,实现单模型跨多类别检测。提出双提示学习方法,融合文本与点云动态提示,通过动态提示生成模块(DPCM)生成样本相关提示,并与类别固定提示结合驱动模型。针对点云特性,设计伪3D异常生成方法(Ano3D),增强无监督检测性能。实验表明,在多类一模型范式下,相比当前最优单类一模型方法,Anomaly-ShapeNet上检测与定位性能提升+8.7%/+17%,Real3D-AD上提升+4.3%/+4.1%。代码将在发表后公开。

原文摘要 · Abstract (English)

Anomaly detection (AD) in 3D point clouds is crucial in a wide range of industrial applications, especially in various forms of precision manufacturing. Considering the industrial demand for reliable 3D AD, several methods have been developed. However, most of these approaches typically require training separate models for each category, which is memory-intensive and lacks flexibility. In this paper, we propose a novel Point-Language model with dual-prompts for 3D ANomaly dEtection (PLANE). The approach leverages multi-modal prompts to extend the strong generalization capabilities of pre-trained Point-Language Models (PLMs) to the domain of 3D point cloud AD, achieving impressive detection performance across multiple categories using a single model. Specifically, we propose a dual-prompt learning method, incorporating both text and point cloud prompts. The method utilizes a dynamic prompt creator module (DPCM) to produce sample-specific dynamic prompts, which are then integrated with class-specific static prompts for each modality, effectively driving the PLMs. Additionally, based on the characteristics of point cloud data, we propose a pseudo 3D anomaly generation method (Ano3D) to improve the model's detection capabilities in an unsupervised setting. Experimental results demonstrate that the proposed method, which is under the multi-class-one-model paradigm, achieves a +8.7%/+17% gain on anomaly detection and localization performance as compared to the state-of-the-art one-class-one-model methods for the Anomaly-ShapeNet dataset, and obtains +4.3%/+4.1% gain for the Real3D-AD dataset. Code will be available upon publication.

3D异常检测点云双提示零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。