arXiv:2409.13162cs.CV2024-09被引 18

用多视角投影将点云异常检测转为图像任务,实现零样本检测。

Towards Zero-shot Point Cloud Anomaly Detection: A Multi-View Projection Framework

  • 将点云转为多视角深度图,借力预训练视觉语言模型
  • 在MVTec和Real3D-AD上达到领先零样本性能
  • 适合工业界快速部署于未见过的产品检测场景

点云异常检测对工业应用至关重要,但传统无监督方法受限于数据采集成本、生产早期阶段约束及跨产品类别的泛化能力不足。为此,本文提出多视角投影(MVP)框架,利用预训练视觉语言模型(VLMs)进行异常检测。具体地,MVP将点云数据投影为多视角深度图,从而将点云异常检测转化为图像异常检测问题。基于零样本图像异常检测方法,使用预训练的VLM在这些深度图上进行检测。由于预训练VLM并非专为零样本点云异常检测设计,可能缺乏针对性,因此提出引入可学习视觉提示与自适应文本提示技术以微调VLM,提升检测性能。在MVTec 3D-AD和Real3D-AD上的大量实验表明,所提MVP框架具备优越的零样本异常检测性能,且提示技术有效。在汽车塑料件检测的真实场景评估中进一步验证了该方法在未见场景下的良好泛化能力。代码已开源:https://github.com/hustCYQ/MVP-PCLIP。

原文摘要 · Abstract (English)

Detecting anomalies within point clouds is crucial for various industrial applications, but traditional unsupervised methods face challenges due to data acquisition costs, early-stage production constraints, and limited generalization across product categories. To overcome these challenges, we introduce the Multi-View Projection (MVP) framework, leveraging pre-trained Vision-Language Models (VLMs) to detect anomalies. Specifically, MVP projects point cloud data into multi-view depth images, thereby translating point cloud anomaly detection into image anomaly detection. Following zero-shot image anomaly detection methods, pre-trained VLMs are utilized to detect anomalies on these depth images. Given that pre-trained VLMs are not inherently tailored for zero-shot point cloud anomaly detection and may lack specificity, we propose the integration of learnable visual and adaptive text prompting techniques to fine-tune these VLMs, thereby enhancing their detection performance. Extensive experiments on the MVTec 3D-AD and Real3D-AD demonstrate our proposed MVP framework's superior zero-shot anomaly detection performance and the prompting techniques' effectiveness. Real-world evaluations on automotive plastic part inspection further showcase that the proposed method can also be generalized to practical unseen scenarios. The code is available at https://github.com/hustCYQ/MVP-PCLIP.

点云异常检测零样本视觉语言模型工业质检

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。