arXiv:2602.19206cs.CV2026-02中稿 · CVPR被引 6

通过几何提示与多视角融合,实现无需训练数据的3D异常检测。

GS-CLIP: Zero-shot 3D Anomaly Detection by Geometry-Aware Prompt and Synergistic View Representation Learning

  • 用几何先验动态生成文本提示,捕捉全局形状与局部缺陷。
  • 并行处理渲染图与深度图,融合双流特征提升检测能力。
  • 适用于数据稀缺场景,尤其适合工业质检等隐私敏感领域。

零样本3D异常检测旨在不使用目标数据训练的情况下识别三维点云中的异常,对样本稀缺和数据隐私受限的场景尤为重要。现有方法虽将3D点云投影至2D以适配CLIP,但投影过程会丢失部分几何细节,且依赖单一2D模态导致视觉理解不完整,难以检测多样异常。为此,我们提出几何感知提示与协同视角表征学习框架(GS-CLIP),采用两阶段学习:第一阶段通过几何缺陷蒸馏模块(GDDM)提取全局形状上下文与局部缺陷信息,动态生成嵌入3D几何先验的文本提示;第二阶段引入协同视角表征学习架构,同步处理渲染图像与深度图,并通过协同精炼模块(SRM)融合双流特征,发挥互补优势。在四个大规模公开数据集上的实验表明,GS-CLIP在异常检测上表现优异。代码将发布于https://github.com/zhushengxinyue/GS-CLIP。

原文摘要 · Abstract (English)

Zero-shot 3D Anomaly Detection is an emerging task that aims to detect anomalies in a target dataset without any target training data, which is particularly important in scenarios constrained by sample scarcity and data privacy concerns. While current methods adapt CLIP by projecting 3D point clouds into 2D representations, they face challenges. The projection inherently loses some geometric details, and the reliance on a single 2D modality provides an incomplete visual understanding, limiting their ability to detect diverse anomaly types. To address these limitations, we propose the Geometry-Aware Prompt and Synergistic View Representation Learning (GS-CLIP) framework, which enables the model to identify geometric anomalies through a two-stage learning process. In stage 1, we dynamically generate text prompts embedded with 3D geometric priors. These prompts contain global shape context and local defect information distilled by our Geometric Defect Distillation Module (GDDM). In stage 2, we introduce Synergistic View Representation Learning architecture that processes rendered and depth images in parallel. A Synergistic Refinement Module (SRM) subsequently fuses the features of both streams, capitalizing on their complementary strengths. Comprehensive experimental results on four large-scale public datasets show that GS-CLIP achieves superior performance in detection. Code can be available at https://github.com/zhushengxinyue/GS-CLIP.

3D异常检测零样本学习几何先验多视角融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。