arXiv:2606.04369cs.CV2026-06

通过视觉-文本对齐实现少样本跨类别3D异常检测,提升精度与稳定性。

VT-3DAD: Cross-Category 3D Anomaly Detection via Visual-Text Normal Space Alignment

论文配图:VT-3DAD: Cross-Category 3D Anomaly Detection via Visual-Text Normal Space Alignment
图 1 · 摘自论文原文
  • 利用冻结的CLIP模型融合多视角视觉特征与语义提示构建正态空间。
  • 一 shot平均AUC-ROC达94.80%,标准差降低至3.41,优于现有方法。
  • 适合需要高鲁棒性的工业缺陷检测场景,尤其在样本稀缺时表现优异。

少样本跨类别3D异常检测旨在仅用少量正常样本判断未知点云是否属于目标正常类别。现有基于训练的方法通常需类别专属优化,而近期无训练方法依赖多视图CLIP视觉特征,易受几何相似类别干扰。本文提出VT-3DAD,一种基于视觉-文本正态空间对齐的无训练框架。给定少量正常参考样本和待测点云,VT-3DAD首先生成真实感多视角深度图,使用冻结的CLIP视觉编码器提取视图级特征,视觉分支在多视图特征空间中度量参考与测试样本的差异。同时,深度感知与3D感知提示经冻结的CLIP文本编码器编码,构建文本正态锚点,为目标类别提供语义正态性约束。最终异常评分通过融合视觉偏差与语义偏差获得。在ShapeNetPart数据集上的实验表明,VT-3DAD达到当前最优性能。特别地,相比仅视觉基线,一shot平均AUC-ROC从92.49%提升至94.80%,平均标准差由5.64降至3.41。

原文摘要 · Abstract (English)

Few-shot cross-category 3D anomaly detection aims to determine whether an unknown point cloud belongs to a target normal category using only a few normal references. Existing training-based methods usually require category-wise optimization, while recent training-free methods based on multi-view CLIP visual features mainly rely on visual similarity and may be confused by geometrically similar categories. In this paper, we propose VT-3DAD, a training-free framework for cross-category 3D anomaly detection via Visual-Text Normal Space Alignment. Given few-shot normal references and a test point cloud, VT-3DAD first generates realistic multi-view depth maps and extracts view-wise features using a frozen CLIP visual encoder. The visual branch measures reference-test deviation in the multi-view feature space. In parallel, depth-aware and 3D-aware prompts are encoded by the frozen CLIP text encoder to construct textual normal anchors, which provide semantic normality constraints for the target category. The final anomaly score is obtained by fusing visual deviation from normal references and semantic deviation from the textual normal space. Experiments on the ShapeNetPart dataset demonstrate that VT-3DAD achieves state-of-the-art performance. In particular, VT-3DAD improves the one-shot average AUC-ROC from 92.49% to 94.80% compared with the visual-only baseline, while also reducing the average standard deviation from 5.64 to 3.41.

3D异常检测少样本学习视觉-语言对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。