提出可持续学习的3D异常检测框架,支持新类别增量学习。
C3D-AD: Toward Continual 3D Anomaly Detection via Kernel Attention with Learnable Advisor
- 用核注意力机制提取跨类通用特征,提升泛化能力。
- 在三个数据集上分别达66.4%、83.1%、63.4% AUROC。
- 适合工业质检中需持续更新检测类别的场景。
3D异常检测在高精度工业产品缺陷检测中展现出巨大潜力。然而,现有方法通常采用特定类别训练,且缺乏对新类别增量学习的能力。本文提出一种持续学习框架C3D-AD,既能学习多类点云的通用表征,又能应对随时间涌现的新类别。具体地,在特征提取模块中,引入随机特征层的核注意力(KAL)以高效提取多样化产品类型的通用局部特征并归一化特征空间;为实现数据的正确与持续重构,提出可学习导师的核注意力(KAA)机制,能在编码器与解码器中同时学习新类别信息并丢弃冗余旧信息;为保持任务间表征一致性,设计了基于参数扰动的重建(RPP)模块,通过表示回放损失函数确保模型记忆先前类别信息并输出类别自适应表征。在Real3D-AD、Anomaly-ShapeNet和MulSen-AD三个公开数据集上的大量实验表明,该方法分别取得66.4%、83.1%和63.4%的AUROC平均性能,验证了其有效性。
原文摘要 · Abstract (English)
3D Anomaly Detection (AD) has shown great potential in detecting anomalies or defects of high-precision industrial products. However, existing methods are typically trained in a class-specific manner and also lack the capability of learning from emerging classes. In this study, we proposed a continual learning framework named Continual 3D Anomaly Detection (C3D-AD), which can not only learn generalized representations for multi-class point clouds but also handle new classes emerging over time.Specifically, in the feature extraction module, to extract generalized local features from diverse product types of different tasks efficiently, Kernel Attention with random feature Layer (KAL) is introduced, which normalizes the feature space. Then, to reconstruct data correctly and continually, an efficient Kernel Attention with learnable Advisor (KAA) mechanism is proposed, which learns the information from new categories while discarding redundant old information within both the encoder and decoder. Finally, to keep the representation consistency over tasks, a Reconstruction with Parameter Perturbation (RPP) module is proposed by designing a representation rehearsal loss function, which ensures that the model remembers previous category information and returns category-adaptive representation.Extensive experiments on three public datasets demonstrate the effectiveness of the proposed method, achieving an average performance of 66.4%, 83.1%, and 63.4% AUROC on Real3D-AD, Anomaly-ShapeNet, and MulSen-AD, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。