arXiv:2411.00462cs.CV2024-11NeurIPS被引 2

通过对抗性特征擦除提升点云模型抗干扰能力

Target-Guided Adversarial Point Cloud Transformer Towards Recognition Against Real-world Corruptions

  • 用对抗性显著性识别器动态判断关键点
  • 在多个训练步骤中迭代增强对物体模式的捕捉
  • 适合需要高鲁棒性的3D感知场景

面对数据退化问题,当前基于Transformer的点云识别模型容易过拟合特定模式,导致鲁棒性下降。本文提出目标引导的对抗性点云变换器(APCT),通过训练过程中每一步识别并擦除特征模式来增强全局结构捕获能力。APCT包含对抗性显著性标识器和目标引导提示器:前者结合结构显著性指数与辅助监督机制,从全局上下文分析中判断令牌重要性;后者利用该结果,在自注意力机制中强化令牌剔除倾向,引导模型关注后续阶段的其他区域。通过多步迭代策略,网络逐步识别并融合更丰富的物体相关模式。大量实验表明,该方法在多个退化基准上达到领先性能。

原文摘要 · Abstract (English)

Achieving robust 3D perception in the face of corrupted data presents an challenging hurdle within 3D vision research. Contemporary transformer-based point cloud recognition models, albeit advanced, tend to overfit to specific patterns, consequently undermining their robustness against corruption. In this work, we introduce the Target-Guided Adversarial Point Cloud Transformer, termed APCT, a novel architecture designed to augment global structure capture through an adversarial feature erasing mechanism predicated on patterns discerned at each step during training. Specifically, APCT integrates an Adversarial Significance Identifier and a Target-guided Promptor. The Adversarial Significance Identifier, is tasked with discerning token significance by integrating global contextual analysis, utilizing a structural salience index algorithm alongside an auxiliary supervisory mechanism. The Target-guided Promptor, is responsible for accentuating the propensity for token discard within the self-attention mechanism, utilizing the value derived above, consequently directing the model attention towards alternative segments in subsequent stages. By iteratively applying this strategy in multiple steps during training, the network progressively identifies and integrates an expanded array of object-associated patterns. Extensive experiments demonstrate that our method achieves state-of-the-art results on multiple corruption benchmarks.

点云识别对抗训练3D感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。