通过课程学习降低对抗性互信息,提升3D机器人视觉鲁棒性
Enhancing 3D Robotic Vision Robustness by Minimizing Adversarial Mutual Information through a Curriculum Training Approach
- 用互信息约束替代显式对抗样本训练,简化抗攻击设计
- 在ModelNet40上提升2-5%准确率,KITTI目标检测mAP增5-10%
- 适合关注3D感知安全性的机器人系统研发者
对抗攻击通过微小但精心设计的扰动破坏模型决策边界,导致严重误判。在3D视觉中,高维稀疏数据使攻击面大幅扩大,对安全关键的机器人系统尤为危险。本文提出一种联合最小化预测损失与对抗扰动下互信息(MI)的训练目标,以约束误判误差上限。该方法避免了传统需显式搜索和训练对抗样本的复杂流程。然而,预测损失与互信息最小化存在冲突,易引发性能下降和灾难性遗忘。为此,引入课程指导器,在训练中逐步引入对抗目标,防止模型早期被困难样本淹没;同时通过熵正则项促进多样化的互信息样本学习。在ModelNet40和KITTI数据集上,基于PointNet、DGCNN、SECOND和PointTransformers的实验表明,本方法在ModelNet40上获得2-5%准确率提升,在对象检测任务中实现5-10% mAP增长。代码已开源:https://github.com/nstrndrbi/Mine-N-Learn。
原文摘要 · Abstract (English)
Adversarial attacks exploit vulnerabilities in a model's decision boundaries through small, carefully crafted perturbations that lead to significant mispredictions. In 3D vision, the high dimensionality and sparsity of data greatly expand the attack surface, making 3D vision particularly vulnerable for safety-critical robotics. To enhance 3D vision's adversarial robustness, we propose a training objective that simultaneously minimizes prediction loss and mutual information (MI) under adversarial perturbations to contain the upper bound of misprediction errors. This approach simplifies handling adversarial examples compared to conventional methods, which require explicit searching and training on adversarial samples. However, minimizing prediction loss conflicts with minimizing MI, leading to reduced robustness and catastrophic forgetting. To address this, we integrate curriculum advisors in the training setup that gradually introduce adversarial objectives to balance training and prevent models from being overwhelmed by difficult cases early in the process. The advisors also enhance robustness by encouraging training on diverse MI examples through entropy regularizers. We evaluated our method on ModelNet40 and KITTI using PointNet, DGCNN, SECOND, and PointTransformers, achieving 2-5% accuracy gains on ModelNet40 and a 5-10% mAP improvement in object detection. Our code is publicly available at https://github.com/nstrndrbi/Mine-N-Learn.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。