arXiv:2412.16213cs.CVcs.AI2024-12中稿 · AAAI

用强化学习生成3D神经辐射场的鲁棒对抗样本,可骗过真实场景中的视觉系统。

AdvIRL: Reinforcement Learning-Based Adversarial Attacks on 3D NeRF Models

  • 基于强化学习与即时图形原语,生成能抵抗旋转缩放的对抗噪声。
  • 在香蕉、灯塔等不同尺度场景中实现高置信度误分类,如将香蕉识别为蛞蝓。
  • 既可用于攻击测试,也可作为对抗训练数据提升模型鲁棒性。

AI模型在关键应用中的部署日益广泛,面临严重对抗攻击风险。尽管2D视觉模型的对抗脆弱性已得到充分研究,但3D生成模型(如神经辐射场,NeRF)的威胁态势仍待探索。本文提出 extit{AdvIRL}框架,利用即时神经图形原语(Instant-NGP)与强化学习构建对抗性NeRF模型。与以往方法不同, extit{AdvIRL}生成的对抗噪声在多种3D变换(如旋转、缩放)下仍具鲁棒性,支持真实场景下的黑盒攻击。实验覆盖从小型物体(如香蕉)到大型环境(如灯塔)的多类场景。目标攻击实现高置信度误分类,例如将香蕉识别为蛞蝓,将卡车识别为加农炮,揭示了对抗性NeRF的实际风险。此外, extit{AdvIRL}生成的对抗模型可作为对抗训练数据,提升视觉系统的鲁棒性。代码已公开于 exttt{https://github.com/Tommy-Nguyen-cpu/AdvIRL/tree/MultiView-Clean},确保可复现性并推动后续研究。

原文摘要 · Abstract (English)

The increasing deployment of AI models in critical applications has exposed them to significant risks from adversarial attacks. While adversarial vulnerabilities in 2D vision models have been extensively studied, the threat landscape for 3D generative models, such as Neural Radiance Fields (NeRF), remains underexplored. This work introduces \textit{AdvIRL}, a novel framework for crafting adversarial NeRF models using Instant Neural Graphics Primitives (Instant-NGP) and Reinforcement Learning. Unlike prior methods, \textit{AdvIRL} generates adversarial noise that remains robust under diverse 3D transformations, including rotations and scaling, enabling effective black-box attacks in real-world scenarios. Our approach is validated across a wide range of scenes, from small objects (e.g., bananas) to large environments (e.g., lighthouses). Notably, targeted attacks achieved high-confidence misclassifications, such as labeling a banana as a slug and a truck as a cannon, demonstrating the practical risks posed by adversarial NeRFs. Beyond attacking, \textit{AdvIRL}-generated adversarial models can serve as adversarial training data to enhance the robustness of vision systems. The implementation of \textit{AdvIRL} is publicly available at \url{https://github.com/Tommy-Nguyen-cpu/AdvIRL/tree/MultiView-Clean}, ensuring reproducibility and facilitating future research.

3D生成对抗攻击强化学习NeRF

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。