arXiv:2501.05783cs.CVcs.AI2025-01ICLR被引 13

用动态NeRF生成可变人体纹理,实现高成功率物理攻击

UV-Attack: Physical-World Adversarial Attacks for Person Detection via Dynamic-NeRF-based UV Mapping

  • 基于动态NeRF构建UV映射,生成跨动作与视角的人体图像
  • 在动态视频中对FastRCNN攻击成功率达92.7%,远超现有方法
  • 支持实时纹理修改,适合研究物理世界对抗攻击的学者

近期研究中,基于贴纸或静态3D模型的行人检测对抗攻击因人体动作灵活性导致成功率低。本文提出UV-Attack,利用动态NeRF-based UV映射解决人体姿态变形建模难题。该方法可生成多样化动作和视角下的人体图像,并通过采样SMPL参数空间创造新动作。针对神经网络嵌入纹理难以修改的问题,UV-Attack生成UV图而非RGB图,直接编辑纹理堆栈,支持实时修改。同时引入期望姿态变换损失(EoPT),提升对未见姿态和视角的逃避成功率。实验显示,在动态视频设置下,对FastRCNN的攻击成功率达92.7%,显著优于当前最优方法AdvCamou的28.5%;在黑盒设置下对YOLOv8仍达到49.5%的攻击成功率。代码已开源。

原文摘要 · Abstract (English)

In recent research, adversarial attacks on person detectors using patches or static 3D model-based texture modifications have struggled with low success rates due to the flexible nature of human movement. Modeling the 3D deformations caused by various actions has been a major challenge. Fortunately, advancements in Neural Radiance Fields (NeRF) for dynamic human modeling offer new possibilities. In this paper, we introduce UV-Attack, a groundbreaking approach that achieves high success rates even with extensive and unseen human actions. We address the challenge above by leveraging dynamic-NeRF-based UV mapping. UV-Attack can generate human images across diverse actions and viewpoints, and even create novel actions by sampling from the SMPL parameter space. While dynamic NeRF models are capable of modeling human bodies, modifying clothing textures is challenging because they are embedded in neural network parameters. To tackle this, UV-Attack generates UV maps instead of RGB images and modifies the texture stacks. This approach enables real-time texture edits and makes the attack more practical. We also propose a novel Expectation over Pose Transformation loss (EoPT) to improve the evasion success rate on unseen poses and views. Our experiments show that UV-Attack achieves a 92.7% attack success rate against the FastRCNN model across varied poses in dynamic video settings, significantly outperforming the state-of-the-art AdvCamou attack, which only had a 28.5% ASR. Moreover, we achieve 49.5% ASR on the latest YOLOv8 detector in black-box settings. This work highlights the potential of dynamic NeRF-based UV mapping for creating more effective adversarial attacks on person detectors, addressing key challenges in modeling human movement and texture modification. The code is available at https://github.com/PolyLiYJ/UV-Attack.

对抗攻击动态NeRF行人检测物理攻击

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。