arXiv:2505.16402cs.CV2025-05被引 13

提出物理对抗补丁生成框架,提升目标检测系统安全评估有效性

AdvReal: Physical Adversarial Patch Generation Framework for Security Evaluation of Object Detection Systems

  • 联合优化2D纹理与3D网格,增强对抗样本真实感与多样性
  • 物理场景下攻击成功率70.13%,多视角下超90%保持稳定
  • 适合自动驾驶安全测试、对抗样本防御研究者使用

自动驾驶作为以人工智能为核心的复杂智能系统,其基于深度学习的感知方法极易受到对抗样本攻击,引发安全隐患。如何在真实世界中生成有效对抗样本并评估目标检测系统,仍是巨大挑战。本文提出一种统一的2D与3D联合对抗训练框架,同时优化2D图像纹理图与3D网格空间中的纹理,以应对类别内差异与真实环境变化。框架包含新颖的现实增强对抗模块,通过时空映射与再光照流水线,实现对抗补丁与目标服装在不同视角下的光照一致性。进一步构建非刚性形变建模与纹理重映射机制,确保3D场景中与人体非刚性表面的对齐。大量数字与物理实验表明,所生成的对抗纹理能有效误导目标检测模型。具体而言,本方法在物理场景下对YOLOv12的平均攻击成功率达70.13%,显著优于T-SEA(21.65%)和AdvTexture(19.70%)。且在4米距离下,正面与斜视视角平均攻击成功率均超过90%,验证了方法在多角度、光照变化及实际距离下的强鲁棒性与可迁移性。演示视频与代码见:https://github.com/Huangyh98/AdvReal.git。

原文摘要 · Abstract (English)

Autonomous vehicles are typical complex intelligent systems with artificial intelligence at their core. However, perception methods based on deep learning are extremely vulnerable to adversarial samples, resulting in security accidents. How to generate effective adversarial examples in the physical world and evaluate object detection systems is a huge challenge. In this study, we propose a unified joint adversarial training framework for both 2D and 3D domains, which simultaneously optimizes texture maps in 2D image and 3D mesh spaces to better address intra-class diversity and real-world environmental variations. The framework includes a novel realistic enhanced adversarial module, with time-space and relighting mapping pipeline that adjusts illumination consistency between adversarial patches and target garments under varied viewpoints. Building upon this, we develop a realism enhancement mechanism that incorporates non-rigid deformation modeling and texture remapping to ensure alignment with the human body's non-rigid surfaces in 3D scenes. Extensive experiment results in digital and physical environments demonstrate that the adversarial textures generated by our method can effectively mislead the target detection model. Specifically, our method achieves an average attack success rate (ASR) of 70.13% on YOLOv12 in physical scenarios, significantly outperforming existing methods such as T-SEA (21.65%) and AdvTexture (19.70%). Moreover, the proposed method maintains stable ASR across multiple viewpoints and distances, with an average attack success rate exceeding 90% under both frontal and oblique views at a distance of 4 meters. This confirms the method's strong robustness and transferability under multi-angle attacks, varying lighting conditions, and real-world distances. The demo video and code can be obtained at https://github.com/Huangyh98/AdvReal.git.

对抗攻击目标检测物理安全3D生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。