arXiv:2504.09361cs.CV2025-04ECCV被引 7

提出可物理部署的对抗补丁,扰乱多目标跟踪系统

PapMOT: Exploring Adversarial Patch Attack against Multiple Object Tracking

  • 生成可打印的对抗补丁,干扰检测与身份关联
  • 使跟踪结果在时间上不一致,攻击更剧烈
  • 支持数字与真实场景攻击,适用于多种追踪器

连续视频流中的多目标跟踪对众多计算机视觉任务至关重要,涉及跨帧检测与身份关联。尽管多目标跟踪(MOT)取得显著进展,但近期研究揭示现有方法对对抗攻击存在脆弱性。然而,现有攻击均为注入像素级噪声的数字攻击,在物理场景中无效。为此,我们提出PapMOT,可生成针对MOT的物理对抗补丁,适用于数字与物理场景。PapMOT不仅干扰检测机制,还优化可打印补丁,使其被误检为新目标,从而误导身份关联过程。此外,引入补丁增强策略,进一步破坏视频帧间跟踪结果的时间一致性,实现更激进的攻击。我们还设计了新的评估指标,以衡量MOT对这类攻击的鲁棒性。在多个数据集上的大量实验表明,PapMOT可在数字场景中成功攻击多种MOT追踪器架构。通过在真实世界中部署打印的对抗补丁,我们验证了其在物理攻击中的有效性。

原文摘要 · Abstract (English)

Tracking multiple objects in a continuous video stream is crucial for many computer vision tasks. It involves detecting and associating objects with their respective identities across successive frames. Despite significant progress made in multiple object tracking (MOT), recent studies have revealed the vulnerability of existing MOT methods to adversarial attacks. Nevertheless, all of these attacks belong to digital attacks that inject pixel-level noise into input images, and are therefore ineffective in physical scenarios. To fill this gap, we propose PapMOT, which can generate physical adversarial patches against MOT for both digital and physical scenarios. Besides attacking the detection mechanism, PapMOT also optimizes a printable patch that can be detected as new targets to mislead the identity association process. Moreover, we introduce a patch enhancement strategy to further degrade the temporal consistency of tracking results across video frames, resulting in more aggressive attacks. We further develop new evaluation metrics to assess the robustness of MOT against such attacks. Extensive evaluations on multiple datasets demonstrate that our PapMOT can successfully attack various architectures of MOT trackers in digital scenarios. We also validate the effectiveness of PapMOT for physical attacks by deploying printed adversarial patches in the real world.

多目标跟踪对抗攻击物理攻击补丁攻击

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。